CN111006610A - Underwater three-dimensional measurement data correction method based on structured light three-dimensional measurement - Google Patents
Underwater three-dimensional measurement data correction method based on structured light three-dimensional measurement Download PDFInfo
- Publication number
- CN111006610A CN111006610A CN201911278875.7A CN201911278875A CN111006610A CN 111006610 A CN111006610 A CN 111006610A CN 201911278875 A CN201911278875 A CN 201911278875A CN 111006610 A CN111006610 A CN 111006610A
- Authority
- CN
- China
- Prior art keywords
- structured light
- dimensional measurement
- underwater
- dimensional
- measurement data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
- G01B11/2504—Calibration devices
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
The invention discloses an underwater three-dimensional measurement data correction method based on structured light three-dimensional measurement, and a measurement device utilized by the correction method comprises a structured light three-dimensional measurement probe (1), a sealed cabin (2), sealed glass (3), a control processing system (4), an image acquisition module (5) of the structured light three-dimensional measurement probe and a laser projector (6) of the structured light three-dimensional measurement probe. The correction method comprises the following steps: placing a measuring probe at a proper position in front of an underwater target to be measured, and starting a control processing system to obtain erroneous measuring data; and calculating the corrected accurate data according to a formula, and displaying the corrected accurate data in real time. When the correction method is used for measuring the underwater object to be measured, complicated work such as calibration and the like under water is not needed, the method fully considers the influence of the sealing glass and the water medium on the measurement result, establishes a data correction formula and can realize accurate measurement of the underwater object to be measured.
Description
Technical Field
The invention belongs to the field of optical precision measurement, and particularly relates to an underwater three-dimensional measurement data correction method based on structured light three-dimensional measurement.
Background
Different from the underwater imaging, in addition to image degradation caused by absorption and scattering of water, more importantly, light rays corresponding to each scene point underwater pass through various media with different refractive indexes, namely 'water-glass window-air' in the process of propagation, so that the underwater image is deformed, data acquired by a three-dimensional measuring instrument based on linear structured light when the three-dimensional measuring instrument performs three-dimensional measurement on an underwater target is inaccurate, and the three-dimensional size of the underwater target object cannot be really reduced. In order to improve the accuracy of underwater measurement data based on structured light three-dimensional measurement, a camera is mainly calibrated underwater or a three-dimensional measuring instrument based on structured light is calibrated underwater at present, but the method usually ignores the thickness of a glass window to cause poor measurement accuracy, and in addition, the method needs to be calibrated underwater, so that the operation is very inconvenient.
Disclosure of Invention
The invention aims to overcome the defects and provides an underwater three-dimensional measurement data correction method based on structured light three-dimensional measurement.
The technical scheme adopted by the invention is as follows: a method for correcting underwater three-dimensional measurement data based on structured light three-dimensional measurement comprises the following steps:
A. the structured light three-dimensional measuring probe is sealed through a sealing cabin body and sealing glass;
B. placing the sealed structured light three-dimensional measuring probe at a proper position in front of an underwater target object to be measured, and displaying target object measurement data L1 by a control processing system;
C. due to the influence of ' water-glass ' interface refraction and the influence of ' glass-air ' interface refraction, the acquired measurement data L1 is not a true value, and the true distance L between the target object and the structured light three-dimensional measurement probe can be calculated through Snell's law and the geometric relationship.
The concrete method of the step C comprises the following steps: setting the incident angle of the optical path passing through when the point A on the target object is imaged to the image acquisition module of the structured light three-dimensional measurement probe and the optical path is transmitted to the sealing glass as IwAn exit angle of IgThe incident angle when the sealing glass propagates to the air in the cabin is IgAn exit angle of IaRefractive index of water nwThe refractive index of the sealing glass is ngThe refractive index of the air in the sealed cabin is naFrom Snell's law, the formula can be derived:
nasin(Ia)=ngsin(Ig)=nwsin(Iw)
the virtual image formed by the light path and the laser plane are intersected at the point A', the known point F is the focus of an image acquisition module of the structured light three-dimensional measuring probe, the point O is the light emitting point of a laser projector of the structured light three-dimensional measuring probe, the baseline distance of the structured light three-dimensional measuring probe is H, the distance between the baseline and the sealing glass interface is s, and the thickness of the sealing glass is d. From the similar triangles, the angle I can be calculatedaThe value of (c):
further, the method can be obtained as follows:
the deviation between the real distance L and the measurement data L1 is Δ, which can be obtained from the geometric relationship as the sum of the deviation Δ 1 and the deviation Δ 2, where the deviation Δ 1 is the deviation caused by the sealing glass, and the deviation Δ 2 is the deviation caused by the aqueous medium.
L=L1+Δ
Δ=Δ1+Δ2
From the parallel plate imaging characteristics, the value of the offset Δ 1 can be calculated:
the offset Δ 2 can be calculated according to a geometric relationship:
further, the relationship between the real distance L and the measurement data L1 can be established as follows:
by the formula, L1, H, s, d, na,ng,nwAnd substituting the known quantity into the formula to solve, so as to obtain the real measuring distance L.
The invention has the beneficial effects that: when the underwater three-dimensional measurement data correction method based on structured light three-dimensional measurement is used for measuring an underwater object to be measured, complicated work such as calibration and the like under water is not needed, the method fully considers the influence of sealing glass and water medium on a measurement result, establishes a data correction formula, and can realize accurate measurement of the underwater object to be measured.
Drawings
FIG. 1 is a schematic diagram of an apparatus for correcting underwater three-dimensional measurement data based on structured light three-dimensional measurement according to the present invention;
FIG. 2 is a block flow diagram of the method of the present invention;
FIG. 3 is a schematic diagram of the principle of an underwater three-dimensional measurement data correction method based on structured light three-dimensional measurement according to the present invention;
the reference numbers in the figures are: the device comprises a structured light three-dimensional measuring probe 1, a sealed cabin 2, a sealing glass 3, a control processing system 4, an image acquisition module of the structured light three-dimensional measuring probe 5 and a laser projector of the structured light three-dimensional measuring probe 6.
Detailed Description
The invention is further illustrated below with reference to specific examples and the accompanying drawings.
As shown in fig. 1, an apparatus of an underwater three-dimensional measurement data correction method based on structured light three-dimensional measurement includes: the device comprises a structured light three-dimensional measuring probe 1, a sealed cabin 2, sealed glass 3 and a control processing system 4, wherein the structured light three-dimensional measuring probe 1 mainly comprises an image acquisition module 5 of the structured light three-dimensional measuring probe and a laser projector 6 of the structured light three-dimensional measuring probe.
As shown in fig. 2, the method for correcting underwater three-dimensional measurement data based on structured light three-dimensional measurement includes the following steps:
A. the structured light three-dimensional measuring probe 1 is sealed by a sealing cabin 2 and a sealing glass 3;
in this embodiment, the laser projector 6 of the structured light three-dimensional measurement probe is a point laser (for convenience of description, a point laser may be selected, and a single line laser or a multi-line laser may be selected), and the laser light source is a blue laser (considering scattering and absorption of light propagating in water, a detection range may be increased by selecting a blue laser, and a green laser may also be selected).
B. Placing the sealed structured light three-dimensional measuring probe at a proper position in front of an underwater target object to be measured, and displaying target object measurement data L1 by the control processing system 4;
C. due to the influence of ' water-glass ' interface refraction and the influence of ' glass-air ' interface refraction, the acquired measurement data L1 is not a true value, and the true distance L between the target object and the structured light three-dimensional measurement probe can be calculated through Snell's law and the geometric relationship.
The concrete method of the step C comprises the following steps: as shown in fig. 3, an incident angle when an optical path passing through when the point a on the target object is imaged to the image acquisition module 5 of the structured light three-dimensional measurement probe is propagated to the sealing glass 3 by water is set as IwAn exit angle of IgThe incident angle when the air propagates from the sealing glass 3 to the inside of the sealed cabin 2 is IgAn exit angle of IaRefractive index of water nwSealing glass 3 having a refractive index ngThe refractive index of the air in the sealed cabin body 2 is naFrom Snell's law, the formula can be derived:
nasin(Ia)=ngsin(Ig)=nwsin(Iw)
the virtual image formed by the light path and the laser plane are intersected at a point A', a known point F is a focus of an image acquisition module 5 of the structured light three-dimensional measuring probe, a point O is a light emitting point of a laser projector 6 of the structured light three-dimensional measuring probe, the baseline distance of the structured light three-dimensional measuring probe 1 is H, the distance between the baseline and the interface of the sealing glass 3 is s, and the thickness of the sealing glass 3 is d. From the similar triangles, the value of angle Ia can be calculated:
further, the method can be obtained as follows:
the deviation between the actual distance L and the measurement data L1 is Δ, which can be obtained from the geometric relationship as the sum of the deviation Δ 1 and the deviation Δ 2, where the deviation Δ 1 is the deviation caused by the sealing glass 5, and the deviation Δ 2 is the deviation caused by the aqueous medium.
L=L1+Δ
Δ=Δ1+Δ2
From the parallel plate imaging characteristics, the value of the offset Δ 1 can be calculated:
the offset Δ 2 can be calculated according to a geometric relationship:
further, the relationship between the real distance L and the measurement data L1 can be established as follows:
by the formula, L1, H, s, d, na,ng,nwAnd substituting the known quantity into the formula to solve, so as to obtain the real measuring distance L.
It will be understood by those skilled in the art that the foregoing is only a preferred embodiment of the present invention, and is not intended to limit the invention, and that any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (2)
1. An underwater three-dimensional measurement data correction method based on structured light three-dimensional measurement is characterized in that: the method comprises the following steps:
A. the structured light three-dimensional measuring probe is sealed through a sealing cabin body and sealing glass;
B. placing the sealed structured light three-dimensional measuring probe at a proper position in front of an underwater target object to be measured, and displaying target object measurement data L1 by a control processing system;
C. due to the influence of ' water-glass ' interface refraction and the influence of ' glass-air ' interface refraction, the acquired measurement data L1 is not a true value, and the true distance L between the target object and the structured light three-dimensional measurement probe can be calculated through Snell's law and the geometric relationship.
2. The underwater three-dimensional measurement data correction method based on structured light three-dimensional measurement according to claim 1, characterized in that: the concrete method of the step C comprises the following steps: setting the incident angle of the optical path passing through when the point A on the target object is imaged to the image acquisition module of the structured light three-dimensional measurement probe and the optical path is transmitted to the sealing glass as IwAn exit angle of IgThe incident angle when the sealing glass propagates to the air in the cabin is IgAn exit angle of IaRefractive index of water nwThe refractive index of the sealing glass is ngThe refractive index of the air in the sealed cabin is naFrom Snell's law, the formula can be derived:
nasin(Ia)=ngsin(Ig)=nwsin(Iw)
the virtual image formed by the light path and the laser plane are intersected at the point A', the known point F is the focus of an image acquisition module of the structured light three-dimensional measuring probe, the point O is the light emitting point of a laser projector of the structured light three-dimensional measuring probe, the baseline distance of the structured light three-dimensional measuring probe is H, the distance between the baseline and a sealing glass interface is s, the thickness of the sealing glass is d, and the angle I can be calculated by a similar triangleaThe value of (c):
further, the method can be obtained as follows:
the deviation between the real distance L and the measurement data L1 is Δ, which can be obtained from the geometric relationship, and is the sum of the deviation amount Δ 1 and the deviation amount Δ 2, the deviation amount Δ 1 is the deviation caused by the sealing glass, the deviation amount Δ 2 is the deviation caused by the aqueous medium,
L=L1+Δ
Δ=Δ1+Δ2
from the parallel plate imaging characteristics, the value of the offset Δ 1 can be calculated:
the offset Δ 2 can be calculated according to a geometric relationship:
further, the relationship between the real distance L and the measurement data L1 can be established as follows:
by the formula, L1, H, s, d, na,ng,nwAnd substituting the known quantity into the formula to solve, so as to obtain the real measuring distance L.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911278875.7A CN111006610B (en) | 2019-12-13 | 2019-12-13 | Underwater three-dimensional measurement data correction method based on structured light three-dimensional measurement |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911278875.7A CN111006610B (en) | 2019-12-13 | 2019-12-13 | Underwater three-dimensional measurement data correction method based on structured light three-dimensional measurement |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111006610A true CN111006610A (en) | 2020-04-14 |
CN111006610B CN111006610B (en) | 2022-03-29 |
Family
ID=70114692
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201911278875.7A Active CN111006610B (en) | 2019-12-13 | 2019-12-13 | Underwater three-dimensional measurement data correction method based on structured light three-dimensional measurement |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111006610B (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111522019A (en) * | 2020-07-02 | 2020-08-11 | 中国地质大学(武汉) | Error correction method and device for underwater photon position |
CN112835062A (en) * | 2021-01-07 | 2021-05-25 | 深圳潜行创新科技有限公司 | Underwater distance measuring method, device, equipment and storage medium |
CN112946687A (en) * | 2021-01-22 | 2021-06-11 | 西北工业大学 | Image depth correction method for underwater imaging of TOF camera |
CN112945142A (en) * | 2021-02-02 | 2021-06-11 | 江西应用科技学院 | Object three-dimensional measurement system and method based on structured light |
CN113435050A (en) * | 2021-06-30 | 2021-09-24 | 同济大学 | Multi-medium imaging analysis method for underwater medium surface position compensation |
CN114234801A (en) * | 2021-12-02 | 2022-03-25 | 华侨大学 | Underwater three-dimensional automatic measurement system and method based on binocular vision |
CN116608823A (en) * | 2023-07-17 | 2023-08-18 | 中交第一航务工程局有限公司 | Underwater angle measurement device and underwater angle measurement method |
CN116817794A (en) * | 2023-06-27 | 2023-09-29 | 浙江大学 | Underwater high-precision three-dimensional imaging device and method based on structured light |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102269587A (en) * | 2010-11-02 | 2011-12-07 | 中国海洋大学 | Controlled light plane-based underwater three-dimensional redrawing device and method |
US20120200840A1 (en) * | 2008-12-08 | 2012-08-09 | Carl Embry | Continuous Index of Refraction Compensation Method for Measurements in a Medium |
CN103868455A (en) * | 2014-03-25 | 2014-06-18 | 大连理工大学 | Method for achieving visual reconstruction of space coordinates of target point in water tank |
CN103971406A (en) * | 2014-05-09 | 2014-08-06 | 青岛大学 | Underwater target three-dimensional reconstruction method based on line structured light |
JP2015105855A (en) * | 2013-11-29 | 2015-06-08 | 株式会社石井鐵工所 | Underwater detection device |
CN106952341A (en) * | 2017-03-27 | 2017-07-14 | 中国人民解放军国防科学技术大学 | The underwater scene three-dimensional point cloud method for reconstructing and its system of a kind of view-based access control model |
CN107507242A (en) * | 2017-08-16 | 2017-12-22 | 华中科技大学无锡研究院 | A kind of multilayer dioptric system imaging model construction method based on ligh field model |
CN109059873A (en) * | 2018-06-08 | 2018-12-21 | 上海大学 | Underwater 3 D reconstructing device and method based on light field multilayer refraction model |
CN109387488A (en) * | 2018-11-29 | 2019-02-26 | 中国科学院光电技术研究所 | A kind of method for fast measuring and instrument of optical glass refractive index |
CN109387160A (en) * | 2018-11-26 | 2019-02-26 | 中国科学院光电技术研究所 | Profiling object surface measuring device and method under a kind of nuclear radiation environment |
CN110763152A (en) * | 2019-10-09 | 2020-02-07 | 哈尔滨工程大学 | Underwater active rotation structure light three-dimensional vision measuring device and measuring method |
-
2019
- 2019-12-13 CN CN201911278875.7A patent/CN111006610B/en active Active
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120200840A1 (en) * | 2008-12-08 | 2012-08-09 | Carl Embry | Continuous Index of Refraction Compensation Method for Measurements in a Medium |
CN102269587A (en) * | 2010-11-02 | 2011-12-07 | 中国海洋大学 | Controlled light plane-based underwater three-dimensional redrawing device and method |
JP2015105855A (en) * | 2013-11-29 | 2015-06-08 | 株式会社石井鐵工所 | Underwater detection device |
CN103868455A (en) * | 2014-03-25 | 2014-06-18 | 大连理工大学 | Method for achieving visual reconstruction of space coordinates of target point in water tank |
CN103971406A (en) * | 2014-05-09 | 2014-08-06 | 青岛大学 | Underwater target three-dimensional reconstruction method based on line structured light |
CN106952341A (en) * | 2017-03-27 | 2017-07-14 | 中国人民解放军国防科学技术大学 | The underwater scene three-dimensional point cloud method for reconstructing and its system of a kind of view-based access control model |
CN107507242A (en) * | 2017-08-16 | 2017-12-22 | 华中科技大学无锡研究院 | A kind of multilayer dioptric system imaging model construction method based on ligh field model |
CN109059873A (en) * | 2018-06-08 | 2018-12-21 | 上海大学 | Underwater 3 D reconstructing device and method based on light field multilayer refraction model |
CN109387160A (en) * | 2018-11-26 | 2019-02-26 | 中国科学院光电技术研究所 | Profiling object surface measuring device and method under a kind of nuclear radiation environment |
CN109387488A (en) * | 2018-11-29 | 2019-02-26 | 中国科学院光电技术研究所 | A kind of method for fast measuring and instrument of optical glass refractive index |
CN110763152A (en) * | 2019-10-09 | 2020-02-07 | 哈尔滨工程大学 | Underwater active rotation structure light three-dimensional vision measuring device and measuring method |
Non-Patent Citations (3)
Title |
---|
吴康彪等: "基于线结构光视觉的燃料组件变形测量技术研究", 《计算机测量与控制》 * |
王从政等: "基于水下双目视觉的燃料组件变形检测系统", 《应用光学》 * |
解则晓等: "基于折射补偿的水下结构光三维测量系统", 《光电子·激光》 * |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111522019A (en) * | 2020-07-02 | 2020-08-11 | 中国地质大学(武汉) | Error correction method and device for underwater photon position |
CN112835062A (en) * | 2021-01-07 | 2021-05-25 | 深圳潜行创新科技有限公司 | Underwater distance measuring method, device, equipment and storage medium |
CN112946687A (en) * | 2021-01-22 | 2021-06-11 | 西北工业大学 | Image depth correction method for underwater imaging of TOF camera |
CN112945142A (en) * | 2021-02-02 | 2021-06-11 | 江西应用科技学院 | Object three-dimensional measurement system and method based on structured light |
CN112945142B (en) * | 2021-02-02 | 2022-12-06 | 江西应用科技学院 | Object three-dimensional measurement system and method based on structured light |
CN113435050A (en) * | 2021-06-30 | 2021-09-24 | 同济大学 | Multi-medium imaging analysis method for underwater medium surface position compensation |
CN114234801A (en) * | 2021-12-02 | 2022-03-25 | 华侨大学 | Underwater three-dimensional automatic measurement system and method based on binocular vision |
CN114234801B (en) * | 2021-12-02 | 2023-05-23 | 华侨大学 | Automatic underwater three-dimensional measurement system based on binocular vision |
CN116817794A (en) * | 2023-06-27 | 2023-09-29 | 浙江大学 | Underwater high-precision three-dimensional imaging device and method based on structured light |
CN116817794B (en) * | 2023-06-27 | 2024-02-13 | 浙江大学 | Underwater high-precision three-dimensional imaging device and method based on structured light |
CN116608823A (en) * | 2023-07-17 | 2023-08-18 | 中交第一航务工程局有限公司 | Underwater angle measurement device and underwater angle measurement method |
Also Published As
Publication number | Publication date |
---|---|
CN111006610B (en) | 2022-03-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111006610B (en) | Underwater three-dimensional measurement data correction method based on structured light three-dimensional measurement | |
CN102269587B (en) | Method for controlled light plane-based underwater three-dimensional redrawing device | |
CN105222849B (en) | A kind of volumetric glass volumetric measurement system and method | |
CN105043720A (en) | Single camera-based infrared filter refractive index measurement method | |
CN109490251A (en) | Underwater refractive index self-calibrating method based on light field multilayer refraction model | |
CN106932179A (en) | The method and device that off-axis paraboloidal mirror is measured off axis is demarcated based on grating scale and theodolite | |
CN103868455B (en) | A kind of optical rehabilitation tank internal object space of points sits calibration method | |
CN105333980A (en) | Tempered glass surface stress measuring instrument | |
CN108469531B (en) | Doppler effect-based double-correction type speed measurement sensor and calibration and measurement method | |
CN107607050A (en) | Laser thickness measuring apparatus | |
CN108844959B (en) | Method for measuring and correcting gas-liquid two-phase annular flow section phase content in circular tube | |
CN210720179U (en) | Rechecking camera focusing and ranging device and glass rechecking equipment | |
CN115018924A (en) | Method for calibrating key parameters of underwater camera | |
CN108871211B (en) | Method for measuring and correcting thickness of gas-liquid two-phase annular flow liquid film in circular tube | |
CN109151461B (en) | Method for testing angle deviation of focusing optical axis of high-precision tracking camera | |
CN109064517B (en) | Optical axis perpendicularity adjusting method and device | |
CN108646047A (en) | Based on tachogenerator of the Doppler effect with correcting principle and calibration and measurement method | |
CN105091797A (en) | Intensity correlated autocollimator for single-CCD | |
CN206019603U (en) | A kind of novel photoelectric school axle instrument | |
CN109799078B (en) | Collimator focal length measuring device and method using moire fringe amplification effect | |
CN208283418U (en) | Velocity sensor based on Doppler effect with correcting principle | |
CN209640614U (en) | The system for drawing optical antenna outgoing beam optical axis | |
CN112285059A (en) | Device for measuring liquid refractive index based on CCD method | |
CN114234801B (en) | Automatic underwater three-dimensional measurement system based on binocular vision | |
CN115508310A (en) | Liquid refractive index in-situ measuring instrument and method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |