CN111586384A - Projection image geometric correction method based on Bessel curved surface - Google Patents

Projection image geometric correction method based on Bessel curved surface Download PDF

Info

Publication number
CN111586384A
CN111586384A CN202010477837.0A CN202010477837A CN111586384A CN 111586384 A CN111586384 A CN 111586384A CN 202010477837 A CN202010477837 A CN 202010477837A CN 111586384 A CN111586384 A CN 111586384A
Authority
CN
China
Prior art keywords
image
projection
geometric correction
distortion
geometric
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010477837.0A
Other languages
Chinese (zh)
Other versions
CN111586384B (en
Inventor
侯培国
祁继辉
宋涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yanshan University
Original Assignee
Yanshan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yanshan University filed Critical Yanshan University
Priority to CN202010477837.0A priority Critical patent/CN111586384B/en
Publication of CN111586384A publication Critical patent/CN111586384A/en
Application granted granted Critical
Publication of CN111586384B publication Critical patent/CN111586384B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179Video signal processing therefor
    • H04N9/3185Geometric adjustment, e.g. keystone or convergence

Landscapes

  • Physics & Mathematics (AREA)
  • Geometry (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Transforming Electric Information Into Light Information (AREA)
  • Projection Apparatus (AREA)

Abstract

The invention discloses a projection image geometric correction method based on a Bessel curved surface, which belongs to the technical field of virtual reality projection image processing and comprises the steps of 1) collecting distorted projection images which are not subjected to geometric correction by a camera, and establishing a coordinate conversion model of a projection coordinate space and a camera coordinate space through a bicubic Bessel curved surface; 2) making uniform marking points in an ideal area of a screen space and carrying out geometric correction; 3) performing local geometric pre-distortion on the detected screen space pixel offset area; 4) and carrying out Bessel surface pre-distortion on the original image by the obtained coordinate conversion model, eliminating the overall geometric distortion of the projection picture and finishing geometric correction. The invention adopts a Bezier curved surface model to establish the conversion relation of different coordinate space characteristic points, and then carries out error compensation on the area with larger pixel deviation by using an image local Bezier curved surface distortion algorithm.

Description

Projection image geometric correction method based on Bessel curved surface
Technical Field
The invention belongs to the technical field of virtual reality projection image processing, and particularly relates to a projection image geometric correction method based on a Bessel curved surface.
Background
The virtual reality technology is a computer technology which is started at the end of the 20 th century, and enables a user to observe scenes and objects in a three-dimensional space in real time without limitation and immerse the scenes and the objects in a simulation environment. Along with the development of the times, people require more and more to the virtual world, wear VR glasses and can influence the real experience sense, consequently, bore hole virtual reality technique can provide a better VR for people and experience, and multichannel projection concatenation technique is on virtual picture projection wall around, and the user need not wear any auxiliary device when experiencing this technique and using, just can immerse in the picture and have the impression of being personally on the scene. However, in practical applications, due to a series of factors such as the placement of the projectors being inclined or the models of the projectors being different, the projection pictures on the projection screen inevitably have geometric distortion, so that the projection pictures cannot be aligned with each other. At present, many projection image geometric correction methods exist, wherein a bezier curved surface model is typical and is suitable for projection images in various shapes, but one control point of the bezier curved surface is changed to affect each pixel point of the whole image, so that local geometric error compensation is difficult to perform on the image.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a projection image geometric correction method based on a Bezier curved surface, which is characterized in that a transformation relation of different coordinate space characteristic points is established by adopting a Bezier curved surface model, and an area with larger pixel deviation is subjected to error compensation by an image local Bezier curved surface warping algorithm.
In order to solve the technical problems, the technical scheme adopted by the invention is as follows:
a projection image geometric correction method based on Bessel curved surface includes the following steps:
step 1) acquiring a distorted projection picture without geometric correction by using a camera, and establishing a coordinate conversion model of a projection coordinate space and a camera coordinate space by using a bicubic Bessel curved surface;
step 2) making uniform marking points in an ideal area of a screen space and carrying out geometric correction;
step 3) local geometric pre-distortion is carried out on the detected screen space pixel offset area;
and 4) carrying out Bezier curved surface pre-distortion on the original image by the coordinate conversion model obtained in the step 4), eliminating the overall geometric distortion of the projection picture and finishing geometric correction.
The technical scheme of the invention is further improved as follows: in the step 1), the projection picture in the coordinate space is taken as an image before transformation, the projection image in the projection coordinate space is taken as an image after transformation, in the step 2), the original image in the image coordinate space is taken as an image before transformation, and the point set of the ideal area in the screen space is taken as an image after transformation, so that the coordinate conversion model obtained in the step 4) has no reverse Bezier curve operation.
The technical scheme of the invention is further improved as follows: in the step 4), the coordinate conversion models obtained in the step 2) and the step 1) are fused into one-step Bessel surface transformation.
The technical scheme of the invention is further improved as follows: in the step 3), when local geometric pre-distortion is performed on the pixel region corresponding to the image, four edges of the region are fixed through the control points.
Due to the adoption of the technical scheme, the invention has the technical progress that:
the invention provides a projection image geometric correction method based on a Bezier curve, which comprises the steps of 1) shooting a projection picture in a coordinate space as an image before transformation, projecting a projection image in the coordinate space as an image after transformation, and in step 2), taking an original image in the image coordinate space as an image before transformation and taking a point set of an ideal area in a screen space as an image after transformation, so that a coordinate conversion model obtained in step 4) has no reverse Bezier curve operation, thereby reducing the complexity of a mathematical expression.
The invention provides a projection image geometric correction method based on a Bezier curved surface, wherein in the step 4), the coordinate conversion models obtained in the step 2) and the step 1) are fused into one step of Bezier curved surface transformation, so that edge sawteeth after image distortion are reduced.
According to the projection image geometric correction method based on the Bessel curved surface, provided by the invention, in the step 3), when local geometric pre-distortion is carried out on a pixel region corresponding to an image, the continuity and the integrity of the whole image are ensured by fixing four edges of the region through control points.
Drawings
FIG. 1 is an overall flow chart of a projection image geometric correction method based on a Bezier curved surface provided by the invention;
FIG. 2 is an original image before projection provided by the present invention;
FIG. 3 is a two-channel projection display image without geometric correction provided by the present invention;
FIG. 4 is a two-channel projection display image after geometric correction as provided by the present invention;
FIG. 5 is a two-channel projection display image after geometric error compensation provided by the present invention;
FIG. 6 is an effect diagram of the CAVE immersive system provided by the present invention.
Detailed Description
The invention is described in further detail below with reference to the following figures and examples:
the invention relates to a projection image geometric correction method based on a Bezier curved surface, which adopts a Bezier curved surface model to establish the conversion relation of different coordinate space characteristic points and carries out error compensation on a region with larger pixel offset by an image local Bezier curved surface warping algorithm.
As shown in fig. 1 to 5, the device comprises the steps of 1) collecting distorted projection pictures without geometric correction by a camera, and establishing a coordinate conversion model of a projection coordinate space and a camera coordinate space by a bicubic bezier surface;
step 2) making uniform marking points in an ideal area of a screen space and carrying out geometric correction;
step 3) local geometric pre-distortion is carried out on the detected screen space pixel offset area;
and 4) carrying out Bezier curved surface pre-distortion on the original image by the coordinate conversion model obtained in the step 4), eliminating the overall geometric distortion of the projection picture and finishing geometric correction.
In the embodiment provided by the invention, the projection picture in the image coordinate space is taken as an image before transformation in the step 1), the projection image in the projection coordinate space is taken as an image after transformation, in the step 2), the original image in the image coordinate space is taken as an image before transformation, the point set of the ideal area in the screen space is taken as an image after transformation, so that the coordinate transformation model obtained in the step 4) has no reverse Bessel surface operation, the complexity of the mathematical expression is reduced, the algorithm is simplified, and the error rate is reduced.
Further, in the step 4), the coordinate conversion models obtained in the step 2) and the step 1) are fused into one-step Bessel surface transformation, so that edge sawteeth after image distortion are reduced, and the picture adjustment step is simpler and more convenient.
Further, in step 3), when local geometric pre-distortion is performed on the pixel region corresponding to the image, the four edges of the region are fixed by the control points to ensure the continuity and integrity of the whole image and improve the adjustment efficiency.
Specifically, in the embodiment provided by the present invention, the method for geometrically correcting a projection image based on a bezier surface disclosed by the present invention provides a method for recognizing an image by using OpenCV on a Windows operating system of a CAVE immersion system shown in fig. 6, and distorting the image by using OpenGL, and the specific implementation manner includes the following steps: step 1) projecting regular rectangular chessboard grids serving as original images of a projection coordinate space to a projection screen, collecting projection chessboard grid images on the projection screen to a shooting coordinate space by a camera, taking grid corner points as feature points, and establishing a matching relation between the projection coordinate space and corresponding feature points of the shooting coordinate space through a bicubic Bessel curved surface, wherein the following formula is shown:
PP=C(PC)·pC→P
wherein, PCThe coordinate set of the camera shooting space characteristic points is obtained; c (P)C) A Bessel basis function set which is a coordinate of the shooting space characteristic point; p is a radical ofC→PConverting the camera space into a control point coordinate set of a projection space; pPA coordinate set of projection space characteristic points is obtained;
step 2) uniform marking points are made in an ideal area of a screen space, so that a computer can identify the marking points in a picture after the camera collects the marking points, and a coordinate conversion model of an image coordinate space and a camera coordinate space is established through a bicubic Bessel curved surface, wherein the following formula is shown:
PCS=C(PI)·pI→C
wherein, PIA point coordinate set which is uniformly distributed in an image space; c (P)I) A Bessel basis function set of point coordinates which are uniformly distributed in an image space; p is a radical ofI→CConverting the image space into a control point coordinate set of an ideal area in a shooting space; pCSA coordinate set of points uniformly distributed in an ideal area in a shooting space;
carrying out Bessel surface pre-distortion on the original image through the coordinate conversion model obtained in the steps 1) and 2), eliminating the overall geometric distortion of the projection picture, and completing geometric correction, as shown in the following formula:
PA=C(C(PB)·pI→C)·pC→P
wherein, PBSets of coordinate values, P, for all points of the original image before geometric pre-warpingASets of coordinate values for all points after geometric pre-warping of the original image.
The image has edge sawtooth after each pre-distortion, so that the edge sawtooth can be reduced by fusing two steps of Bessel surface distortion transformation into one step, and the obtained P is usedABack calculation control point pI→P(i.e., the set of control point coordinates that the image space is transformed into projection space) as shown by:
PA=C(PB)·pI→P
by pI→PPerforming geometric pre-distortion on an original image;
step 3), random errors can occur when marking is inevitably performed in step 2), and system errors can also be caused by the projection environment, the shooting angle of the camera and the self characteristics of the mark points, so that after the geometric correction is completed, the offset area of the pixel points in the screen space needs to be detected, and the coordinate space conversion relation between the distortion area in the projection screen space and the area corresponding to the original image is shown as the following formula:
PS′=CI′·pS→I
wherein, CI' Bessel basis function set, P, as coordinates of corresponding region of original imageSIs distortion in the screen spaceSet of coordinates of the region, pS→IAnd converting the distorted area of the projection screen space into a coordinate control point set of the corresponding area of the original image. Due to bicubic Bessel surface distortion, pS→IThere are 16 control points, wherein 12 control points on four sides of the region are constants to fix the region contour to ensure the continuity and integrity of the whole image, and the other 4 control points are used for pre-distorting the inside of the corresponding region of the original image to realize geometric error compensation;
step 4), performing local geometric pre-distortion on the pixel region corresponding to the image to reduce the pixel offset of the projection picture before performing overall geometric pre-distortion on the original image through the pixel offset region in the screen space detected in the step 3), as shown in the following formula:
Figure BDA0002516380670000061
wherein, P0The coordinate value set P of all the points before geometric pre-distortion outside the corresponding region of the original image KkThe coordinate value set of all points before geometric pre-distortion of the corresponding area at the kth position of the original image is represented by K which is more than or equal to 1 and less than or equal to K and PTSets of coordinate values for all points after geometric pre-warping of the original image. The invention provides a projection image geometric correction method based on a Bezier curve, which provides a scheme for compensating geometric errors of a pre-distorted original image by an image local Bezier curve distortion algorithm aiming at the problem of larger errors of a projection image geometric correction result fed back by a camera. Firstly, by solving the characteristic points of an original image of a projection space and a projection image of a shooting space, the corresponding relation between the projection space and the shooting space is deduced by utilizing a Bessel surface algorithm; secondly, deducing a corresponding relation of an ideal region of a shooting space and a feature point of an image space by utilizing a Bessel surface algorithm; pre-distorting the original image in the projection space through the two-step corresponding relation; and finally, measuring the error of the pre-distorted image projected to the projection screen, and performing geometric error compensation on the pre-distorted original image by using an image local Bessel curved surface distortion algorithm to reduce the error. The method of the invention is simple, the operation is easy,and additional technical equipment is not needed, so that the maintenance and the use of technicians are facilitated.
It should be understood that the above examples are only for clarity of illustration and are not intended to limit the embodiments. Other variations and modifications will be apparent to persons skilled in the art in light of the above description. And are neither required nor exhaustive of all embodiments. And obvious variations or modifications therefrom are intended to be within the scope of the invention.

Claims (4)

1. A projection image geometric correction method based on Bessel curved surface is characterized in that: the method comprises the following steps:
step 1) acquiring a distorted projection picture without geometric correction by using a camera, and establishing a coordinate conversion model of a projection coordinate space and a camera coordinate space by using a bicubic Bessel curved surface;
step 2) making uniform marking points in an ideal area of a screen space and carrying out geometric correction;
step 3) local geometric pre-distortion is carried out on the detected screen space pixel offset area;
and 4) carrying out Bezier curved surface pre-distortion on the original image by the coordinate conversion model obtained in the step 4), eliminating the overall geometric distortion of the projection picture and finishing geometric correction.
2. The Bezier surface-based projection image geometric correction method according to claim 1, characterized in that: in the step 1), the projection picture in the coordinate space is taken as an image before transformation, the projection image in the projection coordinate space is taken as an image after transformation, in the step 2), the original image in the image coordinate space is taken as an image before transformation, and the point set of the ideal area in the screen space is taken as an image after transformation, so that the coordinate conversion model obtained in the step 4) has no reverse Bezier curve operation.
3. The Bezier surface-based projection image geometric correction method according to claim 1, characterized in that: in the step 4), the coordinate conversion models obtained in the step 2) and the step 1) are fused into one-step Bessel surface transformation.
4. The Bezier surface-based projection image geometric correction method according to claim 1, characterized in that: in the step 3), when local geometric pre-distortion is performed on the pixel region corresponding to the image, four edges of the region are fixed through the control points.
CN202010477837.0A 2020-05-29 2020-05-29 Projection image geometric correction method based on Bessel curved surface Active CN111586384B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010477837.0A CN111586384B (en) 2020-05-29 2020-05-29 Projection image geometric correction method based on Bessel curved surface

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010477837.0A CN111586384B (en) 2020-05-29 2020-05-29 Projection image geometric correction method based on Bessel curved surface

Publications (2)

Publication Number Publication Date
CN111586384A true CN111586384A (en) 2020-08-25
CN111586384B CN111586384B (en) 2022-02-11

Family

ID=72112364

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010477837.0A Active CN111586384B (en) 2020-05-29 2020-05-29 Projection image geometric correction method based on Bessel curved surface

Country Status (1)

Country Link
CN (1) CN111586384B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112330556A (en) * 2020-11-03 2021-02-05 燕山大学 Spherical screen projection geometric correction method based on rational Bessel curved surface
CN112738491A (en) * 2020-12-29 2021-04-30 视田科技(天津)有限公司 Correction method of projection reflection picture
CN113205584A (en) * 2021-04-16 2021-08-03 北京航空航天大学 Multi-view projection method based on Bezier curve
CN114331814A (en) * 2021-12-24 2022-04-12 合肥视涯技术有限公司 Distorted picture correction method and display equipment
WO2022134550A1 (en) * 2020-12-21 2022-06-30 成都极米科技股份有限公司 Adjustment curve calculation and adjustment method, system and apparatus for projected image, and medium
CN115086625A (en) * 2022-05-12 2022-09-20 峰米(重庆)创新科技有限公司 Correction method, device and system of projection picture, correction equipment and projection equipment

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130128057A1 (en) * 2011-11-17 2013-05-23 National University of Sciences & Technology Geometric correction apparatus and method based on recursive bezier patch sub-division cross-reference to related application
CN104020925A (en) * 2014-05-30 2014-09-03 深圳市创凯电子有限公司 Projection method and device
CN104778658A (en) * 2015-04-01 2015-07-15 北京理工大学 Full-automatic geometric mosaic correction method for images projected by multiple projectors
US20160142588A1 (en) * 2014-11-19 2016-05-19 Kabushiki Kaisha Toshiba Image processor, image display device, and image processing method
US20160163068A1 (en) * 2014-12-09 2016-06-09 Canon Kabushiki Kaisha Information processing apparatus, method of estimating curve, and image processing apparatus and method
CN106683057A (en) * 2016-12-23 2017-05-17 中国计量大学 Method for automatically geometrically correcting multi-projection display walls with optional continuous screens with curved surfaces
CN107862649A (en) * 2017-10-11 2018-03-30 中铁第四勘察设计院集团有限公司 A kind of GPU based on emulation visual system accelerates Multichannel fusion method and system
CN108227348A (en) * 2018-01-24 2018-06-29 长春华懋科技有限公司 Geometric distortion auto-correction method based on high-precision vision holder
CN111192552A (en) * 2019-12-13 2020-05-22 南京乐飞航空技术有限公司 Multi-channel LED spherical screen geometric correction method

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130128057A1 (en) * 2011-11-17 2013-05-23 National University of Sciences & Technology Geometric correction apparatus and method based on recursive bezier patch sub-division cross-reference to related application
CN104020925A (en) * 2014-05-30 2014-09-03 深圳市创凯电子有限公司 Projection method and device
US20160142588A1 (en) * 2014-11-19 2016-05-19 Kabushiki Kaisha Toshiba Image processor, image display device, and image processing method
US20160163068A1 (en) * 2014-12-09 2016-06-09 Canon Kabushiki Kaisha Information processing apparatus, method of estimating curve, and image processing apparatus and method
CN104778658A (en) * 2015-04-01 2015-07-15 北京理工大学 Full-automatic geometric mosaic correction method for images projected by multiple projectors
CN106683057A (en) * 2016-12-23 2017-05-17 中国计量大学 Method for automatically geometrically correcting multi-projection display walls with optional continuous screens with curved surfaces
CN107862649A (en) * 2017-10-11 2018-03-30 中铁第四勘察设计院集团有限公司 A kind of GPU based on emulation visual system accelerates Multichannel fusion method and system
CN108227348A (en) * 2018-01-24 2018-06-29 长春华懋科技有限公司 Geometric distortion auto-correction method based on high-precision vision holder
CN111192552A (en) * 2019-12-13 2020-05-22 南京乐飞航空技术有限公司 Multi-channel LED spherical screen geometric correction method

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
曾鸿,张均东著: "《船舶机电系统虚拟仿真研究》", 30 June 2015, 哈尔滨:哈尔滨工程大学出版社 *
曾鸿等: "快速多投影画面几何校正与边缘融合方法 ", 《计算机工程与设计》 *
李松江等: "不同拍摄条件下多投影图像几何校正方法 ", 《计算机应用》 *
薛雅婷: "多通道曲面投影技术研究", 《中国优秀硕士学位论文全文数据库(电子期刊)信息科技辑》 *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112330556A (en) * 2020-11-03 2021-02-05 燕山大学 Spherical screen projection geometric correction method based on rational Bessel curved surface
CN112330556B (en) * 2020-11-03 2022-04-19 燕山大学 Spherical screen projection geometric correction method based on rational Bessel curved surface
WO2022134550A1 (en) * 2020-12-21 2022-06-30 成都极米科技股份有限公司 Adjustment curve calculation and adjustment method, system and apparatus for projected image, and medium
CN112738491A (en) * 2020-12-29 2021-04-30 视田科技(天津)有限公司 Correction method of projection reflection picture
CN113205584A (en) * 2021-04-16 2021-08-03 北京航空航天大学 Multi-view projection method based on Bezier curve
CN113205584B (en) * 2021-04-16 2022-04-26 北京航空航天大学 Multi-view projection method based on Bezier curve
CN114331814A (en) * 2021-12-24 2022-04-12 合肥视涯技术有限公司 Distorted picture correction method and display equipment
CN115086625A (en) * 2022-05-12 2022-09-20 峰米(重庆)创新科技有限公司 Correction method, device and system of projection picture, correction equipment and projection equipment
CN115086625B (en) * 2022-05-12 2024-03-15 峰米(重庆)创新科技有限公司 Correction method, device and system for projection picture, correction equipment and projection equipment

Also Published As

Publication number Publication date
CN111586384B (en) 2022-02-11

Similar Documents

Publication Publication Date Title
CN111586384B (en) Projection image geometric correction method based on Bessel curved surface
JP2022528659A (en) Projector keystone correction methods, devices, systems and readable storage media
Wei et al. Fisheye video correction
CN110458932B (en) Image processing method, device, system, storage medium and image scanning apparatus
CN101572787B (en) Computer vision precision measurement based multi-projection visual automatic geometric correction and splicing method
CN111586385B (en) Projected image color correction method based on B spline curve
CN112734860B (en) Arc-screen prior information-based pixel-by-pixel mapping projection geometric correction method
KR20130054868A (en) Geometric correction apparatus and method based on recursive bezier patch sub-division
CN108377371A (en) A kind of method and device of projection image correction
CN107610183B (en) Calibration method of fringe projection phase height conversion mapping model
CN108550157B (en) Non-shielding processing method for teaching blackboard writing
CN112312106B (en) Projected image color correction method based on color space conversion
CN112734890A (en) Human face replacement method and device based on three-dimensional reconstruction
CN104079907B (en) Projector, image correcting method
CN111062869A (en) Curved screen-oriented multi-channel correction splicing method
CN108198222B (en) Wide-angle lens calibration and image correction method
CN101729739A (en) Method for rectifying deviation of image
CN109587463A (en) Calibration method, projector and the calibration system of projector
CN116152121A (en) Curved surface screen generating method and correcting method based on distortion parameters
KR101139101B1 (en) Method for calibrating image distortion and apparatus thereof
KR20100001608A (en) Apparatus and method for correcting lens distortion
CN116563460A (en) Three-dimensional reconstruction optimization method and device, medium and equipment
CN106485648A (en) Image acquisition device with correction function and correction method of image acquisition device
JP2005234698A (en) Distortion parameter generation method, video generation method, distortion parameter generation system and video generation system
CN111901578B (en) Multi-channel cave type projection method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant