CN108269229B - Pixel position distribution optimization method for panoramic image or video - Google Patents

Pixel position distribution optimization method for panoramic image or video Download PDF

Info

Publication number
CN108269229B
CN108269229B CN201611261410.7A CN201611261410A CN108269229B CN 108269229 B CN108269229 B CN 108269229B CN 201611261410 A CN201611261410 A CN 201611261410A CN 108269229 B CN108269229 B CN 108269229B
Authority
CN
China
Prior art keywords
row
pixel
spherical
latitude
spherical surface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201611261410.7A
Other languages
Chinese (zh)
Other versions
CN108269229A (en
Inventor
朱立松
熊智辉
贾非
张勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cntv Wuxi Co ltd
Original Assignee
Cntv Wuxi Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cntv Wuxi Co ltd filed Critical Cntv Wuxi Co ltd
Priority to CN201611261410.7A priority Critical patent/CN108269229B/en
Publication of CN108269229A publication Critical patent/CN108269229A/en
Application granted granted Critical
Publication of CN108269229B publication Critical patent/CN108269229B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G06T3/04
    • G06T3/073
    • G06T3/08
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • H04N21/4854End-user interface for client configuration for modifying image parameters, e.g. image brightness, contrast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8146Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics

Abstract

The invention discloses a pixel position distribution optimization method of a panoramic image or video, belonging to the technical field of computer multimedia information processing, which comprises the following specific steps: s1: using shooting equipment to obtain pixel values of Euclidean coordinate points (x, y, z) on the spherical surface, and storing the pixel values on a rectangular plane with pixel points; s2: deducing the latitude value of each row of pixel points on the spherical surface; s3: controlling the degree of concentration of pixels to the vicinity of the equator by using an S (beta) function; s4: the method and the device map the pixel points of the rectangular plane to the spherical surface for playing, so that the distribution of the pixel points of the spherical panoramic video on the spherical surface is more optimized, namely the pixel points near the equator of the spherical surface are denser, and the pixel points near the two poles of the spherical surface are sparser, and the method and the device are more in line with the watching habits of users.

Description

Pixel position distribution optimization method for panoramic image or video
Technical Field
The invention relates to the technical field of computer multimedia information processing, in particular to a pixel position distribution optimization method for a panoramic image or video.
Background
Panoramic video is a representation of Virtual Reality (VR) that presents a 720 ° scene to the viewer, giving the viewer an immersive viewing experience. At present, a panoramic video is usually in a spherical projection mode. When the spherical display equipment is available, the panoramic video adopting the spherical projection mode can be directly played on the spherical display equipment. When there is no spherical display device, only a flat display device, a compromise playing method may be used, i.e. it is assumed that the flat display device is a window through which the user can only see a part of the panoramic view. The user can control the view angle of the user in the panoramic view field by means of mouse dragging and the like.
On the other hand, panoramic video is still represented and stored in a rectangular plane mode, namely, a spherical surface is mapped into a rectangular plane when the panoramic video is manufactured. After the mapping from "sphere → moment" the image appears more severely distorted, however this distortion is desirable because it automatically disappears if the video is played on a sphere player. If the video is played through a "view-window panoramic player", the player will project a sub-area of the panoramic video onto the viewing plane according to the viewing angle selected by the user, which is called inverse distortion. After transformation, the density of the pixel points near the two poles of the spherical surface is higher, and the density of the pixel points near the equator of the spherical surface is lower. This situation is easy to understand because the pixel points at the upper edge of the rectangular plane are all mapped near the spherical north pole, and the pixel points at the lower edge of the rectangular plane are all mapped near the spherical south pole, which results in a high density of pixel points at the spherical poles and a low density of pixel points near the spherical equator. The unbalanced distribution of the pixel points on the spherical surface is just deviated from the viewing requirement of the spherical panoramic video, and the reason is that in most cases, users mainly view scenery near the equator in the spherical surface, the scenery located at the north pole of the spherical surface is generally sky or roof, and the scenery located at the south pole of the spherical surface is generally ground. Therefore, the imbalance of the distribution of the effective pixels causes less pixel points in the area which needs to be viewed by the user, and more pixel points in the area which does not need to be viewed by the user. For this reason, we propose a pixel position distribution optimization method of a panoramic image or video to be put into use to solve the above-mentioned problems.
Disclosure of Invention
The invention aims to provide a pixel position distribution optimization method for panoramic images or videos, and aims to solve the problems that pixel point distribution of spherical panoramic images/videos proposed in the background art is unbalanced, the pixel point density near two poles of a spherical surface is high, the pixel point density near the equator of the spherical surface is low, and the viewing requirements of users are not met.
In order to achieve the purpose, the invention provides the following technical scheme: a pixel position distribution optimization method for a panoramic image or a video comprises the following specific steps:
s1: when a panoramic video is manufactured, a shooting device is used for obtaining pixel values of Euclidean coordinate points (x, y, z) on a spherical surface, and the pixel values are stored on a rectangular plane with pixel points;
s2: deducing the latitude value of each row of pixel points on the spherical surface, and determining the specific position of the pixel row on the latitude;
s3: controlling the degree of concentration of pixels to the vicinity of the equator by using an S (beta) function;
s4: when the panoramic video is played, the pixel points of the rectangular plane are mapped to the spherical surface for playing.
Preferably, in the step S2, when the number of the pixel rows on the rectangular plane is odd, the row number is set to (…, -2, -1,0,1,2, …), and the latitude of the 0 th row is set to be (…, -2, -1,0,1,2, …)
α0=0
The latitude angle of row 1 is
Figure BDA0001199865000000031
The weft angle of the 2 nd row is
Figure BDA0001199865000000032
The latitude angle of the-1 st row is
Figure BDA0001199865000000033
The latitude angle of the-2 nd row is
Figure BDA0001199865000000034
When the number of rows of pixels in the moment plane is even, the row number is set to (…, -2, -1,1,2, …), and the latitude of the 1 st row is
Figure BDA0001199865000000035
The latitude of row 2 is
Figure BDA0001199865000000036
The latitude of line-1 is
Figure BDA0001199865000000037
The latitude of the-2 line is
Figure BDA0001199865000000041
Where c is the number of pixel columns and S is the control function.
Preferably, in step S3, any control function S (β) satisfying the following 4 conditions may be used as a function of the degree of concentration of the control pixel point to the vicinity of the equator of the sphere:
in an S (beta) function, the S (beta) is an increasing function when beta is greater than 0, and is a decreasing function when beta is less than 0;
⑵S(β)>0;
s (β) is a convex-down function with x ═ 0 as axis symmetry;
s (beta) should satisfy the condition
Figure BDA0001199865000000042
For a rectangular plane with R rows and c columns of pixel points, and assuming that the radius of the spherical surface is R, the area of the spherical surface is 4 pi R2The spherical area occupied by each row of pixels is
Figure BDA0001199865000000043
Will be provided with
Figure BDA0001199865000000044
Substitution into
Figure BDA0001199865000000045
To obtain
Figure BDA0001199865000000046
Represents the spherical area occupied by each row of pixels, and
Figure BDA0001199865000000047
and also represents the spherical area occupied by each column of pixel points.
Preferably, in step S4, if the coordinate of any point on the rectangular plane is (x, y), and the spherical coordinate corresponding to the point is (x, y, R), then the coordinate is (x, y, R)
Figure BDA0001199865000000048
Wherein R is the spherical radius, C is the number of pixel columns, the spherical coordinates (x, y, R) are transformed into Euclidean coordinates (x, y, z),
Figure BDA0001199865000000049
the coordinate origin is located at the center of a sphere, the x-axis direction is located right below the coordinate origin, the y-axis direction is located east, the z-axis direction is located right ahead, and the x ', y ' and z ' correspond to the positions of pixel points in three-dimensional coordinates.
Compared with the prior art, the invention has the beneficial effects that: according to the spherical panoramic video processing method, the distribution of the pixel points of the spherical panoramic video on the spherical surface is optimized, namely the pixel points near the equator of the spherical surface are dense, and the pixel points near the two poles of the spherical surface are sparse, so that the viewing habit of a user is met.
Drawings
FIG. 1 is a flow chart of the present invention;
FIG. 2 is a diagram of a spherical pixel distribution according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, the present invention provides a technical solution: a pixel position distribution optimization method for a panoramic image or a video comprises the following specific steps:
s1: when a panoramic video is manufactured, a shooting device is used for obtaining pixel values of Euclidean coordinate points (x, y, z) on a spherical surface, and the pixel values are stored on a rectangular plane with pixel points;
s2: deducing latitude value of each row of pixel points on the spherical surface, defining concrete position of pixel row on latitude, when the number of pixel point rows on the rectangular plane is odd, setting row number as (…, -2, -1,0,1,2, …), then latitude of 0 th row is
α0=0
The latitude angle of row 1 is
Figure BDA0001199865000000061
The weft angle of the 2 nd row is
Figure BDA0001199865000000062
The latitude angle of the-1 st row is
Figure BDA0001199865000000068
The latitude angle of the-2 nd row is
Figure BDA0001199865000000063
When the number of rows of pixels in the moment plane is even, the row number is set to (…, -2, -1,1,2, …), and the latitude of the 1 st row is
Figure BDA0001199865000000064
The latitude of row 2 is
Figure BDA0001199865000000065
The latitude of line-1 is
Figure BDA0001199865000000066
The latitude of the-2 line is
Figure BDA0001199865000000067
Where c is the number of pixel columns and S is the control function.
S3: referring to fig. 2, four adjacent pixel points ABCD are arbitrarily taken on the sphere, wherein the arcs of AB and CD are horizontal lines (actually arcs of a horizontal circle section) on the sphere, and the arcs of AC and BD are vertical lines (actually arcs of a vertical circle section) on the sphere. If the number of the pixel points on the unit spherical surface area is the same, one method is to make the spherical surface area enclosed by any four adjacent pixel points on the spherical surface equal, the spherical radius is R, A, B two points are positioned at the north latitude angle alpha, C, D two points are positioned at the north latitude angle beta, and c rows of pixel points are shared, then the spherical surface area enclosed by the ABCD is
Figure BDA0001199865000000071
After integration, the result is obtained
Figure BDA0001199865000000072
If the density of pixels near the equator of the sphere is required to be high, the sphereThe density of the pixel points near the two poles of the plane is low, that is, the spherical area S occupied by the unit pixel is required to be an increasing function of the dimension angle (north dimension, the spherical area S occupied by the unit pixel is required to be a decreasing function of the dimension angle if the dimension value of south dimension is negative), so that S in the formula is replaced by S (beta) to deduce
Figure BDA0001199865000000073
Or
Figure BDA0001199865000000074
From the above, any control function S (β) satisfying the following 4 conditions can be used as a function for controlling the concentration degree of the pixel points to the vicinity of the equator of the sphere:
in an S (beta) function, the S (beta) is an increasing function when beta is greater than 0, and is a decreasing function when beta is less than 0;
⑵S(β)>0;
s (β) is a convex-down function with x ═ 0 as axis symmetry;
s (beta) should satisfy the condition
Figure BDA0001199865000000075
For a rectangular plane with R rows and c columns of pixel points, and assuming that the radius of the spherical surface is R, the area of the spherical surface is 4 pi R2The spherical area occupied by each row of pixels is
Figure BDA0001199865000000081
Will be provided with
Figure BDA0001199865000000082
Substitution into
Figure BDA0001199865000000083
To obtain
Figure BDA0001199865000000084
Represents the spherical area occupied by each row of pixels, and
Figure BDA0001199865000000085
also showing each column imageThe spherical area occupied by the prime point, so the above equation holds;
s4: when the panoramic video is played, mapping the pixel points of the rectangular plane to the spherical surface for playing, wherein the coordinate of any point on the rectangular plane is (x, y), and the coordinate of the sphere corresponding to the point is (x, y, R), and then
Figure BDA0001199865000000086
Wherein R is the spherical radius, c is the number of pixel columns, the spherical coordinates (x, y, R) are transformed into Euclidean coordinates (x, y, z),
Figure BDA0001199865000000087
the coordinate origin is located at the center of a sphere, the x-axis direction is located right below the coordinate origin, the y-axis direction is located east, the z-axis direction is located right ahead, and the x ', y ' and z ' correspond to the positions of pixel points in three-dimensional coordinates.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.

Claims (2)

1. A pixel position distribution optimization method for a panoramic image or video is characterized by comprising the following steps: the pixel position distribution optimization method of the panoramic image or the video comprises the following specific steps:
s1: when a panoramic video is manufactured, a shooting device is used for obtaining pixel values of Euclidean coordinate points (x, y, z) on a spherical surface, and the pixel values are stored on a rectangular plane with pixel points;
s2: deducing latitude value of each row of pixel points on the spherical surface, defining concrete position of pixel row on latitude, when the number of pixel point rows on the rectangular plane is odd, setting row number as (…, -2, -1,0,1,2, …), then latitude of 0 th row is
α0=0
The latitude angle of row 1 is
Figure FDA0003003070610000011
The weft angle of the 2 nd row is
Figure FDA0003003070610000012
The latitude angle of the-1 st row is
Figure FDA0003003070610000013
The latitude angle of the-2 nd row is
Figure FDA0003003070610000014
When the number of rows of pixels in the moment plane is even, the row number is set to (…, -2, -1,1,2, …), and the latitude of the 1 st row is
Figure FDA0003003070610000015
The latitude of row 2 is
Figure FDA0003003070610000021
The latitude of line-1 is
Figure FDA0003003070610000022
The latitude of the-2 line is
Figure FDA0003003070610000023
Wherein c is the number of pixel columns and S is a control function;
s3: the S (beta) function is used for controlling the concentration degree of the pixels to the vicinity of the equator, and any control function S (beta) meeting the following 4 conditions can be used as a function for controlling the concentration degree of the pixels to the vicinity of the equator of the sphere:
in an S (beta) function, the S (beta) is an increasing function when beta is greater than 0, and is a decreasing function when beta is less than 0;
⑵S(β)>0;
s (β) is a convex-down function with x ═ 0 as axis symmetry;
s (beta) should satisfy the condition
Figure FDA0003003070610000024
For a rectangular plane with R rows and c columns of pixel points, and assuming that the radius of the spherical surface is R, the area of the spherical surface is 4 pi R2The spherical area occupied by each row of pixels is
Figure FDA0003003070610000025
Will be provided with
Figure FDA0003003070610000026
Substitution into
Figure FDA0003003070610000027
To obtain
Figure FDA0003003070610000028
Represents the spherical area occupied by each row of pixels, and
Figure FDA0003003070610000029
also represents the spherical area occupied by each row of pixel points, so the above equation is established;
s4: when the panoramic video is played, the pixel points of the rectangular plane are mapped to the spherical surface for playing.
2. The method of optimizing pixel location distribution of a panoramic image or video according to claim 1, wherein: in step S4, if the coordinate of any point on the rectangular plane is (x, y), the corresponding spherical coordinate is (x, y, R), and then
Figure FDA0003003070610000031
Wherein R is the spherical radius, c is the number of pixel columns, the spherical coordinates (x, y, R) are transformed into Euclidean coordinates (x, y, z),
Figure FDA0003003070610000032
the coordinate origin is located at the center of a sphere, the x-axis direction is located right below the coordinate origin, the y-axis direction is located east, the z-axis direction is located right ahead, and the x ', y ' and z ' correspond to the positions of pixel points in three-dimensional coordinates.
CN201611261410.7A 2016-12-30 2016-12-30 Pixel position distribution optimization method for panoramic image or video Active CN108269229B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611261410.7A CN108269229B (en) 2016-12-30 2016-12-30 Pixel position distribution optimization method for panoramic image or video

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611261410.7A CN108269229B (en) 2016-12-30 2016-12-30 Pixel position distribution optimization method for panoramic image or video

Publications (2)

Publication Number Publication Date
CN108269229A CN108269229A (en) 2018-07-10
CN108269229B true CN108269229B (en) 2021-08-06

Family

ID=62755028

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611261410.7A Active CN108269229B (en) 2016-12-30 2016-12-30 Pixel position distribution optimization method for panoramic image or video

Country Status (1)

Country Link
CN (1) CN108269229B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113483739B (en) * 2021-07-14 2022-05-13 中国科学院长春光学精密机械与物理研究所 Offshore target position measuring method

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101123722A (en) * 2007-09-25 2008-02-13 北京智安邦科技有限公司 Panorama video intelligent monitoring method and system
KR20120017901A (en) * 2010-08-20 2012-02-29 주식회사 유오케이 System and method of generating poi information
CN103020900A (en) * 2012-11-15 2013-04-03 北京小米科技有限责任公司 Method and device for image processing
CN103217221A (en) * 2013-03-22 2013-07-24 北京航空航天大学 Air-cooling condenser radiating surface temperature field measuring method based on image stitching
CN103402052A (en) * 2007-07-29 2013-11-20 奈米光子有限公司 Method and apparatus for obtaining panoramic and rectilinear images using rotationally symmetric wide-angle lens
CN103763479A (en) * 2013-12-31 2014-04-30 深圳英飞拓科技股份有限公司 Splicing device for real-time high speed high definition panoramic video and method thereof
CN104246795A (en) * 2012-03-01 2014-12-24 Geo半导体有限公司 Method and system for adaptive perspective correction of ultra wide-angle lens images
JP5676092B2 (en) * 2009-09-18 2015-02-25 株式会社ローラン Panorama image generation method and panorama image generation program
CN104700355A (en) * 2015-03-31 2015-06-10 百度在线网络技术(北京)有限公司 Generation method, device and system for indoor two-dimension plan
CN105809729A (en) * 2016-03-04 2016-07-27 深圳华强数码电影有限公司 Spherical panorama rendering method for virtual scene
CN106127691A (en) * 2016-07-12 2016-11-16 北京大学深圳研究生院 Panoramic picture mapping method

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101392978B1 (en) * 2014-02-04 2014-05-08 (주)나인정보시스템 Object labeling method and apparatus using hybrid parallel processing
CN104333675B (en) * 2014-10-20 2017-09-05 长春理工大学 A kind of panorama electronic image stabilization method based on spherical projection
CN105678693B (en) * 2016-01-25 2019-05-14 成都易瞳科技有限公司 Panoramic video browses playback method

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103402052A (en) * 2007-07-29 2013-11-20 奈米光子有限公司 Method and apparatus for obtaining panoramic and rectilinear images using rotationally symmetric wide-angle lens
CN101123722A (en) * 2007-09-25 2008-02-13 北京智安邦科技有限公司 Panorama video intelligent monitoring method and system
JP5676092B2 (en) * 2009-09-18 2015-02-25 株式会社ローラン Panorama image generation method and panorama image generation program
KR20120017901A (en) * 2010-08-20 2012-02-29 주식회사 유오케이 System and method of generating poi information
CN104246795A (en) * 2012-03-01 2014-12-24 Geo半导体有限公司 Method and system for adaptive perspective correction of ultra wide-angle lens images
CN103020900A (en) * 2012-11-15 2013-04-03 北京小米科技有限责任公司 Method and device for image processing
CN103217221A (en) * 2013-03-22 2013-07-24 北京航空航天大学 Air-cooling condenser radiating surface temperature field measuring method based on image stitching
CN103763479A (en) * 2013-12-31 2014-04-30 深圳英飞拓科技股份有限公司 Splicing device for real-time high speed high definition panoramic video and method thereof
CN104700355A (en) * 2015-03-31 2015-06-10 百度在线网络技术(北京)有限公司 Generation method, device and system for indoor two-dimension plan
CN105809729A (en) * 2016-03-04 2016-07-27 深圳华强数码电影有限公司 Spherical panorama rendering method for virtual scene
CN106127691A (en) * 2016-07-12 2016-11-16 北京大学深圳研究生院 Panoramic picture mapping method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于灰度累积评价的全景图像自动拼接算法;罗立宏 等;《兰州理工大学学报》;20070630;第33卷(第3期);第104-107页 *

Also Published As

Publication number Publication date
CN108269229A (en) 2018-07-10

Similar Documents

Publication Publication Date Title
US10957011B2 (en) System and method of capturing and rendering a stereoscopic panorama using a depth buffer
US10460459B2 (en) Stitching frames into a panoramic frame
CN106101741B (en) Method and system for watching panoramic video on network video live broadcast platform
JP5624053B2 (en) Creating a depth map from an image
US11381802B2 (en) Methods and apparatus for capturing images of an environment
CN105137705B (en) A kind of creation method and device of virtual ball curtain
CN101561988A (en) Method for exhibiting panoramagram
CN106028115A (en) Video playing method and device
CN108124108B (en) Method for balancing pixels in spherical panoramic image/video
CN111866523B (en) Panoramic video synthesis method and device, electronic equipment and computer storage medium
CN107197135A (en) A kind of video generation method, player method and video-generating device, playing device
CN110710203A (en) Methods, systems, and media for generating and rendering immersive video content
CN108269229B (en) Pixel position distribution optimization method for panoramic image or video
US8233741B1 (en) Reducing building lean in stitched images
CN110675482A (en) Spherical Fibonacci pixel dot matrix panoramic picture rendering and displaying method for virtual three-dimensional scene
CN108022204B (en) A kind of method that cylinder panorama video is converted to spherical panoramic video
CN108012160B (en) A kind of logo insertion method based on panoramic video
CN108765582A (en) A kind of panoramic pictures display methods and equipment
US20160093109A1 (en) Image processing device, image processing method, and program
CN110197524B (en) Stereoscopic display method, apparatus, device, and computer-readable storage medium
US20220122216A1 (en) Generating and processing an image property pixel structure
CN112102160B (en) Video processing method and device adaptive to 720 capsule type screen and related products
KR102192433B1 (en) Apparatus and method for upright adjustment of 360 panoramas
CN108040241B (en) A kind of method that spherical panoramic video is converted to cylinder panorama video
JP7447403B2 (en) Information processing device, information processing system, information processing method and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant