CN108986028A - A kind of method and system of high-definition picture processing - Google Patents

A kind of method and system of high-definition picture processing Download PDF

Info

Publication number
CN108986028A
CN108986028A CN201810684366.3A CN201810684366A CN108986028A CN 108986028 A CN108986028 A CN 108986028A CN 201810684366 A CN201810684366 A CN 201810684366A CN 108986028 A CN108986028 A CN 108986028A
Authority
CN
China
Prior art keywords
interface
image
resolution
processing
chip
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810684366.3A
Other languages
Chinese (zh)
Other versions
CN108986028B (en
Inventor
陈智
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fuzhou Rockchip Electronics Co Ltd
Original Assignee
Fuzhou Rockchip Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fuzhou Rockchip Electronics Co Ltd filed Critical Fuzhou Rockchip Electronics Co Ltd
Priority to CN201810684366.3A priority Critical patent/CN108986028B/en
Publication of CN108986028A publication Critical patent/CN108986028A/en
Application granted granted Critical
Publication of CN108986028B publication Critical patent/CN108986028B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4053Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038Image mosaicing, e.g. composing plane images from plane sub-images

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)

Abstract

The present invention provides a kind of method and systems of high-definition picture processing, and the system comprises the first chip and the second chip, first chip includes first interface, first processing units and second interface;Second chip includes third interface, the second processing unit and the 4th interface.First processing chip is sent to the second chip by second interface after splitting to high-definition picture by first interface reception high-definition picture.Second chip is the chip with processing high-definition picture performance, lower resolution image after the fractionation received is spliced into high-definition picture again and handled by it, and the corresponding image effect parameter of processing result is sent to the first chip, first chip receives image effect parameter, and executes corresponding image effect to first resolution image according to image effect parameter.In this way, allowing for lower first chip of performance also can be realized post-processing operation to super-resolution image.

Description

A kind of method and system of high-definition picture processing
Technical field
The present invention relates to field of image processing, in particular to a kind of method and system of high-definition picture processing.
Background technique
With the development of science and technology and social progress, higher requirements are also raised to taking pictures by people, is mainly manifested in and wants Ask camera that can take high-resolution image.
Currently, oversubscription camera is widely used, oversubscription (i.e. super-resolution) can be defined as resolution ratio and be greater than 1080P.Oversubscription camera acquired image is transmitted to after oversubscription image processing system, due to part preprocessor hardware item Part is limited, can only handle the lower image of resolution ratio, often helpless for the super-resolution image received. Thus, if it is possible on the basis of hardware condition is constant, so that original image processing system for being merely able to processing low resolution Become also to be capable of handling oversubscription image, this will be very significant.
Summary of the invention
For this reason, it may be necessary to a kind of technical solution of high-definition picture processing be provided, for solving oversubscription image processing system Due to being limited by hardware condition, lead to not the problem of handling super-resolution image.
To achieve the above object, the system for inventor providing a kind of processing of high-definition picture, the system comprises the One chip and the second chip, first chip include first interface, first processing units and second interface;Second chip Including third interface, the second processing unit and the 4th interface;
The first interface is supported to receive first resolution image, the second interface support transmission second resolution figure Picture, the third interface are supported to receive second resolution image, the 4th interface support transmission first resolution image;It is described First resolution is greater than second resolution;
The first processing units are used to receive first resolution image by first interface, and according to first resolution and First resolution image is cut into several second resolution images by the size relation of second resolution, and will be after cutting Each second resolution image is successively sent to third interface by second interface;
Described the second processing unit is used for through third interface second resolution image, and received second is differentiated Rate image is spliced into first resolution image according to cutting rule again, and is differentiated using image processing algorithm to the first of splicing Rate image carries out the first processing, obtains image effect parameter according to the first processing result image, and pass through the 4th interface for image Efficacy parameter is sent to first interface;
The first processing units are used to receive image effect parameter by second interface, and according to image effect parameter pair First resolution image executes corresponding image effect.
Further, first chip further includes the first storage unit, and the first processing units will be for that will execute figure As the first resolution image after effect is stored in the first storage unit.
Further, described image Processing Algorithm includes HDR image algorithm, night scene image enhancing algorithm, recognition of face calculation Method, object recognition algorithm, any one in human bioequivalence algorithm.
Further, the first interface and third interface are MIPI-CSI receiving interface, the second interface and the 4th Interface is MIPI-CSI transmission interface.
Further, second interface and the 4th interface transmittability mismatch.
Inventor additionally provides a kind of method of high-definition picture processing, and the method is applied to kind of a high-definition picture The system of processing, the system comprises the first chip and the second chip, first chip includes first interface, the first processing list Member and second interface;Second chip includes third interface, the second processing unit and the 4th interface;
First interface supports reception first resolution image, and second interface is supported to send second resolution image, and third connects Mouth is supported to receive second resolution image, the 4th interface support transmission first resolution image;The first resolution is greater than the Two resolution ratio;
It the described method comprises the following steps:
First processing units receive first resolution image by first interface, and are differentiated according to first resolution and second First resolution image is cut into several second resolution images by the size relation of rate, and by each second after cutting Image in different resolution is successively sent to third interface by second interface;
The second processing unit is pressed received second resolution image by third interface second resolution image Be spliced into first resolution image again according to cutting rule, and using image processing algorithm to the first resolution image of splicing into The processing of row first obtains image effect parameter according to the first processing result image, and passes through the 4th interface for image effect parameter It is sent to first interface;
First processing units receive image effect parameter by second interface, and are differentiated according to image effect parameter to first Rate image executes corresponding image effect.
Further, first chip further includes the first storage unit, which comprises
First resolution image after executing image effect is stored in the first storage unit by first processing units.
Further, described image Processing Algorithm includes HDR image algorithm, night scene image enhancing algorithm, recognition of face calculation Method, object recognition algorithm, any one in human bioequivalence algorithm.
Further, the first interface and third interface are MIPI-CSI receiving interface, the second interface and the 4th Interface is MIPI-CSI transmission interface.
Further, second interface and the 4th interface transmittability mismatch.
It is different from the prior art, the method and system of the processing of high-definition picture described in above-mentioned technical proposal, the system System includes the first chip and the second chip, and first chip includes first interface, first processing units and second interface;It is described Second chip includes third interface, the second processing unit and the 4th interface.First processing chip receives high score by first interface Resolution image, and the second chip is sent to by second interface after splitting to high-definition picture.Second chip be with The chip for handling high-definition picture performance, is spliced into high-resolution for the lower resolution image after the fractionation received again Rate image is simultaneously handled, and the corresponding image effect parameter of processing result is sent to the first chip, and the first chip receives Image effect parameter, and corresponding image effect is executed to first resolution image according to image effect parameter.In this way, allowing for Lower first chip of performance also can be realized the post-processing operation to super-resolution image.
Detailed description of the invention
Fig. 1 is the schematic diagram of the system for the high-definition picture processing that an embodiment of the present invention is related to;
Fig. 2 is the flow chart of the method for the high-definition picture processing that an embodiment of the present invention is related to;
Description of symbols:
101, the first chip;
111, first interface;112, first processing units;113, second interface;
102, the second chip;
121, third interface;122, the second processing unit;123, the 4th interface;
103, oversubscription camera.
Specific embodiment
Technology contents, construction feature, the objects and the effects for detailed description technical solution, below in conjunction with specific reality It applies example and attached drawing is cooperated to be explained in detail.
Referring to Fig. 1, the schematic diagram of the system for the high-definition picture processing that an embodiment of the present invention is related to.The system System includes the first chip 101 and the second chip 102, and first chip 101 includes first interface 111, first processing units 112 With second interface 113;Second chip 102 includes third interface 121, the second processing unit 122 and the 4th interface 123;
The first interface 111 is supported to receive first resolution image, the second resolution of the support of second interface 113 transmission Rate image, the third interface 121 are supported to receive second resolution image, the first resolution of the 4th interface 123 support transmission Rate image;The first resolution is greater than second resolution.
First processing units and the second processing unit are the electronic component with image processing function, such as dsp processor (number Word signal processor).Preferably, the performance of the second processing unit is better than first processing units, i.e. the second processing unit is compared It is capable of handling the image of higher resolution in first processing units, or can be right using more complicated algorithm (such as AI algorithm) Image is handled.
In the present embodiment, the first interface and third interface are MIPI-CSI receiving interface, the second interface It is MIPI-CSI transmission interface with the 4th interface.Specifically, second interface and the 4th interface transmittability mismatch.Such as second Interface is the transmission interface for supporting 1080P image in different resolution, and the 4th interface is the transmission interface for supporting 4K image in different resolution.Another In some embodiments, the second interface, third interface, the 4th interface can also be SPI interface.Preferably, second interface is MIPI-Tx/Rx multiplex interface, i.e. second interface be both used to send data and can be used for receiving data, connect so as to second Mouth receives the image effect parameter that the second chip is sent.
The first processing units 112 are used to receive first resolution image by first interface 111, and according to first point First resolution image is cut into several second resolution images, and will cut by the size relation of resolution and second resolution Each second resolution image after cutting successively is sent to third interface 121 by second interface 113.In the present embodiment, First resolution is 4K, second resolution 1080P, and first processing units tear the 4K image for receiving oversubscription camera 103 open It is divided into 4 width 1080P images.The rule of fractionation is preferably to carry out 4 equal parts to the image received.
Described the second processing unit 122 is used to receive second resolution image by third interface 121, and by received the Two image in different resolution are spliced into first resolution image according to cutting rule again, and using image processing algorithm to the of splicing One image in different resolution carries out the first processing, obtains image effect parameter according to the first processing result image, and pass through the 4th interface Image effect parameter is sent to first interface by 123;
The first processing units 112 are used to receive image effect parameter by second interface, and are joined according to image effect Several pairs of first resolution images execute corresponding image effect.
Image effect parameter is corresponding with image processing algorithm, and in the present embodiment, described image Processing Algorithm includes It is HDR image algorithm, night scene image enhancing algorithm, face recognition algorithms, object recognition algorithm, any one in human bioequivalence algorithm Kind.
Specifically, when image processing algorithm is that night scene enhances algorithm, image effect parameter is night scene reinforcing effect, such as The brightness value that the needs of night scene image enhance;
When image processing algorithm is HDR (high dynamic range) image algorithm, image effect parameter is HDR effect image, Such as convert the image into the brightness value that HDR image needs to enhance;
When image processing algorithm is face or object recognition algorithm, image effect parameter is face or object features value Coordinate and weighted value, such as image effect can be the position outlined where face in image or object.
In certain embodiments, first chip further includes the first storage unit, and the first processing units are used for will First resolution image after executing image effect is stored in the first storage unit.First resolution image can pass through display Unit is shown, other applications subsequent processing, such as compression processing can also be waited.
As shown in Fig. 2, inventor additionally provides a kind of method of high-definition picture processing, the method is applied to kind of a height Image in different resolution processing system, the system comprises the first chip and the second chip, first chip include first interface, First processing units and second interface;Second chip includes third interface, the second processing unit and the 4th interface;
First interface supports reception first resolution image, and second interface is supported to send second resolution image, and third connects Mouth is supported to receive second resolution image, the 4th interface support transmission first resolution image;The first resolution is greater than the Two resolution ratio;
It the described method comprises the following steps:
It initially enters step S201 first processing units and first resolution image is received by first interface, and according to first First resolution image is cut into several second resolution images by the size relation of resolution ratio and second resolution, and will Each second resolution image after cutting is successively sent to third interface by second interface;
S202 the second processing unit is then entered step by third interface second resolution image, and will be received Second resolution image is spliced into first resolution image according to cutting rule again, and using image processing algorithm to splicing First resolution image carries out the first processing, obtains image effect parameter according to the first processing result image, and connect by the 4th Image effect parameter is sent to first interface by mouth;
It then enters step S203 first processing units and image effect parameter is received by second interface, and imitated according to image Fruit parameter executes corresponding image effect to first resolution image.
In certain embodiments, first chip further includes the first storage unit, which comprises the first processing is single First resolution image after executing image effect is stored in the first storage unit by member.When first processing units get phase After should instructing, it will acquire the image stored in the first storage unit and carry out corresponding operating, the operational order includes but is not limited to Display operation, squeeze operation, transmission operation etc..
The method and system of the processing of high-definition picture described in above-mentioned technical proposal, the system comprises the first chip and Second chip, first chip include first interface, first processing units and second interface;Second chip includes third Interface, the second processing unit and the 4th interface.First processing chip receives high-definition picture by first interface, and to high score Resolution image by second interface is sent to the second chip after being split.Second chip is with processing high-definition picture The chip of energy, is spliced into high-definition picture for the lower resolution image after the fractionation received again and handles, And the corresponding image effect parameter of processing result is sent to the first chip, the first chip receives image effect parameter, and root Corresponding image effect is executed to first resolution image according to image effect parameter.In this way, allowing for lower first core of performance Piece also can be realized the post-processing operation to super-resolution image.
It should be noted that being not intended to limit although the various embodiments described above have been described herein Scope of patent protection of the invention.Therefore, it based on innovative idea of the invention, change that embodiment described herein is carried out and is repaired Change, or using equivalent structure or equivalent flow shift made by description of the invention and accompanying drawing content, it directly or indirectly will be with Upper technical solution is used in other related technical areas, is included within scope of patent protection of the invention.

Claims (10)

1. a kind of system of high-definition picture processing, which is characterized in that the system comprises the first chip and the second chip, institutes Stating the first chip includes first interface, first processing units and second interface;Second chip includes third interface, at second Manage unit and the 4th interface;
The first interface is supported to receive first resolution image, the second interface support transmission second resolution image, institute It states third interface to support to receive second resolution image, the 4th interface is supported to send first resolution image;Described first Resolution ratio is greater than second resolution;
The first processing units are used to receive first resolution image by first interface, and according to first resolution and second First resolution image is cut into several second resolution images by the size relation of resolution ratio, and will be each after cutting Second resolution image is successively sent to third interface by second interface;
Described the second processing unit is used for through third interface second resolution image, and by received second resolution figure As being spliced into first resolution image again according to cutting rule, and using image processing algorithm to the first resolution figure of splicing As carrying out the first processing, image effect parameter is obtained according to the first processing result image, and pass through the 4th interface for image effect Parameter is sent to first interface;
The first processing units are used to receive image effect parameter by second interface, and according to image effect parameter to first Image in different resolution executes corresponding image effect.
2. the system of high-definition picture as described in claim 1 processing, which is characterized in that first chip further includes the One storage unit, the first processing units are used to the first resolution image after execution image effect being stored in the first storage In unit.
3. the system of high-definition picture as described in claim 1 processing, which is characterized in that described image Processing Algorithm includes It is HDR image algorithm, night scene image enhancing algorithm, face recognition algorithms, object recognition algorithm, any one in human bioequivalence algorithm Kind.
4. the system of high-definition picture processing as described in claim 1, which is characterized in that the first interface and third connect Mouth is MIPI-CSI receiving interface, and the second interface and the 4th interface are MIPI-CSI transmission interface.
5. the system of high-definition picture processing as described in claim 1 or 4, which is characterized in that second interface and the 4th connects Oral instructions Movement Capabilities mismatch.
6. a kind of method of high-definition picture processing, which is characterized in that the method is applied to kind of a high-definition picture processing System, the system comprises the first chip and the second chip, first chip include first interface, first processing units and Second interface;Second chip includes third interface, the second processing unit and the 4th interface;
First interface is supported to receive first resolution image, second interface support transmission second resolution image, third interface branch It holds and receives second resolution image, the 4th interface is supported to send first resolution image;The first resolution is greater than second point Resolution;
It the described method comprises the following steps:
First processing units receive first resolution image by first interface, and according to first resolution and second resolution First resolution image is cut into several second resolution images, and each second after cutting is differentiated by size relation Rate image is successively sent to third interface by second interface;
The second processing unit is by third interface second resolution image, and by received second resolution image according to cutting It cuts rule and is spliced into first resolution image again, and carry out the using first resolution image of the image processing algorithm to splicing One processing, obtains image effect parameter according to the first processing result image, and send image effect parameter by the 4th interface To first interface;
First processing units receive image effect parameter by second interface, and according to image effect parameter to first resolution figure As executing corresponding image effect.
7. the method for high-definition picture as claimed in claim 6 processing, which is characterized in that first chip further includes the One storage unit, which comprises
First resolution image after executing image effect is stored in the first storage unit by first processing units.
8. the method for high-definition picture as claimed in claim 6 processing, which is characterized in that described image Processing Algorithm includes It is HDR image algorithm, night scene image enhancing algorithm, face recognition algorithms, object recognition algorithm, any one in human bioequivalence algorithm Kind.
9. the method for high-definition picture processing as claimed in claim 6, which is characterized in that the first interface and third connect Mouth is MIPI-CSI receiving interface, and the second interface and the 4th interface are MIPI-CSI transmission interface.
10. the method that the high-definition picture as described in claim 6 or 9 is handled, which is characterized in that second interface and the 4th connects Oral instructions Movement Capabilities mismatch.
CN201810684366.3A 2018-06-28 2018-06-28 Method and system for processing high-resolution image Active CN108986028B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810684366.3A CN108986028B (en) 2018-06-28 2018-06-28 Method and system for processing high-resolution image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810684366.3A CN108986028B (en) 2018-06-28 2018-06-28 Method and system for processing high-resolution image

Publications (2)

Publication Number Publication Date
CN108986028A true CN108986028A (en) 2018-12-11
CN108986028B CN108986028B (en) 2022-12-16

Family

ID=64538761

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810684366.3A Active CN108986028B (en) 2018-06-28 2018-06-28 Method and system for processing high-resolution image

Country Status (1)

Country Link
CN (1) CN108986028B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113963650A (en) * 2021-10-11 2022-01-21 Tcl华星光电技术有限公司 Driving device and display apparatus
WO2022021194A1 (en) * 2020-07-30 2022-02-03 华为技术有限公司 Electronic system, camera module, and system on chip
CN117151968A (en) * 2023-10-25 2023-12-01 南京芯驰半导体科技有限公司 Image processing method and device for vehicle, electronic equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006094237A (en) * 2004-09-24 2006-04-06 Fuji Xerox Co Ltd Image processing device, image processing method and image processing program
JP2008085474A (en) * 2006-09-26 2008-04-10 Victor Co Of Japan Ltd Image data processor
JP2009010626A (en) * 2007-06-27 2009-01-15 Toshiba Corp Image processing device and image processing method
JP2010130701A (en) * 2009-12-11 2010-06-10 Toshiba Corp Image processing device, receiving device and display device
CN105096249A (en) * 2014-05-23 2015-11-25 北京大学 Image processing method and image processing apparatus
DE102015115998A1 (en) * 2014-09-29 2016-03-31 Avaya Inc. Segmented video codec for high-resolution, high-frame-rate video

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006094237A (en) * 2004-09-24 2006-04-06 Fuji Xerox Co Ltd Image processing device, image processing method and image processing program
JP2008085474A (en) * 2006-09-26 2008-04-10 Victor Co Of Japan Ltd Image data processor
JP2009010626A (en) * 2007-06-27 2009-01-15 Toshiba Corp Image processing device and image processing method
JP2010130701A (en) * 2009-12-11 2010-06-10 Toshiba Corp Image processing device, receiving device and display device
CN105096249A (en) * 2014-05-23 2015-11-25 北京大学 Image processing method and image processing apparatus
DE102015115998A1 (en) * 2014-09-29 2016-03-31 Avaya Inc. Segmented video codec for high-resolution, high-frame-rate video

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022021194A1 (en) * 2020-07-30 2022-02-03 华为技术有限公司 Electronic system, camera module, and system on chip
CN113963650A (en) * 2021-10-11 2022-01-21 Tcl华星光电技术有限公司 Driving device and display apparatus
CN113963650B (en) * 2021-10-11 2023-07-04 Tcl华星光电技术有限公司 Driving device and display apparatus
CN117151968A (en) * 2023-10-25 2023-12-01 南京芯驰半导体科技有限公司 Image processing method and device for vehicle, electronic equipment and storage medium
CN117151968B (en) * 2023-10-25 2024-02-27 南京芯驰半导体科技有限公司 Image processing method and device for vehicle, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN108986028B (en) 2022-12-16

Similar Documents

Publication Publication Date Title
US11501574B2 (en) Multi-person pose recognition method and apparatus, electronic device, and storage medium
CN108986028A (en) A kind of method and system of high-definition picture processing
US8872817B2 (en) Real-time three-dimensional real environment reconstruction apparatus and method
WO2020051776A1 (en) Method and system of deep supervision object detection for reducing resource usage
Nitta et al. Image reconstruction for thin observation module by bound optics by using the iterative backprojection method
EP2973386B1 (en) Adaptive data path for computer-vision applications
US10122941B2 (en) Image pickup apparatus, method for controlling the image pickup apparatus, and recording medium
US11949848B2 (en) Techniques to capture and edit dynamic depth images
KR102628898B1 (en) Method of processing image based on artificial intelligence and image processing device performing the same
EP4109882A1 (en) Image processing method and electronic device
CN109445760B (en) Image rendering method and system
JP2010113618A (en) Image distribution device and method, and program
CN109274949A (en) A kind of method of video image processing and its device, display equipment
CN108174084A (en) panoramic video processing method and terminal device
CN101159819A (en) Method and device of inter cut Flash in online video
CN111277896A (en) Method and device for splicing network video stream images
WO2023010981A1 (en) Encoding and decoding methods and apparatus
CN114422698B (en) Video generation method, device, equipment and storage medium
CN114781622A (en) Image processing method and device, and video processing method and device
CN113905040B (en) File transmission method, device, system, equipment and storage medium
CN104463790A (en) Image processing method, apparatus and system
Hasper et al. Remote execution vs. simplification for mobile real-time computer vision
Potetsianakis et al. A Kinect-based framework for better user experience in real-time audiovisual content manipulation
EP2184922A2 (en) Moving-picture processing device, moving-picture processing method, and program
JP2005340974A (en) Image-transmission control program and image display program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 350003 building 18, No.89, software Avenue, Gulou District, Fuzhou City, Fujian Province

Applicant after: Ruixin Microelectronics Co.,Ltd.

Address before: 350003 building 18, No.89, software Avenue, Gulou District, Fuzhou City, Fujian Province

Applicant before: FUZHOU ROCKCHIP ELECTRONICS Co.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant