CN108022297B - Three-dimensional imaging modeling method, storage medium, and apparatus - Google Patents

Three-dimensional imaging modeling method, storage medium, and apparatus Download PDF

Info

Publication number
CN108022297B
CN108022297B CN201711239644.6A CN201711239644A CN108022297B CN 108022297 B CN108022297 B CN 108022297B CN 201711239644 A CN201711239644 A CN 201711239644A CN 108022297 B CN108022297 B CN 108022297B
Authority
CN
China
Prior art keywords
computer
lens
picture
steps
dimensional imaging
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201711239644.6A
Other languages
Chinese (zh)
Other versions
CN108022297A (en
Inventor
赵新杰
王文斌
周五杰
王春江
孙若菡
耿革
赵承伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Jiuweidu Network Technology Co ltd
Original Assignee
Shandong Jiuweidu Network Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Jiuweidu Network Technology Co ltd filed Critical Shandong Jiuweidu Network Technology Co ltd
Priority to CN201711239644.6A priority Critical patent/CN108022297B/en
Publication of CN108022297A publication Critical patent/CN108022297A/en
Application granted granted Critical
Publication of CN108022297B publication Critical patent/CN108022297B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20Finite element generation, e.g. wire-frame surface description, tesselation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/80Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Image Input (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention discloses a three-dimensional imaging modeling method, a storage medium and equipment, wherein the method comprises the following steps: the computer acquires a lens address; the computer starts the lens and loads the real-time picture; the computer takes a picture through the lens; the computer rotates the electric turntable according to a preset angle and takes a picture; the computer loads and aligns the shot photos; the computer builds dense point cloud, generates grid, generates texture and generates three-dimensional model according to the photo. Compared with the prior art, the method has the advantages that the convenient three-dimensional modeling can be realized on the basis of the modeling instrument, and the three-dimensional modeling difficulty is reduced.

Description

Three-dimensional imaging modeling method, storage medium, and apparatus
Technical Field
The present invention relates to the field of three-dimensional modeling software, and more particularly, to a three-dimensional imaging modeling method, a storage medium, and a device.
Background
In the imaging field, the problems of spatial optical axis position information loss, single object focal plane, limited depth of field and the like of the traditional lens cause that the traditional lens cannot meet the requirement of multi-dimensional informatization. The traditional imaging technology can only record the projection position information of an incident beam in a scene, but cannot record other dimension information, and can only obtain an accurate focusing image of a single object plane in a mechanical focusing mode. Depth information of different object planes can be calculated by using the multi-view intersection measuring method, but the method is only suitable for special occasions due to the difficulty in calibration, the multi-pose setting of the lens and the limitation of an intersection area, and the timeliness of an imaging system is influenced.
Disclosure of Invention
Therefore, it is necessary to provide a three-dimensional imaging modeling method, a storage medium, and an apparatus, which solve the problem of difficulty in the conventional three-dimensional imaging.
To achieve the above object, the inventors provide a three-dimensional imaging modeling method, comprising the steps of:
the computer acquires a lens address;
the computer starts the lens and loads the real-time picture;
the computer takes a picture through the lens;
the computer rotates the electric turntable according to a preset angle and takes a picture;
the computer loads and aligns the shot photos;
the computer builds dense point cloud, generates grid, generates texture and generates three-dimensional model according to the photo.
Further, the method also comprises the following steps:
the computer measures the distance between the modeled object and the lens and instructs the slider module to adjust the lens with long focal length.
Further, before shooting, the method also comprises the following steps:
the lens computer instructs the lens to perform a fine focus adjustment to the optimum focus.
Further, the method also comprises the following steps:
the computer derives a three-dimensional model.
Further, the method also comprises the following steps:
the computer saves the photograph.
Further, the method also comprises the following steps:
and the computer deletes the photo according to the user instruction.
The present invention provides a storage medium characterized in that: the storage medium stores a computer program which, when executed by a processor, implements the steps of the above-described method.
The present invention provides an electronic device characterized in that: comprising a memory, a processor, said memory having stored thereon a computer program, which, when being executed by the processor, carries out the steps of the method as described above.
Compared with the prior art, the method has the advantages that the convenient three-dimensional modeling can be realized on the basis of the modeling instrument, and the three-dimensional modeling difficulty is reduced.
Drawings
FIG. 1 is a schematic structural diagram of a three-dimensional imaging modeler;
fig. 2 is a flow chart of a method of three-dimensional imaging.
Detailed Description
To explain technical contents, structural features, and objects and effects of the technical solutions in detail, the following detailed description is given with reference to the accompanying drawings in conjunction with the embodiments.
Referring to fig. 1 to 2, the three-dimensional imaging modeling apparatus provided in this embodiment includes a semi-circular support frame 1, where the semi-circular support frame includes a plurality of end-to-end i-shaped frameworks, adjacent frameworks may be connected by bolts, the i-shaped frameworks may be formed by welding steel pipes or aluminum pipes, and include a front framework and a rear framework connected to each other, and a lens may be disposed between the front and rear frameworks. The semi-circle support frame of cordwood system is convenient to disassemble, assemble and transport. The plane of semicircle support frame place is perpendicular with the horizontal plane, and semicircle support frame's centre of a circle below department is provided with the level and puts thing platform 2, and the level is put and is provided with electric rotary table 3 under the thing platform, is provided with a plurality of camera lenses 4 on the semicircle support frame, and a plurality of camera lenses are in on the coplanar, and the camera lens of camera lens is just to semicircle support frame's centre of a circle department, the camera lens is in the level is put the horizontal plane top and the below of thing platform and is respectively provided with a platform at least.
Wherein, the semicircle support frame mainly plays the supporting role, is the semicircle form. The horizontal placing table is used for placing the shot objects, and a motor can be placed in the horizontal placing table as shown in fig. 1. The electric turntable 3 is used for driving the horizontal object placing table to horizontally rotate, and the imaging computer can be connected with the electric turntable and controls the electric turntable to rotate. The lens is used for taking pictures, and the plurality of lenses are positioned on the same vertical plane. In order to make the lens cover the shot object as much as possible, the lens is not only provided with at least one lens above and below the horizontal plane, but also has a large included angle in the direction of the lens, so that the top surface and the bottom surface of one side of the modeled object are covered by the pictures shot by the lens at one time.
In the actual use process, the modeling instrument can be connected with a computer, and then the computer can operate a three-dimensional imaging modeling method to carry out three-dimensional imaging on the modeled object, wherein the modeling method specifically comprises the following steps: the computer acquires a lens address; the computer starts the lens and loads the real-time picture; the computer takes a picture through the lens; the computer rotates the electric turntable according to a preset angle and takes a picture; the computer loads and aligns the shot photos; the computer builds dense point cloud, generates grid, generates texture and generates three-dimensional model according to the photo. The lens address can be an IP address of the lens, so that the computer can acquire an image of the lens and control the lens. The preset angle is the angle interval of the electric turntable rotated by the computer, generally, in order to obtain relatively more detailed images, 24-36 photos are taken by each lens when the computer rotates 360 degrees, and the angle of each rotation is generally between 10 and 15 degrees. Generally, 15 degrees is optimal, so that the number of photos can meet the modeling requirement, and the processing amount of a computer is not too large, so that the processing efficiency can be improved. After the photos are shot, the modeled object is placed upside down, the photos below are shot repeatedly, and after the computer controls the electric turntable to rotate for a preset angle, all the lenses are controlled to shoot a group of photos until the photos of the modeled object are shot in a circle after the electric turntable rotates for 360 degrees. After the photographing is completed, three-dimensional modeling is performed, and the common modeling method comprises alignment, dense point cloud establishment, grid generation, texture generation and three-dimensional model generation. Aligning the photo, namely enabling the computer to acquire the position of the photo in the three-dimensional imaging by the computer through recognizing the content of the photo, and establishing dense point cloud, namely point cloud data formed by the computer calculating the depth of an object shot in the center of the photo, wherein the point of the point cloud data is on the surface of the modeled object. The mesh generation is to establish a mesh according to the point cloud data, that is, each point is connected with an adjacent point to form a mesh. Finally, generating texture on the surface of the grid, and filling the covering grid with the texture, thereby forming a three-dimensional model. Therefore, through the modeling instrument, the computer can acquire enough photos and finally realize three-dimensional modeling. The modeling instrument has the advantages of small quantity of lenses and simple structure, and greatly reduces the cost of the modeling instrument.
In order to realize shooting of objects with different sizes, the lens is connected with the semicircular supporting frame through the moving mechanism 5, the moving mechanism comprises a motor 6, the motor is used for driving the moving mechanism to move, and the moving direction of the moving mechanism is the same as the direction opposite to the lens of the lens. The movement mechanism can be understood as an electric telescopic rod, and then the lens is arranged at the tail end, so that the computer can control the distance between the lens and the object by controlling the rotation of the motor. The computer may also adjust the distance between the lens and the modeled object during modeling so that the ratio of the modeled object to the lens frame is greater than a predetermined value, such as a frame ratio of 3/4. During specific adjustment, automatic adjustment can be realized, namely, firstly, a computer instructs a motion mechanism to enable a lens to be far away from a modeled object, then, a real-time picture is loaded, and whether the picture proportion occupied by the modeled object is larger than a preset proportion or not is judged, such as 3/4. If the ratio of the picture of the object to be modeled to the whole picture of the lens is larger than the preset ratio, the adjustment is not carried out, if the ratio of the picture of the object to be modeled to the whole picture of the lens is smaller than the preset ratio, the motion mechanism is instructed to move so that the lens is close to the object to be modeled, and finally the ratio of the picture of the object to be modeled to the whole picture of the lens is larger than the preset ratio. Therefore, more details can be shot, and a good three-dimensional modeling effect of the modeled object is achieved.
To achieve focusing of the modeled object, the lens is an electronic focus lens. Therefore, the computer can realize focusing by controlling the lens, ensure the focusing of the modeled object and avoid the condition of virtual shooting. The movement mechanism can be a sliding block module, and the modeling instrument is further provided with a distance measuring device at the lens for measuring the distance between the modeled object and the lens. During specific focusing, the computer measures the distance between the modeled object and the lens and instructs the sliding block module to slide to realize long-focus adjustment. After the long focal length is adjusted, the computer instructs the lens to finely adjust the focal length to the optimal focal length, thereby realizing focusing.
The generated three-dimensional model can be exported by a computer, so that the generated three-dimensional model can be directly used for printing the three-dimensional model on a 3D printer connected with the computer, and rapid modeling and printing are realized.
In order to realize the storage of the photos, the method also comprises the following steps: the computer saves the photograph. Of course, the computer may delete the photo according to the user's instruction, as desired by the user.
Further, still include the light filling lamp (not shown), the light filling lamp sets up on half circular support frame. Therefore, light supplement for the modeled object can be realized. The light supplement lamp can also be connected with a computer, so that the computer can control the light intensity. In order to keep the modeled object at the circle center of the semicircular supporting frame, the electric turntable can be connected with the semicircular supporting frame through an electric lifting platform, so that the electric turntable can be adjusted up and down. In some embodiments, if the modeled object is large, the motorized lift stage can be removed and the motorized turntable can be placed directly on the ground to take a picture.
The modeling instrument is provided with a plurality of controlled devices, and further comprises a controller or a computer for controlling the electric rotating disc and the lens in order to realize the control of the controlled devices.
In order to realize the support of the semi-circular support frame, the support device further comprises a vertical base 7, and the vertical base is arranged on one side of the circumference of the semi-circular support frame. The vertical base can be detachably connected with the semicircular supporting frame, so that the transportation and the assembly are convenient.
The number of lenses is not limited in the present invention, and generally, the number of lenses is 3 or more. Generally, the modeling method is related to the size of an object to be modeled, so that 3 small objects such as mobile phones can be used, and more than 9 small objects can be used for automobiles. This allows more photographs of the modeled object to be taken without significant processing.
The two ends of the semicircular support frame of the modeling instrument can be provided with solid background cloth, the background cloth is arranged on one side of a modeled article relative to the lens, and the plane where the background cloth is located is perpendicular to the plane where the semicircular support frame is located, so that the lens has a uniform background when the modeled article is shot, the processing of a computer is facilitated, and the processing speed of the computer is greatly increased.
In a specific embodiment, the method of the present invention can be as shown in fig. 2, and includes a step S101 of reading a lens IP, that is, acquiring a lens address. And S102, lens sorting, namely sorting the lenses or the order of the lenses. Step S103 starts a lens so that the lens can take a photograph. And step S104, zooming the lens to realize focusing of the lens. Step S105 takes a picture, thereby obtaining a photograph. Step S106 loads the photo, and may acquire and process the data on the photo. Step S107 suggests a dense point cloud, i.e. a set of points is generated on the surface of the item according to the depth of the item on the photograph, which points constitute the surface contour of the item. Step S108 generates grids, namely the connection lines of adjacent points, so that the subsequent texture generation is facilitated. Step S109 generates texture, so that mesh filling can be implemented, so that the surface of the article becomes electronic data. Step S110 derives a model, i.e., a three-dimensional model can be generated and derived. Thus, a three-dimensional modeling process is realized.
The invention also provides a storage medium storing a computer program which, when executed by a processor, implements the steps of the above method. The storage medium of the present embodiment may be a storage medium provided in an electronic device, and the electronic device may read the content of the storage medium and achieve the effects of the present invention. The storage medium may also be a separate storage medium, which is connected to the electronic device, and the electronic device may read the content of the storage medium and implement the method steps of the present invention.
The present invention provides an electronic device characterized in that: comprising a memory, a processor, said memory having stored thereon a computer program, which, when being executed by the processor, carries out the steps of the method as described above.
It should be noted that, although the above embodiments have been described herein, the invention is not limited thereto. Therefore, based on the innovative concepts of the present invention, the technical solutions of the present invention can be directly or indirectly applied to other related technical fields by making changes and modifications to the embodiments described herein, or by using equivalent structures or equivalent processes performed in the content of the present specification and the attached drawings, which are included in the scope of the present invention.

Claims (7)

1. The three-dimensional imaging modeling method is characterized in that the method is operated on a computer connected with a modeling instrument, the modeling instrument comprises a semicircular support frame, a plurality of lenses are arranged on the semicircular support frame, the lenses are opposite to the circle center of the semicircular support frame, a horizontal object placing table is arranged below the circle center of the semicircular support frame, the lenses are connected with the semicircular support frame through a movement mechanism, the movement mechanism comprises a motor, the motor is used for driving the movement mechanism to move, and the movement direction of the movement mechanism is the same as the opposite direction of the lenses; the movement mechanism is an electric telescopic rod, the lens is arranged at the tail end, the computer controls the distance between the lens and the object by controlling the rotation of the motor, and the computer adjusts the distance between the lens and the object to be modeled so that the ratio of the object to be modeled to the lens picture is larger than a preset value; the method comprises the following steps:
the computer acquires a lens address;
the computer starts the lens and loads the real-time picture;
the computer takes a picture through the lens;
the computer rotates the electric turntable according to a preset angle and takes a picture;
the computer loads and aligns the shot photos;
the computer establishes dense point cloud, generates a grid, generates textures and generates a three-dimensional model according to the picture;
further comprising the steps of:
the computer measures the distance between the modeled object and the lens and instructs the sliding block module to adjust the lens with long focal length; firstly, a computer instructs a movement mechanism to enable a lens to be far away from a modeled object, then a real-time picture is loaded, whether the picture proportion occupied by the modeled object is larger than a preset proportion or not is judged, if so, adjustment is not carried out, and if not, the movement mechanism is instructed to move to enable the lens to be close to the modeled object, so that the picture proportion occupied by the modeled object in the whole lens picture is larger than the preset proportion.
2. The three-dimensional imaging modeling method of claim 1, further comprising, prior to the capturing, the steps of:
the computer instructs the lens to perform fine focus adjustment to the best focus lens.
3. The three-dimensional imaging modeling method of claim 1, further comprising the steps of:
the computer derives a three-dimensional model.
4. The three-dimensional imaging modeling method of claim 1, further comprising the steps of:
the computer saves the photograph.
5. The three-dimensional imaging modeling method of claim 1, further comprising the steps of:
and the computer deletes the photo according to the user instruction.
6. A storage medium, characterized by: the storage medium stores a computer program which, when executed by a processor, carries out the steps of the method according to any one of claims 1 to 5.
7. An electronic device, characterized in that: comprising a memory, a processor, said memory having stored thereon a computer program which, when being executed by the processor, carries out the steps of the method according to any one of claims 1 to 5.
CN201711239644.6A 2017-11-30 2017-11-30 Three-dimensional imaging modeling method, storage medium, and apparatus Active CN108022297B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711239644.6A CN108022297B (en) 2017-11-30 2017-11-30 Three-dimensional imaging modeling method, storage medium, and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711239644.6A CN108022297B (en) 2017-11-30 2017-11-30 Three-dimensional imaging modeling method, storage medium, and apparatus

Publications (2)

Publication Number Publication Date
CN108022297A CN108022297A (en) 2018-05-11
CN108022297B true CN108022297B (en) 2021-11-19

Family

ID=62077500

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711239644.6A Active CN108022297B (en) 2017-11-30 2017-11-30 Three-dimensional imaging modeling method, storage medium, and apparatus

Country Status (1)

Country Link
CN (1) CN108022297B (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108833805A (en) * 2018-06-27 2018-11-16 北京中科知识工程技术研究院 A kind of stingy figure modeling method of mobile phone photograph light field matrix three-dimensional
CN108921937A (en) * 2018-06-27 2018-11-30 北京中科知识工程技术研究院 A kind of stingy drawing method of mobile phone photograph automatic identification picture
CN109068120A (en) * 2018-06-27 2018-12-21 北京中科知识工程技术研究院 A kind of mobile phone photograph light field matrix three-dimensional modeling method
CN108810424A (en) * 2018-06-27 2018-11-13 淄博丙合商贸有限公司 A kind of full-automatic mobile phone photograph ring object methods of exhibiting
CN108833806A (en) * 2018-06-27 2018-11-16 北京中科知识工程技术研究院 A kind of stingy figure ring object methods of exhibiting of mobile phone
CN110886951A (en) * 2018-09-11 2020-03-17 杭州海康威视数字技术股份有限公司 Support for image acquisition, image acquisition system and method
CN110784646A (en) * 2019-10-28 2020-02-11 中科智云科技有限公司 System and method for sample collection
CN113674405A (en) * 2021-09-07 2021-11-19 河南徕拓勘测规划设计有限公司 Three-dimensional imaging modeling method
CN115393528B (en) * 2022-09-20 2023-04-18 中国地震局地球物理研究所 Three-dimensional modeling method and system for ancient seismic exploration groove

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102866573A (en) * 2011-07-07 2013-01-09 登尼克股份有限公司 Three-dimensional imaging system and three-dimensional imaging method
CN104331924A (en) * 2014-11-26 2015-02-04 西安冉科信息技术有限公司 Three-dimensional reconstruction method based on single camera SFS algorithm
CN105157957A (en) * 2015-10-20 2015-12-16 广州市光机电技术研究院 LED display screen field testing apparatus and method
CN205505995U (en) * 2016-04-22 2016-08-24 杭州非白三维科技有限公司 A full angle shot automatic acquisition system of object for three -dimensional image builds pattern
CN106981085A (en) * 2016-01-16 2017-07-25 张诗剑 Based on digital photography and the contrast of the object of cloud computing and simulation three-dimensional display system
WO2017146202A1 (en) * 2016-02-25 2017-08-31 大日本印刷株式会社 Three-dimensional shape data and texture information generation system, photographing control program, and three-dimensional shape data and texture information generation method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102866573A (en) * 2011-07-07 2013-01-09 登尼克股份有限公司 Three-dimensional imaging system and three-dimensional imaging method
CN104331924A (en) * 2014-11-26 2015-02-04 西安冉科信息技术有限公司 Three-dimensional reconstruction method based on single camera SFS algorithm
CN105157957A (en) * 2015-10-20 2015-12-16 广州市光机电技术研究院 LED display screen field testing apparatus and method
CN106981085A (en) * 2016-01-16 2017-07-25 张诗剑 Based on digital photography and the contrast of the object of cloud computing and simulation three-dimensional display system
WO2017146202A1 (en) * 2016-02-25 2017-08-31 大日本印刷株式会社 Three-dimensional shape data and texture information generation system, photographing control program, and three-dimensional shape data and texture information generation method
CN205505995U (en) * 2016-04-22 2016-08-24 杭州非白三维科技有限公司 A full angle shot automatic acquisition system of object for three -dimensional image builds pattern

Also Published As

Publication number Publication date
CN108022297A (en) 2018-05-11

Similar Documents

Publication Publication Date Title
CN108022297B (en) Three-dimensional imaging modeling method, storage medium, and apparatus
CN103945210B (en) A kind of multi-cam image pickup method realizing shallow Deep Canvas
CN107170035B (en) High-reflection object scanning method and system
CN109218665B (en) Intelligent tracking shooting system
WO2020125797A1 (en) Terminal, photographing method, and storage medium
CN111189415B (en) Multifunctional three-dimensional measurement reconstruction system and method based on line structured light
CN206563985U (en) 3-D imaging system
CN101916036B (en) Computer-controlled physical three-dimensional automatic imaging device with light and horizontal rotating table
CN107454377B (en) A kind of algorithm and system carrying out three-dimensional imaging using camera
CN102589529B (en) Scanning close-range photogrammetry method
Kaufman et al. Single camera photogrammetry for reverse engineering and fabrication of ancient and modern artifacts
CN107862739B (en) Three-dimensional imaging modeling system
US20170142276A1 (en) Mobile networked system for capturing and printing three dimensional images
CN105931177B (en) Image acquisition processing device and method under specific environment
CN107835377A (en) Three-dimensional imaging models instrument
CN108347561B (en) Laser guide scanning system and scanning method
CN112822478B (en) High-quality photo sequence acquisition method for three-dimensional reconstruction
JP2007264592A (en) Automatic three-dimensional image forming device and method
CN106384331B (en) A kind of high-definition picture synthetic method based on accurate displacement
CN108810424A (en) A kind of full-automatic mobile phone photograph ring object methods of exhibiting
FR2910648A1 (en) Object's e.g. building, geometrical data capturing method for e.g. online sale application, involves capturing images representing object, from two different view points, and measuring distance between one of view points and point of object
CN110086994A (en) A kind of integrated system of the panorama light field based on camera array
CN206649565U (en) Panoramic camera and drive recorder
CN207475723U (en) A kind of three-dimensional imaging models instrument
CN108833806A (en) A kind of stingy figure ring object methods of exhibiting of mobile phone

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant