CN112362309B - Eccentric parallax testing method and device - Google Patents

Eccentric parallax testing method and device Download PDF

Info

Publication number
CN112362309B
CN112362309B CN202011165742.1A CN202011165742A CN112362309B CN 112362309 B CN112362309 B CN 112362309B CN 202011165742 A CN202011165742 A CN 202011165742A CN 112362309 B CN112362309 B CN 112362309B
Authority
CN
China
Prior art keywords
test
parallax
product
eccentric
tested
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011165742.1A
Other languages
Chinese (zh)
Other versions
CN112362309A (en
Inventor
唐宝杰
姚威
胡守岩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Goertek Technology Co Ltd
Original Assignee
Qingdao Goertek Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Goertek Technology Co Ltd filed Critical Qingdao Goertek Technology Co Ltd
Priority to CN202011165742.1A priority Critical patent/CN112362309B/en
Publication of CN112362309A publication Critical patent/CN112362309A/en
Application granted granted Critical
Publication of CN112362309B publication Critical patent/CN112362309B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01MTESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M11/00Testing of optical apparatus; Testing structures by optical methods not otherwise provided for
    • G01M11/02Testing optical properties
    • G01M11/0242Testing optical properties by measuring geometrical properties or aberrations
    • G01M11/0257Testing optical properties by measuring geometrical properties or aberrations by analyzing the image formed by the object to be tested

Abstract

The invention provides an eccentric parallax testing method and device, wherein the method comprises the following steps: manufacturing a test graphic card based on the resolution of the display screen of the product to be tested, and guiding the test graphic card into the product to be tested; controlling a display screen to play a test graphic card through a product to be tested; shooting a test graphic card played by a display screen through a camera, and acquiring a test image corresponding to the test graphic card; and transmitting the test image to a test system, and processing the test image by the test system to obtain the eccentric parallax of the product to be tested. The eccentric parallax data of the product can be accurately acquired by using the device, and the device is simple to build, strong in flexibility and high in test accuracy.

Description

Eccentric parallax testing method and device
Technical Field
The invention relates to the technical field of eccentric parallax testing of products, in particular to an eccentric parallax testing method and device.
Background
VR (Virtual Reality) products are characterized by creating a three-dimensional Virtual environment close to the real world, in which the user is immersed completely, giving the user a sense of environmental immersion. However, based on the imaging and display principle of VR products, discomfort such as dizziness and nausea may occur to users when used for a long time, and one of the causes of the discomfort is eccentric parallax of the products.
The eccentric parallax mainly refers to binocular imaging difference caused by binocular eccentricity in VR products; wherein, eccentricity refers to the deviation between the center of the VR product lens and the center of the display screen, left eye eccentricity is defined as dL, and right eye eccentricity is defined as dR; the decentration parallax is the difference between the decentration of the two eyes, i.e. | dL-dR |. At present, the eccentric parallax is an important parameter for measuring the binocular imaging fusion degree of VR products, and the larger the eccentric parallax is, the larger the binocular imaging deviation is, and the worse the user experience is. Therefore, testing for off-center parallax is particularly important for VR products.
The existing eccentric parallax testing method is basically divided into two steps: 1) Testing the eccentricity of the left eye and the right eye independently; 2) The eccentric parallax is calculated from the binocular eccentricity. Therefore, the testing method and the adopted testing equipment are complex, the obtained testing result is not intuitive enough, the testing error is large, and the accuracy is low.
Disclosure of Invention
In view of the above problems, an object of the present invention is to provide a method and an apparatus for testing an eccentric parallax, so as to solve the problems of the current products, such as insufficient intuitive result, complicated operation, and low accuracy during the eccentric parallax testing process.
The invention provides an eccentric parallax testing method, which comprises the following steps: manufacturing a test graphic card based on the resolution of the display screen of the product to be tested, and guiding the test graphic card into the product to be tested; controlling a display screen to play a test graphic card through a product to be tested; shooting a test graphic card played by a display screen through a camera, and acquiring a test image corresponding to the test graphic card; and transmitting the test image to a test system, and obtaining the eccentric parallax of the product to be tested after the image processing of the test system.
In addition, the preferable technical scheme is that the test chart card comprises a black background card and a double-cross line which is arranged on the black background card and is provided with two intersection points; the intersection point positions of the double cross lines respectively correspond to the central positions of the left eye and the right eye of the product to be detected.
In addition, the preferred technical scheme is that the double-cross lines comprise a horizontal line and two vertical lines which are parallel to each other; the intersection point of the vertical line and the horizontal line is the intersection point position of the double-cross line.
In addition, the preferred technical scheme is that the double-cross lines comprise two groups of cross lines; the intersection positions of the two groups of crossed lines respectively correspond to the central position setting values of the left eye and the right eye of the product to be detected.
Further, it is preferable that the line width of the double cross line is equal to the size of one pixel of the display screen.
In addition, it is preferable that position mark information is provided at least one intersection of the double crossing lines.
In addition, it is preferable that the position mark information includes left-eye mark information and/or right-eye mark information.
In addition, the preferable technical scheme is that the process of acquiring the eccentric parallax of the product to be tested through the test system comprises the following steps: carrying out high-pass filtering processing on the test image to eliminate pixel points of low-frequency components such as stray light and the like protruding out of double cross lines on the test image; carrying out image enhancement processing on the image subjected to the high-pass filtering processing so as to enhance pixel points of double cross lines; and performing linear fitting on the pixel points in the image after the enhancement processing, and determining the eccentric parallax of the product to be detected according to the fitted linear.
Further, it is preferable that the off-center parallax includes an X-direction off-center parallax and a Y-direction off-center parallax.
According to another aspect of the present invention, an eccentric parallax testing apparatus is provided, which performs an eccentric parallax test on a product to be tested by using the eccentric parallax testing method; the eccentric parallax testing device comprises a product fixing tool, a camera fixing tool and a testing system; the device comprises a product to be detected, a camera fixing tool and a product fixing tool, wherein the product to be detected is limited on the product fixing tool; the camera is used for shooting a test graphic card played by a display screen of a product to be tested and transmitting the test graphic card to the test system; the test system is used for determining the eccentric parallax of the product to be tested according to the test graphic card.
By using the eccentric parallax testing method and device, the test chart card played by the VR waiting to be tested can be shot by the camera, so that the eccentric parallax data of the product can be obtained quantitatively according to the corresponding test image, different test chart cards can be set according to the test requirements, and the method and device are high in flexibility, low in requirement on the test environment, wide in application range and high in accuracy.
To the accomplishment of the foregoing and related ends, one or more aspects of the invention comprise the features hereinafter fully described. The following description and the annexed drawings set forth in detail certain illustrative aspects of the invention. These aspects are indicative, however, of but a few of the various ways in which the principles of the invention may be employed. Further, the present invention is intended to include all such aspects and their equivalents.
Drawings
Other objects and results of the present invention will become more apparent and readily appreciated by reference to the following description taken in conjunction with the accompanying drawings, and as the invention becomes more fully understood. In the drawings:
FIG. 1 is a flow chart of an off-center parallax test method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a test card according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating a test card with location marker information according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a test image according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a test image after image enhancement according to an embodiment of the present invention;
FIG. 6 is a schematic view of a test image after fitting a straight line according to an embodiment of the invention;
fig. 7 is a schematic structural diagram of an eccentric parallax testing apparatus according to an embodiment of the present invention.
Wherein the reference numerals include: the device comprises a product fixing tool 1, a camera fixing tool 2, a product to be tested 3, a camera 4 and a test system 5.
The same reference numbers in all figures indicate similar or corresponding features or functions.
Detailed Description
In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more embodiments. It may be evident, however, that such embodiment(s) may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate describing one or more embodiments.
In the description of the present invention, it is to be understood that the terms "central," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," "circumferential," and the like are used in the orientations and positional relationships indicated in the drawings for convenience in describing the invention and to simplify the description, and are not intended to indicate or imply that the referenced devices or elements must have a particular orientation, be constructed and operated in a particular orientation, and are therefore not to be considered limiting of the invention.
To describe the eccentric parallax test method and apparatus according to the embodiments of the present invention in detail, the following describes embodiments of the present invention in detail with reference to the accompanying drawings.
Fig. 1 shows a flow of an eccentric parallax test method according to an embodiment of the present invention.
As shown in fig. 1, the eccentric parallax testing method according to the embodiment of the present invention includes the following steps:
s110: and manufacturing a test graphic card based on the resolution of the display screen of the product to be tested, and guiding the test graphic card into the product to be tested.
The size of the test graphic card can be set according to the resolution of the display screen of the product to be tested, and the shape of the test graphic card can be adjusted and deformed according to the structure of the product to be tested; as a specific example, the test card may include a black background card and a double cross line disposed on the black background card and having two intersection points, where the two intersection points are located at two positions corresponding to the central positions of the left and right eyes of the product to be tested, respectively.
In particular, FIG. 2 shows a schematic pattern of a test card according to an embodiment of the present invention.
As shown in fig. 2, the test chart card according to the embodiment of the present invention includes a background card and a double cross line disposed on the background card, where the double cross line may include a horizontal line and two vertical lines parallel to each other, and an intersection of the two vertical lines and the horizontal line is used as two intersection positions of the double cross line; or the double cross lines are set to be in a form of two groups of cross lines, and the intersection positions of the two groups of cross lines respectively correspond to the central positions of the left eye and the right eye of the product to be detected.
It is understood that the background color of the test chart card may be set to other color systems that can be distinguished from the color of the double crossing lines, in addition to black, for example, the background color of the test chart card may be set to black, the double crossing lines may be set to green, or the background color of the test chart card may be set to green, or the double crossing lines may be set to other colors such as black or red, and the double crossing lines may be displayed in a distinguishable manner. The double crossing lines arranged on the test chart card can also be arranged in other forms with two crossing points or two marked points, and are not limited to the specific structure shown in the figures.
In an embodiment of the present invention, the line width of the double-cross line may be set to be equal to the size of one pixel of the display screen of the product to be tested, or to be greater than the width of one pixel of the display screen.
FIG. 3 shows a pattern of a test card with location mark information according to an embodiment of the invention.
As shown in fig. 3, in order to assist the tester to distinguish two intersection points of the double crossing lines as the left eye center or the right eye center of the product to be tested, in the eccentric parallax test method of the present invention, position mark information may also be set at least one intersection point of the double crossing lines, and the position mark information may include left eye mark information and/or right eye mark information.
For example, a mark such as a line segment, a dot or other shape may be provided on one side of any intersection of the double-cross lines to assist in distinguishing the left and right positions of the product, and the specific structure of using the line segment as the center position of the right eye of the product to be measured in fig. 3 is not limited.
S120: and controlling the display screen to play the test chart through the product to be tested.
S130: and shooting the test graphic card played by the display screen through the camera, and acquiring a test image corresponding to the test graphic card.
The exposure time of the camera can be adjusted to match the refreshing frequency of the display screen of the product to be tested, so that the camera can shoot stable test images, the relative position of the product to be tested or the camera can be adjusted in the test process, the binocular center of a test chart played by the product to be tested can be captured by the camera, and high-quality test images can be obtained.
S140: and transmitting the test image to a test system, and processing the test image by the test system to obtain the eccentric parallax of the product to be tested.
In the step, a test image shot by the camera is transmitted to the test system, and the test system processes the test image and acquires eccentric parallax data corresponding to a product to be tested.
In particular, fig. 4-6 respectively show test images at different processing stages in a process according to an embodiment of the invention.
As shown in fig. 4 to fig. 6, the process of processing the test image by the test system according to the embodiment of the present invention to obtain the eccentric parallax of the product to be tested includes the following steps:
1. carrying out high-pass filtering processing on the test image to eliminate pixel points lower than a preset value on the test image; and pixel points with prominent low-frequency components in the double-cross line halo region can be removed through high-pass filtering processing.
2. Carrying out image enhancement processing on the image subjected to the high-pass filtering processing so as to enhance pixel points of double cross lines; the processing of the step can enhance the brightness of the pixel points of the double-cross lines, and facilitates the subsequent straight line fitting operation.
3. And performing linear fitting on the pixel points in the image after the enhancement processing, and determining the eccentric parallax of the product to be detected according to the fitted linear.
And C, performing straight line fitting on the positions of the pixel points of the double-cross lines in the test image processed in the step 2, marking the fitted straight lines in the test image, and calculating to obtain the eccentric parallax of the product to be tested according to the intersection point positions of the straight lines. As shown in fig. 6, the off-center parallax includes an X-direction off-center parallax and a Y-direction off-center parallax.
Corresponding to the eccentric parallax testing method, the invention also provides an eccentric parallax testing device. Fig. 7 shows a schematic structure of an eccentric parallax test apparatus according to an embodiment of the present invention.
As shown in fig. 7, the eccentric parallax testing apparatus according to the embodiment of the present invention includes a product fixing tool 1, a camera fixing tool 2, and a testing system 5; the device comprises a product fixing tool 1, a camera 4, a test system 5, a test system 4, a test image card and a test image card, wherein the product 3 to be tested is limited on the product fixing tool 1, the camera 4 is limited on the camera fixing tool 2, the product 3 to be tested and the camera 4 are both connected with the test system 5, the test image card played by the product 3 to be tested is controlled to be played through the test system 5, the test image card played by a display screen of the product 3 to be tested is shot through the camera 4, and a corresponding test image is obtained and transmitted to the test system 5; the test system 5 is used for processing the test image and acquiring the eccentric parallax of the product 3 to be tested based on the processing result.
Wherein, the relative position relation between 3 and the camera 4 of awaiting measuring is adjusted to the position of the fixed frock 1 of accessible adjustment product or the position of the fixed frock 2 of camera, and it can to ensure that the camera can be complete shoot the left and right eyes central point of test chart put.
It should be noted that, the embodiments of the eccentric parallax test apparatus can refer to the description in the embodiments of the eccentric parallax test method, and details are not repeated here.
By using the eccentric parallax testing method and device provided by the invention, the testing graphic card played by the product to be tested is shot by the camera, the obtained testing image is sent to the testing system, the eccentric parallax value of the product is determined quantitatively by processing the testing image by the testing system, the testing graphic card can be flexibly set according to the testing requirement, the requirement on the testing environment is not high, the testing process is not interfered, the application range is wide, and the testing accuracy is high.
The eccentric parallax test method and apparatus according to the present invention are described above by way of example with reference to the accompanying drawings. However, it should be understood by those skilled in the art that various modifications can be made to the above-described eccentric parallax testing method and apparatus without departing from the scope of the present invention. Accordingly, the scope of the invention should be determined from the content of the appended claims.

Claims (9)

1. An off-center parallax test method, the method comprising:
manufacturing a test graphic card based on the resolution of a display screen of a product to be tested, and guiding the test graphic card into the product to be tested; the product to be detected is a virtual reality product;
controlling the display screen to play the test graphic card through the product to be tested;
shooting binocular centers of the test graphic cards played by the display screen through a camera at the same time, and acquiring test images corresponding to the test graphic cards;
transmitting the test image to a test system, and obtaining the eccentric parallax of the product to be tested after the image processing of the test system;
the test graphic card comprises a black background card and a double-cross line which is arranged on the black background card and is provided with two intersection points;
and the intersection point positions of the double cross lines respectively correspond to the central positions of the left eye and the right eye of the product to be detected.
2. The eccentric parallax test method according to claim 1,
the double-cross lines comprise a horizontal line and two vertical lines which are parallel to each other;
and the intersection point of the vertical line and the horizontal line is the intersection point position of the double-cross line.
3. The eccentric parallax test method according to claim 1,
the double cross lines comprise two groups of cross lines;
and the intersection point positions of the two groups of crossed lines respectively correspond to the central positions of the left eye and the right eye of the product to be detected.
4. The eccentric parallax test method according to claim 1,
the line width of the double cross line is equal to the size of one pixel of the display screen.
5. The eccentric parallax test method according to claim 1,
position mark information is provided at least one intersection of the double crossing lines.
6. The eccentric parallax test method according to claim 5,
the position marker information includes left eye marker information and/or right eye marker information.
7. The eccentric parallax test method according to claim 1, wherein the image processing procedure of acquiring the eccentric parallax of the product to be tested by the test system comprises:
carrying out high-pass filtering processing on the test image so as to eliminate pixel points of low-frequency components such as stray light and the like protruding out of double cross lines on the test image;
carrying out image enhancement processing on the image subjected to the high-pass filtering processing so as to enhance the pixel points of the double cross lines;
and performing linear fitting on pixel points in the image after the enhancement processing, and determining the eccentric parallax of the product to be detected according to the fitted linear.
8. The eccentric parallax test method according to claim 7,
the off-center parallax includes an X-direction off-center parallax and a Y-direction off-center parallax.
9. An eccentric parallax test device, characterized in that, the eccentric parallax test method of any claim 1 to 8 is used to perform the eccentric parallax test on the product to be tested; the eccentric parallax testing device comprises a product fixing tool, a camera fixing tool and a testing system; wherein, the first and the second end of the pipe are connected with each other,
a product to be detected is limited on the product fixing tool, and a camera is limited on the camera fixing tool;
the camera is used for shooting a test graphic card played by a display screen of the product to be tested and transmitting the test graphic card to the test system;
and the test system is used for determining the eccentric parallax of the product to be tested according to the test graphic card.
CN202011165742.1A 2020-10-27 2020-10-27 Eccentric parallax testing method and device Active CN112362309B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011165742.1A CN112362309B (en) 2020-10-27 2020-10-27 Eccentric parallax testing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011165742.1A CN112362309B (en) 2020-10-27 2020-10-27 Eccentric parallax testing method and device

Publications (2)

Publication Number Publication Date
CN112362309A CN112362309A (en) 2021-02-12
CN112362309B true CN112362309B (en) 2023-03-03

Family

ID=74510762

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011165742.1A Active CN112362309B (en) 2020-10-27 2020-10-27 Eccentric parallax testing method and device

Country Status (1)

Country Link
CN (1) CN112362309B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113155417B (en) * 2021-04-25 2022-10-18 歌尔股份有限公司 Offset state testing method, testing device and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107024339A (en) * 2017-04-21 2017-08-08 杭州蓝斯特科技有限公司 A kind of test device and method for wearing display device
CN107396097A (en) * 2017-09-01 2017-11-24 京东方科技集团股份有限公司 A kind of method and apparatus of the parallax test of virtual reality device
CN107818583A (en) * 2017-11-07 2018-03-20 歌尔股份有限公司 Cross searching detection method and device
CN108734729A (en) * 2018-05-25 2018-11-02 上海复瞻智能科技有限公司 The detection method of binocular parallax in a kind of head-up display system
CN108827602A (en) * 2018-05-31 2018-11-16 华勤通讯技术有限公司 A kind of VR/AR equipment imaging definition measurement method and measuring device
CN109297680A (en) * 2018-08-14 2019-02-01 深圳奥比中光科技有限公司 The detection method and device of light shaft offset error amount
CA3126464A1 (en) * 2019-01-10 2020-07-16 6 Over 6 Vision Ltd. Apparatus, system, and method of determining one or more parameters of a lens

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107515672B (en) * 2017-07-26 2019-06-07 维沃移动通信有限公司 A kind of the display localization method and mobile terminal of virtual reality device
CN107682690A (en) * 2017-10-19 2018-02-09 京东方科技集团股份有限公司 Self-adapting parallax adjusting method and Virtual Reality display system
US20200077073A1 (en) * 2018-08-28 2020-03-05 Qualcomm Incorporated Real-time stereo calibration by direct disparity minimization and keypoint accumulation

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107024339A (en) * 2017-04-21 2017-08-08 杭州蓝斯特科技有限公司 A kind of test device and method for wearing display device
CN107396097A (en) * 2017-09-01 2017-11-24 京东方科技集团股份有限公司 A kind of method and apparatus of the parallax test of virtual reality device
CN107818583A (en) * 2017-11-07 2018-03-20 歌尔股份有限公司 Cross searching detection method and device
CN108734729A (en) * 2018-05-25 2018-11-02 上海复瞻智能科技有限公司 The detection method of binocular parallax in a kind of head-up display system
CN108827602A (en) * 2018-05-31 2018-11-16 华勤通讯技术有限公司 A kind of VR/AR equipment imaging definition measurement method and measuring device
CN109297680A (en) * 2018-08-14 2019-02-01 深圳奥比中光科技有限公司 The detection method and device of light shaft offset error amount
CA3126464A1 (en) * 2019-01-10 2020-07-16 6 Over 6 Vision Ltd. Apparatus, system, and method of determining one or more parameters of a lens

Also Published As

Publication number Publication date
CN112362309A (en) 2021-02-12

Similar Documents

Publication Publication Date Title
JP7292000B2 (en) dynamic camera calibration
CN102207424B (en) Parameter measuring system and method of stereo display device
CN110160749B (en) Calibration device and calibration method applied to augmented reality equipment
CN108898634B (en) Method for accurately positioning embroidery machine target needle eye based on binocular camera parallax
CN110119258B (en) Method and system for testing and adjusting positions of display screen and optical system
CN112614192B (en) On-line calibration method of vehicle-mounted camera and vehicle-mounted information entertainment system
CN104247411B (en) Method and device for correcting distortion errors due to accommodation effect in stereoscopic display
CN109727290A (en) Zoom camera dynamic calibrating method based on monocular vision triangle telemetry
CN108989794B (en) Virtual image information measuring method and system based on head-up display system
CN104751458B (en) A kind of demarcation angular-point detection method based on 180 ° of rotation operators
CN109862345B (en) Method and system for testing field angle
CN108416765A (en) A kind of character defect automatic testing method and system
CN105835507A (en) Method for attaching mobile phone cover lens to liquid crystal display
CN112362309B (en) Eccentric parallax testing method and device
CN104483331A (en) Three-dimensional detection method, three-dimensional detection device and three-dimensional detection system for connector contact pin
CN108462867A (en) The system and method for automatic Calibration tracking mode bore hole stereoscopic display equipment
CN207223200U (en) A kind of marking on the fly system to be tested the speed based on general galvanometer and vision
CN111638227B (en) VR optical module picture defect detection method and device
CN108548655B (en) Imaging precision measuring system and method and testing host
CN109741294B (en) Pupil distance testing method and equipment
EP3977724B1 (en) Method for detection of deviation from a calibration for a stereo camera system and stereo camera system therefor
CN114909999A (en) Three-dimensional measurement system and method based on structured light
EP4054187A1 (en) Calibration method of a portable electronic device
CN114062265A (en) Method for evaluating stability of supporting structure of visual system
CN114219758A (en) Defect detection method, system, electronic device and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant