CN115035100B - Scene identification platform applying panoramic picture analysis - Google Patents

Scene identification platform applying panoramic picture analysis Download PDF

Info

Publication number
CN115035100B
CN115035100B CN202210826659.7A CN202210826659A CN115035100B CN 115035100 B CN115035100 B CN 115035100B CN 202210826659 A CN202210826659 A CN 202210826659A CN 115035100 B CN115035100 B CN 115035100B
Authority
CN
China
Prior art keywords
tire
panoramic picture
scene
air pressure
wall
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210826659.7A
Other languages
Chinese (zh)
Other versions
CN115035100A (en
Inventor
谢国华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangyin Heat Resistant Wire and Cable Factory Co Ltd
Original Assignee
Jiangyin Heat Resistant Wire and Cable Factory Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangyin Heat Resistant Wire and Cable Factory Co Ltd filed Critical Jiangyin Heat Resistant Wire and Cable Factory Co Ltd
Priority to CN202210826659.7A priority Critical patent/CN115035100B/en
Publication of CN115035100A publication Critical patent/CN115035100A/en
Priority to GBGB2214695.5A priority patent/GB202214695D0/en
Application granted granted Critical
Publication of CN115035100B publication Critical patent/CN115035100B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/50Depth or shape recovery
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image

Abstract

The invention relates to a scene identification platform applying panoramic picture analysis, which comprises: the shake detection equipment is used for sending out a shake overrun signal when the current shake amplitude of the vehicle body is greater than or equal to a set amplitude threshold value; the air pressure measuring equipment is used for triggering air pressure measuring action inside the vehicle tire when receiving the jitter overrun signal; and the scene identification equipment is used for sending an over-extrusion signal when the depth of field value of a certain inner wall pixel point in the received in-fetal panoramic picture is less than or equal to a set depth of field threshold value. The scene identification platform applying the panoramic picture analysis is stable in layered identification and operation. The current scene of the tire can be judged before the panoramic image analysis is performed on the inner part of the tire, so that other identification modes with less computation or capable of acquiring indirect data are adopted to analyze the state of the tire when the extrusion is not serious, and the layered identification processing of the current scene of the tire is realized.

Description

Scene identification platform applying panoramic picture analysis
Technical Field
The invention relates to the field of image processing, in particular to a scene identification platform applying panoramic picture analysis.
Background
Image processing includes various specific image information processing modes, such as image enhancement, which aims to improve the quality of pictures, such as increasing contrast, removing blur and noise, correcting geometric distortion, and the like; image restoration is a technique that attempts to estimate the original image, assuming a model of known blur or noise. Image enhancement can be divided into frequency domain and spatial domain methods, depending on the method used. The former regards an image as a two-dimensional signal, which is subjected to signal enhancement based on two-dimensional fourier transform. The noise in the image can be removed by adopting a low-pass filtering method (namely, only a low-frequency signal passes through the low-pass filtering method); by adopting a high-pass filtering method, high-frequency signals such as edges and the like can be enhanced, so that a blurred picture becomes clear. Typical spatial domain algorithms include local averaging and median filtering (taking the median pixel value in the local neighborhood), which are used to remove or attenuate noise
At present, image processing can be used in the fine analysis of various application fields, however, since the image processing brings about the fine analysis and also brings about a large amount of operation data, for example, judgment of the tire squeezing degree, people often want to start the image processing when the fine analysis is needed, general non-fine analysis under other scenes can replace the image processing to achieve the same result, and obviously, there is no corresponding technical scheme in this fine division field of the tire squeezing degree judgment.
Disclosure of Invention
In order to solve the above problems, the present invention provides a scene evaluation platform applying panoramic picture analysis, which can determine a current scene of a tire before performing high-precision panoramic image analysis on the inside of the tire to obtain a tire squeezing degree, and perform tire condition analysis using other evaluation modes with a small amount of computation or capable of obtaining indirect data when squeezing is not serious, thereby avoiding always getting into large-scale data computation while ensuring a reliable analysis result.
According to an aspect of the present invention, there is provided a scene discrimination platform applying panorama picture analysis, the platform comprising:
the shake detection equipment is arranged on a vehicle body of the vehicle and used for detecting the current shake amplitude of the vehicle body and sending a shake overrun signal when the current shake amplitude is larger than or equal to a set amplitude threshold;
the air pressure measuring equipment is buried in the vehicle tire, is in bidirectional connection with the jitter detection equipment through a wireless communication link, and is used for triggering air pressure measuring action in the vehicle tire to obtain real-time measured air pressure when receiving a jitter overrun signal;
the action triggering device is connected with the air pressure measuring device and is used for sending a first triggering instruction when the received real-time measured air pressure is greater than or equal to a preset air pressure threshold value;
the customized camera set is connected with the action trigger equipment and used for entering a working state after receiving the first trigger instruction, the customized camera set comprises a synchronous control unit, a data combination unit and a plurality of embedded cameras, the customized camera set is respectively embedded in a circle of a wheel hub corresponding to the wheel hub and facing the inner wall of the wheel hub inside the wheel hub, and the positions of the embedded cameras are uniformly distributed along the circle so as to realize image acquisition of different positions inside the wheel hub and obtain a plurality of real-time acquisition images;
the tire body extraction device is connected with the data combination unit and used for extracting each inner wall pixel point in the tire inner panoramic picture based on the imaging characteristics of the tire inner wall;
the scene identification equipment is connected with the tire body extraction device and is used for sending an over-extrusion signal when the depth of field value of a certain inner wall pixel point in the received in-tire panoramic picture is shallower than or equal to a set depth of field threshold value;
the scene identification equipment is further used for determining the corresponding tire extrusion grade based on the shallowest depth of field value in the depth of field values respectively corresponding to the inner wall pixel points in the received in-tire panoramic picture.
According to another aspect of the present invention there is also provided a method of scene qualification using panoramic picture analysis, the method comprising using a scene qualification platform as described above using panoramic picture analysis for capturing an in-tire panoramic picture using a synchronous control mechanism and performing a targeted picture analysis to determine a current tire compression level.
The scene identification platform applying the panoramic picture analysis is stable in layered identification and operation. The current scene of the tire can be judged before the panoramic image analysis is performed on the inner part of the tire, so that other identification modes with less computation or capable of acquiring indirect data are adopted to analyze the state of the tire when the extrusion is not serious, and the layered identification processing of the current scene of the tire is realized.
Brief description of the drawings
The numerous advantages of the present invention may be better understood by those skilled in the art by reference to the accompanying drawings in which:
fig. 1 is a schematic diagram of an internal structure of a scene authentication platform applying panorama picture analysis according to the present invention.
Fig. 2 is a view illustrating a usage scenario of an embedded camera used in a scene authentication platform applying panoramic picture analysis according to the present invention.
Detailed Description
An embodiment of a scene discrimination platform to which panorama picture analysis is applied according to the present invention will be described in detail with reference to the accompanying drawings.
Conventional tire pressure monitoring systems can be divided into two categories: one is an indirect tire pressure monitoring system, which judges whether the tire is abnormal or not through the rotation speed difference of the tire; the other type is a direct type tire pressure monitoring system, four tire pressure monitoring sensors are additionally arranged in a tire, so that the pressure and the temperature of the tire are automatically monitored in real time in the static or driving process of the automobile, and the high pressure, the low pressure and the high temperature of the tire are alarmed in time, so that traffic accidents caused by tire faults are avoided, and the driving safety is ensured.
At present, image processing can be used in the fine analysis of various application fields, however, since the image processing brings about both the fine analysis and a large amount of calculation data, for example, the judgment of the tire squeezing degree, people often want to start the image processing when the fine analysis is needed, general non-fine analysis under other scenes can replace the image processing to achieve the same result, and obviously, there is no corresponding technical scheme in this fine division field of the tire squeezing degree judgment.
In order to overcome the defects, the invention builds a scene identification platform applying panoramic picture analysis, and can effectively solve the corresponding technical problem.
The invention has at least the following two significant technical advances: (1) Capturing an in-tire panoramic picture by adopting a synchronous control mechanism and performing targeted picture analysis to determine the current tire extrusion level and determine whether the tire is extruded excessively currently; (2) And a three-level trigger mechanism is adopted to improve the tire extrusion analysis efficiency and reduce the system power consumption as much as possible, and the three-level detection mechanism comprises a first-level vehicle body shake detection, a second-level tire internal air pressure detection and a third-level depth of field detection based on image analysis.
Fig. 1 is a schematic diagram of the internal structure of a scene authentication platform applying panoramic picture analysis according to the present invention, the platform including:
the shake detection equipment is arranged on a vehicle body of the vehicle and used for detecting the current shake amplitude of the vehicle body and sending a shake overrun signal when the current shake amplitude is larger than or equal to a set amplitude threshold;
the air pressure measuring equipment is buried in the vehicle tire, is in bidirectional connection with the jitter detection equipment through a wireless communication link, and is used for triggering air pressure measuring action in the vehicle tire to obtain real-time measured air pressure when receiving a jitter overrun signal;
the action triggering device is connected with the air pressure measuring device and is used for sending a first triggering instruction when the received real-time measured air pressure is greater than or equal to a preset air pressure threshold value;
the customized camera set is connected with the action triggering device and used for entering a working state after receiving the first triggering instruction, the customized camera set comprises a synchronous control unit, a data combination unit and a plurality of embedded cameras, the customized camera set is respectively embedded into a circular circumference of the inner wall of the hub, facing the inner part of the tire, of the corresponding hub of the vehicle tire, and the embedded positions are uniformly distributed along the circumference so as to realize the image acquisition of different positions in the vehicle tire and obtain a plurality of real-time acquisition images;
FIG. 2 is a schematic view of a usage scenario of an embedded camera used by a scene authentication platform applying panoramic picture analysis in accordance with the present invention;
as shown in fig. 2, a use scenario of each embedded camera is given, namely, the embedded camera is installed at a corresponding position of the inner wall of the hub to face the inner wall of the opposite tire to perform picture acquisition within a visual angle range;
in fig. 2, the embedded camera includes a camera lens 1, a mounting plane 2, and a data access interface 3;
the tire body extraction device is connected with the data combination unit and used for extracting each inner wall pixel point in the panoramic image in the tire based on the imaging characteristics of the inner wall of the tire;
the scene identification equipment is connected with the tire body extraction device and is used for sending an over-extrusion signal when the depth of field value of a certain inner wall pixel point in the received in-tire panoramic picture is shallower than or equal to a set depth of field threshold value;
the scene identification equipment is further used for determining the corresponding tire extrusion grade based on the shallowest depth of field value in the depth of field values respectively corresponding to all inner wall pixel points in the received in-tire panoramic picture;
the scene identification equipment is further used for determining the content related to the corresponding tire extrusion grade based on the shallowest depth of field value in the depth of field values respectively corresponding to all inner wall pixel points in the received in-tire panoramic picture, wherein the shallowest depth of field value in the depth of field values respectively corresponding to all inner wall pixel points in the received in-tire panoramic picture represents the reference value of the shortest distance from the inner wall of the tire carcass to the tire shaft body, the smaller the value of the shallowest depth of field value is, the shorter the shortest distance from the inner wall of the tire carcass to the tire shaft body is, the larger the tire is pressed, and the higher the corresponding tire extrusion grade is.
Next, the detailed structure of the scene discrimination platform to which the panoramic image analysis is applied according to the present invention will be further described.
The scene identification platform applying the panoramic picture analysis may further include:
and the central control display mechanism is arranged in the vehicle, is electrically connected with the scene identification equipment, and is used for receiving and displaying the over-extrusion signal and the tire extrusion grade.
In the scene identification platform applying the panoramic picture analysis:
determining the corresponding tire extrusion grade based on the shallowest depth of field value of the depth of field values respectively corresponding to the inner wall pixel points in the received in-tire panoramic picture comprises the following steps: and the determined corresponding tire extrusion grade is reversely associated with the shallowest depth of field value in the depth of field values respectively corresponding to the inner wall pixel points in the received in-tire panoramic picture.
In the scene identification platform applying the panoramic picture analysis:
extracting each inner wall pixel point in the panoramic picture in the tire based on the imaging characteristics of the inner wall of the tire comprises the following steps: and extracting each inner wall pixel point in the in-tire panoramic picture based on the gray value distribution interval of the inner wall of the tire.
In the scene identification platform applying the panoramic picture analysis:
extracting each inner wall pixel point in the panoramic picture in the tire based on the brightness value distribution interval of the inner wall of the tire comprises the following steps: and when the brightness value of a certain pixel point in the intra-tire panoramic picture is in the brightness value distribution interval of the inner wall of the tire, judging that the certain pixel point is an inner wall pixel point.
In the scene identification platform applying the panoramic picture analysis:
based on the regional extraction of the luminance numerical value distribution of tire inner wall each inner wall pixel in the child panorama picture still includes: and when the brightness value of a certain pixel point in the intra-tire panoramic picture is outside the brightness value distribution interval of the inner wall of the tire, judging that the certain pixel point is other pixel points.
In the scene identification platform applying the panoramic picture analysis:
the positions respectively embedded in the circumference of a circular shape presented by the inner wall of the hub of the corresponding hub of the vehicle tire facing the tire inner part comprise that: the depths of the inner walls of the hubs, which are respectively embedded in the corresponding hubs of the vehicle tire and face the interior of the tire, are equal.
In the scene identification platform applying the panoramic picture analysis:
the action triggering device is also used for sending a second triggering instruction when the received real-time measured air pressure is smaller than the preset air pressure threshold value;
and the customized camera set is further used for entering a sleeping state after receiving the second trigger instruction.
In the scene identification platform applying the panoramic picture analysis:
establishing a bidirectional connection with the jitter detection device over a wireless communication link includes: and establishing bidirectional connection with the jitter detection equipment through a Bluetooth communication link.
And in the scene authentication platform applying panoramic picture analysis:
the jitter detection equipment is also used for sending out a vehicle body stability signal when the current jitter amplitude is smaller than the set amplitude threshold value;
the air pressure measuring device is also used for stopping executing the air pressure measuring action on the inner part of the vehicle tire when receiving the vehicle body stable signal.
Meanwhile, in order to overcome the defects, the invention also builds a scene identification method applying the panoramic picture analysis, and the method comprises the step of using a scene identification platform applying the panoramic picture analysis and used for capturing the intra-fetal panoramic picture by adopting a synchronous control mechanism and executing the targeted picture analysis to determine the current tire extrusion level.
In addition, in the scene identification platform applying the panoramic picture analysis, the reversely associating the determined corresponding tire extrusion grade with the shallowest depth of field value of the depth of field values respectively corresponding to the inner wall pixel points in the received in-tire panoramic picture comprises: the shallower depth of field value of the depth of field values respectively corresponding to all inner wall pixel points in the received in-tire panoramic picture is smaller, and the higher the determined corresponding tire extrusion grade is.
While the foregoing has been described as best modes and/or other examples, it is to be understood that various modifications may be made therein and that the subject matter disclosed herein may be implemented in various forms and examples, and that the teachings may be applied in numerous applications, only some of which have been disclosed herein. The following claims are intended to claim any and all applications, modifications and variations that fall within the true scope of the present teachings.

Claims (7)

1. A scene discrimination platform applying panoramic picture analysis, the platform comprising:
the shake detection equipment is arranged on a vehicle body of the vehicle and used for detecting the current shake amplitude of the vehicle body and sending a shake overrun signal when the current shake amplitude is larger than or equal to a set amplitude threshold;
the air pressure measuring equipment is buried in the vehicle tire, is in bidirectional connection with the jitter detection equipment through a wireless communication link, and is used for triggering the air pressure measuring action in the vehicle tire to obtain real-time measured air pressure when receiving a jitter overrun signal;
the action triggering device is connected with the air pressure measuring device and is used for sending a first triggering instruction when the received real-time measured air pressure is greater than or equal to a preset air pressure threshold value;
the customized camera set is connected with the action triggering device and used for entering a working state after receiving the first triggering instruction, the customized camera set comprises a synchronous control unit, a data combination unit and a plurality of embedded cameras, the customized camera set is respectively embedded into a circular circumference of the inner wall of the hub, facing the inner part of the tire, of the corresponding hub of the vehicle tire, and the embedded positions are uniformly distributed along the circumference so as to realize the image acquisition of different positions in the vehicle tire and obtain a plurality of real-time acquisition images;
the carcass extraction device is connected with the data combination unit and used for extracting all inner wall pixel points in the in-tire panoramic picture based on the imaging characteristics of the inner wall of the tire, including extracting all inner wall pixel points in the in-tire panoramic picture based on the brightness value distribution interval of the inner wall of the tire, when the brightness value of a certain pixel point in the in-tire panoramic picture is in the brightness value distribution interval of the inner wall of the tire, the certain pixel point is judged as an inner wall pixel point, and when the brightness value of the certain pixel point in the in-tire panoramic picture is out of the brightness value distribution interval of the inner wall of the tire, the certain pixel point is judged as other pixel points;
the scene identification equipment is connected with the tire body extraction device and is used for sending an over-extrusion signal when the depth of field value of a certain inner wall pixel point in the received in-tire panoramic picture is less than or equal to a set depth of field threshold value;
the scene identification equipment is further used for determining a corresponding tire extrusion grade based on the shallowest depth of field value in the depth of field values respectively corresponding to all the inner wall pixel points in the received in-tire panoramic picture, and the determined corresponding tire extrusion grade is reversely associated with the shallowest depth of field value in the depth of field values respectively corresponding to all the inner wall pixel points in the received in-tire panoramic picture.
2. The scene discrimination platform applying panoramic picture analysis according to claim 1, wherein the platform further comprises:
and the central control display mechanism is arranged in the vehicle, is electrically connected with the scene identification equipment, and is used for receiving and displaying the over-extrusion signal and the tire extrusion grade.
3. A scene discrimination platform applying panoramic picture analysis according to any of claims 1-2, characterized in that:
the positions respectively embedded in the circumference of a circular shape presented by the inner wall of the hub of the corresponding hub of the vehicle tire facing the tire inner part comprise that: the depths of the inner walls of the hubs, which are respectively embedded in the corresponding hubs of the vehicle tire and face the interior of the tire, are equal.
4. A scene discrimination platform applying panoramic picture analysis according to any of claims 1-2, characterized in that:
the action triggering device is also used for sending a second triggering instruction when the received real-time measured air pressure is smaller than the preset air pressure threshold value;
and the customized camera set is further used for entering a sleep state after receiving the second trigger instruction.
5. A scene discrimination platform applying panorama picture analysis according to any of claims 1-2, wherein:
establishing a bidirectional connection with the jitter detection device over a wireless communication link includes: and establishing bidirectional connection with the jitter detection equipment through a Bluetooth communication link.
6. A scene discrimination platform applying panorama picture analysis according to any of claims 1-2, wherein:
the jitter detection equipment is also used for sending out a vehicle body stability signal when the current jitter amplitude is smaller than the set amplitude threshold value;
the air pressure measuring device is also used for stopping executing the air pressure measuring action on the inner part of the vehicle tire when receiving the vehicle body stable signal.
7. A method of scene qualification using panoramic picture analysis, the method comprising providing a scene qualification platform using panoramic picture analysis as claimed in any of claims 1 to 6 for capturing an in-tyre panoramic picture using a synchronous control mechanism and performing a targeted picture analysis to determine a current tyre squeeze level.
CN202210826659.7A 2022-07-13 2022-07-14 Scene identification platform applying panoramic picture analysis Active CN115035100B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202210826659.7A CN115035100B (en) 2022-07-14 2022-07-14 Scene identification platform applying panoramic picture analysis
GBGB2214695.5A GB202214695D0 (en) 2022-07-13 2022-10-06 Object state judgment system using visual inspection and scene identification platform using panoramic image analysis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210826659.7A CN115035100B (en) 2022-07-14 2022-07-14 Scene identification platform applying panoramic picture analysis

Publications (2)

Publication Number Publication Date
CN115035100A CN115035100A (en) 2022-09-09
CN115035100B true CN115035100B (en) 2023-01-06

Family

ID=83128919

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210826659.7A Active CN115035100B (en) 2022-07-13 2022-07-14 Scene identification platform applying panoramic picture analysis

Country Status (1)

Country Link
CN (1) CN115035100B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115439460B (en) * 2022-09-22 2023-03-10 江阴市耐热电线电缆厂有限公司 Heat-resisting cable laying scene identification system
CN115339962B (en) * 2022-10-13 2022-12-16 江阴市耐热电线电缆厂有限公司 Heat-resisting cable laying groove depth analysis device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9071752B2 (en) * 2012-09-25 2015-06-30 National Chiao Tung University Scene imaging method using a portable two-camera omni-imaging device for human-reachable environments
CN112572077B (en) * 2019-09-30 2022-03-15 比亚迪股份有限公司 Vehicle and control method and control device thereof
CN112611582B (en) * 2020-11-02 2022-04-22 山东华通二手车信息技术有限公司 Tire state real-time analysis platform and method
CN113992839A (en) * 2021-09-07 2022-01-28 施化灿 Pan-tilt control platform for judging application direction

Also Published As

Publication number Publication date
CN115035100A (en) 2022-09-09

Similar Documents

Publication Publication Date Title
CN115035100B (en) Scene identification platform applying panoramic picture analysis
TWI613905B (en) Anomaly image detecting device, image processing system including abnormal image detecting device, and vehicle equipped with image processing system
JP4374211B2 (en) Lane marker position detection method, lane marker position detection device, and lane departure warning device
JP5809751B2 (en) Object recognition device
US20110235925A1 (en) Image monitoring system
JP3255360B2 (en) Inspection method of distance data and its inspection device
CN105825184A (en) Vehicle data processing method and device
CN108345855B (en) Lane line pressing detection method and system
CN107798688B (en) Moving target identification method, early warning method and automobile rear-end collision prevention early warning device
WO2013047088A1 (en) Biometric device
JP2001211466A (en) Image processing system having self-diagnostic function
KR102066290B1 (en) Image recognition apparatus and method thereof
CN110728212A (en) Road well lid monitoring device and method based on computer vision
JP2002197588A (en) Method for discriminating tire type of traveling vehicle and method and device for discriminating vehicle model
KR20190036897A (en) Tire abrasion mesuring apparatus, method and computer redable recording medium
CN116246251A (en) Vehicle bottom safety detection method and system
CN108875641B (en) Long-term parallel driving identification method and system for expressway
CN107609498B (en) Data processing method of computer monitoring system
WO2017208585A1 (en) Image display system
JP2008028478A (en) Obstacle detection system, and obstacle detecting method
TWI579173B (en) An driver fatigue monitoring and detection method base on an ear-angle
CN105740788A (en) In-vehicle abnormality anti-theft method based on inter-frame histogram disturbance detection
US20200130581A1 (en) Reverse image display method
CN112212937A (en) Water level monitoring method and device, electronic equipment and storage medium
CN110798680A (en) Single-frame no-reference self-adaptive video snowflake noise detection method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant