CN114359521A - AR technology-based digital warehousing system and method - Google Patents

AR technology-based digital warehousing system and method Download PDF

Info

Publication number
CN114359521A
CN114359521A CN202111577149.2A CN202111577149A CN114359521A CN 114359521 A CN114359521 A CN 114359521A CN 202111577149 A CN202111577149 A CN 202111577149A CN 114359521 A CN114359521 A CN 114359521A
Authority
CN
China
Prior art keywords
module
information
warehouse
image
warehousing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111577149.2A
Other languages
Chinese (zh)
Other versions
CN114359521B (en
Inventor
张潇
曾晔
王德封
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
E Surfing Reading Culture Communications Co Ltd
Original Assignee
E Surfing Reading Culture Communications Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by E Surfing Reading Culture Communications Co Ltd filed Critical E Surfing Reading Culture Communications Co Ltd
Priority to CN202111577149.2A priority Critical patent/CN114359521B/en
Publication of CN114359521A publication Critical patent/CN114359521A/en
Application granted granted Critical
Publication of CN114359521B publication Critical patent/CN114359521B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/08Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087Inventory or stock management, e.g. order filling, procurement or balancing against orders
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Economics (AREA)
  • Quality & Reliability (AREA)
  • Marketing (AREA)
  • Development Economics (AREA)
  • Human Computer Interaction (AREA)
  • Accounting & Taxation (AREA)
  • Human Resources & Organizations (AREA)
  • Finance (AREA)
  • Operations Research (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a digital warehousing system and a digital warehousing method based on AR technology, which comprise a control module, a communication interface module and a virtual enhancement module, wherein the control module is in control connection with the virtual enhancement module through the communication interface module; the invention is safe and reliable, and the control modes in various modes are realized by the matched use of the gesture recognition module, the voice recognition module and the touch screen feedback module in the control module, so that the use is convenient; the data analysis and processing module automatically analyzes and knows the information in the warehouse bin, and the early warning module alarms the safety accidents and the products at the time of emergency, so that the processing is convenient in time; warehouse information is automatically acquired through a field image acquisition module, an image analysis processing module, an equipment element module, a data analysis module and a 3D image construction module in the virtual enhancement module, and a 3D picture is constructed, so that a user is personally on the scene, remote interaction is realized, and the use experience of the user is improved.

Description

AR technology-based digital warehousing system and method
Technical Field
The invention relates to the technical field of AR, in particular to a digital warehousing system and a digital warehousing method based on AR technology.
Background
With the vigorous development of the logistics industry, certain requirements are made on the use of the warehousing system. However, the existing warehousing system has low automation degree, needs more workers for matching use, and is easy to cause safety accidents, and along with the development of the AR technology, the high automation of the warehousing system can be realized through the combination of the AR technology and the warehousing system and the remote control, and the occurrence of safety accidents is reduced.
Disclosure of Invention
In order to solve the defects of the prior art, realize the purposes of reducing the labor cost, improving the automation degree and avoiding safety accidents, the invention adopts the following technical scheme:
a digital warehousing system based on AR technology comprises: the system comprises a control module, a communication interface module and a virtual enhancement module;
the virtual enhancement module comprises a field image acquisition module, an image analysis processing module, an equipment element module, a data analysis module, a 3D graph construction module and an animation library storage module; the field image acquisition module acquires an empty warehouse image and a full warehouse image, and integrates a plurality of acquired images through the image analysis processing module to remove fuzzy images; the equipment element module acquires the warehousing information and performs analysis processing through the data analysis module; the 3D image construction module acquires the integrated empty warehouse image and the analyzed and processed empty warehouse information, constructs a 3D image and stores the 3D image through the animation warehouse storage module; importing the constructed 3D image, the integrated full-warehouse image and the analyzed full-warehouse information into a 3D image construction module to construct a real-time 3D image; transmitting the real-time 3D image and the warehousing information to a control module through the communication interface module;
the control module comprises a transmission module, a display module, a data analysis processing module, an early warning module and an instruction acquisition module; the transmission module receives the real-time 3D images and the warehousing information, and the real-time 3D images and the warehousing information in the warehouse are displayed through the display module; the data analysis processing module analyzes the warehousing information and warns the condition meeting the warning condition through the early warning module; according to the warning, the instruction acquisition module is used for acquiring the instruction, and the transmission module is used for controlling the warehouse site, so that the aim of remote control is fulfilled.
The virtual enhancement module further comprises an order tracking module and a monitoring module, the order tracking module is connected with the data analysis module, the warehouse information further comprises logistics information, and when the warehouse needs to enter or leave the warehouse, the warehouse information is tracked, recorded and updated through the order tracking module according to the logistics information, and the record is monitored through the monitoring module.
Furthermore, the display module comprises a storage state display module and a storage information display module which are respectively used for displaying the real-time 3D images and the storage information in the warehouse.
Further, the warehousing information comprises warehouse information and product information, the warehousing information display module respectively displays the warehouse information and the product information, and the empty warehouse information and the full warehouse information are full warehouse information and empty warehouse information respectively.
Further, the early warning module comprises a safety warning module and a temporary product warning module, and when the product stacking state information and the temporary product information analyzed by the data analysis processing module reach warning conditions, warning is performed through the safety warning module and the temporary product warning module respectively.
Further, the instruction acquisition module comprises a gesture recognition module, a voice recognition module and a touch screen feedback module, and is used for respectively acquiring the gesture, voice and touch screen feedback instructions of the terminal user and processing the on-site warning of the warehouse.
A digital warehousing method based on AR technology comprises the following steps:
s1, collecting images of an empty warehouse and images of a full warehouse, integrating the collected images, and removing fuzzy images;
s2, acquiring warehousing information and analyzing;
s3, constructing a 3D image through the integrated empty warehouse image and the analyzed and processed empty warehouse information;
s4, constructing a real-time 3D image by the constructed 3D image, the integrated full-warehouse image and the analyzed full-warehouse information;
s5, displaying the real-time 3D image and the warehousing information, analyzing the warehousing information, and warning the condition meeting the warning condition;
and S6, controlling the warehouse site according to the warning, and achieving the purpose of remote control.
Further, the warehouse information also comprises logistics information, and according to the logistics information, when the warehouse needs to enter the warehouse or leave the warehouse, the warehouse information is tracked, recorded and updated.
Further, the warehousing information comprises warehouse information and product information, and the empty warehouse information and the full warehouse information are full warehouse information and empty warehouse information respectively.
Further, the information of the alarm condition, including the product stacking state information and the temporary product information, is respectively warned when reaching the threshold of the other party and/or the threshold of the temporary product.
The invention has the advantages and beneficial effects that:
the invention is safe and reliable, and the control mode of various modes is realized by the matched use of the gesture recognition module, the voice recognition module and the touch screen feedback module in the control module, so that the use is convenient; the data analysis and processing module automatically analyzes and knows the information in the warehouse bin, and the early warning module alarms the safety accidents and the products at the time of emergency, so that the processing is convenient in time; warehouse information is automatically acquired through a field image acquisition module, an image analysis processing module, an equipment element module, a data analysis module and a 3D image construction module in the virtual enhancement module, and a 3D picture is constructed, so that a user is personally on the scene, remote interaction is realized, and the use experience of the user is improved.
Drawings
FIG. 1 is a schematic diagram of the system architecture of the present invention.
Fig. 2 is a schematic diagram of the operation of the system of the present invention.
Fig. 3 is a flow chart of the method of the present invention.
Fig. 4 is a working principle diagram of the present invention.
Detailed Description
The following detailed description of embodiments of the invention refers to the accompanying drawings. It should be understood that the detailed description and specific examples, while indicating the present invention, are given by way of illustration and explanation only, not limitation.
The embodiment provided by the invention comprises the following steps: as shown in fig. 1 and 2, a digital warehousing system based on AR technology includes a control module 1, a communication interface module 2, and a virtual enhancement module 3, wherein the control module 1 is in control connection with the virtual enhancement module 3 through the communication interface module 2.
The control module 1 consists of a transmission module 11, a display module 12, a data analysis processing module 13, an early warning module 14, a gesture recognition module 15, a voice recognition module 16 and a touch screen feedback module 17; the transmission module 11 is in control connection with the data analysis processing module 13, the data analysis processing module 13 is in control connection with the display module 12 and the early warning module 14 respectively, the early warning module 14 is in control connection with the display module 12, and the gesture recognition module 15, the sound recognition module 16 and the touch screen feedback module 17 are in control connection with the data analysis processing module 13; the display module 12 is composed of a warehousing state display module 121 and a warehousing information display module 122, the early warning module 14 is composed of a safety warning module 141 and a provisional product warning module 142, and the warehousing state display module 121, the warehousing information display module 122, the safety warning module 141 and the provisional product warning module 142 are all in control connection with the data analysis processing module 13.
The virtual enhancement module 3 is composed of a field image acquisition module 31, an image analysis processing module 32, an equipment element module 33, a data analysis module 34, a 3D graph construction module 35, an animation library storage module 36, an order tracking module 37 and a monitoring module 38; the field image acquisition module 31 is in control connection with the image analysis processing module 32, the image analysis processing module 32 and the equipment element module 33 are in control connection with the data analysis module 34, the data analysis module 34 is in control connection with the 3D graph construction module 35, the 3D graph construction module 35 is in control connection with the animation library storage module 36, the data analysis module 34 is in control connection with the order tracking module 37, and the order tracking module 37 is in control connection with the monitoring module 38.
As shown in fig. 3 and 4, the field image collecting module 31 collects field images of empty warehouse and warehouse images of full warehouse, inputs warehouse information and stored product information through the device element module 33, integrates a plurality of collected images through the image analyzing and processing module 32 to remove blurry images, the integrated video image has 1920 × 1080 effective pixels, the maximum pixel is 601 ten thousand, the optical zoom is 17 times, the effective pixel is 400 ten thousand, and the maximum resolution is 1920 × 1080, analyzes and processes the collected warehouse information and the stored product information through the data analyzing module 34, introduces the analyzed empty warehouse information and the processed empty warehouse images into the 3D image constructing module 35 to construct a 3D image, stores the 3D image in the animation library storage module 36, and then stores the 3D image and the processed warehouse images of full warehouse, The stored product information is combined and led into the 3D graph construction module 35, a real-time 3D image is constructed, then the real-time 3D image and the warehousing information are transmitted to the control module 1 through the communication interface module 2, a worker receives the 3D image and the warehousing information through the transmission module 11 in the control module 1, the 3D image in the warehouse is displayed through the warehousing state display module 121 in the display module 12, the data of the product, the warehouse data and the logistics data are displayed through the warehousing information display module 122 in the display module 12, and the product data table, the warehouse data table and the logistics data table are respectively as the following table 1, the table 2 and the table 3:
table 1:
data item numbering Commodity numbering device
Alias name Is free of
Brief description of the drawings Certain commodity
Type (B) Character type
Length of 8 bytes
Table 2:
data item numbering 1-1
Data item name Stock quantity
Brief description of the drawings Number of various kinds of commodities
Type (B) Numerical type
Length of Five-digit integer
Table 3:
data stream name Warehousing bill
Brief description of the drawings Filled in by the purchasing staffCommodity warehousing voucher
Data stream source Purchasing personnel
Data stream composition Date | + warehousing list number + commodity number + warehousing number
Through the constructed product data table, warehouse data table and logistics data table, the incidence relation among the product information, the warehouse information and the logistics information is established, and the product stacking state information and the temporary product information are provided for the data analysis processing module 13 and are used for early warning analysis and triggering.
Then, the data analysis processing module 13 analyzes the warehousing information to obtain product stacking state information and temporary product information, the information is respectively warned through the safety warning module 141 and the temporary product warning module 142, when workers know safety warning or temporary product warning, commands can be input through gestures, sounds and touch screens, the system obtains command information through the gesture recognition module 15, the sound recognition module 16 and the touch screen feedback module 17 and transmits the command information to field workers through the transmission module 11, the field workers process safety warning or temporary product warning through commands to achieve the purpose of remote control, and when warehouses need to enter or leave warehouses, data are tracked and recorded through the warehouse order tracking module 37, and records are monitored and monitored through the monitoring module 38.
The above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. A digital warehousing system based on AR technology comprises: control module (1), communication interface module (2), virtual enhancement module (3), its characterized in that:
the virtual enhancement module (3) comprises a field image acquisition module (31), an image analysis processing module (32), an equipment element module (33), a data analysis module (34), a 3D (three-dimensional) graph construction module (35) and an animation library storage module (36); a field image acquisition module (31) acquires images of an empty warehouse and images of a full warehouse, and a plurality of acquired images are integrated through an image analysis processing module (32); the equipment element module (33) acquires the warehousing information and carries out analysis processing through the data analysis module (34); the 3D image construction module (35) acquires the integrated empty warehouse image and the analyzed and processed empty warehouse information, constructs a 3D image and stores the 3D image through the animation warehouse storage module (36); the constructed 3D image, the integrated full-warehouse image and the analyzed full-warehouse information are led into a 3D image construction module (35) to construct a real-time 3D image; transmitting the real-time 3D image and the warehousing information to a control module (1) through the communication interface module (2);
the control module (1) comprises a transmission module (11), a display module (12), a data analysis processing module (13), an early warning module (14) and an instruction acquisition module; the transmission module (11) receives the real-time 3D images and the warehousing information, and the real-time 3D images and the warehousing information in the warehouse are displayed through the display module (12); the data analysis processing module (13) analyzes the warehousing information and warns the condition meeting the warning condition through the early warning module (14); according to the warning, the instruction acquisition module is used for acquiring the instruction, and the warehouse site is controlled through the transmission module (11).
2. The AR technology-based digital warehousing system of claim 1, wherein: the virtual enhancement module (3) further comprises an order tracking module (37) and a monitoring module (38), the order tracking module (37) is connected with the data analysis module (34), the warehousing information further comprises logistics information, the order tracking module (37) tracks and records and updates warehouse information according to the logistics information, and the monitoring module (38) monitors and records.
3. The AR technology-based digital warehousing system of claim 1, wherein: the display module (12) comprises a storage state display module (121) and a storage information display module (122) which are respectively used for displaying real-time 3D images and storage information in the storage.
4. The AR technology-based digital warehousing system of claim 3, wherein: the warehousing information comprises warehouse information and product information, the warehousing information display module (122) respectively displays the warehouse information and the product information, and the empty warehouse information and the full warehouse information are full warehouse information and empty warehouse information respectively.
5. The AR technology-based digital warehousing system of claim 1, wherein: the early warning module (14) comprises a safety warning module (141) and a temporary product warning module (142), and when the product stacking state information and the temporary product information analyzed by the data analysis processing module (13) reach warning conditions, warning is respectively carried out through the safety warning module (141) and the temporary product warning module (142).
6. The AR technology-based digital warehousing system of claim 1, wherein: the instruction acquisition module comprises a gesture recognition module (15), a voice recognition module (16) and a touch screen feedback module (17), and is used for respectively acquiring gestures, voice and touch screen feedback instructions of a terminal user and processing the on-site warning of the warehouse.
7. A digital warehousing method based on AR technology is characterized by comprising the following steps:
s1, collecting images of empty and full warehouses, and integrating the collected images;
s2, acquiring warehousing information and analyzing;
s3, constructing a 3D image through the integrated empty warehouse image and the analyzed and processed empty warehouse information;
s4, constructing a real-time 3D image by the constructed 3D image, the integrated full-warehouse image and the analyzed full-warehouse information;
s5, displaying the real-time 3D image and the warehousing information, analyzing the warehousing information, and warning the condition meeting the warning condition;
and S6, controlling the warehouse site according to the warning.
8. The AR technology-based digital warehousing method of claim 7, wherein the warehousing information further includes logistics information, and the warehouse information is tracked, recorded and updated according to the logistics information.
9. The AR technology-based digital warehousing method according to claim 7, wherein the warehousing information includes warehouse information and product information, and the empty warehouse information and the full warehouse information are full warehouse information and empty warehouse information, respectively.
10. The AR technology-based digital warehousing method as claimed in claim 7, wherein the information of the alarm condition, including information of product stacking status and information of products in imminent, is alerted when reaching an opponent threshold and/or a threshold of products in imminent.
CN202111577149.2A 2021-12-22 2021-12-22 AR technology-based digital warehousing system and method Active CN114359521B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111577149.2A CN114359521B (en) 2021-12-22 2021-12-22 AR technology-based digital warehousing system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111577149.2A CN114359521B (en) 2021-12-22 2021-12-22 AR technology-based digital warehousing system and method

Publications (2)

Publication Number Publication Date
CN114359521A true CN114359521A (en) 2022-04-15
CN114359521B CN114359521B (en) 2024-04-12

Family

ID=81100984

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111577149.2A Active CN114359521B (en) 2021-12-22 2021-12-22 AR technology-based digital warehousing system and method

Country Status (1)

Country Link
CN (1) CN114359521B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116880477A (en) * 2023-07-07 2023-10-13 盐城工业职业技术学院 AGV intelligent guiding system and method applied to warehouse logistics

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN203012788U (en) * 2013-01-04 2013-06-19 电子科技大学中山学院 Intelligent storage control system
CN109064100A (en) * 2018-08-16 2018-12-21 深圳前海启航供应链管理有限公司 Stock control monitoring system
CN109635132A (en) * 2018-12-10 2019-04-16 Oppo(重庆)智能科技有限公司 A kind of Automatic Warehouse management method, system and terminal device
CN111444358A (en) * 2020-03-24 2020-07-24 北京大学深圳研究生院 Method for intelligent warehouse management
CN112508476A (en) * 2020-11-20 2021-03-16 南京英诺森软件科技有限公司 Visual management system for intelligent warehousing scene
CN113537880A (en) * 2021-07-05 2021-10-22 国网山东省电力公司物资公司 Automatic warehousing system capable of automatically establishing three-dimensional model and displaying three-dimensional model in one body

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN203012788U (en) * 2013-01-04 2013-06-19 电子科技大学中山学院 Intelligent storage control system
CN109064100A (en) * 2018-08-16 2018-12-21 深圳前海启航供应链管理有限公司 Stock control monitoring system
CN109635132A (en) * 2018-12-10 2019-04-16 Oppo(重庆)智能科技有限公司 A kind of Automatic Warehouse management method, system and terminal device
CN111444358A (en) * 2020-03-24 2020-07-24 北京大学深圳研究生院 Method for intelligent warehouse management
CN112508476A (en) * 2020-11-20 2021-03-16 南京英诺森软件科技有限公司 Visual management system for intelligent warehousing scene
CN113537880A (en) * 2021-07-05 2021-10-22 国网山东省电力公司物资公司 Automatic warehousing system capable of automatically establishing three-dimensional model and displaying three-dimensional model in one body

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116880477A (en) * 2023-07-07 2023-10-13 盐城工业职业技术学院 AGV intelligent guiding system and method applied to warehouse logistics

Also Published As

Publication number Publication date
CN114359521B (en) 2024-04-12

Similar Documents

Publication Publication Date Title
JP6890609B2 (en) Information display system
EP2390853A1 (en) Time based visual review of multi-polar incidents
JPH11266487A (en) Intelligent remote supervisory system and recording medium
CN110147723B (en) Method and system for processing abnormal behaviors of customers in unmanned store
CN103826108B (en) Monitoring method and system after loan based on video image
CN110619308A (en) Aisle sundry detection method, device, system and equipment
CN114359521B (en) AR technology-based digital warehousing system and method
CN101872515B (en) Transaction linkage video image monitoring system for banking system
CN113238544A (en) Equipment data acquisition system and method based on action signals
CN112129350A (en) Chemical enterprise real scene monitoring system based on AR + security protection
CN117173613B (en) Intelligent management system and method for whole process informatization of engineering construction project
CN107544393A (en) Oil well automated management system
EP2027724A1 (en) Video verification system and method for central station alarm monitoring
CN115379178B (en) Monitoring picture exception handling method, system, device and medium
CN106954040A (en) The method of the fault diagnosis of marine diesel, apparatus and system
CN112612360A (en) Three-dimensional visualization equipment monitoring system and method based on VR technology
CN111736539B (en) Monitoring data display method, device, system, server and storage medium
KR100794614B1 (en) Apparatus and method for analyzing transaction data of a pos device
CN112135100A (en) Chemical production process monitoring and early warning system based on AR technology
CN112883816A (en) Information pushing method and device
EP3683743A1 (en) Computer-implemented method, system and computer program for providing audit records that relate to technical equipment
CN112306012A (en) Factory management system and control system
CN215071801U (en) Integrated monitoring system of transformer substation
CN103135535A (en) Mine material information management system
US20240142344A1 (en) Production line analyzer and visualizer for line performance improvement

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant