CN108109460A - Equipment is visited in a kind of teaching with augmented reality chemical plant - Google Patents
Equipment is visited in a kind of teaching with augmented reality chemical plant Download PDFInfo
- Publication number
- CN108109460A CN108109460A CN201711365336.8A CN201711365336A CN108109460A CN 108109460 A CN108109460 A CN 108109460A CN 201711365336 A CN201711365336 A CN 201711365336A CN 108109460 A CN108109460 A CN 108109460A
- Authority
- CN
- China
- Prior art keywords
- augmented reality
- upper computer
- factory
- equipment
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 74
- 239000000126 substance Substances 0.000 title claims abstract description 15
- 230000005540 biological transmission Effects 0.000 claims abstract description 12
- 230000006870 function Effects 0.000 claims description 15
- 239000003550 marker Substances 0.000 claims description 6
- 230000000007 visual effect Effects 0.000 claims description 5
- 238000004088 simulation Methods 0.000 abstract description 2
- 238000007654 immersion Methods 0.000 abstract 2
- 238000000034 method Methods 0.000 description 9
- 230000000694 effects Effects 0.000 description 6
- 239000011159 matrix material Substances 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000012824 chemical production Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 229920000535 Tan II Polymers 0.000 description 1
- 102100029469 WD repeat and HMG-box DNA-binding protein 1 Human genes 0.000 description 1
- 101710097421 WD repeat and HMG-box DNA-binding protein 1 Proteins 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000007306 functionalization reaction Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of chemical plant teaching with augmented reality to visit equipment.The equipment is made of moving cart, host computer and the augmented reality helmet, moving cart is walked according to specific track in factory, its upper part installs camera, instead of scene in eye-observation factory, by the data transmission of acquisition to host computer, augmented reality is utilized in host computer, the threedimensional model of virtual text information and each equipment is added in real factory's contextual data, the augmented reality helmet receives the actual situation mixing contextual data from host computer, and a kind of immersion experience walked in factory is simulated by wearing the augmented reality helmet.The present invention avoids the various dangerous situations really visited in factory using augmented reality, a kind of very three-dimensional immersion experience walked in factory of simulation, student while actual experience is obtained.
Description
Technical Field
The invention relates to a teaching visit device with an augmented reality functional factory, which is a teaching visit device with augmented reality immersive experience and remote learning operation.
Background
At present, most of courses such as chemical major are taught in various industrial and scientific schools in a simple image-text mode, the teaching mode is boring and cannot stimulate the learning interest of students, so that the students learning the courses do not have comprehensive and visual understanding on the chemical production process, the operation principle and the internal structure of each large-scale device cannot be understood, graduates lack corresponding professional skills, and the requirement of enterprises on talents is difficult to meet. Although some colleges organize students to visit on the spot in factories while performing image-text teaching, the visiting time is short, the whole production process cannot be known, and the danger coefficient in the chemical production process is high, so that the personal safety of the students is difficult to guarantee. In addition, the visit of a large number of students indirectly affects the production efficiency of a factory.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provide the chemical plant teaching visiting equipment with the augmented reality function. This equipment is by the travelling car, host computer and augmented reality helmet are constituteed, the travelling car walks in the mill according to specific orbit, its upper installation camera, replace people's eye to observe scene in the mill, data transmission to the host computer with gathering, utilize augmented reality technique in the host computer, superpose virtual literal information and the three-dimensional model of each equipment to real mill scene data in, the mixed scene data of virtuality and reality that the augmented reality helmet received and comes from the host computer, through wearing the immersive experience of the simulation of augmented reality helmet walking in the mill.
In order to solve the technical problems, the invention is realized by the following technical scheme:
a chemical plant teaching visit device with augmented reality function is composed of a mobile trolley, an upper computer and an augmented reality helmet; the mobile trolley is provided with a camera for acquiring scene data in a factory and transmitting the scene data to the upper computer through a wireless network, the upper computer superimposes virtual information to real scene data in the factory by adopting an augmented reality technology and then transmits the virtual information to the augmented reality helmet, and the augmented reality helmet can enable a wearer to simulate a real three-dimensional immersive experience of walking in the factory and further learn the running state and the internal structure of each device in the factory through the virtual information superimposed to the scene; the wireless network is built by ZigBee and covers the whole factory range.
The moving trolley is driven by the STM32 single chip microcomputer to control a trolley motor, moves in a factory according to a set track, and controls the moving and stopping of the moving trolley through the upper computer; the camera on the moving trolley controls the rotation angle of the camera through the upper computer, and scene data in a factory are collected at different visual angles; and the mobile trolley transmits the collected scene data in the factory to the upper computer in real time through a wireless network.
The upper computer comprises a first upper computer and a second upper computer, and the first upper computer is positioned on the movable trolley and used for receiving real-time video data collected by the movable trolley; the second upper computer is positioned on the augmented reality helmet, and the first upper computer and the second upper computer perform data transmission and command transmission by using the cloud server and can realize remote control; after receiving real-time data in a factory, the second upper computer identifies and positions each device by identifying the markers on the devices in the factory, superimposes virtual information to the periphery of the real device by using a three-dimensional registration technology to obtain augmented reality virtual-real mixed data, and transmits the augmented reality virtual-real mixed data to the augmented reality helmet through a wireless network; the movement and the stop of the mobile trolley, the rotation angle of the camera and the display of the virtual information in the augmented reality helmet are controlled by a second upper computer; the virtual information comprises a text introduction of the plant equipment and a three-dimensional model of the equipment; the three-dimensional model is modeled according to the real structure in the factory equipment, the running state of the equipment can be simulated, the three-dimensional model can be disassembled in a one-key mode, and the internal structure of the three-dimensional model is visually displayed.
The augmented reality helmet receives the scene data in the factory through superposition mixing from the second upper computer through a wireless network, and projects the scene data into a lens in front of the helmet. The trainee simulates a true three-dimensional immersive experience of walking within the plant by wearing an augmented reality helmet and further learns the operational status and internal configuration of the various devices within the plant through superimposed virtual information, such as a three-dimensional model of the devices.
The chemical plant teaching visit equipment with the augmented reality function further comprises a teacher system, wherein the teacher system controls the display of the virtual information of the three-dimensional model in the augmented reality helmet through a second upper computer, controls the running state of the simulated equipment in the augmented reality helmet, and can disassemble the three-dimensional model in a one-key mode; the students can learn the operation principle of each device and the internal structure of each device in the chemical production process more intuitively and clearly; on the other hand, the teacher system can also control the movement and stop of the mobile cart and the rotation angle of the camera through the second upper computer so as to observe the equipment of interest in the factory.
The chemical plant teaching visit equipment with the augmented reality function also has a remote learning function, and the first upper computer and the second upper computer perform data transmission and command control through the cloud server to realize remote operation; meanwhile, the first upper computers and the second upper computers which are positioned in different places in multiple groups can be connected in a matched mode through the cloud server instead of being connected in a one-to-one mode, so that resource sharing can be achieved to the maximum extent, resources can be utilized to the maximum, and students can learn more professional skills.
Due to the adoption of the technical scheme, compared with the prior art, the chemical plant teaching visiting equipment with the augmented reality function provided by the invention has the following beneficial effects:
the method adopts an augmented reality technology to simulate a true three-dimensional immersive experience of walking in a factory, and students avoid various dangerous situations of true visit in the factory while obtaining the true experience;
the virtual equipment model is overlaid and displayed in a real environment by adopting an augmented reality technology, so that the teaching is more vivid and the learning interest of students is stimulated;
the remote learning function is provided, and the teaching activities and the autonomous learning of students are not limited by time and space, so that the learning is more convenient and free;
the resource sharing is realized, so that the resources are utilized to the maximum, and meanwhile, students can obtain more learning resources.
Drawings
FIG. 1 is a general schematic of the present invention;
FIG. 2 is a schematic structural view of the present invention;
FIG. 3 is a flow chart of the three-dimensional registration technique of the present invention;
FIG. 4 is a coordinate relationship conversion diagram for the three-dimensional registration technique of the present invention;
FIG. 5 is a diagram of scene effects of augmented reality according to the present invention;
fig. 6 is a drawing showing the effect of disassembling the three-dimensional device model according to the present invention.
Detailed Description
The invention is described in further detail below with reference to the following detailed description and accompanying drawings:
the invention discloses chemical plant teaching visiting equipment with an augmented reality function, which is composed of a moving trolley, an upper computer and an augmented reality helmet as shown in figure 1. The mobile trolley is provided with a camera for acquiring scene data in a factory, the camera is transmitted to the upper computer through a wireless network, the upper computer adopts an augmented reality technology to superimpose virtual information on real scene data in the factory and then transmits the virtual information to the augmented reality helmet, a student simulates true three-dimensional immersive experience of walking in the factory by wearing the augmented reality helmet, and the student further learns the running state and the internal structure of each device in the factory through the virtual information superimposed on the scene. The wireless network is built by ZigBee and covers the whole factory range.
The moving trolley is driven by the STM32 single chip microcomputer to control a trolley motor, moves in a factory according to a set track, and controls the moving and stopping of the moving trolley through the upper computer; the camera on the moving trolley controls the rotation angle of the camera through the upper computer, and scene data in a factory are collected at different visual angles; and the mobile trolley transmits the collected scene data in the factory to the upper computer in real time through a wireless network.
The upper computer comprises a first upper computer and a second upper computer, and the first upper computer is positioned on the movable trolley and used for receiving real-time video data collected by the movable trolley; the second upper computer is located the augmented reality helmet, utilize the cloud ware to carry out data transmission and command transmission between first upper computer and the second upper computer, can realize remote control, the second upper computer is after receiving the real-time data in the mill, through the marker on the discernment on the equipment in the mill, discern the location to each equipment, utilize three-dimensional registration technique to superpose virtual information around true equipment, obtain augmented reality's virtual and real mixed data to transmit the augmented reality helmet through wireless network. The movement and the stop of the mobile trolley, the rotation angle of the camera and the display of the virtual information in the augmented reality helmet are controlled by a second upper computer;
the virtual information comprises a text introduction of the equipment and a three-dimensional model of the equipment.
The three-dimensional model is modeled according to the real structure in the equipment, the running state of the equipment can be simulated, and in addition, the three-dimensional model can be disassembled by one key to visually display the internal structure.
In the invention, a visual tracking registration technology based on artificial markers is adopted, and different markers placed on each device are identified to complete the identification and positioning of each device. The three-dimensional registration technology is implemented by the flow chart shown in fig. 3, and the whole three-dimensional registration process comprises the following steps:
the first step is as follows: the image feature detection and description mainly extracts feature information of a marker in an image and describes the feature of the marker, in the invention, a FAST From Accessed Segment Test (FAST) algorithm is adopted to detect feature points, the gray values of pixel points to be detected and pixel points in a neighborhood are calculated, and the pixel points are divided into three types:
where d is the neighborhood point of the point C to be detected, IdIs the gray value of the point, ICAnd t is a self-defined threshold value of the gray value of the point C to be detected, and-1, 0 and 1 respectively represent that the point d is darker, similar or lighter than the detection point C. And if n continuous pixel points are detected as dark points (d is-1) or bright points (d is 1), judging the point as an angular point. In addition, the invention describes the corner points by using an ORB (oriented FASTandpending BRIEF) algorithm, and the algorithm defines the main direction of the feature points as follows:
θ＝a tan2(m01,m10)
wherein,the sum of the regional gray levels in the x direction of the pixel,is the regional gray sum of the y direction of the pixel. The definition descriptor is:
gn(p,θ)＝fn(p)|(xi,yi)∈Sθ
wherein S is the central pixel point position combination (x) of the selected n groups of pixel block pairsi,yi) A matrix of size 2xn is defined.
The second step is that: and performing feature matching, and searching a corresponding matching identifier from the feature information template library.
The third step: calculating the posture of the camera, identifying the marker in the image through the steps, establishing a right-hand coordinate system by taking the plane of the marker as a Z plane, and calculating the posture of the camera according to a formula
Calculating external parameter rotation matrix R, translation vector T and internal parameter f of camerau、fv、u0、v0S to obtain an extrinsic parameter matrix M1And the reference matrix M2And determining the posture of the camera to obtain a projection matrix M.
The fourth step: and virtual-real registration, namely performing corresponding projection transformation on the virtual information according to the external parameters and the internal parameters of the camera calculated in the previous step and the coordinate conversion sequence shown in the figure 4 by taking the image as a projection plane, and superposing the virtual information on a target object to realize the augmented reality effect.
Fig. 2 is a schematic structural diagram of the present invention. The mobile trolley moves in a factory according to a specific track, a camera arranged on the upper part of the mobile trolley is used for observing the environment in the factory instead of human eyes, and collected scene data in the factory are transmitted to a first upper computer through a wireless network; the cloud server is used between the first upper computer and the second upper computer for data transmission and command transmission, remote control is achieved, meanwhile, the first upper computers located in different factories and the second upper computers located in different places can be connected with each other instead of being connected in a one-to-one mode, and maximum sharing of resources is achieved; after receiving real-time data in a factory, the second upper computer identifies and positions each device by identifying markers on devices in the factory, superimposes virtual information to the periphery of the real device by using a three-dimensional registration technology to obtain virtual-real mixed data of augmented reality, and transmits the virtual-real mixed data to an augmented reality helmet through a wireless network; on the lens of augmented reality helmet in its the place ahead with received image projection, the student wears the augmented reality helmet and will sees the scene in mill after the augmented reality, and the travelling car replaces the student and walks in mill, and the camera replaces people's eye to observe, simulates the immersive of walking in mill and experiences to the inner structure of each equipment of three-dimensional model study through virtual equipment, knows its running state.
The augmented reality helmet receives scene data in the factory mixed with reality through a wireless network, and in a lens in front of the helmet projected by the augmented reality helmet, a student simulates true three-dimensional immersive experience of walking in the factory by wearing the augmented reality helmet, and further learns the running state and the internal structure of each device in the factory through superimposed virtual information, such as a three-dimensional model of the device.
Fig. 5 shows the scene effect of the augmented reality of the present invention. A virtual three-dimensional engine model is put into a real environment through an augmented reality technology, students can see that the engine model is really put into the environment by wearing an augmented reality helmet, and the operation state can be simulated as if a real engine is operated in front of eyes. In addition, fig. 6 is a diagram showing the disassembling effect of the three-dimensional device model of the present invention, and the three-dimensional model of the virtual device is disassembled by one key to display each component of the device, so that students can more intuitively know the internal structure of the device.
Claims (6)
1. The utility model provides a chemical plant teaching equipment of visiting with augmented reality function which characterized in that: the equipment consists of a mobile trolley, an upper computer and an augmented reality helmet; the mobile trolley is provided with a camera for acquiring scene data in a factory and transmitting the scene data to the upper computer through a wireless network, the upper computer superimposes virtual information to real scene data in the factory by adopting an augmented reality technology and then transmits the virtual information to the augmented reality helmet, and the augmented reality helmet can enable a wearer to simulate a real three-dimensional immersive experience of walking in the factory and further learn the running state and the internal structure of each device in the factory through the virtual information superimposed to the scene; the wireless network is built by ZigBee and covers the whole factory range.
2. The chemical plant teaching visit device with augmented reality function of claim 1, wherein: the moving trolley is driven by the STM32 single chip microcomputer to control a trolley motor, moves in a factory according to a set track, and controls the moving and stopping of the moving trolley through the upper computer; the camera on the moving trolley controls the rotation angle of the camera through the upper computer, and scene data in a factory are collected at different visual angles; and the mobile trolley transmits the collected scene data in the factory to the upper computer in real time through a wireless network.
3. The chemical plant teaching visit device with augmented reality function of claim 1, wherein: the upper computer comprises a first upper computer and a second upper computer, and the first upper computer is positioned on the movable trolley and used for receiving real-time video data collected by the movable trolley; the second upper computer is positioned on the augmented reality helmet, and the first upper computer and the second upper computer perform data transmission and command transmission by using the cloud server and can realize remote control; after receiving real-time data in a factory, a second upper computer identifies and positions each device by identifying a marker on the device in the factory, superimposes virtual information to the periphery of the real device by using a three-dimensional registration technology to obtain augmented reality virtual-real mixed data, and transmits the augmented reality virtual-real mixed data to the augmented reality helmet through a wireless network, wherein the movement and the stop of the mobile trolley, the rotation angle of the camera and the display of the virtual information in the augmented reality helmet are controlled by the second upper computer; the virtual information comprises a text introduction of the plant equipment and a three-dimensional model of the equipment; the three-dimensional model is modeled according to the real structure in the factory equipment, the running state of the equipment can be simulated, the three-dimensional model can be disassembled in a one-key mode, and the internal structure of the three-dimensional model is visually displayed.
4. The chemical plant teaching visit device with augmented reality function of claim 1, wherein: the augmented reality helmet receives the scene data in the factory through superposition mixing from the second upper computer through a wireless network, and projects the scene data into a lens in front of the helmet.
5. The chemical plant teaching visit device with augmented reality function of claim 1, wherein: the equipment is also provided with a teacher system, the teacher system controls the display of the virtual information of the three-dimensional model in the augmented reality helmet through a second upper computer, controls the running state of the simulated equipment in the augmented reality helmet, and can disassemble the three-dimensional model by one key; the teacher system can also control the movement and stop of the mobile trolley and control the rotation angle of the camera through the second upper computer.
6. The chemical product teaching visit device with the augmented reality function according to claim 1, wherein: the device also has a remote learning function, and the first upper computer and the second upper computer perform data transmission and command control through the cloud server to realize remote operation; meanwhile, the first upper computers and the second upper computers which are positioned in different places in multiple groups can be connected in a matched mode through the cloud server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711365336.8A CN108109460A (en) | 2017-12-18 | 2017-12-18 | Equipment is visited in a kind of teaching with augmented reality chemical plant |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711365336.8A CN108109460A (en) | 2017-12-18 | 2017-12-18 | Equipment is visited in a kind of teaching with augmented reality chemical plant |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108109460A true CN108109460A (en) | 2018-06-01 |
Family
ID=62210913
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711365336.8A Pending CN108109460A (en) | 2017-12-18 | 2017-12-18 | Equipment is visited in a kind of teaching with augmented reality chemical plant |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108109460A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108958491A (en) * | 2018-08-01 | 2018-12-07 | 林向阳 | Long-range experiential method and its system |
| CN109947242A (en) * | 2019-02-26 | 2019-06-28 | 贵州翰凯斯智能技术有限公司 | A kind of factory's virtual application system and application method based on information fusion |
| CN110062221A (en) * | 2019-04-16 | 2019-07-26 | 杭州坤天自动化系统有限公司 | Intelligent simulation device and method based on mixed reality technology |
| CN111182286A (en) * | 2019-12-31 | 2020-05-19 | 广州幻境科技有限公司 | Underwater visiting method and system based on augmented reality |
| CN113421343A (en) * | 2021-05-27 | 2021-09-21 | 深圳市晨北科技有限公司 | Method for observing internal structure of equipment based on augmented reality |
| CN114038260A (en) * | 2021-10-28 | 2022-02-11 | 徐州嘉恒智能科技有限公司 | AR glasses-based coal mine safety operation training method |
-
2017
- 2017-12-18 CN CN201711365336.8A patent/CN108109460A/en active Pending
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108958491A (en) * | 2018-08-01 | 2018-12-07 | 林向阳 | Long-range experiential method and its system |
| CN109947242A (en) * | 2019-02-26 | 2019-06-28 | 贵州翰凯斯智能技术有限公司 | A kind of factory's virtual application system and application method based on information fusion |
| CN110062221A (en) * | 2019-04-16 | 2019-07-26 | 杭州坤天自动化系统有限公司 | Intelligent simulation device and method based on mixed reality technology |
| CN111182286A (en) * | 2019-12-31 | 2020-05-19 | 广州幻境科技有限公司 | Underwater visiting method and system based on augmented reality |
| CN113421343A (en) * | 2021-05-27 | 2021-09-21 | 深圳市晨北科技有限公司 | Method for observing internal structure of equipment based on augmented reality |
| CN113421343B (en) * | 2021-05-27 | 2024-06-04 | 深圳市晨北科技有限公司 | Method based on internal structure of augmented reality observation equipment |
| CN114038260A (en) * | 2021-10-28 | 2022-02-11 | 徐州嘉恒智能科技有限公司 | AR glasses-based coal mine safety operation training method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108109460A (en) | Equipment is visited in a kind of teaching with augmented reality chemical plant | |
| Baek et al. | Augmented reality system for facility management using image-based indoor localization | |
| Kaarlela et al. | Digital twin and virtual reality for safety training | |
| Chi et al. | Development of user interface for tele-operated cranes | |
| CN105551059A (en) | Power transformation simulation human body motion capturing method based on optical and inertial body feeling data fusion | |
| CN110047150A (en) | It is a kind of based on augmented reality complex device operation operate in bit emulator system | |
| CN107871414A (en) | Maintenance electrician training tutoring system and method based on VR and BIM technology | |
| CN104464431B (en) | Electric power security training entity simulation system | |
| CN109189213A (en) | A kind of assembling process of products augmented reality guidance method based on movable computer | |
| CN104570731A (en) | Uncalibrated human-computer interaction control system and method based on Kinect | |
| CN110333776A (en) | A kind of military equipment operation training system and method based on wearable device | |
| CN110977981A (en) | Robot virtual reality synchronization system and synchronization method | |
| CN109033535A (en) | A kind of Design of Production Line visualization system based on VR technology | |
| CN105183161A (en) | Synchronized moving method for user in real environment and virtual environment | |
| CN110727351A (en) | Multi-user collaboration system for VR environment | |
| Zhang et al. | A novel animation authoring framework for the virtual teacher performing experiment in mixed reality | |
| CN116168586A (en) | Immersive ground carrying equipment simulation training system | |
| Liu et al. | A video-enabled dynamic site planner | |
| Wilson et al. | A virtual environment for training overhead crane operators: real-time implementation | |
| Grehl et al. | Research perspective-mobile robots in underground mining | |
| CN107705660A (en) | A kind of long-range robot of giving lessons | |
| Stein et al. | Mixed reality robotics for stem education | |
| CN115497357A (en) | VR simulation training system and training method for multi-person manual capturing, searching and explosion elimination | |
| Patrao et al. | An immersive system for the training of tower crane operators | |
| CN104269081A (en) | Simulation training device and method for light geodetic system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180601 |
|
| WD01 | Invention patent application deemed withdrawn after publication |