CN109658518A - A kind of three-dimensional object display methods, storage medium and computer based on augmented reality - Google Patents
A kind of three-dimensional object display methods, storage medium and computer based on augmented reality Download PDFInfo
- Publication number
- CN109658518A CN109658518A CN201811573180.7A CN201811573180A CN109658518A CN 109658518 A CN109658518 A CN 109658518A CN 201811573180 A CN201811573180 A CN 201811573180A CN 109658518 A CN109658518 A CN 109658518A
- Authority
- CN
- China
- Prior art keywords
- augmented reality
- dimensional
- image masking
- display
- dimension object
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
A kind of three-dimensional object display methods, storage medium and computer based on augmented reality, wherein method includes the following steps, establish object dimensional feature database, when augmented reality scanning device captures the three-dimension object in scene, the projection view of the three-dimension object and the characteristic matching in three-dimensional feature library are carried out, size, the location information of the three-dimension object are obtained；Image masking-out is created according to current visual angle and size, location information, covers the display of the three-dimension object.Reach the augmented reality display effect that Special display is carried out to special object.It solves the problems, such as identification object and distinctly displays.
Description
Technical field
The present invention relates to augmented reality fields, more particularly to a kind of three-dimensional object display side for capableing of auxiliary display of information
Method.
Background technique
Augmented reality (Augmented Reality, abbreviation AR), be a kind of position for calculating camera image in real time and
Angle and the technology for adding respective image, the target of this technology is that virtual world is covered in real world and carried out on the screen
Interaction.Augmented reality (AR), is also referred to as mixed reality.It is by computer technology, by virtual Information application to true generation
Boundary, true environment and virtual object have been added to the same picture in real time or space exists simultaneously.Augmented reality provides
Under normal circumstances, it is different from the mankind appreciable information.It not only presents the information of real world, and will be virtual
Information show that two kinds of information are complementary to one another, are superimposed simultaneously.In the augmented reality of visualization, user is aobvious using the helmet
Show device, real world with computer graphic is multiple is synthesized together, the true world can be seen around it.
Augmented reality generates the virtual objects being not present in actual environment by computer graphics techniques and visualization technique,
And by sensing technology by virtual objects accurate " placements " in true environment, by showing equipment by virtual objects and true ring
Border is combined together, and is presented to one true new environment of sensory effects of user.In the scene for needing multi-person interactive, due to
The numerous and complicated multiplicity of the actual environment faced, user hardly notice speaker and are directed to that object interacts in this scenario, difficult
To establish the cognition sympathetic response of more people in the case where interacting situation.
Summary of the invention
For this reason, it may be necessary to which object can be identified by providing one kind, the augmented reality display side of Special display is carried out to special object
Method.It solves the problems, such as identification object and distinctly displays.
To achieve the above object, a kind of three-dimensional object display methods based on augmented reality is inventor provided, including such as
Lower step, establishes object dimensional feature database, when augmented reality scanning device captures the three-dimension object in scene, carry out this three
The projection view of object and the characteristic matching in three-dimensional feature library are tieed up, size, the location information of the three-dimension object are obtained；According to working as
Preceding visual angle and size, location information create image masking-out, cover the display of the three-dimension object.
Further, the edge of image masking-out is shown as the profile of predetermined width, pre-set color.
Specifically, described image masking-out and the three-dimension object are big in projection of current visual angle etc., described image masking-out
The partially transparent display of non-edge.
Further, further include step, based on image masking-out, text, picture or video are shown in image masking-out.
A kind of three-dimensional object display storage medium based on augmented reality, is stored with computer program, the computer journey
Sequence executes following steps when being run, and establishes object dimensional feature database, when augmented reality scanning device captures in scene
When three-dimension object, the projection view of the three-dimension object and the characteristic matching in three-dimensional feature library are carried out, the three-dimension object is obtained
Size, location information；Image masking-out is created according to current visual angle and size, location information, covers the display of the three-dimension object.
Further, the computer program executes step when being run, and the edge of image masking-out is shown as default
The profile of width, pre-set color.
Specifically, the computer program also executes step, setting described image masking-out and the three-dimensional when being run
Object is big in projection of current visual angle etc., the partially transparent display of the non-edge of described image masking-out.
Further, the computer program also executes step when being run, and based on image masking-out, covers in image
Text, picture or video are shown in version.
A kind of three-dimensional object display computer based on augmented reality, the computer includes above-mentioned storage medium.
It being different from the prior art, above-mentioned technical proposal is learnt by establishing feature database, training machine to identify three-dimension object,
It is able to carry out when identifying certain objects and retouches the operation such as side, highlighted, display supplemental information, to reach in augmented reality environment
The technical effect of more supplemental informations is provided for interaction scene.
Detailed description of the invention
Fig. 1 is three-dimensional object display methods flow chart described in the specific embodiment of the invention.
Specific embodiment
Technology contents, construction feature, the objects and the effects for detailed description technical solution, below in conjunction with specific reality
It applies example and attached drawing is cooperated to be explained in detail.
Referring to Fig. 1, for a kind of three-dimensional object display methods flow chart based on augmented reality of the present invention, including walk as follows
Suddenly, S100 establishes object dimensional feature database, we can be by RGBD depth camera to the identified three-dimensional article for retouching side of needs
Body does depth scan, obtains the dummy model of three-dimension object and by the projection view under each viewpoint of three-dimension object
The acquisition of SIFT feature (such as angle point, marginal point) and profile information believes model and viewpoint characteristic point by computer
The mapping relations of breath are trained, enable a computer to distinguish two-dimensional projection scan and threedimensional model and project pilot it
Between corresponding relationship, to generate corresponding feature database, identification, which scans the threedimensional model come, certainly can also be deposited into three-dimensional spy
It levies in library, completes the foundation of object dimensional feature database.In extreme embodiment, feature database can directly be established and be set in scanning
It is standby upper, it is contemplated that the performance and cost of scanning device, generally establish in three-dimensional feature library on the server, the data in library
It is interacted by server and scanning device or following augmented reality helmets.Then our method carries out step
S102 carries out the projection view and three-dimensional of the three-dimension object when mixed reality scanning device captures the three-dimension object in scene
The two-dimensional projection for the three-dimension object that the characteristic matching of feature database, i.e. current view point direction are seen can in three-dimensional feature library
The certain viewing angles characteristic matching of certain threedimensional model is coincide, then can obtain the corresponding threedimensional model of three-dimension object that Current Scan arrives
Information, according to three-dimensional model information reverse operation, it will be able to obtain the actual size of three-dimension object and in current spatial
Location information can then deduce the specific pendulum of three-dimension object in space according to angle information specific in the projection of certain viewing angles
Put direction.Then it carries out step S104 and image masking-out is created according to current visual angle and size, location information, cover the three-dimensional article
The display of body.Three-dimensional object model is understood since abovementioned steps are identified and the projection view angles for calculating itself and current device close
System, distance then create a corresponding visual angle by equipment, the two dimensional image masking-out of size can accomplish, preferred implementation
In example, image masking-out and three-dimension object are big in projection of current visual angle etc., naturally it is also possible to slightly larger than the projection of former three-dimension object,
It only needs to be finally reached, newly created two dimensional image masking-out can cover three-dimensional article on the visual angle that current AR shows equipment
The display of body.Masking-out can be according to the customized selection color of user, or is superimposed other pictures, text, video information
Deng the more displays for carrying out information, the call user's attention in augmented reality equipment can be reached, or push additional letter to user
Breath and other effects.For example, user wears augmented reality and shows equipment in museum's scene, when scanning is pre- in feature database to meeting
When the three-dimension object for the characteristic information deposited, the three-dimensional being shown in AR equipment just is covered by creating new image masking-out
Before project objects, user is just it can be seen that information in image masking-out, such as explanatory note: ancient cooking vessel, manufacturing year generation, unearthed age etc.
Deng, or start to play one section of brief introduction about historical relic as interface using image masking-out.The selection of these functions can pass through detection
User gesture acts to realize.Through the above steps, the method for the present invention has reached the three-dimension object that can be identified in scene, goes forward side by side
The effect that row additional information is shown, by the way that the more expansion contents of display using two dimensional image masking-out as display interface, can be enhanced,
Applied to having very strong application prospect under multiple scenes such as teaching, tour guide, exhibition, the reality of existing augmented reality is improved
The property used.
In some other further embodiment, the edge of image masking-out is shown as the wheel of predetermined width, pre-set color
It is wide.In the present embodiment, the edge of image masking-out is carried out retouching side effect, if predetermined width here can be subject to visually
Dry angular distance is its width, then the size regardless of three-dimension object under such situation, retouches hem width degree and fix always.It can also be with
The one of several points that retouch hem width degree as area or length and width dimensions is set on the basis of image masking-out size or length and width, then display effect is then
Change to retouch side size as the size of field of view of three-dimension object changes.Here pre-set color can also according to user demand into
Row choose, as be chosen for it is orange, red etc. if it is more eye-catching, the effect of alerting also will be more preferable.
In other specific embodiments, while in order to more attract attention in the effect for enabling three-dimension object show, and not
Observation of the augmented reality user to former three-dimension object is influenced, in the present embodiment, step is specifically also carried out, by image masking-out and institute
It states three-dimension object and is set as equal big in the projection of current visual angle, and above-mentioned side of retouching is carried out to marginal portion and is handled, border width
Different displays still can be set for according to user with color, and remaining non-edge part of image masking-out, it does transparent
Display processing.Then its effect reached is that user is in the augmented reality equipment under museum's scene, it is seen that an ancient cooking vessel, only
The peripheral outline of ancient cooking vessel body has carried out paying attention to prompt by orange highlighted side of retouching, but is adjusted to transparent in the centre of masking-out, then
Appreciation and taste of the user to the Key details such as the lines, embossment on the practical object such as ancient cooking vessel whole body, dragon design are not influenced.Therefore by upper
Scheme is stated, the present invention can carry out prominent prompt under the premise of not influencing user's normal observation reality object, carry out to object
Side is retouched, a variety of display demands in augmented reality have been better solved.
A kind of three-dimensional object display storage medium based on augmented reality, is stored with computer program, the computer journey
Sequence executes following steps when being run, and establishes object dimensional feature database, when augmented reality scanning device captures in scene
When three-dimension object, the projection view of the three-dimension object and the characteristic matching in three-dimensional feature library are carried out, the three-dimension object is obtained
Size, location information；Image masking-out is created according to current visual angle and size, location information, covers the display of the three-dimension object.
Further, the computer program executes step when being run, and the edge of image masking-out is shown as default
The profile of width, pre-set color.
Specifically, the computer program also executes step, setting described image masking-out and the three-dimensional when being run
Object is big in projection of current visual angle etc., the partially transparent display of the non-edge of described image masking-out.
Further, the computer program also executes step when being run, and based on image masking-out, covers in image
Text, picture or video are shown in version.
Storage medium by above-mentioned design, we have reached the three-dimension object that can be identified in scene, and are added
The effect that information is shown is being applied to by the way that the more expansion contents of display using two dimensional image masking-out as display interface, can be enhanced
There is very strong application prospect under multiple scenes such as teaching, tour guide, exhibition, improve the practicability of existing augmented reality.
A kind of three-dimensional object display computer based on augmented reality, the computer includes above-mentioned storage medium.Institute
It states computer and has reached the three-dimension object that can be identified in scene, and carry out the effect that additional information is shown, by with X-Y scheme
Picture masking-out is display interface, the more expansion contents of display can be enhanced, under applied to multiple scenes such as teaching, tour guide, exhibitions
With very strong application prospect, the practicability of existing augmented reality is improved.
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that the process, method, article or the terminal device that include a series of elements not only include those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or end
The intrinsic element of end equipment.In the absence of more restrictions, being limited by sentence " including ... " or " including ... "
Element, it is not excluded that there is also other elements in process, method, article or the terminal device for including the element.This
Outside, herein, " being greater than ", " being less than ", " being more than " etc. are interpreted as not including this number；" more than ", " following ", " within " etc. understand
Being includes this number.
It should be understood by those skilled in the art that, the various embodiments described above can provide as method, apparatus or computer program production
Product.Complete hardware embodiment, complete software embodiment or embodiment combining software and hardware aspects can be used in these embodiments
Form.The all or part of the steps in method that the various embodiments described above are related to can be instructed by program relevant hardware come
It completes, the program can store in the storage medium that computer equipment can be read, for executing the various embodiments described above side
All or part of the steps described in method.The computer equipment, including but not limited to: personal computer, server, general-purpose computations
It is machine, special purpose computer, the network equipment, embedded device, programmable device, intelligent mobile terminal, smart home device, wearable
Smart machine, vehicle intelligent equipment etc.；The storage medium, including but not limited to: RAM, ROM, magnetic disk, tape, CD, sudden strain of a muscle
It deposits, USB flash disk, mobile hard disk, storage card, memory stick, webserver storage, network cloud storage etc..
The various embodiments described above are referring to the method according to embodiment, equipment (system) and computer program product
Flowchart and/or the block diagram describes.It should be understood that can be realized by computer program instructions every in flowchart and/or the block diagram
The combination of process and/or box in one process and/or box and flowchart and/or the block diagram.It can provide these computers
Program instruction generates a machine to the processor of computer equipment, so that the finger executed by the processor of computer equipment
It enables and generates to specify in one or more flows of the flowchart and/or one or more blocks of the block diagram
The device of function.
These computer program instructions, which may also be stored in, to be able to guide computer equipment computer operate in a specific manner and sets
In standby readable memory, so that the instruction being stored in the computer equipment readable memory generates the manufacture including command device
Product, command device realization refer in one or more flows of the flowchart and/or one or more blocks of the block diagram
Fixed function.
These computer program instructions can also be loaded into computer equipment, so that executing on a computing device a series of
Operating procedure is to generate computer implemented processing, so that the instruction executed on a computing device is provided for realizing in process
The step of function of being specified in figure one process or multiple processes and/or block diagrams one box or multiple boxes.
Although the various embodiments described above are described, once a person skilled in the art knows basic wounds
The property made concept, then additional changes and modifications can be made to these embodiments, so the above description is only an embodiment of the present invention,
It is not intended to limit scope of patent protection of the invention, it is all to utilize equivalent structure made by description of the invention and accompanying drawing content
Or equivalent process transformation, being applied directly or indirectly in other relevant technical fields, similarly includes in patent of the invention
Within protection scope.
Claims (9)
1. a kind of three-dimensional object display methods based on augmented reality, which is characterized in that include the following steps, establish object dimensional
Feature database, when augmented reality scanning device captures the three-dimension object in scene, carry out the projection view of the three-dimension object with
The characteristic matching in three-dimensional feature library obtains size, the location information of the three-dimension object；According to current visual angle and size, position
Information creating image masking-out, covers the display of the three-dimension object.
2. the three-dimensional object display methods according to claim 1 based on augmented reality, which is characterized in that image masking-out
Edge is shown as the profile of predetermined width, pre-set color.
3. the three-dimensional object display methods according to claim 2 based on augmented reality, which is characterized in that described image is covered
Version and the three-dimension object big, partially transparent display of the non-edge of described image masking-out in projection of current visual angle etc..
4. the three-dimensional object display methods according to claim 1 based on augmented reality, which is characterized in that further include step
Suddenly, based on image masking-out, text, picture or video are shown in image masking-out.
5. a kind of three-dimensional object based on augmented reality shows storage medium, which is characterized in that it is stored with computer program, it is described
Computer program executes following steps when being run, and establishes object dimensional feature database, when augmented reality scanning device captures
When three-dimension object in scene, the projection view of the three-dimension object and the characteristic matching in three-dimensional feature library are carried out, obtains described three
Tie up size, the location information of object；Image masking-out is created according to current visual angle and size, location information, covers the three-dimensional article
The display of body.
6. the three-dimensional object according to claim 5 based on augmented reality shows storage medium, which is characterized in that the meter
Calculation machine program executes step when being run, and the edge of image masking-out is shown as to the profile of predetermined width, pre-set color.
7. the three-dimensional object according to claim 6 based on augmented reality shows storage medium, which is characterized in that the meter
Calculation machine program also executes step, setting described image masking-out and the three-dimension object when being run in the projection etc. of current visual angle
Greatly, the partially transparent display of the non-edge of described image masking-out.
8. the three-dimensional object according to claim 5 based on augmented reality shows storage medium, which is characterized in that the meter
Calculation machine program also executes step when being run, and based on image masking-out, text, picture or view are shown in image masking-out
Frequently.
9. a kind of three-dimensional object based on augmented reality shows computer, which is characterized in that the computer includes claim
The described in any item storage mediums of 5-8.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2018104086531 | 2018-05-02 | ||
| CN201810408653.1A CN108597035A (en) | 2018-05-02 | 2018-05-02 | A kind of three-dimensional object display methods, storage medium and computer based on augmented reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109658518A true CN109658518A (en) | 2019-04-19 |
Family
ID=63620318
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810408653.1A Withdrawn CN108597035A (en) | 2018-05-02 | 2018-05-02 | A kind of three-dimensional object display methods, storage medium and computer based on augmented reality |
| CN201811573180.7A Pending CN109658518A (en) | 2018-05-02 | 2018-12-21 | A kind of three-dimensional object display methods, storage medium and computer based on augmented reality |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810408653.1A Withdrawn CN108597035A (en) | 2018-05-02 | 2018-05-02 | A kind of three-dimensional object display methods, storage medium and computer based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN108597035A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021088161A1 (en) * | 2019-11-08 | 2021-05-14 | 福建工程学院 | Ar-based description method and description system |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109670399A (en) * | 2018-11-12 | 2019-04-23 | 万瞳(南京)科技有限公司 | Museum exhibits image-recognizing method based on computer vision and system |
| CN109686277A (en) * | 2019-01-09 | 2019-04-26 | 上海蓝眸多媒体科技有限公司 | A kind of subway shield door display systems, method and apparatus |
| CN111932673B (en) * | 2020-09-22 | 2020-12-25 | 中国人民解放军国防科技大学 | Object space data augmentation method and system based on three-dimensional reconstruction |
| CN113763090B (en) * | 2020-11-06 | 2024-05-21 | 北京沃东天骏信息技术有限公司 | Information processing method and device |
| CN113327329B (en) * | 2020-12-15 | 2024-06-14 | 广州富港生活智能科技有限公司 | Indoor projection method, device and system based on three-dimensional model |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102014012677A1 (en) * | 2014-08-26 | 2016-03-03 | Zimmermann Holding-Ag | Method and device for single and multi-axis 360 ° / three-dimensional scanning of objects, in particular in connection with augmented reality technological methods and applications |
| CN105701863A (en) * | 2016-01-11 | 2016-06-22 | 华为技术有限公司 | Image processing method and device |
| CN105844714A (en) * | 2016-04-12 | 2016-08-10 | 广州凡拓数字创意科技股份有限公司 | Augmented reality based scenario display method and system |
| CN106254848A (en) * | 2016-07-29 | 2016-12-21 | 宇龙计算机通信科技(深圳)有限公司 | A kind of learning method based on augmented reality and terminal |
| CN107734384A (en) * | 2016-08-10 | 2018-02-23 | 北京光子互动科技有限公司 | Image processing method and device |
-
2018
- 2018-05-02 CN CN201810408653.1A patent/CN108597035A/en not_active Withdrawn
- 2018-12-21 CN CN201811573180.7A patent/CN109658518A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102014012677A1 (en) * | 2014-08-26 | 2016-03-03 | Zimmermann Holding-Ag | Method and device for single and multi-axis 360 ° / three-dimensional scanning of objects, in particular in connection with augmented reality technological methods and applications |
| CN105701863A (en) * | 2016-01-11 | 2016-06-22 | 华为技术有限公司 | Image processing method and device |
| CN105844714A (en) * | 2016-04-12 | 2016-08-10 | 广州凡拓数字创意科技股份有限公司 | Augmented reality based scenario display method and system |
| CN106254848A (en) * | 2016-07-29 | 2016-12-21 | 宇龙计算机通信科技(深圳)有限公司 | A kind of learning method based on augmented reality and terminal |
| CN107734384A (en) * | 2016-08-10 | 2018-02-23 | 北京光子互动科技有限公司 | Image processing method and device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021088161A1 (en) * | 2019-11-08 | 2021-05-14 | 福建工程学院 | Ar-based description method and description system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108597035A (en) | 2018-09-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109658518A (en) | A kind of three-dimensional object display methods, storage medium and computer based on augmented reality | |
| CN105474213B (en) | For creating the system and method that can manipulate view | |
| US9665988B2 (en) | Systems and methods for data visualization using three-dimensional displays | |
| US9652895B2 (en) | Augmented reality image transformation | |
| US20050166163A1 (en) | Systems and methods of interfacing with a machine | |
| Shepherd | Travails in the third dimension: A critical evaluation of three-dimensional geographical visualization | |
| JP2015001875A (en) | Image processing apparatus, image processing method, program, print medium, and print-media set | |
| CN109308734B (en) | 3D character generation method and device, equipment and storage medium thereof | |
| Kouřil et al. | Labels on levels: Labeling of multi-scale multi-instance and crowded 3D biological environments | |
| Jenny et al. | Interactive local terrain deformation inspired by hand-painted panoramas | |
| CN106204746A (en) | A kind of augmented reality system realizing 3D model live paint | |
| Perez-Yus et al. | Peripheral expansion of depth information via layout estimation with fisheye camera | |
| Sandnes | Sketching 3D immersed experiences rapidly by hand through 2D cross sections | |
| Desai et al. | Markerless augmented reality based application for e-commerce to visualise 3d content | |
| Trapp et al. | Strategies for visualising 3D points-of-interest on mobile devices | |
| Cui et al. | Fusing surveillance videos and three‐dimensional scene: A mixed reality system | |
| Zhu et al. | Large-scale architectural asset extraction from panoramic imagery | |
| Li et al. | 3D sketching for 3D object retrieval | |
| EP4227907A1 (en) | Object annotation information presentation method and apparatus, and electronic device and storage medium | |
| Liu et al. | A study of digital exhibition visual design led by digital twin and VR technology | |
| Díaz et al. | Augmented reality without fiducial markers | |
| CN115690363A (en) | Virtual object display method and device and head-mounted display device | |
| KR102056985B1 (en) | Method and apparatus for virtual reality interaction | |
| Song et al. | Landscape Fusion Method Based on Augmented Reality and Multiview Reconstruction | |
| Chen et al. | 3D registration based perception in augmented reality environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190419 |
|
| WD01 | Invention patent application deemed withdrawn after publication |