CN108845670A - A kind of online virtual fitness entertainment systems and method based on somatosensory device - Google Patents
A kind of online virtual fitness entertainment systems and method based on somatosensory device Download PDFInfo
- Publication number
- CN108845670A CN108845670A CN201810673203.5A CN201810673203A CN108845670A CN 108845670 A CN108845670 A CN 108845670A CN 201810673203 A CN201810673203 A CN 201810673203A CN 108845670 A CN108845670 A CN 108845670A
- Authority
- CN
- China
- Prior art keywords
- data
- kinect
- virtual
- server
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Processing Or Creating Images (AREA)
Abstract
The present invention relates to a kind of online virtual fitness entertainment systems and method based on somatosensory device, more particularly to a kind of online more people's real-time, interactive virtual fitness systems based on Kinect somatosensory device, it realizes that remote user is synchronous in interactive scene with network technology using Kinect camera to present, and body-building recreation game can be carried out with collective, it can be used for strange land user and carry out the sport and body-building based on same virtual interactive scene and the needs of emotion communication, not only the entertainment of body-sensing body-building had been enhanced, but also has strengthened the tie of emotion contact each other.This law invention system realizes that steps are as follows：(1) user loads the virtual interactive scene based on Kinect to locally；(2) human body and pose presentation and depth information are obtained using Kinect somatosensory camera；(3) it after the data for acquiring Kinect somatosensory camera carry out special filtering and compression, is packaged and server end is sent to by network transmission module；(4) server is matched after receiving the data that client is sent, and is forwarded according to the request of other clients；(5) the local data returned by server, can decompress and obtain the real-time color image of strange land user, and this human body image data is synthesized in local virtual interactive scene by client-side program.
Description
Technical field
The online virtual fitness entertainment systems and method more particularly to a kind of base that the present invention relates to a kind of based on somatosensory device
In online more people's real-time, interactive virtual fitness systems of Kinect somatosensory device, realized using body-sensing camera and network technology remote
Journey user is synchronous in virtual interactive scene to be presented, and can carry out interaction body-building game with collective, can be used for strange land user progress
The needs that sport and body-building and emotion based on same virtual interactive scene are linked up not only had enhanced the entertainment of body-sensing body-building, but also had added
The strong tie of emotion contact each other.
Background technique
For current many people, enthusiasm of the collective motion in addition to body-building can be enhanced gets rid of inertia, while can
Enhance mutual emotion to link up, eliminates feeling of lonely.
For the user in strange land, Video chat can be carried out by camera, to link up mutual emotion.But this side
Method lacks further interaction, and can not supervise and carry out fitness entertainment each other.
Currently, Kinect somatosensory game can support maximum six people while carry out somatic sensation television game, enhance somatosensory motion
Entertaining, and promote mutual affection exchange.But it cannot achieve while carrying out the need of somatic sensation television game for the user in strange land
It asks.For example, the children of far beyond the sea wish to carry out some fitness entertainments with the parent in family, mutual human body can be seen
Realtime graphic, while body-sensing body-building game can be completed together, the interest of emotion contact each other was both strengthened, while can superintend and direct
Promote a frequent movable lower body each other, improves the interest of body-building.
Summary of the invention
In order to solve problem above, the present invention provides a kind of online virtual fitness amusement system based on Kinect somatosensory device
System and method.The system allows Kinect somatosensory user to can see the body for participating in all users of Same Scene fitness interactive
Image and posture movement, while interaction body-building game is carried out, the multiple users of Buddhist of walking back and forth stand progress in face of Kinect camera side by side
Somatosensory motion enhances sense of participation and entertainment that body faces wonderland.
The concrete scheme that the present invention uses is as follows：
Different online users are locally loading identical virtual fitness scene, what which allowed to be locally configured by user
Kinect somatosensory device is realized that posture is captured and is interacted with movement；
Human body and pose presentation and depth information are obtained using Kinect somatosensory camera；
In order to reduce net cost and promoted image transmitting quality, the data that Kinect somatosensory camera is acquired into
After the special filtering of row and compression, it is packaged and server end is sent to by network transmission module；
Server is matched after receiving the data that client is sent, and is forwarded according to the request of other clients；
The local data returned by server, can decompress and obtain real-time body's color image of strange land user, and
This human body image is synthesized in local virtual interactive scene by client-side program, allows local user same virtual mutual
Real-time body and the posture for seeing oneself and other side in dynamic scene simultaneously collect physically weak to realize with virtual scene synchronization interactive
The effect of quasi- body-building recreation；
The system is divided into human body real-time Data Transmission module and server process distribution module；
The invention patent has following beneficial effect：
1. traditional Kinect somatosensory game can not support the synchronization body-building recreation demand of strange land user, and can not see
The respective real-time body's image of both sides.This system can make strange land user that can not only synchronize progress body-sensing body-building game, and
It can be seen that real-time body's image of both sides appears in identical virtual interactive scene, it can common body-building recreation interaction.
2. being directed to the disadvantage of current strange land crowd communication way dullness, this system is interactive using Kinect somatosensory and network takes
The mode that device technology of being engaged in combines allows strange land user is synchronous to carry out body-building somatic sensation television game, not only can permit user's body medical examination and faces
The feeling in its border encourages common body-building each other, and provides a kind of more interactive communication entertainment way.
3. this system by situated interactive mode to the know-how and cognitive ability of system participant without limitation,
Children/granddaughter grandson for being especially suitable for the solitary the elderly being in and strange land synchronizes interaction body-building recreation, promote physiology and
The health of psychology, making up both sides to the greatest extent cannot often meet that bring is sorry and Jamais Vu.
Detailed description of the invention
In order to facilitate the understanding of those skilled in the art, the present invention will be further described below with reference to the drawings.
Fig. 1 is the flow chart of online body-building recreation system of the invention；
Fig. 2 is the schematic diagram of online body-building recreation system of the invention；
Fig. 3 is the client and server communication specific flow chart for connecting Kinect camera；
Fig. 4 is Kinect wire data type schematic diagram；
Fig. 5 is the schematic diagram at initial loading scene interface；
Fig. 6 is the schematic diagram at interface after scene synthesis；
Fig. 7 is Kinect catcher's body skeletal graph；
Specific embodiment
In order to which technical problems, technical solutions and advantages to be solved are more clearly understood, tie below
Attached drawing and case study on implementation are closed, the present invention will be described in detail.
As shown in Fig. 2, present system is mainly made of computer, Kinect somatosensory camera and server.User
Scene preloading is carried out by opening client, Kinect is sent to automatic collection real-time body image data and by network
Server end, by treated, strange land user data returns to client to subsequent server, restores user images after system analysis.
Whole system flow chart is as shown in Figure 1.
The each isolated user of the present invention need to install Kinect somatosensory camera, and be connected with computer by USB, to obtain
Human body colour color image and depth data are taken, and realizes human-computer interaction.System is divided into somatic data and server process distribution
Module is based on Kinect, Unity and Socket technology provides the body-building recreation interaction platform under a kind of on-line mode, and platform is used
Family can carry out fitness training and recreation in selected virtual interactive scene.
It, below will be by comparing common " cutting watermelon " somatic sensation television game pair as a case study on implementation of virtual interactive scene
Whole system process is illustrated in detail.
" cutting watermelon " somatic sensation television game is also known as " the fruit person of bearing ", allows user by way of gesture interaction to from bottom of screen
Emergent all kinds of fruit carry out " cutting ", when the hand position of human body and fruit position are overlapped at projected position in screen
When, fruit is " being cut in half ".Such game is carried out by way of body feeling interaction, that is, the joint for having tempered user is flexible
Degree, while brain being allowed to keep sensitive.
Kinect camera is mainly made of infrared transmitter, RGB camera, infrared depth camera, can at most simultaneously
Monitor the bone of 6 people.The schematic diagram that Kinect captures key point is as shown in Figure 7." cutting watermelon " game emphasis need to obtain left and right
The joint Viewport coordinate (position R, Q) of palm, and respective coordinates are changed into ugui coordinate.
Kinect is connected to computer by USB, after starting the client-side program that Unity3d writes, KinectSensor
Object can obtain color image data, depth of field data and bone tracking data etc..Specifically the data type obtained is needed to see Fig. 4.
Unity3d client-side program need to bind Kinect Manager script to Main Camera, wherein Compute Color Map
It needs to choose, since it is desired that calling the color image of Kinect intake.It is mutual that human body image after acquisition can be presented on initial virtual
In dynamic scene, and game interaction is carried out, as shown in Figure 5.
Since Kinect acquisition can generate a large amount of point cloud datas, it is contemplated that the actual needs of real-time network transmission transmits it
Preceding needs are filtered to acquisition data and compression processing.
The method that filter method mainly uses " ignoring approximate data frame " is ignored by the data frame transmitted before comparing
Similar data frame.Using octree (eight fork numbers) variation monitoring data structure of PCL (Dian Yunku), pass through recursive method pair
Voxel than octree.The vector value index comprising different voxels can be returned in this way.It calculates similarity (SP), benefit
With following formula：
SP=(AP-DP)/AP*100
Wherein, SP is similarity, and DP is the quantity that difference cloud includes point, and AP is that all the points cloud includes the quantity of point for difference
Scene demand can set different limit values (threshold), more than similarity limit frame can be considered it is excessively close and
It loses.If higher to the requirement of scene fluency, relatively low limit value can be set, if instead wanting to scenario reduction degree
If seeking height, higher limit value can be set.
The compression algorithm equally octree data structure based on PCL, the compress mode eliminate spatial information data in when
Between and spatial data redundancy.In order to realize this technology, the octree structure using dual caching is needed, while comparing currently and going through
The information of history point cloud data carrys out the spatio-temporal redundancies data in test point cloud data flow.Pass through xor operator (XOR), comparison caching
The history point cloud data in current point cloud data and caching B in A, guarantees only to carry out compression packing to delta data, most throughout one's life
At byte data flow.
In order to promote data processing and network transmission performance, system is handled by the way of multithreading.For client
End, first thread carry out data acquisition and filtering, filtered data are temporarily stored in caching.Second thread will cache
In filtered data carry out compression processing, and compressed processing is deposited into second caching.Third thread can be with
Caching before access, and carry out network transmission.4th thread is used to request server and returns to other users somatic data letter
Breath.5th thread is used to receive the data information of server return, and is stored in caching.The last one thread is read from caching
Access evidence, is handled and generated data is into initial virtual scene.
Unity3d client-side program sends server by Socket for ready data by udp protocol and receives
Start data after instruction to transmit, the data dump that client will be sent completely at any time, because system is not relevant for historical data, this
Sample is done can be with lifting system performance.
After server receives data, it can delay being parsed and then being stored in corresponding data according to the data of agreement
It deposits.Server records the IP address and port numbers of client simultaneously, to return to the data of strange land user in time.
Server equally uses multithreading concurrent processing affairs.First thread, which is used to receive client transmissions, to come
Data, and be stored in caching.The IP address and port numbers of second thread record requesting client, and and caching in data
Establish association.Third thread and requesting client establish connection, and carry out data transmission.
After requesting client receives the data of server return, corresponding data parsing is carried out.Particularly, for material
Textures are parsed into png file, and recover to human body surface.
Since " cutting watermelon, " game needs to determine whether human hands and fruit are overlapped in screen position, needs will acquire
Strange land user's hand depth image coordinate is converted to screen actual coordinate, and transformation for mula is：
Wherein, (xworld,yworld,zworld) it is screen actual coordinate, (ximage,yimage,zimage) it is depth image coordinate, H=
3.5*10-4Rad, K=12.36cm, L=1.18rad, O=3.7cm, D '=- 10, F=0.002l
After the completion of entire contextual data load, local initial scene can be added in strange land user's human body image, cut watermelon jointly
Body-sensing body-building game.Interaction body-building recreation scene after synthesis is as shown in Figure 6.
The present invention provides a kind of implementation method of online virtual fitness entertainment systems based on somatosensory device, passes through Kinect
Body-sensing body-building recreation can be expanded into a kind of network-based body-sensing body-building recreation platform by somatosensory device and network transmission technology, from
And realize that strange land user carries out the mode of body-sensing training jointly under same virtual scene, there is certain promotional value.
The above is the preferred embodiment of the present invention, for those skilled in the art,
Without departing from the principles of the invention, several improvements and modifications can also be made, these improvements and modifications are also regarded as this hair
Bright protection scope.
Claims (2)
1. a kind of online virtual fitness entertainment systems and method based on somatosensory device, more particularly to it is a kind of based on Kinect somatosensory
Online more people's real-time, interactive virtual fitness entertainment systems that equipment is realized, which is characterized in that mainly include human body realtime graphic number
According to transmission module and server process distribution module；Wherein, real-time body's video transmission module is needed using Kinect
Somatosensory device is connect with computer, reads the human body image and depth data of local user, is compressed and is encrypted by special method
After use a network for data be packaged transmission；
The server process distribution module is transferred to request data after being associated matching to acquisition human body image data
Client；
In order to promote the performance of data processing and network transmission, above-mentioned module is required to be handled by the way of multithreading；
2. the online virtual fitness system according to right 1 based on somatosensory device, which is characterized in that include the following steps：
The first step：In the locally identical virtual fitness Entertainment Scene of load, which allows through user local different online users
The Kinect somatosensory device of configuration is realized that posture is captured and is interacted with movement；
Second step：Human body and pose presentation and depth information are obtained using Kinect somatosensory camera；
Third step：In order to reduce net cost and promote image transmitting quality, the number that Kinect somatosensory camera is acquired
After carrying out special filtering and compression method, it is packaged and network server end is sent to by network transmission module；
4th step：After server receives the data of client transmission, it is forwarded according to the request of other clients；
5th step：The local data returned by server, can decompress and obtain real-time body's image data of strange land user,
And this image data is synthesized in local virtual interactive scene by client-side program, allow local user same virtual
The human body realtime graphic of oneself and other side is seen in reality scene simultaneously, and virtual reality scenario synchronization interactive, and then realize and collect
The effect of physically weak quasi- body-building recreation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810673203.5A CN108845670A (en) | 2018-06-27 | 2018-06-27 | A kind of online virtual fitness entertainment systems and method based on somatosensory device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810673203.5A CN108845670A (en) | 2018-06-27 | 2018-06-27 | A kind of online virtual fitness entertainment systems and method based on somatosensory device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108845670A true CN108845670A (en) | 2018-11-20 |
Family
ID=64202401
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810673203.5A Pending CN108845670A (en) | 2018-06-27 | 2018-06-27 | A kind of online virtual fitness entertainment systems and method based on somatosensory device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108845670A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111068288A (en) * | 2020-01-05 | 2020-04-28 | 上海淡竹体育科技有限公司 | Body-building field data acquisition method and device |
| CN111695376A (en) * | 2019-03-13 | 2020-09-22 | 阿里巴巴集团控股有限公司 | Video processing method, video processing device and electronic equipment |
| CN111915736A (en) * | 2020-08-06 | 2020-11-10 | 黄得锋 | AR interaction control system, device and application |
| CN112354185A (en) * | 2020-11-27 | 2021-02-12 | Oppo广东移动通信有限公司 | Cloud game control system and cloud game control method |
| CN112887386A (en) * | 2021-01-19 | 2021-06-01 | 青岛美购传媒有限公司 | Low-delay transmission synchronization method for virtual reality data |
| CN112947758A (en) * | 2021-03-04 | 2021-06-11 | 北京京航计算通讯研究所 | Multi-user virtual-real cooperative system based on VR technology |
| CN113552943A (en) * | 2021-07-20 | 2021-10-26 | 深圳市博乐信息技术有限公司 | AR interaction system and device for health and health science popularization |
| CN116382487A (en) * | 2023-05-09 | 2023-07-04 | 北京维艾狄尔信息科技有限公司 | Interaction system is felt to wall body that runs accompany |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101336441A (en) * | 2005-12-22 | 2008-12-31 | Pkr有限公司 | Improvement of on-line game |
| US20130249947A1 (en) * | 2011-08-26 | 2013-09-26 | Reincloud Corporation | Communication using augmented reality |
| CN105727559A (en) * | 2015-10-12 | 2016-07-06 | 吉林大学 | Body building game implementation method based on virtual reality body building game system |
| CN106572099A (en) * | 2016-10-25 | 2017-04-19 | 霍尔果斯霹雳互动网络科技有限公司 | Cross-server method and system for network game |
| CN106789991A (en) * | 2016-12-09 | 2017-05-31 | 福建星网视易信息系统有限公司 | A kind of multi-person interactive method and system based on virtual scene |
| CN106954092A (en) * | 2017-03-09 | 2017-07-14 | 华东师范大学 | A kind of virtual reality bicycle implementation method based on cloud computing |
| CN107678715A (en) * | 2016-08-02 | 2018-02-09 | 北京康得新创科技股份有限公司 | The sharing method of virtual information, device and system |
| CN108200064A (en) * | 2018-01-04 | 2018-06-22 | 超元域（北京）科技有限公司 | Method of data synchronization and device |
-
2018
- 2018-06-27 CN CN201810673203.5A patent/CN108845670A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101336441A (en) * | 2005-12-22 | 2008-12-31 | Pkr有限公司 | Improvement of on-line game |
| US20130249947A1 (en) * | 2011-08-26 | 2013-09-26 | Reincloud Corporation | Communication using augmented reality |
| CN105727559A (en) * | 2015-10-12 | 2016-07-06 | 吉林大学 | Body building game implementation method based on virtual reality body building game system |
| CN107678715A (en) * | 2016-08-02 | 2018-02-09 | 北京康得新创科技股份有限公司 | The sharing method of virtual information, device and system |
| CN106572099A (en) * | 2016-10-25 | 2017-04-19 | 霍尔果斯霹雳互动网络科技有限公司 | Cross-server method and system for network game |
| CN106789991A (en) * | 2016-12-09 | 2017-05-31 | 福建星网视易信息系统有限公司 | A kind of multi-person interactive method and system based on virtual scene |
| CN106954092A (en) * | 2017-03-09 | 2017-07-14 | 华东师范大学 | A kind of virtual reality bicycle implementation method based on cloud computing |
| CN108200064A (en) * | 2018-01-04 | 2018-06-22 | 超元域（北京）科技有限公司 | Method of data synchronization and device |
Non-Patent Citations (1)
| Title |
|---|
| 孙博文等: "基于Kinect体感交互的多人在线虚拟实验系统", 《计算机科学》 * |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111695376A (en) * | 2019-03-13 | 2020-09-22 | 阿里巴巴集团控股有限公司 | Video processing method, video processing device and electronic equipment |
| CN111068288A (en) * | 2020-01-05 | 2020-04-28 | 上海淡竹体育科技有限公司 | Body-building field data acquisition method and device |
| CN111915736A (en) * | 2020-08-06 | 2020-11-10 | 黄得锋 | AR interaction control system, device and application |
| CN112354185A (en) * | 2020-11-27 | 2021-02-12 | Oppo广东移动通信有限公司 | Cloud game control system and cloud game control method |
| CN112887386A (en) * | 2021-01-19 | 2021-06-01 | 青岛美购传媒有限公司 | Low-delay transmission synchronization method for virtual reality data |
| CN112947758A (en) * | 2021-03-04 | 2021-06-11 | 北京京航计算通讯研究所 | Multi-user virtual-real cooperative system based on VR technology |
| CN113552943A (en) * | 2021-07-20 | 2021-10-26 | 深圳市博乐信息技术有限公司 | AR interaction system and device for health and health science popularization |
| CN116382487A (en) * | 2023-05-09 | 2023-07-04 | 北京维艾狄尔信息科技有限公司 | Interaction system is felt to wall body that runs accompany |
| CN116382487B (en) * | 2023-05-09 | 2023-12-12 | 北京维艾狄尔信息科技有限公司 | Interaction system is felt to wall body that runs accompany |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108845670A (en) | A kind of online virtual fitness entertainment systems and method based on somatosensory device | |
| US10527846B2 (en) | Image processing for head mounted display devices | |
| CN111752511B (en) | AR glasses remote interaction method, device and computer readable medium | |
| US7285047B2 (en) | Method and system for real-time rendering within a gaming environment | |
| KR102362001B1 (en) | Method and system for providing eye tracking based information about a user behavior, client device, server and computer program product | |
| US9030486B2 (en) | System and method for low bandwidth image transmission | |
| US20100322111A1 (en) | Methods and systems for realizing interaction between video input and virtual network scene | |
| CN112198959A (en) | Virtual reality interaction method, device and system | |
| CN106652590B (en) | Teaching method, teaching identifier and tutoring system | |
| CN109671141B (en) | Image rendering method and device, storage medium and electronic device | |
| CN111862348B (en) | Video display method, video generation method, device, equipment and storage medium | |
| DE102018207518A1 (en) | Method and system for animating a 3D avatar | |
| CN110083235A (en) | Interactive system and data processing method | |
| CN107103645A (en) | virtual reality media file generation method and device | |
| Kurillo et al. | Real-time 3D avatars for tele-rehabilitation in virtual reality | |
| Wolff et al. | Communicating eye gaze across a distance without rooting participants to the spot | |
| EP2830728B1 (en) | Entertainment system and method of providing entertainment | |
| CN108200064B (en) | Data synchronization method and device | |
| CN112017266A (en) | Method for presenting real person action in virtual space in real time by 3D model | |
| Hu et al. | LiveVV: Human-Centered Live Volumetric Video Streaming System | |
| JP6731532B1 (en) | Video playback device, video playback method, and video delivery system | |
| JP7442107B2 (en) | Video playback device, video playback method, and video distribution system | |
| Duncan et al. | Fusing exocentric and egocentric real-time reconstructions for embodied immersive experiences | |
| CN113873175B (en) | Video playing method and device, storage medium and electronic equipment | |
| JP6945693B2 (en) | Video playback device, video playback method, and video distribution system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20181120 |
|
| WD01 | Invention patent application deemed withdrawn after publication |