CN108549153A - A kind of intelligent VR glasses based on appearance Expression Recognition - Google Patents
A kind of intelligent VR glasses based on appearance Expression Recognition Download PDFInfo
- Publication number
- CN108549153A CN108549153A CN201810554101.1A CN201810554101A CN108549153A CN 108549153 A CN108549153 A CN 108549153A CN 201810554101 A CN201810554101 A CN 201810554101A CN 108549153 A CN108549153 A CN 108549153A
- Authority
- CN
- China
- Prior art keywords
- signal
- unit
- intelligent
- mirror holder
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 230000014509 gene expression Effects 0.000 title claims abstract description 30
- 239000011521 glass Substances 0.000 title claims abstract description 15
- 210000003205 muscle Anatomy 0.000 claims abstract description 31
- 230000002452 interceptive effect Effects 0.000 claims abstract description 19
- 230000003183 myoelectrical effect Effects 0.000 claims abstract description 18
- 238000012545 processing Methods 0.000 claims abstract description 17
- 230000005540 biological transmission Effects 0.000 claims abstract description 12
- 230000008921 facial expression Effects 0.000 claims abstract description 12
- 230000008054 signal transmission Effects 0.000 claims abstract description 5
- 230000005611 electricity Effects 0.000 claims description 4
- 235000006508 Nelumbo nucifera Nutrition 0.000 claims 1
- 240000002853 Nelumbo nucifera Species 0.000 claims 1
- 235000006510 Nelumbo pentapetala Nutrition 0.000 claims 1
- 230000035807 sensation Effects 0.000 abstract description 2
- 238000002567 electromyography Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 9
- 230000000694 effects Effects 0.000 description 8
- 210000004709 eyebrow Anatomy 0.000 description 5
- 230000003993 interaction Effects 0.000 description 5
- 101000739754 Homo sapiens Semenogelin-1 Proteins 0.000 description 4
- 102100037550 Semenogelin-1 Human genes 0.000 description 4
- 230000008451 emotion Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 210000000744 eyelid Anatomy 0.000 description 4
- 230000003387 muscular Effects 0.000 description 4
- 238000000034 method Methods 0.000 description 3
- 230000003321 amplification Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000009977 dual effect Effects 0.000 description 2
- 230000002996 emotional effect Effects 0.000 description 2
- 210000001097 facial muscle Anatomy 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 230000001755 vocal effect Effects 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 210000001015 abdomen Anatomy 0.000 description 1
- 230000036982 action potential Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000004020 conductor Substances 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- YCKOAAUKSGOOJH-UHFFFAOYSA-N copper silver Chemical compound [Cu].[Ag].[Ag] YCKOAAUKSGOOJH-UHFFFAOYSA-N 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000001727 in vivo Methods 0.000 description 1
- 230000005764 inhibitory process Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 230000002232 neuromuscular Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000002560 therapeutic procedure Methods 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Abstract
The present invention provides a kind of intelligent VR glasses based on appearance Expression Recognition, including mirror holder, mirror holder is equipped with VR electronics eyeglasses and shows electronic image, it further include electromyographic signal collection unit, the surface charge signal intensity that face muscle is acquired by surface myoelectric sensor passes to processing unit, the electric signal that surface myoelectric sensor acquires is converted to digital signal by processing unit, it is transferred to the corresponding display signal of interactive unit generation after transformed digital signal and expression data matching in database, interactive unit will show that signal outwardly transmits or receive from extraneous display signal, signal transmission will be shown to display unit after receiving extraneous display signal, 3D facial expression images are included in VR electron mirror on pieces by the display signal that display unit is transmitted according to interactive unit.The present invention applies in the interactive experience between VR user, and expression is increased experience pleasant sensation by image transmission to two parties.
Description
Technical field
The present invention relates to network appliance technical fields, and in particular to a kind of intelligent VR glasses based on appearance Expression Recognition.
Background technology
Facial expression refers to that various emotional states are showed by the variation of eye muscle, face muscle and oral area muscle.
Facial expression is a kind of highly important non-verbal communication means.Face accurately conveys difference by the movement of tens of pieces of muscle
Phychology and emotion.Any type facial expression is all but face certain privileged sites caused by facial muscles allomeric function
Muscle becomes apparent from for expressing the effect of certain special emotions.Mouth, cheek, eyebrow, volume are the pleasant key positions of performance；Nose, cheek, mouth
Performance is detested；Eyebrow, volume, eyes, eyelid performance are sad；Eyes and eyelid performance are frightened.It therefore can be by detecting face muscle
Movable information to obtain the state of face muscle movement, and muscular movement will produce electromyography signal, therefore can pass through survey
Face EMG signal is measured to obtain the feature of face facial expression.
VR technologies are just risen currently on the market, and VR technologies are interacted with virtual network can bring abundant life to people
And recreation experience, but for the prior art, VR interacts current majority and rests in the stage of the interaction of people and virtual world,
Interpersonal interaction simply by sound, lacks image mostly, and experience is more deficient.
Invention content
The purpose of the present invention overcomes the deficiencies of the prior art and provide a kind of intelligent VR glasses based on appearance Expression Recognition,
It applies in the interactive experience between VR user, expression is increased into experience pleasant sensation by image transmission to two parties.
The purpose of the present invention is what is reached by following technical measures：
A kind of intelligent VR glasses based on appearance Expression Recognition, including mirror holder, mirror holder are equipped with VR electronics eyeglasses display electricity
Subgraph further includes electromyographic signal collection unit, and the surface charge signal that face muscle is acquired by surface myoelectric sensor becomes
Change passes to processing unit；
The electric signal that surface myoelectric sensor acquires is converted to digital signal, transformed digital signal by processing unit
Display signal corresponding with interactive unit generation is transferred to after the expression data matching in database；
Interactive unit will show that signal is outwardly transmitted or received and receive extraneous display from extraneous display signal
Signal transmission will be shown to display unit after signal；
3D facial expression images are included in VR electron mirror on pieces by display unit, the display signal transmitted according to interactive unit.
Further, the signal gathering unit be additionally provided with differential-mode amplifier will surface myoelectric sensor signal amplify after
It is transferred to processing unit.
Further, the processing unit is equipped with A/D converter, the electricity that A/D converter acquires surface myoelectric sensor
Signal is converted to digital signal for the transmission in circuit.
Further, the mirror holder built-in rechargeable battery, mirror holder are equipped with charging hole.
Further, the mirror holder is equipped with USB port and is used for data transmission.
Further, the mirror holder includes frame and temple, and the quantity of surface myoelectric sensor is multiple, is distributed in frame
Around.
Further, the processing unit and interactive unit are built in frame.
Compared with prior art, the beneficial effects of the invention are as follows：
Appearance expression information is obtained by the signal transmission between the equipment interactive unit between different user, reaches VR void
The purpose of quasi- expression interaction.
It can realize Context aware and remote dummy interaction, experience sense is good, and it is simple and fast to power, reusable.
It elaborates with reference to the accompanying drawings and detailed description to the present invention.
Description of the drawings
Fig. 1 is the structural schematic diagram of front view of the present invention.
Fig. 2 is the structural schematic diagram of side view of the present invention.
Fig. 3 is the structural schematic diagram of vertical view of the present invention.
Fig. 4 is the structural schematic diagram of workflow block diagram of the present invention.
Wherein, 1, surface myoelectric sensor, 2, frame, 3, temple, 4, VR electronics eyeglasses, 5, charging hole, 6, USB port, 7,
Processing unit, 8, differential-mode amplifier, 9, A/D converter, 10, interactive unit, 11, display unit.
Specific implementation mode
Facial expression refers to that various emotional states are showed by the variation of eye muscle, face muscle and oral area muscle.
Facial expression is a kind of highly important non-verbal communication means.Face accurately conveys difference by the movement of tens of pieces of muscle
Phychology and emotion.Any type facial expression is all but face certain privileged sites caused by facial muscles allomeric function
Muscle becomes apparent from for expressing the effect of certain special emotions.Mouth, cheek, eyebrow, volume are the pleasant key positions of performance；Nose, cheek, mouth
Performance is detested；Eyebrow, volume, eyes, eyelid performance are sad；Eyes and eyelid performance are frightened.It therefore can be by detecting face muscle
Movable information to obtain the state of face muscle movement, and muscular movement will produce electromyography signal, therefore can pass through survey
Face electromyography signal (EMG) signal is measured to obtain the feature of face facial expression.
Electromyography signal (EMG) is moving cell action potential (MUAP) over time and space folded in numerous muscle fibres
Add.Surface electromyogram signal (SEMG) is that electrical activity, can be one in the comprehensive effect of skin surface on superficial muscular EMG and nerve cord
Determine to reflect nervimuscular activity in degree；Relative to pin electrode EMG, SEMG has Noninvasive, hurtless measure, behaviour in measurement
Make the advantages that simple.Thus, SEMG has weight in clinical medicine, man-machine efficacy, medical science of recovery therapy and sports science etc.
The practical value wanted.
Surface electromyogram signal is the neuromuscular system for guiding, amplify, showing and recording by electrode from skin surface
Bioelectrical signals when system activity, signal aspect have larger randomness and unstability.Its active state with muscle and
The relevance of various degrees between functional status, thus can reflect nervimuscular activity in certain degree, it is
In the important method of body surface Non-invasive detection muscle activity, relative to pin electrode EMG, SEMG has Noninvasive, nothing in measurement
Wound, simple operation and other advantages.
The present invention by surface muscle sensor mainly monitor be face superciliary corrugator muscle and depressor supercilii (feel gloomy, thinking etc.
In expression this several groups of muscular tones can shrink and generate the expression of lock eyebrow), greater zygomatic muscle (be generate laugh at expression it is main because
Element), orbicular muscle of eye (closing one's eyes, the expressions such as thinking can all influence orbicular muscle of eye) and ear's cluster (nervous and angry) etc..It is logical
The acquisition changed to these major muscles surface signals is crossed, using convolutional neural networks technology as algorithm basis, is aided with drop
Processing Algorithm of making an uproar and feature extraction algorithm judge appearance expression shape change to analyze.
Fig. 1-3 is the structural schematic diagram of the three-view diagram of the intelligent VR glasses based on appearance Expression Recognition, and the mirror holder includes
Frame 2 and temple 3, are equipped with the electromyography signal that multiple surface myoelectric sensors 1 are used to acquire human face around frame 2, in mirror holder
Rechargeable battery is set, mirror holder is equipped with charging hole 5 and USB port 6 is used for data transmission, and processing unit 7 and interactive unit 10 are built-in
In frame 2.
Fig. 4 is the workflow block diagram of intelligent VR glasses of the dual user based on appearance Expression Recognition in the present embodiment, myoelectricity
The surface charge signal intensity that signal gathering unit acquires face muscle by surface myoelectric sensor 1 will through differential-mode amplifier 8
It is transferred to processing unit 7 after the signal amplification of surface myoelectric sensor 1；
Processing unit 7 is equipped with A/D converter 9, and A/D converter 9 is converted to the electric signal that surface myoelectric sensor 1 acquires
Digital signal is used for the transmission in circuit, and transformed digital signal is transferred to interaction after being matched with the expression data in database
Unit 10 generates corresponding display signal；
Interactive unit 10 will show that signal transmits or receives the display from other users equipment to other users equipment and believes
Number, receive after extraneous display signal will display signal transmission to display unit 11, between the interactive unit 10 of distinct device
Transmission uses the transmission method of Cloud Server.
3D facial expression images are included in VR electronics eyeglass 4 by the display signal that display unit 11 is transmitted according to interactive unit 10
On, display unit 11 includes the model library unit for being processed to expression, any model conduct in user's preference pattern library
The expression that transmission comes is synthesized with model and is presented on VR electronics eyeglass 4 by carrier.
Fig. 4 is the workflow block diagram based on dual user in the present embodiment, can be applied to multi-user according to this operation principle
It realizes.
The matrix of the electrode plates of the present embodiment surface myoelectric sensor 1 is made with copper, and electroplate is ambipolar, two
There are a comparison reference electrodes, i.e. indifferent electrode to improve the inhibition to common-mode signal for reducing noise among a electrode
Ability.Reduce noise on electric wire by differential amplification method.EMG signal is detected by two copper silver-coated electrodes, two input signal phases
Subtract, identical " common mode " component can be removed, and only different " differential mode " components is amplified.Any noise far from test point will
It is shown as " common mode " signal in test point；And detect the signal near surface and show as difference mode signal, it will be amplified.So phase
The power line noise adjusted the distance farther out will be eliminated totally, and the EMG signal of relative close will be amplified.Its accuracy is by common mode
Inhibit to weigh than (CMRR).When EMG information is organized to propagate in (volume conductor) in vivo, increases with transmission range and decline rapidly
Subtract.So electrode should be placed on the strongest muscle abdomens of EMG, the EMG to reduce proximity of muscle interferes (crosstalk).Use smaller electricity
Pole improves selection flexibility, but brings larger skin contact resistance.Sensor is INA128 chips, for measuring muscle
The electric signal of generation, this chip frequency acquisition is very high, can reach 200Hz, can dynamically acquire the fortune of human muscle in real time
Emotionally condition.
Claims (7)
1. a kind of intelligent VR glasses based on appearance Expression Recognition, including mirror holder, mirror holder is equipped with VR electronics eyeglasses and shows electronics
Image, it is characterised in that：Further include electromyographic signal collection unit, the surface electricity of face muscle is acquired by surface myoelectric sensor
Lotus signal intensity passes to processing unit；
The electric signal that surface myoelectric sensor acquires is converted to digital signal, transformed digital signal and number by processing unit
Corresponding display signal is generated according to interactive unit is transferred to after the expression data matching in library；
Interactive unit will show that signal is outwardly transmitted or received and receive extraneous display signal from extraneous display signal
Signal transmission will be shown to display unit afterwards；
3D facial expression images are included in VR electron mirror on pieces by display unit, the display signal transmitted according to interactive unit.
2. a kind of intelligent VR glasses based on appearance Expression Recognition according to claim 1, it is characterised in that：The signal
Collecting unit is additionally provided with after differential-mode amplifier amplifies the signal of surface myoelectric sensor and is transferred to processing unit.
3. a kind of intelligent VR glasses based on appearance Expression Recognition according to claim 1, it is characterised in that：The processing
Unit is equipped with A/D converter, and the electric signal that surface myoelectric sensor acquires is converted to digital signal for circuit by A/D converter
In transmission.
4. a kind of intelligent VR glasses based on appearance Expression Recognition according to claim 1, it is characterised in that：The mirror holder
Built-in rechargeable battery, mirror holder are equipped with charging hole.
5. a kind of intelligent VR glasses based on appearance Expression Recognition according to claim 1, it is characterised in that：The mirror holder
It is used for data transmission equipped with USB port.
6. a kind of intelligent VR glasses based on appearance Expression Recognition according to claim 1, it is characterised in that：The mirror holder
Including frame and temple, the quantity of surface myoelectric sensor is multiple, is distributed in around frame.
7. a kind of intelligent VR glasses based on appearance Expression Recognition according to claim 6, it is characterised in that：The processing
Unit and interactive unit are built in frame.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810554101.1A CN108549153A (en) | 2018-06-01 | 2018-06-01 | A kind of intelligent VR glasses based on appearance Expression Recognition |
| PCT/CN2019/086547 WO2019228174A1 (en) | 2018-06-01 | 2019-05-13 | Facial expression recognition-based smart vr eyewear |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810554101.1A CN108549153A (en) | 2018-06-01 | 2018-06-01 | A kind of intelligent VR glasses based on appearance Expression Recognition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108549153A true CN108549153A (en) | 2018-09-18 |
Family
ID=63511624
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810554101.1A Withdrawn CN108549153A (en) | 2018-06-01 | 2018-06-01 | A kind of intelligent VR glasses based on appearance Expression Recognition |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108549153A (en) |
| WO (1) | WO2019228174A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019228174A1 (en) * | 2018-06-01 | 2019-12-05 | 烟台市安特洛普网络科技有限公司 | Facial expression recognition-based smart vr eyewear |
| WO2023050522A1 (en) * | 2021-09-28 | 2023-04-06 | 歌尔股份有限公司 | Interaction method, terminal device, and readable storage medium |
| US11768379B2 (en) | 2020-03-17 | 2023-09-26 | Apple Inc. | Electronic device with facial sensors |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117480529A (en) * | 2021-06-18 | 2024-01-30 | 惠普发展公司，有限责任合伙企业 | Automatic capture of neutral facial expressions |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104142583A (en) * | 2014-07-18 | 2014-11-12 | 广州市香港科大霍英东研究院 | Intelligent glasses with blinking detection function and implementation method thereof |
| GB2534580B (en) * | 2015-01-28 | 2020-06-17 | Sony Interactive Entertainment Europe Ltd | Image processing |
| US9910275B2 (en) * | 2015-05-18 | 2018-03-06 | Samsung Electronics Co., Ltd. | Image processing for head mounted display devices |
| CN105487676A (en) * | 2016-01-17 | 2016-04-13 | 仲佳 | Virtual-reality device with head-bio-electricity-signal-based human-computer interaction function |
| CN106390318B (en) * | 2016-10-18 | 2019-10-01 | 京东方科技集团股份有限公司 | A kind of intelligence mask and its control method |
| CN106599811B (en) * | 2016-11-29 | 2019-11-05 | 苏州虚现数字科技有限公司 | A kind of VR aobvious facial expression method for tracing |
| CN108549153A (en) * | 2018-06-01 | 2018-09-18 | 烟台市安特洛普网络科技有限公司 | A kind of intelligent VR glasses based on appearance Expression Recognition |
| CN208421417U (en) * | 2018-06-01 | 2019-01-22 | 烟台市安特洛普网络科技有限公司 | A kind of intelligent VR glasses based on appearance Expression Recognition |
-
2018
- 2018-06-01 CN CN201810554101.1A patent/CN108549153A/en not_active Withdrawn
-
2019
- 2019-05-13 WO PCT/CN2019/086547 patent/WO2019228174A1/en active Application Filing
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019228174A1 (en) * | 2018-06-01 | 2019-12-05 | 烟台市安特洛普网络科技有限公司 | Facial expression recognition-based smart vr eyewear |
| US11768379B2 (en) | 2020-03-17 | 2023-09-26 | Apple Inc. | Electronic device with facial sensors |
| WO2023050522A1 (en) * | 2021-09-28 | 2023-04-06 | 歌尔股份有限公司 | Interaction method, terminal device, and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019228174A1 (en) | 2019-12-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108549153A (en) | A kind of intelligent VR glasses based on appearance Expression Recognition | |
| CN106345034A (en) | Device based on brain electricity acquisition terminal for cognitive emotion regulation | |
| Von Rosenberg et al. | Hearables: Feasibility of recording cardiac rhythms from head and in-ear locations | |
| CN107438406A (en) | For non-invasively monitoring equipment, the system and method for physiological parameter | |
| CN207008541U (en) | A kind of control armlet of the VR/AR interactions helmet | |
| CN106166065B (en) | Wearable electrocardio health interaction platform based on social network and implementation method thereof | |
| CN105962935A (en) | Brain electrical nerve feedback training system and method for improving motor learning function | |
| Gorur et al. | Glossokinetic potential based tongue–machine interface for 1-D extraction | |
| CN108784716A (en) | A kind of headset equipment and its pay attention to force estimation training method | |
| CN110141258A (en) | A kind of emotional state detection method, equipment and terminal | |
| CN208421417U (en) | A kind of intelligent VR glasses based on appearance Expression Recognition | |
| Yarici et al. | Hearables: feasibility of recording cardiac rhythms from single in-ear locations | |
| CN207037600U (en) | A kind of Sign Language Recognition translates armlet | |
| CN112057090B (en) | Emotion judgment wearable device and method based on body surface extremely-low-frequency potential difference characteristics | |
| CN103690179B (en) | Wearable electroencephalogram relaxation training instrument | |
| CN106667480B (en) | Human body model for performance test of wearable physiological signal detection equipment | |
| Li et al. | Multi-modal emotion recognition based on deep learning of EEG and audio signals | |
| CN110772246B (en) | Device and method for synchronous and apposition detection of bioelectric signals and pressure signals | |
| CN110464351A (en) | A kind of system and method monitoring muscular fatigue degree | |
| Vo et al. | WEEGEE: Wireless 8-channel EEG recording device | |
| CN108464831A (en) | A kind of device and method of wearable muscular fatigue detection | |
| CN112932508B (en) | Finger activity recognition system based on arm electromyography network | |
| CN103690161A (en) | Wearable electroencephalogram sleeping quality evaluator | |
| Hanic et al. | BIO-monitoring system with conductive textile electrodes integrated into t-shirt | |
| Yan et al. | A dry electrode based headband voice brain-computer interface device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20180918 |
|
| WW01 | Invention patent application withdrawn after publication |