CN104901739A - Multilingual audio commentary device and method thereof based on visible light communication technology - Google Patents
Multilingual audio commentary device and method thereof based on visible light communication technology Download PDFInfo
- Publication number
- CN104901739A CN104901739A CN201510237031.3A CN201510237031A CN104901739A CN 104901739 A CN104901739 A CN 104901739A CN 201510237031 A CN201510237031 A CN 201510237031A CN 104901739 A CN104901739 A CN 104901739A
- Authority
- CN
- China
- Prior art keywords
- module
- languages
- signal processing
- memory
- stored
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention provides a multilingual audio commentary device based on the visible light communication technology and a multilingual audio commentary method based on the visible light communication technology. The device comprises a transmitting end and a receiving end. The transmitting end comprises a digital audio capture module, an SD card storage module, an FPGA signal processing module 1 and an LED light emitting module. The receiving end comprises a light detection module, an FPGA signal processing module 2, a language selection module, and a digital audio output module. The FPGA signal processing module 1 alternately reads audio signal of different languages in an SD card and a real-time voice signal collected by the digital audio capture module, the RS encoding and PWM modulation are carried out, and a modulation signal drives the LED light emitting module to emit a light signal. The light detection module converts the received light signals into electric signals, inputs the electric signals into the FPGA signal processing module 2 to carry out PWM demodulation and RS decoding and then alternately stores the signals into different storage units, and a user selects a language or real-time voice through the language selection module. According to the device and the method, the problems of easy interference and crosstalk of a traditional commentary system are solved, and the device has the double functions of automatic commentary and real-time voice communication.
Description
Technical field
The present invention relates to visible light communication technology, especially a kind of multilingual explanation device and method based on visible light communication.
Background technology
At present, self-service interpretation system is applied in various exhibition place very at large, and particularly in the indoor museums such as the open various tourist attraction of developed country and museum, artificial guide interpreting is cancelled substantially.In technical scheme, current self-service interpretation system mainly have employed the technology such as Radio-Frequency Wireless Communication, ultrasonic communication.2004, the people such as Li-Der develop with PDA be platform based on radio communication multimedia museum guiding system (Li-Der C, Chia-Hs ieh W, Shih-Pang H, et al.Requirement analysis and implementation of palm-based multimedia museum guide systems:Advanced Information Networking and Applications, 2004.AINA 2004.18th International Conference on, 2004 [C] .2004.); 2008, the people such as Jihyun achieve augmented reality museum guiding system (Jihyun O on UMPC, Moon-Hyun L, Hanhoon P, et al.Efficient mobile museum guidance system using augmented reality:Consumer Electronics, 2008.ISCE 2008.IEEE International Symposium on, 2008 [C] .14-16April2008.), adopt ultrasonic sensing device and electronic compass to carry out overall Attitude Tracking.Current domestic digital guide to visitors introduction system mainly adopts less radio-frequency auto-induction type.Due to the multipath effect of radiofrequency signal and the restriction of frequency resource, when particularly visitor is more, there is serious crosstalk, interference in interpretation system; It is large to there is power consumption in ultrasonic communication, the problems such as communication distance is short.
Visible light communication technology (Visible Light Communication, VLC), as the term suggests realize radio communication with visible ray exactly, the high speed light and shade flash signal be invisible to the naked eye of mainly leaning on light-emitting diode (LED) etc. to send carrys out transmission information.Visible light communication can realize illumination and the function communicated simultaneously, has transmitted data rates high, strong security, without electromagnetic interference, without the need to advantages such as frequency spectrum certifications.LED is adopted to throw light on for increasing tourist attraction, museum and commodity sales exhibition etc. at present, visible light communication technology is applied to multilingual interactive voice introduction system by the present invention, make to which overcome the shortcomings such as the easy interference of conventional radio frequency speech sound eeplaining system existence, easy crosstalk, achieve and broadcast multilingual explanation signal and real-time speech communicating two major functions simultaneously.
Summary of the invention
The present invention is directed to the shortcoming such as easy interference, easy crosstalk that conventional radio frequency speech sound eeplaining system exists, propose a kind of multilingual phonetic explaining device and method based on visible light communication, on the basis overcoming the shortcomings such as traditional introduction system easily disturbs, easily crosstalk, power consumption is large, communication distance is short, achieve multilingual explanation signal simultaneously, and there is the function of real-time voice broadcast communication.
The present invention is realized by following technical solution.
Based on a multilingual phonetic explaining device for visible light communication technology, comprise transmitting terminal and receiving terminal.
Described transmitting terminal comprises digital audio capture module, SD card memory module, FPGA signal processing module one, LED light transmitter module.Digital audio capture module is connected with FPGA signal processing module one with SD card memory module, and FPGA signal processing module one is connected with LED light transmitter module.
Described audio collection module comprises microphone and WM8371 digital audio chip.
Described FPGA signal processing module two comprises alternately reading unit, RS coding unit, PWM unit, and three is connected successively; Wherein alternately read module comprises a FIFO memory (push-up storage).
Described LED light transmitter module adopts six models to be the LED lamp bead of CREE Q5.
Described receiving terminal comprises optical detection module, FPGA signal processing module two, languages selection module, Digital Audio Output Modules.Optical detection module is connected with FPGA signal processing module two, and FPGA signal processing module two and languages select module to be connected with Digital Audio Output Modules.
Described optical detection module adopts model to be the PIN photoelectric detector of PC10-6.
Described FPGA signal processing module two comprises PWM demodulating unit, RS decoding unit, alternately memory cell, and three is connected successively; Wherein alternately memory cell comprises multiple FIFO memory (push-up storage).
Described Digital Audio Output Modules comprises WM8731 digital audio chip and earphone or loud speaker.
Based on a multilingual explanation method for visible light communication technology, said method comprising the steps of:
1. existed by the interpretation speech frequency file of different language in the different memory cell of SD card memory module, then SD card memory module is connected to FPGA signal processing module one.
2. the simulated audio signal that transmitting terminal microphone produces is input to digital audio capture module to carry out real-Time Speech Signals Acquisition and outputs to FPGA signal processing module one.
3.FPGA data processing module one reads the data in SD card memory module and digital audio capture module, is then handled as follows successively:
3.1 reading different language audio files and collecting voice data in real time are in the FIFO memory replacing reading unit.
Concrete operations mode: first read 1 byte data in languages 1 audio files and stored in a memory cell of FIFO memory, then reads 1 byte data in languages 2 audio file and stored in the next memory cell of FIFO memory; Then 1 byte data in languages 3 audio files is read and stored in the next memory cell of FIFO memory, then 1 byte data that real-time voice gathers is read and stored in the next memory cell of FIFO memory, then read 1 byte data in languages 1 audio files again and stored in a memory cell of FIFO memory, then read 1 byte data in languages 2 audio file and stored in the next memory cell of FIFO memory; Then 1 byte data in languages 3 audio files is read and stored in the next memory cell of FIFO memory, then 1 byte data that digital audio capture module exports is read and stored in the next memory cell of FIFO memory, circulate according to this, until FIFO memory is full.
3.2 read the RS coding that 28 byte datas carry out (255,239) position from the FIFO memory replacing reading unit.
Concrete operations mode: read 28 byte datas from FIFO memory, these 28 byte datas and 15 zero are formed 239 and carries out RS coding, rear continuation of having encoded is read 28 byte datas and is encoded from FIFO memory, until FIFO memory is empty.
The encode code word that obtains of 3.3RS is input to PWM unit and modulates.
3.4 export PWM modulation signal from FPGA signal processing module one.
4.PWM modulation signal is input to LED light transmitter module, and the light on and off flicker of control LED sends signal.
5. receiving terminal optical detection module changes the blinking light received into digital square-wave.
6. digital square-wave input PWM demodulating unit carries out demodulation, then carries out RS decoding.
7. decoding gained multilingual explanation audio frequency and Real-time voice data are alternately carried out buffer memory stored in the multiple FIFO memory buffer areas replaced in memory module.
Concrete operations mode: languages 1 audio frequency is stored in FIFO-1, and languages 2 audio frequency is stored in FIFO-2, and languages 3 audio frequency is stored in FIFO-3, and real-time voice is stored in FIFO-4.
8. the button in user by selecting module selects a certain languages audio frequency or Real-time voice data to output to Digital Audio Output Modules.
9. user-selected a certain languages audio frequency or Real-time voice data are converted to simulated audio signal by Digital Audio Output Modules, and output to earphone or loud speaker is sounded.
The advantage that the present invention has:
1. alternately read and the method for receiving terminal alternately storage because the present invention have employed at transmitting terminal, can realize multilingual synchronous explanation, user can unrestricted choice languages as required, meet the individual demand of user.
2. the present invention has the dual-use function of autoexplainer and real-time speech communicating.User, except selecting to receive except the explanation signal of a certain languages, can receive real-time voice broadcast singal again.
3. LED illumination combines with the communication technology by the present invention, improves resource utilization, energy-conserving and environment-protective.
4. the present invention is owing to have employed visible light communication technology, can be implemented in the quick switching between different showpiece, and does not interfere with each other between exhibition booth.
5. present invention employs the technology that RS encoding and decoding and PWM demodulation combine, can burst error be reduced, improve communication reliability and antijamming capability.
Accompanying drawing explanation
Fig. 1 is the composition frame chart of apparatus of the present invention.
Fig. 2 is the inventive method flow chart.
Fig. 3 is scene enforcement figure of the present invention.
Embodiment
Below in conjunction with drawings and Examples, the specific embodiment of the present invention is described in further detail.Following examples for illustration of the present invention, but are not used for limiting the scope of the invention.
The present invention proposes a kind of multilingual phonetic explaining device based on visible light communication technology, as shown in Figure 1, comprising: transmitting terminal and receiving terminal.Transmitting terminal comprises digital audio capture module, SD card memory module, FPGA signal processing module one, LED light transmitter module; Receiving terminal comprises optical detection module, FPGA signal processing module two, languages selection module, Digital Audio Output Modules.
A kind of multilingual phonetic explaining method realization flow based on visible light communication technology is as Fig. 2, first audio collection module is made up of microphone and WM8371 digital audio chip, real-Time Speech Signals converts digital audio and video signals by microphone input to through WM8371 digital audio chip, outputs to FPGA signal processing module one.
FPGA signal processing module one comprises alternately reading unit, RS coding unit, PWM unit.Alternately reading unit alternately reads audio commentary file and the real-Time Speech Signals of the different language existed in SD card, is then cached to push-up storage.Concrete operations mode is as follows: first read 1 byte data in languages 1 audio files and stored in a memory cell of FIFO memory, then reads 1 byte data in languages 2 audio file and stored in the next memory cell of FIFO memory; Then 1 byte data in languages 3 audio files is read and stored in the next memory cell of FIFO memory, then 1 byte data that real-time voice gathers is read and stored in the next memory cell of FIFO memory, then read 1 byte data in languages 1 audio files again and stored in a memory cell of FIFO memory, then read 1 byte data in languages 2 audio file and stored in the next memory cell of FIFO memory; Then 1 byte data in languages 3 audio files is read and stored in the next memory cell of FIFO memory, then 1 byte data that digital audio capture module exports is read and stored in the next memory cell of FIFO memory, circulate according to this, until FIFO memory is full.
RS coding unit reads 28 byte datas and carries out (255 from FIFO memory, 239) the RS coding of position, concrete operations mode: read 28 byte datas from FIFO memory, these 28 byte datas and 15 zero are formed 239 and carries out RS coding, rear continuation of having encoded is read 28 byte datas and is encoded from FIFO memory, until FIFO memory is empty.
PWM unit is modulated the code word obtained, and modulation signal is input to LED light transmitter module, and the light on and off flicker of control LED sends signal.
Receiving terminal optical detection module changes the blinking light received into digital square-wave, is then input to FPGA signal processing module two.
FPGA signal processing module two is made up of PWM demodulating unit, RS decoding unit, alternately memory cell.Wherein PWM demodulating unit carries out demodulation to digital square-wave, and restituted signal is input to RS decoding unit and carries out RS decoding.
Alternately decoding gained multilingual explanation audio frequency and Real-time voice data are alternately carried out buffer memory stored in different FIFO memory buffer areas by memory cell.Concrete operations mode: languages 1 audio frequency is stored in FIFO-1, and languages 2 audio frequency is stored in FIFO-2, and languages 3 audio frequency is stored in FIFO-3, and real-time voice is stored in FIFO-4.
User selects the button in module to select a certain languages audio frequency or Real-time voice data to output to Digital Audio Output Modules by languages.User-selected a certain languages audio frequency or Real-time voice data are converted to simulated audio signal by Digital Audio Output Modules, and output to earphone or loud speaker is sounded, thus achieve a kind of multilingual phonetic explaining apparatus and method based on visible light communication technology.
As the showpiece scene enforcement figure that Fig. 3 is a kind of multilingual phonetic explaining device and method based on visible light communication technology.The present invention is mainly used in museum, exhibition center, and exhibition and sale of products can wait the place adopting LED illumination, the multilingual phonetic explaining device of the present invention is placed at showpiece place, comprise transmitting terminal and receiving terminal, visitor also carries the multilingual phonetic explaining device of the present invention, comprises transmitting terminal and receiving terminal.Visitor selects each languages phonetic explaining and real-time voice by the button of earphone end, thus realizes multilingual automation solution and to mediate a settlement interactive exhibition.Visitor not only can listen to the automatic speech sound eeplaining under multilingual pattern, also synchronously can listen to the broadcast of exhibition room real-time voice.The area of light that visitor only need enter another exhibition booth LED from the area of light of an exhibition booth LED can realize different exhibition booth explain orally between switching, and the explanation between each exhibition booth does not interfere with each other.In case of emergency also can ask for help to staff in time.Thus overcome the shortcomings such as easy interference, the easily crosstalk of conventional radio frequency speech sound eeplaining system existence, ensure that and explain orally orderly the carrying out of efficient work.
Claims (2)
1., based on a multilingual phonetic explaining device for visible light communication technology, it is characterized in that comprising transmitting terminal and receiving terminal;
Described transmitting terminal comprises digital audio capture module, SD card memory module, FPGA signal processing module one, LED light transmitter module; Digital audio capture module is connected with FPGA signal processing module one with SD card memory module, and FPGA signal processing module one is connected with LED light transmitter module;
Described audio collection module comprises microphone and WM8371 digital audio chip;
Described FPGA signal processing module one comprises alternately reading unit, RS coding unit, PWM unit, and three is connected successively; Wherein alternately read module comprises a FIFO memory;
Described LED light transmitter module adopts six models to be the LED lamp bead of CREE Q5;
Described receiving terminal comprises optical detection module, FPGA signal processing module two, languages selection module, Digital Audio Output Modules; Optical detection module is connected with FPGA signal processing module two, and FPGA signal processing module two and languages select module to be connected with Digital Audio Output Modules;
Described optical detection module adopts model to be the PIN photoelectric detector of PC10-6;
Described FPGA signal processing module two comprises PWM demodulating unit, RS decoding unit, alternately memory cell, and three is connected successively; Wherein alternately memory cell comprises multiple FIFO memory;
Described Digital Audio Output Modules comprises WM8731 digital audio chip and earphone or loud speaker.
2. the explanation method of a kind of multilingual explanation device based on visible light communication technology according to claim 1, is characterized in that comprising the following steps:
(1) existed by the interpretation speech frequency file of different language in the different memory cell of SD card memory module, then SD card memory module is connected to FPGA signal processing module one;
(2) simulated audio signal that transmitting terminal microphone produces is input to digital audio capture module to carry out real-Time Speech Signals Acquisition and outputs to FPGA signal processing module one;
(3) FPGA signal processing module one reads the data in SD card memory module and digital audio capture module, is then handled as follows successively:
(3.1) reading different language audio file and collecting voice data in real time are in the FIFO memory replacing reading unit:
First read 1 byte data in languages 1 audio files and stored in a memory cell of FIFO memory, then read 1 byte data in languages 2 audio file and stored in the next memory cell of FIFO memory; Then 1 byte data in languages 3 audio files is read and stored in the next memory cell of FIFO memory, then 1 byte data that real-time voice gathers is read and stored in the next memory cell of FIFO memory, then read 1 byte data in languages 1 audio files again and stored in a memory cell of FIFO memory, then read 1 byte data in languages 2 audio file and stored in the next memory cell of FIFO memory; Then 1 byte data in languages 3 audio files is read and stored in the next memory cell of FIFO memory, then 1 byte data that digital audio capture module exports is read and stored in the next memory cell of FIFO memory, circulate according to this, until FIFO memory is full;
(3.2) from the FIFO memory replacing reading unit, the RS coding that 28 byte datas carry out 255,239 is read:
From FIFO memory, read 28 byte datas, these 28 byte datas and 15 zero are formed 239 and carries out RS coding, rear continuation of having encoded is read 28 byte datas and is encoded from FIFO memory, until FIFO memory is empty;
(3.3) the encode code word that obtains of RS is input to PWM unit and modulates;
(3.4) PWM modulation signal is exported from FPGA signal processing module one;
(4) PWM modulation signal is input to LED light transmitter module, and the light on and off flicker of control LED sends signal;
(5) receiving terminal optical detection module changes the blinking light received into digital square-wave;
(6) digital square-wave input PWM demodulating unit carries out demodulation, then carries out RS decoding;
(7) decoding gained multilingual explanation audio frequency and Real-time voice data are alternately carried out buffer memory stored in the multiple FIFO memory buffer areas replaced in memory module:
Languages 1 audio frequency is stored in FIFO-1, and languages 2 audio frequency is stored in FIFO-2, and languages 3 audio frequency is stored in FIFO-3, and real-time voice is stored in FIFO-4;
(8) user selects the button in module to select a certain languages audio frequency or Real-time voice data to output to Digital Audio Output Modules by languages;
(9) user-selected a certain languages audio frequency or Real-time voice data are converted to simulated audio signal by Digital Audio Output Modules, and output to earphone or loud speaker is sounded.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510237031.3A CN104901739A (en) | 2015-05-11 | 2015-05-11 | Multilingual audio commentary device and method thereof based on visible light communication technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510237031.3A CN104901739A (en) | 2015-05-11 | 2015-05-11 | Multilingual audio commentary device and method thereof based on visible light communication technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104901739A true CN104901739A (en) | 2015-09-09 |
Family
ID=54034153
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510237031.3A Pending CN104901739A (en) | 2015-05-11 | 2015-05-11 | Multilingual audio commentary device and method thereof based on visible light communication technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104901739A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105743577A (en) * | 2016-01-29 | 2016-07-06 | 杭州电子科技大学 | Visible light audio transmission system based on phase-locked loop |
| CN108599844A (en) * | 2018-01-25 | 2018-09-28 | 南昌大学 | A kind of synchronous translation apparatus and its working method based on visible light communication technology |
| CN110518977A (en) * | 2019-09-11 | 2019-11-29 | 南京邮电大学 | Underwater visible light communication method and underwater visible light communication device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006089468A1 (en) * | 2005-02-22 | 2006-08-31 | Ning Yuan | Apparatus for displaying color visible light image from mobile telephone and the method thereof |
| CN103117826A (en) * | 2013-02-01 | 2013-05-22 | 东南大学 | Voice broadcaster implemented by aid of visible light wireless communication |
| CN103490813A (en) * | 2013-09-26 | 2014-01-01 | 江苏理工学院 | Museum intelligent explanation system based on visible light and power line carrier communication |
| CN103684597A (en) * | 2013-11-19 | 2014-03-26 | 北京邮电大学 | FPGA-based visible light video communication system and method |
| CN103825656A (en) * | 2013-12-10 | 2014-05-28 | 上海航天测控通信研究所 | Visible light communication system based on TCP/IP and method |
| CN104168060A (en) * | 2014-07-09 | 2014-11-26 | 珠海横琴华策光通信科技有限公司 | Methods and apparatuses for information transmission/obtaining by using visible optical signal |
-
2015
- 2015-05-11 CN CN201510237031.3A patent/CN104901739A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006089468A1 (en) * | 2005-02-22 | 2006-08-31 | Ning Yuan | Apparatus for displaying color visible light image from mobile telephone and the method thereof |
| CN103117826A (en) * | 2013-02-01 | 2013-05-22 | 东南大学 | Voice broadcaster implemented by aid of visible light wireless communication |
| CN103490813A (en) * | 2013-09-26 | 2014-01-01 | 江苏理工学院 | Museum intelligent explanation system based on visible light and power line carrier communication |
| CN103684597A (en) * | 2013-11-19 | 2014-03-26 | 北京邮电大学 | FPGA-based visible light video communication system and method |
| CN103825656A (en) * | 2013-12-10 | 2014-05-28 | 上海航天测控通信研究所 | Visible light communication system based on TCP/IP and method |
| CN104168060A (en) * | 2014-07-09 | 2014-11-26 | 珠海横琴华策光通信科技有限公司 | Methods and apparatuses for information transmission/obtaining by using visible optical signal |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105743577A (en) * | 2016-01-29 | 2016-07-06 | 杭州电子科技大学 | Visible light audio transmission system based on phase-locked loop |
| CN108599844A (en) * | 2018-01-25 | 2018-09-28 | 南昌大学 | A kind of synchronous translation apparatus and its working method based on visible light communication technology |
| CN108599844B (en) * | 2018-01-25 | 2021-03-26 | 南昌大学 | Simultaneous interpretation device based on visible light communication technology and working method thereof |
| CN110518977A (en) * | 2019-09-11 | 2019-11-29 | 南京邮电大学 | Underwater visible light communication method and underwater visible light communication device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Albraheem et al. | Toward designing a Li-Fi-based hierarchical IoT architecture | |
| US7415212B2 (en) | Data communication system, data transmitter and data receiver | |
| CN102749072B (en) | Indoor positioning method, indoor positioning apparatus and indoor positioning system | |
| Matsushita et al. | ID CAM: A smart camera for scene capturing and ID recognition | |
| CN102215068A (en) | Wireless automatic navigation system based on visible light communication | |
| CN103684529B (en) | Method for transmitting signals and device | |
| CN103986518B (en) | Single-chip microcomputer voice frequency storing and broadcasting system and single-chip microcomputer voice frequency storing and broadcasting method based on visible light communication | |
| CN103338072B (en) | Based on visible light communication and the radio switch-in method of android system | |
| CN105740936A (en) | Optical tag, method and apparatus for identifying optical tag | |
| CN105162520A (en) | Automatic identification method and information service system based on visible light illumination | |
| CN105871461A (en) | Multiple access method based on optical two-dimensional code and visible light communication system for implementing multiple access method | |
| CN104614701A (en) | Intelligent electric meter defect detection equipment | |
| CN104901739A (en) | Multilingual audio commentary device and method thereof based on visible light communication technology | |
| CN107063266A (en) | The method that indoor positioning is realized based on indoor LED lamp and smart mobile phone camera | |
| CN204537192U (en) | The equipment of a kind of optical label and identification optical label | |
| CN105005025A (en) | Precise positioning system based on visible light and precise positioning method thereof | |
| CN107105408A (en) | A kind of localization method based on visible light communication, apparatus and system | |
| CN108352124A (en) | Card early learning machine system | |
| CN108599844B (en) | Simultaneous interpretation device based on visible light communication technology and working method thereof | |
| Liu et al. | Indoor visible light applications for communication, positioning, and security | |
| CN204462371U (en) | Ammeter defect Intelligent testing equipment | |
| CN110429981A (en) | It is shown based on LED and the hiding information Transmission system and method for visible light communication | |
| CN106059866A (en) | Voice control system for wireless smart home | |
| CN105719166A (en) | Shopping guide method based on Zigbee communication and visible light communication and system achieving method | |
| CN205945745U (en) | Visible light communication experimental apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150909 |