CN101727897A - Speech synthesis device, method and monitor applied thereby - Google Patents
Speech synthesis device, method and monitor applied thereby Download PDFInfo
- Publication number
- CN101727897A CN101727897A CN200810216875A CN200810216875A CN101727897A CN 101727897 A CN101727897 A CN 101727897A CN 200810216875 A CN200810216875 A CN 200810216875A CN 200810216875 A CN200810216875 A CN 200810216875A CN 101727897 A CN101727897 A CN 101727897A
- Authority
- CN
- China
- Prior art keywords
- interrupt source
- priority
- speech
- data
- mechanism unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Machine Translation (AREA)
Abstract
The invention discloses a speech synthesis device, a method and a monitor applied thereby, the speech synthesis device comprises a speech library used for storing digital speech data to be played and a PWM converter used for carrying out pulse width modulation on the speech data; and the device further comprises a data loading mechanism unit containing a first priority interrupt source, and the data loading mechanism unit is used for interrupt processing result of the first priority interrupt source, thereby controlling the digital speech data to be sequentially loaded in the PWM converter. The invention can improve the utilization rate of the system, reduce the cost and improve the speech synthesis quality.
Description
Technical field
The present invention relates to speech synthesis technique, in particular, a kind of speech synthetic device and method and applied patient monitor thereof.
Background technology
At present the phoneme synthesizing method kind is a lot, and wherein to export synthetic speech be the low and simple numerical synthetic speech mode of a kind of cost to the PWM mode.As shown in Figure 1, the principle of prior PWM output phonetic synthesis as shown in Figure 1, digital voice data that generally will receive or that prepare to play is stored in the sound bank, configure the interior PWM converter of IC integrated chip then and open the interior PWM event interrupt source of PWM converter, each PWM event interrupt source sends interrupt request to processor cores, the event controller of this interrupt request by IC sends processor cores to and handles, and after processor cores is reacted to interrupt request, control the read-write of sound bank in order, the speech data that will play in the sound bank is loaded into volume to be regulated in computing module and the PWM converter, every request is once interrupted, processor cores need be to interrupting carrying out primary first-order equation, and load speech data one time, thereby realize the pwm pulse width modulated, the synthetic speech that output needs drives follow-up circuit (be low-pass filter or can directly drive loudspeaker).The volume is here regulated computing module and is carried out conventional algorithm computing, and the volume that can regulate voice.
As shown in Figure 2, when the processor cores of IC system need be handled a plurality of task, the interrupt source that each task utilizes peripheral hardware to provide usually sends interrupt request by event controller to processor cores, wait for the processing of processor cores, so at this moment, just may handle the interrupt request of higher priority, and cause in time to handle the interrupt request of PWM converter, cause voice distortion because of processor cores; The worst may be that the voice distortion meeting is more serious so if the interruption of higher priority frequently occurs, even voice change, and can not discern.At this problem, common solution is to improve the dominant frequency of IC system.Need handling when the processor cores of system of task more after a little while, can also reduce by the dominant frequency that improves system and the voice distortion frequency occur, but generally to arrive more than hundred MHz and could realize voice preferably, and improve dominant frequency and can cause the power consumption of system rise greatly (because power consumption is directly proportional with dominant frequency).But,, can not avoid the complete distortion of voice fully by the way that improves system's dominant frequency if when system task is too much.
From as seen last, the mode of PWM synthetic speech process because of adopting low level to interrupt, inevitably there is certain delay in its speech processes process, and postpones to influence the quality of synthetic speech, so just need to improve the prior PWM synthetic technology.
Summary of the invention
The object of the present invention is to provide a kind of speech synthetic device and method and applied patient monitor thereof, its improved system utilization factor, reduced cost, and improved the quality of phonetic synthesis.
To achieve these goals, the present invention adopts following technical scheme:
The invention provides a kind of speech synthetic device, described device comprises: be used to store the sound bank of digital voice data to be played, and the pulse width modulated converter that is used for speech data is carried out pulse-length modulation; Described device also comprises: one contains the data filling mechanism unit of the first priority interrupt source, described data filling mechanism unit is used for the Interrupt Process result according to the described first priority interrupt source, controls described digital voice data and is loaded in the pulse width modulated converter in order.
The present invention also provides a kind of patient monitor, described patient monitor comprises: be used to the follow-up circuit that connects the output terminal of PWM converter and realize voice output, the processor that is used for the read-write of control figure speech data, be used to store the sound bank of digital voice data to be played, and the pulse width modulated converter that is used for speech data is carried out pulse-length modulation, described patient monitor also comprises: the data filling mechanism unit that contains the first priority interrupt source, described data filling mechanism unit sends interrupt request every a Preset Time one time to described processor, according to the result of described processor, control described digital voice data and be loaded in the pulse width modulated converter in order.
The present invention also provides a kind of phoneme synthesizing method, comprising: utilize first a default priority interrupt source to produce interrupt request; According to described interrupt request, processor carries out width modulation to the digital voice data to be played of storage; Output language data process result.
The present invention sends interruption by one first priority interrupt source being set being independent of outside the pulse width modulated converter (hereinafter to be referred as the PWM converter) to processor cores, the system handles resource of request speech synthetic device.The priority that will be higher than the interior PWM event interrupt source of PWM converter in the prior art at least of the priority setting of the first priority interrupt source here, it can be the interrupt source of the higher priority of the inner close processor cores of speech synthetic device, or the interrupt source of the high priority of external trigger, such as some non-shielding interrupt sources (promptly not maskable interrupt source), so just can avoid the delay of phonetic synthesis, avoid because of existing more senior interrupt request to obstruct the process of phonetic synthesis, guaranteed when a plurality of tasks are handled jointly, effectively to improve the quality of phonetic synthesis.
Description of drawings
Fig. 1 is the structural representation of prior art phonetic synthesis;
Fig. 2 is the principle of work synoptic diagram of processor under the multitask in the prior art;
Fig. 3 is the structural representation of PWM converter of the present invention;
Fig. 4 is the structural representation of speech synthetic device of the present invention;
Fig. 5 is the structural representation of the embodiment of the invention 1;
Fig. 6 is the structural representation of the embodiment of the invention 2.
Embodiment
Describe technical scheme of the present invention in detail below in conjunction with accompanying drawing.
As shown in Figure 4, the invention provides a kind of new speech synthetic device, it mainly adopts the PWM speech synthesis technique, and it mainly comprises following components:
(1) sound bank 200, are used to store digital voice data to be played, and the digital speech here comprises media informations such as sound or music.
(2) the PWM converter 240, are used for the speech data after the volume adjusting computing is carried out pulse-length modulation.
(3) data filling mechanism unit 230, it contains the first priority interrupt source of a higher priority, described data filling mechanism unit 230 utilizes the first priority interrupt source to send interrupt request one time every a Preset Time, and after the result according to interrupt request, the read-write of digital voice data in the control sound bank 200, digital voice data is loaded in the PWM converter 240 in order, obtain the pulse-length modulation ripple from the output terminal of PWM converter 240, be used to drive follow-up circuit 250, such as can be directly in order to drive loudspeaker.Normally adopt 221 pairs of interrupt request of processor cores to handle, this processor cores 221 belongs to the important hardware components of the IC integrated chip of realizing phonetic synthesis, and it receives interrupt request by event controller 222, and replys corresponding order.
As shown in Figure 4, above-mentioned speech synthetic device also comprises: be used for described digital voice data is carried out the volume adjusting computing module 210 that volume is regulated computing, this module is connected between described sound bank 200 and the described data filling mechanism unit 230, described data filling mechanism unit 230 is according to the Interrupt Process result of the described first priority interrupt source, and the output result who in order described volume is regulated computing module 210 delivers to PWM converter 240.The volume is here regulated computing and both can also can be realized in interrupting in the interruption outside.
The present invention sends interruption by the first priority interrupt source is set to processor cores 221, the system handles resource of request speech synthetic device.Here the priority setting of the first priority interrupt source will be higher than the priority in the interior pulse-width modulation PWM event interrupt source of PWM converter in the prior art at least, it can be the interrupt source that is used to realize the high priority of the interrupt source of the inner higher priority near processor cores of the IC integrated chip of phonetic synthesis or external trigger, such as some non-shielding interrupt source.Preferably, the count cycle of the described PWM converter 240 and the first priority interrupt source is identical with the sampling period of speech data, thereby guarantees the synchronous of reading and writing data.
To illustrate the implementation of above-mentioned data filling mechanism unit below.
Embodiment 1: as shown in Figure 5, the data filling mechanism unit 230 in the present embodiment is arranged on the inside of IC integrated chip, such as, present embodiment adopts the high-performance Blackfin processor of the ADSP-BF531 of ADI up to 600MHZ.The ADSP-BF531 processor has a serial ports, three and has the counter/timer of PWM (pulse-length modulation) and impulsive measurement ability, real-time clock, inner core timer, on-chip memory up to 148Kbytes, event controller or the like peripheral hardware.Event controller comprises two parts: kernel events controller (CEC) and system break controller (SIC), kernel events controller (CEC) and system break controller (SIC) collaborative work are controlled priority and all system events of control.The interruption from peripheral hardware as a rule enters into SIC, and then is sent straight in the general interrupts of CEC and handles, and system break controller SIC provides to the mapping and the route of the input of CEC general interrupts for the interrupt source from a plurality of peripheral hardwares.
As shown in Figure 5, present embodiment utilizes ADSP-BF531 to realize speech synthetic device, it adopts the first priority interrupt source of the on-chip timer 231 of IC chip as data filling mechanism unit 230, the timer of the support PWM function that employing IC chip internal provides is as PWM converter 240, and in data filling mechanism unit 230, also comprise data filling controller 232, being used for controlling volume regulates the speech data of computing module 210 outputs and is input to PWM converter 240, data filling controller 232 can build on the Physical layer of IC integrated chip, realizes function corresponding by the software programming program.The course of work of present embodiment speech synthetic device is as follows:
At first, speech data to be played is stored in the sound bank 200, and the speech database 200 here can adopt on-chip memory; Then, open the PWM translation function of present embodiment, promptly activate volume and regulate computing module 210 and PWM converter 240; At this moment, on-chip timer 231 will send interrupt request by event controller 222 to processor cores 221 at regular intervals, and send control signal to data filling controller 232, processor cores 221 receives interrupt request and handles, according to the processor cores distributed system resources, speech data in the sound bank 200 is loaded into the input end that volume is regulated computing module 210 in order, the speech data of regulating the output terminal acquisition of computing module 210 from volume changes over to the PWM converter 240 by data filling controller 232, correspondingly handle, in order to drive follow-up circuit 250 (as loudspeaker).The priority of the interrupt request that on-chip timer 231 sends is decided by kernel events controller CEC, and is as shown in table 1 below.
Table 1
Last table has only write down the incident of kernel events control CEC, the title and the priority of event vector table (EVT).CEC is except that dedicated interrupt and anomalous event in kernel events control, also support 9 general interrupts (as above shown in the table), wherein general interrupts 14 and 15 is used for software interruption, interrupt and remain 7 peripheral hardwares that can be used as processor cores, and provide interruption input mapping to CEC by system break controller (SIC).According to the content shown in the last table, if on-chip timer 231 adopts inner core timer, then its priority bit is in the 6th.And usually in the prior art, the mapping IVG11 that device was given tacit consent to when the interrupt source of PWM incident adopted the processor piece internally and externally set, it belongs to the 11st of the priority of table 1.This shows, the inner core timer that present embodiment adopted or not the maskable interrupt source priority of sending interrupt request to be higher than the interrupt request that the interrupt source of PWM incident in the prior art is sent, so the present embodiment speech synthetic device will reduce time delay effectively, and avoid to handle the distortion that a plurality of tasks cause synthetic speech, thereby improved the quality of synthetic speech because of processor.
Embodiment 2: as shown in Figure 6, the difference of present embodiment and the foregoing description 1 is: data in present embodiment filling mechanism unit 230 constitutes by data filling controller 232 with as 233 two parts of peripheral hardware interrupt source of the first priority interrupt source, the peripheral hardware interrupt source 233 here is arranged on the outside of the IC integrated chip that is used to realize phonetic synthesis, constitute by outer timer of sheet or counter, and the event attribute of this interrupt source is set to not, and maskable interrupts.In the course of work of present embodiment PWM speech synthetic device, will send interrupt request by event controller 222 to processor cores 221 at regular intervals by peripheral hardware interrupt source 233, and send control signal to data filling controller 232.The PWM speech synthetic device of present embodiment also can adopt the ADSP-BF531 of ADI to realize up to the high-performance Blackfin processor of 600MHZ.Like this, the interrupt request that peripheral hardware interrupt source 233 is sent can send processor cores 221 to by system break controller SIC, kernel events controller CEC successively, as shown in table 1, the priority bit of the peripheral hardware interrupt source 233 of present embodiment is in the 2nd of above-mentioned table 1 priority.Compared with prior art, the priority of the interrupt request of present embodiment PWM change event will be higher than the interrupt request that the interrupt source of PWM incident in the prior art is sent, so the present embodiment speech synthetic device also will reduce time delay effectively, and avoid to handle the distortion that a plurality of tasks cause synthetic speech, thereby improved the quality of synthetic speech because of processor.
Implement 3: on the basis of embodiment 1 or 2, as shown in Figure 3, the PWM converter 240 of present embodiment comprises: a counter and a comparer; Counter is according to certain loop cycle counting, regularly at an input end input digit speech data of comparer, and, both are compared in the value of the counter of another input end input of comparer, the width-modulation pulse of output is in order to drive amplifier, power amplifier, just realize voice again.Other ingredients of present embodiment are identical with embodiment 1 or 2 with annexation.If present embodiment also adopts ADSP-BF531, then PWM converter 240 can be realized by three timers of peripheral hardware in the sheet.
Based on such scheme, the present invention also provides a kind of patient monitor, it comprises the described speech synthetic device of Fig. 4, wherein contain: be used to the follow-up circuit that connects the output terminal of PWM converter and realize voice output, the processor that is used for the read-write of control figure speech data, be used to store the sound bank of digital voice data to be played, be used for speech data is carried out the PWM converter of pulse-length modulation, and the data filling mechanism unit that contains the first priority interrupt source, described data filling mechanism unit sends interrupt request every a Preset Time one time to described processor, according to the result of described processor, control described digital voice data and be loaded in order in the PWM converter.Here relating to the related art scheme of speech synthetic device and expand all can be referring to above-mentioned related description, and the processor here can be a processor cores of realizing the IC integrated chip of phonetic synthesis, also can be in order to receive the also module or the unit of handling interrupt requests.
In addition, the present invention also provides a kind of phoneme synthesizing method, and it comprises: utilize first a default priority interrupt source to produce interrupt request; According to described interrupt request, processor carries out width modulation to the digital voice data to be played of storage; Output language data process result.The priority of the described first priority interrupt source is higher than the priority of width modulation incident.Here relating to the related art scheme (as the explanation to the first priority interrupt source) of phoneme synthesizing method and expand all can be referring to above-mentioned related description.
In sum, technical scheme of the present invention can be verified in the ADSP-BF531 of ADI, set the PWM and the first priority interrupt source (as the inner core timer among the embodiment 1, the perhaps outer timer of sheet) count cycle is identical with the sampling period of speech data, open the interruption of the first priority interrupt source, enable the PWM converter and the first priority interrupt source simultaneously, in the interrupt service routine of the first priority interrupt source, load the register of the adjusting dutycycle in the PWM converter with speech data, utilize PWM phoneme synthesizing method (for example 11MHz) simultaneity factor when dominant frequency is very low of the present invention program to open such as timer, SPORTS, SPI, 7 interrupt task such as UART, actual test finds also can not influence the quality of phonetic synthesis when task is very frequent.If do not adopt the solution of the present invention, if under interrupt task still less, also adopt low dominant frequency, substantially can not playback, even raising dominant frequency, for example bring up to 10 times, when interrupt task is very busy, still voice distortion can appear, and the raising of processor host frequency simultaneously also can make power consumption almost improve an order of magnitude.As seen, the invention provides a kind of PWM speech synthesis technique, it can utilize the embedded system of low dominant frequency promptly can finish the phonetic synthesis task and finish other tasks again, improved the utilization factor of system, having reduced cost, reduced power consumption, is a kind of efficient height, phonetic synthesis scheme that cost is low.
More than be example with the embedded system of low dominant frequency, illustrated that the present invention not only finishes the phonetic synthesis task but also finishes other tasks, improved the utilization factor of system, reduced cost.In fact, the present invention can also be applied to non-embedded system, and other speech synthesis systems.
Should be understood that, for those of ordinary skills, can be improved according to the above description or conversion, and all these improvement and conversion all should belong to the protection domain of claims of the present invention.
Claims (16)
1. speech synthetic device, described device comprises: be used to store the sound bank of digital voice data to be played, and the pulse width modulated converter that is used for speech data is carried out pulse-length modulation; It is characterized in that,
Described device also comprises: one contains the data filling mechanism unit of the first priority interrupt source, described data filling mechanism unit is used for the Interrupt Process result according to the described first priority interrupt source, controls described digital voice data and is loaded in the pulse width modulated converter in order.
2. speech synthetic device according to claim 1 is characterized in that the priority of the described first priority interrupt source is higher than the priority of width modulation incident.
3. speech synthetic device according to claim 1, it is characterized in that, described speech synthetic device also comprises: be used for described digital voice data is carried out the volume adjusting computing module that volume is regulated computing, this module is connected between described sound bank and the described data filling mechanism unit, described data filling mechanism unit is according to the Interrupt Process result of the described first priority interrupt source, and the output result who in order described volume is regulated computing module delivers to described pulse width modulated converter.
4. speech synthetic device according to claim 2 is characterized in that, the described first priority interrupt source is in the inner interrupt source near processor cores of the IC integrated chip of realizing phonetic synthesis.
5. speech synthetic device according to claim 2 is characterized in that, the described first priority interrupt source is maskable interrupt source not.
6. speech synthetic device according to claim 4 is characterized in that, the first priority interrupt source in the described data filling mechanism unit is the inner core timer of IC integrated chip inside.
7. speech synthetic device according to claim 5, it is characterized in that, the first priority interrupt source in the described data filling mechanism unit is arranged on the outside of the IC integrated chip that is used to realize phonetic synthesis, and the event attribute of this interrupt source is set to not, and maskable interrupts.
8. according to the described speech synthetic device of the arbitrary claim of claim 1 to 7, it is characterized in that the count cycle of the described pulse width modulated converter and the first priority interrupt source is identical with the sampling period of speech data.
9. patient monitor, described patient monitor comprises: the processor that is used for the read-write of control figure speech data, be used to store the sound bank of digital voice data to be played, be used for speech data is carried out the pulse width modulated converter of pulse-length modulation, and be used to the follow-up circuit that connects the output terminal of PWM converter and realize voice output, it is characterized in that described patient monitor also comprises:
The data filling mechanism unit that contains the first priority interrupt source, described data filling mechanism unit sends interrupt request every a Preset Time one time to described processor, according to the result of described processor, control described digital voice data and be loaded in the pulse width modulated converter in order.
10. speech synthetic device according to claim 7 is characterized in that the priority of the described first priority interrupt source is higher than the priority of width modulation incident.
11. a phoneme synthesizing method comprises:
Utilize first a default priority interrupt source to produce interrupt request;
According to described interrupt request, processor carries out width modulation to the digital voice data to be played of storage;
Output language data process result.
12. phoneme synthesizing method according to claim 11 is characterized in that, the priority of the described first priority interrupt source is higher than the priority of width modulation incident.
13. phoneme synthesizing method according to claim 12 is characterized in that, the described first priority interrupt source is in the inner interrupt source near processor cores of the IC integrated chip of realizing phonetic synthesis.
14. phoneme synthesizing method according to claim 12 is characterized in that, the described first priority interrupt source is maskable interrupt source not.
15. phoneme synthesizing method according to claim 14 is characterized in that, the described first priority interrupt source is the inner core timer of IC integrated chip inside.
16. phoneme synthesizing method according to claim 14 is characterized in that, the described first priority interrupt source is the external interrupt source of processor chips, and the event attribute of this interrupt source is set to not, and maskable interrupts.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN200810216875A CN101727897B (en) | 2008-10-17 | 2008-10-17 | Speech synthesis device, method and monitor applied thereby |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN200810216875A CN101727897B (en) | 2008-10-17 | 2008-10-17 | Speech synthesis device, method and monitor applied thereby |
Publications (2)
Publication Number | Publication Date |
---|---|
CN101727897A true CN101727897A (en) | 2010-06-09 |
CN101727897B CN101727897B (en) | 2012-09-19 |
Family
ID=42448688
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN200810216875A Expired - Fee Related CN101727897B (en) | 2008-10-17 | 2008-10-17 | Speech synthesis device, method and monitor applied thereby |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN101727897B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102831889A (en) * | 2012-08-30 | 2012-12-19 | 杭州晟元芯片技术有限公司 | System of voice PWM (Pulse-Width Modulation) output |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4397562A (en) * | 1980-02-26 | 1983-08-09 | Citizen Watch Company Limited | Digital-analog converter circuit for speech-synthesizing electronic timepiece |
CN2627768Y (en) * | 2003-07-29 | 2004-07-21 | 天津市北海通信技术有限公司 | Small-sized integrated broadcaster |
CN2710084Y (en) * | 2004-06-25 | 2005-07-13 | 邱晓鸣 | Multifunction electronic school timetable with voice broadcast |
-
2008
- 2008-10-17 CN CN200810216875A patent/CN101727897B/en not_active Expired - Fee Related
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102831889A (en) * | 2012-08-30 | 2012-12-19 | 杭州晟元芯片技术有限公司 | System of voice PWM (Pulse-Width Modulation) output |
Also Published As
Publication number | Publication date |
---|---|
CN101727897B (en) | 2012-09-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104981789B (en) | Device and method for Variable delay storage operation | |
CN102736999B (en) | Voice data input equipment and voice data output device | |
JP2011505037A (en) | Read data buffering system and method | |
JP2013544006A (en) | Minimizing resource latency between processor application states in portable computing devices by scheduling resource set migration | |
US8190924B2 (en) | Computer system, processor device, and method for controlling computer system | |
CN109960589A (en) | Implementation method, device and the readable medium of the system software layer of embedded system | |
US8594816B2 (en) | Method and system for measuring task load | |
US8949845B2 (en) | Systems and methods for resource controlling | |
CN101727897B (en) | Speech synthesis device, method and monitor applied thereby | |
US8180943B1 (en) | Method and apparatus for latency based thread scheduling | |
CN109933549A (en) | A kind of interrupt control unit suitable for RISC-V processor | |
US20110029757A1 (en) | Stream processor and task management method thereof | |
US9792135B2 (en) | Differential voltage and frequency scaling (DVFS) switch reduction | |
EP1366421B1 (en) | Digital signal processor interrupt accelerator | |
JPH04330561A (en) | Digital signal processor | |
US7984234B2 (en) | Memory control apparatus and memory control method | |
US10540305B2 (en) | Semiconductor device | |
CN105679320B (en) | Phonetic controller and sound control method for household electrical appliance | |
JP2011081695A (en) | Control circuit of data operation unit and data operation unit | |
JP3887005B2 (en) | Processor integrated circuit | |
WO2022206227A1 (en) | System startup method, device, and system, and storage medium | |
US20240143268A1 (en) | Supporting multiple audio endpoints with a single integrated inter-chip sound controller | |
JPS6225334A (en) | Instruction processing system | |
JP2006331008A (en) | Memory interface | |
US20060212638A1 (en) | Motherboard and control method thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120919 Termination date: 20161017 |