CN202602832U - System for identifying programs played on television - Google Patents

System for identifying programs played on television Download PDF

Info

Publication number
CN202602832U
CN202602832U CN 201220208455 CN201220208455U CN202602832U CN 202602832 U CN202602832 U CN 202602832U CN 201220208455 CN201220208455 CN 201220208455 CN 201220208455 U CN201220208455 U CN 201220208455U CN 202602832 U CN202602832 U CN 202602832U
Authority
CN
China
Prior art keywords
module
control module
voice data
television set
station symbol
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN 201220208455
Other languages
Chinese (zh)
Inventor
喻子达
陈宜龙
张晓娜
于翀
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Haier Group Corp
Qingdao Haier Electronics Co Ltd
Hefei Haier Information Product Co Ltd
Qingdao Haier Multimedia Co Ltd
Original Assignee
Haier Group Corp
Qingdao Haier Electronics Co Ltd
Hefei Haier Information Product Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Haier Group Corp, Qingdao Haier Electronics Co Ltd, Hefei Haier Information Product Co Ltd filed Critical Haier Group Corp
Priority to CN 201220208455 priority Critical patent/CN202602832U/en
Application granted granted Critical
Publication of CN202602832U publication Critical patent/CN202602832U/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The utility model provides a system for identifying programs played on a television. The system comprises the television and a server. The television identifies a station caption and audio frequency of a currently-played channel and sends identification results to the server, the server reads program information of the channel according to station caption images and the audio frequency performs feedback to the television, and the program information is displayed through the television. According to the system, played contents are identified by identifying the station caption of the currently-played channel on the television and the audio frequency.

Description

The system of identification television set broadcast program
Technical field
The utility model relates to a kind of system that discerns the television set broadcast program.
Background technology
Obtain at present mode that the user watching content usually for to judge, but this mode only is applicable to digital television signal through electronic program EPG information.If when the signal that television set received is analog signal, then can't be suitable for.
The utility model content
In view of this, the main purpose of the utility model is, a kind of system that discerns the television set broadcast program is provided, and realizes identifying in progress content through station symbol and the audio frequency of discerning current television set institute broadcasting channel.
The system of the identification television set broadcast program that the utility model provided comprises television set and server, and said television set comprises tuner and video decode module that is connected with tuner and audio decoder module, it is characterized in that said television set also comprises:
Video acquisition module;
Picture recognition module is connected with video acquisition module, and the station symbol image that is used for vedio data is comprised is discerned;
The audio collection module;
The audio frequency pretreatment module is connected with the audio collection module, is used for the voice data of being gathered is extracted audio frequency characteristics;
First control module is connected with picture recognition module with the audio frequency pretreatment module, is used for station symbol image that carries current time information and the voice data that extracted audio frequency characteristics are sent;
Said server comprises:
The program data memory module;
The programme memory module;
Second control module; Be connected with the programme memory module with the program data memory module; Be used to receive station symbol image that first control module sends and the voice data that has extracted audio frequency characteristics, compare, determine the channel that current television set is play with the station symbol image in the program data memory module and the voice data of station symbol image subordinate channel; And call the programme information in the programme memory module according to determined channel, feed back to television set.
By last, realize identifying in progress content through station symbol and the audio frequency of discerning current television set institute broadcasting channel.
Optional, said television set also comprises the OSD unit, is connected with first control module with the video decode module respectively, being used for provides the menu that shows this control command according to the programme information that first control module is transmitted, and is superimposed to vedio data.
By last, realize the programme information that shows this channel directly perceived.
Optional, said program data memory module comprises station symbol image memory module and voice data memory module.
By last, realize storing respectively station symbol image and voice data.
Optional, said audio frequency pretreatment module comprises and connecting successively:
The normalizing processing module is used to eliminate the height difference of different channel audio sound;
The preemphasis processing module is used to promote the high frequency of voice data;
Divide the frame processing module, be used for that voice data is carried out the branch frame and handle;
The windowing process module is used to eliminate the discontinuity of the adjacent frame of voice data that frequency division handles.
Optional,
Said normalizing processing module is to comprise that model is the circuit of TMS320C549 chip;
Said preemphasis processing module is a digital filter;
Said minute frame processing module is to comprise that model is the circuit of 74HC393 chip;
Said windowing process module is to comprise that model is the circuit of SN54HC151J chip.
Optional, also comprise clock module, be connected with said first control module, be used to provide clock information.
Description of drawings
Fig. 1 is the principle schematic of the system of identification television set broadcast program.
Embodiment
Below in conjunction with accompanying drawing the system of the described identification television set of the utility model broadcast program is described.In the present embodiment, comprise television set 10 and server 20.Wherein, television set 10 identifies the station symbol and the audio frequency of current institute broadcasting channel, and recognition result is sent to server 20, and server 20 reads out the programme information of this channel according to station symbol and audio frequency, and feeds back to television set 10.
As shown in Figure 1, television set 10 comprises: tuner 101, the video decode module 102 and the audio decoder module 103 that are connected with tuner 101; The video processing module 113 and the video acquisition module 108 that are connected with video decode module 102; The loud speaker 105 and the audio collection module 106 that are connected with audio decoder module 103; The picture recognition module 109 that is connected with video acquisition module 108; The audio processing modules 107 that is connected with audio collection module 106; First control module 110 that is connected with audio processing modules 107 with picture recognition module 109, and the clock module 111 and OSD unit 112 that are connected with first control module 110.
Wherein, tuner 101 is used for the TV signal that is received being decoded and demodulation outputting video signal (like the CVBS signal) and audio signal.Tuner 101 can adopt single tuner, also can adopt double high-frequency head.
Video decode module 102 is connected with tuner 101, is used for decoding video signal is handled, and generates vedio data.Selectable, the function of said video decoding unit 102 is realized by the circuit that comprises integrated chips such as ADV7441A, TVP5150AM1PBSR or SAA7113H, does not give unnecessary details at this.
OSD unit 112 is connected with first control module 110 with video decode module 102 respectively, and being used for provides the menu that shows this programme information according to the programme information that first control module 110 is transmitted.The function of OSD unit 112 is realized by the circuit that comprises the MB90092 integrated chip.
Video processing module 113 is connected with first control module 110 with video decode module 102; Be used for superposeing the programme information menu of transmitting by the video decode module 102 generation vedio datas and first control unit 110 that is received synthetic; And according to video image property control instruction the attribute of vedio data is adjusted, said attribute comprises color, brightness and the contrast of video image.Display screen 104 is connected with video processing module 113.
Video acquisition module 108 is connected with video decode module 102, is used for vedio data is pursued the frame screenshotss.
Picture recognition module 109 is connected with video acquisition module 108, and the station symbol image that is used for vedio data is comprised is discerned.
The recognition methods of said station symbol is: set up in the picture recognition module 109 the identical array I of the vedio data pixel of being gathered with video acquisition module 108 (xi, yj).Wherein, the x in the array representes abscissa, and y representes ordinate; I, j represent the ordinal number of abscissa or ordinate pixel respectively.Each two field picture of institute's screenshotss is all carried out the frame difference operation with first two field picture, if the frame difference of this pixel thinks that less than specified threshold value this pixel is identical at adjacent two frame video images.Preferable, because the station symbol of most channels all is positioned at the same position (upper left side of picture) of video image, when therefore carrying out the calculating of frame difference, only need calculate to the station symbol region, save computing time thus.(for example 3 seconds) N continuous two field picture in a period of time is carried out the frame difference calculate,, therefore get the image of equal no change (being the pixel of frame difference) in the N two field picture, be the station symbol image less than specified threshold value because background image can change.The function of said picture recognition module 109 is through comprising that model is the circuit realization of TMS3206455 chip.
Audio decoder module 103 is connected with tuner 101, is used for audio signal is carried out decoding processing, generates playing audio-fequency data.The function of said video decoding unit 103 is realized by the MSH9010 integrated chip, does not give unnecessary details at this.Preferable, also comprise audio treatment unit (not shown), be connected with audio decoder module 103, loud speaker 105 and first control module 110 respectively, be used for exporting loud speaker 105 volumes to by audio decoder module 103 according to the adjusting of volume control command.
Audio collection module 106 is connected with audio decoder module 103, is used to gather decoded voice data.
Audio processing modules 107 is connected with audio collection module 106, is used for the voice data of being gathered is carried out preliminary treatment, extracts audio frequency characteristics.Said audio processing modules 107 comprises normalizing processing module, preemphasis processing module, branch frame processing module and the windowing process module that connects successively.
Wherein, the normalizing processing module is used for that audio frequency is carried out normalization to be handled, to eliminate the height difference of different channel audio sound.According to expression formula y (n)=x (n)/max (| x (n) |), wherein, the audio sound after y (n) expression normalization is handled, x (n) representes former audio sound.The function of said normalizing processing module is through comprising that model is the circuit realization of TMS320C549 integrated chip.
The preemphasis processing module is used to promote the HFS of voice data.Because voice data can lose the part radio-frequency component after decoding through audio decoder module 103, handles promoting HFS through preemphasis, realizes that voice data keeps smooth on frequency band.Preemphasis is handled through the digital filter of single order and is realized, that is: H (z)=1-μ z -1
Dividing the frame processing module to be used for that voice data is carried out the branch frame handles.Voice data has time-varying characteristics, but (for example 10ms~30ms), its characteristic remains unchanged basically, and is promptly relatively stable in one enough short period.Therefore decoded voice data is carried out the branch frame and handle every frame duration 20ms.Can to seamlessly transit in order making between frame and the frame, to keep its continuity, present embodiment adopts the method for overlapping segmentation, and promptly the frame head of the postamble of each frame and next frame is overlapping, and the ratio that frame moves with frame length generally is taken as 1/3~1/2.The function of said minute frame processing module is through comprising that model is the circuit realization of 74HC393 integrated chip.
The windowing process module is used to eliminate the discontinuity of the adjacent frame head and the tail of frequency division voice data.It is in order to eliminate mutually owing to divide frame to handle the discontinuity of caused adjacent frame head and the tail that each frame voice data is carried out windowing process.Hamming (Hamming) window is adopted in said windowing process:
Figure BDA00001625252200051
0≤n≤N-1.As sampling period T s=1/f sOne regularly, and the relation between length of window N and the frequency resolution Δ f is:
Figure BDA00001625252200052
When sampling period Ts was definite value, along with the variation of the window size N that selects, frequency Δ f constantly changed.If it is too small that window is selected, frequency resolution can reduce; Temporal resolution has just reduced if it is excessive that window is selected, and frequency resolution can improve.The function of said windowing process module is through comprising that model is the circuit realization of SN54HC151J integrated chip.
First control module 110 is connected with audio processing modules 107, picture recognition module 109 and clock module 111, is used for the station symbol image that carries the current time information that clock module 111 provided and the voice data that extracted audio frequency characteristics transmitted exporting said second control module 201 of back literary composition to.
In addition, said first control module 110 also is used for from second control module, 201 program receiving information, and is forwarded to OSD unit 112, and provides the menu of programme information to be forwarded to video processing module 113 112 of OSD unit.
Need to prove that communicating by letter between said first control module 110 and second control module 201 can be adopted WLAN, Radio Transmission Technologys such as WIFI, WIFI Direct or 2.4G for example, this is prior art, repeats no more.
Server 20 reads out the programme of this channel according to station symbol and audio frequency, feeds back to television set 10.Comprise second control module 201, and the program data memory module 202 and programme memory module 203 that are connected with second control module 201.
Said program data memory module 202 is used to store the station symbol image of each channel and the voice data of current broadcast program.Wherein, program data memory module 202 comprises station symbol image memory module (not shown) and voice data memory module (not shown).
Said programme memory module 203 is used to store the programme information of each channel.
Second control module 201 is used to receive station symbol image that first control module 110 sends and the voice data that has extracted audio frequency characteristics; Respectively with station symbol image memory module in station symbol image or the voice data of the current broadcast program in the voice data memory module compare; Determine the channel that current television set is play; And call the programme information in the programme memory module 203 according to determined channel, feed back to first control module 110.Wherein, the comparison recognition function of station symbol image can realize through the circuit that comprises CPLD picture processing chip or TMS3206455 chip in second control module 201; And the comparison recognition function of voice data can realize through the circuit that comprises ADI series logic audio chip.Above-mentioned hardware belongs to the conventional techniques of sound, video identification, so repeat no more.
Just describe in the face of the judgement of the utility model down in the process of play content.
Tuner 101 is with institute's received television signal decoding and demodulation; Outputting video signal and audio signal; After vision signal and audio signal were decoded through video decode module 102 and audio decoder module 103 respectively, video image was shown that by display screen 104 audio frequency is play by loud speaker 105.Video acquisition module 108 is pursued the frame screenshotss with the video image of being play.Picture recognition module 109 is all carried out the frame difference operation with first two field picture with each two field picture of institute's screenshotss, to identify the station symbol image.Audio collection module 10 is gathered decoded voice data.Above-mentioned voice data carries out preliminary treatment such as normalizing, preemphasis, branch frame and windowing to extract the characteristic of voice data through audio processing modules 107.First control module 110 is with the station symbol image and carry transmitting through pretreated voice data of current time information and export said second control module 201 of back literary composition to.The station symbol image in second control module 201 and the program data memory module 202 or the voice data of current broadcast program are compared; Determine the channel that current television set is play; And call the programme information in the programme memory module 203 according to determined channel, feed back to first control module 110.First control module 110 is forwarded to OSD unit 112 with said order information, and OSD unit 112 is forwarded to video processing module 113 according to the programme information menu that programme information provides, and is superimposed to vedio data by video processing module 113.
Need to prove; When the station symbol image of being discerned when picture recognition module 109 is unique; Then the first control module 110 station symbol image that only will carry current time information transfers to second control module 201; Read the programme that 203 pairs of programme memory modules should station symbol by second control module 201, obtain programme content title corresponding in the programme, feed back to first control module 110 according to temporal information.
And the station symbol image of being discerned when picture recognition module 109 two station symbol images then can occur when not unique (for example local broadcasting stations relay the program of the Chinese Central Television (CCTV) synchronously).First control module 110 is with said two station symbol images and carry the pretreated voice data of the process of current time information and transmit and export said second control module 201 of back literary composition to; Second control module 201 reads the programme that 203 pairs of programme memory modules should two station symbols; And from corresponding these two program datas that the station symbol subordinate channel is current of program data memory module 202 acquisitions; Compare with the pretreated voice data of carry out respectively; The programm name of being play to determine, the programme content title feeds back to first control module 110.
The above is merely the preferred embodiment of the utility model; Not in order to restriction the utility model; All within the spirit and principle of the utility model, any modification of being done, be equal to replacement, improvement etc., all should be included within the protection range of the utility model.

Claims (6)

1. system that discerns the television set broadcast program; Comprise television set (10) and server (20); Said television set comprises tuner (101) and video decode module (102) that is connected with tuner (101) and audio decoder module (103), it is characterized in that said television set (10) also comprises:
Video acquisition module (108);
The picture recognition module (109) that the station symbol image that is used for that vedio data is comprised is discerned, this module is connected with video acquisition module (108);
Be used for carrying first control module (110) that the station symbol image of current time information sends, this control module is connected with picture recognition module (109);
Said server (20) comprising:
Station symbol image memory module;
Programme memory module (203);
Be used to receive the station symbol image that first control module (110) is sent; Determine the channel that current television set is play; And second control module (201) that will feed back with the programme information that this channel is mated, said second control module (201) is connected with programme memory module (203) with station symbol image memory module respectively.
2. system for TV set according to claim 1 is characterized in that, said television set (10) also comprises:
Audio collection module (106);
Be used for the voice data of being gathered is extracted the audio frequency pretreatment module (107) of audio frequency characteristics, audio frequency pretreatment module (107) is connected with said audio collection module (106);
Said first control module (110) also is used for the voice data output of extracting audio frequency characteristics is connected with said audio frequency pretreatment module (107);
Said server (20) also comprises:
The voice data memory module is connected with said station symbol image memory module;
Programme memory module (203);
Said second control module (201) also is used to receive station symbol image that first control module (110) sends and the voice data that has extracted audio frequency characteristics; Determine the channel that current television set is play; And will feed back to television set (10) with the programme information that this channel is mated, said second control module (201) is connected with voice data memory module, voice data memory module and programme memory module (203) respectively.
3. system for TV set according to claim 1; It is characterized in that; Said television set comprises also and is used for according to the programme information that first control module (110) is transmitted the OSD unit (112) that shows this programme information menu being provided that said OSD unit (112) is connected with first control module (110);
Be used for OSD unit (112) the programme information menu that is provided is superimposed to the video processing module (113) of vedio data, video processing module (113) is connected with video decode module (102) with first control module (110) respectively.
4. system for TV set according to claim 1 is characterized in that, said audio frequency pretreatment module (107) comprises successively and to connect:
Be used to eliminate the normalizing processing module of the height difference of different channel audio sound;
Be used to promote the preemphasis processing module of the high frequency of voice data;
Be used for voice data is carried out the branch frame processing module that the branch frame is handled;
Be used to eliminate the windowing process module of the discontinuity of the adjacent frame of voice data that frequency division handles.
5. system for TV set according to claim 4 is characterized in that,
Said normalizing processing module is to comprise that model is the circuit of TMS320C549 chip;
Said preemphasis processing module is a digital filter;
Said minute frame processing module is to comprise that model is the circuit of 74HC393 chip;
Said windowing process module is to comprise that model is the circuit of SN54HC151J chip.
6. system for TV set according to claim 1 is characterized in that, also comprises the clock module (111) that is used to provide said current time information, and this module is connected with said first control module (110).
CN 201220208455 2012-05-10 2012-05-10 System for identifying programs played on television Expired - Fee Related CN202602832U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201220208455 CN202602832U (en) 2012-05-10 2012-05-10 System for identifying programs played on television

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201220208455 CN202602832U (en) 2012-05-10 2012-05-10 System for identifying programs played on television

Publications (1)

Publication Number Publication Date
CN202602832U true CN202602832U (en) 2012-12-12

Family

ID=47320338

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201220208455 Expired - Fee Related CN202602832U (en) 2012-05-10 2012-05-10 System for identifying programs played on television

Country Status (1)

Country Link
CN (1) CN202602832U (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104104975A (en) * 2013-04-03 2014-10-15 宇瞻科技股份有限公司 Channel information collection method and system for receiving and rebroadcasting programs coming from multiple media sources
CN104185069A (en) * 2013-05-23 2014-12-03 北京下周科技有限公司 Station icon identification method and identification system
CN104301755A (en) * 2013-07-19 2015-01-21 联想(北京)有限公司 Television information obtaining method, television set, background server and system
CN104519398A (en) * 2013-09-29 2015-04-15 宇瞻科技股份有限公司 Method and system for jointly displaying broadcast and network interaction information
CN105979280A (en) * 2015-12-18 2016-09-28 乐视致新电子科技(天津)有限公司 Intelligent television program recognizing method and device
CN106601243A (en) * 2015-10-20 2017-04-26 阿里巴巴集团控股有限公司 Video file identification method and device
CN106851397A (en) * 2017-02-28 2017-06-13 青岛海信电器股份有限公司 A kind of station symbol replacing options and device
CN109495781A (en) * 2018-12-26 2019-03-19 深圳Tcl新技术有限公司 Image quality adjustment method, TV and readable storage medium storing program for executing

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104104975A (en) * 2013-04-03 2014-10-15 宇瞻科技股份有限公司 Channel information collection method and system for receiving and rebroadcasting programs coming from multiple media sources
CN104185069A (en) * 2013-05-23 2014-12-03 北京下周科技有限公司 Station icon identification method and identification system
CN104185069B (en) * 2013-05-23 2018-03-16 北京下周科技有限公司 A kind of TV station symbol recognition method and its identifying system
CN104301755A (en) * 2013-07-19 2015-01-21 联想(北京)有限公司 Television information obtaining method, television set, background server and system
CN104301755B (en) * 2013-07-19 2017-11-03 联想(北京)有限公司 A kind of TV information acquisition methods, TV, background server and system
CN104519398A (en) * 2013-09-29 2015-04-15 宇瞻科技股份有限公司 Method and system for jointly displaying broadcast and network interaction information
CN106601243B (en) * 2015-10-20 2020-11-06 阿里巴巴集团控股有限公司 Video file identification method and device
CN106601243A (en) * 2015-10-20 2017-04-26 阿里巴巴集团控股有限公司 Video file identification method and device
CN105979280A (en) * 2015-12-18 2016-09-28 乐视致新电子科技(天津)有限公司 Intelligent television program recognizing method and device
CN106851397A (en) * 2017-02-28 2017-06-13 青岛海信电器股份有限公司 A kind of station symbol replacing options and device
CN106851397B (en) * 2017-02-28 2020-03-10 青岛海信电器股份有限公司 Station caption replacing method and device
WO2020135499A1 (en) * 2018-12-26 2020-07-02 深圳Tcl新技术有限公司 Image quality adjustment method, television set, and readable storage medium
CN109495781A (en) * 2018-12-26 2019-03-19 深圳Tcl新技术有限公司 Image quality adjustment method, TV and readable storage medium storing program for executing

Similar Documents

Publication Publication Date Title
CN202602832U (en) System for identifying programs played on television
CN101742156B (en) High-resolution digital television all-in-one machine and implementation method thereof
CN105592322B (en) A kind of optimization method and device of media data
CN102710980A (en) Method and device for rapidly changing channel of digital television set top box
CN103281574A (en) Method for synchronizing media services
US8339515B2 (en) Image signal generating apparatus, image signal generating method, and image signal generating program
CN105657492A (en) Television signal processing method and device and television playing control system
CN101022548A (en) Method for processing data in a terminal with digital broadcasting receiver
CN106412384A (en) Video processing system
CN102364960B (en) Mobile digital television picture in picture and channel thumbnail playing method and mobile terminal
CN204168404U (en) A kind of processing unit of ultra high-definition signal and full HD TV
KR20150037372A (en) Image display apparatus, Server for synchronizing contents, and method for operating the same
US8976301B2 (en) Television tuner and method thereof
CN202663483U (en) Television set and control system of television set
CN2938639Y (en) TV receiver with DVB-T digital signal receiving function
CN108965953A (en) It is a kind of to receive DVB-C and DTMB simple two-way signal set-top-box system and method simultaneously
CN202218322U (en) Energy-saving internet protocol television
CN204887296U (en) Cable television fuses STB with terrestrial digital TV and IPTV terminal
CN201541330U (en) 3D stereoscopic digital television
CN201854360U (en) Digital television receiving device
CN108449622B (en) Mixed data source smart television playing and interaction system
CN207382476U (en) One kind supports cable TV signal and ISDB-T dual mode systems based on set-top box
CN107707949A (en) It is a kind of to support cable TV signal and ISDB T set-top-box system and method
CN201286147Y (en) Television signal converting apparatus
CN202738040U (en) Network television set-top box

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant
C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20151117

Address after: 266101 Haier Information Park, 1 Haier Road, hi tech park, Laoshan District, Qingdao, Shandong

Patentee after: Qingdao Haier Electric Appliance Co., Ltd.

Patentee after: haier group corporation

Patentee after: Hefei Haier Information Product Co., Ltd.

Patentee after: QINGDAO HAIER MULTI-MEDIA CO., LTD.

Address before: 266101 Haier Information Park, 1 Haier Road, hi tech park, Laoshan District, Qingdao, Shandong

Patentee before: Qingdao Haier Electric Appliance Co., Ltd.

Patentee before: haier group corporation

Patentee before: Hefei Haier Information Product Co., Ltd.

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20121212

Termination date: 20210510