CN202218352U - Non-intrusive double-ended-acquisition video end-to-end time delay measuring device - Google Patents

Non-intrusive double-ended-acquisition video end-to-end time delay measuring device Download PDF

Info

Publication number
CN202218352U
CN202218352U CN2011203399227U CN201120339922U CN202218352U CN 202218352 U CN202218352 U CN 202218352U CN 2011203399227 U CN2011203399227 U CN 2011203399227U CN 201120339922 U CN201120339922 U CN 201120339922U CN 202218352 U CN202218352 U CN 202218352U
Authority
CN
China
Prior art keywords
video
time delay
measurement mechanism
test
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2011203399227U
Other languages
Chinese (zh)
Inventor
黄松
姬予
张晶
张凌
许勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South China University of Technology SCUT
Original Assignee
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT filed Critical South China University of Technology SCUT
Priority to CN2011203399227U priority Critical patent/CN202218352U/en
Application granted granted Critical
Publication of CN202218352U publication Critical patent/CN202218352U/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Abstract

The utility model provides a non-intrusive double-ended-acquisition video end-to-end time delay measuring device. The measuring device comprises a main measuring device and an auxiliary measuring device which are communicated through a network or a special wire, wherein, the main measuring device comprises a video test signal generator, a video multi-way acquisition module, a network receiving module, a video time delay measuring unit, and a data storage and display unit; and the auxiliary measuring device also comprises a video test signal generator, a video multi-way acquisition module and a network sending module. Compared with the prior art, the non-intrusive measuring device is free of the influence of the inside of the tested system, can comprehensively measure the time delay of all links, and has the characteristics of accuracy and convenience.

Description

The video end-to-end time delay measurement mechanism that the non-intervention type both-end is gathered
Technical field
The utility model relates to the propagation of computer media information, QoS qos measurement, particularly relates to the video end-to-end time delay measurement mechanism that a kind of non-intervention type both-end is gathered.
Background technology
Use fast development and popularize along with based on network multimedia service, systems such as network audio-video program request, network audio-video meeting are popular rapidly.The user has proposed increasingly high requirement to the professional QoS service quality of network multimedia.How can be fast, convenient, accurately the key qos parameter of candidate products is made assessment, be the key of successfully selecting best product.
Simultaneously, research and development and produce the professional manufacturer with system of network multimedia also need a kind of device can be quickly and easily the key parameter of the network multimedia product of own production to be measured, so that in product development process, measure key parameter, and improvement at any time.
End-to-end time delay is one of critical performance parameters of multimedia service, and it directly influences the assessment of QoS and user experience.End-to-end time delay generally includes and gathers time delay, coding time delay, network transfer delay, decoding time delay, plays time delay etc.
The method of existing detection end-to-end time delay roughly can be divided into two big types: one type belongs to insertion type; Promptly through inject the measuring-signal of characteristic at an end of the signal transmission path of system under test (SUT); Perhaps additional measurement data on the original signal data of system under test (SUT); Extract the time that measurement data and recorder are arrived at the other end then, relatively the difference of two times is obtained the time delay size.
The main feature of this type insertion type method is need get involved in the signal transmission path of system under test (SUT), to wherein adding data or therefrom extract measurement data, has being connected of physical circuit between measurement mechanism and the equipment under test.
The main difficult point of this type insertion type method of measurement is:
At first, transmit because measurement data depends on the Frame or the packet of system under test (SUT) usually, middle inevitable through links such as encoding compression, encapsulation, decapsulation, decodings, measurement data may lose or damage in encoding compression and decompression procedure;
Secondly, because data format, encapsulation format, encoding compression and the decoding algorithm of system under test (SUT) may not disclose, the tester will design the metering system and the measuring-signal that match can compare difficulty.
The 3rd, the insertion type method of measurement usually requires serial connection tap or tandem head on the signal data path of system under test (SUT), and is for the system under test (SUT) that has installed, cumbersome usually or be not allowed to.
In addition, the tool software that the insertion type method of measurement that has need operating measurement be used on the terminal of system under test (SUT) carries out timing through tool software.This mode may influence the normal operation at system under test (SUT) terminal itself, can only use in exploitation and debug phase at most, and be difficult to be used in the system of commercialization.
Another kind of method of testing is a non-intervention type, does not have the physics contact between system under test (SUT) and the measurement mechanism, is regarded as flight data recorder to system under test (SUT), and test signal mainly is to get into system under test (SUT) through the sound and optic signal mode, and exports with sound, light mode.Measurement mechanism is through contrast and analyze input, the output signal obtains the time delay size.The advantage of these class methods is the actual motions that stay out of system under test (SUT), with system under test (SUT) concrete realize irrelevant, so have extensive applicability.Such as the subjective sensation and the sense of hearing through human eye, people's ear, assessing end-to-end time delay is exactly these class methods.
Though utilize human eye, people's ear to come subjective evaluation and test very directly perceived, exist under the more approaching situation of the end-to-end time delay parameter of very big error, especially two kinds of systems under test (SUT), be difficult to make science and judge accurately, cause measurement result to lack persuasion.
The utility model content
The purpose of the utility model is to overcome the shortcoming and defect of above-mentioned prior art, the video end-to-end time delay method of measurement and the device that provide the non-intervention type both-end to gather.
The utility model adopts the strategy of non-intervention, is used as flight data recorder to system under test (SUT), to system under test (SUT) end to end the video time delay designed the measuring technique scheme.
The measurement mechanism of the utility model comprises main measurement mechanism and aided measurement device, realizes communication through network or special line between the two.
The aided measurement device of the utility model comprises following assembly:
(1) flying-spot video generator 101, and periodicity or disposable generation have the vision signal of specific format and pattern, and are responsible for playing back vision signal.
(2) vision signal multi pass acquisition module 102; Provide two-way above video acquisition passage; Connect video capture devices such as camera, video camera through interfaces such as USB, video frequency collection cards, gather the video test signals of local video test signals and process system under test (SUT).
(3) the network sending module 103, will collect data test signal and send main measurement mechanism to through network.
The main measurement mechanism of the utility model comprises following assembly:
(1) flying-spot video generator 201, and periodicity or disposable generation have the vision signal of specific format and pattern, and are responsible for playing back vision signal.
(2) vision signal multi pass acquisition module 202; Provide two-way above video acquisition passage; Connect video capture devices such as camera, video camera through interfaces such as USB, video frequency collection cards, gather the video test signals of local video test signals and process system under test (SUT).The video capture device and the interface that are adopted in the specification of this video capture device and interface and the auxiliary test unit vision signal multi pass acquisition module are identical.
(3) the network receiver module 203, receive the data that aided measurement device sends from network.
(4) the video time-delay measuring unit 204, from multi-channel video acquisition module, network receiver module input two-path video signal, the time delay between the two paths of signals added up and calculated.
(5) storage and display unit 205, the receiver, video delay data outputs results on the memory device and display device of appointment.
Measuring process is following:
(1) testing apparatus is made up of the main measurement mechanism of this locality and the aided measurement device of far-end jointly, and main measurement mechanism is gathered the local test signal, and aided measurement device is gathered the remote test signal and passed back to main measurement mechanism through network or special line.
(2) local video test signal generator sends video test signals, and this signal is imported the video capture device (as: video camera) of local terminal of video capture device (as: video camera) and the system under test (SUT) of this landlord testing apparatus simultaneously.
(3) video test signals that gets into system under test (SUT) local terminal video camera arrives the display screen of system under test (SUT) distance terminal through handling and Network Transmission.The test signal that gets into this landlord testing apparatus is then directly read by measurement mechanism, and the time T of video test signals received in main testing apparatus record VL1
(4) camera of far-end aided measurement device is gathered the distal displayed screen and is gone up the test video signal of playing over against system under test (SUT) distal displayed screen, passes this landlord measurement mechanism back through links such as encoding compression, Network Transmission.
(5) local main measurement mechanism receives the test signal that the far-end aided measurement device is passed back, and the time T of this signal received in record VL2, the decoding back submits to signal processing unit to carry out analytical calculation.
(6) local main measurement mechanism calculates time difference between the two according to the time that obtains in step (3) and the step (5), is designated as Δ T VL=T VL2-T VL1
(7) measuring signal generator of far-end sends video test signals, and this signal is simultaneously by the reception that video camera is gathered of the distance terminal of the video camera of the aided measurement device of far-end and system under test (SUT).
(8) the video test signals process that gets into the video camera of system under test (SUT) distance terminal is handled and Network Transmission; Arrive the display screen of system under test (SUT) local terminal; After local main measurement mechanism is gathered; The entering signal processing unit is analyzed and is calculated, and the time T of this video test signals received in main measurement mechanism record VR1.
(9) video test signals of entering far-end aided measurement device camera is transferred to this landlord measurement mechanism through network or special line, is submitted to signal processing unit then and carries out analytical calculation, and the time T of this video test signals received in main measurement mechanism record VR2.
(10) signal processing unit of local main measurement mechanism calculates time difference between the two according to two times of step (8) and step (9) record, is designated as Δ T VR=T VR1-T VR2
(11) signal processing unit of main measurement mechanism is according to two time difference Δ T that successively obtain VLWith Δ T VR, video end-to-end time delay Δ V=(the Δ T of calculating system under test (SUT) VL+ Δ T VR)/2.
The video end-to-end time delay method of measurement and the measurement mechanism of the collection of the utility model non-intervention type both-end have the following advantages:
(1) the utility model method is a non-intervention type, is regarded as flight data recorder to system under test (SUT), and method of testing does not receive the influence of factors such as the internal structure, network type, data type, code decode algorithm, function implementation of system under test (SUT).
(2) the video end-to-end time delay measured of the utility model method, comprised from video acquisition until video playback in the time delay summation of interior all links, in full accord on type and content with the decide time delay assessed when impression receives and evaluates and tests of user.
(3) measurement mechanism of the utility model method is formed with the aided measurement device that is positioned at far-end by being positioned at local main measurement mechanism.Be connected through network between auxiliary equipment and the main equipment, form a video test signals transmission path.This path is with the video Data Transmission path of system under test (SUT); Constitute the transmission loop of test signal; Can solve the occasion of being inconvenient to provide the test signal loop of system under test (SUT) own; Such as: the terminal of system under test (SUT) far-end, display screen and video camera be fix in position all, is difficult to each other over against forming the vision signal loop.
(4) utilize the method for the utility model, the measuring signal generator of local side measuring signal generator and far-end produces test signal separately respectively, and each test signal divides two-way to get into main measurement mechanism, obtains a time difference, is respectively Δ T VRWith Δ T VL, The ultimate results is Δ T VRWith Δ T VLDivided by 2, just cancel out each other the propagation delay time between main measurement mechanism and the aided measurement device after the addition.And the result of both additions both comprised the transmission path from this locality to the far-end, also comprised the transmission path from the far-end to this locality.Even there is the whereabouts path in transmission network and returns asymmetric to the performance in path; Also can be through after the counter circuit time delay; Obtain a comprehensive mean value divided by 2, eliminate the influence of this asymmetry, the result after average can reflect the actual performance of end-to-end time delay more accurately.
(5) the utility model method can make measuring signal generator continue to produce characteristic signal in a period of time; Utilize measurement mechanism to continue test; Obtain a series of delay data; Therefrom analyze statistical natures such as maximum delay, minimal time delay and average delay, can more comprehensively reflect the performance change under the heterogeneous networks load condition of end-to-end time delay.
Description of drawings
When Fig. 1 is the application local test signal generator of the utility model one instance, video end-to-end time delay test philosophy sketch map;
When Fig. 2 is the application remote test signal generator of the utility model one instance, video end-to-end time delay test philosophy sketch map;
Fig. 3 is the aided measurement device internal structure sketch map of the utility model one instance;
Fig. 4 is the main measurement mechanism internal structure sketch map of the utility model one instance.
Embodiment
Below in conjunction with embodiment and accompanying drawing, the utility model is done to specify further, but the execution mode of the utility model is not limited thereto.
Embodiment 1, and Fig. 1, Fig. 2 have provided the video end-to-end time delay testing principle sketch map that the non-intervention type double-end signal is gathered.
Like Fig. 1, the video end-to-end time delay method of measurement of the utility model comprises:
Step 1 is placed a main measurement mechanism in this locality, place an aided measurement device at far-end, connects through network between two equipment and communicates by letter; Main measurement mechanism is gathered local signal, and aided measurement device is gathered remote signaling and passed the main measurement mechanism to this locality back through network.
(1) camera of the main measurement mechanism in this step 1 guarantees accurately to gather the video test signals that the local terminal display screen sends over against the display screen of system under test (SUT) local terminal.
(2) camera of the aided measurement device in this step 1 guarantees accurately to gather the video test signals that the distance terminal display screen sends over against the display screen of system under test (SUT) distance terminal.
Step 2, local video test signal generator sends the test video signal, and this signal is imported the video camera (shown in the position A among Fig. 1) of the local terminal of system under test (SUT) and the video camera (shown in the position B among Fig. 1) of main measurement mechanism simultaneously.
(1) video test signals in this step 2 gets into system under test (SUT) local terminal video camera, through handling and Network Transmission, arrives the display screen (shown in the position C among Fig. 1) of system under test (SUT) distance terminal through signal.
(2) the then direct measured device of signal that also gets into simultaneously main testing apparatus video capture device of the video test signals in this step 2 reads (shown in the position B among Fig. 1).
Step 3, the video test signals that the distal displayed screen is play through the camera of far-end aided measurement device, gets into far-end aided measurement device (shown in the position D among Fig. 1).
Get into the video test signals of far-end aided measurement device in this step 3,, pass this landlord measurement mechanism back through Network Transmission, successively position E among approach Fig. 1 and position F through after the encoding compression.
Step 4, local main measurement mechanism receives the test video that the far-end aided measurement device is passed back, and the decoding back submits to signal processing unit to carry out analytical calculation.
Step 5, local main measurement mechanism is discerned two kinds of test video signals successively receiving, calculates time difference between the two, is designated as Δ T VL.
The time difference Δ T that calculates in this step 5 VLMainly be two parts time delay with, the i.e. One Way Delay Δ T of A → C ACAnd the One Way Delay Δ T of D → E → F DEF, Δ T is promptly arranged VL=Δ T AC+ Δ T DEF.
Step 6, the far-end video test signal generator among Fig. 2 sends video test signals, and this signal is imported the video camera (shown in the position C of Fig. 2) of the distance terminal of system under test (SUT) and the video camera (shown in the position D of Fig. 2) of far-end aided measurement device simultaneously.
Step 7; The signal that gets into system under test (SUT) distance terminal video camera is through handling and Network Transmission; Arrive the display (shown in the position A of Fig. 2) of local terminal, after local main measurement mechanism collection (shown in the position B of Fig. 2), the entering signal processing unit is analyzed and is calculated.
Step 8, the video test signals that gets into far-end aided measurement device camera arrives this landlord measurement mechanism through Network Transmission, and successively position E among approach Fig. 2 and position F are submitted to signal processing unit then and are carried out analytical calculation.
Step 9, the signal processing unit of local main measurement mechanism is discerned the test video signal of successively receiving from the remote signaling generator, calculates time difference between the two, is designated as Δ T VR
The time difference Δ T that calculates in this step 9 VRMainly be the poor of two parts time delay, promptly the One Way Delay of C → A and D → E → F One Way Delay is poor, is designated as Δ T respectively CAWith Δ T DEF, thereby Δ T is arranged VR=Δ T CA-Δ T DEF.
Step 10, the signal processing unit of main measurement mechanism is according to two time difference Δ T of step (5) and the acquisition of (9) priority VLWith Δ T VR, end-to-end time delay Δ V=(the Δ T of calculating system under test (SUT) VL+ Δ T VA)/2.
Δ T in this step 10 VL=Δ T AC+ Δ T DEF, Δ T VR=Δ T CA-Δ T DEF, both add up to:
ΔV=(ΔT VL+ΔT VR)/2
=[(ΔT AC+ΔT DEF)+(ΔT CA-ΔT DEF)]/2
=(ΔT AC+ΔT CA)/2
The result who obtains is the mean value of A → C time delay and C → A time delay.
Embodiment 2, and Fig. 3 has provided the organigram of aided measurement device
Like Fig. 3, the aided measurement device of the audio frequency and video end-to-end time delay of the utility model comprises:
Assembly 1, video test signal generator 101 is responsible for producing video test signals.This signal can be analyzed and discerned by video latency measurement device.
Assembly 2, multi-channel video acquisition module 102 is responsible for the multi-channel video test signal that input separates, and with the vision signal input video time-delay measuring unit that collects.
Assembly 3, network sending module 103 is responsible for the measuring-signal that collects is sent to main measurement mechanism through network.
Embodiment 3, and Fig. 4 has provided the organigram of the main measurement mechanism of video end-to-end time delay
Like Fig. 4, the main measurement mechanism of the audio frequency and video end-to-end time delay of the utility model comprises:
Assembly 1, video test signal generator 201 is responsible for producing video test signals.This signal can be analyzed and discerned by video latency measurement device.
Assembly 2, multi-channel video acquisition module 202 is responsible for the multi-channel video test signal that input separates, and with the vision signal input video time-delay measuring unit that collects.
Assembly 3, network receiver module 203 is responsible for receiving the measuring-signal that the far-end aided measurement device sends through network.
Assembly 4, video time-delay measuring unit 204 is responsible for the vision signal of input is analyzed, discerns, compared and measures, and concrete steps comprise:
Step 1; Multi-channel test signal to the input of multi-channel video acquisition module is analyzed; Since the time video test signals delayed unavoidably have noise jamming, need from mixed signal, identify video test signals exactly, and time of arriving of record acquisition.
Step 2, poor computing time to the measuring-signal that local signal generator sends, be designated as Δ T VL, Δ T wherein VL=Δ T AC+ Δ T DEF, Δ T ACBe the One Way Delay of A → C, Δ T DEFOne Way Delay for D → E → F.
Step 3, poor computing time to the measuring-signal that the remote signaling generator sends, be designated as Δ T VR, Δ T wherein VR=Δ T CA-Δ T DEF, Δ T CABe the One Way Delay of C → A, Δ T DEFBe D → E → F One Way Delay.
Step 4, the end-to-end time delay Δ T of calculating system under test (SUT) V=(Δ T VL+ Δ T VR)/2 are submitted to storage and display unit.
Assembly 5, storage and display unit 205, the receiver, video delay data outputs results on the memory device and display device of appointment
The foregoing description is the utility model preferred implementation; But the execution mode of the utility model is not restricted to the described embodiments; Other any do not deviate from change, the modification done under spirit and the principle of the utility model, substitutes, combination, simplify; All should be the substitute mode of equivalence, be included within the protection range of the utility model.

Claims (4)

1. the video end-to-end time delay measurement mechanism of non-intervention type both-end collection is characterized in that, comprising: main measurement mechanism and aided measurement device, realize communication through network or special line between the two.
2. the video end-to-end time delay measurement mechanism of gathering according to the said non-intervention type both-end of claim 2 is characterized in that said aided measurement device comprises:
Flying-spot video generator (101) is used for periodically or disposable generation has the video test signals of specific format and pattern, and this test signal can be discerned for testing apparatus;
Multi-channel video acquisition module (102) is gathered video test signals that the far-end flying-spot video generator produces, that play by the system under test (SUT) distance terminal respectively;
Network sending module (103) is used for sending the test signal that multi-channel video acquisition module (102) collects to main measurement mechanism.
3. the video end-to-end time delay measurement mechanism of gathering according to the said non-intervention type both-end of claim 2 is characterized in that said main measurement mechanism comprises:
Flying-spot video generator (201) is used for periodically or disposable generation has the video test signals of specific format and pattern, and test signal is sent to local video harvester and system under test (SUT) local terminal;
Multi-channel video acquisition module (202) is gathered video test signals that the local video signal generator produces, that play by the system under test (SUT) local terminal respectively;
Network receiver module (203) is used to receive the test signal that aided measurement device sends;
Video time-delay measuring unit (204) is used for the vision signal that receiver, video acquisition module (202) and network receiver module (203) are imported, and confirms time delay between the two.
4. the video end-to-end time delay measurement mechanism of gathering according to the said non-intervention type both-end of claim 4; It is characterized in that said main measurement mechanism also comprises storage and display unit (205), be used to store the time delay of video end to end that display video time-delay measuring unit (204) is confirmed.
CN2011203399227U 2011-09-09 2011-09-09 Non-intrusive double-ended-acquisition video end-to-end time delay measuring device Expired - Fee Related CN202218352U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011203399227U CN202218352U (en) 2011-09-09 2011-09-09 Non-intrusive double-ended-acquisition video end-to-end time delay measuring device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2011203399227U CN202218352U (en) 2011-09-09 2011-09-09 Non-intrusive double-ended-acquisition video end-to-end time delay measuring device

Publications (1)

Publication Number Publication Date
CN202218352U true CN202218352U (en) 2012-05-09

Family

ID=46017577

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011203399227U Expired - Fee Related CN202218352U (en) 2011-09-09 2011-09-09 Non-intrusive double-ended-acquisition video end-to-end time delay measuring device

Country Status (1)

Country Link
CN (1) CN202218352U (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102316363A (en) * 2011-09-09 2012-01-11 华南理工大学 Method and devices for measuring video end-to-end delay by non-intrusive double-ended collection
CN106060534A (en) * 2016-06-03 2016-10-26 公安部第三研究所 System and method for testing synchronization of audio and video

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102316363A (en) * 2011-09-09 2012-01-11 华南理工大学 Method and devices for measuring video end-to-end delay by non-intrusive double-ended collection
CN106060534A (en) * 2016-06-03 2016-10-26 公安部第三研究所 System and method for testing synchronization of audio and video

Similar Documents

Publication Publication Date Title
CN102316357A (en) Non-intrusive single-ended acquired video end-to-end time delay measuring method and device
CN102325059B (en) Audio frequency end-to-end time delay measurement method of non-intrusive single end acquisition and apparatus thereof
CN104125022B (en) The method of measurement of audio transmission time delay and system
CN101542863B (en) Method and apparatus for a power line communications test system
CN103188236B (en) The appraisal procedure of media transmission quality and device
CN101516017B (en) Method, device and system for measuring video transmission delay of session service
CN102332261B (en) Audio end-to-end delay measuring method and device based on nonintrusive double-end collection
CN108872744B (en) Method and system for identifying distribution room
CN103327070A (en) Electric transmission line multi-state information monitoring system based on 3G internet of things technology
CN102316363B (en) Method and devices for measuring video end-to-end delay by non-intrusive double-ended collection
CN101247286B (en) Method and system for service quality detection of video distribution system
CN103389440B (en) A kind of power fault analysis system
CN202309990U (en) Non-intrusive single-end acquired video end-to-end time delay measuring device
CN104023229B (en) Non-contact image system performance detection process and system
CN101267576A (en) A test method and its device for digital TV broadcast receiving
US8347153B2 (en) Protocol aware error ratio tester
CN101925833B (en) Radio communication device, program, radio communication method, and radio communication system
CN102158881A (en) Method and device for completely evaluating 3G visual telephone quality
CN101656892A (en) IPTV tester merged to telecom operation and maintenance system and use method thereof
CN202218352U (en) Non-intrusive double-ended-acquisition video end-to-end time delay measuring device
CN202261341U (en) Non-intrusive dual-end acquired audio end-to-end delay measuring device
CN101556304B (en) Automatic diagnostic method and equipment of serial ports of embedded type equipment
CN202218235U (en) Voice frequency end-to-end time delay measurement device with function of non-intrusive single-end acquisition
CN103024367B (en) Low-voltage differential signaling (LVDS) receiver, transmitter and method for receiving and transmitting LVDS
Baena et al. Video Streaming and Cloud Gaming services over 4G and 5G: a complete network and service metrics dataset

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20120509

Termination date: 20140909

EXPY Termination of patent right or utility model