CN205679316U - A kind of digital zoom optical spectrum imagers based on self adaptation microlens array sensor - Google Patents

A kind of digital zoom optical spectrum imagers based on self adaptation microlens array sensor Download PDF

Info

Publication number
CN205679316U
CN205679316U CN201620413613.2U CN201620413613U CN205679316U CN 205679316 U CN205679316 U CN 205679316U CN 201620413613 U CN201620413613 U CN 201620413613U CN 205679316 U CN205679316 U CN 205679316U
Authority
CN
China
Prior art keywords
microlens array
self adaptation
spectrum
array sensor
digital zoom
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201620413613.2U
Other languages
Chinese (zh)
Inventor
赵祥杰
沈志学
段佳著
曾建成
乔冉
黄立贤
骆永全
王海峰
刘海涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute of Fluid Physics of CAEP
Original Assignee
Institute of Fluid Physics of CAEP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Fluid Physics of CAEP filed Critical Institute of Fluid Physics of CAEP
Priority to CN201620413613.2U priority Critical patent/CN205679316U/en
Application granted granted Critical
Publication of CN205679316U publication Critical patent/CN205679316U/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

This utility model discloses a kind of digital zoom optical spectrum imagers based on self adaptation microlens array sensor, including electric control belt pass filter, optical imaging lens, self adaptation microlens array sensor, dispersion self adaptive imaging controller, image acquisition and processing terminal.This utility model can be while spectrum imaging system spectrum picture sequence scanning, obtain the spatial frequency field information of each spectrum picture, the digital zoom functions focused after realizing first exposure image, and carry out self adaptation De-dispersion raising digital zoom performance, eliminate the dispersive influence that spectral scan on a large scale brings to the full extent, the acquisition of complicated topography and geomorphology spectral image information is ensure that on to greatest extent, when complicated topography and geomorphology is carried out remote sensing, can obtain and become apparent from and image information and spectral information more accurately, expand major function and the range of application of existing optical spectrum imagers.

Description

A kind of digital zoom optical spectrum imagers based on self adaptation microlens array sensor
Technical field
This utility model relates to spectral imaging technology field, specifically refers to a kind of based on self adaptation microlens array sensor Digital zoom optical spectrum imagers.
Background technology
Spectrum imaging system can obtain image and the spectral information of target simultaneously, is a kind of " performance is complete ", collection of illustrative plates unification Optical pickocff, current optical spectrum imagers can realize that adjustable band is many, spectral resolution strong and spatial resolution Advantages of higher, is properly applied to the remote sensing fields such as airborne, spaceborne of staring imaging, for relevant departments provide mineral resource reconnaissance, The new technique means of biomedical diagnostic, agricultural pest monitoring etc..But in actual remote sensing application, due to remote sensing pair The topography and geomorphology skewness of elephant, in order to obtain remote sensing images clearly, needs to carry out zoom manipulation according to topography and geomorphology.? In spectral imaging technology based on bandpass filter, spectral information is to carry out sequence scanning by bandpass filter, during with needs Between the zoom manipulation that controls there is bigger conflict.
Current spectrum imaging system when complicated topography and geomorphology is carried out remote sensing, have that definition is low, distortion, Yi Ji great The problem of the dispersive influence that range of spectra imaging brings.
Utility model content
The purpose of this utility model is to provide a kind of digital zoom spectrum based on self adaptation microlens array sensor Imager, it is achieved focusing the light spectrum image-forming function of De-dispersion after first exposure image, reaches carrying out distant to complicated topography and geomorphology During sense detection, it is possible to obtain become apparent from and image information and spectral information more accurately, expand existing optical spectrum imagers Major function and the purpose of range of application.
The purpose of this utility model is achieved through the following technical solutions:
A kind of digital zoom optical spectrum imagers based on self adaptation microlens array sensor, it is characterised in that including:
Electric control belt pass filter: the light of object under test, after the filtration of electric control belt pass filter, is sent to light Learn imaging lens;
Optical imaging lens: for the target light source received being converted into optical imagery and being transported to self adaptation lenticule Sensor array;
Self adaptation microlens array sensor: the light from object under test sequentially passes through electric control belt pass filter, optics Imaging lens arrives the focal plane of self adaptation microlens array sensor, the final spectrum of self adaptation microlens array sensor acquisition The space pixel that image is corresponding provides corresponding spatial frequency field information, and is transferred to image acquisition and processing terminal;
Dispersion self adaptive imaging controller: the scanning spectral coverage of Real-time Collection electric control belt pass filter, is adjusted by automatically controlled mode The focal length of whole self adaptation microlens array sensor, the most persistently output sequence spectrum picture is to image acquisition and processing terminal;
Image acquisition and processing terminal: while keeping sequential spectrum picture record and processing, extract each spectrogram As all spatial frequency field information of pixel, by optimizing and combining the light of the different space frequency in each spectrum picture pixel Information, and carry out calculating the digital zoom functions obtaining spectrum picture, finally processes sequential spectrum picture and three Dimension space shows.
Optical spectrum imagers of the present utility model, the light that object under test sends is through the filtration of electric control belt pass filter After, it is sent to optical imaging lens and carries out optical imagery, then the image of optical imagery is passed through self adaptation microlens array Sensor carries out the collection of image information, obtains spatial image information and the field information of each pixel of object under test simultaneously, passes Being defeated by image acquisition and processing terminal, image processing terminal utilizes the field information of each pixel to carry out digital zoom manipulation, can To realize in the light spectrum image-forming data of single exposure collection the extraction of object picture rich in detail at different distance.This method exists While not affecting sequential light spectrum image-forming function, simple Digital Image Processing function and microlens array sensor is utilized to provide Light field spectral image information, it is achieved that the digital zoom manipulation after single exposure imaging, improve spectrum imaging system to multiple Miscellaneous landforms, the function of the far and near clear light spectrum image-forming of object;Simultaneously because have employed self adaptation microlens array sensor, at big light In the light spectrum image-forming application of spectral limit, owing to using dispersion correction, such that it is able to object at different distance is passed through digital zoom Obtain picture rich in detail.This utility model uses self adaptation microlens array sensor to carry out the decomposition of image information, by optics The extraneous image information of lens focusing has carried out the lifting of pixel, can be at spectrum imaging system spectrum picture sequence scanning Meanwhile, obtain the spatial frequency field information of each spectrum picture, it is achieved after first exposure image focusing digital zoom functions and Carrying out self adaptation De-dispersion and improve digital zoom performance, this optical spectrum imagers based on microlens array sensor should in remote sensing Used time is made without the manipulation of optical lens zoom, simultaneously the elimination dispersion shadow to digital zoom when spectral scan on a large scale Ring;Overcome manipulation contradiction of the prior art, and digital zoom type spectrum based on self adaptation microlens array sensor Imaging system, can apply to the light spectrum image-forming remote sensing application of complicated topography and geomorphology, eliminates spectrum on a large scale to the full extent The dispersive influence brought of scanning, to greatest extent on ensure that the acquisition of complicated topography and geomorphology spectral image information, both ensured light Learn the definition of image information outside lens focusing region, ensured again the accuracy of spectral information, it is possible to achieve first exposure image The light spectrum image-forming function of rear focusing De-dispersion, when carrying out remote sensing to complicated topography and geomorphology, it is possible to obtain become apparent from With image information and spectral information more accurately, expand major function and the range of application of existing optical spectrum imagers.
Described self adaptation microlens array sensor includes self adaptation microlens array dough-making powder imaging detector, optical imagery Camera lens forms conjugation with surface imaging detector relative to self adaptation microlens array.Concretely, by by optical imaging lens Form conjugation with surface imaging detector relative to self adaptation microlens array, i.e. optical imaging lens is positioned at self adaptation lenticule battle array On the object plane of row, surface imaging detector is positioned in the image plane of self adaptation microlens array;List on self adaptation microlens array The lenticular size of unit and distribution, be divided into surface imaging detector and unit self-adapting lenticule region one to one, connect Receive the imaging light eventually through bandpass filter and self adaptation microlens array;With unit self-adapting lenticule one to one Detector subregion constitutes a pixel of final image, simultaneously all spatial frequency light fields letter of this this position of subregion record Breath;Described dispersion self adaptive imaging controller, the scanning spectral coverage of Real-time Collection electric control belt pass filter, adjusted by automatically controlled mode The focal length of whole self adaptation microlens array, the most persistently output sequence spectrum picture is to image acquisition and processing terminal;Described Image acquisition and processing terminal, while record sequential spectrum picture, record the field information of each object space, according to light field Information can carry out digital zoom to the sequential spectrum picture of record, thus obtains complicated landform geomorphologic map picture clearly, and real Spectrum letter the most accurately.
The lenticule number of unit of described wherein self adaptation microlens array is that M*N, M and N are natural number.By self adaptation Its lenticule number of unit of microlens array is M*N, and tradition its number of pixels of surface imaging detector is KM*KN, in conjunction with being formed Novel surface imaging detector, this surface imaging detector is while recording original spectral image information, and its spectrum picture space is divided Resolution is M*N, it is also possible to records the spatial frequency field information of each spectrum picture pixel, i.e. this field information and is visited by surface imaging Survey the sub-district record of each K*K array of device, utilize this novel sensor can realize digital zoom functions;Utilize self adaptation The automatically controlled varifocal performance of microlens array, can eliminate microlens array pass when the light spectrum image-forming of spectral scan on a large scale The dispersive influence brought of sensor.
Described self adaptation microlens array is LCD self-adapting microlens array.
This utility model compared with prior art, has such advantages as and beneficial effect:
A kind of digital zoom optical spectrum imagers based on self adaptation microlens array sensor of 1 this utility model, uses certainly Adapt to microlens array sensor and carry out the decomposition of image information, obtain spatial image information and the light field of each pixel simultaneously Information, it is achieved the clear digital image of object at different distance;Can same at spectrum imaging system spectrum picture sequence scanning Time, obtain the spatial frequency field information of each spectrum picture, it is achieved the digital zoom functions of focusing after first exposure image, go forward side by side Row self adaptation De-dispersion improves digital zoom performance, and this optical spectrum imagers based on microlens array sensor is in remote sensing application Time be made without zoom manipulation, simultaneously eliminate the dispersion impact on digital zoom when spectral scan on a large scale;Overcome existing There is the manipulation contradiction in technology, and digital zoom type spectrum imaging system based on self adaptation microlens array sensor, can To be applied to the light spectrum image-forming remote sensing application of complicated topography and geomorphology, eliminate the color that spectral scan on a large scale brings to the full extent Dissipate impact, to greatest extent on ensure that the acquisition of complicated topography and geomorphology spectral image information, both ensured the clear of image information Degree, has ensured again the accuracy of spectral information, it is possible to achieve focusing the light spectrum image-forming function of De-dispersion after first exposure image, When complicated topography and geomorphology is carried out remote sensing, it is possible to obtain become apparent from image information and more accurately spectrum believe Breath, expands major function and the range of application of existing optical spectrum imagers;
A kind of digital zoom optical spectrum imagers based on self adaptation microlens array sensor of 2 this utility model, light studies It is micro-that picture camera lens and surface imaging detector are positioned at self adaptation relative to self adaptation microlens array formation conjugation, i.e. optical imaging lens On the object plane of lens arra, surface imaging detector is positioned in the image plane of self adaptation microlens array;Surface imaging detector quilt Self adaptation microlens array is divided into and unit microlens subregion one to one, and the spatial resolution of final image is with adaptive The number of unit answering microlens array is consistent;The surface imaging detector subregion split by unit microlens is final spectrum picture Corresponding space pixel provides corresponding spatial frequency field information.
Accompanying drawing explanation
Accompanying drawing described herein is used for providing being further appreciated by this utility model embodiment, constitutes the one of the application Part, is not intended that the restriction to this utility model embodiment.In the accompanying drawings:
Fig. 1 is principle framework structural representation of the present utility model;
Fig. 2 is single-point pixel field information recording principle schematic diagram of the present utility model;
Fig. 3 is digital zoom operation principle schematic diagram of the present utility model;
Fig. 4 is the dispersive influence schematic diagram that this utility model carries out when spatial frequency light field is extracted;
Fig. 5 is this utility model De-dispersion schematic diagram.
Labelling and corresponding parts title in accompanying drawing:
1-object under test, 2-electric control belt pass filter, 3-optical imaging lens, 4-self adaptation microlens array sensor, 401-self adaptation microlens array, 402-surface imaging detector, 5-image acquisition and processing terminal, the red object point to be measured of 6-, 7- Green object point to be measured, the blue object point to be measured of 8-.
Detailed description of the invention
For making the purpose of this utility model, technical scheme and advantage clearer, below in conjunction with embodiment and accompanying drawing, The utility model is described in further detail, and exemplary embodiment of the present utility model and explanation thereof are only used for explaining this Utility model, is not intended as restriction of the present utility model.
Embodiment
As it is shown in figure 1, a kind of digital zoom light spectrum image-forming based on self adaptation microlens array sensor of this utility model Instrument, including electric control belt pass filter 2, optical imaging lens 3, self adaptation microlens array sensor 4 and image acquisition and place Reason terminal 5, wherein self adaptation microlens array sensor 4 is by self adaptation microlens array 401 dough-making powder imaging detector 402 groups Becoming, the lenticule number of unit of self adaptation microlens array 401 is M*N, self adaptation microlens array 401 and traditional surface imaging Detector 402 combines and forms novel surface imaging detector, and the number of pixels of surface imaging detector 402 is KM*KN, and this surface imaging is visited Survey device is while recording original spectral image information, and spectrum picture spatial resolution is M*N, it is also possible to record each spectrogram As the spatial frequency field information of pixel, this field information is by the sub-district record of each K*K array of surface imaging detector;Its In, the light from object under test 1 sequentially passes through electric control belt pass filter 2, optical imaging lens 3 arrives self adaptation lenticule battle array The focal plane of sensor 4, as shown in the light in Fig. 1, it is micro-that object under test is imaged on self adaptation through optical imaging lens The position of lens array, i.e. self adaptation microlens array is in the image plane of optical imaging lens;Imaging lens and surface imaging Detector forms conjugation relative to self adaptation microlens array, i.e. imaging lens is positioned on the object plane of microlens array, and face becomes As detector is positioned in the image plane of self adaptation microlens array;Surface imaging detector by self adaptation microlens array be divided into The number of unit one of unit microlens subregion one to one, the spatial resolution of final image and self adaptation microlens array Cause;The surface imaging detector subregion split by unit self-adapting lenticule provides for the space pixel that final spectrum picture is corresponding Corresponding spatial frequency field information, the array of subregion is K*K, according to the spatial resolution requirements of spectrum picture, K value model It is the most suitable to be trapped among between 5 to 20.
If Fig. 2 is the single-point pixel light field of this utility model optical spectrum imagers based on self adaptation microlens array sensor Information recording principle schematic diagram, as shown in Figure 2, at thing side A the light of red object point to be measured through electric control belt pass filter 2, Optical imaging lens 3 is imaged in self adaptation microlens array sensor 4, and the face in self adaptation microlens array sensor 4 becomes As detector is while self adaptation microlens array resolution spectra re-recorded image information, record each spectrum picture pixel Spatial frequency field information;In like manner, the principle of digital zoom work is as shown in Figure 3, red object point 6 to be measured at thing side A, green Three unit being imaged on respectively on self adaptation microlens array sensor 4 at color object point to be measured 7, blue object point 8 three to be measured are micro- At lens, the surface imaging detector in self adaptation microlens array sensor 4 is recording red object point to be measured 6, green determinand While point 7, the spectral image information of blue object point 8 to be measured, according to the position of unit microlens simultaneously with K*K An arrayed recording its Spatial frequency field information, the spatial frequency light field that in this K*K array subregion, the corresponding object point to be measured of each pixel is different Information, by choosing particular space frequency light field as shown in Figure 3 for each determinand point numeral, abandons other light simultaneously Field information, is combined into the spectrum picture of new self adaptation microlens array resolution, it is possible to obtain at thing side B, object under test is clear Clear picture, this has substantial promise for the remote sensing survey definition of complicated topography and geomorphology, the most this more exact figure Zoom mode can obtain object under test spectral information the most accurately.
Fig. 4 be the effect of dispersion in spectral scan on a large scale on spatial frequency field information and the impact of digital zoom, The automatically controlled scanning spectral coverage that arranges of electric control belt pass filter 2 is respectivelyWithTime, colour killing is not carried out due to common microlens array Difference work, the focal length of micro-lens array that the light of different spectral coverage is corresponding is different, optical imaging lens 3The light of spectral coverage can be through Cross microlens array and successfully focus on surface imaging detector, optical imaging lens 3The light of spectral coverage is through microlens array Cannot focus on surface imaging detector, therefore cannot completely obtain the spatial frequency light field letter of spectrum picture at out of focus spectral coverage Breath, and then digital zoom performance when affecting spectral scan on a large scale and spectrum picture treatment effect.
Fig. 5 is to use De-dispersion self adaptive imaging controller and self adaptation microlens array to carry out the work of De-dispersion former Reason schematic diagram,Moment, when the spectral deploying of electric control belt pass filter 2 isTime, by De-dispersion self adaptive imaging controller 9 The spectrum of Real-time Collection electric control belt pass filter 2, the on-load voltage arranging self adaptation microlens array 4 is, by adaptive The focal length answering microlens array is set to f0, now optical imaging lens 3The light of spectral coverage can become through microlens array Merit focuses on surface imaging detector 402;Moment, when the spectral deploying of electric control belt pass filter 2 isTime, pass through De-dispersion The spectrum of self adaptive imaging controller 9 Real-time Collection electric control belt pass filter 2, arranges self adaptation microlens array 401 On-load voltage is, due to the automatically controlled adjustable characteristics of self adaptation microlens array 41 focal length, now self adaptation microlens array 401 Focal length can also be adjusted to, now optical imaging lensThe light of spectral coverage successfully can focus on through microlens array On surface imaging detector, so eliminate on a large scale in light spectrum image-forming effect of dispersion to digital zoom and the shadow of imaging definition Ring.
Above-described detailed description of the invention, is entered the purpose of this utility model, technical scheme and beneficial effect One step describes in detail, be it should be understood that and the foregoing is only detailed description of the invention of the present utility model, is not used to limit Fixed protection domain of the present utility model, all within spirit of the present utility model and principle, any amendment, the equivalent made are replaced Change, improvement etc., within should be included in protection domain of the present utility model.

Claims (4)

1. a digital zoom optical spectrum imagers based on self adaptation microlens array sensor, it is characterised in that including:
Electric control belt pass filter (2): the light of object under test (1), after the filtration of electric control belt pass filter (2), is sent into To optical imaging lens (3);
Optical imaging lens (3): for the target light source received being converted into optical imagery and being transported to self adaptation lenticule Sensor array (4);
Self adaptation microlens array sensor (4): the light from object under test (1) sequentially pass through electric control belt pass filter (2), Optical imaging lens (3) arrives the focal plane of self adaptation microlens array sensor (4), self adaptation microlens array sensor (4) gather the spatial frequency field information that space pixel corresponding to final spectrum picture provides corresponding, and be transferred to image acquisition With processing terminal (5);
Dispersion self adaptive imaging controller (9): the scanning spectral coverage of Real-time Collection electric control belt pass filter, is adjusted by automatically controlled mode The focal length of self adaptation microlens array sensor (4), the most persistently output sequence spectrum picture is to image acquisition and processing terminal (5);
Image acquisition and processing terminal (5): while keeping sequential spectrum picture record and processing, extract each spectrum picture All spatial frequency field information of pixel, by optimizing and combining the light field of the different space frequency in each spectrum picture pixel Information, and carry out calculating the digital zoom functions obtaining spectrum picture, finally sequential spectrum picture is processed and three-dimensional Space shows.
A kind of digital zoom optical spectrum imagers based on self adaptation microlens array sensor the most according to claim 1, It is characterized in that: described self adaptation microlens array sensor (4) includes self adaptation microlens array (401) dough-making powder imaging detection Device (402), optical imaging lens (3) is formed altogether relative to self adaptation microlens array (401) with surface imaging detector (402) Yoke.
A kind of digital zoom optical spectrum imagers based on self adaptation microlens array sensor the most according to claim 2, It is characterized in that: the lenticule number of unit of described wherein self adaptation microlens array (401) is that M*N, M and N are natural number.
A kind of digital zoom optical spectrum imagers based on self adaptation microlens array sensor the most according to claim 1, It is characterized in that: described self adaptation microlens array (401) is LCD self-adapting microlens array.
CN201620413613.2U 2016-05-10 2016-05-10 A kind of digital zoom optical spectrum imagers based on self adaptation microlens array sensor Expired - Fee Related CN205679316U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201620413613.2U CN205679316U (en) 2016-05-10 2016-05-10 A kind of digital zoom optical spectrum imagers based on self adaptation microlens array sensor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201620413613.2U CN205679316U (en) 2016-05-10 2016-05-10 A kind of digital zoom optical spectrum imagers based on self adaptation microlens array sensor

Publications (1)

Publication Number Publication Date
CN205679316U true CN205679316U (en) 2016-11-09

Family

ID=57438847

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201620413613.2U Expired - Fee Related CN205679316U (en) 2016-05-10 2016-05-10 A kind of digital zoom optical spectrum imagers based on self adaptation microlens array sensor

Country Status (1)

Country Link
CN (1) CN205679316U (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105806480A (en) * 2016-05-10 2016-07-27 中国工程物理研究院流体物理研究所 Digital zooming spectrum imager based on self-adaptive micro-lens array sensor

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105806480A (en) * 2016-05-10 2016-07-27 中国工程物理研究院流体物理研究所 Digital zooming spectrum imager based on self-adaptive micro-lens array sensor
CN105806480B (en) * 2016-05-10 2018-10-12 中国工程物理研究院流体物理研究所 A kind of digital zoom optical spectrum imagers based on adaptive microlens array sensor

Similar Documents

Publication Publication Date Title
CN105917641B (en) With the slim multiple aperture imaging system focused automatically and its application method
CA2812860C (en) Digital multi-spectral camera system having at least two independent digital cameras
EP2721828B1 (en) High resolution multispectral image capture
US9706116B2 (en) Plenoptic color imaging system with enhanced resolution
CN105187815B (en) For obtaining the system and method for image depth information
CN103688536B (en) Image processing apparatus, image processing method
CN106840398A (en) A kind of multispectral light-field imaging method
CN104010183A (en) Camera array systems including at least one bayer type camera and associated methods
JP2014011526A (en) Image processing apparatus, imaging apparatus, and image processing method
CN101662590A (en) Image pickup apparatus and image processing apparatus
CN105806480B (en) A kind of digital zoom optical spectrum imagers based on adaptive microlens array sensor
JPH0595509A (en) Method and apparatus for obtaining information element regarding depth of object field observed with image sensing apparatus
CN106165398A (en) Imaging apparatus, camera head and image processing apparatus
CN104185984A (en) Image processing device, imaging device and image processing program
CN205679317U (en) A kind of digital zoom type optical spectrum imagers based on microlens array sensor
CN110248095B (en) Focusing device, focusing method and storage medium
CN107710741B (en) Method for acquiring depth information and camera device
CN109163809B (en) Multi-aperture view field partially overlapped dual-band thermal imaging method and device
CN104106003A (en) Imaging device
CN205679316U (en) A kind of digital zoom optical spectrum imagers based on self adaptation microlens array sensor
JP2012252280A (en) Imaging apparatus
US10580807B2 (en) Color pixel and range pixel combination unit
CN105737985B (en) A kind of digital zoom type optical spectrum imagers based on microlens array sensor
CN105681650A (en) Chromatic aberration elimination method of light field camera
WO2017195858A1 (en) Multi-line image sensor devices, image capturing device, moving body detecting device, and moving body detecting program

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20161109

Termination date: 20180510