CN102306654A - Bionic charge coupling device and manufacturing method and pixel information scanning and reading method thereof - Google Patents

Bionic charge coupling device and manufacturing method and pixel information scanning and reading method thereof Download PDF

Info

Publication number
CN102306654A
CN102306654A CN201110210446A CN201110210446A CN102306654A CN 102306654 A CN102306654 A CN 102306654A CN 201110210446 A CN201110210446 A CN 201110210446A CN 201110210446 A CN201110210446 A CN 201110210446A CN 102306654 A CN102306654 A CN 102306654A
Authority
CN
China
Prior art keywords
curve
charge coupled
coupled device
human eye
family
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201110210446A
Other languages
Chinese (zh)
Other versions
CN102306654B (en
Inventor
李军
张明华
朱元励
梅琨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wenzhou Medical College
Original Assignee
Wenzhou Medical College
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wenzhou Medical College filed Critical Wenzhou Medical College
Priority to CN201110210446.3A priority Critical patent/CN102306654B/en
Publication of CN102306654A publication Critical patent/CN102306654A/en
Application granted granted Critical
Publication of CN102306654B publication Critical patent/CN102306654B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Image Processing (AREA)
  • Prostheses (AREA)

Abstract

The invention relates to a bionic charge coupling device and a manufacturing method and a pixel information scanning and reading method thereof. Pixels of the charge coupling device are divided by a simulating growth curve of human retinal ganglion cells; the simulating growth curve of the human retinal ganglion cells is formed by a positive family and a negative family of a basic curve under the same coordinate system; and the basic curve is a logarithm helix. The technical scheme of the invention has a bionic effect of simulating human retina and the bionic effect can be used for intelligent machine vision.

Description

Bionical charge coupled device and manufacturing approach thereof and image element information scanning read method
Technical field
The present invention relates to the charge coupled device field, be specifically related to a kind of bionical charge coupled device and manufacturing approach thereof and image element information scanning read method.
Background technology
Realize the intelligence machine vision, as the quick search of human eye, attention, identification with understand object, this is human dream, and human eye retina's bionical manufacturing is one of its key technology.
The sensor devices of traditional cameras is exactly CCD, i.e. charge coupled device.The invention of CCD charge coupled device is a human creation greatly, and its inventor wins 2009 annual Nobel Prizes in physics.The CCD charge coupled device is a kind of large scale integrated circuit photoelectric device.Charge coupled device is on semi-conductor silicon chip, to make hundreds and thousands of (ten thousand) individual photosensitive unit, and a photosensitive unit claims a pixel again, and photosensitive unit arranges by linear array or face battle array regularly on the semiconductor silicon plane.When object through object lens when imaging, these photosensitive units are the photogenerated charge that is directly proportional with light intensity above impinging upon them of generation just), on the same area photosensitive unit multiresolution is high more more, the image that obtains is clear more.Charge coupled device has the self-scanning ability, can be with the output of the photogenerated charge that produces in photosensitive unit serial clocklike successively, and the quantity of electric charge is directly proportional on the amplitude of output and the corresponding light-sensitive element.
Traditional C CD is not because sampling photosensitive identical permutation of the same size in length and breadth can obtain the picture rich in detail of resolution uniformity fully, but this meets human eye retina's standard, obstacle the realization of bionic intelligence machine vision.
Summary of the invention
Deficiency to prior art exists the object of the present invention is to provide a kind of bionical charge coupled device that can be used in the intelligence machine vision.
For realizing above-mentioned purpose; The invention provides following technical scheme: a kind of bionical charge coupled device; The pixel of said charge coupled device is divided by human eye retina ganglion cell's simulate growth curve; Said human eye retina ganglion cell's simulate growth curve is made up of with reverse family the forward family of the fundamental curve under the same coordinate system, and said fundamental curve is a log spiral.
Object relies on " sun " reflective, constitutes light stream in kind system according to the light intensity attenuation rate.The light stream system is adjustable through eyeball this light hurdle, the crystal curvature-adjustable, the optical axis is adjustable, non-linear, aperture optical imaging system arrives retina.But retina be an eccentric sphere of special type, multi-level color separation, non-homogeneous, Fuzzy Processing is arranged, lateral inhibition is arranged, the optical-electrical converter of signal compensation is arranged.The distribution of gangliocyte, classification, signal power have constituted original retinal images.Retinal images arrives cerebral cortex V1 district input layer through over-segmentation, distortion, classification and transmission.The V1 district is a three-dimensional nerve network solid space, receives binocular information, multilayered structure, constitutes the elementary presentation of visual perception by stereoscopic vision matched rule, mapping real three-dimensional space.Cerebral cortex is a fold, V1 district wedgewise under normal state, but after the fold expansion, the V1 district is rectangle.The inventor after deliberation; With the rectangle V1 district topological transformation after the fold expansion is that circular flat (is the end with rectangle V1 district promptly on one side; Dual-side links to each other and constitutes a cylinder; The cylinder bottom is constant; Be punctured into circular cone; Compress from the top again; Topological transformation is a circular flat); This circular flat is the retina image-forming vertical plane; Rectangle V1 district after topological transformation is circular flat its diagonal at curve that this circular flat became; Crossed over whole circular flat (being retina); This curve just in time is a log spiral; And; This curve and X-axis; Y-axis has five times and intersects; Thus whole circular flat is classified as five characteristic areas; Respectively with the maximum district of human eye retina's awl cell density; The zone of no rod cell; Macular area; The other district of central fovea is corresponding with outer peripheral areas; This curve has been represented the essential characteristic of retinal ganglion cell distribution; We are the fundamental curve of human eye retina ganglion cell's simulate growth curve with this curve definitions; And the diagonal in rectangle V1 district is maximum in the leap in rectangle V1 district; Therefore; The real world mankind can be efficient; Fast; Mechanically retinal patterns is mapped to the V1 district; Realize the quick identification and the understanding of image information then, form visual perception at last.Therefore; The pixel of charge-coupled image sensor is divided by human eye retina ganglion cell's simulate growth curve; Human eye retina ganglion cell's simulate growth curve is made of with reverse family the forward family of the fundamental curve under the same coordinate system; Fundamental curve is the number helix; Promptly this fundamental curve be a rectangle after topological transformation is circular flat one of which root diagonal at curve that this circular flat became; Each is exactly the bionical charge-coupled image sensor pixel of human eye retina by the closed irregular bent quadrangle of four curves; Pixel is corresponding with the retinal ganglion cell; The speed of make total pixel of charge-coupled image sensor significantly reduce, information search and follow-up identification being handled is accelerated greatly, and the vision sensor of front end is provided for the intelligence machine vision that realizes type human eye.
The present invention further is set to: the curvilinear equation of said fundamental curve is: ρ=ρ 0(2 π * m/M), promptly this fundamental curve is: one of which root diagonal is at the curve that this circular flat became after topological transformation is circular flat for a square, and the forward family curvilinear equation of fundamental curve is: ρ=ρ for * e^ 0(2 π * m/M+2 π * n/N), the reverse family curvilinear equation of fundamental curve is * e^: ρ=ρ 0(2 π * m/M+2 π * n/N), wherein M, N are natural number to * e^, and the codomain of m is [0, M], and the codomain of n is [1, N].
Because square is that its cornerwise 45 remains constant in the circular flat process through topological transformation; Can make that pixel (size of pixel can be understood as the size of its receptive field) distribution of charge coupled device is more reasonable, the geometry of each pixel all has not consistency of topology.And this curve and X-axis, Y-axis intersect for five times, and whole circular flat is classified as five characteristic areas, and be more corresponding with the maximum district of human eye retina's awl cell density, the zone of no rod cell, macular area, the other district of central fovea and outer peripheral areas.
The present invention further is set to: said M=1104, and N=1104, said charge coupled device is divided 1104 standard rings by human eye retina ganglion cell's simulate growth curve, divides 1104 pixels, ρ<ρ in each standard ring 0The center microcell, whole divide a round pixel.
Based on retina physiology cell statistics, charge coupled device is done as above pixel division and the retinal ganglion cell reaches the close order of magnitude, makes charge coupled device reach better bionical effect, because ρ<ρ 0Center microcell pixel be difficult to divide, it is wholely divided a round pixel.
Another object of the present invention is to provide a kind of manufacturing approach of bionical charge coupled device.
For realizing above-mentioned purpose; The invention provides following technical scheme: a kind of manufacturing approach of bionical charge coupled device; Charge coupled device is divided pixel with human eye retina ganglion cell's simulate growth curve; Said human eye retina ganglion cell's simulate growth curve is made up of with reverse family the forward family of the fundamental curve under the same coordinate system, and said fundamental curve is a log spiral.
The present invention further is set to: the curvilinear equation of said fundamental curve is: ρ=ρ 0(2 π * m/M), promptly this fundamental curve is: one of which root diagonal is at the curve that this circular flat became after topological transformation is circular flat for a square, and the forward family curvilinear equation of fundamental curve is: ρ=ρ for * e^ 0(2 π * m/M+2 π * n/N), the reverse family curvilinear equation of fundamental curve is * e^: ρ=ρ 0(2 π * m/M+2 π * n/N), wherein M, N are natural number to * e^, and the codomain of m is [0, M], and the codomain of n is [1, N].
The present invention further is set to: said M=1104, and N=1104, said charge coupled device is divided 1104 standard rings by human eye retina ganglion cell's simulate growth curve, divides 1104 pixels, ρ<ρ in each standard ring 0The center microcell, whole divide a round pixel.
Another purpose of the present invention is to provide a kind of image element information scanning read method of bionical charge coupled device.
For realizing above-mentioned purpose, the invention provides following technical scheme: carry out the scanning of photogenerated charge image element information according to said human eye retina ganglion cell's simulate growth curve and read.
Because charge coupled device has the self-scanning ability; The photogenerated charge that produces on the pixel output of serial clocklike successively soon; Adopt technique scheme; Can imitate human eye; Efficiently, fast, mechanically the bionical charge coupled device of the present invention is carried out photogenerated charge image element information scanning and read, and realize separating of original object and background.
Below in conjunction with accompanying drawing the present invention is further described.
Description of drawings
Fig. 1 is the circular flat procedure chart for square topological transformation;
Fig. 2 is standard analog human eye, retinal projection's dish and the elementary mapping graph of V1 district information;
Fig. 3 is that charge coupled device pixel of the present invention is divided sketch map.
Embodiment
Bionical charge coupled device disclosed by the invention; The pixel of said charge coupled device is divided by human eye retina ganglion cell's simulate growth curve; Said human eye retina ganglion cell's simulate growth curve is made up of with reverse family the forward family of the fundamental curve under the same coordinate system; Said fundamental curve is a log spiral, promptly rectangle after topological transformation is circular flat one of which root diagonal at curve that this circular flat became.
Present embodiment preferably is set to: the curvilinear equation of said fundamental curve is: ρ=ρ 0* e^ (2 π * m/M); Promptly this fundamental curve is: square after topological transformation is circular flat one of which root diagonal at curve that this circular flat became; Referring to accompanying drawing 1; With square is the end on one side, and dual-side links to each other and constitutes a cylinder, and the cylinder bottom is constant; Be punctured into circular cone; The compression from the top again, topological transformation is a circular flat, the forward family curvilinear equation of fundamental curve is: ρ=ρ 0(2 π * m/M+2 π * n/N), the reverse family curvilinear equation of fundamental curve is * e^: ρ=ρ 0(2 π * m/M+2 π * n/N), wherein M, N are natural number to * e^, and the codomain of m is [0, M], and the codomain of n is [1, N].M=1104 wherein, N=1104, charge coupled device is divided 1104 standard rings by human eye retina ganglion cell's simulate growth curve, divides 1104 pixels, ρ<ρ in each standard ring 0The center microcell, whole divide a round pixel.
Because square is that its cornerwise 45 remains constant in the circular flat process through topological transformation; Can make that pixel (size of pixel can be understood as the size of its receptive field) distribution of charge coupled device is more reasonable, the geometry of each pixel all has not consistency of topology.And based on retina physiology cell statistics, charge coupled device is done as above pixel division and the retinal ganglion cell reaches the close order of magnitude, makes charge coupled device reach better bionical effect, because ρ<ρ 0Center microcell pixel be difficult to divide, so it is wholely divided a round pixel.Again and this curve and X-axis, Y-axis intersect for five times, whole circular flat is classified as five characteristic areas, distinguish with zone, macular area, the central fovea side of the maximum district of human eye retina's awl cell density, no rod cell and outer peripheral areas more corresponding.
Referring to accompanying drawing 2; Retina is an extraordinary eccentric type sphere; For ease of studying us retina is idealized as sphere; Set: the radius of a ball=11mm; Nodal point separation=4.4mm must be transformed to retinal projection's dish to the retina image-forming vertical plane by idealized eyeball parameter when experiment test; With this retinal projection's dish is charge coupled device, divides pixel with human eye retina ganglion cell's simulate growth curve.Human eye retina ganglion cell's simulate growth curve and X-axis, Y-axis have five times to intersect; Intersection point is corresponding with amphiblestroid several essential characteristic lines (being five area dividing lines of retina); With n=0 human eye retina ganglion cell's simulate growth curve is example, draws form 1.
Form 1
? The retina feature description ω (degree) ρ? (cm) β simulates (degree) β tests (degree)
1 The maximum district of awl cell density: 0 0.03 0.113 0.09
2 The zone of no rod cell: 90 0.16 0.542 0.5
3 Macular area: 180 0.80 2.604 2.6
4 The other district of central fovea: 270 3.85 12.341 11.0
5 Other zone: 360 18.52 46.463 45.1
Wherein, ω, ρ are respectively the angle and the vector lengths of curve in the polar coordinate system; The β simulation is the corresponding standard human eye visual angle of standard retinal projection disk, and the β test is that actual human eye is tested resulting perspective data.
A kind of manufacturing approach of bionical charge coupled device; Charge coupled device is divided pixel with human eye retina ganglion cell's simulate growth curve; Said human eye retina ganglion cell's simulate growth curve is made up of with reverse family the forward family of the fundamental curve under the same coordinate system; Said fundamental curve is a log spiral, promptly rectangle after topological transformation is circular flat one of which root diagonal at curve that this circular flat became.
Present embodiment preferably is set to: the curvilinear equation of said fundamental curve is: ρ=ρ 0(2 π * m/M), promptly this fundamental curve is: one of which root diagonal is at the curve that this circular flat became after topological transformation is circular flat for a square, and the forward family curvilinear equation of fundamental curve is: ρ=ρ for * e^ 0(2 π * m/M+2 π * n/N), the reverse family curvilinear equation of fundamental curve is * e^: ρ=ρ 0* e^ (2 π * m/M+2 π * n/N); Wherein M, N are natural number; The codomain of m is [0, M], and the codomain of n is [1; N]; M=1104 wherein, N=1104, said charge coupled device is divided 1104 standard rings by human eye retina ganglion cell's simulate growth curve; Divide 1104 pixels, ρ<ρ in each standard ring 0The center microcell, whole divide a round pixel.
A kind of image element information scanning read method of bionical charge coupled device: carry out the scanning of photogenerated charge image element information according to said human eye retina ganglion cell's simulate growth curve and read.
Because charge coupled device has the self-scanning ability; The photogenerated charge that produces on the pixel output of serial clocklike successively soon; Adopt technique scheme; Can imitate human eye; Efficiently, fast, mechanically the bionical charge coupled device of the present invention is carried out photogenerated charge image element information scanning and read, and realize separating of original object and background.
Below be that 1 centimetre the bionical charge coupled device of circular human eye retina is an example with diameter:
1. calculate ρ 0
The fundamental curve equation of human eye retina ganglion cell's simulate growth curve: ρ=ρ 0* e^ (2 π * m/M)
Wherein: M=1104; The m codomain is: [0,1104]
When m=0, ρ=0.5 centimetre
Therefore, calculate ρ 0=0.000933721
2. formulate human eye retina ganglion cell's simulate growth curve of two family's quadratures
Forward family: ρ=ρ 0* e^ (2 π * m/M+2 π * n/N)
Reverse family: ρ=ρ 0* e^ (2 π * m/M+2 π * n/N)
Wherein: N=1104; The n codomain is: [1,1104]
3. draw the bionical charge coupled device pixel of circular human eye retina division figure
Utilize the fundamental curve of positive and negative two clansman's eyes retina ganglion cell simulate growth curves to draw CAD figure (referring to accompanying drawing 3), each is exactly a bionical charge coupled device pixel of human eye retina by the closed irregular bent quadrangle of four curves among the figure.
4. microcell pixel in center is divided for ρ<ρ 0The center microcell, whole divide a round pixel.
5. the image element information way of output is with the photogenerated charge output of serial clocklike successively that produces in the photosensitive unit, and this rule also is to carry out according to human eye retina ganglion cell's simulate growth curve.N gets 1~1104, and for each n, m gets 0~1104 respectively again, reads image element information successively.Obtain thus image element information serial output, the round image element information of the center microcell of ρ<ρ 0 reads separately.

Claims (7)

1. bionical charge coupled device; Be characterised in that: the pixel of said charge coupled device is divided by human eye retina ganglion cell's simulate growth curve; Said human eye retina ganglion cell's simulate growth curve is made up of with reverse family the forward family of the fundamental curve under the same coordinate system, and said fundamental curve is a log spiral.
2. bionical charge coupled device according to claim 1 is characterized in that: the curvilinear equation of said fundamental curve is: ρ=ρ 0(2 π * m/M), the forward family curvilinear equation of fundamental curve is * e^: ρ=ρ 0(2 π * m/M+2 π * n/N), the reverse family curvilinear equation of fundamental curve is * e^: ρ=ρ 0(2 π * m/M+2 π * n/N), wherein M, N are natural number to * e^, and the codomain of m is [0, M], and the codomain of n is [1, N].
3. bionical charge coupled device according to claim 2; It is characterized in that: said M=1104, N=1104, said charge coupled device is divided 1104 standard rings by human eye retina ganglion cell's simulate growth curve; Divide 1104 pixels, ρ<ρ in each standard ring 0The center microcell, whole divide a round pixel.
4. the manufacturing approach of a bionical charge coupled device; It is characterized in that: charge coupled device is divided pixel with human eye retina ganglion cell's simulate growth curve; Said human eye retina ganglion cell's simulate growth curve is made up of with reverse family the forward family of the fundamental curve under the same coordinate system, and said fundamental curve is a log spiral.
5. the manufacturing approach of bionical charge coupled device according to claim 4, it is characterized in that: the curvilinear equation of said fundamental curve is: ρ=ρ 0(2 π * m/M), the forward family curvilinear equation of fundamental curve is * e^: ρ=ρ 0(2 π * m/M+2 π * n/N), the reverse family curvilinear equation of fundamental curve is * e^: ρ=ρ 0(2 π * m/M+2 π * n/N), wherein M, N are natural number to * e^, and the codomain of m is [0, M], and the codomain of n is [1, N].
6. the manufacturing approach of bionical charge coupled device according to claim 5; It is characterized in that: said M=1104, N=1104, said charge coupled device is divided 1104 standard rings by human eye retina ganglion cell's simulate growth curve; Divide 1104 pixels, ρ<ρ in each standard ring 0The center microcell, whole divide a round pixel.
7. according to the image element information scanning read method of claim 1 or 2 or 3 described bionical charge coupled devices, it is characterized in that: carry out the scanning of photogenerated charge image element information according to said human eye retina ganglion cell's simulate growth curve and read.
CN201110210446.3A 2011-07-26 2011-07-26 Bionic charge coupling device and manufacturing method and pixel information scanning and reading method thereof Expired - Fee Related CN102306654B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110210446.3A CN102306654B (en) 2011-07-26 2011-07-26 Bionic charge coupling device and manufacturing method and pixel information scanning and reading method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110210446.3A CN102306654B (en) 2011-07-26 2011-07-26 Bionic charge coupling device and manufacturing method and pixel information scanning and reading method thereof

Publications (2)

Publication Number Publication Date
CN102306654A true CN102306654A (en) 2012-01-04
CN102306654B CN102306654B (en) 2014-11-05

Family

ID=45380488

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110210446.3A Expired - Fee Related CN102306654B (en) 2011-07-26 2011-07-26 Bionic charge coupling device and manufacturing method and pixel information scanning and reading method thereof

Country Status (1)

Country Link
CN (1) CN102306654B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103745257A (en) * 2013-12-23 2014-04-23 温州医科大学眼视光器械有限公司 Cone-cell density calculation method based on image identification

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2259728Y (en) * 1996-06-25 1997-08-13 瞿寿德 Infrared CCD thermal imaging apparatus
US20030011745A1 (en) * 1998-10-07 2003-01-16 Tracey Technologies, Llc Device for measuring aberration refraction of the eye
JP2010518407A (en) * 2007-02-14 2010-05-27 ザ インスティチュート フォー アイ リサーチ リミテッド Characteristic analysis of optical systems

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2259728Y (en) * 1996-06-25 1997-08-13 瞿寿德 Infrared CCD thermal imaging apparatus
US20030011745A1 (en) * 1998-10-07 2003-01-16 Tracey Technologies, Llc Device for measuring aberration refraction of the eye
JP2010518407A (en) * 2007-02-14 2010-05-27 ザ インスティチュート フォー アイ リサーチ リミテッド Characteristic analysis of optical systems

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103745257A (en) * 2013-12-23 2014-04-23 温州医科大学眼视光器械有限公司 Cone-cell density calculation method based on image identification
CN103745257B (en) * 2013-12-23 2016-08-17 温州医科大学眼视光器械有限公司 A kind of computational methods of cone cell density based on image recognition

Also Published As

Publication number Publication date
CN102306654B (en) 2014-11-05

Similar Documents

Publication Publication Date Title
Ikoma et al. Depth from defocus with learned optics for imaging and occlusion-aware depth estimation
CN106464861B (en) The compact display glasses of immersion
US10129984B1 (en) Three-dimensional electronics distribution by geodesic faceting
CN113963044B (en) Cargo box intelligent loading method and system based on RGBD camera
CN101576771B (en) Scaling method for eye tracker based on nonuniform sample interpolation
CN104252700B (en) A kind of histogram equalization method of infrared image
CN104007556B (en) Low crosstalk integrated imaging three-dimensional display method based on microlens array group
CN104463949A (en) Rapid three-dimensional reconstruction method and system based on light field digit refocusing
CN108280814A (en) Light field image angle super-resolution rate method for reconstructing based on perception loss
CN103325120A (en) Rapid self-adaption binocular vision stereo matching method capable of supporting weight
Forman et al. Continuous parallax in discrete pixelated integral three-dimensional displays
US11146781B2 (en) In-layer signal processing
US20190246044A1 (en) Distributed Multi-Aperture Camera Array
CN103440648B (en) The method for automatic measurement of corps canopy regularity and device
WO2020117459A1 (en) Eccentric incident luminance pupil tracking
CN105374044A (en) Automatic calibration method of light field camera
CN109644232A (en) Sectional type is obtained without lens compression image
CN104732495B (en) A kind of image processing method and system based on fuzzy auto tone
CN111161203A (en) Multi-focus image fusion method based on memristor pulse coupling neural network
CN102306654B (en) Bionic charge coupling device and manufacturing method and pixel information scanning and reading method thereof
CN104933435B (en) Machine vision construction method based on simulation human vision
CN106973205A (en) A kind of camera, camera imaging method and mobile terminal
CN101690687B (en) Method for generating phosphene for simulating prothetic vision device
US20190246098A1 (en) Distributed Multi-Screen Array for High Density Display
CN104700373B (en) A kind of multiple dimensioned gaussian filtering device and its building method for image analoging signal

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20141105

Termination date: 20210726