CN101526669A - Microscope photographing imaging device and imaging method thereof used for chromosome and pathology slide - Google Patents
Microscope photographing imaging device and imaging method thereof used for chromosome and pathology slide Download PDFInfo
- Publication number
- CN101526669A CN101526669A CN200810220672A CN200810220672A CN101526669A CN 101526669 A CN101526669 A CN 101526669A CN 200810220672 A CN200810220672 A CN 200810220672A CN 200810220672 A CN200810220672 A CN 200810220672A CN 101526669 A CN101526669 A CN 101526669A
- Authority
- CN
- China
- Prior art keywords
- filtering assembly
- chromosome
- image
- slide
- white
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Microscoopes, Condenser (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The invention discloses a microscope photographing imaging device and an imaging method thereof which can be simultaneously used for chromosomes and pathology. A light filtering assembly comprises a first light filtering assembly and a second light filtering assembly, wherein the first light filtering assembly is between a light source and a slide, is used for regulating the color of the light source, and mainly comprises light filtering plates with a light filtering function, and the second light filtering assembly is between an adaptation lens and a colorful digital video camera. When a chromosome slide of a monochrome image is shot, a filtering plate for the green light to pass is used, so the colorful digital video camera only shoots the green light; and when a pathology slide of a color image is shot, a white light source is directly used, and the second light filtering assembly is infrared cut-off light filtering plates. The invention has the following advantages: the functions of the monochrome imaging of the chromosome slide and the colorful imaging of the pathology slide of different imaging requirements are realized only by one colorful digital video camera, the structure is simple, the operation of switching the device referring to two environments for use of different requirements is simple and easy, the cost is low and the realization is easy.
Description
Technical field
The present invention relates to the microscope photographing imaging technique, specially refer to by video camera and take microscopical colour and black and white imaging, the grey level stretching of black white image, converter technique.
Background technology
In existing microscope imaging device, because various application emphasis difference, the requirement of imaging is also had nothing in common with each other.Pathology slide lays particular emphasis on the resolution and the color rendition degree of imaging; The chromosome slide is not high and do not need the color performance to the resolution requirement of imaging, but relatively pays attention to the expressive ability of GTG.In order to satisfy the demand, in the existing pathology imaging device, use be colour TV camera; And in the chromosome imaging device, use be B, both can not be compatible.If on the pathology color image forming apparatus, observe chromosome, each point all is to be combined by three kinds of color components of red, green, blue on the view data, because it is as shown in Figure 1 that the pixel of CCD or CMOS photoreceptor is arranged, on the photoreceptor each pixel have only red (R), green (G), blue (B) three kinds of colors one of them be the current numerical value that collects, all the other two kinds of colors are to calculate interpolation by the numerical value that the adjacent sensitivity speck of this point obtains.As Fig. 1, be V (n) at the numerical value of n pixel of view data, the figure image width is a w pixel, then the composition of the view data of this point is:
Red: R=V (n),
Green: G=(V (n-1)+V (n+1)+V (n-w)+V (n+w))/4,
Blue: B=(V (n-w-1)+V (n-w+1)+V (n+w-1)+V (n+w+1))/4,
(the rest of pixels point is analogized).By the brightness calculation formula, color image data is converted to the black and white gray-scale value be: Y=0.299R+0.587G+0.114B.By above step as can be seen, in this way by coloured image being converted to the chromosome image that black white image forms the black and white imaging, because the brightness of each point (gray scale) is all converted by the rgb value of this point, and this rgb value has 2nd/3rd, calculates by the value of other adjacent points, so the gray-scale value of this point must be subjected to the influence of consecutive point, reduced the GTG expressive ability of image, and the color interpolation of coloured image and in the transfer process of gray level image, need a large amount of expenses.If observe pathology with the chromosome imaging system of black and white, be B then because of what use, can not show the different colours in the pathology slide.Usually in fields such as medical science and biological test, observation and teaching, often have the application that relates to above-mentioned colour and black and white imaging.In different application, use the video camera of colored and black and white respectively, switching, operation and use are all very inconvenient, use to have limitation, and the cost height.
Summary of the invention
The shortcoming that the objective of the invention is to overcome prior art provides a kind of simple in structure with not enough, and convenient the switching operated simple and easyly, can keep picture quality, satisfies the device of color pathological and the imaging of black and white chromosome microscope photographing simultaneously.
Another object of the present invention is to provide the above-mentioned imaging acquisition method that satisfies the device of color pathological and the imaging of black and white chromosome microscope photographing simultaneously.
Purpose of the present invention is achieved through the following technical solutions: a kind of microscope photographing imaging device that can be used for chromosome and pathology simultaneously, comprise the colorful digital video camera, optical microscope with white light source, adaptive mirror between microscope and video camera, main process equipment and filtering assembly, the colorful digital video camera is installed on the microscope, be connected with main process equipment by data-interface, main process equipment is by this interface control video camera shooting area, acquisition mode, each Color Channel gain, shutter, view data sends main process equipment to by this interface, described filtering assembly comprises first filtering assembly that is used to regulate light source colour between light source and slide, and second filtering assembly between described adaptive mirror and described colorful digital video camera, first filtering assembly is mainly by being made up of the optical filter of filter action, when taking the chromosome slide of black white image, use first filtering assembly, described colorful digital video camera is only photographed be used for the monochromatic light that black and white is handled; When the pathology slide of color image shot, remove first filtering assembly and get final product.
Described first filtering assembly mainly is made up of by optical filter switchable green glow, and described second filtering assembly is can completely cut off the contained infrared light of light source and reduce the cutoff filter of infrared light to the influence of coloured image real colour degree.
Described main process equipment and digital camera, when taking black white image, main process equipment can send instructions to the sensor of colorful digital video camera, regulate shooting area, drainage pattern, shutter, the gain that redness, blue channel are set is 0, regulates the brightness of the gain of green channel in order to the adjusting image on demand, after view data is passed on main frame, by gray level image treatment technologies such as grey level stretching and conversion, strengthen the GTG effect of image; When color image shot, main process equipment can send instructions to the digital camera sensor, regulate shooting area, drainage pattern, shutter, each Color Channel gain earlier is set to identical value, by the Automatic white balance algorithm, then according to the Automatic white balance computing regulate the yield value of three passages of red, green, blue respectively to parameter, reach the most approaching real color rendition.
Described digital camera refers to the camera that comprises that ccd image sensor or cmos image sensor are connected with main process equipment with data, control interface, this interface can be USB, 1394 or CameraLink etc., the size of sensor can be 2/3 cun, 1/2 cun or 1/3 cun etc.
Described adaptive mirror is installed between video camera and the microscope, except being used for different interface between adaptive video camera and the microscope, also include one group of lens, these lens dwindle certain multiple (0.25 to microscopical image, 0.3,0.5 or 1), make the size of image can be fit to the size of the sensor of video camera.
Described microscope has the object lens of various multiples, as: 5 times, 10 times, 20 times, 40 times, 100 times.
Described main process equipment can adopt have can with the personal computer of video camera mating interface, industrial computer etc.
Shot image data can be kept in the main process equipment, also can be kept in the external storage facilities.
A kind of microscope photographing imaging method that can satisfy colored and black and white simultaneously that is realized by the above-mentioned microscope photographing imaging device that can be used for chromosome and pathology slide may further comprise the steps:
S101: when taking black and white chromosome slide, use first filtering assembly; When taking the color pathological slide, remove first filtering assembly;
S102: start the colorful digital video camera, shooting area, drainage pattern, shutter are set, the gain of redness, green, blue channel is set;
S103: original view data is delivered to main process equipment by data-interface, after main process equipment receives data, according to different applied environments, carries out corresponding interpolation and image optimization and handles;
S104: display screen shows the continuous image that video camera photographs;
S105: the response user takes and holds instruction, and preserves the current images data.
Wherein, the method that the gain of redness, green, blue channel is set among the S102 is:
(1), when taking the imaging of chromosome slide black and white, what first filtering assembly used is green by optical filter, the gain of the Color Channel of corresponding camera sensor is set to: yield value red and blue channel is set to 0; Green channel is provided with suitable numerical value according to the brightness demand of the image of taking;
(2) when taking the pathology slide colour imaging, shift out first filtering assembly, make microscope white light source direct irradiation micro objective, the Color Channel gain of corresponding camera sensor is set to: three kinds of colors of red, green, blue are made as same numerical value; After the Automatic white balance computing, obtain the modification value of three kinds of color gains respectively, according to this modification value, reset the yield value of three kinds of colors of camera sensor, make the most approaching white of image.
Wherein, the raw image data that the main process equipment among the step S103 receives is the data of RAW form, according to different applied environments, carries out following corresponding processing:
(1), when taking the imaging of chromosome slide black and white, in the view data, data red, blue channel all are 0, the numerical value of green channel is directly as the gray-scale value of this point; If this point is red or blue photosite, then this gray-scale value is the mean value of the green photosite numerical value in adjacent 1 pixel coverage, and image is carried out grey level stretching, conversion process, to strengthen the GTG expressive ability of black white image;
(2), when taking the pathology slide colour imaging, in the view data, the color-values of current point is made up of the numerical value of the current sensitization color of this point collection and the mean value of the other two kinds of colors in adjacent 1 pixel coverage.
The present invention has following advantage and effect with respect to prior art: 1, the present invention only need realize chromosome slide black and white imaging and the pathology slide colour imaging function different to imaging requirements with a colorful digital video camera.2, the present invention is by filtering assembly and camera sensor shades of colour channel gain value is set, utilize the high characteristics of camera sensor green photosite accounting example, reduce the number of times of interpolation, and eliminated classic method and caused gray-scale deviation from the error that coloured image extraction brightness value converts computing the black white image process to, make color sensor also can allow the more clear light and shade of chromosome band that reflects of black white image of emphasis GTG expressive ability distribute, changing black white image with coloured image by the computing of extracting brightness value with classic method compares, the quality of gray scale image is significantly improved, and efficient also obviously promotes.3, the present invention regulates the yield value of each Color Channel of camera sensor respectively by the Automatic white balance algorithm, makes the more approaching reality of coloured image, reduction truly.4, the present invention is simple in structure, and the operation of carrying out the device switching at the environment for use of two kinds of different demands is simple and easy, and cost is low, realizes easily.
Description of drawings
Fig. 1 is a digital camera photoreceptor synoptic diagram;
Fig. 2 is a black and white image DATA DISTRIBUTION synoptic diagram;
Fig. 3 is a colour imaging view data distribution schematic diagram;
Fig. 4 is the structural representation of microscopic imaging device of the present invention;
Fig. 5 is the operational flowchart by the formation method of device realization shown in Figure 4.
Embodiment
Below in conjunction with reaching accompanying drawing in implementing the present invention is described in further detail.
Fig. 4 has showed the concrete structure of microscope imaging device of the present invention, as seen from Figure 4, this device comprises microscope 3, first filtering assembly 5, second filtering assembly 6 and the main process equipment 7 of colorful digital video camera 1, adaptive mirror 2, band white light source 4, first filtering assembly 5 is between the light source and objective table slide of microscope 3, when taking the imaging of chromosome slide black and white is that green glow passes through optical filter, is used to intercept green ray cast in addition to slide; Removing green glow when taking the pathology slide colour imaging changes high lens or allows light source directly throw slide by optical filter.Colorful digital video camera 1 docks with microscope 3 by adaptive mirror 2, described adaptive mirror 2 has the lens of certain minification, and the multiple of lens is determined according to the size and the imaging size of photoreceptor on the colorful digital video camera 1, can be 0.25,0.3,0.5 or 1 equimultiple.Second filtering assembly 6 is housed between colorful digital video camera 1 and the adaptive mirror 2, second filtering assembly 6 is made up of cutoff filter, in imaging process, be used to intercept the infrared light of light source, to lower or influence when eliminating infrared light to the 1 sensor imaging of colorful digital video camera.Colorful digital video camera 1 is a digital camera with colored CCD or cmos sensor, and this colorful digital video camera 1 uses data-interfaces 8 such as USB or 1394, CameraLink, links to each other with main process equipment 7 by cable.Described main process equipment 7 is a computing machine.The view data that photographs can be kept in the storage facilities of computing machine, also can be kept in the external storage facilities.
The microscope photographing formation method of being realized by above-mentioned microscope photographing imaging device that can be used for chromosome and pathology simultaneously comprises the steps: as shown in Figure 5
S101 changes first filtering assembly 5 according to environment for use, when taking black and white chromosome slide, uses green glow to pass through optical filter; When taking the color pathological slide, shift out green glow, directly use white light source by optical filter;
S102 starts colorful digital video camera 1, and shooting area, drainage pattern, shutter are set, and the gain of redness, green, blue channel is set according to different use occasions;
The original view data of S103 is delivered to computing machine by data-interface, receive data after, according to different application scenarios, carry out corresponding interpolation and image optimization and handle.
S104 computer screen curtain will photograph continuous the showing of image from video camera.
S105 response user's shooting is held instruction, and the view data that video camera is photographed is kept in the middle of the storage facilities of computing machine.
Wherein, that the detailed process of method of red, green, blue channel gain is set according to different use occasions is as follows for the video camera of S102:
(1) when taking the imaging of chromosome slide black and white, what first filtering assembly 5 used is green by optical filter, and in the photoreceptor of computing machine to camera, the register address of the yield value correspondence of redness, blue channel writes 0; The green channel yield value writes suitable numerical value according to the brightness demand of the image of taking to the register address of correspondence, and scope is by 0 to 255;
(2) when taking the pathology slide colour imaging, first filtering assembly 5 shifts out optical filter, makes the white light source 4 direct irradiation micro objectives of microscope 3.The global color gain that camera sensor is set earlier is same numerical value, promptly the global color corresponding register that gains is write this numerical value according to the brightness demand, or respectively the register of three kinds of colors of red, green, blue in sensor gain being write same yield value, this value scope is by 0 to 255.Computing machine is reference with the image of current collection then, after the Automatic white balance computing, obtains the modification value of three kinds of color gains respectively, according to this modification value, resets the yield value of three kinds of colors of camera sensor, makes the most approaching white of image.
Wherein, in the S103 step, after computing machine received data, according to different application scenarios, the detailed process of carrying out the method that corresponding interpolation and image optimization handle was as follows:
(1) when taking the imaging of chromosome slide black and white, because gain red in the camera sensor, blue channel has been set to 0.Therefore, in the view data, data red, blue channel all are 0, and the numerical value of green channel is directly as the gray-scale value of this point; If this point corresponds to redness or blue photosite, then in the gray level image data, this gray-scale value is the mean value of the green photosite numerical value in adjacent 1 pixel coverage, with the gray scale numerical value of red point and blue position pixel in this mean value replacement original digital image data.As Fig. 2: in raw image data, being set in n gray values of pixel points is G (n), and this raw data is V (n), and adopting the image width degree is w pixel, and when n corresponded to green photosite, this gray values of pixel points was a currency; When n corresponds to redness or blue photosite, this point value is 0 in the raw data, then this gray-scale value
G(n)＝(V(n-1)+V(n+1)+V(n-w)+V(n+w))/4
The calculating of the pixel average that is positioned at edge lines or lists be with this put an adjacent pixel coverage interior pixel and divided by the number of neighbor pixel.
Image is carried out grey level stretching, conversion process, to strengthen the GTG expressive ability of black white image.
(2) when taking the pathology slide colour imaging, in the view data, the color-values of current point is made up of the mean value of other two kinds of colors of the numerical value of the current sensitization color of this point collection and neighbor.As Fig. 3: in raw image data, be set in n pixel and correspond to red photosite, three kinds of color component numerical value of this pixel red, green, blue are respectively R (n), G (n), B (n), adopting the image width degree is w pixel, n pixel numerical value is V (n) in the raw data, then this pixel red component numerical value
R (n)=V (n), i.e. currency;
G (n)=(V (n-1)+V (n+1)+V (n-w)+V (n+w))/4, i.e. G (n)=(G1+G2+G3+G4)/4;
B (n)=(V (n-w-1)+V (n-w+1)+V (n+w-1)+V (n+w+1))/4, i.e. B (n)=(B1+B2+B3+B4)/4;
The rest may be inferred by analogy for it, be positioned at edge lines or the calculating of the pixel average that lists be with this put an adjacent pixel coverage interior pixel and divided by the number of neighbor pixel.
The foregoing description is a preferred implementation of the present invention; but embodiments of the present invention are not restricted to the described embodiments; other any do not deviate from change, the modification done under spirit of the present invention and the principle, substitutes, combination, simplify; all should be the substitute mode of equivalence, be included within protection scope of the present invention.
Claims (7)
1, a kind of microscope photographing imaging device that can be used for chromosome and pathology simultaneously, comprise the colorful digital video camera, the optical microscope that has white light source, adaptive mirror between microscope and video camera, main process equipment and filtering assembly, the colorful digital video camera is installed on the microscope, be connected with main process equipment by data-interface, main process equipment is by this interface control video camera shooting area, acquisition mode, each Color Channel gain, shutter, view data sends main process equipment to by this interface, it is characterized in that: described filtering assembly comprises first filtering assembly that is used to regulate light source colour between light source and slide, and second filtering assembly between described adaptive mirror and described colorful digital video camera, first filtering assembly is mainly by being made up of the optical filter of filter action, when taking the chromosome slide of black white image, use first filtering assembly, described colorful digital video camera is only photographed be used for the monochromatic light that black and white is handled; When the pathology slide of color image shot, remove first filtering assembly.
2, a kind of microscope photographing imaging device that can be used for chromosome and pathology simultaneously according to claim 1, it is characterized in that: described first filtering assembly mainly is made up of by optical filter switchable green glow, and described second filtering assembly is can completely cut off the contained infrared light of light source and reduce the cutoff filter of infrared light to the influence of coloured image real colour degree.
3, the microscope photographing imaging device that can be used for chromosome and pathology simultaneously according to claim 1, it is characterized in that: described colorful digital camera is meant and comprises data transmission interface, the digital camera of ccd image sensor or cmos image sensor.
4, the microscope photographing imaging device that can be used for chromosome and pathology simultaneously according to claim 1, it is characterized in that: described main process equipment is computing machine or industrial computer.
5, a kind of by the described formation method that can be used for the microscope photographing imaging device of chromosome and pathology simultaneously of claim 1, it is characterized in that: comprise the steps:
S101: when taking black and white chromosome slide, use first filtering assembly; When taking the color pathological slide, remove first filtering assembly;
S102: start the colorful digital video camera, shooting area, drainage pattern, shutter are set, the gain of redness, green, blue channel is set;
S103: original view data is delivered to main process equipment by data-interface, after main process equipment receives data, according to different applied environments, carries out corresponding interpolation and image optimization and handles;
S104: display screen shows the continuous image that video camera photographs;
S105: the response user takes and holds instruction, and preserves the current images data.
6, the formation method that can be used for the microscope photographing of chromosome and pathology simultaneously according to claim 5, it is characterized in that: the method for the gain that redness, green, blue channel are set among the step S102 is as follows:
(1) when taking the imaging of chromosome slide black and white, what first filtering assembly used is green by optical filter, and the gain of the Color Channel of corresponding camera sensor is set to: yield value red and blue channel is set to 0; Green channel is provided with suitable numerical value according to the brightness demand of the image of taking;
(2) when taking the pathology slide colour imaging, remove first filtering assembly, make microscope white light source direct irradiation micro objective, the Color Channel gain of corresponding camera sensor is set to: three kinds of colors of red, green, blue are made as same numerical value; After the Automatic white balance computing, obtain the modification value of three kinds of color gains respectively, according to this modification value, reset the yield value of three kinds of colors of camera sensor, make the most approaching white of image.
7, the formation method that can be used for the microscope photographing of chromosome and pathology simultaneously according to claim 5, it is characterized in that: the raw image data that the main process equipment among the step S103 receives is the data of RAW form, according to different applied environments, carry out following corresponding processing:
(1) when taking the imaging of chromosome slide black and white, in the view data, data red, blue channel all are 0, and the numerical value of green channel is directly as the gray-scale value of this point; If this point is red or blue photosite, then this gray-scale value is the mean value of the green photosite numerical value in adjacent 1 pixel coverage, and image is carried out grey level stretching, conversion process, to strengthen the GTG expressive ability of black white image;
(2) when taking the pathology slide colour imaging, in the view data, the color-values of current point is made up of the numerical value of the current sensitization color of this some collection and the mean value of the other two kinds of colors in adjacent 1 pixel coverage.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008102206728A CN101526669B (en) | 2008-12-31 | 2008-12-31 | Microscope photographing imaging device and imaging method thereof used for chromosome and pathology slide |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008102206728A CN101526669B (en) | 2008-12-31 | 2008-12-31 | Microscope photographing imaging device and imaging method thereof used for chromosome and pathology slide |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101526669A true CN101526669A (en) | 2009-09-09 |
| CN101526669B CN101526669B (en) | 2010-12-15 |
Family
ID=41094610
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2008102206728A Expired - Fee Related CN101526669B (en) | 2008-12-31 | 2008-12-31 | Microscope photographing imaging device and imaging method thereof used for chromosome and pathology slide |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101526669B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115079393A (en) * | 2022-08-19 | 2022-09-20 | 杭州德适生物科技有限公司 | Chromosome karyotype analysis microscopic shooting device and method based on 10-fold objective lens |
-
2008
- 2008-12-31 CN CN2008102206728A patent/CN101526669B/en not_active Expired - Fee Related
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115079393A (en) * | 2022-08-19 | 2022-09-20 | 杭州德适生物科技有限公司 | Chromosome karyotype analysis microscopic shooting device and method based on 10-fold objective lens |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101526669B (en) | 2010-12-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9482797B2 (en) | Pixel array, camera using the same and color processing method based on the pixel array | |
| JP5543616B2 (en) | Color filter array image repetitive denoising | |
| CN102204258B (en) | Image inputting apparatus | |
| CN102754443B (en) | Image processing device and image processing method | |
| US9160935B2 (en) | Sensor arrangement for transforming color space representation in a digital color image | |
| JP5749741B2 (en) | Noise reduction method | |
| CN108965654A (en) | Double spectrum camera systems and image processing method based on single-sensor | |
| US20060146064A1 (en) | Hexagonal color pixel structure with white pixels | |
| EP2793470A1 (en) | Image pickup device | |
| CN102143322B (en) | Image capturing apparatus and control method thereof | |
| CN103458162B (en) | For the lens array of sectional image sensor | |
| CN102783135A (en) | Method and apparatus for providing a high resolution image using low resolution | |
| CN105432068B (en) | Photographic device, image capture method and image processing apparatus | |
| CN103327220A (en) | Denoising method oriented by green channel on low illumination Bayer image | |
| WO2004097736A1 (en) | Color filter array interpolation | |
| CN104429056A (en) | Image processing method, image processing device, imaging device, and image processing program | |
| CN102379125A (en) | Image input device | |
| EP1873713A3 (en) | Demosaicing for a colour filter array | |
| JP2014126903A (en) | Image processing apparatus, image processing method, and program | |
| CN107852456A (en) | Image processing apparatus, camera device, image processing method and program | |
| WO2015186510A1 (en) | Imaging device and method, and program | |
| US20080007635A1 (en) | System and method for reducing the appearance of inherent random optical patterns in a light-diffusing screen | |
| JP2011013857A (en) | Image processing device | |
| CN101526669B (en) | Microscope photographing imaging device and imaging method thereof used for chromosome and pathology slide | |
| US20110170776A1 (en) | Image distortion correcting method and image processing apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20101215 Termination date: 20141231 |
|
| EXPY | Termination of patent right or utility model |