CN102014291B - Method for generating left-eye and right-eye picture pair at horizontal view angle of camera larger than 180 degrees - Google Patents
Method for generating left-eye and right-eye picture pair at horizontal view angle of camera larger than 180 degrees Download PDFInfo
- Publication number
- CN102014291B CN102014291B CN2010102988760A CN201010298876A CN102014291B CN 102014291 B CN102014291 B CN 102014291B CN 2010102988760 A CN2010102988760 A CN 2010102988760A CN 201010298876 A CN201010298876 A CN 201010298876A CN 102014291 B CN102014291 B CN 102014291B
- Authority
- CN
- China
- Prior art keywords
- imaging
- plane
- curved surface
- imaging space
- space combination
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a method for generating a left-eye and right-eye picture pair at a horizontal view angle of a camera larger than 180 degrees in stereo display, which comprises the following steps of: (1) in a three-dimensional drawing system, setting a three-dimensional scene, camera parameters and a parallax value in the stereo display by a user; (2) drawing a plurality of imaging curves of planes cutting the camera to form a plurality of imaging space combinations, and selecting a plurality of the imaging space combinations to form an imaging space combination set; (3) for any imaging space combination in the imaging space combination set, shifting the viewpoint position of the camera, and performing the processing on each imaging space combination in the set to form a group of points; and (4) for each imaging spacing combination in the imaging space combination set, performing drawing by adopting calculated vertex parameters and the known parameters set by the user to obtain left-eye and right-eye pictures. The method can overcome the technical shortcomings of the conventional stereo display, support the generation of the left-eye and right-eye picture pair at the horizontal view angle of the camera larger than 180 degrees, and improve the sense of immersion and reality in the stereo display.
Description
Technical field
The present invention relates to stereo display technique, relate in particular to a kind of camera horizontal view angle that obtains greater than 180 o'clock right methods of generation right and left eyes picture.
Background technology
Stereo display development since coming out has formed three big series so far: initiatively stereo display, passive stereo display and bore hole stereo display.Passive stereo display is owing to can support mass viewer audiences to experience simultaneously, and cost is relatively low, is widely used at three-dimensional film, exhibition etc. gradually.Along with the requirement of the feeling of immersion of stereo in showing improves constantly; Requirement is in stereo display, and the horizontal view angle of camera is increasing, just needs to solve camera levels visual angle; Particularly the horizontal view angle generated the right method of right and left eyes picture greater than 180 o'clock in the real-time rendering.
Summary of the invention
The objective of the invention is to deficiency, provide a kind of camera horizontal view angle that obtains greater than 180 o'clock right methods of generation right and left eyes picture to technology in the existing stereo display.
It is following greater than the step that generated the right method of right and left eyes picture at 180 o'clock to obtain the camera horizontal view angle:
1) in 3 d graphics system, the given three-dimensional scenic of user defines a camera C, and given camera parameter value, and the camera parameter value comprises: viewpoint position C
Pos, direction of visual lines C
Dir, direction C up
UpWith an imaging curved surface Φ, the curved surface Φ that wherein forms images satisfies condition: cross viewpoint position C
PosAny straight line, curved surface Φ has only an intersection point at most with imaging, the parallax value d during the given again stereo display of user
Ieye
2) cross viewpoint position C
Pos, with direction of visual lines C
DirBe normal, do plane P
0, incite somebody to action direction C up
UpProject to plane P
0On, obtain direction vector V
Up, cross viewpoint position C
PosAlong direction vector V
UpBe straight line L
0, do m plane of intersecting with imaging curved surface Φ, the set on this m plane is plane set M, the plane among the plane set M satisfies condition: have and have only a public intersection, and this public intersection is straight line L
0, m is that the user is given more than or equal to 1 positive number, straight line L
0Each the plane separated into two parts among the M is gathered on the plane, formed 2*m half-plane, the half-plane K that wherein intersects with imaging curved surface Φ
1, K
2..., K
n, half-plane K
iWith half-plane K
jThree dimensions is divided into two area of space, wherein half-plane K
iWith half-plane K
jThe area of space at the angular bisector place of the dihedral angle that constitutes is defined as R
Ij, select two half-plane K that intersect with imaging curved surface Φ
iWith half-plane K
j, satisfy condition: the subregion of imaging curved surface Φ belongs to area of space R
IjBelong to area of space R
IjThe subregion of imaging curved surface Φ be called imaging curved surface area Φ
Ij, half-plane K
iWith half-plane K
jThe dihedral angle that constitutes, and imaging curved surface area Φ
IjBe defined as the imaging space combination; Select several imaging space combinations wherein, be designated as S set, the number of the imaging space combination in the S set is h; Any imaging space combination in the S set satisfies condition: the dihedral angle in the imaging space combination is greater than 0, less than 180; Simultaneously S set satisfies condition: all imaging curved surface area unions that belong in the imaging space combination of set are Φ;
3) for any imaging space combination Z in the S set
i, cross viewpoint position C
PosBe a ray J
i, ray J
iDihedral angle angular bisector with in the imaging space combination is parallel, crosses straight line L
0With ray J
iDo plane P
i, viewpoint position C
PosAlong plane P
iNormal negative direction translation distance a is a V in the position
Il, viewpoint position C
PosAlong plane P
iNormal positive direction translation distance b is a V in the position
Ir, a and b satisfy condition: a+b=d
Ieye, and a and b be positive number, carries out above-mentioned processing for each imaging space combination in the S set, obtains one group of point: V
1l, V
1r, V
2l, V
2r..., V
Nl, V
Nr
4) for any imaging space combination Z in the S set
i, with V
IlBe viewpoint position, direction of observation and imaging space combination Z
iIn dihedral angle angular bisector direction parallel, direction V upwards
Up, the imaging curved surface is imaging space combination Z
iIn the imaging curved surface area, draw, obtain picture I
Il, carry out above-mentioned processing for each imaging space combination in the S set, obtain a group of pictures I
1l..., I
Nl, this group of pictures has formed the left eye picture about camera C;
5) for any imaging space combination Z in the S set
i, with V
IrBe viewpoint position, direction of observation and imaging space combination Z
iIn dihedral angle angular bisector direction parallel, direction V upwards
Up, the imaging curved surface is imaging space combination Z
iIn the imaging curved surface area, draw, obtain picture I
Ir, carry out above-mentioned processing for each imaging space combination in the S set, obtain picture sequence I
1r..., I
Nr, this group of pictures has formed the right eye picture about camera C.
The present invention is in stereo display, and the camera horizontal view angle was greater than 180 o'clock, and it is right well to generate the right and left eyes picture, improves the feeling of immersion in the stereo display, supports more spectators to experience stereo display.
Description of drawings
Fig. 1 draws with OpenGL, and the camera horizontal view angle is 360 when spending, and is cut into the method for image space combination;
Fig. 2 draws with OpenGL, and the camera horizontal view angle is 360 when spending, the definition of the viewpoint position of imaging space combination;
Embodiment
Below in conjunction with accompanying drawing and execution mode the present invention is further specified.
It is following greater than the step that generated the right method of right and left eyes picture at 180 o'clock to obtain the camera horizontal view angle:
1) in 3 d graphics system, the given three-dimensional scenic of user defines a camera C, and given camera parameter value, and the camera parameter value comprises: viewpoint position C
Pos, direction of visual lines C
Dir, direction C up
UpWith an imaging curved surface Φ, the curved surface Φ that wherein forms images satisfies condition: cross viewpoint position C
PosAny straight line, curved surface Φ has only an intersection point at most with imaging, the parallax value d during the given again stereo display of user
Ieye
2) cross viewpoint position C
Pos, with direction of visual lines C
DirBe normal, do plane P
0, incite somebody to action direction C up
UpProject to plane P
0On, obtain direction vector V
Up, cross viewpoint position C
PosAlong direction vector V
UpBe straight line L
0, do m plane of intersecting with imaging curved surface Φ, the set on this m plane is plane set M, the plane among the plane set M satisfies condition: have and have only a public intersection, and this public intersection is straight line L
0, m is that the user is given more than or equal to 1 positive number, straight line L
0Each the plane separated into two parts among the M is gathered on the plane, formed 2*m half-plane, the half-plane K that wherein intersects with imaging curved surface Φ
1, K
2..., K
n, half-plane K
iWith half-plane K
jThree dimensions is divided into two area of space, wherein half-plane K
iWith half-plane K
jThe area of space at the angular bisector place of the dihedral angle that constitutes is defined as R
Ij, select two half-plane K that intersect with imaging curved surface Φ
iWith half-plane K
j, satisfy condition: the subregion of imaging curved surface Φ belongs to area of space R
IjBelong to area of space R
IjThe subregion of imaging curved surface Φ be called imaging curved surface area Φ
Ij, half-plane K
iWith half-plane K
jThe dihedral angle that constitutes, and imaging curved surface area Φ
IjBe defined as the imaging space combination; Select several imaging space combinations wherein, be designated as S set, the number of the imaging space combination in the S set is h; Any imaging space combination in the S set satisfies condition: the dihedral angle in the imaging space combination is greater than 0, less than 180; Simultaneously S set satisfies condition: all imaging curved surface area unions that belong in the imaging space combination of set are Φ;
3) for any imaging space combination Z in the S set
i, cross viewpoint position C
PosBe a ray J
i, ray J
iDihedral angle angular bisector with in the imaging space combination is parallel, crosses straight line L
0With ray J
iDo plane P
i, viewpoint position C
PosAlong plane P
iNormal negative direction translation distance a is a V in the position
Il, viewpoint position C
PosAlong plane P
iNormal positive direction translation distance b is a V in the position
Ir, a and b satisfy condition: a+b=d
Ieye, and a and b be positive number, carries out above-mentioned processing for each imaging space combination in the S set, obtains one group of point: V
1l, V
1r, V
2l, V
2r..., V
Nl, V
Nr
4) for any imaging space combination Z in the S set
i, with V
IlBe viewpoint position, direction of observation and imaging space combination Z
iIn dihedral angle angular bisector direction parallel, direction V upwards
Up, the imaging curved surface is imaging space combination Z
iIn the imaging curved surface area, draw, obtain picture I
Il, carry out above-mentioned processing for each imaging space combination in the S set, obtain a group of pictures I
1l..., I
Nl, this group of pictures has formed the left eye picture about camera C;
5) for any imaging space combination Z in the S set
i, with V
IrBe viewpoint position, direction of observation and imaging space combination Z
iIn dihedral angle angular bisector direction parallel, direction V upwards
Up, the imaging curved surface is imaging space combination Z
iIn the imaging curved surface area, draw, obtain picture I
Ir, carry out above-mentioned processing for each imaging space combination in the S set, obtain picture sequence I
1r..., I
Nr, this group of pictures has formed the right eye picture about camera C.
Embodiment
Be implemented in the stereo display, draw with OpenGL, the camera horizontal view angle is 360 when spending, and obtains the right and left eyes picture to may further comprise the steps:
1) in 3 d graphics system, the user is through 3DS Max modeling, and a given three-dimensional scenic defines a camera C, and given its parameter value, and camera parameter comprises: viewpoint position C
Pos, direction of visual lines C
Dir, direction C up
UpWith a cylinder imaging curved surface Φ, the curved surface that wherein forms images satisfies condition: cross viewpoint position C
PosAny straight line, with the imaging curved surface have only an intersection point at most.Parallax value d during the given again stereo display of user
Ieye
Viewpoint position C
PosOn cylinder imaging curved surface axle,, equal apart from the distance of cylinder bottom surface in the center of cylinder axis.
2) cross viewpoint position C
Pos, with direction of visual lines C
DirBe normal, do plane P
0To direction C up
UpProject to plane P
0On, obtain direction vector V
UpCross viewpoint position C
PosAlong direction V
UpBe straight line L
0Do 3 planes of intersecting with imaging curved surface Φ, these three planes are divided into 6 parts with a cylindricality imaging curved surface Φ, and the set on these 3 planes is plane set M; Plane among the plane set M satisfies condition: have and have only a public intersection, and this public intersection is straight line L
0Straight line L
0Each the plane separated into two parts among the M is gathered on the plane, formed 2*3 half-plane, the half-plane K that wherein intersects with imaging curved surface Φ
1, K
2..., K
6, half-plane K
iWith half-plane K
jThree dimensions is divided into two area of space, wherein half-plane K
iWith half-plane K
jThe area of space at the angular bisector place of the dihedral angle that constitutes is defined as R
IjSelect two half-plane K that intersect with imaging curved surface Φ
iWith half-plane K
j, satisfy condition: the subregion of imaging curved surface Φ belongs to area of space R
IjBelong to area of space R
IjThe subregion of imaging curved surface Φ be called imaging curved surface area Φ
IjHalf-plane K
iWith half-plane K
jThe dihedral angle that constitutes, and imaging curved surface area Φ
IjBe defined as the imaging space combination, be designated as Z{K
i, K
j, Φ
Ij.Select 3 imaging space combination: Z wherein
1{ K
1, K
3, Φ
13, Z
2{ K
3, K
5, Φ
35And Z
3{ K
5, K
1, Φ
51, be designated as S set, see Fig. 1.Any imaging space combination in the S set is satisfied: the dihedral angle in the imaging space combination is 120 degree, greater than 0 degree, less than 180 degree; Simultaneously S set satisfies condition: all imaging curved surface area unions that belong in the imaging space combination of set are Φ.
3) for any imaging space combination Z in the S set
i, cross viewpoint position C
PosBe a ray J
i, this ray is parallel with the dihedral angle angular bisector in the imaging space combination, crosses straight line L
0With ray J
iDo plane P
i, C
PosAlong plane P
iNormal negative direction translation distance d
IeyeA V is in/2 positions
Il, C
PosAlong plane P
iNormal positive direction translation distance d
IeyeA V is in/2 positions
Ir, carry out above-mentioned processing for each imaging space combination in the S set, obtain one group of some (see figure 2): V
1l, V
1r, V
2l, V
2r, V
3l, V
3r
4) for any imaging space combination Z in the S set
i, in using the OpenGL drawing process, camera parameter: with V
IlBe viewpoint position, direction of observation and imaging space combination Z
iIn dihedral angle angular bisector direction parallel, upwards direction is V
Up, the imaging curved surface is imaging space combination Z
iIn the imaging curved surface area, draw, obtain picture I
IlCarry out above-mentioned processing for each imaging space combination in the S set, obtain a group of pictures I
1l, I
2l, I
3l, this group of pictures has formed the left eye picture about camera C;
In carrying out drawing process, the imaging curved surface that OpenGL draws is a two-dimensional plane, in order to obtain imaging space combination Z
iIn the imaging curved surface on picture, after completing, picture is mapped on the cylinder imaging curved surface.
5) for any imaging space combination Z in the S set
i, in using the OpenGL drawing process, with V
IrBe viewpoint position, direction of observation and imaging space combination Z
iIn dihedral angle angular bisector direction parallel, direction V upwards
Up, the imaging curved surface is imaging space combination Z
iIn the imaging curved surface area, draw, obtain picture I
IrCarry out above-mentioned processing for each imaging space combination in the S set, obtain picture sequence I
1r, I
2r, I
3r, this group of pictures has formed the right eye picture about camera C.
In carrying out drawing process, the imaging curved surface that OpenGL draws is a two-dimensional plane, in order to obtain imaging space combination Z
iIn the imaging curved surface on picture, after completing, picture is mapped on the cylinder imaging curved surface.
Claims (1)
1. one kind is obtained the camera horizontal view angle greater than 180 o'clock right methods of generation right and left eyes picture, it is characterized in that its step is following:
1) in 3 d graphics system, the given three-dimensional scenic of user defines a camera C, and given camera parameter value, and the camera parameter value comprises: viewpoint position C
Pos, direction of visual lines C
Dir, direction C up
UpWith an imaging curved surface Φ, the curved surface Φ that wherein forms images satisfies condition: cross viewpoint position C
PosAny ray, curved surface Φ has only an intersection point at most with imaging, the parallax value d during the given again stereo display of user
Ieye
2) cross viewpoint position C
Pos, with direction of visual lines C
DirBe normal, do plane P
0, incite somebody to action direction C up
UpProject to plane P
0On, obtain direction vector V
Up, cross viewpoint position C
PosAlong direction vector V
UpBe straight line L
0, do m plane of intersecting with imaging curved surface Φ, the set on this m plane is plane set M, the plane among the plane set M satisfies condition: have and have only a public intersection, and this public intersection is straight line L
0, m is that the user is given more than or equal to 1 positive number, straight line L
0Each the plane separated into two parts among the M is gathered on the plane, formed 2*m half-plane, the half-plane K that wherein intersects with imaging curved surface Φ
1, K
2..., K
n, half-plane K
iWith half-plane K
jThree dimensions is divided into two area of space, wherein half-plane K
iWith half-plane K
jThe area of space at the angular bisector place of the dihedral angle that constitutes is defined as R
Ij, select two half-plane K that intersect with imaging curved surface Φ
iWith half-plane K
j, satisfy condition: the subregion of imaging curved surface Φ belongs to area of space R
IjBelong to area of space R
IjThe subregion of imaging curved surface Φ be called imaging curved surface area Ф
Ij, half-plane K
iWith half-plane K
jThe dihedral angle that constitutes, and imaging curved surface area Φ
IjBe defined as the imaging space combination; Select several imaging space combinations wherein, be designated as S set, the number of the imaging space combination in the S set is h; Any imaging space combination in the S set satisfies condition: the dihedral angle in the imaging space combination is greater than 0, less than 180; Simultaneously S set satisfies condition: all imaging curved surface area unions that belong in the imaging space combination of set are Φ;
3) for any imaging space combination Z in the S set
i, cross viewpoint position C
PosBe a ray J
i, ray J
iDihedral angle angular bisector with in the imaging space combination is parallel, crosses straight line L
0With ray J
iDo plane P
i, viewpoint position C
PosAlong plane P
iNormal negative direction translation distance a is a V in the position
Il, viewpoint position C
PosAlong plane P
iNormal positive direction translation distance b is a V in the position
Ir, a and b satisfy condition: a+b=d
Ieye, and a and b be positive number, carries out above-mentioned processing for each imaging space combination in the S set, obtains one group of point: V
1l, V
1r, V
2l, V
2r..., V
Nl, V
Nr
4) for any imaging space combination Z in the S set
i, with V
IlBe viewpoint position, direction of observation and imaging space combination Z
iIn dihedral angle angular bisector direction parallel, direction V upwards
Up, the imaging curved surface is imaging space combination Z
iIn the imaging curved surface area, draw, obtain picture I
Il, carry out above-mentioned processing for each imaging space combination in the S set, obtain a group of pictures I
1l..., I
Nl, this group of pictures has formed the left eye picture about camera C;
5) for any imaging space combination Z in the S set
i, with V
IrBe viewpoint position, direction of observation and imaging space combination Z
iIn dihedral angle angular bisector direction parallel, direction V upwards
Up, the imaging curved surface is imaging space combination Z
iIn the imaging curved surface area, draw, obtain picture I
Ir, carry out above-mentioned processing for each imaging space combination in the S set, obtain picture sequence I
1r..., I
Nr, this group of pictures has formed the right eye picture about camera C.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010102988760A CN102014291B (en) | 2010-09-30 | 2010-09-30 | Method for generating left-eye and right-eye picture pair at horizontal view angle of camera larger than 180 degrees |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010102988760A CN102014291B (en) | 2010-09-30 | 2010-09-30 | Method for generating left-eye and right-eye picture pair at horizontal view angle of camera larger than 180 degrees |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102014291A CN102014291A (en) | 2011-04-13 |
| CN102014291B true CN102014291B (en) | 2012-07-04 |
Family
ID=43844277
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010102988760A Expired - Fee Related CN102014291B (en) | 2010-09-30 | 2010-09-30 | Method for generating left-eye and right-eye picture pair at horizontal view angle of camera larger than 180 degrees |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102014291B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1917658A (en) * | 2006-08-01 | 2007-02-21 | 杭州镭星科技有限公司 | Method for generating sequence of stereo images from monocular image sequence |
| CN101605211A (en) * | 2009-07-23 | 2009-12-16 | 杭州镭星科技有限公司 | Virtual three-dimensional building and actual environment real scene shooting video there is not the method that is stitched into |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4854582B2 (en) * | 2007-04-25 | 2012-01-18 | キヤノン株式会社 | Image processing apparatus and image processing method |
-
2010
- 2010-09-30 CN CN2010102988760A patent/CN102014291B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1917658A (en) * | 2006-08-01 | 2007-02-21 | 杭州镭星科技有限公司 | Method for generating sequence of stereo images from monocular image sequence |
| CN101605211A (en) * | 2009-07-23 | 2009-12-16 | 杭州镭星科技有限公司 | Virtual three-dimensional building and actual environment real scene shooting video there is not the method that is stitched into |
Non-Patent Citations (2)
| Title |
|---|
| JP特开2008-276318A 2008.11.13 |
| 高俊鑫等.带约束的摄像机定标方法.《中国图象图形学报》.2010,第15卷(第3期),536-540页. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102014291A (en) | 2011-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4764305B2 (en) | Stereoscopic image generating apparatus, method and program | |
| CN104331918B (en) | Based on earth's surface occlusion culling and accelerated method outside depth map real-time rendering room | |
| US9495799B2 (en) | Image distortion correction system | |
| US9721385B2 (en) | Generation of three-dimensional imagery from a two-dimensional image using a depth map | |
| KR100679054B1 (en) | Apparatus and method for displaying three-dimensional image | |
| JP4489610B2 (en) | Stereoscopic display device and method | |
| US20120306860A1 (en) | Image generation system, image generation method, and information storage medium | |
| AU2018249563B2 (en) | System, method and software for producing virtual three dimensional images that appear to project forward of or above an electronic display | |
| CN103139580B (en) | A kind of three-dimensional panoramic space stereo image generation method | |
| US20090231331A1 (en) | System and method for displaying stereo images | |
| WO2015196791A1 (en) | Binocular three-dimensional graphic rendering method and related system | |
| US20130257864A1 (en) | Medial axis decomposition of 2d objects to synthesize binocular depth | |
| JP6017795B2 (en) | GAME PROGRAM, GAME DEVICE, GAME SYSTEM, AND GAME IMAGE GENERATION METHOD | |
| JP2002073003A (en) | Stereoscopic image forming device and information storage medium | |
| CN104240281A (en) | Virtual reality head-mounted device based on Unity3D engine | |
| CN106993179A (en) | A kind of method that 3D models turn three-dimensional double vision point view | |
| CN104284177A (en) | Convergence stereo image parallax control method | |
| CN104299258A (en) | Solid figure processing method and equipment | |
| CN102014291B (en) | Method for generating left-eye and right-eye picture pair at horizontal view angle of camera larger than 180 degrees | |
| US10110876B1 (en) | System and method for displaying images in 3-D stereo | |
| JP6200316B2 (en) | Image generation method, image generation apparatus, and image generation program | |
| JP6181549B2 (en) | Image generation method, image generation apparatus, and image generation program | |
| JP6042732B2 (en) | Image generation method, image generation apparatus, and image generation program | |
| Hoang et al. | Real-time stereo rendering technique for virtual reality system based on the interactions with human view and hand gestures | |
| Yanaka | Real-time rendering for integral photography that uses extended fractional view |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120704 Termination date: 20160930 |