CN101000688A - Method for automatic photomotage of multi-face - Google Patents

Method for automatic photomotage of multi-face Download PDF

Info

Publication number
CN101000688A
CN101000688A CN 200710066716 CN200710066716A CN101000688A CN 101000688 A CN101000688 A CN 101000688A CN 200710066716 CN200710066716 CN 200710066716 CN 200710066716 A CN200710066716 A CN 200710066716A CN 101000688 A CN101000688 A CN 101000688A
Authority
CN
China
Prior art keywords
face
photo
color
people
distribution
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200710066716
Other languages
Chinese (zh)
Other versions
CN100514365C (en
Inventor
陈纯
卜佳俊
庞晨
宋明黎
王栋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University ZJU
Original Assignee
Zhejiang University ZJU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University ZJU filed Critical Zhejiang University ZJU
Priority to CNB2007100667161A priority Critical patent/CN100514365C/en
Publication of CN101000688A publication Critical patent/CN101000688A/en
Application granted granted Critical
Publication of CN100514365C publication Critical patent/CN100514365C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

A method for automatically synthesizing multi-sheet of human face photograph includes positioning human face position in each inputted photograph preliminarily, accurately labeling outline and facial features by utilizing multiple constraint of positioned total or partial information of human face, carrying out color regulation automatically on each photograph to obtain unified color, utilizing deformation algorithm and interpolation synthesis of each pixel color to obtain a sheet of human face photograph with characters of each inputted photograph clearly and truly.

Description

Method for automatic photomotage of multi-face
Technical field
The present invention relates to people's face and detect, feature point tracking, technical field such as many images are synthetic particularly relates to a kind of automatic synthesis method of many human face photos.
Background technology
Along with the development of computer vision and the rapid raising of hardware speed, the theory of part computer vision, method have reached the level of carrying out practical application under the common hardware condition.In recent years, some business software and services based on computer vision engender, and promote to masses.Method of the present invention has been utilized just at the more people's face of computer vision field research and has been detected and feature point tracking, realizes the synthetic of many human face photos.
People's face detects and the tracking of human face characteristic point is that one of computer vision field does not improve the problem that solves as yet, is again the important technology during recognition of face, Expression Recognition etc. are used.Not its objective is having and detect the people's face in photo or the video automatically, and further accurately mark out the position of people's various unique points on the face, as eye socket, nose, lip or the like under the artificial auxiliary condition.Wherein people's face detects and only requires in judgement photo or the video that nobody's face is arranged, and roughly judges the scope of people's face region under the situation that people's face is arranged.This technology less demanding because of to output handled simply relatively, and current had the very high and speed of success ratio to reach real-time method.Human face characteristic point is followed the tracks of usually and is detected based on people's face, further marks the exact position of unique point, and this process is difficulty relatively, success ratio is low and need expend the more time, but fix in input photo form, quality is not under the too poor situation, can reach requirement of actual application.Find (T.Cootes, G.Edwards such as T.Cootes through research and experiment to existing document, C.Taylor, " ActiveAppearance Models ", IEEE Transactions on Pattern Analysis and MachineIntelligence, vol 23, no.6, pp.681-685, June, 2001) the AAM model that proposes, after adding the Local Search constraint, can reach application requirements.
The synthetic anamorphose problem that then relates to of human face photo.For individual picture, after demarcating some unique points, change the position of Partial Feature point, can pass through deformation algorithm, the rule that the pixel basis around the unique point is certain is mobile jointly with unique point, and what obtain is still the picture that a Zhang Ping is slided.For two or many similar pictures, human face photo as different people, demarcate abundant unique point, and make the position of unique point corresponding in each picture, by aforesaid deformation algorithm all pictures are out of shape again, make the unique point of each photo move to the same position of same yardstick, at this moment the pixel of being out of shape each picture of back is averaged, can obtain a clear photograph.This photo has been inherited the feature from each input photo.
Summary of the invention
The object of the present invention is to provide a kind of method for automatic photomotage of multi-face.
The technical scheme that the present invention solves its technical matters is as follows:
1. the step of a method for automatic photomotage of multi-face is as follows:
(1) at first the people's face in the input photo is carried out Primary Location, demarcation comprises the rectangular area of people's face, and abandons the other parts of photo;
(2) in the rectangular area of step (1) location, carry out human face characteristic point and follow the tracks of, the local result who follows the tracks of of comprehensive utilization global follow and face, the unique point of accurately demarcating people's face outline and face;
(3) in people's face outline that step (2) is demarcated, carrying out color adaptation, is benchmark with a default average color, the COLOR COMPOSITION THROUGH DISTRIBUTION that rule of thumb obtains, the shade of color of photo is adjusted near this reference color, made each photo tone unanimity, do not have too big difference;
(4) each that import in the photo is opened, all execution in step (1) is to (3);
(5) calculate the weighted mean of each picture tracking results in step (2);
(6) with each input photograph deformation, the unique point that each photo is demarcated in step (2) moves in the step (5) and obtains on the average;
(7) generate picture as a result, its pixel color is the weighted mean value of respective pixel in each input picture.
2. step (1) executor's face on photo detects, and after demarcation comprises the rectangular area of people's face, picture is carried out cutting, only keeps inside, rectangular area.
3. step (2) fully utilizes the unique point of global follow and the local track and localization people of face face, be meant: behind the position of estimation face, independent tracking pairs of eyes, nose and mouth, tracking results is compared with the global follow result, with good being as the criterion of result, demarcate the position of unique point on people's face outline and the face, each point coordinate is stored in the vectorial s that represents this photo character shape, and it is defined as follows:
S k = x k y k
Wherein
x k, y kBe the position relative coordinate of k unique point on photo.
4. the used experience COLOR COMPOSITION THROUGH DISTRIBUTION of step (3), be meant the pivot analysis that some standard faces photo COLOR COMPOSITION THROUGH DISTRIBUTION are done, get wherein three pivots, then to concentrate among the space S c that these three pivots support with the average color be in the ellipsoid zone, center to face's COLOR COMPOSITION THROUGH DISTRIBUTION.
5. the color adaptation done of step (3) is meant the space S of the color conversion in the input photo human face region to experience COLOR COMPOSITION THROUGH DISTRIBUTION place cOn, constraining in its distribution with default average color by mapping function again is in the ellipsoid zone of experience COLOR COMPOSITION THROUGH DISTRIBUTION at center; Wherein default average color is meant with to some standard faces photo COLOR COMPOSITION THROUGH DISTRIBUTION the time average color that calculates.
6. step (6) will be imported photograph deformation, width of cloth length and width that obtain and the artificial identical photo of setting of output photo length and width, any pixel p[x among this result, y], on former picture, have exist a corresponding point p ' [x ', y '], the color of this pixel is identical with its corresponding point, and the corresponding point position is calculated by following formula:
Figure A20071006671600061
Wherein
N is the unique point number,
s kBe k element in the weighted mean value of each photo character shape vector,
S ' kBe k element of the character shape vector of former photo,
Figure A20071006671600062
Be that former photo mid point p is to vector
Figure A20071006671600063
Distance.
7. in the photo as a result that step (7) generates, each pixel color is the weighted mean value of pixel color on the same position in each deformation result of obtaining of step (6).
The present invention compares with background technology, and the useful effect that has is:
Whole process is automatically carried out, and need not manually assist, and can apply to the hardware adaptor simple environment.Simultaneously, the face as a result that program produces are clear, and color is even, can not cause because of the factor of the colour of skin and illumination usually to have the color abnormal area among the result.Tracking is because of having adopted local tracking and the whole method that combines, the success ratio height followed the tracks of.Following the tracks of successfully, the result under the situation, ghost image can not occur among the synthetic result accurately.
Description of drawings
Accompanying drawing is a key step process flow diagram of the present invention.
Embodiment
Below in conjunction with concrete enforcement technical scheme of the present invention is described further.
Enforcement has adopted the human face photo of actual photographed as the training storehouse, makes up the AAM model, and this is to carry out following technical proposals preliminary work before.
The specific implementation flow process of technical scheme is as follows:
1) at first the people's face in the input photo is carried out Primary Location, demarcation comprises the rectangular area of people's face, and abandons the other parts of photo.This step detects with the Adaboost face of conducting oneself the input photo, finds out rectangular area, people's face place, and people's face edge is not close in this zone, and comparable people's face is big slightly, but guarantees people's face is included in the zone.Comparison film is reduced, a rectangular area of arriving that keeps, and the photo that obtains enters subsequent treatment.If bigger non-face zone is arranged in the photo, then this step reduction effect is obvious.People's face in this step respective figure detects.
2) in the rectangular area of step 1) location, carry out human face characteristic point and follow the tracks of, the local result who follows the tracks of of comprehensive utilization global follow and face, the unique point of accurately demarcating people's face outline and face.For the picture that step 1) obtains, estimate the approximate location that each face may occur earlier, in the scope of estimation, utilize the AAM model of each face that obtains at precondition, detect face separately.The result who detects utilizes overall AAM data to do global detection as initial estimate again, obtains the exact position of facial contour and face unique point.Each unique point coordinate of picture is stored among the vectorial s, and it is defined as follows:
s k = x k y k
Wherein
x k, y kBe the position relative coordinate of k unique point on photo.Feature point tracking in this step respective figure 1.
3) in step 2) in people's face outline of demarcating, carry out color adaptation, be benchmark with a default average color, the COLOR COMPOSITION THROUGH DISTRIBUTION that rule of thumb obtains, the shade of color of photo is adjusted near this reference color, made each photo tone unanimity, do not have too big difference.The foundation of this step is, finds the color conversion of normal human face photo S in the space of first three pivot formation in the process of the COLOR COMPOSITION THROUGH DISTRIBUTION of a large amount of standard faces photos being carried out pivot analysis cAfter, concentrate on an ellipsoid zone.For the input photo, existing color conversion with its pixel arrives same space S cOn, by mapping function its distribution is constrained in the ellipsoid zone of experience COLOR COMPOSITION THROUGH DISTRIBUTION again, and be central point with the average color of the standard faces photo being carried out obtain in the pivot analysis.The purpose of this step is to allow the tone basically identical of each secondary picture, otherwise it is inhomogeneous to occur color easily when synthesizing in subsequent step.Color adjustment in this step respective figure 1.
4) to each input photo execution in step 1) to 3).
5) obtain weighted mean value from each character shape vector that obtains
Figure A20071006671600072
6) with each input photograph deformation, make each photo in step 2) in the unique point of demarcation, move in the step 5) and obtain on the average.Be meant,, the unique point of each photo moved to average with deformation algorithm to every input photo
Figure A20071006671600073
On, and to unify same scale.The implementation method of this process is, for an input photo I ', sets up new photo I, and length and width are preset value.For each the pixel p[x among the I, y], on former picture, calculate corresponding point p ' [x ', y '], with pixel p[x, y] color be made as identical with p ' [x ', y '].The computing formula of correspondence position is:
Figure A20071006671600074
Wherein:
N is the unique point number,
s kBe k element in the weighted mean value of each photo character shape vector,
S ' kBe k element of the character shape vector of former photo,
Be that former photo mid point p is to vector Distance.
This formula has kept the position relation of the line segment that the continuous unique point of this pixel and two constitutes, and is weight with the inverse of putting the disconnected distance of line, to from each line segment to the position make weighted mean.Deformation algorithm in this step respective figure 1.
7) in the photo as a result of Sheng Chenging, its pixel color is the weighted mean value of respective pixel in each input picture.Be meant that each pixel color is the weighted mean value of pixel color on the same position in each deformation result of obtaining of step 6).The result that obtains because of step 6) is the wide identical picture of a group leader, sets up an onesize picture, and wherein the color of each pixel is the weighted mean value of each picture in the pixel color of same coordinate.Weight can artificially be set according to concrete enforcement needs, influences proportion to determine each secondary input photo in the result.Synthetic result in this step respective figure 1.

Claims (7)

1. method for automatic photomotage of multi-face is characterized in that the step of this method is as follows:
(1) at first the people's face in the input photo is carried out Primary Location, demarcation comprises the rectangular area of people's face, and abandons the other parts of photo;
(2) in the rectangular area of step (1) location, carry out human face characteristic point and follow the tracks of, the local result who follows the tracks of of comprehensive utilization global follow and face, the unique point of accurately demarcating people's face outline and face;
(3) in people's face outline that step (2) is demarcated, carrying out color adaptation, is benchmark with a default average color, the COLOR COMPOSITION THROUGH DISTRIBUTION that rule of thumb obtains, the shade of color of photo is adjusted near this reference color, made each photo tone unanimity, do not have too big difference;
(4) each that import in the photo is opened, all execution in step (1) is to (3);
(5) calculate the weighted mean of each picture tracking results in step (2);
(6) with each input photograph deformation, the unique point that each photo is demarcated in step (2) moves in the step (5) and obtains on the average;
(7) generate picture as a result, its pixel color is the weighted mean value of respective pixel in each input picture.
2. a kind of method for automatic photomotage of multi-face according to claim 1 is characterized in that: step (1) executor's face on photo detects, and after demarcation comprises the rectangular area of people's face, picture is carried out cutting, only keeps inside, rectangular area.
3. a kind of method for automatic photomotage of multi-face according to claim 1, it is characterized in that: the unique point of step (2) comprehensive utilization global follow and the local track and localization people of face face, be meant: behind the position of estimation face, independent tracking pairs of eyes, nose and mouth, tracking results is compared with the global follow result, with good being as the criterion of result, demarcates the position of unique point on people's face outline and the face, each point coordinate is stored in the vectorial s that represents this photo character shape, and it is defined as follows:
s k = x k y k
Wherein
x k, y kBe the position relative coordinate of k unique point on photo.
4. a kind of method for automatic photomotage of multi-face according to claim 1, it is characterized in that: the experience COLOR COMPOSITION THROUGH DISTRIBUTION that step (3) is used, be meant the pivot analysis that some standard faces photo COLOR COMPOSITION THROUGH DISTRIBUTION are done, get wherein three pivots, then to concentrate among the space S c that these three pivots support with the average color be in the ellipsoid zone, center to face's COLOR COMPOSITION THROUGH DISTRIBUTION.
5. a kind of method for automatic photomotage of multi-face according to claim 1 is characterized in that: the color adaptation that step (3) is done is meant the space S of the color conversion in the input photo human face region to experience COLOR COMPOSITION THROUGH DISTRIBUTION place cOn, constraining in its distribution with default average color by mapping function again is in the ellipsoid zone of experience COLOR COMPOSITION THROUGH DISTRIBUTION at center; Wherein default average color is meant with to some standard faces photo COLOR COMPOSITION THROUGH DISTRIBUTION the time average color that calculates.
6. a kind of method for automatic photomotage of multi-face according to claim 1, it is characterized in that: step (6) will be imported photograph deformation, width of cloth length and width that obtain and the artificial identical photo of setting of output photo length and width, any pixel p[x among this result, y], on former picture, have to have a corresponding point p ' [x ', y '], the color of this pixel is identical with its corresponding point, and the corresponding point position is calculated by following formula:
p ′ = 1 N Σ k 1 dist ( p , s k s k + 1 ‾ ) ( p - s k + s k ′ )
Wherein
N is the unique point number,
s kBe k element in the weighted mean value of each photo character shape vector,
S ' kBe k element of the character shape vector of former photo,
Figure A2007100667160003C2
Be that former photo mid point p is to vector
Figure A2007100667160003C3
Distance.
7. a kind of method for automatic photomotage of multi-face according to claim 1, it is characterized in that: in the photo as a result that step (7) generates, each pixel color is the weighted mean value of pixel color on the same position in each deformation result of obtaining of step (6).
CNB2007100667161A 2007-01-15 2007-01-15 Method for automatic photomotage of multi-face Expired - Fee Related CN100514365C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2007100667161A CN100514365C (en) 2007-01-15 2007-01-15 Method for automatic photomotage of multi-face

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2007100667161A CN100514365C (en) 2007-01-15 2007-01-15 Method for automatic photomotage of multi-face

Publications (2)

Publication Number Publication Date
CN101000688A true CN101000688A (en) 2007-07-18
CN100514365C CN100514365C (en) 2009-07-15

Family

ID=38692646

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2007100667161A Expired - Fee Related CN100514365C (en) 2007-01-15 2007-01-15 Method for automatic photomotage of multi-face

Country Status (1)

Country Link
CN (1) CN100514365C (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101964874A (en) * 2009-07-23 2011-02-02 卡西欧计算机株式会社 Image processing apparatus and image processing method
CN101789135B (en) * 2009-01-23 2012-05-30 广州市设计院 Portrait presenting method based on historical photograph/picture
CN102486868A (en) * 2010-12-06 2012-06-06 华南理工大学 Average face-based beautiful face synthesis method
CN102870123A (en) * 2010-06-15 2013-01-09 苹果公司 Object detection metadata
CN103218775A (en) * 2013-05-13 2013-07-24 苏州华漫信息服务有限公司 Method of changing faces in portrait photos
CN103824269A (en) * 2012-11-16 2014-05-28 广州三星通信技术研究有限公司 Face special-effect processing method and system
CN105407275A (en) * 2015-10-30 2016-03-16 努比亚技术有限公司 Photo synthesizing device and method
CN105468361A (en) * 2015-11-17 2016-04-06 小米科技有限责任公司 Head portrait generation method and device
CN105718885A (en) * 2016-01-20 2016-06-29 南京邮电大学 Human face characteristic point tracking method
CN105956997A (en) * 2016-04-27 2016-09-21 腾讯科技（深圳）有限公司 Image deformation treatment method and device
CN106156730A (en) * 2016-06-30 2016-11-23 腾讯科技（深圳）有限公司 The synthetic method of a kind of facial image and device
CN106157235A (en) * 2015-04-03 2016-11-23 阿里巴巴集团控股有限公司 Picture synthetic method, device and instant communicating method, picture synthesis server
CN106326823A (en) * 2015-07-07 2017-01-11 北京神州泰岳软件股份有限公司 Method and system for acquiring head image in picture
CN104156938B (en) * 2013-05-14 2017-08-11 五邑大学 A kind of image connectivity region description method and its application process in image registration
WO2018098860A1 (en) * 2016-11-29 2018-06-07 北京小米移动软件有限公司 Photograph synthesis method and apparatus
CN108710853A (en) * 2018-05-21 2018-10-26 深圳市梦网科技发展有限公司 Face identification method and device
CN113050428A (en) * 2021-03-26 2021-06-29 清华大学 Position pivot element contour tracking algorithm based on time-varying internal model

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101789135B (en) * 2009-01-23 2012-05-30 广州市设计院 Portrait presenting method based on historical photograph/picture
CN101964874A (en) * 2009-07-23 2011-02-02 卡西欧计算机株式会社 Image processing apparatus and image processing method
CN101964874B (en) * 2009-07-23 2013-07-24 卡西欧计算机株式会社 Image processing apparatus and image processing method
CN102870123A (en) * 2010-06-15 2013-01-09 苹果公司 Object detection metadata
CN102486868A (en) * 2010-12-06 2012-06-06 华南理工大学 Average face-based beautiful face synthesis method
CN103824269A (en) * 2012-11-16 2014-05-28 广州三星通信技术研究有限公司 Face special-effect processing method and system
CN103824269B (en) * 2012-11-16 2017-03-29 广州三星通信技术研究有限公司 Face effect processing method and system
CN103218775A (en) * 2013-05-13 2013-07-24 苏州华漫信息服务有限公司 Method of changing faces in portrait photos
CN104156938B (en) * 2013-05-14 2017-08-11 五邑大学 A kind of image connectivity region description method and its application process in image registration
CN106157235A (en) * 2015-04-03 2016-11-23 阿里巴巴集团控股有限公司 Picture synthetic method, device and instant communicating method, picture synthesis server
US10388051B2 (en) 2015-04-03 2019-08-20 Alibaba Group Holding Limited Picture synthesis method and apparatus, instant communication method, and picture synthesis server
CN106326823A (en) * 2015-07-07 2017-01-11 北京神州泰岳软件股份有限公司 Method and system for acquiring head image in picture
CN105407275A (en) * 2015-10-30 2016-03-16 努比亚技术有限公司 Photo synthesizing device and method
CN105407275B (en) * 2015-10-30 2019-03-22 努比亚技术有限公司 Photo synthesizer and method
CN105468361A (en) * 2015-11-17 2016-04-06 小米科技有限责任公司 Head portrait generation method and device
CN105718885B (en) * 2016-01-20 2018-11-09 南京邮电大学 A kind of Facial features tracking method
CN105718885A (en) * 2016-01-20 2016-06-29 南京邮电大学 Human face characteristic point tracking method
CN105956997A (en) * 2016-04-27 2016-09-21 腾讯科技（深圳）有限公司 Image deformation treatment method and device
CN105956997B (en) * 2016-04-27 2019-07-05 腾讯科技（深圳）有限公司 The method and apparatus of image deformation processing
US10691927B2 (en) 2016-04-27 2020-06-23 Tencent Technology (Shenzhen) Company Limited Image deformation processing method and apparatus, and computer storage medium
CN106156730B (en) * 2016-06-30 2019-03-15 腾讯科技（深圳）有限公司 A kind of synthetic method and device of facial image
CN106156730A (en) * 2016-06-30 2016-11-23 腾讯科技（深圳）有限公司 The synthetic method of a kind of facial image and device
WO2018098860A1 (en) * 2016-11-29 2018-06-07 北京小米移动软件有限公司 Photograph synthesis method and apparatus
CN108710853A (en) * 2018-05-21 2018-10-26 深圳市梦网科技发展有限公司 Face identification method and device
CN108710853B (en) * 2018-05-21 2021-01-01 深圳市梦网科技发展有限公司 Face recognition method and device
CN113050428A (en) * 2021-03-26 2021-06-29 清华大学 Position pivot element contour tracking algorithm based on time-varying internal model
CN113050428B (en) * 2021-03-26 2021-12-07 清华大学 Position pivot element contour tracking algorithm based on time-varying internal model

Also Published As

Publication number Publication date
CN100514365C (en) 2009-07-15

Similar Documents

Publication Publication Date Title
CN100514365C (en) Method for automatic photomotage of multi-face
US10169905B2 (en) Systems and methods for animating models from audio data
CN101964064B (en) Human face comparison method
CN101968846B (en) Face tracking method
US8306283B2 (en) Focus enhancing method for portrait in digital image
CN101499128B (en) Three-dimensional human face action detecting and tracing method based on video stream
CN103824050B (en) A kind of face key independent positioning method returned based on cascade
EP2706507B1 (en) Method and apparatus for generating morphing animation
CN108345869A (en) Driver's gesture recognition method based on depth image and virtual data
CN107895160A (en) Human face detection and tracing device and method
US20130044958A1 (en) Methods and Apparatus for Automated Facial Feature Localization
CN107316333B (en) A method of it automatically generates and day overflows portrait
CN100389430C (en) AAM-based head pose real-time estimating method and system
WO2014093706A1 (en) Generation of a three-dimensional representation of a user
CN102567716B (en) Face synthetic system and implementation method
CN101770649A (en) Automatic synthesis method for facial image
CN102654903A (en) Face comparison method
MX2013002904A (en) Person image processing apparatus and person image processing method.
CN102027505A (en) Automatic face and skin beautification using face detection
CN105426882B (en) The method of human eye is quickly positioned in a kind of facial image
CN105069745A (en) face-changing system based on common image sensor and enhanced augmented reality technology and method
JP2018535457A (en) Statistical method and apparatus for passersby based on identification of human head top
CN111079625A (en) Control method for camera to automatically rotate along with human face
US20050074148A1 (en) Face tracking
CN103544478A (en) All-dimensional face detection method and system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090715

Termination date: 20160115

EXPY Termination of patent right or utility model