CN103108124B - Image acquiring method, device and mobile terminal - Google Patents

Image acquiring method, device and mobile terminal Download PDF

Info

Publication number
CN103108124B
CN103108124B CN201210586002.4A CN201210586002A CN103108124B CN 103108124 B CN103108124 B CN 103108124B CN 201210586002 A CN201210586002 A CN 201210586002A CN 103108124 B CN103108124 B CN 103108124B
Authority
CN
China
Prior art keywords
image
landscape
mark
personage
photographer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201210586002.4A
Other languages
Chinese (zh)
Other versions
CN103108124A (en
Inventor
任慧
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Ding Electronic Technology (group) Co Ltd
Original Assignee
Shanghai Ding Electronic Technology (group) Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Ding Electronic Technology (group) Co Ltd filed Critical Shanghai Ding Electronic Technology (group) Co Ltd
Priority to CN201210586002.4A priority Critical patent/CN103108124B/en
Publication of CN103108124A publication Critical patent/CN103108124A/en
Application granted granted Critical
Publication of CN103108124B publication Critical patent/CN103108124B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

Present invention is disclosed a kind of image acquiring method, device and mobile terminal.The image processing method may include:The landscape that camera lens is taken in is identified, and extracts the mark for having recognized landscape;Selection according to photographer to mark, retains and identifies the landscape associated with selected;After shooting is performed, generation retains the image of landscape.The present invention can by the identification to personage in taking lens, and provide identification character face's feature give photographer selection, generation image in retain the selected personage of photographer so that photographer can easily obtain required for shooting image.

Description

Image acquiring method, device and mobile terminal
Technical field
The present invention relates to image processing techniques, a kind of image acquiring method, device and mobile terminal are especially related to.
Background technology
Electronic equipment is used in the prior art(Such as digital camera or mobile phone etc.)Taken pictures, obtain content in image It is exactly whole landscapes that camera lens can be obtained when shooting.But sometimes photographer may be only wanted to the part landscape in camera lens Retain in the picture.Especially in some tourist attractions or business district, often People are hurrying to and fro, it is desirable to claps an image souvenir and also becomes One difficult matter, it is easy to other visitors are clapped the overall effect of influence of entering.
The content of the invention
The main object of the present invention is provides a kind of image acquiring method, and the landscape that can choose needs is shot, and is lifted Image effect.
The present invention proposes a kind of image acquiring method, including:
The landscape that camera lens is taken in is identified, and extracts the mark for having recognized landscape;
Selection according to photographer to mark, retains and identifies the landscape associated with selected;
After shooting is performed, generation retains the image of landscape.
Preferably, it is described that the landscape that camera lens is taken in is identified, and it is specific to extract the step of having recognized the mark of landscape Including:
Under cleaning pattern of taking pictures, personage's overall profile that camera lens is taken in is identified, and extract character face's conduct The mark of personage's overall profile.
Preferably, the selection according to photographer to mark, the step of retaining the landscape associated with selected mark, is specific Including:
When there is multiple face identifications, being supplied to photographer to be selected the multiple face identification, will not be chosen The personage's overall profile for selecting face identification association is rejected from image and allows to perform shooting again.
Preferably, also include after described image processing method:
The part rejected in image is replaced using background image.
The present invention also proposes a kind of image acquiring device, including:
Landscape identification module, for the landscape that camera lens is taken in be identified, and extracts the mark for having recognized landscape;
Selecting module is shot, for the selection according to photographer to mark, retains and identifies the landscape associated with selected;
Image generation module, for after shooting is performed, generation to retain the image of landscape.
Preferably, the landscape identification module specifically for:
Under cleaning pattern of taking pictures, personage's overall profile that camera lens is taken in is identified, and extract character face's conduct The mark of personage's overall profile.
Preferably, it is described shooting selecting module specifically for:
When there is multiple face identifications, being supplied to photographer to be selected the multiple face identification, will not be chosen The personage's overall profile for selecting face identification association is rejected from image and allows to perform shooting again.
Preferably, described image processing unit also includes:
Image complementary module, for the part rejected in image to be replaced using background image.
The present invention also proposes a kind of mobile terminal, including:
Landscape identification module, for the landscape that camera lens is taken in be identified, and extracts the mark for having recognized landscape;
Selecting module is shot, for the selection according to photographer to mark, retains and identifies the landscape associated with selected;
Image generation module, for after shooting is performed, generation to retain the image of landscape.
Preferably, the landscape identification module specifically for:
Under cleaning pattern of taking pictures, personage's overall profile that camera lens is taken in is identified, and extract character face's conduct The mark of personage's overall profile.
Preferably, it is described shooting selecting module specifically for:
When there is multiple face identifications, being supplied to photographer to be selected the multiple face identification, will not be chosen The personage's overall profile for selecting face identification association is rejected from image and allows to perform shooting again.
Preferably, the mobile terminal also includes:
Image complementary module, for the part rejected in image to be replaced using background image.
The present invention can by the identification to personage in taking lens, and provide identification character face's feature give photographer choosing Select, retain the selected personage of photographer in generation image, so that the image that photographer shoots required for can easily obtaining.
Brief description of the drawings
Fig. 1 is the step schematic flow sheet in the embodiment of image acquiring method one of the present invention;
Fig. 2 is the step schematic flow sheet in another embodiment of image acquiring method of the present invention;
Fig. 3 is the structural representation in the embodiment of image acquiring device one of the present invention;
Fig. 4 is the structural representation in another embodiment of image acquiring device of the present invention;
Fig. 5 is the structural representation in the embodiment of mobile terminal one of the present invention.
The realization, functional characteristics and advantage of the object of the invention will be described further referring to the drawings in conjunction with the embodiments.
Embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
Reference picture 1, proposes a kind of embodiment of image acquiring method one of the invention.The image processing method may include:
Step S11, the landscape to camera lens intake are identified, and extract the mark for having recognized landscape;
Step S12, the selection according to photographer to mark, retain and identify the landscape associated with selected;
Step S13, perform shoot after, generation retain landscape image.
Above-mentioned steps S11 may particularly include:Under cleaning pattern of taking pictures, personage's overall profile that camera lens is taken in is known Not, and mark of the character face as personage's overall profile is extracted.Before image taking, the selection of screening-mode can be carried out, Than if desired for realizing that cleaning pattern of taking pictures may be selected in scheme in the present embodiment.
Above-mentioned character contour feature is used as a kind of one of inherent important clue that shape facility is human body behavior.Institute of the present invention The contour feature used, which describes method, has star-like skeleton technique, Fourier to describe operator etc..Fourier describes operator coefficient Low frequency part describes the general characteristics of profile, and the microscopic feature of profile is reflected with HFS.The present invention is in above two wheel On the basis of wide description method, also by the profile described function of boundary point-radius, the local feature of profile is described with Analysis, can to blocking, loss of data and robustness is stronger situations such as deformation.
The character contour of the present invention is extracted to be comprised the following steps with pretreatment:Image denoising, target detection and background segment, Shadow removal and contours extract.Image denoising refer to remove obtain and transmit image when by various noise jammings, and this A little noise jammings can bring very big inconvenience to subsequent treatment, and visual perception is also influenceed to a certain extent.In order to improve image Quality and it is easy to various subsequent treatments, image denoising of the invention uses the method that gaussian filtering and neighborhood denoising are combined. The target detection of the present invention comprises the following steps with background segment:Motion people in video sequence is detected using background subtraction Body, initially sets up the background model of an adaptive change with time and spatial variations, then by present frame and background model Difference is carried out, given threshold, binarization segmentation image obtains foreground and background.The shadow removal of the present invention comprises the following steps: Remove when detecting moving target, the merging of the moving target caused, geometry deformation, and the data that target is lost.The present invention Contours extract comprise the following steps:Using based on connective edge following algorithm, personage in whole image sequence is extracted Profile.
Above-mentioned steps S12 may particularly include:When there is multiple face identifications, the multiple face identification is supplied to bat The person of taking the photograph is selected, and personage's overall profile that not selected face identification is associated is rejected from image to be allowed to perform shooting again.
When camera lens take in landscape in identify there is multiple personages when, can extract the plurality of personage facial characteristics displaying To photographer, it is to need to be retained in the image ultimately generated to select which personage for photographer, so as to retain The landscape taken in from camera lens of personage in reject.So that after photographer presses shutter execution shooting, can in the image of the shooting Retain the selected character image of photographer and shooting background image etc., and non-selected character image is then from landscape Reject, will not be embodied in the image graph picture of the shooting.
Reference picture 2, in another embodiment of the invention, may also include after above-mentioned steps S13:
Step S14, the part rejected in image replaced using background image.
After above-mentioned non-selected character image is rejected from image, the image of the image will appear from the feelings of excalation Condition, will so influence image effect.The background image that can have entered camera lens by interception in the present embodiment is filled to the lack part, Or the lack part is filled up according to the background image as the background image of camera lens rebuilds the lack part so that image will not Whole structure is influenceed because there is excalation.
Above-mentioned image acquiring method, can be by the identification to personage in taking lens, and it is special to provide the character face of identification Levy and give photographer's selection, retain the selected personage of photographer in generation image, so that needed for photographer can easily obtain The image to be shot.
Reference picture 3, proposes a kind of embodiment of image acquiring device 20 1 of the invention.The image processing apparatus 20 may include: Landscape identification module 21, shooting selecting module 22 and image generation module 23;The landscape identification module 21, for being taken the photograph to camera lens The landscape entered is identified, and extracts the mark for having recognized landscape;The shooting selecting module 22, for according to photographer to mark Selection, retain and the selected landscape that associates of mark;The image generation module 23, for after shooting is performed, generation to retain scape The image of sight.
Above-mentioned landscape identification module 21 can be specifically for:Under cleaning pattern of taking pictures, the personage's monolithic wheel taken in camera lens Exterior feature is identified, and extracts mark of the character face as personage's overall profile.Before image taking, screening-mode can be carried out Selection, than if desired for realizing that cleaning pattern of taking pictures may be selected in scheme in the present embodiment.
Above-mentioned character contour feature is used as a kind of one of inherent important clue that shape facility is human body behavior.Conventional wheel Wide character description method has star-like skeleton technique, Fourier descriptors etc..Fourier describes operator and retouched with the low frequency part of coefficient The general characteristics of profile are stated, the microscopic feature of profile is reflected with HFS.The basis of method is described in above two profile On, a kind of profile described function for being referred to as boundary point-radius of definable is gone back, the local feature of profile can be described with dividing Analysis, to blocking, loss of data and robustness is stronger situations such as deformation.
Character contour extracts as follows with pre-treatment step:Image denoising, target detection and background segment, shadow removal and Contours extract.The image denoising:Video sequence often can be by various noise jammings in acquisition and transmission, and these noises can be given Subsequent treatment brings very big inconvenience, and visual perception is also influenceed to a certain extent.In order to improve picture quality and be easy to each Plant subsequent treatment, it is proposed that the method for many removal noises, algorithm uses the method that gaussian filtering and neighborhood denoising are combined.Should Target detection and background segment:Movement human in video sequence is detected using background subtraction, one is initially set up with the time With the background model of spatial variations and adaptive change, present frame and background model are then subjected to difference, given threshold, two-value Change segmentation figure picture and obtain foreground and background.The shadow removal:When detecting moving target, the shade of moving target projection can also be detected For a part for sport foreground, merging, the geometry deformation of moving target are caused, or even loses target.The contours extract:Using Based on connective edge following algorithm, the profile for extracting pedestrian in whole image sequence is obtained.
Above-mentioned shooting selecting module 22 can be specifically for:When there is multiple face identifications, by the multiple face identification It is supplied to photographer to be selected, personage's overall profile that not selected face identification is associated is rejected from image to be allowed to hold again Row is shot.
When camera lens take in landscape in identify there is multiple personages when, can extract the plurality of personage facial characteristics displaying To photographer, it is to need to be retained in the image ultimately generated to select which personage for photographer, so as to retain The landscape taken in from camera lens of personage in reject.So that after photographer presses shutter execution shooting, can in the image of the shooting Retain the selected character image of photographer and shooting background image etc., and non-selected character image is then from landscape Reject, will not be embodied in the image graph picture of the shooting.
Reference picture 4, in an alternative embodiment of the invention, above-mentioned image processing apparatus 20 may also include:Image complementary module 24, for the part rejected in image to be replaced using background image.
After above-mentioned non-selected character image is rejected from image, the image of the image will appear from the feelings of excalation Condition, will so influence image effect.The background image that can have entered camera lens by interception in the present embodiment is filled to the lack part, Or the lack part is filled up according to the background image as the background image of camera lens rebuilds the lack part so that image will not Whole structure is influenceed because there is excalation.
Above-mentioned image acquiring device 20, can be by the identification to personage in taking lens, and provides the character face of identification Feature is selected to photographer, retains the selected personage of photographer in generation image, so that photographer can easily obtain institute Need the image shot.
Reference picture 5, proposes an a kind of embodiment of mobile terminal 30 of the invention.The mobile terminal 30 may include:Landscape is known Other module 21, shooting selecting module 22 and image generation module 23;The landscape identification module 21, for the scape taken in camera lens Sight is identified, and extracts the mark for having recognized landscape;The shooting selecting module 22, for the choosing according to photographer to mark Select, retain and identify the landscape associated with selected;The image generation module 23, for after shooting is performed, generation to retain landscape Image.
Above-mentioned landscape identification module 21 can be specifically for:Under cleaning pattern of taking pictures, the personage's monolithic wheel taken in camera lens Exterior feature is identified, and extracts mark of the character face as personage's overall profile.
Above-mentioned shooting selecting module 22 can be specifically for:When there is multiple face identifications, by the multiple face identification It is supplied to photographer to be selected, personage's overall profile that not selected face identification is associated is rejected from image to be allowed to hold again Row is shot.
Above-mentioned mobile terminal 30 may also include:Image complementary module 24, for the part rejected in image to be used into background Image is replaced.
Above-mentioned landscape identification module 21, shooting selecting module 22, image generation module 23 and image complementary module 24 have Body can be as described in above-mentioned embodiment.
Image acquiring method, image acquiring device in the present invention, and mobile terminal can apply still image and dynamic The acquisition of state image.
The preferred embodiments of the present invention are the foregoing is only, are not intended to limit the scope of the invention, it is every to utilize Equivalent structure or equivalent flow conversion that description of the invention and accompanying drawing content are made, or directly or indirectly it is used in other correlations Technical field, be included within the scope of the present invention.

Claims (6)

1. a kind of image acquiring method, it is characterised in that including:
The landscape that camera lens is taken in is identified, and extracts the mark for having recognized landscape;
Selection according to photographer to mark, retains and identifies the landscape associated with selected;
After shooting is performed, generation retains the image of landscape;Wherein:
It is described that the landscape that camera lens is taken in is identified, and extract the step of recognized the mark of landscape and specifically include:Taking pictures Under cleaning pattern, personage's overall profile that camera lens is taken in is identified, and extract character face as personage's overall profile Mark;
The selection according to photographer to mark, the step of retaining the landscape associated with selected mark specifically includes:Work as presence During multiple face identifications, it is supplied to photographer to be selected the multiple face identification, not selected face identification is associated Personage's overall profile rejected from image and allow to perform shooting again.
2. image acquiring method according to claim 1, it is characterised in that described image acquisition methods also include:
The part rejected in image is replaced using background image.
3. a kind of image acquiring device, it is characterised in that including:
Landscape identification module, for the landscape that camera lens is taken in be identified, and extracts the mark for having recognized landscape;
Selecting module is shot, for the selection according to photographer to mark, retains and identifies the landscape associated with selected;
Image generation module, for after shooting is performed, generation to retain the image of landscape;Wherein:
The landscape identification module specifically for:Under cleaning pattern of taking pictures, personage's overall profile that camera lens is taken in is known Not, and mark of the character face as personage's overall profile is extracted;
It is described shooting selecting module specifically for:When there is multiple face identifications, the multiple face identification is supplied to bat The person of taking the photograph is selected, and personage's overall profile that not selected face identification is associated is rejected from image to be allowed to perform shooting again.
4. image acquiring device according to claim 3, it is characterised in that described image acquisition device also includes:
Image complementary module, for the part rejected in image to be replaced using background image.
5. a kind of mobile terminal, it is characterised in that including:
Landscape identification module, for the landscape that camera lens is taken in be identified, and extracts the mark for having recognized landscape;
Selecting module is shot, for the selection according to photographer to mark, retains and identifies the landscape associated with selected;
Image generation module, for after shooting is performed, generation to retain the image of landscape;Wherein:
The landscape identification module specifically for:Under cleaning pattern of taking pictures, personage's overall profile that camera lens is taken in is known Not, and mark of the character face as personage's overall profile is extracted;
It is described shooting selecting module specifically for:When there is multiple face identifications, the multiple face identification is supplied to bat The person of taking the photograph is selected, and personage's overall profile that not selected face identification is associated is rejected from image to be allowed to perform shooting again.
6. mobile terminal according to claim 5, it is characterised in that the mobile terminal also includes:
Image complementary module, for the part rejected in image to be replaced using background image.
CN201210586002.4A 2012-12-28 2012-12-28 Image acquiring method, device and mobile terminal Expired - Fee Related CN103108124B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210586002.4A CN103108124B (en) 2012-12-28 2012-12-28 Image acquiring method, device and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210586002.4A CN103108124B (en) 2012-12-28 2012-12-28 Image acquiring method, device and mobile terminal

Publications (2)

Publication Number Publication Date
CN103108124A CN103108124A (en) 2013-05-15
CN103108124B true CN103108124B (en) 2017-07-18

Family

ID=48315664

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210586002.4A Expired - Fee Related CN103108124B (en) 2012-12-28 2012-12-28 Image acquiring method, device and mobile terminal

Country Status (1)

Country Link
CN (1) CN103108124B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10474921B2 (en) * 2013-06-14 2019-11-12 Qualcomm Incorporated Tracker assisted image capture
CN103984942A (en) * 2014-05-28 2014-08-13 深圳市中兴移动通信有限公司 Object recognition method and mobile terminal
CN105704396A (en) * 2014-11-24 2016-06-22 中兴通讯股份有限公司 Picture processing method and device
CN106791449B (en) * 2017-02-27 2020-02-11 努比亚技术有限公司 Photo shooting method and device
CN107959790A (en) * 2017-11-15 2018-04-24 维沃移动通信有限公司 A kind of image capturing method, device and mobile terminal
CN108272449A (en) * 2018-01-30 2018-07-13 中国科学院电子学研究所 Contactless monitoring of blood pressure method and system
CN109727266A (en) * 2019-01-08 2019-05-07 青岛一舍科技有限公司 A method of the target person photo based on the pure view background of video acquisition
CN114550389A (en) * 2020-04-16 2022-05-27 浙江口碑网络技术有限公司 Self-service settlement method and device, storage medium and computer equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1916936A (en) * 2006-09-07 2007-02-21 北京理工大学 ID recognizing device of combining side profile and characteristic of ear
CN101588450A (en) * 2008-05-19 2009-11-25 株式会社日立制作所 Recording and reproducing apparatus and method thereof
CN101895684A (en) * 2009-05-22 2010-11-24 奥林巴斯映像株式会社 Photographing condition control device, camera and photographing condition control method
CN102036008A (en) * 2009-09-25 2011-04-27 华晶科技股份有限公司 Automatic focusing system and method for particular persons
CN102088561A (en) * 2009-12-04 2011-06-08 三星电子株式会社 Digital photographing apparatus and method of controlling the same

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7856125B2 (en) * 2006-01-31 2010-12-21 University Of Southern California 3D face reconstruction from 2D images
CN101409817B (en) * 2007-10-11 2012-08-29 鸿富锦精密工业(深圳)有限公司 Video processing method, video processing system and video apparatus
CN101795400B (en) * 2010-03-16 2013-03-27 上海复控华龙微系统技术有限公司 Method for actively tracking and monitoring infants and realization system thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1916936A (en) * 2006-09-07 2007-02-21 北京理工大学 ID recognizing device of combining side profile and characteristic of ear
CN101588450A (en) * 2008-05-19 2009-11-25 株式会社日立制作所 Recording and reproducing apparatus and method thereof
CN101895684A (en) * 2009-05-22 2010-11-24 奥林巴斯映像株式会社 Photographing condition control device, camera and photographing condition control method
CN102036008A (en) * 2009-09-25 2011-04-27 华晶科技股份有限公司 Automatic focusing system and method for particular persons
CN102088561A (en) * 2009-12-04 2011-06-08 三星电子株式会社 Digital photographing apparatus and method of controlling the same

Also Published As

Publication number Publication date
CN103108124A (en) 2013-05-15

Similar Documents

Publication Publication Date Title
CN103108124B (en) Image acquiring method, device and mobile terminal
CN108090888B (en) Fusion detection method of infrared image and visible light image based on visual attention model
Zhang et al. Fast depth image denoising and enhancement using a deep convolutional network
CN111091091A (en) Method, device and equipment for extracting target object re-identification features and storage medium
WO2017058579A1 (en) Automatic composition of video with dynamic background and composite frames selected based on frame criteria
CN104135612B (en) A kind of image pickup method and filming apparatus of adjustable shooting body position
CN105631417A (en) Video beautification system and method applied to Internet video live broadcast
CN108305223B (en) Image background blurring processing method and device
CN104778396A (en) Method and system for eyeprint recognition unlocking based on environment filtering frames
CN111339831B (en) Lighting lamp control method and system
CN102932541A (en) Mobile phone photographing method and system
CN111985281B (en) Image generation model generation method and device and image generation method and device
WO2015066984A1 (en) Complex background-oriented optical character recognition method and device
CN111079688A (en) Living body detection method based on infrared image in face recognition
CN104091317B (en) Night scene image window mirror reflection effect removing method
CN108764230A (en) A kind of bank's card number automatic identifying method based on convolutional neural networks
Hong et al. Near-infrared image guided reflection removal
CN108335268A (en) A method of the coloured image deblurring based on blind deconvolution
CN109472230B (en) Automatic athlete shooting recommendation system and method based on pedestrian detection and Internet
Khalil et al. A review of fingerprint pre-processing using a mobile phone
CN110827375B (en) Infrared image true color coloring method and system based on low-light-level image
CN107451971A (en) The blind convolved image restoring method of low-light (level) of priori is combined based on dark and Gauss
CN106611417B (en) Method and device for classifying visual elements into foreground or background
CN116506724A (en) Photographing auxiliary method, photographing auxiliary device, medium and terminal
CN109165551A (en) A kind of expression recognition method of adaptive weighted fusion conspicuousness structure tensor and LBP feature

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C53 Correction of patent for invention or patent application
CB02 Change of applicant information

Address after: 200121, room 2, building 4091, 116 South Road, Shanghai, Pudong New Area

Applicant after: Shanghai Ding Electronic Technology (Group) Co., Ltd.

Address before: 200121, room 2, building 4091, 116 South Road, Shanghai, Pudong New Area

Applicant before: Shanghai Dingwei Software Technology Co., Ltd.

COR Change of bibliographic data

Free format text: CORRECT: APPLICANT; FROM: SHANGHAI DINGWEI SOFTWARE TECHNOLOGY CO., LTD. TO: SHANGHAI DINGWEI ELECTRONICS TECHNOLOGY (GROUP) CO., LTD.

GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20170718

Termination date: 20171228

CF01 Termination of patent right due to non-payment of annual fee