TW440801B - Method and apparatus for perceptual determination of threshold for gradient-based local edge determination - Google Patents

Method and apparatus for perceptual determination of threshold for gradient-based local edge determination Download PDF

Info

Publication number
TW440801B
TW440801B TW087119801A TW87119801A TW440801B TW 440801 B TW440801 B TW 440801B TW 087119801 A TW087119801 A TW 087119801A TW 87119801 A TW87119801 A TW 87119801A TW 440801 B TW440801 B TW 440801B
Authority
TW
Taiwan
Prior art keywords
image
gradient
intensity
scope
pixel
Prior art date
Application number
TW087119801A
Other languages
English (en)
Chinese (zh)
Inventor
Tinku Acharya
Ping-Sing Tsai
Original Assignee
Intel Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intel Corp filed Critical Intel Corp
Application granted granted Critical
Publication of TW440801B publication Critical patent/TW440801B/zh

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/46Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/12Edge-based segmentation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20192Edge enhancement; Edge preservation

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)
TW087119801A 1997-12-08 1998-11-30 Method and apparatus for perceptual determination of threshold for gradient-based local edge determination TW440801B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US08/986,461 US6094508A (en) 1997-12-08 1997-12-08 Perceptual thresholding for gradient-based local edge detection

Publications (1)

Publication Number Publication Date
TW440801B true TW440801B (en) 2001-06-16

Family

ID=25532448

Family Applications (1)

Application Number Title Priority Date Filing Date
TW087119801A TW440801B (en) 1997-12-08 1998-11-30 Method and apparatus for perceptual determination of threshold for gradient-based local edge determination

Country Status (8)

Country Link
US (1) US6094508A (enExample)
EP (1) EP1058909B1 (enExample)
JP (1) JP4160258B2 (enExample)
KR (1) KR100371470B1 (enExample)
AU (1) AU1412199A (enExample)
DE (1) DE69828909T2 (enExample)
TW (1) TW440801B (enExample)
WO (1) WO1999030270A1 (enExample)

Families Citing this family (120)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6415053B1 (en) * 1998-04-20 2002-07-02 Fuji Photo Film Co., Ltd. Image processing method and apparatus
US6240208B1 (en) * 1998-07-23 2001-05-29 Cognex Corporation Method for automatic visual identification of a reference site in an image
US6614474B1 (en) * 1998-08-27 2003-09-02 Polycom, Inc. Electronic pan tilt zoom video camera with adaptive edge sharpening filter
JP2000241117A (ja) * 1999-02-22 2000-09-08 Keyence Corp 画像のエッジ検出方法、検査装置及び記録媒体
SE513728C2 (sv) * 1999-03-26 2000-10-30 Goesta Granlund Förfarande och system för artificiellt seende
US7095164B1 (en) 1999-05-25 2006-08-22 Intel Corporation Display screen
US6697534B1 (en) 1999-06-09 2004-02-24 Intel Corporation Method and apparatus for adaptively sharpening local image content of an image
US6744532B1 (en) * 1999-08-31 2004-06-01 Lite-On Technology Corporation Method for enhancing printing quality
US6625308B1 (en) 1999-09-10 2003-09-23 Intel Corporation Fuzzy distinction based thresholding technique for image segmentation
US6658399B1 (en) 1999-09-10 2003-12-02 Intel Corporation Fuzzy based thresholding technique for image segmentation
US7053944B1 (en) 1999-10-01 2006-05-30 Intel Corporation Method of using hue to interpolate color pixel signals
US7106910B2 (en) * 1999-10-01 2006-09-12 Intel Corporation Color video coding scheme
US6628827B1 (en) 1999-12-14 2003-09-30 Intel Corporation Method of upscaling a color image
US7158178B1 (en) 1999-12-14 2007-01-02 Intel Corporation Method of converting a sub-sampled color image
US6748118B1 (en) 2000-02-18 2004-06-08 Intel Corporation Method of quantizing signal samples of an image during same
US6961472B1 (en) 2000-02-18 2005-11-01 Intel Corporation Method of inverse quantized signal samples of an image during image decompression
US6337925B1 (en) * 2000-05-08 2002-01-08 Adobe Systems Incorporated Method for determining a border in a complex scene with applications to image masking
US6738520B1 (en) 2000-06-19 2004-05-18 Intel Corporation Method of compressing an image
US7046728B1 (en) 2000-06-30 2006-05-16 Intel Corporation Method of video coding the movement of a human face from a sequence of images
US6775413B1 (en) 2000-09-18 2004-08-10 Intel Corporation Techniques to implement one-dimensional compression
US6563439B1 (en) 2000-10-31 2003-05-13 Intel Corporation Method of performing Huffman decoding
US6636167B1 (en) * 2000-10-31 2003-10-21 Intel Corporation Method of generating Huffman code length information
US6422082B1 (en) 2000-11-27 2002-07-23 General Electric Company Laser shock peening quality assurance by ultrasonic analysis
US20020118746A1 (en) * 2001-01-03 2002-08-29 Kim Hyun Mun Method of performing video encoding rate control using motion estimation
EP1368787A1 (en) * 2001-02-28 2003-12-10 PTS Corporation Dynamic chain-based thresholding
US6766286B2 (en) 2001-03-28 2004-07-20 Intel Corporation Pyramid filter
US20020184276A1 (en) * 2001-03-30 2002-12-05 Tinku Acharya Two-dimensional pyramid filter architecture
US6889237B2 (en) * 2001-03-30 2005-05-03 Intel Corporation Two-dimensional pyramid filter architecture
US7342681B2 (en) * 2001-07-13 2008-03-11 Transpacific Ip, Ltd High-speed calibration method and system for an image-capture apparatus
CN1184796C (zh) * 2001-07-26 2005-01-12 佳能株式会社 图象处理方法和设备以及图象处理系统
US7110612B1 (en) 2001-10-11 2006-09-19 Pixelworks, Inc. Weighted absolute difference based noise reduction method and apparatus
AUPR891701A0 (en) * 2001-11-16 2001-12-13 Proteome Systems Ltd Method for locating the edge of an object
US6891549B2 (en) * 2002-01-11 2005-05-10 Applied Materials, Inc. System and method for edge enhancement of images
US7154556B1 (en) 2002-03-21 2006-12-26 Pixelworks, Inc. Weighted absolute difference based deinterlace method and apparatus
CN1313979C (zh) * 2002-05-03 2007-05-02 三星电子株式会社 产生三维漫画的装置和方法
US7149356B2 (en) * 2002-07-10 2006-12-12 Northrop Grumman Corporation System and method for template matching of candidates within a two-dimensional image
US7116823B2 (en) * 2002-07-10 2006-10-03 Northrop Grumman Corporation System and method for analyzing a contour of an image by applying a Sobel operator thereto
US7146057B2 (en) * 2002-07-10 2006-12-05 Northrop Grumman Corporation System and method for image analysis using a chaincode
US7239314B2 (en) * 2002-08-29 2007-07-03 Warner Bros. Animation Method for 2-D animation
US20040042551A1 (en) * 2002-09-04 2004-03-04 Tinku Acharya Motion estimation
US7266151B2 (en) * 2002-09-04 2007-09-04 Intel Corporation Method and system for performing motion estimation using logarithmic search
US20040057626A1 (en) * 2002-09-23 2004-03-25 Tinku Acharya Motion estimation using a context adaptive search
GB0224357D0 (en) * 2002-10-19 2002-11-27 Eastman Kodak Co Image processing
US7502525B2 (en) * 2003-01-27 2009-03-10 Boston Scientific Scimed, Inc. System and method for edge detection of an image
US6993187B2 (en) 2003-02-14 2006-01-31 Ikonisys, Inc. Method and system for object recognition using fractal maps
US7062079B2 (en) * 2003-02-14 2006-06-13 Ikonisys, Inc. Method and system for image segmentation
US7274393B2 (en) * 2003-02-28 2007-09-25 Intel Corporation Four-color mosaic pattern for depth and image capture
US20040169748A1 (en) * 2003-02-28 2004-09-02 Tinku Acharya Sub-sampled infrared sensor for use in a digital image capture device
US20040174446A1 (en) * 2003-02-28 2004-09-09 Tinku Acharya Four-color mosaic pattern for depth and image capture
JP4522054B2 (ja) * 2003-05-07 2010-08-11 キヤノン株式会社 診断支援装置及び方法
US7200279B1 (en) * 2003-09-11 2007-04-03 Magnachip Semiconductor, Inc. Method and system for image chroma suppression
US7302099B2 (en) * 2003-11-10 2007-11-27 Microsoft Corporation Stroke segmentation for template-based cursive handwriting recognition
US7805003B1 (en) * 2003-11-18 2010-09-28 Adobe Systems Incorporated Identifying one or more objects within an image
US7496237B1 (en) 2004-01-02 2009-02-24 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Image processing for binarization enhancement via fuzzy reasoning
US7672507B2 (en) * 2004-01-30 2010-03-02 Hewlett-Packard Development Company, L.P. Image processing methods and systems
US7298897B1 (en) 2004-02-11 2007-11-20 United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Optimal binarization of gray-scaled digital images via fuzzy reasoning
US7400766B1 (en) 2004-02-19 2008-07-15 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Image edge extraction via fuzzy reasoning
US20050254728A1 (en) * 2004-05-13 2005-11-17 Zhuo-Ya Wang Automatic cutting method for digital images
KR101108435B1 (ko) * 2005-05-31 2012-02-16 서강대학교산학협력단 의사윤곽 제거 방법 및 이 방법이 적용되는 디스플레이장치
US8463065B2 (en) * 2005-12-07 2013-06-11 Commonwealth Scientific And Industrial Research Organisation Linear feature detection method and apparatus
US20070154089A1 (en) * 2006-01-03 2007-07-05 Chang-Jung Kao Method and apparatus for calculating image histogram with configurable granularity
US20070206844A1 (en) * 2006-03-03 2007-09-06 Fuji Photo Film Co., Ltd. Method and apparatus for breast border detection
JP4523926B2 (ja) * 2006-04-05 2010-08-11 富士通株式会社 画像処理装置、画像処理プログラムおよび画像処理方法
EP2036037B1 (en) * 2006-05-18 2013-04-17 Resonant Medical Inc. Methods and systems for segmentation using boundary reparameterization
KR100780932B1 (ko) * 2006-05-30 2007-11-30 엠텍비젼 주식회사 컬러 보간 방법 및 장치
WO2007148284A2 (en) * 2006-06-23 2007-12-27 Koninklijke Philips Electronics N.V. A method, a system and a computer program for determining a threshold in an image comprising image values
GB0616293D0 (en) 2006-08-16 2006-09-27 Imp Innovations Ltd Method of image processing
US9451928B2 (en) * 2006-09-13 2016-09-27 Elekta Ltd. Incorporating internal anatomy in clinical radiotherapy setups
AU2006252019B2 (en) * 2006-12-13 2012-06-28 Canon Kabushiki Kaisha Method and Apparatus for Dynamic Connector Analysis
KR100850561B1 (ko) 2007-01-03 2008-08-06 (주)폴리다임 디지털 이미지 내의 픽셀 윤곽 가로선 제거 방법
KR100835380B1 (ko) * 2007-01-15 2008-06-05 한국과학기술원 영상의 경계를 검출하는 방법 및 그 장치와 이를 구현할 수있는 컴퓨터로 읽을 수 있는 기록 매체
US7881497B2 (en) * 2007-03-08 2011-02-01 Honeywell International Inc. Vision based navigation and guidance system
US10531858B2 (en) * 2007-07-20 2020-01-14 Elekta, LTD Methods and systems for guiding the acquisition of ultrasound images
US8249317B2 (en) * 2007-07-20 2012-08-21 Eleckta Ltd. Methods and systems for compensating for changes in anatomy of radiotherapy patients
US7882177B2 (en) * 2007-08-06 2011-02-01 Yahoo! Inc. Employing pixel density to detect a spam image
US8135198B2 (en) * 2007-08-08 2012-03-13 Resonant Medical, Inc. Systems and methods for constructing images
US8264591B2 (en) * 2007-10-22 2012-09-11 Candela Microsystems (S) Pte. Ltd. Method and system for generating focus signal
TWI370673B (en) * 2007-11-05 2012-08-11 Altek Corp Method for an image adjustment and digital image processing device thereof
US8036468B2 (en) * 2007-12-24 2011-10-11 Microsoft Corporation Invariant visual scene and object recognition
US8200022B2 (en) * 2008-03-24 2012-06-12 Verint Systems Ltd. Method and system for edge detection
US8189738B2 (en) * 2008-06-02 2012-05-29 Elekta Ltd. Methods and systems for guiding clinical radiotherapy setups
JP5271031B2 (ja) * 2008-08-09 2013-08-21 株式会社キーエンス 画像のデータ圧縮方法、画像処理におけるパターンモデルの位置決め方法、画像処理装置、画像処理プログラム及びコンピュータで読み取り可能な記録媒体
RU2360289C1 (ru) * 2008-08-11 2009-06-27 Евгений Александрович Самойлин Способ помехоустойчивого градиентного выделения контуров объектов на цифровых изображениях
US20100166257A1 (en) * 2008-12-30 2010-07-01 Ati Technologies Ulc Method and apparatus for detecting semi-transparencies in video
TWI430649B (zh) * 2009-05-26 2014-03-11 Silicon Motion Inc 影像的邊界係數計算方法以及使用此邊界係數計算方法的影像雜訊去除方法
US8270754B2 (en) * 2009-06-22 2012-09-18 Qualcomm Incorporated Lens roll-off correction operation using values corrected based on brightness information
US10542962B2 (en) * 2009-07-10 2020-01-28 Elekta, LTD Adaptive radiotherapy treatment using ultrasound
RU2403616C1 (ru) * 2009-08-12 2010-11-10 Евгений Александрович Самойлин Способ помехоустойчивого градиентного выделения контуров объектов на цифровых изображениях
US8345106B2 (en) * 2009-09-23 2013-01-01 Microsoft Corporation Camera-based scanning
JP5507962B2 (ja) * 2009-11-05 2014-05-28 キヤノン株式会社 情報処理装置及びその制御方法、プログラム
US8457431B2 (en) 2009-12-07 2013-06-04 Hiok Nam Tay Auto-focus image system
KR101268520B1 (ko) * 2009-12-14 2013-06-04 한국전자통신연구원 영상 인식 장치 및 방법
US9248316B2 (en) 2010-01-12 2016-02-02 Elekta Ltd. Feature tracking using ultrasound
US20110172526A1 (en) 2010-01-12 2011-07-14 Martin Lachaine Feature Tracking Using Ultrasound
GB2487143B (en) 2010-05-26 2012-12-12 Hiok-Nam Tay Auto-focus image system
US8396876B2 (en) 2010-11-30 2013-03-12 Yahoo! Inc. Identifying reliable and authoritative sources of multimedia content
US8942917B2 (en) 2011-02-14 2015-01-27 Microsoft Corporation Change invariant scene recognition by an agent
TWI450155B (zh) * 2011-02-15 2014-08-21 Wistron Corp 應用於光學式觸控裝置之校正資訊計算方法及系統
JP4967065B2 (ja) 2011-02-24 2012-07-04 任天堂株式会社 画像処理プログラム、画像処理装置、画像処理システム、および画像処理方法
JP5178860B2 (ja) 2011-02-24 2013-04-10 任天堂株式会社 画像認識プログラム、画像認識装置、画像認識システム、および画像認識方法
JP5016723B2 (ja) 2011-02-24 2012-09-05 任天堂株式会社 画像認識プログラム、画像認識装置、画像認識システム、および画像認識方法
JP4989768B2 (ja) 2011-02-24 2012-08-01 任天堂株式会社 画像処理プログラム、画像処理装置、画像処理システム、および画像処理方法
JP5026604B2 (ja) * 2011-02-24 2012-09-12 任天堂株式会社 画像認識プログラム、画像認識装置、画像認識システム、および画像認識方法
JP2011134343A (ja) 2011-02-24 2011-07-07 Nintendo Co Ltd 画像処理プログラム、画像処理装置、画像処理システム、および画像処理方法
US9065999B2 (en) 2011-03-24 2015-06-23 Hiok Nam Tay Method and apparatus for evaluating sharpness of image
US9726486B1 (en) * 2011-07-29 2017-08-08 Rockwell Collins, Inc. System and method for merging enhanced vision data with a synthetic vision data
EP2786345B1 (en) * 2011-11-28 2020-03-11 Koninklijke Philips N.V. Image processing apparatus.
CN102871686B (zh) * 2012-03-05 2015-08-19 杭州弘恩医疗科技有限公司 基于3d医学影像测定生理参数的装置和方法
JP5772675B2 (ja) * 2012-03-23 2015-09-02 トヨタ車体株式会社 濃淡画像のエッジ抽出方法、エッジ抽出装置並びに濃淡画像のエッジ抽出プログラム
US8971637B1 (en) 2012-07-16 2015-03-03 Matrox Electronic Systems Ltd. Method and system for identifying an edge in an image
WO2014200454A1 (en) * 2013-06-10 2014-12-18 Intel Corporation Performing hand gesture recognition using 2d image data
EP3371671B1 (en) 2015-11-02 2020-10-21 Starship Technologies OÜ Method, device and assembly for map generation
US9727793B2 (en) * 2015-12-15 2017-08-08 Honda Motor Co., Ltd. System and method for image based vehicle localization
EP3206164B1 (en) 2016-02-12 2022-05-25 Cognex Corporation System and method for efficiently scoring probes in an image with a vision system
EP3293672A1 (en) * 2016-09-07 2018-03-14 Malvern Panalytical Limited Particle boundary identification
WO2018109764A1 (en) * 2016-12-14 2018-06-21 Eyes Ltd System and methods for fully automated data analysis, reporting and quantification for medical and general diagnosis, and for edge detection in digitized images
CN110189349B (zh) * 2019-06-03 2022-03-25 湖南国科微电子股份有限公司 图像处理方法及装置
CN114331951B (zh) * 2021-09-30 2024-09-24 腾讯科技(深圳)有限公司 图像检测方法、装置、计算机、可读存储介质及程序产品
US20250173847A1 (en) * 2023-11-28 2025-05-29 Samsung Electronics Co., Ltd. Simultaneous contrast based picture quality improvement for power saving
CN120705916B (zh) * 2025-08-13 2025-11-21 杭州海康威视数字技术股份有限公司 面向多媒体隐私保护的多维量化指标评价方法及装置

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5014124A (en) * 1988-02-25 1991-05-07 Ricoh Company, Ltd. Digital image processing apparatus
JP2885823B2 (ja) * 1989-04-11 1999-04-26 株式会社豊田中央研究所 視覚認識装置
US5457754A (en) * 1990-08-02 1995-10-10 University Of Cincinnati Method for automatic contour extraction of a cardiac image
US5210799A (en) * 1991-03-28 1993-05-11 Texas Instruments Incorporated System and method for ranking and extracting salient contours for target recognition
US5231580A (en) * 1991-04-01 1993-07-27 The United States Of America As Represented By The Secretary Of The Department Of Health And Human Services Automated method and apparatus for determining characteristics of nerve fibers
US5778107A (en) * 1993-12-24 1998-07-07 Kabushiki Kaisha Komatsu Seisakusho Position recognition method
US5734739A (en) * 1994-05-31 1998-03-31 University Of Washington Method for determining the contour of an in vivo organ using multiple image frames of the organ
US5572565A (en) * 1994-12-30 1996-11-05 Philips Electronics North America Corporation Automatic segmentation, skinline and nipple detection in digital mammograms
FR2731819B1 (fr) * 1995-03-17 1997-04-11 Alsthom Cge Alcatel Methode d'extraction de contours utilisant une analyse multi-fractale
US5845007A (en) * 1996-01-02 1998-12-01 Cognex Corporation Machine vision method and apparatus for edge-based image histogram analysis

Also Published As

Publication number Publication date
EP1058909B1 (en) 2005-02-02
KR20010032850A (ko) 2001-04-25
EP1058909A1 (en) 2000-12-13
JP4160258B2 (ja) 2008-10-01
JP2002503840A (ja) 2002-02-05
AU1412199A (en) 1999-06-28
DE69828909T2 (de) 2006-04-06
KR100371470B1 (ko) 2003-02-07
WO1999030270A1 (en) 1999-06-17
US6094508A (en) 2000-07-25
DE69828909D1 (de) 2005-03-10
EP1058909A4 (en) 2002-06-19

Similar Documents

Publication Publication Date Title
TW440801B (en) Method and apparatus for perceptual determination of threshold for gradient-based local edge determination
US7324701B2 (en) Image noise reduction
O'Gorman et al. Practical algorithms for image analysis with CD-ROM
TWI467495B (zh) 利用全彩像素映射邊緣
TWI430184B (zh) 結合全色像素之邊緣映射
Seul et al. Practical algorithms for image analysis with CD-ROM: description, examples, and code
US10410087B2 (en) Automated methods and systems for locating document subimages in images to facilitate extraction of information from the located document subimages
US10992851B2 (en) Image processing apparatus, image processing method, and non-transitory computer-readable storage medium, with image processing based on image processing condition and information equivalent to distance from focal plane
US8275211B2 (en) Image processing apparatus and method
JP5541679B2 (ja) 画像処理装置及び方法、並びに、プログラム
US9595082B2 (en) Image processor and non-transitory computer readable medium for generating a reproduction image which is reproduced so that visibility of an original image is enhanced
JP5878451B2 (ja) マーカー埋め込み装置、マーカー検出装置、マーカー埋め込み方法、マーカー検出方法、及びプログラム
Śluzek Incremental Image Decolorization with Randomizing Factors
JPH10340332A5 (enExample)
JP4445026B2 (ja) 画像処理方法および装置並びにプログラム
JP2006107018A (ja) 画像解析方法及び装置、画像処理方法及びシステム、これらの動作プログラム
JP4008715B2 (ja) 帳票読取装置および帳票読取処理用プログラム
JP2020027357A (ja) 画像処理装置およびその制御方法
JP2024124710A (ja) 真贋判定装置、真贋判定方法及び真贋判定プログラム
CN116309664A (zh) 图像自动裁剪方法、装置、电子设备及存储介质
JP4735374B2 (ja) 画像処理装置
CN116894788A (zh) 图像处理方法、装置、电子设备及存储介质
JP2021033502A (ja) 画像処理装置、方法、及びプログラム
JPH11120343A (ja) 画像処理装置
JPH05197802A (ja) 画像の二値化処理装置

Legal Events

Date Code Title Description
GD4A Issue of patent certificate for granted invention patent
MM4A Annulment or lapse of patent due to non-payment of fees