JP3974964B2 - 画像処理装置 - Google Patents

画像処理装置 Download PDF

Info

Publication number
JP3974964B2
JP3974964B2 JP31226096A JP31226096A JP3974964B2 JP 3974964 B2 JP3974964 B2 JP 3974964B2 JP 31226096 A JP31226096 A JP 31226096A JP 31226096 A JP31226096 A JP 31226096A JP 3974964 B2 JP3974964 B2 JP 3974964B2
Authority
JP
Japan
Prior art keywords
image
images
correction
input
correction parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP31226096A
Other languages
English (en)
Japanese (ja)
Other versions
JPH10187929A (ja
JPH10187929A5 (enExample
Inventor
正樹 日暮
康宏 小宮
崗路 井
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Olympus Corp
Original Assignee
Olympus Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Olympus Corp filed Critical Olympus Corp
Priority to JP31226096A priority Critical patent/JP3974964B2/ja
Priority to US08/964,180 priority patent/US6995790B2/en
Publication of JPH10187929A publication Critical patent/JPH10187929A/ja
Publication of JPH10187929A5 publication Critical patent/JPH10187929A5/ja
Application granted granted Critical
Publication of JP3974964B2 publication Critical patent/JP3974964B2/ja
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038Image mosaicing, e.g. composing plane images from plane sub-images
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/14Transformations for image registration, e.g. adjusting or mapping for alignment of images
    • G06T3/153Transformations for image registration, e.g. adjusting or mapping for alignment of images using elastic snapping
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/80Geometric correction
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/387Composing, repositioning or otherwise geometrically modifying originals
    • H04N1/3876Recombination of partial images to recreate the original image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/40Picture signal circuits
    • H04N1/407Control or modification of tonal gradation or of extreme levels, e.g. background level
    • H04N1/4072Control or modification of tonal gradation or of extreme levels, e.g. background level dependent on the contents of the original
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46Colour picture communication systems
    • H04N1/56Processing of colour picture signals
    • H04N1/60Colour correction or control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N2201/3201Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3225Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document
    • H04N2201/3247Data linking a set of images to one another, e.g. sequence, burst or continuous capture mode

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Processing (AREA)
JP31226096A 1996-11-08 1996-11-22 画像処理装置 Expired - Fee Related JP3974964B2 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP31226096A JP3974964B2 (ja) 1996-11-08 1996-11-22 画像処理装置
US08/964,180 US6995790B2 (en) 1996-11-08 1997-11-04 Image processing apparatus for joining a plurality of images

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP29675096 1996-11-08
JP8-296750 1996-11-08
JP31226096A JP3974964B2 (ja) 1996-11-08 1996-11-22 画像処理装置

Publications (3)

Publication Number Publication Date
JPH10187929A JPH10187929A (ja) 1998-07-21
JPH10187929A5 JPH10187929A5 (enExample) 2005-02-24
JP3974964B2 true JP3974964B2 (ja) 2007-09-12

Family

ID=26560827

Family Applications (1)

Application Number Title Priority Date Filing Date
JP31226096A Expired - Fee Related JP3974964B2 (ja) 1996-11-08 1996-11-22 画像処理装置

Country Status (2)

Country Link
US (1) US6995790B2 (enExample)
JP (1) JP3974964B2 (enExample)

Families Citing this family (81)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6786420B1 (en) 1997-07-15 2004-09-07 Silverbrook Research Pty. Ltd. Data distribution mechanism in the form of ink dots on cards
US6618117B2 (en) 1997-07-12 2003-09-09 Silverbrook Research Pty Ltd Image sensing apparatus including a microcontroller
US6948794B2 (en) 1997-07-15 2005-09-27 Silverbrook Reserach Pty Ltd Printhead re-capping assembly for a print and demand digital camera system
US7110024B1 (en) 1997-07-15 2006-09-19 Silverbrook Research Pty Ltd Digital camera system having motion deblurring means
US6624848B1 (en) 1997-07-15 2003-09-23 Silverbrook Research Pty Ltd Cascading image modification using multiple digital cameras incorporating image processing
US6879341B1 (en) 1997-07-15 2005-04-12 Silverbrook Research Pty Ltd Digital camera system containing a VLIW vector processor
US6690419B1 (en) 1997-07-15 2004-02-10 Silverbrook Research Pty Ltd Utilising eye detection methods for image processing in a digital image camera
US7057650B1 (en) * 1998-06-22 2006-06-06 Fuji Photo Film Co., Ltd. Image sensing apparatus and method for synthesizing a composite image
JP4282113B2 (ja) * 1998-07-24 2009-06-17 オリンパス株式会社 撮像装置および撮像方法、並びに、撮像プログラムを記録した記録媒体
JP2000083157A (ja) 1998-09-07 2000-03-21 Fuji Photo Film Co Ltd 画像処理方法および画像処理装置
AUPP702098A0 (en) 1998-11-09 1998-12-03 Silverbrook Research Pty Ltd Image creation method and apparatus (ART73)
JP3000527B1 (ja) * 1998-09-16 2000-01-17 株式会社アトラス 画像プリント供給装置
US6930710B1 (en) * 1998-11-13 2005-08-16 Cnh Canada, Ltd. Method of and apparatus for processing a video image
EP1067804A4 (en) * 1998-12-26 2005-05-11 Sony Corp VIDEO SIGNAL PROCESSING APPARATUS AND METHOD
JP3449937B2 (ja) * 1999-01-14 2003-09-22 日本電信電話株式会社 パノラマ画像作成方法及びパノラマ画像を用いた周囲状況伝達方法並びにこれらの方法を記録した記録媒体
JP3799861B2 (ja) * 1999-02-24 2006-07-19 株式会社日立製作所 画像合成装置、画像合成方法を実行させるプログラムが記録された記録媒体
US7015966B1 (en) * 1999-03-15 2006-03-21 Canon Kabushiki Kaisha Reducing discontinuities in segmented imaging sensors
AUPQ056099A0 (en) 1999-05-25 1999-06-17 Silverbrook Research Pty Ltd A method and apparatus (pprint01)
JP4169462B2 (ja) * 1999-08-26 2008-10-22 株式会社リコー 画像処理方法及び装置、デジタルカメラ、画像処理システム、並びに、画像処理プログラムを記録した記録媒体
US7542070B2 (en) 2000-01-17 2009-06-02 Fujifilm Corporation Image processing apparatus, and photographing system for receiving and creating processing information
US8407595B1 (en) * 2000-02-11 2013-03-26 Sony Corporation Imaging service for automating the display of images
JP2001274973A (ja) * 2000-03-24 2001-10-05 Sanyo Electric Co Ltd 顕微鏡画像合成装置、顕微鏡画像合成方法、顕微鏡画像合成処理プログラムを記録したコンピュータ読み取り可能な記録媒体
US7313289B2 (en) * 2000-08-30 2007-12-25 Ricoh Company, Ltd. Image processing method and apparatus and computer-readable storage medium using improved distortion correction
JP3539394B2 (ja) * 2001-03-26 2004-07-07 ミノルタ株式会社 画像処理装置、プログラムおよび記録媒体
JP3297040B1 (ja) 2001-04-24 2002-07-02 松下電器産業株式会社 車載カメラの画像合成表示方法及びその装置
JP2005515675A (ja) * 2001-12-26 2005-05-26 イェダ リサーチ アンド デベロップメント カンパニー リミテッド ビデオの空間または時間解像度を高めるためのシステムおよび方法
JP3971246B2 (ja) * 2002-06-03 2007-09-05 富士フイルム株式会社 デジタル撮影装置
JP4048907B2 (ja) 2002-10-15 2008-02-20 セイコーエプソン株式会社 複数の画像データのパノラマ合成
WO2004114677A1 (ja) 2003-06-23 2004-12-29 Sony Corporation 画像処理方法および装置、並びにプログラム
SE0302065D0 (sv) * 2003-07-14 2003-07-14 Stefan Carlsson Video - method and apparatus
US7596286B2 (en) * 2003-08-06 2009-09-29 Sony Corporation Image processing apparatus, image processing system, imaging apparatus and image processing method
EP1667439A4 (en) * 2003-09-26 2006-11-08 Sharp Kk DEVICE FOR GENERATING A PANORAMIC IMAGE AND PICTORIAL IMAGING APPARATUS
US8804028B2 (en) * 2004-01-30 2014-08-12 Hewlett-Packard Development Company, L.P. Digital image production method and apparatus
JP4617085B2 (ja) * 2004-02-16 2011-01-19 キヤノン株式会社 画像表示装置および画像表示方法
JP4338551B2 (ja) * 2004-03-04 2009-10-07 富士フイルム株式会社 画像再生方法、画像再生装置及び画像再生プログラム
DE602004029133D1 (de) * 2004-03-05 2010-10-28 Mega Vision Corp Verarbeitungsvorrichtung und Computerprogramm zur Gamma-Korrektur
JP4223420B2 (ja) 2004-03-05 2009-02-12 メガビジョン株式会社 撮影装置
JP4632721B2 (ja) 2004-03-18 2011-02-16 メガビジョン株式会社 処理装置及びガンマ値調整プログラム
JP4566591B2 (ja) * 2004-03-19 2010-10-20 キヤノン株式会社 画像変形推定方法および画像変形推定装置
US7463296B2 (en) * 2004-04-01 2008-12-09 Microsoft Corporation Digital cameras with luminance correction
WO2006022630A1 (en) 2004-07-26 2006-03-02 Silicon Optix, Inc. Panoramic vision system and method
US20070103544A1 (en) * 2004-08-26 2007-05-10 Naofumi Nakazawa Panorama image creation device and panorama image imaging device
JP4763469B2 (ja) * 2005-03-07 2011-08-31 富士フイルム株式会社 固体撮像装置および画像入力装置、ならびにその画像補正方法
US10341558B2 (en) * 2005-06-03 2019-07-02 Craig P. Mowry System and apparatus for increasing quality and efficiency of film capture and methods of use thereof
US20070127909A1 (en) * 2005-08-25 2007-06-07 Craig Mowry System and apparatus for increasing quality and efficiency of film capture and methods of use thereof
US11632498B1 (en) * 2005-06-03 2023-04-18 Craig P. Mowry Multi-dimensional imaging system and method
JP4687265B2 (ja) * 2005-06-14 2011-05-25 富士ゼロックス株式会社 画像分析装置
US7454136B2 (en) * 2005-07-28 2008-11-18 Mitsubishi Electric Research Laboratories, Inc. Method and apparatus for acquiring HDR flash images
JP2007096904A (ja) * 2005-09-29 2007-04-12 Fujifilm Corp プリント注文受付装置及び方法並びにインデックス画像作成装置及び方法
JP4297111B2 (ja) * 2005-12-14 2009-07-15 ソニー株式会社 撮像装置、画像処理方法及びそのプログラム
JP4706466B2 (ja) * 2005-12-16 2011-06-22 株式会社日立製作所 撮像装置
JP5074777B2 (ja) * 2006-05-22 2012-11-14 キヤノン株式会社 撮像機能付表示装置、画像処理装置、画像処理方法、および、画像表示システム
JP4345829B2 (ja) * 2007-03-09 2009-10-14 ソニー株式会社 画像表示システム、画像表示装置、画像表示方法およびプログラム
JP4714174B2 (ja) * 2007-03-27 2011-06-29 富士フイルム株式会社 撮像装置
KR101014572B1 (ko) * 2007-08-27 2011-02-16 주식회사 코아로직 영상 왜곡 보정 방법 및 그 보정 방법을 채용한 영상처리장치
JP4940116B2 (ja) * 2007-12-06 2012-05-30 キヤノン株式会社 画像処理装置、画像処理方法、およびプログラム
JP5187139B2 (ja) * 2008-10-30 2013-04-24 セイコーエプソン株式会社 画像処理装置およびプログラム
US20100259639A1 (en) * 2009-04-13 2010-10-14 Qualcomm Incorporated Automatic backlight detection
JP4709309B2 (ja) * 2009-10-20 2011-06-22 株式会社パスコ 路面画像撮影・編集装置及び路面画像撮影・編集プログラム
US9237294B2 (en) 2010-03-05 2016-01-12 Sony Corporation Apparatus and method for replacing a broadcasted advertisement based on both heuristic information and attempts in altering the playback of the advertisement
US9832528B2 (en) 2010-10-21 2017-11-28 Sony Corporation System and method for merging network-based content with broadcasted programming content
US8374428B2 (en) * 2010-12-05 2013-02-12 Microsoft Corporation Color balancing for partially overlapping images
US9600863B2 (en) * 2012-02-13 2017-03-21 Omnivision Technologies, Inc. Method for combining images
CN102663716A (zh) * 2012-03-12 2012-09-12 武汉大学 适用于影像有效范围为凸多边形的接缝线网络生成方法
JP5950678B2 (ja) * 2012-04-27 2016-07-13 キヤノン株式会社 撮像装置、制御方法、及びプログラム
CN102867297B (zh) * 2012-08-31 2015-08-19 天津大学 一种低照度图像采集的数字化处理方法
JP5996462B2 (ja) * 2013-03-13 2016-09-21 オリンパス株式会社 画像処理装置、顕微鏡システム及び画像処理方法
JP2015032890A (ja) * 2013-07-31 2015-02-16 三星電子株式会社Samsung Electronics Co.,Ltd. 撮像装置及び現像方法
JP6223135B2 (ja) * 2013-11-14 2017-11-01 キヤノン株式会社 撮像装置およびその制御方法
US9396571B2 (en) 2014-02-10 2016-07-19 International Business Machines Corporation Simplified lighting compositing
US9196039B2 (en) 2014-04-01 2015-11-24 Gopro, Inc. Image sensor read window adjustment for multi-camera array tolerance
JP2016001781A (ja) * 2014-06-11 2016-01-07 ソニー株式会社 情報処理装置、情報処理方法、プログラム、及び画像表示装置
CN105812649B (zh) * 2014-12-31 2019-03-29 联想(北京)有限公司 一种摄像方法和装置
EP3076657B1 (en) 2015-04-02 2017-05-24 Axis AB Method for determination of focal length for a zoom lens
US9563957B1 (en) * 2015-07-02 2017-02-07 Yesvideo, Inc. 2D/3D image scanning and compositing
JP6746892B2 (ja) * 2015-09-30 2020-08-26 ヤマハ株式会社 画像処理装置、画像処理方法およびプログラム
KR102517104B1 (ko) 2016-02-17 2023-04-04 삼성전자주식회사 가상 현실 시스템에서 이미지 처리 방법 및 장치
US10085006B2 (en) * 2016-09-08 2018-09-25 Samsung Electronics Co., Ltd. Three hundred sixty degree video stitching
US10706512B2 (en) * 2017-03-07 2020-07-07 Adobe Inc. Preserving color in image brightness adjustment for exposure fusion
US11508047B2 (en) * 2017-09-14 2022-11-22 Hitachi High-Tech Corporation Charged particle microscope device and wide-field image generation method
US11647284B2 (en) * 2018-08-20 2023-05-09 Sony Semiconductor Solutions Corporation Image processing apparatus and image processing system with image combination that implements signal level matching

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2710317B2 (ja) 1986-10-15 1998-02-10 オリンパス光学工業株式会社 カラー撮像装置
US4926247A (en) 1986-10-15 1990-05-15 Olympus Optical Co., Ltd. Color imaging apparatus including a means for electronically non-linearly expanding and compressing dynamic range of an image signal
GB2256989B (en) * 1991-06-21 1995-02-08 Sony Broadcast & Communication Video image capture apparatus
JP3335413B2 (ja) 1992-04-14 2002-10-15 オリンパス光学工業株式会社 電子カメラ
JP3791696B2 (ja) 1992-04-09 2006-06-28 オリンパス株式会社 画像表示装置
JP3192875B2 (ja) * 1994-06-30 2001-07-30 キヤノン株式会社 画像合成方法および画像合成装置
JPH0832847A (ja) * 1994-07-13 1996-02-02 Fuji Photo Film Co Ltd 電子スチル・カメラおよびその制御方法
JPH08116490A (ja) 1994-10-14 1996-05-07 Olympus Optical Co Ltd 画像処理装置
JPH08256295A (ja) * 1994-12-21 1996-10-01 Olympus Optical Co Ltd 画像処理装置
US5828793A (en) * 1996-05-06 1998-10-27 Massachusetts Institute Of Technology Method and apparatus for producing digital images having extended dynamic ranges

Also Published As

Publication number Publication date
JPH10187929A (ja) 1998-07-21
US20030133019A1 (en) 2003-07-17
US6995790B2 (en) 2006-02-07

Similar Documents

Publication Publication Date Title
JP3974964B2 (ja) 画像処理装置
US6995793B1 (en) Video tap for a digital motion camera that simulates the look of post processing
US20140022415A1 (en) Imaging apparatus
JP5300756B2 (ja) 撮像装置及び画像処理方法
JP2010020758A (ja) 画像処理装置、撮像装置、画像処理方法及びプログラム
JP2005051776A (ja) ディジタルカメラ画像テンプレートガイド装置及び方法
JP5457845B2 (ja) 色特性補正装置およびカメラ
JP6624889B2 (ja) 映像処理装置、映像処理方法、及び映像処理プログラム
JP3926947B2 (ja) 画像データ形成装置および画像データ処理方法
US20100141823A1 (en) Image Processing Apparatus And Electronic Appliance
JP2006340120A (ja) 撮像装置、撮像結果の処理方法、画像処理装置、撮像結果の処理方法のプログラム、撮像結果の処理方法のプログラムを記録した記録媒体及び撮像結果の処理システム
JP6529533B2 (ja) 撮像装置、撮像装置の制御方法、及び、プログラム
CN103685928B (zh) 图像处理装置以及图像处理方法
JP2002300372A (ja) 画像処理装置、画像処理プログラムが記録された記録媒体、および、画像再生装置
JPH11242737A (ja) 画像処理方法及び装置並びに情報記録媒体
JP3984346B2 (ja) 撮像装置及び画像合成方法
JP2002305684A (ja) 撮像システム及びプログラム
JP4406461B2 (ja) 撮像装置
JPH07131718A (ja) 画像合成装置
JP3503655B2 (ja) 画像合成装置
JP3332942B2 (ja) 電子スチルカメラ
JP6210772B2 (ja) 情報処理装置、撮像装置、制御方法、及びプログラム
JP2003259200A (ja) 撮像装置
JP2000217022A (ja) 電子スチルカメラおよびその画像デ―タ記録再生方法
JP2000013675A (ja) デジタルカメラ

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20040319

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20060718

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20060914

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20061128

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20070124

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20070306

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20070507

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20070517

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20070612

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20070618

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100622

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110622

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120622

Year of fee payment: 5

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120622

Year of fee payment: 5

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130622

Year of fee payment: 6

LAPS Cancellation because of no payment of annual fees