JP4740657B2 - カラーセグメンテーションに基づくステレオ３次元再構成システムおよびプロセス - Google Patents

カラーセグメンテーションに基づくステレオ３次元再構成システムおよびプロセス Download PDF

Info

Publication number
JP4740657B2
JP4740657B2 JP2005180926A JP2005180926A JP4740657B2 JP 4740657 B2 JP4740657 B2 JP 4740657B2 JP 2005180926 A JP2005180926 A JP 2005180926A JP 2005180926 A JP2005180926 A JP 2005180926A JP 4740657 B2 JP4740657 B2 JP 4740657B2
Authority
JP
Japan
Prior art keywords
disparity
image
segment
pixel
pixels
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2005180926A
Other languages
English (en)
Japanese (ja)
Other versions
JP2006012166A (ja
JP2006012166A5 (enExample
Inventor
ジトニック ザ サード チャールズ
オイテンダール マシュー
スリスキ リチャード
ウインダー サイモン
ビング カン シング
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Corp
Original Assignee
Microsoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Corp filed Critical Microsoft Corp
Publication of JP2006012166A publication Critical patent/JP2006012166A/ja
Publication of JP2006012166A5 publication Critical patent/JP2006012166A5/ja
Application granted granted Critical
Publication of JP4740657B2 publication Critical patent/JP4740657B2/ja
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/12—Acquisition of 3D measurements of objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)
  • Processing Or Creating Images (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
JP2005180926A 2004-06-28 2005-06-21 カラーセグメンテーションに基づくステレオ３次元再構成システムおよびプロセス Expired - Fee Related JP4740657B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/879,327 2004-06-28
US10/879,327 US7324687B2 (en) 2004-06-28 2004-06-28 Color segmentation-based stereo 3D reconstruction system and process

Publications (3)

Publication Number Publication Date
JP2006012166A JP2006012166A (ja) 2006-01-12
JP2006012166A5 JP2006012166A5 (enExample) 2011-03-31
JP4740657B2 true JP4740657B2 (ja) 2011-08-03

Family

ID=34940185

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2005180926A Expired - Fee Related JP4740657B2 (ja) 2004-06-28 2005-06-21 カラーセグメンテーションに基づくステレオ３次元再構成システムおよびプロセス

Country Status (7)

Country Link
US (2) US7324687B2 (enExample)
EP (1) EP1612733B1 (enExample)
JP (1) JP4740657B2 (enExample)
KR (1) KR101143218B1 (enExample)
CN (1) CN100514367C (enExample)
AT (1) ATE438160T1 (enExample)
DE (1) DE602005015649D1 (enExample)

Families Citing this family (97)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4350706B2 (ja) * 2003-03-28 2009-10-21 オリンパス株式会社 画像処理装置及び画像処理プログラム
DE102005017313A1 (de) * 2005-04-14 2006-10-19 Volkswagen Ag Verfahren zur Darstellung von Informationen in einem Verkehrsmittel und Kombiinstrument für ein Kraftfahrzeug
US7676103B2 (en) * 2005-06-20 2010-03-09 Intel Corporation Enhancing video sharpness and contrast by luminance and chrominance transient improvement
JP2009515404A (ja) * 2005-11-04 2009-04-09 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ マルチビューディスプレイのための画像データの再生
US7889932B2 (en) * 2006-03-02 2011-02-15 Sharp Laboratories Of America, Inc. Methods and systems for detecting regions in digital images
US8630498B2 (en) 2006-03-02 2014-01-14 Sharp Laboratories Of America, Inc. Methods and systems for detecting pictorial regions in digital images
US7916934B2 (en) * 2006-04-04 2011-03-29 Mitsubishi Electric Research Laboratories, Inc. Method and system for acquiring, encoding, decoding and displaying 3D light fields
US20090167843A1 (en) * 2006-06-08 2009-07-02 Izzat Hekmat Izzat Two pass approach to three dimensional Reconstruction
US8437054B2 (en) * 2006-06-15 2013-05-07 Sharp Laboratories Of America, Inc. Methods and systems for identifying regions of substantially uniform color in a digital image
US7864365B2 (en) 2006-06-15 2011-01-04 Sharp Laboratories Of America, Inc. Methods and systems for segmenting a digital image into regions
JP5053373B2 (ja) * 2006-06-29 2012-10-17 トムソン ライセンシング 適応ピクセルベースのフィルタリング
US7876959B2 (en) 2006-09-06 2011-01-25 Sharp Laboratories Of America, Inc. Methods and systems for identifying text in digital images
WO2008062351A1 (en) * 2006-11-21 2008-05-29 Koninklijke Philips Electronics N.V. Generation of depth map for an image
CN101001391B (zh) * 2007-01-09 2010-05-19 四川大学 一种立体图像编码方法
US7970226B2 (en) * 2007-04-23 2011-06-28 Microsoft Corporation Local image descriptors
US8126275B2 (en) 2007-04-24 2012-02-28 Microsoft Corporation Interest point detection
CN101690220B (zh) * 2007-04-25 2013-09-25 Lg电子株式会社 用于解码/编码视频信号的方法和装置
CN101785025B (zh) * 2007-07-12 2013-10-30 汤姆森特许公司 用于从二维图像进行三维对象重构的系统和方法
US8280149B2 (en) * 2007-09-11 2012-10-02 Motorola Solutions, Inc. Method and apparatus to facilitate processing a stereoscopic image using first and second images to facilitate computing a depth/disparity image
CA2704479C (en) 2007-11-09 2016-01-05 Thomson Licensing System and method for depth map extraction using region-based filtering
US9094675B2 (en) * 2008-02-29 2015-07-28 Disney Enterprises Inc. Processing image data from multiple cameras for motion pictures
US8781250B2 (en) * 2008-06-26 2014-07-15 Microsoft Corporation Image deconvolution using color priors
KR100942925B1 (ko) * 2008-08-11 2010-02-22 한국전자통신연구원 스테레오 비전 시스템 및 그 제어방법
US8164617B2 (en) 2009-03-25 2012-04-24 Cisco Technology, Inc. Combining views of a plurality of cameras for a video conferencing endpoint with a display wall
JP5249114B2 (ja) * 2009-04-03 2013-07-31 Ｋｄｄｉ株式会社 画像生成装置、方法及びプログラム
KR20100135032A (ko) * 2009-06-16 2010-12-24 삼성전자주식회사 2차원 영상의 3차원 영상 변환 장치 및 방법
JP4934701B2 (ja) * 2009-06-30 2012-05-16 株式会社日立製作所 ステレオ画像処理装置およびステレオ画像処理方法
RU2423018C2 (ru) * 2009-08-04 2011-06-27 Корпорация "САМСУНГ ЭЛЕКТРОНИКС Ко., Лтд." Способ и система для преобразования стереоконтента
TWI398158B (zh) * 2009-12-01 2013-06-01 Ind Tech Res Inst 產生立體影像之影像深度的方法
CN101719286B (zh) * 2009-12-09 2012-05-23 北京大学 融合单视点场景分析的多视点三维场景重建方法及其系统
US8290248B2 (en) * 2009-12-31 2012-10-16 Mitsubishi Electric Research Laboratories, Inc. Determining disparity search range in stereo videos
US20110169818A1 (en) * 2010-01-13 2011-07-14 Sharp Laboratories Of America, Inc. Reducing viewing discomfort
CN102822873B (zh) * 2010-01-26 2016-07-13 萨博股份公司 自动三维绘图方法
RU2453922C2 (ru) * 2010-02-12 2012-06-20 Георгий Русланович Вяхирев Способ представления исходной трехмерной сцены по результатам съемки изображений в двумерной проекции (варианты)
US8669979B2 (en) * 2010-04-01 2014-03-11 Intel Corporation Multi-core processor supporting real-time 3D image rendering on an autostereoscopic display
US8488870B2 (en) * 2010-06-25 2013-07-16 Qualcomm Incorporated Multi-resolution, multi-window disparity estimation in 3D video processing
CN101945299B (zh) * 2010-07-09 2013-10-09 清华大学 一种基于拍摄设备阵列的动态场景深度恢复方法
US8655093B2 (en) * 2010-09-02 2014-02-18 Edge 3 Technologies, Inc. Method and apparatus for performing segmentation of an image
US9177381B2 (en) * 2010-12-22 2015-11-03 Nani Holdings IP, LLC Depth estimate determination, systems and methods
US8884949B1 (en) 2011-06-06 2014-11-11 Thibault Lambert Method and system for real time rendering of objects from a low resolution depth camera
US8941644B2 (en) 2011-06-14 2015-01-27 Microsoft Corporation Computing three-dimensional image models in parallel
CN102263954B (zh) * 2011-07-06 2014-01-29 北京航空航天大学 一种基于对象的快速分形视频压缩与解压缩方法
CN102291579B (zh) * 2011-07-06 2014-03-05 北京航空航天大学 一种快速的多目立体视频分形压缩与解压缩方法
CN102263952B (zh) * 2011-07-06 2013-12-11 北京航空航天大学 一种基于对象的快速双目立体视频分形压缩与解压缩方法
CN102263953B (zh) * 2011-07-06 2013-12-11 北京航空航天大学 一种基于对象的快速多目立体视频分形压缩与解压缩方法
CN102263951B (zh) * 2011-07-06 2014-03-05 北京航空航天大学 一种快速的分形视频压缩与解压缩方法
CN103647969B (zh) * 2011-07-06 2016-09-14 北京航空航天大学 一种基于对象的快速分形视频压缩与解压缩方法
CN102316323B (zh) * 2011-07-06 2014-03-05 北京航空航天大学 一种快速的双目立体视频分形压缩与解压缩方法
US8553998B1 (en) * 2011-08-16 2013-10-08 Google Inc. Depthmap compression using a primitive
US8553997B1 (en) * 2011-08-16 2013-10-08 Google Inc. Depthmap compression
US8749548B2 (en) * 2011-09-01 2014-06-10 Samsung Electronics Co., Ltd. Display system with image conversion mechanism and method of operation thereof
US9129378B2 (en) * 2011-09-07 2015-09-08 Thomson Licensing Method and apparatus for recovering a component of a distortion field and for determining a disparity field
JP2013073598A (ja) * 2011-09-29 2013-04-22 Sony Corp 画像処理装置、画像処理方法、及びプログラム
US8995755B2 (en) 2011-09-30 2015-03-31 Cyberlink Corp. Two-dimensional to stereoscopic conversion systems and methods
US8854724B2 (en) 2012-03-27 2014-10-07 Ostendo Technologies, Inc. Spatio-temporal directional light modulator
US8928969B2 (en) 2011-12-06 2015-01-06 Ostendo Technologies, Inc. Spatio-optical directional light modulator
JP5755571B2 (ja) * 2012-01-11 2015-07-29 シャープ株式会社 仮想視点画像生成装置、仮想視点画像生成方法、制御プログラム、記録媒体、および立体表示装置
US9924196B2 (en) 2012-05-18 2018-03-20 The Regents Of The University Of California Independent thread video disparity estimation method and codec
EP2669845A3 (en) * 2012-06-01 2014-11-19 Ricoh Company, Ltd. Target recognition system, target recognition method executed by the target recognition system, target recognition program executed on the target recognition system, and recording medium storing the target recognition program
DE102012209316A1 (de) * 2012-06-01 2013-12-05 Robert Bosch Gmbh Verfahren und Vorrichtung zum Verarbeiten von Sensordaten eines Stereosensorsystems
US9179126B2 (en) 2012-06-01 2015-11-03 Ostendo Technologies, Inc. Spatio-temporal light field cameras
CN102831637B (zh) * 2012-06-28 2015-08-26 北京理工大学 基于移动设备的三维重建方法
US9641821B2 (en) 2012-09-24 2017-05-02 Panasonic Intellectual Property Management Co., Ltd. Image signal processing device and image signal processing method
JP2014078095A (ja) 2012-10-10 2014-05-01 Sony Corp 画像処理装置、画像処理方法、及びプログラム
KR101885088B1 (ko) 2012-11-22 2018-08-06 삼성전자주식회사 깊이 영상을 이용한 컬러 영상 처리 장치 및 방법
US8964254B2 (en) 2013-04-03 2015-02-24 Hewlett-Packard Development Company, L.P. To generate a histogram matched image
EP2787319A1 (de) * 2013-04-05 2014-10-08 Leica Geosystems AG Steuerung einer Bildauslösung zur Luftbilderfassung in Nadir-Ausrichtung für ein unbemanntes Fluggerät
CN104123715B (zh) * 2013-04-27 2017-12-05 株式会社理光 配置视差值的方法和系统
US10341611B2 (en) 2013-04-30 2019-07-02 Inuitive Ltd. System and method for video conferencing
CN103310450B (zh) * 2013-06-17 2016-12-28 北京工业大学 一种融合直连通约束的图像分割方法
CN105659604B (zh) 2013-10-18 2018-12-21 Lg电子株式会社 在多视图视频编译中预测视图合成的方法和用于通过使用其构建合并候选列表的方法
US8760500B1 (en) * 2013-10-23 2014-06-24 Google Inc. Depth map generation
CN104021774B (zh) * 2014-05-29 2016-06-15 京东方科技集团股份有限公司 一种图像处理的方法及装置
KR102265315B1 (ko) 2015-04-17 2021-06-15 삼성전자주식회사 영상 광류를 추정하는 방법 및 이를 위한 장치
US10489970B2 (en) * 2015-11-06 2019-11-26 Microsoft Technology Licensing, Llc 2D image processing for extrusion into 3D objects
US10372968B2 (en) * 2016-01-22 2019-08-06 Qualcomm Incorporated Object-focused active three-dimensional reconstruction
US10582179B2 (en) 2016-02-01 2020-03-03 Samsung Electronics Co., Ltd. Method and apparatus for processing binocular disparity image
EP3427008B1 (en) 2016-03-11 2022-09-07 Kaarta, Inc. Laser scanner with real-time, online ego-motion estimation
US11573325B2 (en) 2016-03-11 2023-02-07 Kaarta, Inc. Systems and methods for improvements in scanning and mapping
US10989542B2 (en) 2016-03-11 2021-04-27 Kaarta, Inc. Aligning measured signal data with slam localization data and uses thereof
US11567201B2 (en) 2016-03-11 2023-01-31 Kaarta, Inc. Laser scanner with real-time, online ego-motion estimation
JP6991700B2 (ja) 2016-04-28 2022-01-12 キヤノン株式会社 情報処理装置、情報処理方法、プログラム
EP3252713A1 (en) * 2016-06-01 2017-12-06 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for performing 3d estimation based on locally determined 3d information hypotheses
EP3343506A1 (en) * 2016-12-28 2018-07-04 Thomson Licensing Method and device for joint segmentation and 3d reconstruction of a scene
US10885714B2 (en) * 2017-07-07 2021-01-05 Niantic, Inc. Cloud enabled augmented reality
WO2019099605A1 (en) 2017-11-17 2019-05-23 Kaarta, Inc. Methods and systems for geo-referencing mapping systems
WO2019165194A1 (en) * 2018-02-23 2019-08-29 Kaarta, Inc. Methods and systems for processing and colorizing point clouds and meshes
WO2019195270A1 (en) 2018-04-03 2019-10-10 Kaarta, Inc. Methods and systems for real or near real-time point cloud map data confidence evaluation
WO2020009826A1 (en) 2018-07-05 2020-01-09 Kaarta, Inc. Methods and systems for auto-leveling of point clouds and 3d models
US11023722B2 (en) * 2018-07-11 2021-06-01 International Business Machines Corporation Data classification bandwidth reduction
CN110889851B (zh) * 2018-09-11 2023-08-01 苹果公司 针对深度和视差估计的语义分割的稳健用途
CN110838148B (zh) * 2019-11-11 2023-05-05 杭州凌像科技有限公司 一种双目相机自标定方法
US11069071B1 (en) * 2020-01-21 2021-07-20 Compound Eye, Inc. System and method for egomotion estimation
KR102455833B1 (ko) * 2020-02-12 2022-10-19 한국전자통신연구원 변이 지도 개선 방법 및 장치
CN113256815B (zh) * 2021-02-24 2024-03-22 北京华清易通科技有限公司 虚拟现实场景融合及播放方法和虚拟现实设备
US12003697B2 (en) 2021-05-06 2024-06-04 Samsung Electronics Co., Ltd. Wearable electronic device and method of outputting three-dimensional image
KR20220151420A (ko) * 2021-05-06 2022-11-15 삼성전자주식회사 웨어러블 전자 장치 및 3d 이미지 출력 방법

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5179441A (en) * 1991-12-18 1993-01-12 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Near real-time stereo vision system
JPH09218954A (ja) * 1996-02-14 1997-08-19 Nippon Telegr & Teleph Corp <Ntt> 画像生成方法
JPH1023331A (ja) 1996-06-28 1998-01-23 Olympus Optical Co Ltd 画像処理装置
JPH1079029A (ja) * 1996-09-02 1998-03-24 Canon Inc 立体情報検出方法及びその装置
JP3017122B2 (ja) * 1997-04-03 2000-03-06 株式会社エイ・ティ・アール知能映像通信研究所 奥行き情報抽出装置および奥行き情報抽出方法
JP3728160B2 (ja) * 1999-12-06 2005-12-21 キヤノン株式会社 奥行き画像計測装置及び方法、並びに複合現実感提示システム
US6788809B1 (en) * 2000-06-30 2004-09-07 Intel Corporation System and method for gesture recognition in three dimensions using stereo imaging and color vision
US7227526B2 (en) 2000-07-24 2007-06-05 Gesturetek, Inc. Video-based image control system
US7031512B2 (en) 2002-04-18 2006-04-18 Stmicroelectronics, Inc. Method and system for 3D smoothing within the bound of error regions of matching curves
US6847728B2 (en) 2002-12-09 2005-01-25 Sarnoff Corporation Dynamic depth recovery from multiple synchronized video streams

Also Published As

Publication number Publication date
US20050286758A1 (en) 2005-12-29
US7324687B2 (en) 2008-01-29
CN100514367C (zh) 2009-07-15
CN1716316A (zh) 2006-01-04
JP2006012166A (ja) 2006-01-12
KR101143218B1 (ko) 2012-05-18
DE602005015649D1 (de) 2009-09-10
EP1612733A3 (en) 2007-05-09
EP1612733B1 (en) 2009-07-29
US7379583B2 (en) 2008-05-27
EP1612733A2 (en) 2006-01-04
ATE438160T1 (de) 2009-08-15
KR20060048642A (ko) 2006-05-18
US20050286757A1 (en) 2005-12-29

Similar Documents

Publication Publication Date Title
JP4740657B2 (ja) カラーセグメンテーションに基づくステレオ３次元再構成システムおよびプロセス
CN109479098B (zh) 多视图场景分割和传播
KR102709925B1 (ko) 투영 기반 메시 압축
JP4074062B2 (ja) ベクトル画像シーケンスにおける意味対象物の追跡
JP5985910B2 (ja) ホールレンダリングを用いるマルチビュー映像処理方法及び装置
US7046850B2 (en) Image matching
US8472709B2 (en) Apparatus and method for reducing artifacts in images
KR100583902B1 (ko) 이미지세그멘테이션
US8279930B2 (en) Image processing apparatus and method, program, and recording medium
US20100141651A1 (en) Synthesizing Detailed Depth Maps from Images
US7974470B2 (en) Method and apparatus for processing an image
US9786055B1 (en) Method and apparatus for real-time matting using local color estimation and propagation
US7522749B2 (en) Simultaneous optical flow estimation and image segmentation
Lo et al. Depth map super-resolution via Markov random fields without texture-copying artifacts
US20120014605A1 (en) Image processing apparatus, image processing method, and computer-readable recording medium
KR101316848B1 (ko) 배경 합성을 위한 자동 객체 분할 장치 및 방법
Kaviani et al. An adaptive patch-based reconstruction scheme for view synthesis by disparity estimation using optical flow
JP4796072B2 (ja) 画像セグメンテーションに基づく画像レンダリング
US20120014606A1 (en) Image processing apparatus, image processing method, and computer-readable recording medium
CN103618904B (zh) 基于像素的运动估计方法及装置
JP2005517257A (ja) セグメント化装置及び方法
Chiu et al. Voting-based depth map refinement and propagation for 2D to 3D conversion
Oh et al. Robust stereo matching with improved graph and surface models and occlusion handling
WO2024185093A1 (ja) 処理装置、処理方法、及び処理プログラム
CN119790429A (zh) 一种视频脏点检测的方法、设备及电子设备

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20080623

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20080623

RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20090901

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20091008

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20101105

A524 Written submission of copy of amendment under article 19 pct

Free format text: JAPANESE INTERMEDIATE CODE: A524

Effective date: 20110207

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20110407

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20110502

R150 Certificate of patent or registration of utility model

Ref document number: 4740657

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20140513

Year of fee payment: 3

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313113

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees