TWI800513B - 基於紋理圖與網格之3d影像資訊的處理 - Google Patents

基於紋理圖與網格之3d影像資訊的處理 Download PDF

Info

Publication number
TWI800513B
TWI800513B TW107121041A TW107121041A TWI800513B TW I800513 B TWI800513 B TW I800513B TW 107121041 A TW107121041 A TW 107121041A TW 107121041 A TW107121041 A TW 107121041A TW I800513 B TWI800513 B TW I800513B
Authority
TW
Taiwan
Prior art keywords
meshes
processing
image information
information based
texture maps
Prior art date
Application number
TW107121041A
Other languages
English (en)
Other versions
TW201921921A (zh
Inventor
克莉斯汀 維爾甘
巴特 庫倫
派崔克 路克 艾爾斯 凡德沃爾
Original Assignee
荷蘭商皇家飛利浦有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 荷蘭商皇家飛利浦有限公司 filed Critical 荷蘭商皇家飛利浦有限公司
Publication of TW201921921A publication Critical patent/TW201921921A/zh
Application granted granted Critical
Publication of TWI800513B publication Critical patent/TWI800513B/zh

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/161Encoding, multiplexing or demultiplexing different image signal components
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/04Texture mapping
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20Finite element generation, e.g. wire-frame surface description, tesselation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/111Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194Transmission of image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117Filters, e.g. for pre-processing or post-processing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/04Indexing scheme for image data processing or generation, in general involving 3D image data

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Image Generation (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Processing Or Creating Images (AREA)
TW107121041A 2017-06-23 2018-06-20 基於紋理圖與網格之3d影像資訊的處理 TWI800513B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP17177649.5A EP3419286A1 (en) 2017-06-23 2017-06-23 Processing of 3d image information based on texture maps and meshes
??17177649.5 2017-06-23
EP17177649.5 2017-06-23

Publications (2)

Publication Number Publication Date
TW201921921A TW201921921A (zh) 2019-06-01
TWI800513B true TWI800513B (zh) 2023-05-01

Family

ID=59152789

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107121041A TWI800513B (zh) 2017-06-23 2018-06-20 基於紋理圖與網格之3d影像資訊的處理

Country Status (9)

Country Link
US (1) US11189079B2 (zh)
EP (2) EP3419286A1 (zh)
JP (1) JP7181233B2 (zh)
KR (1) KR102538939B1 (zh)
CN (1) CN110999285B (zh)
BR (1) BR112019027116A2 (zh)
RU (1) RU2764187C2 (zh)
TW (1) TWI800513B (zh)
WO (1) WO2018234258A1 (zh)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019046821A1 (en) * 2017-09-01 2019-03-07 Magic Leap, Inc. GENERATING A NEW FRAME USING REBUILDED CONTENT AND UNRESTITUDED CONTENT FROM A PREVIOUS PERSPECTIVE
EP3509308A1 (en) 2018-01-05 2019-07-10 Koninklijke Philips N.V. Apparatus and method for generating an image data bitstream
GB2582315B (en) 2019-03-19 2023-05-17 Sony Interactive Entertainment Inc Method and system for generating an image
EP3712843A1 (en) 2019-03-19 2020-09-23 Koninklijke Philips N.V. Image signal representing a scene
US11217011B2 (en) * 2019-04-19 2022-01-04 Facebook Technologies, Llc. Providing semantic-augmented artificial-reality experience
US12020363B2 (en) * 2021-03-29 2024-06-25 Tetavi Ltd. Surface texturing from multiple cameras
US12008806B2 (en) 2021-08-19 2024-06-11 Meta Platforms Technologies, Llc Methods and systems to allow three-dimensional map sharing between heterogeneous computing systems, cross-localization, and sharing content in three-dimensional space
US20230162404A1 (en) * 2021-11-22 2023-05-25 Tencent America LLC Decoding of patch temporal alignment for mesh compression
CN114140569B (zh) * 2022-01-27 2022-04-26 山东捷瑞数字科技股份有限公司 一种三维场景序列化压缩方法
WO2024105530A1 (en) * 2022-11-15 2024-05-23 Fitix Visualization Ltd. System and method for creating 3d model data
WO2024107872A1 (en) * 2022-11-15 2024-05-23 Google Llc Real-time view synthesis
WO2024129727A1 (en) * 2022-12-12 2024-06-20 Google Llc Real-time view synthesis
CN117974817B (zh) * 2024-04-02 2024-06-21 江苏狄诺尼信息技术有限责任公司 基于图像编码的三维模型纹理数据高效压缩方法及系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130095920A1 (en) * 2011-10-13 2013-04-18 Microsoft Corporation Generating free viewpoint video using stereo imaging
US20140132601A1 (en) * 2012-11-09 2014-05-15 Sony Computer Entertainment Europe Limited System and method of image rendering
US20160073117A1 (en) * 2014-09-09 2016-03-10 Qualcomm Incorporated Simultaneous localization and mapping for video coding

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6124864A (en) * 1997-04-07 2000-09-26 Synapix, Inc. Adaptive modeling and segmentation of visual image streams
DE60126387D1 (de) 2000-10-27 2007-03-22 Canon Kk Bilderzeugungsverfahren und Bilderzeugungsgerät
RU2237283C2 (ru) * 2001-11-27 2004-09-27 Самсунг Электроникс Ко., Лтд. Устройство и способ представления трехмерного объекта на основе изображений с глубиной
KR100731979B1 (ko) 2005-10-18 2007-06-25 전자부품연구원 다시점 정방향 카메라 구조 기반의 메쉬를 이용한 중간영상 합성 방법 및 장치와 이를 구현하는 기능을실현시키기 위한 프로그램을 기록한 컴퓨터로 읽을 수 있는기록 매체
TWI348120B (en) 2008-01-21 2011-09-01 Ind Tech Res Inst Method of synthesizing an image with multi-view images
US8913657B2 (en) * 2008-10-27 2014-12-16 Lg Electronics Inc. Virtual view image synthesis method and apparatus
CN101626509B (zh) * 2009-08-10 2011-02-02 北京工业大学 三维网格编码、解码方法及编码、解码装置
EP2478708A2 (en) * 2009-09-18 2012-07-25 Logos Technologies Inc. Method for the compression of an aerial image using an image prediction based on a depth model of the terrain
RU2467395C1 (ru) * 2011-07-11 2012-11-20 Российская Федерация, От Имени Которой Выступает Министерство Промышленности И Торговли Российской Федерации Способ создания изображений трехмерных объектов для систем реального времени
CN102625126B (zh) * 2012-03-22 2014-10-15 北京工业大学 一种基于预测的三维网格编码方法
KR101429349B1 (ko) * 2012-09-18 2014-08-12 연세대학교 산학협력단 중간 시점 영상 합성 장치 및 방법과 이에 관한 기록매체
US20140092439A1 (en) * 2012-09-28 2014-04-03 Scott A. Krig Encoding images using a 3d mesh of polygons and corresponding textures
US10163247B2 (en) * 2015-07-14 2018-12-25 Microsoft Technology Licensing, Llc Context-adaptive allocation of render model resources
WO2018042388A1 (en) * 2016-09-02 2018-03-08 Artomatix Ltd. Systems and methods for providing convolutional neural network based image synthesis using stable and controllable parametric models, a multiscale synthesis framework and novel network architectures
WO2018104102A1 (en) 2016-12-06 2018-06-14 Koninklijke Philips N.V. Apparatus and method for generating a light intensity image
US10026218B1 (en) * 2017-11-01 2018-07-17 Pencil and Pixel, Inc. Modeling indoor scenes based on digital images
EP3509308A1 (en) * 2018-01-05 2019-07-10 Koninklijke Philips N.V. Apparatus and method for generating an image data bitstream

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130095920A1 (en) * 2011-10-13 2013-04-18 Microsoft Corporation Generating free viewpoint video using stereo imaging
US20140132601A1 (en) * 2012-11-09 2014-05-15 Sony Computer Entertainment Europe Limited System and method of image rendering
US20160073117A1 (en) * 2014-09-09 2016-03-10 Qualcomm Incorporated Simultaneous localization and mapping for video coding

Also Published As

Publication number Publication date
KR102538939B1 (ko) 2023-06-01
RU2020102462A3 (zh) 2021-08-25
BR112019027116A2 (pt) 2020-07-07
JP7181233B2 (ja) 2022-11-30
CN110999285A (zh) 2020-04-10
EP3643059B1 (en) 2022-03-30
RU2764187C2 (ru) 2022-01-14
CN110999285B (zh) 2023-02-28
EP3643059A1 (en) 2020-04-29
RU2020102462A (ru) 2021-07-26
WO2018234258A1 (en) 2018-12-27
US20210150802A1 (en) 2021-05-20
EP3419286A1 (en) 2018-12-26
KR20200020879A (ko) 2020-02-26
TW201921921A (zh) 2019-06-01
JP2020524851A (ja) 2020-08-20
US11189079B2 (en) 2021-11-30

Similar Documents

Publication Publication Date Title
TWI800513B (zh) 基於紋理圖與網格之3d影像資訊的處理
EP3440626A4 (en) MODIFICATION AND IMPROVEMENT OF IMAGE USING RECOGNITION BASED ON THREE-DIMENSIONAL OBJECT MODEL
EP4023418A4 (en) 3D OBJECT DATA LAYER PROCESSING METHOD AND 3D PRINTING DEVICE
EP3423858A4 (en) SYSTEM AND METHOD FOR 3D IMAGING
EP3349107A4 (en) INFORMATION PROCESSING DEVICE AND PICTURE PRODUCTION METHOD
EP3737295A4 (en) THREE-DIMENSIONAL IMAGING AND ULTRASOUND IMAGE DATA MODELING
EP3349183A4 (en) INFORMATION PROCESSING DEVICE AND PICTURE PRODUCTION METHOD
EP3647853A4 (en) DISPLAY SYSTEM AND IMAGE DISPLAY METHOD
EP3549096A4 (en) SYSTEMS AND METHOD FOR RIM REINFORCEMENT IN PICTURES
EP3411818A4 (en) SYSTEM AND METHOD FOR PROCESSING IMAGE TO GENERATE A THREE-DIMENSIONAL (3D) VIEW OF AN ANATOMICAL PART
EP3694216A4 (en) IMAGE DISPLAY SYSTEM AND IMAGE DISPLAY METHOD
EP3850584A4 (en) MULTISCALE IMAGE RECONSTRUCTION OF THREE-DIMENSIONAL OBJECTS
EP3596588A4 (en) GRADUAL TRANSITION BETWEEN TWO-DIMENSIONAL AND THREE-DIMENSIONAL IMAGES OF THE EXTENDED REALITY
EP3644617A4 (en) IMAGE DISPLAY SYSTEM AND IMAGE DISPLAY METHOD
EP3682629A4 (en) IMAGE PROCESSING AND PRESENTATION
EP3497654A4 (en) METHODS AND SYSTEMS FOR DISPLAYING INFORMATION FROM THREE-DIMENSIONAL DIGITAL ASSETS
EP3485462A4 (en) IMAGE PROCESSING TO OBTAIN ENVIRONMENTAL INFORMATION
EP3410387A4 (en) INFORMATION PROCESSOR AND INFORMATION PROCESSING METHOD
GB2575137B (en) An image sensor and an image dynamic information processing method
EP3651471A4 (en) IMAGE PROCESSING SYSTEM AND METHOD
EP3454759A4 (en) SYSTEMS AND METHODS FOR DETERMINING STRUCTURE DIMENSIONS IN MEDICAL IMAGES
EP3693811A4 (en) HOLOGRAPHIC DISPLAY AND HOLOGRAPHIC IMAGE FORMING METHOD
EP3204892A4 (en) Systems and methods of dynamic image segmentation
EP3296940A4 (en) Virtual reality system and information processing system
EP3722876A4 (en) IMAGE DISPLAY SYSTEM AND IMAGE DISPLAY METHOD