JPWO2020004013A1 - 画像処理装置および画像処理方法 - Google Patents

画像処理装置および画像処理方法 Download PDF

Info

Publication number
JPWO2020004013A1
JPWO2020004013A1 JP2020527368A JP2020527368A JPWO2020004013A1 JP WO2020004013 A1 JPWO2020004013 A1 JP WO2020004013A1 JP 2020527368 A JP2020527368 A JP 2020527368A JP 2020527368 A JP2020527368 A JP 2020527368A JP WO2020004013 A1 JPWO2020004013 A1 JP WO2020004013A1
Authority
JP
Japan
Prior art keywords
image
viewpoint
data
viewing
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
JP2020527368A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2020004013A5 (enExample
Inventor
高橋　宏彰
宏彰 高橋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Sony Group Corp
Original Assignee
Sony Corp
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp, Sony Group Corp filed Critical Sony Corp
Publication of JPWO2020004013A1 publication Critical patent/JPWO2020004013A1/ja
Publication of JPWO2020004013A5 publication Critical patent/JPWO2020004013A5/ja
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/04—Texture mapping
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20004—Adaptive image processing
    • G06T2207/20012—Locally adaptive
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Geometry (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Databases & Information Systems (AREA)
  • Image Generation (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
JP2020527368A 2018-06-25 2019-06-11 画像処理装置および画像処理方法 Abandoned JPWO2020004013A1 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2018119438 2018-06-25
JP2018119438 2018-06-25
PCT/JP2019/023107 WO2020004013A1 (ja) 2018-06-25 2019-06-11 画像処理装置および画像処理方法

Publications (2)

Publication Number Publication Date
JPWO2020004013A1 true JPWO2020004013A1 (ja) 2021-08-02
JPWO2020004013A5 JPWO2020004013A5 (enExample) 2022-04-25

Family

ID=68984838

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020527368A Abandoned JPWO2020004013A1 (ja) 2018-06-25 2019-06-11 画像処理装置および画像処理方法

Country Status (5)

Country Link
US (1) US20210233303A1 (enExample)
EP (1) EP3813024A4 (enExample)
JP (1) JPWO2020004013A1 (enExample)
CN (1) CN112352264A (enExample)
WO (1) WO2020004013A1 (enExample)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10733800B2 (en) * 2018-09-17 2020-08-04 Facebook Technologies, Llc Reconstruction of essential visual cues in mixed reality applications
US11620789B2 (en) * 2019-05-03 2023-04-04 Novocure Gmbh Methods, systems, and apparatuses for managing transducer array placement
KR102770795B1 (ko) * 2019-09-09 2025-02-21 삼성전자주식회사 3d 렌더링 방법 및 장치
KR102702493B1 (ko) 2020-03-01 2024-09-05 레이아 인코포레이티드 멀티뷰 스타일 전이 시스템 및 방법
JP7434032B2 (ja) * 2020-03-31 2024-02-20 キヤノン株式会社 情報処理装置、情報処理方法、およびプログラム
US12579729B2 (en) * 2021-04-07 2026-03-17 Interdigital Ce Patent Holdings, Sas Volumetric video supporting light effects
CN114627223B (zh) * 2022-03-04 2025-03-18 华南师范大学 一种自由视点视频合成方法、装置、电子设备及存储介质
JP7501559B2 (ja) * 2022-03-17 2024-06-18 株式会社リコー 表示端末、表示方法、通信システム、通信方法、及びプログラム
US12175602B2 (en) 2022-08-19 2024-12-24 Meta Platforms Technologies, Llc Method of generating a virtual environment by scanning a real-world environment with a first device and displaying the virtual environment on a second device
WO2024053288A1 (ja) * 2022-09-07 2024-03-14 株式会社Ｎｔｔドコモ ３次元データリダクション装置、及び非一過性の記録媒体
US12518307B1 (en) 2022-09-07 2026-01-06 Meta Platforms Technologies, Llc Human body scanning for size recommendation
US12626470B1 (en) 2023-07-03 2026-05-12 Meta Platforms Technologies, Llc Artificial reality room capture realignment
JPWO2025047368A1 (enExample) * 2023-08-29 2025-03-06
US12661585B2 (en) 2023-11-01 2026-06-23 Meta Platforms Technologies, Llc Accessing artificial reality content through a handheld device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5011224B2 (ja) * 2008-07-09 2012-08-29 日本放送協会 任意視点映像生成装置及び任意視点映像生成プログラム
US10484697B2 (en) * 2014-09-09 2019-11-19 Qualcomm Incorporated Simultaneous localization and mapping for video coding

Also Published As

Publication number Publication date
EP3813024A4 (en) 2022-01-05
CN112352264A (zh) 2021-02-09
US20210233303A1 (en) 2021-07-29
EP3813024A1 (en) 2021-04-28
WO2020004013A1 (ja) 2020-01-02

Similar Documents

Publication Publication Date Title
EP3813024A1 (en) Image processing device and image processing method
US10600233B2 (en) Parameterizing 3D scenes for volumetric viewing
US20250227297A1 (en) Three-dimensional data encoding method, three-dimensional data decoding method, three-dimensional data encoding device, and three-dimensional data decoding device
US10652517B2 (en) Virtual reality 360-degree video camera system for live streaming
US10567464B2 (en) Video compression with adaptive view-dependent lighting removal
US10419737B2 (en) Data structures and delivery methods for expediting virtual reality playback
US10341632B2 (en) Spatial random access enabled video system with a three-dimensional viewing volume
US20200051269A1 (en) Hybrid depth sensing pipeline
TWI691197B (zh) 用於全視差光場壓縮之預處理器
US8941750B2 (en) Image processing device for generating reconstruction image, image generating method, and storage medium
US20210152848A1 (en) Image processing device, image processing method, program, and image transmission system
US20180035134A1 (en) Encoding and decoding virtual reality video
JP3996630B2 (ja) 画像変換方法、テクスチャマッピング方法、画像変換装置、サーバークライアントシステム、画像変換プログラム、影認識方法および影認識装置
JP2020513703A (ja) 自由視点映像ストリーミング用の復号器中心ｕｖコーデック
US20180310025A1 (en) Method and technical equipment for encoding media content
WO2019124248A1 (ja) 画像処理装置、コンテンツ処理装置、コンテンツ処理システム、および画像処理方法
JPWO2020004013A5 (enExample)
WO2020184174A1 (ja) 画像処理装置および画像処理方法
JP6575999B2 (ja) 照明情報取得装置、照明復元装置、およびこれらのプログラム
GB2565301A (en) Three-dimensional video processing
JP2008510357A (ja) 画像のエンコーディング方法、エンコーディング装置、画像のデコーディング方法及びデコーディング装置
US20260045023A1 (en) Information processing system, operation method of information processing system, and program
JP2014164497A (ja) 画像処理装置、画像処理方法及びプログラム
JP7389565B2 (ja) 符号化装置、復号装置、及びプログラム
JP2023072296A (ja) 情報処理装置および方法

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220415

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220415

A762 Written abandonment of application

Free format text: JAPANESE INTERMEDIATE CODE: A762

Effective date: 20221012