JP6812803B2 - 情報処理装置、情報処理方法、およびプログラム - Google Patents

情報処理装置、情報処理方法、およびプログラム Download PDF

Info

Publication number
JP6812803B2
JP6812803B2 JP2017003423A JP2017003423A JP6812803B2 JP 6812803 B2 JP6812803 B2 JP 6812803B2 JP 2017003423 A JP2017003423 A JP 2017003423A JP 2017003423 A JP2017003423 A JP 2017003423A JP 6812803 B2 JP6812803 B2 JP 6812803B2
Authority
JP
Japan
Prior art keywords
video
arrangement
user
information processing
change
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017003423A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018113616A5 (enExample
JP2018113616A (ja
Inventor
石川　毅
毅 石川
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Priority to JP2017003423A priority Critical patent/JP6812803B2/ja
Priority to US15/840,742 priority patent/US10356382B2/en
Priority to CN201810011539.5A priority patent/CN108304063B/zh
Priority to EP18161210.2A priority patent/EP3383036A3/en
Publication of JP2018113616A publication Critical patent/JP2018113616A/ja
Priority to US16/444,122 priority patent/US10516870B2/en
Publication of JP2018113616A5 publication Critical patent/JP2018113616A5/ja
Application granted granted Critical
Publication of JP6812803B2 publication Critical patent/JP6812803B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals
    • H04N13/279—Image signal generators from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals the virtual viewpoint locations being selected by the viewers or determined by tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/178—Metadata, e.g. disparity information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/189—Recording image signals; Reproducing recorded image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/61—Scene description
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/024—Multi-user, collaborative environment
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2024—Style variation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Library & Information Science (AREA)
  • Human Computer Interaction (AREA)
  • Architecture (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
JP2017003423A 2017-01-12 2017-01-12 情報処理装置、情報処理方法、およびプログラム Active JP6812803B2 (ja)

Priority Applications (5)

Application Number Priority Date Filing Date Title
JP2017003423A JP6812803B2 (ja) 2017-01-12 2017-01-12 情報処理装置、情報処理方法、およびプログラム
US15/840,742 US10356382B2 (en) 2017-01-12 2017-12-13 Information processing device, information processing method, and program
CN201810011539.5A CN108304063B (zh) 2017-01-12 2018-01-05 信息处理装置、信息处理方法和计算机可读介质
EP18161210.2A EP3383036A3 (en) 2017-01-12 2018-03-12 Information processing device, information processing method, and program
US16/444,122 US10516870B2 (en) 2017-01-12 2019-06-18 Information processing device, information processing method, and program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2017003423A JP6812803B2 (ja) 2017-01-12 2017-01-12 情報処理装置、情報処理方法、およびプログラム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2020209641A Division JP7044149B2 (ja) 2020-12-17 2020-12-17 情報処理装置、情報処理方法、およびプログラム

Publications (3)

Publication Number Publication Date
JP2018113616A JP2018113616A (ja) 2018-07-19
JP2018113616A5 JP2018113616A5 (enExample) 2020-02-13
JP6812803B2 true JP6812803B2 (ja) 2021-01-13

Family

ID=61691224

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017003423A Active JP6812803B2 (ja) 2017-01-12 2017-01-12 情報処理装置、情報処理方法、およびプログラム

Country Status (4)

Country Link
US (2) US10356382B2 (enExample)
EP (1) EP3383036A3 (enExample)
JP (1) JP6812803B2 (enExample)
CN (1) CN108304063B (enExample)

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10607654B2 (en) * 2017-02-09 2020-03-31 Verizon Patent And Licensing Inc. Using sharding to generate virtual reality content
US10916066B2 (en) * 2018-04-20 2021-02-09 Edx Technologies, Inc. Methods of virtual model modification
JP6707111B2 (ja) * 2018-07-25 2020-06-10 株式会社バーチャルキャスト ３次元コンテンツ配信システム、３次元コンテンツ配信方法、コンピュータプログラム
CN109857249A (zh) * 2019-01-09 2019-06-07 重庆爱奇艺智能科技有限公司 一种用于生成虚拟化身形象的方法与装置
WO2020159891A1 (en) * 2019-01-28 2020-08-06 Lecamus Russell Custom generated real-time media on demand
WO2020162218A1 (ja) 2019-02-08 2020-08-13 ソニー株式会社 再生装置、および再生方法、並びにプログラム
JP6900419B2 (ja) * 2019-04-10 2021-07-07 グリー株式会社 動画配信システム、動画配信方法および動画配信プログラム
US12217409B2 (en) * 2019-04-23 2025-02-04 Sony Group Corporation Information processing device and information processing method
JP2021018474A (ja) * 2019-07-17 2021-02-15 株式会社デンソー 情報処理システム
KR102760283B1 (ko) * 2019-07-25 2025-02-03 엘지전자 주식회사 멀티미디어 디바이스 및 그 제어 방법
JP7392377B2 (ja) * 2019-10-10 2023-12-06 沖電気工業株式会社 機器、情報処理方法、プログラム、情報処理システムおよび情報処理システムの方法
CN111510671A (zh) * 2020-03-13 2020-08-07 海信集团有限公司 一种监控视频调取显示的方法及智能终端
US11907412B2 (en) * 2020-09-28 2024-02-20 International Business Machines Corporation Contextual spectator inclusion in a virtual reality experience
JP7129463B2 (ja) * 2020-12-21 2022-09-01 グリー株式会社 コンピュータプログラム、方法、及び、サーバ装置
WO2022201509A1 (ja) * 2021-03-26 2022-09-29 ソニーグループ株式会社 情報処理装置、情報処理方法、およびプログラム
JP7843123B2 (ja) * 2021-09-30 2026-04-09 株式会社デンソーテン 情報処理装置、情報処理方法および情報処理プログラム
JP7138317B1 (ja) * 2022-02-21 2022-09-16 株式会社4Colors 動画生成システム、動画生成プログラム、及び、動画生成方法
CN116726495B (zh) * 2022-03-01 2026-07-07 腾讯科技（深圳）有限公司 基于虚拟环境的交互方法、装置、设备、介质及程序产品
US20230384788A1 (en) * 2022-05-31 2023-11-30 Ricoh Company, Ltd. Information processing device, information processing system, information processing method, and recording medium storing program
US12155967B2 (en) 2022-06-20 2024-11-26 International Business Machines Corporation Contextual positioning in virtual space
US12236539B2 (en) * 2022-06-20 2025-02-25 International Business Machines Corporation Contextual positioning in virtual space
WO2024205075A1 (ko) * 2023-03-31 2024-10-03 삼성전자주식회사 화면을 생성하기 위한 렌더링 데이터를 외부 전자 장치에게 송신하기 위한 전자 장치, 방법, 및 비-일시적 컴퓨터 판독 가능 저장 매체
CN120917759A (zh) * 2023-05-01 2025-11-07 索尼集团公司 信息处理装置、方法和程序

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3594181B2 (ja) * 2000-01-27 2004-11-24 株式会社ナムコ ゲーム装置及び当該ゲーム制御方法、記録媒体
US7925703B2 (en) * 2000-12-26 2011-04-12 Numedeon, Inc. Graphical interactive interface for immersive online communities
US20030117397A1 (en) * 2001-12-21 2003-06-26 Hubrecht Alain Yves Nestor Systems and methods for generating virtual reality (VR) file(s) for complex virtual environments
GB2404546B (en) * 2003-07-25 2005-12-14 Purple Interactive Ltd A method of organising and displaying material content on a display to a viewer
JP4307310B2 (ja) * 2004-03-31 2009-08-05 任天堂株式会社 ゲーム装置及びゲームプログラム
JP4546151B2 (ja) * 2004-05-26 2010-09-15 株式会社日立製作所 音声コミュニケーション・システム
US8588465B2 (en) 2009-01-30 2013-11-19 Microsoft Corporation Visual target tracking
US8267781B2 (en) * 2009-01-30 2012-09-18 Microsoft Corporation Visual target tracking
US8942428B2 (en) * 2009-05-01 2015-01-27 Microsoft Corporation Isolate extraneous motions
KR101671900B1 (ko) * 2009-05-08 2016-11-03 삼성전자주식회사 가상 세계에서의 객체를 제어하는 시스템, 방법 및 기록 매체
US20100306716A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Extending standard gestures
US8284157B2 (en) * 2010-01-15 2012-10-09 Microsoft Corporation Directed performance in motion capture system
US8334842B2 (en) * 2010-01-15 2012-12-18 Microsoft Corporation Recognizing user intent in motion capture system
CN103460256B (zh) * 2011-03-29 2016-09-14 高通股份有限公司 在扩增现实系统中将虚拟图像锚定到真实世界表面
US8823699B2 (en) * 2011-05-16 2014-09-02 International Business Machines Corporation Getting snapshots in immersible 3D scene recording in virtual world
JP5891131B2 (ja) 2012-07-11 2016-03-22 株式会社ソニー・コンピュータエンタテインメント 画像生成装置および画像生成方法
KR102021857B1 (ko) * 2013-07-23 2019-09-17 엘지전자 주식회사 이동 단말기 및 그의 파노라마 촬영방법
CN105980962B (zh) 2014-02-17 2019-07-23 索尼公司 信息处理设备和信息处理方法
US10203762B2 (en) * 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
US9226090B1 (en) * 2014-06-23 2015-12-29 Glen A. Norris Sound localization for an electronic call
US10248285B2 (en) * 2014-09-10 2019-04-02 Utherverse Digital Inc. Immersive displays
US20160150212A1 (en) 2014-11-26 2016-05-26 Sony Corporation Live selective adaptive bandwidth
JP5869712B1 (ja) * 2015-04-08 2016-02-24 株式会社コロプラ 没入型仮想空間に実空間のユーザの周辺環境を提示するためのヘッドマウント・ディスプレイ・システムおよびコンピュータ・プログラム
US9704298B2 (en) * 2015-06-23 2017-07-11 Paofit Holdings Pte Ltd. Systems and methods for generating 360 degree mixed reality environments
JP2018010788A (ja) * 2016-07-13 2018-01-18 オムロン株式会社 多光軸光電センサ
CN106249882B (zh) * 2016-07-26 2022-07-12 华为技术有限公司 一种应用于vr设备的手势操控方法与装置
US10699461B2 (en) * 2016-12-20 2020-06-30 Sony Interactive Entertainment LLC Telepresence of multiple users in interactive virtual space

Also Published As

Publication number Publication date
US20190306483A1 (en) 2019-10-03
JP2018113616A (ja) 2018-07-19
US10356382B2 (en) 2019-07-16
CN108304063A (zh) 2018-07-20
EP3383036A3 (en) 2018-12-26
US20180199023A1 (en) 2018-07-12
CN108304063B (zh) 2022-04-29
US10516870B2 (en) 2019-12-24
EP3383036A2 (en) 2018-10-03

Similar Documents

Publication Publication Date Title
US10516870B2 (en) Information processing device, information processing method, and program
US10078917B1 (en) Augmented reality simulation
JP7523615B2 (ja) 拡張現実表示装置及び拡張現実表示方法
US9779538B2 (en) Real-time content immersion system
JP7722373B2 (ja) 情報処理装置、情報処理方法、および情報処理システム
JP6511386B2 (ja) 情報処理装置および画像生成方法
US12022357B1 (en) Content presentation and layering across multiple devices
JP6298563B1 (ja) ヘッドマウントデバイスによって仮想空間を提供するためのプログラム、方法、および当該プログラムを実行するための情報処理装置
US11521346B2 (en) Image processing apparatus, image processing method, and storage medium
JP2019087226A (ja) 情報処理装置、情報処理システムおよび表情画像出力方法
US20230179756A1 (en) Information processing device, information processing method, and program
CN107533833A (zh) 头戴式显示器、信息处理装置、信息处理系统和内容数据输出方法
JP7512488B2 (ja) 画像処理装置、画像処理方法及び画像処理システム
US20220030210A1 (en) Information processing system, information processing method, and computer program
JP6454883B1 (ja) コンテンツ配信システム、コンテンツ配信方法およびコンテンツ配信プログラム
WO2020017435A1 (ja) 情報処理装置、情報処理方法、およびプログラム
US12477040B2 (en) Systems, methods, and media for controlling shared extended reality presentations
JP7044149B2 (ja) 情報処理装置、情報処理方法、およびプログラム
JP2019012509A (ja) ヘッドマウントデバイスによって仮想空間を提供するためのプログラム、方法、および当該プログラムを実行するための情報処理装置
JP2020530218A (ja) 没入型視聴覚コンテンツを投影する方法
CN113485547A (zh) 一种应用于全息沙盘的交互方法及装置
US20240273758A1 (en) Information processing device and image genaration method
JP6875029B1 (ja) 方法、プログラム、情報処理装置
JP2024031113A (ja) 情報処理装置および画像生成方法
JP2018190390A (ja) 仮想空間を提供するための方法、および当該方法をコンピュータに実行させるためのプログラム、および当該プログラムを実行するための情報処理装置

Legal Events

Date Code Title Description
RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20190208

RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20190214

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20190222

RD02 Notification of acceptance of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7422

Effective date: 20190515

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20190522

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20191224

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20191224

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20200811

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20200908

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201104

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20201117

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20201130

R151 Written notification of patent or utility model registration

Ref document number: 6812803

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151