JP5891125B2 - 映像処理装置、映像処理方法、および映像処理システム - Google Patents

映像処理装置、映像処理方法、および映像処理システム Download PDF

Info

Publication number
JP5891125B2
JP5891125B2 JP2012147344A JP2012147344A JP5891125B2 JP 5891125 B2 JP5891125 B2 JP 5891125B2 JP 2012147344 A JP2012147344 A JP 2012147344A JP 2012147344 A JP2012147344 A JP 2012147344A JP 5891125 B2 JP5891125 B2 JP 5891125B2
Authority
JP
Japan
Prior art keywords
image
marker
proximity
interaction
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2012147344A
Other languages
English (en)
Japanese (ja)
Other versions
JP2014010664A5 (enExample
JP2014010664A (ja
Inventor
良徳 大橋
良徳 大橋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment Inc
Original Assignee
Sony Interactive Entertainment Inc
Sony Computer Entertainment Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to JP2012147344A priority Critical patent/JP5891125B2/ja
Application filed by Sony Interactive Entertainment Inc, Sony Computer Entertainment Inc filed Critical Sony Interactive Entertainment Inc
Priority to US14/406,919 priority patent/US9639989B2/en
Priority to PCT/JP2013/002605 priority patent/WO2014002346A1/ja
Priority to EP13810089.6A priority patent/EP2869274A4/en
Priority to CN201380032960.XA priority patent/CN104380347B/zh
Priority to CN201711039232.8A priority patent/CN107844196B/zh
Publication of JP2014010664A publication Critical patent/JP2014010664A/ja
Publication of JP2014010664A5 publication Critical patent/JP2014010664A5/ja
Application granted granted Critical
Publication of JP5891125B2 publication Critical patent/JP5891125B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/74—Projection arrangements for image reproduction, e.g. using eidophor
    • H04N5/7475—Constructional details of television projection apparatus
    • H04N5/7491—Constructional details of television projection apparatus of head mounted projectors

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Optics & Photonics (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Controls And Circuits For Display Device (AREA)
JP2012147344A 2012-06-29 2012-06-29 映像処理装置、映像処理方法、および映像処理システム Active JP5891125B2 (ja)

Priority Applications (6)

Application Number Priority Date Filing Date Title
JP2012147344A JP5891125B2 (ja) 2012-06-29 2012-06-29 映像処理装置、映像処理方法、および映像処理システム
PCT/JP2013/002605 WO2014002346A1 (ja) 2012-06-29 2013-04-17 映像処理装置、映像処理方法、および映像処理システム
EP13810089.6A EP2869274A4 (en) 2012-06-29 2013-04-17 VIDEO PROCESSING DEVICE, VIDEO PROCESSING METHOD AND VIDEO PROCESSING SYSTEM
CN201380032960.XA CN104380347B (zh) 2012-06-29 2013-04-17 视频处理设备、视频处理方法和视频处理系统
US14/406,919 US9639989B2 (en) 2012-06-29 2013-04-17 Video processing device, video processing method, and video processing system
CN201711039232.8A CN107844196B (zh) 2012-06-29 2013-04-17 视频处理设备、视频处理方法和视频处理系统

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2012147344A JP5891125B2 (ja) 2012-06-29 2012-06-29 映像処理装置、映像処理方法、および映像処理システム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2016031175A Division JP6161749B2 (ja) 2016-02-22 2016-02-22 映像処理装置、映像処理方法、および映像処理システム

Publications (3)

Publication Number Publication Date
JP2014010664A JP2014010664A (ja) 2014-01-20
JP2014010664A5 JP2014010664A5 (enExample) 2015-07-16
JP5891125B2 true JP5891125B2 (ja) 2016-03-22

Family

ID=49782553

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2012147344A Active JP5891125B2 (ja) 2012-06-29 2012-06-29 映像処理装置、映像処理方法、および映像処理システム

Country Status (5)

Country Link
US (1) US9639989B2 (enExample)
EP (1) EP2869274A4 (enExample)
JP (1) JP5891125B2 (enExample)
CN (2) CN104380347B (enExample)
WO (1) WO2014002346A1 (enExample)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5891125B2 (ja) * 2012-06-29 2016-03-22 株式会社ソニー・コンピュータエンタテインメント 映像処理装置、映像処理方法、および映像処理システム
KR101483054B1 (ko) * 2014-05-31 2015-01-16 연세대학교 산학협력단 상호작용을 지원하는 모바일 기반 증강현실 제작 시스템 및 방법
CN105872526B (zh) * 2015-01-21 2017-10-31 成都理想境界科技有限公司 双目ar头戴显示设备及其信息显示方法
KR101618004B1 (ko) * 2015-01-27 2016-05-09 가톨릭대학교 산학협력단 가상 현실 기반의 인터랙티브 컨텐츠 제공 장치 및 그 방법
JP6336930B2 (ja) 2015-02-16 2018-06-06 富士フイルム株式会社 仮想オブジェクト表示装置、方法、プログラムおよびシステム
GB2535727A (en) * 2015-02-25 2016-08-31 Bae Systems Plc Interactive information system
US20160253891A1 (en) * 2015-02-27 2016-09-01 Elwha Llc Device that determines that a subject may contact a sensed object and that warns of the potential contact
US10038838B2 (en) 2015-05-29 2018-07-31 Hover Inc. Directed image capture
WO2017001146A1 (en) * 2015-06-29 2017-01-05 Essilor International (Compagnie Générale d'Optique) A scene image analysis module
US9922463B2 (en) 2015-08-07 2018-03-20 Microsoft Technology Licensing, Llc Virtually visualizing energy
US20170039986A1 (en) * 2015-08-07 2017-02-09 Microsoft Technology Licensing, Llc Mixed Reality Social Interactions
US20170038829A1 (en) * 2015-08-07 2017-02-09 Microsoft Technology Licensing, Llc Social interaction for remote communication
WO2017034886A1 (en) 2015-08-24 2017-03-02 Pcms Holdings, Inc. Systems and methods for enhancing augmented reality experience with dynamic output mapping
EP4380150A3 (en) * 2015-10-08 2024-07-24 InterDigital VC Holdings, Inc. Methods and systems of automatic calibration for dynamic display configurations
US10616662B2 (en) 2016-02-10 2020-04-07 Disney Enterprises, Inc. Systems and methods to provide video and control signals over an internet protocol communications network
US10788966B2 (en) * 2016-02-10 2020-09-29 Disney Enterprises, Inc. Systems and methods for interacting with a virtual interface
US10163198B2 (en) 2016-02-26 2018-12-25 Samsung Electronics Co., Ltd. Portable image device for simulating interaction with electronic device
US10169918B2 (en) * 2016-06-24 2019-01-01 Microsoft Technology Licensing, Llc Relational rendering of holographic objects
US11014001B2 (en) 2018-03-05 2021-05-25 Sony Interactive Entertainment LLC Building virtual reality (VR) gaming environments using real-world virtual reality maps
US10695667B2 (en) * 2018-03-14 2020-06-30 Sony Interactive Entertainment LLC Pro gaming AR visor and method for parsing context specific HUD content from a video stream
US10777012B2 (en) * 2018-09-27 2020-09-15 Universal City Studios Llc Display systems in an entertainment environment
US10776954B2 (en) 2018-10-08 2020-09-15 Microsoft Technology Licensing, Llc Real-world anchor in a virtual-reality environment
CN113273184B (zh) 2018-11-30 2025-01-03 Pcms控股公司 将3d对象镜像到光场显示器的方法
JP7443014B2 (ja) * 2019-10-08 2024-03-05 大豊精機株式会社 ロボットアーム試験装置
EP4499251A1 (en) * 2022-03-30 2025-02-05 Universal City Studios LLC Systems and methods for producing responses to interactions within an interactive environment
JP2024052410A (ja) * 2022-09-30 2024-04-11 富士フイルム株式会社 プロセッサ、情報処理方法、及び情報処理プログラム

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3401897B2 (ja) 1994-02-16 2003-04-28 株式会社セガ 衝突判定処理システムおよびこれを用いた画像処理装置
CN1161087A (zh) * 1994-08-10 1997-10-01 实质(Ip)有限公司 安置在头上的光学系统
US6522312B2 (en) 1997-09-01 2003-02-18 Canon Kabushiki Kaisha Apparatus for presenting mixed reality shared among operators
JP3486536B2 (ja) * 1997-09-01 2004-01-13 キヤノン株式会社 複合現実感提示装置および方法
ATE543546T1 (de) 1999-06-11 2012-02-15 Canon Kk Vorrichtung und verfahren zur darstellung eines von mehreren benutzern geteilten raumes, wo wirklichkeit zum teil einbezogen wird, entsprechende spielvorrichtung und entsprechendes schnittstellenverfahren
JP2000350865A (ja) 1999-06-11 2000-12-19 Mr System Kenkyusho:Kk 複合現実空間のゲーム装置、その画像処理方法およびプログラム記憶媒体
JP3413127B2 (ja) * 1999-06-11 2003-06-03 キヤノン株式会社 複合現実感装置及び複合現実感提示方法
US6771841B1 (en) * 1999-12-29 2004-08-03 Intel Corporation Determining a bounding shape for a collection of points
US20030062675A1 (en) 2001-09-28 2003-04-03 Canon Kabushiki Kaisha Image experiencing system and information processing method
JP3584230B2 (ja) * 2001-09-28 2004-11-04 キヤノン株式会社 映像体験システム、情報処理方法およびプログラム
CN2667920Y (zh) 2003-12-26 2005-01-05 沈阳工业学院 一种光学双视场三维头盔显示装置
US7991220B2 (en) 2004-09-01 2011-08-02 Sony Computer Entertainment Inc. Augmented reality game system using identification information to display a virtual object in association with a position of a real object
JP3844482B2 (ja) 2004-09-01 2006-11-15 株式会社ソニー・コンピュータエンタテインメント 画像処理装置
JP4335160B2 (ja) 2005-03-02 2009-09-30 任天堂株式会社 衝突判定プログラムおよび衝突判定装置
ES2325374T3 (es) 2005-05-03 2009-09-02 Seac02 S.R.L. Sistema de realidad aumentada con identificacion de objeto marcador real.
JP4689344B2 (ja) * 2005-05-11 2011-05-25 キヤノン株式会社 情報処理方法、情報処理装置
US7773098B2 (en) 2005-05-11 2010-08-10 Canon Kabushiki Kaisha Virtual reality presentation apparatus and method
CN100399835C (zh) 2005-09-29 2008-07-02 北京理工大学 用于现场数字三维重建的增强现实定点观察系统
KR100809479B1 (ko) * 2006-07-27 2008-03-03 한국전자통신연구원 혼합 현실 환경을 위한 얼굴 착용형 디스플레이 장치
JP2010026818A (ja) 2008-07-18 2010-02-04 Geisha Tokyo Entertainment Inc 画像処理プログラム、画像処理装置及び画像処理方法
CN101539804A (zh) * 2009-03-11 2009-09-23 上海大学 基于增强虚拟现实与异型屏的实时人机互动方法及系统
JP5627973B2 (ja) * 2010-09-24 2014-11-19 任天堂株式会社 ゲーム処理をするためのプログラム、装置、システムおよび方法
US8625200B2 (en) * 2010-10-21 2014-01-07 Lockheed Martin Corporation Head-mounted display apparatus employing one or more reflective optical surfaces
JP5472056B2 (ja) * 2010-11-19 2014-04-16 コニカミノルタ株式会社 表示システム、表示処理装置、表示方法、および表示プログラム
US8189263B1 (en) * 2011-04-01 2012-05-29 Google Inc. Image waveguide with mirror arrays
JP5891125B2 (ja) * 2012-06-29 2016-03-22 株式会社ソニー・コンピュータエンタテインメント 映像処理装置、映像処理方法、および映像処理システム

Also Published As

Publication number Publication date
US9639989B2 (en) 2017-05-02
CN107844196B (zh) 2020-12-01
EP2869274A4 (en) 2016-01-27
CN104380347B (zh) 2017-12-05
CN104380347A (zh) 2015-02-25
CN107844196A (zh) 2018-03-27
JP2014010664A (ja) 2014-01-20
US20150170419A1 (en) 2015-06-18
EP2869274A1 (en) 2015-05-06
WO2014002346A1 (ja) 2014-01-03

Similar Documents

Publication Publication Date Title
JP5891125B2 (ja) 映像処理装置、映像処理方法、および映像処理システム
JP5483761B2 (ja) 映像出力装置、立体映像観察デバイス、映像提示システム、および映像出力方法
US11738270B2 (en) Simulation system, processing method, and information storage medium
US9122053B2 (en) Realistic occlusion for a head mounted augmented reality display
US10453248B2 (en) Method of providing virtual space and system for executing the same
JP5602618B2 (ja) 画像処理プログラム、画像処理装置、画像処理システム、および画像処理方法
US9317971B2 (en) Mechanism to give holographic objects saliency in multiple spaces
JP6340017B2 (ja) 被写体と３次元仮想空間をリアルタイムに合成する撮影システム
US9183676B2 (en) Displaying a collision between real and virtual objects
JP2022502800A (ja) 拡張現実のためのシステムおよび方法
US9662583B2 (en) Portable type game device and method for controlling portable type game device
US20180189549A1 (en) Method for communication via virtual space, program for executing the method on computer, and information processing apparatus for executing the program
US20180357817A1 (en) Information processing method, program, and computer
JP2016525741A (ja) 共有ホログラフィックオブジェクトおよびプライベートホログラフィックオブジェクト
TW201447375A (zh) 擴增實境之頭戴式電子裝置及方法
JP6161749B2 (ja) 映像処理装置、映像処理方法、および映像処理システム
WO2013155217A1 (en) Realistic occlusion for a head mounted augmented reality display
JP2018522324A (ja) 拡張現実システムに結合されるプライバシーセンシティブ消費者カメラ
CN104995583A (zh) 用于混合现实环境的直接交互系统
CN110709897A (zh) 用于插入到图像中的图像内容的阴影生成
US20180190010A1 (en) Method for providing virtual space, program for executing the method on computer, and information processing apparatus for executing the program
JP2011215919A (ja) プログラム、情報記憶媒体及び画像生成システム
HK1190481B (en) Realistic occlusion for a head mounted augmented reality display
HK1190481A (en) Realistic occlusion for a head mounted augmented reality display

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20150527

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20150527

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20151117

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20151225

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20160126

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20160222

R150 Certificate of patent or registration of utility model

Ref document number: 5891125

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250