EP3281058A4 - Virtual reality display apparatus and display method thereof - Google Patents

Virtual reality display apparatus and display method thereof Download PDF

Info

Publication number
EP3281058A4
EP3281058A4 EP16842274.9A EP16842274A EP3281058A4 EP 3281058 A4 EP3281058 A4 EP 3281058A4 EP 16842274 A EP16842274 A EP 16842274A EP 3281058 A4 EP3281058 A4 EP 3281058A4
Authority
EP
European Patent Office
Prior art keywords
virtual reality
display apparatus
display
display method
reality display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP16842274.9A
Other languages
German (de)
French (fr)
Other versions
EP3281058A1 (en
Inventor
Weiming Li
Do-Wan Kim
Jae-Yun Jeong
Yong-Gyoo Kim
Gengyu Ma
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Priority claimed from PCT/KR2016/009711 external-priority patent/WO2017039308A1/en
Publication of EP3281058A1 publication Critical patent/EP3281058A1/en
Publication of EP3281058A4 publication Critical patent/EP3281058A4/en
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/398Synchronisation thereof; Control thereof
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0132Head-up displays characterised by optical features comprising binocular systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0132Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
EP16842274.9A 2015-08-31 2016-08-31 Virtual reality display apparatus and display method thereof Ceased EP3281058A4 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201510549225.7A CN106484085B (en) 2015-08-31 2015-08-31 The method and its head-mounted display of real-world object are shown in head-mounted display
KR1020160106177A KR20170026164A (en) 2015-08-31 2016-08-22 Virtual reality display apparatus and display method thereof
PCT/KR2016/009711 WO2017039308A1 (en) 2015-08-31 2016-08-31 Virtual reality display apparatus and display method thereof

Publications (2)

Publication Number Publication Date
EP3281058A1 EP3281058A1 (en) 2018-02-14
EP3281058A4 true EP3281058A4 (en) 2018-04-11

Family

ID=58236359

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16842274.9A Ceased EP3281058A4 (en) 2015-08-31 2016-08-31 Virtual reality display apparatus and display method thereof

Country Status (3)

Country Link
EP (1) EP3281058A4 (en)
KR (1) KR20170026164A (en)
CN (2) CN110275619A (en)

Families Citing this family (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110402578B (en) * 2017-03-22 2022-05-03 索尼公司 Image processing apparatus, method and recording medium
CN107168515A (en) * 2017-03-31 2017-09-15 北京奇艺世纪科技有限公司 The localization method and device of handle in a kind of VR all-in-ones
CN106896925A (en) * 2017-04-14 2017-06-27 陈柳华 The device that a kind of virtual reality is merged with real scene
CN107222689B (en) * 2017-05-18 2020-07-03 歌尔科技有限公司 Real scene switching method and device based on VR (virtual reality) lens
CN108960008B (en) * 2017-05-22 2021-12-14 华为技术有限公司 VR display method and device and VR equipment
CN107229342A (en) * 2017-06-30 2017-10-03 宇龙计算机通信科技(深圳)有限公司 Document handling method and user equipment
CN107577337A (en) * 2017-07-25 2018-01-12 北京小鸟看看科技有限公司 A kind of keyboard display method for wearing display device, device and wear display device
US10627635B2 (en) 2017-08-02 2020-04-21 Microsoft Technology Licensing, Llc Transitioning into a VR environment and warning HMD users of real-world physical obstacles
CN107422942A (en) * 2017-08-15 2017-12-01 吴金河 A kind of control system and method for immersion experience
CN111448568B (en) * 2017-09-29 2023-11-14 苹果公司 Environment-based application presentation
DE102017218215A1 (en) * 2017-10-12 2019-04-18 Audi Ag A method of operating a head-mounted electronic display device and display system for displaying a virtual content
KR102389185B1 (en) * 2017-10-17 2022-04-21 삼성전자주식회사 Electronic device and method for executing function using input interface displayed via at least portion of content
CN108169901A (en) * 2017-12-27 2018-06-15 北京传嘉科技有限公司 VR glasses
CN108040247A (en) * 2017-12-29 2018-05-15 湖南航天捷诚电子装备有限责任公司 A kind of wear-type augmented reality display device and method
CN108572723B (en) * 2018-02-02 2021-01-29 陈尚语 Carsickness prevention method and equipment
KR102076647B1 (en) * 2018-03-30 2020-02-12 데이터얼라이언스 주식회사 IoT Device Control System And Method Using Virtual reality And Augmented Reality
CN108519676B (en) * 2018-04-09 2020-04-28 杭州瑞杰珑科技有限公司 Head-wearing type vision-aiding device
CN108764152B (en) * 2018-05-29 2020-12-04 北京物灵智能科技有限公司 Method and device for realizing interactive prompt based on picture matching and storage equipment
CN108922115B (en) * 2018-06-26 2020-12-18 联想(北京)有限公司 Information processing method and electronic equipment
CN112771473A (en) * 2018-09-07 2021-05-07 苹果公司 Inserting imagery from a real environment into a virtual environment
JP6739847B2 (en) 2018-09-12 2020-08-12 株式会社アルファコード Image display control device and image display control program
EP3671410B1 (en) * 2018-12-19 2022-08-24 Siemens Healthcare GmbH Method and device to control a virtual reality display unit
US20200327867A1 (en) * 2019-04-15 2020-10-15 XRSpace CO., LTD. Head mounted display system capable of displaying a virtual scene and a map of a real environment in a picture-in-picture mode, related method and related non-transitory computer readable storage medium
US10992926B2 (en) * 2019-04-15 2021-04-27 XRSpace CO., LTD. Head mounted display system capable of displaying a virtual scene and a real scene in a picture-in-picture mode, related method and related non-transitory computer readable storage medium
US11137908B2 (en) * 2019-04-15 2021-10-05 Apple Inc. Keyboard operation with head-mounted device
US11265487B2 (en) * 2019-06-05 2022-03-01 Mediatek Inc. Camera view synthesis on head-mounted display for virtual reality and augmented reality
CN110475103A (en) * 2019-09-05 2019-11-19 上海临奇智能科技有限公司 A kind of wear-type visual device
CN111124112A (en) * 2019-12-10 2020-05-08 北京一数科技有限公司 Interactive display method and device for virtual interface and entity object
CN111427447B (en) * 2020-03-04 2023-08-29 青岛小鸟看看科技有限公司 Virtual keyboard display method, head-mounted display device and system
CN112462937B (en) 2020-11-23 2022-11-08 青岛小鸟看看科技有限公司 Local perspective method and device of virtual reality equipment and virtual reality equipment
CN112445341B (en) * 2020-11-23 2022-11-08 青岛小鸟看看科技有限公司 Keyboard perspective method and device of virtual reality equipment and virtual reality equipment
CN112581054B (en) * 2020-12-09 2023-08-29 珠海格力电器股份有限公司 Material management method and material management device
CN114827338A (en) * 2021-01-29 2022-07-29 北京外号信息技术有限公司 Method and electronic device for presenting virtual objects on a display medium of a device
CN114035732A (en) * 2021-11-04 2022-02-11 海南诺亦腾海洋科技研究院有限公司 Method and device for controlling virtual experience content of VR head display equipment by one key
WO2023130435A1 (en) * 2022-01-10 2023-07-13 深圳市闪至科技有限公司 Interaction method, head-mounted display device, and system and storage medium
CN114972692B (en) * 2022-05-12 2023-04-18 北京领为军融科技有限公司 Target positioning method based on AI identification and mixed reality
CN116744195B (en) * 2023-08-10 2023-10-31 苏州清听声学科技有限公司 Parametric array loudspeaker and directional deflection method thereof

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015111283A1 (en) * 2014-01-23 2015-07-30 ソニー株式会社 Image display device and image display method

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6037882A (en) * 1997-09-30 2000-03-14 Levy; David H. Method and apparatus for inputting data to an electronic system
GB2376397A (en) * 2001-06-04 2002-12-11 Hewlett Packard Co Virtual or augmented reality
JP2005044102A (en) * 2003-07-28 2005-02-17 Canon Inc Image reproduction method and device
JP2009025918A (en) * 2007-07-17 2009-02-05 Canon Inc Image processor and image processing method
CN101893935B (en) * 2010-07-14 2012-01-11 北京航空航天大学 Cooperative construction method for enhancing realistic table-tennis system based on real rackets
US8884984B2 (en) * 2010-10-15 2014-11-11 Microsoft Corporation Fusing virtual content into real content
JP2012173772A (en) * 2011-02-17 2012-09-10 Panasonic Corp User interaction apparatus, user interaction method, user interaction program and integrated circuit
US20120249416A1 (en) * 2011-03-29 2012-10-04 Giuliano Maciocci Modular mobile connected pico projectors for a local multi-user collaboration
US9547438B2 (en) * 2011-06-21 2017-01-17 Empire Technology Development Llc Gesture based user interface for augmented reality
JP5765133B2 (en) * 2011-08-16 2015-08-19 富士通株式会社 Input device, input control method, and input control program
US8941560B2 (en) * 2011-09-21 2015-01-27 Google Inc. Wearable computer with superimposed controls and instructions for external device
CN103018905A (en) * 2011-09-23 2013-04-03 奇想创造事业股份有限公司 Head-mounted somatosensory manipulation display system and method thereof
US9081177B2 (en) * 2011-10-07 2015-07-14 Google Inc. Wearable computer with nearby object response
JP6079614B2 (en) * 2013-12-19 2017-02-15 ソニー株式会社 Image display device and image display method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015111283A1 (en) * 2014-01-23 2015-07-30 ソニー株式会社 Image display device and image display method
EP3098689A1 (en) * 2014-01-23 2016-11-30 Sony Corporation Image display device and image display method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2017039308A1 *

Also Published As

Publication number Publication date
EP3281058A1 (en) 2018-02-14
CN110275619A (en) 2019-09-24
CN106484085A (en) 2017-03-08
KR20170026164A (en) 2017-03-08
CN106484085B (en) 2019-07-23

Similar Documents

Publication Publication Date Title
EP3281058A4 (en) Virtual reality display apparatus and display method thereof
EP3652744A4 (en) Virtual reality apparatus
EP3494571A4 (en) Display apparatus and display method
EP3445463A4 (en) Virtual reality haptic system and apparatus
EP3284081A4 (en) Display apparatus and method for displaying
EP3281403A4 (en) Methods and apparatus for augmented reality applications
EP3286911A4 (en) Display apparatus and control method thereof
EP3358524A4 (en) Method and device for tweaking virtual reality image
EP3302251A4 (en) Biofeedback virtual reality system and method
EP3149539A4 (en) Methods and systems for generating virtual content display with a virtual or augmented reality apparatus
EP3167356A4 (en) Display apparatus and control method thereof
GB2554914B (en) Virtual reality system and method
EP3565453A4 (en) Virtual reality apparatus and methods therefor
EP3273287A4 (en) Display device and display method therefor
EP3338178A4 (en) Display apparatus and control method thereof
EP3345384A4 (en) Display apparatus and control method thereof
EP3286630A4 (en) Display apparatus and control method thereof
EP3350989A4 (en) 3d display apparatus and control method thereof
EP3400580A4 (en) Method and apparatus for facilitating interaction with virtual reality equipment
EP3351998A4 (en) 3d display apparatus and driving method therefor
EP3428807A4 (en) Display method and apparatus
EP3318058A4 (en) Display apparatus and controlling method thereof
EP3549110A4 (en) Method and apparatus for modifying display settings in virtual/augmented reality
EP3494694A4 (en) Display apparatus and display method thereof
EP3108356A4 (en) Display apparatus and control method thereof

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20171106

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

A4 Supplementary search report drawn up and despatched

Effective date: 20180308

RIC1 Information provided on ipc code assigned before grant

Ipc: G06T 7/70 20170101ALI20180303BHEP

Ipc: G02B 27/01 20060101ALI20180303BHEP

Ipc: G02B 27/22 20180101AFI20180303BHEP

Ipc: G06T 19/00 20110101ALI20180303BHEP

Ipc: G06F 3/01 20060101ALI20180303BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20181128

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20210320