RU2693329C2 - Способ и устройство отображения с оптимизацией перераспределения пикселей - Google Patents

Способ и устройство отображения с оптимизацией перераспределения пикселей Download PDF

Info

Publication number
RU2693329C2
RU2693329C2 RU2017101239A RU2017101239A RU2693329C2 RU 2693329 C2 RU2693329 C2 RU 2693329C2 RU 2017101239 A RU2017101239 A RU 2017101239A RU 2017101239 A RU2017101239 A RU 2017101239A RU 2693329 C2 RU2693329 C2 RU 2693329C2
Authority
RU
Russia
Prior art keywords
display device
image
viewer
pixel density
optical component
Prior art date
Application number
RU2017101239A
Other languages
English (en)
Russian (ru)
Other versions
RU2017101239A3 (enExample
RU2017101239A (ru
Inventor
Сильвэн ТЬЕБО
Лоран БЛОНДЕ
Тьерри ТАПИ
Вальтер ДРАЖИЧ
Original Assignee
Томсон Лайсенсинг
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Томсон Лайсенсинг filed Critical Томсон Лайсенсинг
Publication of RU2017101239A publication Critical patent/RU2017101239A/ru
Publication of RU2017101239A3 publication Critical patent/RU2017101239A3/ru
Application granted granted Critical
Publication of RU2693329C2 publication Critical patent/RU2693329C2/ru

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4023—Scaling of whole images or parts thereof, e.g. expanding or contracting based on decimating pixels or lines of pixels; based on inserting pixels or lines of pixels
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0176—Head mounted characterised by mechanical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/02—Viewing or reading apparatus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/04—Context-preserving transformations, e.g. by using an importance map
    • G06T3/053—Detail-in-context presentations
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N3/00—Scanning details of television systems; Combination thereof with generation of supply voltages
    • H04N3/10—Scanning details of television systems; Combination thereof with generation of supply voltages by means not exclusively optical-mechanical
    • H04N3/16—Scanning details of television systems; Combination thereof with generation of supply voltages by means not exclusively optical-mechanical by deflecting electron beam in cathode-ray tube, e.g. scanning corrections
    • H04N3/22—Circuits for controlling dimensions, shape or centering of picture on screen
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0147—Head-up displays characterised by optical features comprising a device modifying the resolution of the displayed image
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20016—Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20092—Interactive image processing based on input by user
    • G06T2207/20104—Interactive definition of region of interest [ROI]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Signal Processing (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Image Processing (AREA)
  • Devices For Indicating Variable Information By Combining Individual Elements (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
RU2017101239A 2014-06-17 2015-06-16 Способ и устройство отображения с оптимизацией перераспределения пикселей RU2693329C2 (ru)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP14305923.6 2014-06-17
EP14305923.6A EP2958074A1 (en) 2014-06-17 2014-06-17 A method and a display device with pixel repartition optimization
PCT/EP2015/063435 WO2015193287A1 (en) 2014-06-17 2015-06-16 A method and a display device with pixel repartition optimization

Publications (3)

Publication Number Publication Date
RU2017101239A RU2017101239A (ru) 2018-07-17
RU2017101239A3 RU2017101239A3 (enExample) 2018-12-13
RU2693329C2 true RU2693329C2 (ru) 2019-07-02

Family

ID=51162628

Family Applications (1)

Application Number Title Priority Date Filing Date
RU2017101239A RU2693329C2 (ru) 2014-06-17 2015-06-16 Способ и устройство отображения с оптимизацией перераспределения пикселей

Country Status (10)

Country Link
US (1) US11593914B2 (enExample)
EP (2) EP2958074A1 (enExample)
JP (1) JP6684728B2 (enExample)
KR (1) KR102503029B1 (enExample)
CN (1) CN106461951B (enExample)
CA (1) CA2952710C (enExample)
MX (1) MX371370B (enExample)
RU (1) RU2693329C2 (enExample)
TW (1) TWI660201B (enExample)
WO (1) WO2015193287A1 (enExample)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107209390A (zh) * 2015-02-12 2017-09-26 谷歌公司 组合高分辨率窄场显示和中分辨率宽场显示
CN106293047B (zh) * 2015-06-26 2020-01-10 微软技术许可有限责任公司 通过动态分辨率缩放来减少移动设备的功耗
US10958834B2 (en) 2016-07-22 2021-03-23 Immervision, Inc. Method to capture, store, distribute, share, stream and display panoramic image or video
JP6844210B2 (ja) * 2016-11-16 2021-03-17 凸版印刷株式会社 視覚的顕著性マップ生成装置、視覚的顕著性マップ生成方法及びプログラム
CN110447082B (zh) 2017-03-22 2021-12-14 奇跃公司 动态视场可变聚焦显示系统
JP2020523803A (ja) * 2017-05-26 2020-08-06 グーグル エルエルシー 疎サンプリング超解像を用いたニアアイディスプレイ
CN110832442A (zh) * 2017-06-09 2020-02-21 索尼互动娱乐股份有限公司 注视点渲染系统中的优化的阴影和自适应网状蒙皮
US20190079284A1 (en) * 2017-09-08 2019-03-14 Mediatek Inc. Variable DPI Across A Display And Control Thereof
US10521881B1 (en) * 2017-09-28 2019-12-31 Apple Inc. Error concealment for a head-mountable device
US10511842B2 (en) 2017-10-06 2019-12-17 Qualcomm Incorporated System and method for foveated compression of image frames in a system on a chip
WO2019077614A1 (en) 2017-10-22 2019-04-25 Lumus Ltd. Head-mounted augmented reality device employing an optical bench
KR20200097289A (ko) 2017-12-10 2020-08-18 루머스 리미티드 이미지 프로젝터
WO2019221105A1 (ja) * 2018-05-15 2019-11-21 ソニーセミコンダクタソリューションズ株式会社 表示装置
IL259518B2 (en) * 2018-05-22 2023-04-01 Lumus Ltd Optical system and method for improving light field uniformity
US10802585B2 (en) * 2018-07-12 2020-10-13 Apple Inc. Electronic devices with display operation based on eye activity
US11221494B2 (en) * 2018-12-10 2022-01-11 Facebook Technologies, Llc Adaptive viewport optical display systems and methods
EP4528436A3 (en) 2019-06-27 2025-05-21 Lumus Ltd. Apparatus and methods for eye tracking based on eye imaging via a light-guide optical element
KR102582407B1 (ko) * 2019-07-28 2023-09-26 구글 엘엘씨 포비에이티드 메시들로 몰입형 비디오 콘텐츠를 렌더링하기 위한 방법들, 시스템들, 및 매체들
CN114746797B (zh) 2019-12-08 2024-11-12 鲁姆斯有限公司 具有紧凑型图像投影仪的光学系统
US12019249B2 (en) 2019-12-25 2024-06-25 Lumus Ltd. Optical systems and methods for eye tracking based on redirecting light from eye using an optical arrangement associated with a light-guide optical element
CN115668037A (zh) * 2020-05-27 2023-01-31 索尼集团公司 显示装置和显示方法
US12039958B2 (en) 2020-08-03 2024-07-16 Arizona Board Of Regents On Behalf Of The University Of Arizona Perceptual-driven foveated displays
CN116670625B (zh) 2020-12-17 2026-05-15 鲁姆斯有限公司 基于经由准直元件和光导光学元件对眼睛成像来进行眼睛跟踪的光学系统和方法
EP4264942A4 (en) 2020-12-20 2024-10-23 Lumus Ltd. IMAGE PROJECTOR WITH LASER SCANNING ON SPATIAL LIGHT MODULATOR
US11899215B1 (en) * 2022-07-29 2024-02-13 Htc Corporation Head mounted display, display device and image display method thereof
KR20240106658A (ko) 2022-12-29 2024-07-08 삼성전자주식회사 시선 추적 센서를 포함하는 헤드 마운티드 디스플레이 장치 및 헤드 마운티드 디스플레이 장치의 동작 방법

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020063807A1 (en) * 1999-04-19 2002-05-30 Neal Margulis Method for Performing Image Transforms in a Digital Display System
RU2322771C2 (ru) * 2005-04-25 2008-04-20 Святослав Иванович АРСЕНИЧ Стереопроекционная система
WO2012082807A2 (en) * 2010-12-17 2012-06-21 Microsoft Corporation Optimized focal area for augmented reality displays
US20130016413A1 (en) * 2011-07-12 2013-01-17 Google Inc. Whole image scanning mirror display system
WO2013090100A1 (en) * 2011-12-12 2013-06-20 John Clavin Connecting head mounted displays to external displays and other communication networks
US20130235169A1 (en) * 2011-06-16 2013-09-12 Panasonic Corporation Head-mounted display and position gap adjustment method

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH01252993A (ja) 1988-04-01 1989-10-09 Nippon Telegr & Teleph Corp <Ntt> 画像表示方法
JPH0638219A (ja) * 1992-07-20 1994-02-10 Olympus Optical Co Ltd 映像表示装置
JP2896291B2 (ja) * 1993-06-14 1999-05-31 株式会社エイ・ティ・アール通信システム研究所 画像表示装置
JP2638444B2 (ja) 1993-10-04 1997-08-06 日本電気株式会社 頭部搭載型画像表示装置
JP3283367B2 (ja) 1993-11-11 2002-05-20 三菱プレシジョン株式会社 潜望鏡映像表示装置
JP3604443B2 (ja) 1995-02-28 2004-12-22 株式会社島津製作所 テレビジョンシステム
US6734838B1 (en) 1998-05-18 2004-05-11 Dimension Technologies Inc. Enhanced resolution for image generation
JP2000310747A (ja) 1999-02-26 2000-11-07 Mr System Kenkyusho:Kk 画像観察装置
JP4374708B2 (ja) * 2000-03-30 2009-12-02 株式会社デンソー 網膜走査ディスプレイ装置及び光走査装置
KR20020089475A (ko) * 2001-02-21 2002-11-29 코닌클리케 필립스 일렉트로닉스 엔.브이. 비디오 신호를 처리하기 위한 디스플레이 시스템
US7068813B2 (en) * 2001-03-28 2006-06-27 Koninklijke Philips Electronics N.V. Method and apparatus for eye gazing smart display
US20060145945A1 (en) 2002-01-07 2006-07-06 Lewis John R Scanned beam system with distortion compensation
US7495638B2 (en) * 2003-05-13 2009-02-24 Research Triangle Institute Visual display with increased field of view
WO2008053166A1 (en) 2006-10-31 2008-05-08 Bae Systems Plc Image display systems
IL196078A (en) * 2007-12-20 2014-09-30 Raytheon Co Imaging system
US8941559B2 (en) * 2010-09-21 2015-01-27 Microsoft Corporation Opacity filter for display device
US9529191B2 (en) * 2010-11-03 2016-12-27 Trex Enterprises Corporation Dynamic foveal vision display
US8749892B2 (en) * 2011-06-17 2014-06-10 DigitalOptics Corporation Europe Limited Auto-focus actuator for field curvature correction of zoom lenses
US20130215147A1 (en) 2012-02-17 2013-08-22 Esight Corp. Apparatus and Method for Enhancing Human Visual Performance in a Head Worn Video System
US20130246967A1 (en) * 2012-03-15 2013-09-19 Google Inc. Head-Tracked User Interaction with Graphical Interface
US9720231B2 (en) * 2012-09-26 2017-08-01 Dolby Laboratories Licensing Corporation Display, imaging system and controller for eyewear display device
JP5935640B2 (ja) 2012-10-01 2016-06-15 ソニー株式会社 情報処理装置、表示制御方法及びプログラム
CN103593051B (zh) 2013-11-11 2017-02-15 百度在线网络技术（北京）有限公司 头戴式显示设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020063807A1 (en) * 1999-04-19 2002-05-30 Neal Margulis Method for Performing Image Transforms in a Digital Display System
RU2322771C2 (ru) * 2005-04-25 2008-04-20 Святослав Иванович АРСЕНИЧ Стереопроекционная система
WO2012082807A2 (en) * 2010-12-17 2012-06-21 Microsoft Corporation Optimized focal area for augmented reality displays
US20130235169A1 (en) * 2011-06-16 2013-09-12 Panasonic Corporation Head-mounted display and position gap adjustment method
US20130016413A1 (en) * 2011-07-12 2013-01-17 Google Inc. Whole image scanning mirror display system
WO2013090100A1 (en) * 2011-12-12 2013-06-20 John Clavin Connecting head mounted displays to external displays and other communication networks

Also Published As

Publication number Publication date
RU2017101239A3 (enExample) 2018-12-13
WO2015193287A1 (en) 2015-12-23
CN106461951B (zh) 2020-07-17
CN106461951A (zh) 2017-02-22
EP3158531B1 (en) 2024-04-24
US11593914B2 (en) 2023-02-28
EP3158531A1 (en) 2017-04-26
JP6684728B2 (ja) 2020-04-22
EP2958074A1 (en) 2015-12-23
JP2017522591A (ja) 2017-08-10
KR20170020351A (ko) 2017-02-22
TWI660201B (zh) 2019-05-21
MX2016016718A (es) 2017-04-13
RU2017101239A (ru) 2018-07-17
CA2952710A1 (en) 2015-12-23
KR102503029B1 (ko) 2023-02-23
MX371370B (es) 2020-01-28
CA2952710C (en) 2024-01-02
TW201600887A (zh) 2016-01-01
US20170132757A1 (en) 2017-05-11

Similar Documents

Publication Publication Date Title
KR102503029B1 (ko) 픽셀 재분할 최적화를 갖는 방법 및 디스플레이 디바이스
US11727695B2 (en) Language element vision augmentation methods and devices
US11816820B2 (en) Gaze direction-based adaptive pre-filtering of video data
US11217021B2 (en) Display system having sensors
CN111602082B (zh) 用于包括传感器集成电路的头戴式显示器的位置跟踪系统
US20190331914A1 (en) Experience Sharing with Region-Of-Interest Selection
Konrad et al. Gazegpt: Augmenting human capabilities using gaze-contingent contextual ai for smart eyewear
US12423841B2 (en) Scene camera retargeting
JP2018523321A (ja) 眼と異なるレンズの位置を補正する、実際のシーンを見るための仮想眼鏡セット
CN115985209B (zh) 可穿戴显示设备、控制方法、装置、电子设备和存储介质
US10771774B1 (en) Display apparatus and method of producing images having spatially-variable angular resolutions
CN114047822B (zh) 近眼显示方法及系统
US12586151B2 (en) Frame rate extrapolation
US10083675B2 (en) Display control method and display control apparatus
US20250245932A1 (en) Tile processing and transformation for video see-through (vst) extended reality (xr)
US20260030793A1 (en) Dynamic attentional region generation and rendering
HK1236670A1 (en) A method and a display device with pixel repartition optimization
HK1236670B (en) A method and a display device with pixel repartition optimization
CN120722575A (zh) 使用基于每度硬件像素估计的自动面板增强来改进扩展现实渲染及其系统和使用方法

Legal Events

Date Code Title Description
PD4A Correction of name of patent owner
PC41 Official registration of the transfer of exclusive right

Effective date: 20200213