WO2014199127A1 - Génération d'images stéréoscopiques avec niveau asymétrique de netteté - Google Patents

Génération d'images stéréoscopiques avec niveau asymétrique de netteté Download PDF

Info

Publication number
WO2014199127A1
WO2014199127A1 PCT/GB2014/051689 GB2014051689W WO2014199127A1 WO 2014199127 A1 WO2014199127 A1 WO 2014199127A1 GB 2014051689 W GB2014051689 W GB 2014051689W WO 2014199127 A1 WO2014199127 A1 WO 2014199127A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
scene
displayed
feature
viewer
Prior art date
Application number
PCT/GB2014/051689
Other languages
English (en)
Inventor
Gordon Derek LOVE
Martin Scott BANKS
Original Assignee
The University Of Durham
The Regents Of The University Of California
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by The University Of Durham, The Regents Of The University Of California filed Critical The University Of Durham
Publication of WO2014199127A1 publication Critical patent/WO2014199127A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/25—Image signal generators using stereoscopic image cameras using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/144—Processing image signals for flicker reduction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion

Definitions

  • the present invention relates to a stereoscopic display- apparatus and method, and relates particularly, but not exclusively, to a stereoscopic display apparatus and method for use in computer games .
  • Vergence is the binocular eye movement by which a viewer's two eyes become directed at a single point in space.
  • Accommodation is the adjustment of the viewer's eyes' focal power to bring the image of a point in space to sharp focus on the retina.
  • vergence and accommodation distances are always the same.
  • the vergence and accommodation functions are neurally coupled such that a vergence response causes an accommodative response and vice versa.
  • WO 2012/175939 discloses an attempt to address this problem in which a system is provided in which a scene to be displayed is divided into discrete depths or depth planes.
  • each depth plane is displayed at a different time and a lens state is synchronised to the display to be consistent with the presentation of the appropriate depth plane.
  • a lens in front of a viewer's eye is set to the correct value to simulate that distance.
  • the viewer of the display can focus the eye at different distances and will perceive the appropriate changes in image sharpness.
  • the mismatch between vergence and accommodation is eliminated because the focal state matches the image content, and this in turn significantly reduces visual discomfort.
  • Preferred embodiments of the present invention seek to overcome one or more of the above disadvantages of the prior art .
  • a stereoscopic display apparatus comprising:- first image supplying means for supplying to a first eye of a viewer a first image of a scene to be displayed; second image supplying means for supplying to a second eye of said viewer a second image of said scene such that said viewer views said first and second images to perceive a 3 dimensional scene; and focus adjusting means for adjusting the focal distance of at least one of said first and second images from the corresponding retina of said viewer; wherein said first image supplying means is adapted to cause at least one first feature of said scene to be displayed in focus, and at least one second feature of said scene to be displayed blurred, in said first image, and said second image supplying means is adapted to cause at least one said first feature to be displayed blurred, and at least one said second feature to be displayed in focus, in said second image .
  • the present invention is based on the surprising discovery that the eye and brain can co-operate to perform complicated synthesis of images based on components of an image received by one eye combined with different components of an image received by the other eye to generate a focused image.
  • a first image supplying means is adapted to cause at least one first feature of a scene to be displayed in focus and at least one second feature of said scene to be displayed blurred in a first image
  • a second image supplying means is adapted to cause at least one said first feature to be displayed blurred and at least one said second feature to be displayed in focus in a second image
  • the first image supplying means may be adapted to cause at least one feature of said scene greater than a predetermined distance from the viewer to be displayed in focus, and at least one feature of said scene equal to or less than said predetermined distance from said viewer to be displayed blurred, in said first image
  • said second image supplying means may be adapted to cause at least one feature of said scene greater than a predetermined distance from the viewer to be displayed blurred, and at least one feature of said scene equal to or less than said predetermined distance from said viewer to be displayed in focus, in said second image .
  • near objects in the scene may be displayed in focus in a first image, and the vergence-accommodation disparity for an eye viewing those objects will be slight
  • far objects may be displayed in focus in a second image (for example focussed at infinity)
  • the focus adjusting means may cause objects at infinity to be focussed on the viewer's retina, thereby also reducing the vergence-accommodation disparity for the eye viewing the far objects.
  • the focus adjusting means may be adapted to adjust focal distance to a variable extent, and said predetermined distance may be variable in synchronism with said focus adjusting means.
  • This provides the advantage of enabling the predetermined distance to be varied in dependence on the content of the scene being displayed, thereby improving viewing quality.
  • a data generating apparatus for generating image data for use with a stereoscopic display apparatus a defined above, the data generating apparatus comprising: data processing means for (i) processing first unprocessed image data to provide first processed image data representing a first image, of a scene to be displayed, and to be supplied to a first eye of a viewer, and (ii) processing second unprocessed image data to provide second processed image data representing a second image, of said scene to be displayed, and to be supplied to a second eye of said viewer such that said viewer views said first and second images to perceive a 3 dimensional scene, wherein at least one first feature of said scene is displayed in focus, and at least one second feature of said scene is displayed blurred, in said first image, and wherein at least one said first feature is displayed blurred, and at least one said second feature is displayed in focus, in said second image.
  • the data processing means may be adapted to cause at least one feature of said scene greater than a predetermined distance from the viewer to be displayed in focus, and at least one feature of said scene equal to or less than said predetermined distance from said viewer to be displayed blurred, in said first image, and to cause at least one feature of said scene greater than a predetermined distance from the viewer to be displayed blurred, and at least one feature of said scene equal to or less than said predetermined distance from said viewer to be displayed in focus, in said second image.
  • the data processing means may be adapted to vary said predetermined distance.
  • the apparatus may further comprise image generating means for generating data representing one of said first and second images from data representing the other of said first and second images .
  • a stereoscopic imaging apparatus comprising : first imaging means for forming a first image of a scene to be displayed, wherein when said first image is viewed by a first eye of a viewer, at least one first feature of said scene is displayed in focus, and at least one second feature of said scene is displayed blurred, in said first image ; and second imaging means for forming a second image of said scene, wherein when said first image is viewed by said first eye and said second image is viewed by a second eye of said viewer, at least one first feature of said scene is displayed blurred, and at least one second feature of said scene is displayed in focus, in said second image, and said user perceives a 3 dimensional scene.
  • At least one feature of said scene greater than a predetermined distance from the viewer may be displayed in focus, and at least one feature of said scene equal to or less than said predetermined distance from said viewer may be displayed blurred, in said first image, and at least one feature of said scene greater than a predetermined distance from the viewer may be displayed blurred, and at least one feature of said scene equal to or less than said predetermined distance from said viewer may be displayed in focus, in said second image .
  • a method of stereoscopically displaying a scene to a viewer comprising: - supplying to a first eye of a viewer a first image of a scene to be displayed; supplying to a second eye of said viewer a second image of said scene such that said viewer views said first and second images to perceive a 3 dimensional scene; and adjusting the focal distance of at least one of said first and second images from the corresponding retina of said viewer; wherein at least one first feature of said scene is displayed in focus, and at least one second feature of said scene is displayed blurred, in said first image, and at least one said first feature is displayed blurred, and at least one said second feature is displayed in focus, in said second image .
  • the method may comprise causing at least one feature of said scene greater than a predetermined distance from the viewer to be displayed in focus, and at least one feature of said scene equal to or less than said predetermined distance from said viewer to be displayed blurred, in said first image, and causing at least one feature of said scene greater than a predetermined distance from the viewer to be displayed blurred, and at least one feature of said scene equal to or less than said predetermined distance from said viewer to be displayed in focus, in said second image.
  • the method may further comprise adjusting said focal distance to a variable extent, and varying said predetermined distance in synchronism with adjustment of said focal distance.
  • a method of generating image data for use with a stereoscopic display apparatus comprising: processing first unprocessed image data to provide first processed image data representing a first image, of a scene to be displayed, and to be supplied to a first eye of a viewer, and processing second unprocessed image data to provide second processed image data representing a second image, of said scene to be displayed, and to be supplied to a second eye of said viewer such that said viewer views said first and second images to perceive a 3 dimensional scene, wherein at least one first feature of said scene is displayed in focus, and at least one second feature of said scene is displayed blurred, in said first image, and wherein at least one said first feature is displayed blurred, and at least one said second feature is displayed in focus, in said second image.
  • the method may comprise causing at least one feature of said scene greater than a predetermined distance from the viewer to be displayed in focus, and at least one feature of said scene equal to or less than said predetermined distance from said viewer to be displayed blurred, in said first image, and causing at least one feature of said scene greater than a predetermined distance from the viewer to be displayed blurred, and at least one feature of said scene equal to or less than said predetermined distance from said viewer to be displayed in focus, in said second image.
  • the method may further comprise varying said predetermined distance.
  • the method may further comprise generating data representing one of said first and second images from data representing the other of said first and second images.
  • a computer program product adapted to be run on a computer to generate image data for use with a stereoscopic display apparatus as defined above, the computer program product comprising: first computer code executable by a computer to process first unprocessed image data to provide first processed image data representing a first image, of a scene to be displayed, and to be supplied to a first eye of a viewer, and second computer code executable by a computer to process second unprocessed image data to provide second processed image data representing a second image, of said scene to be displayed, and to be supplied to a second eye of said viewer such that said viewer views said first and second images to perceive a 3 dimensional scene, wherein at least one first feature of said scene is displayed in focus, and at least one second feature of said scene is displayed blurred, in said first image, and wherein at least one said first feature is displayed blurred, and at least one said second feature is displayed in focus, in said second image.
  • the first computer code may be executable by a computer to cause at least one feature of said scene greater than a predetermined distance from the viewer to be displayed in focus, and at least one feature of said scene equal to or less than said predetermined distance from said viewer to be displayed blurred, in said first image
  • the second computer code may be executable by a computer to cause at least one feature of said scene greater than a predetermined distance from the viewer to be displayed blurred, and at least one feature of said scene equal to or less than said predetermined distance from said viewer to be displayed in focus, in said second image.
  • the computer program product may further comprise third computer code executable by a computer to vary said predetermined distance.
  • the computer program product may further comprise fourth computer code executable by a computer to generate data representing one of said first and second images from data representing the other of said first and second images.
  • Figure 1 shows a schematic view of a stereoscopic imaging apparatus embodying the present invention.
  • Figure 2 shows a schematic view of an image display apparatus embodying the present invention.
  • a stereoscopic imaging apparatus 2 for forming a stereoscopic image of a scene 4 containing near objects 6 and far objects 8 comprises a first camera 10 for forming a first image 12 (Figure 2) of the scene 4, to be provided to a right eye 14 ( Figure 2) of a viewer, and a second camera 16 for providing a second image 18 ( Figure 2) of the scene 4, to be provided to a left eye 20 of the viewer.
  • a controller 22 controls focussing of the first camera 10 and second camera 16 such that far objects 8 are in focus and near objects 6 are blurred in the first image 12, and far objects 8 are blurred and near objects 6 are in focus in the second image 18.
  • a stereoscopic display apparatus 24 for displaying a stereoscopic image of the scene 4 has a first display 26 and a second display 28 for providing the separate first and second images 12, 18 of the scene 4 to the right 14, and left 20 eyes of the viewer respectively.
  • the displays operate in a manner which will be familiar to persons skilled in the art, for example by using polarisation switching combined with displays 26, 28 having a sequential polarisation switch, or interleaved sets of pixels.
  • a controller 30 such as a microprocessor divides the scene to be displayed into near and far depth planes (not shown) such that all objects in the near plane (i.e. near objects 6) are displayed blurred in the first image 12 and in focus in the second image 18, and the objects in the far plane (i.e.
  • far objects 8) are displayed in focus in the first image 12 and blurred in the second image 18. Blurring is achieved by means of suitable software executed by the controller 30.
  • a viewer viewing the displays 26, 28, is provided with viewing spectacles with different lenses for each eye 14, 20 so that one eye is required to accommodate at a first distance and the other eye is required to accommodate at a second distance.
  • the viewer is only provided with a single lens 32 in front of the right eye 14, which corrects the focal distance of that eye 14 to infinity.
  • the vergence and accommodation distances for the left eye 20 viewing objects in the near image plane in focus at the second display 28 are generally equal.
  • the lens 32 causes the vergence and accommodation distances for the right eye 14 viewing objects in the far image plane in focus at the first display 26 to be generally equal, thereby resulting in an improved 3 dimensional image perceived by the viewer, with reduced vergence-accommodation conflict.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

L'invention concerne une génération d'images stéréoscopiques, les images gauche et droite présentant un niveau asymétrique de netteté suivant la profondeur, pour réduire le conflit vergence-accommodation: autrement dit, un détail situé à une distance supérieure à une distance prédéterminée sera affiché nettement dans une première image et flou dans une deuxième image, et un détail situé à une distance inférieure à ladite distance prédéterminée sera affiché flou dans une première image et net dans une deuxième image.
PCT/GB2014/051689 2013-06-10 2014-06-03 Génération d'images stéréoscopiques avec niveau asymétrique de netteté WO2014199127A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GBGB1310256.1A GB201310256D0 (en) 2013-06-10 2013-06-10 Stereoscopic display and method
GB1310256.1 2013-06-10

Publications (1)

Publication Number Publication Date
WO2014199127A1 true WO2014199127A1 (fr) 2014-12-18

Family

ID=48875987

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2014/051689 WO2014199127A1 (fr) 2013-06-10 2014-06-03 Génération d'images stéréoscopiques avec niveau asymétrique de netteté

Country Status (2)

Country Link
GB (1) GB201310256D0 (fr)
WO (1) WO2014199127A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018209969A1 (fr) * 2017-05-19 2018-11-22 成都通甲优博科技有限责任公司 Procédé et système de création de carte de profondeur ainsi que procédé et système de flou d'image
US10943359B2 (en) 2016-08-04 2021-03-09 Dolby Laboratories Licensing Corporation Single depth tracked accommodation-vergence solutions

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1995013564A1 (fr) * 1993-11-09 1995-05-18 Eric Martin White Procede et appareil de visualisation en trois dimensions d'images cinematographiques bidimensionnelles
US20120154547A1 (en) * 2010-07-23 2012-06-21 Hidekuni Aizawa Imaging device, control method thereof, and program
US20130093754A1 (en) * 2011-10-14 2013-04-18 Ching-Ming Wei 3d image processing method with a reduced ghost effect and 3d display device thereof

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1995013564A1 (fr) * 1993-11-09 1995-05-18 Eric Martin White Procede et appareil de visualisation en trois dimensions d'images cinematographiques bidimensionnelles
US20120154547A1 (en) * 2010-07-23 2012-06-21 Hidekuni Aizawa Imaging device, control method thereof, and program
US20130093754A1 (en) * 2011-10-14 2013-04-18 Ching-Ming Wei 3d image processing method with a reduced ghost effect and 3d display device thereof

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10943359B2 (en) 2016-08-04 2021-03-09 Dolby Laboratories Licensing Corporation Single depth tracked accommodation-vergence solutions
US20210264631A1 (en) 2016-08-04 2021-08-26 Dolby Laboratories Licensing Corporation Single depth tracked accommodation-vergence solutions
US11694353B2 (en) 2016-08-04 2023-07-04 Dolby Laboratories Licensing Corporation Single depth tracked accommodation-vergence solutions
WO2018209969A1 (fr) * 2017-05-19 2018-11-22 成都通甲优博科技有限责任公司 Procédé et système de création de carte de profondeur ainsi que procédé et système de flou d'image

Also Published As

Publication number Publication date
GB201310256D0 (en) 2013-07-24

Similar Documents

Publication Publication Date Title
DE102011057187B4 (de) Stereoskopische Bildanzeigevorrichtung und Verfahren zum Einstellen eines stereoskopischen Bildes derselben
EP2332340B1 (fr) Procédé de traitement d'informations de parallaxe comprises dans un signal
US20160041662A1 (en) Method for changing play mode, method for changing display mode, and display apparatus and 3d image providing system using the same
JP5427035B2 (ja) 複数の個別設定を用いた画像観察
KR20110044573A (ko) 디스플레이장치 및 그 영상표시방법
KR20160117522A (ko) 멀티-포컬 디스플레이 시스템 및 방법
US20130249874A1 (en) Method and system for 3d display with adaptive disparity
JP2011071898A (ja) 立体映像表示装置および立体映像表示方法
US20120236114A1 (en) Depth information generator for generating depth information output by only processing part of received images having different views, and related depth information generating method and depth adjusting apparatus thereof
WO2012175939A1 (fr) Appareil et procédé d'affichage d'images
US11310487B1 (en) Frustum change in projection stereo rendering
JP2011035712A (ja) 画像処理装置、画像処理方法及び立体画像表示装置
CN104539935A (zh) 图像亮度的调节方法及调节装置、显示装置
US20120188226A1 (en) Method and system for displaying stereoscopic images
JP2010171628A (ja) 画像処理装置、プログラム、画像処理方法、記録方法および記録媒体
Moreau Visual immersion issues in Virtual Reality: a survey
WO2014199127A1 (fr) Génération d'images stéréoscopiques avec niveau asymétrique de netteté
US20120098831A1 (en) 3d display apparatus and method for processing 3d image
CN113692738A (zh) 一种用于模拟三维图像序列的方法和系统
JP5902701B2 (ja) ３次元画像にグラフィックオブジェクトを散りばめる３次元画像生成方法及びこれに用いられる表示装置
JP2013057697A (ja) 立体映像表示装置
JP4951079B2 (ja) 立体表示装置、映像処理装置
JP2014053782A (ja) 立体画像データ処理装置、および、立体画像データ処理方法
JP2013024910A (ja) 観察用光学機器
KR102242923B1 (ko) 스테레오 카메라의 정렬장치 및 스테레오 카메라의 정렬방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14734209

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14734209

Country of ref document: EP

Kind code of ref document: A1