WO2017222665A2 - Presentation of scenes for binocular rivalry perception - Google Patents

Presentation of scenes for binocular rivalry perception Download PDF

Info

Publication number
WO2017222665A2
WO2017222665A2 PCT/US2017/031995 US2017031995W WO2017222665A2 WO 2017222665 A2 WO2017222665 A2 WO 2017222665A2 US 2017031995 W US2017031995 W US 2017031995W WO 2017222665 A2 WO2017222665 A2 WO 2017222665A2
Authority
WO
WIPO (PCT)
Prior art keywords
image
scene
camera
enhanced
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2017/031995
Other languages
French (fr)
Other versions
WO2017222665A3 (en
Inventor
Vadim SUKHOMLINOV
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Intel Corp
Original Assignee
Intel Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intel Corp filed Critical Intel Corp
Publication of WO2017222665A2 publication Critical patent/WO2017222665A2/en
Publication of WO2017222665A3 publication Critical patent/WO2017222665A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006Mixed reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/122Improving the three-dimensional [3D] impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00Three-dimensional [3D] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • G06T15/205Image-based rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/239Image signal generators using stereoscopic image cameras using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/25Image signal generators using stereoscopic image cameras using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/254Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/271Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/324Colour aspects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0132Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/014Head-up displays characterised by optical features comprising information/image processing systems

Definitions

  • Embodiments of the present disclosure generally relate to the field of augmented or virtual reality and, more particularly, to presentation of scenes for binocular rivalry perception.
  • the rich content information may block the real world picture and prevent interactions and/or activity based on visual input.
  • Previous solutions have tried to minimize the amount of area used by additional information or have used the application of graphic effects such as transparency.
  • the previous methods are limited in that they do not preserve the original image data content in the visible light spectrum because they either cover a portion of the original image data content with opaque presentation of the rich content information or alter a portion of the visible light image when transparent presentation is used.
  • Embodiments of the presentation of information in augmented or virtual reality using binocular rivalry techniques of the present disclosure may overcome these limitations.
  • the techniques will be readily understood by the following detailed description in conjunction with the accompanying drawings. To facilitate this description, like reference numerals designate like structural elements. Embodiments are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings.
  • Figure 1 is a block diagram of a system to generate and display enhanced stereographic imagery of scenes, according to various embodiments.
  • Figure 2 is a flow diagram illustrating a method of enhanced stereographic image creation and display, according to various embodiments.
  • Figure 3 is a diagram of an enhanced stereoscopic image, according to various embodiments.
  • Figure 4 is a representation of an enhanced stereoscopic image, according to various embodiments.
  • Figure 5 is a representation of another enhanced stereoscopic image, according to various embodiments.
  • Figure 6 schematically illustrates an example computer device to generate and display enhanced stereographic imagery, according to various embodiments.
  • Fig. 7 illustrates an example storage medium with instructions configured to enable an apparatus to practice various aspects of the present disclosure, in accordance with various embodiments.
  • an apparatus to display enhanced stereographic imagery may include one or more processors, an image generation module to generate an enhanced stereoscopic image of a scene having a first two-dimensional (2D) image of the scene and a second 2D image of the same scene that is visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user at substantially the same time or in a coordinated manner, and a display module to display the enhanced stereoscopic image of the scene to the user, with the first 2D image of the scene presented to the first eye of the user and the second 2D image of the same scene presented to the second eye of the user at substantially the same time or in a coordinated manner.
  • 2D two-dimensional
  • phrase “A and/or B” means (A), (B), or (A and B).
  • phrase “A, B, and/or C” means (A), (B), (C), (A and B), (A and C), (B and C), or (A, B, and C).
  • Coupled may mean one or more of the following. “Coupled” may mean that two or more elements are in direct physical or electrical contact. However, “coupled” may also mean that two or more elements indirectly contact each other, but yet still cooperate or interact with each other, and may mean that one or more other elements are coupled or connected between the elements that are said to be coupled with each other.
  • directly coupled may mean that two or more elements are in direct contact.
  • FIG. 1 is a block diagram of a system 100 to generate and display enhanced stereographic imagery of scenes, according to various embodiments.
  • the system 100 may include a stereographic imagery device 102 that may include a processor 104 coupled with an image generation module 106 and a display module 108.
  • the system 100 may further include a camera 110, a first sensor 112, a second sensor 114, and a display 116 coupled with the processor 104.
  • the first sensor 112 and/or the second sensor 114 may sense aspects of a real scene that are not in the visible electromagnetic spectrum.
  • the first sensor 112 may e.g., be an infrared (IR) sensor and/or the second sensor 114 may e.g., be an ultraviolet (UV) sensor in some embodiments.
  • IR infrared
  • UV ultraviolet
  • two sensors are shown, it should be understood that a different number of sensors may be present in other embodiments and other types of sensors may be used, such as x-ray sensors, ultrasonic sensors, a depth camera, a 3D camera, or a thermal camera sensor. In some embodiments, more than two sensors may be present.
  • the image generation module 106 may be operated on the processor 104 to generate an enhanced stereoscopic image of a scene that may include a first 2D image of the scene and a second 2D image of the same scene based at least in part on one or more camera images captured by the camera 110, where the second 2D image may be visually and/or optically different from the first 2D image.
  • the second 2D image may be a visual representation of a non- visual spectrum of the scene, and/or include a visual element not present in the first 2D image.
  • color or some other visual representation may be used to represent non-visible aspects of a scene such as infrared or ultraviolet imagery, for example.
  • the display module 108 may be operated on the processor 104 to display the enhanced stereoscopic image to a user on the display 116.
  • the display module 108 may present the first 2D image to a first eye of a user and the second 2D image to a second eye of the user at substantially the same time or in a coordinated manner for joint/coordinated perception, thereby facilitating creation of the binocular rivalry effect when the two 2D images are perceived/consumed together.
  • Coordinated manner may include e,g., timed alternate presentation of the two 2D images to the two eyes. Experience has shown that perception/consumption of the two 2D images in this manner may enhance perception of the details of the objects of the scenes within the images.
  • the first and second 2D images may include sufficient similarity such that stereopsis and 3D perception is achieved when the first and second 2D images are presented to respective first and second eyes of a user.
  • the first and second 2D images may have at least some common edges on both images, allowing the brain of a user to match the images together when they are presented.
  • the image generation module 106 may be configured to generate the second 2D image based at least in part on one or more camera images captured by the camera 110 and sensor data captured by at least one of the first sensor 112 and the second sensor 114. In some embodiments, the image generation module 106 may be configured to generate the second 2D image based at least in part on sensor data captured by more than two sensors. In various embodiments, the visual element not present in the first 2D image may be based at least in part on the sensor data and/or the visual or optical difference between the first 2D image and the second 2D image may be based at least in part on the sensor data.
  • the camera 110 may be a camera on a headset
  • the image generation module 106 may be configured to generate the first 2D image based at least in part on one or more camera images captured by the camera 110
  • the image generation module 106 may be configured to generate the second 2D image based at least in part on a thermographic image from a thermographic sensor
  • the image generation module 106 may align the thermographic image with the one or more camera images.
  • the first 2D image and the second 2D image may be displayed to a user for applications such as construction and/or maintenance of a building or engineering system to see temperature variations in real-world objects such as hidden wire shorts or overheating due to tension, while allowing the user to simultaneously manipulate the real- world objects as they view them rather than requiring them to shift their view from a thermographic sensor to the real-world object as may be required using previous visualization techniques.
  • the image generation module 106 may be configured to generate the second 2D image based at least in part on sensor data without including imagery from a camera such as the camera 110 in the second 2D image.
  • the image generation module 106 may be configured to generate the first 2D image without using the sensor data. In other embodiments, the image generation module 106 may be configured to generate the first 2D image based at least in part on data from at least one sensor. In various embodiments, the image generation module 106 may be configured to generate additional enhanced stereoscopic images and the display module 108 may be configured to display the enhanced stereoscopic images as video stereoscopic imagery.
  • the display 116 may include a virtual reality device, a stereoscopic three dimensional (3D) display device that may use polarization or active 3D glasses to display 3D imagery, a device to project imagery directly to a user's eyes, or any other display device configured to display a first 2D image to a first eye of the user and a second 2D image to a second eye of the user.
  • a virtual reality device a stereoscopic three dimensional (3D) display device that may use polarization or active 3D glasses to display 3D imagery
  • a device to project imagery directly to a user's eyes or any other display device configured to display a first 2D image to a first eye of the user and a second 2D image to a second eye of the user.
  • FIG 2 is a flow diagram illustrating a method 200 of enhanced stereographic image creation and display, according to various embodiments.
  • some or all of the method 200 may be practiced by components of the system 100, including components of the stereographic imagery device 102, described with respect to Figure 1 (optionally, in conjunction with other components of Figure 1).
  • the method 200 may include capturing an image of a real scene with a camera (e.g., camera 110 of Fig. 1) at a block 202.
  • the method 200 may include sensing at least one aspect of the real scene that is not in the visible electromagnetic spectrum at a block 204.
  • sensing at least one aspect of the real scene may include capturing an infrared image of the real scene (e.g., with first sensor 112 of Fig. 1) and/or capturing an ultraviolet image of the real scene (e.g., with the second sensor 114 of Fig. 1).
  • the method 200 may include generating an enhanced stereoscopic image having a first 2D image and a second 2D image, where the second 2D image be visually and/or optically different from the first 2D image.
  • the second 2D image may be a visual representation of a non- visual spectrum of the scene, and/or includes a visual element not present in the first 2D image.
  • the enhanced stereoscopic image may be generated based at least in part on at least one camera image of a real scene captured by a camera.
  • generating the second 2D image may be based at least in part on at least one sensed aspect of the real scene.
  • generating the enhanced stereoscopic image may include detecting edges of objects in at least one camera image of a real scene captured by a camera, and generating the second 2D image may include removing at least some non-edge imagery from at least one of the camera images and adding the visual element not present in the first 2D image to the second 2D image.
  • the visual element may include a text label.
  • the method 200 may include displaying the first 2D image to a first eye of a user in various embodiments.
  • the method 200 may include displaying the second 2D image to a second eye of the user at a block 210 for perception at substantially the same time or in a coordinated manner.
  • the first and/or second 2D images may be generated by the processor 104 operating the display module 108 to display the 2D images using the display 116.
  • the method 200 may include performing other actions at a block 212.
  • Figure 3 is a diagram of an enhanced stereoscopic image 300, according to various embodiments.
  • the enhanced stereographic image 300 may be generated in a virtual reality environment and may include a first 2D image 302 and a second 2D image 304. Although shown in grayscale, it should be understood that the enhanced stereographic image 300 may be displayed in color in some embodiments.
  • the enhanced stereographic image 300 includes relatively simple two dimensional objects in each of the first and second 2D images, it should be understood that enhanced stereographic images using two 2D representations of more complex three dimensional forms may also be generated and displayed in a VR environment according to some embodiments.
  • the enhanced stereoscopic image may include a text label added to the first 2D image 302, indicated as "Blue” and a second text label added to the second 2D image 304, indicated as "Yellow", where the text labels on each of the first and second 2D images 302-304 do not overlap when viewed
  • first tree 306 is shown with a visual texture
  • second tree 308 in the second 2D image 304 that corresponds with a location of the first tree 306 does not include the visual texture of first tree 306.
  • joint perception/consumption of the two 2D images 302-304 may enhance perception of the details of the objects of the scenes within the images, when the two images are respectively presented to first and second eyes of a user at substantially the same time or in a coordinated manner.
  • Figure 4 is a representation of an enhanced stereoscopic image 400, according to various embodiments.
  • the enhanced stereographic image 400 may be generated in an augmented reality environment and may include a first 2D image 402 and a second 2D image 404. Although shown in grayscale for illustrative purposes, it should be understood that the enhanced stereographic image 400 may be displayed in color in some embodiments.
  • the first 2D image 402 may be a grayscale representation of a first image having a red (R) channel of a color camera image of a scene inverted to highlight areas in the shade
  • the second 2D image 404 may be a grayscale representation of a second image that may use an unaltered color camera image of the same scene.
  • the images are shown as grayscale representations for illustrative purposes, it should be understood that color images may be used in various embodiments.
  • the enhanced stereographic image 400 includes a black border around the first and second 2D images for clarity, it should be understood that the black border may not be present in some embodiments. Similar to the coordinated presentation of the two complementary 2D images 302-304, experience has shown that joint perception/consumption of the two 2D images 402-404 may enhance perception of the details of the objects of the scenes within the images, when the two images 402-404 are respectively presented to first and second eyes of a user at substantially the same time or in a coordinated manner.
  • Figure 5 is a representation of another enhanced stereoscopic image 500, according to various embodiments.
  • the enhanced stereographic image 500 may present multispectral blending using binocular rivalry and may include a first 2D image 502 and a second 2D image 504.
  • the first 2D image 502 may represent imagery in the visible light range and the second 2D image 504 may represent imagery in a non-visible portion of the electromagnetic spectrum such as the UV range.
  • the enhanced stereographic image 500 may be displayed in color in some embodiments.
  • the enhanced stereographic image 400 includes a black border around the first and second 2D images for clarity, it should be understood that the black border may not be present in some embodiments.
  • the system 100 of Fig. 1 and/or the method 200 of Fig. 2 may be used to generate and display enhanced stereographic images such as the enhanced stereographic image 300, 400, or 500 of Figs. 3-5.
  • Figure 6 illustrates an example computer device 600 that may include components corresponding to and/or implementing various components and methods of Figures 1-5, such as stereographic imagery device 102 with image generation module 106 and display module 108, described with respect to Fig. 1, in accordance with various embodiments.
  • computer device 600 may include one or more processors 602, each having one or more processor cores, and system memory 604.
  • the processor 602 may include any type of processors, single or multi-core microprocessors, and the like.
  • the processor 602 may be implemented as an integrated circuit.
  • the computer device 600 may include mass storage devices 606 (such as diskette, hard drive, volatile memory (e.g., dynamic random-access memory (DRAM), compact disc read-only memory (CD-ROM), digital versatile disk (DVD), and so forth).
  • volatile memory e.g., dynamic random-access memory (DRAM), compact disc read-only memory (CD-ROM), digital versatile disk (DVD), and so forth.
  • system memory 604 and/or mass storage devices 606 may be temporal and/or persistent storage of any type, including, but not limited to, volatile and non-volatile memory, optical, magnetic, and/or solid state mass storage, and so forth.
  • Volatile memory may include, but is not limited to, static and/or dynamic random access memory.
  • Non-volatile memory may include, but is not limited to, electrically erasable programmable read-only memory, phase change memory, resistive memory, and so forth.
  • the computer device 600 may further include input/output devices 608
  • the computer device 600 may include a stereographic system 650 having enhanced stereographic image generation and display capabilities that may include a stereographic imagery device 652 and an image generation module 654.
  • the stereographic system 650 may be configured similarly to the system 100
  • the stereographic imagery device 652 may be configured similarly to the stereographic imagery device 102
  • the image generation module 654 may be configured similarly to the image generation module 106.
  • the computer device 600 may include a portion of the stereographic system 650, such as the stereographic imagery device 652 and/or the image generation module 654 without including other components of the stereographic system 650.
  • the communication interfaces 610 may include communication chips (not shown) that may be configured to operate the computer device 600 in accordance with a Global System for Mobile Communication (GSM), General Packet Radio Service (GPRS), Universal Mobile Telecommunications System (UMTS), High Speed Packet Access (HSPA), Evolved HSPA (E-HSPA), or Long-Term Evolution (LTE) network.
  • GSM Global System for Mobile Communication
  • GPRS General Packet Radio Service
  • UMTS Universal Mobile Telecommunications System
  • HSPA High Speed Packet Access
  • E-HSPA Evolved HSPA
  • LTE Long-Term Evolution
  • the communication chips may also be configured to operate in accordance with Enhanced Data for GSM Evolution (EDGE), GSM EDGE Radio Access Network (GERAN), Universal Terrestrial Radio Access Network (UTRAN), or Evolved UTRAN (E-UTRAN).
  • EDGE Enhanced Data for GSM Evolution
  • GERAN GSM EDGE Radio Access Network
  • UTRAN Universal Terrestrial Radio Access Network
  • E-UTRAN Evolved UTRAN
  • the communication chips may be configured to operate in accordance with Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Digital Enhanced Cordless Telecommunications (DECT), Evolution-Data Optimized (EV-DO), derivatives thereof, as well as any other wireless protocols that are designated as 3G, 4G, 5G, and beyond.
  • the communication interfaces 610 may operate in accordance with other wireless protocols in other embodiments.
  • system bus 612 may represent one or more buses. In the case of multiple buses, they may be bridged by one or more bus bridges (not shown). Each of these elements may perform its conventional functions known in the art.
  • system memory 604 and mass storage devices 606 may be employed to store a working copy and a permanent copy of the programming instructions, such as drivers, for the operation of various components of computer device 600, including but not limited to operation of the system 100 of Fig. 1, the image generation module 106 of Fig. 1, the display module 108 of Fig. 1, the processor 104 of Fig. 1, the other components 120 of Fig. 1, an operating system of computer device 600, and/or one or more applications, collectively referred to as computational logic 622.
  • the various elements may be implemented by assembler instructions supported by processor(s) 602 or high-level languages that may be compiled into such instructions.
  • the permanent copy of the programming instructions may be placed into mass storage devices 606 in the factory or in the field through, for example, a distribution medium (not shown), such as a compact disc (CD), or through communication interface 610 (from a distribution server (not shown)). That is, one or more distribution media having an implementation of the agent program may be employed to distribute the agent and to program various computing devices.
  • a distribution medium such as a compact disc (CD)
  • CD compact disc
  • communication interface 610 from a distribution server (not shown)
  • the number, capability, and/or capacity of the elements 608, 610, 612 may vary, depending on whether computer device 600 is used as a stationary computing device, such as a set-top box or desktop computer, or a mobile computing device, such as a tablet computing device, laptop computer, game console, or smartphone. Their constitutions are otherwise known, and accordingly will not be further described.
  • processors 602 may be packaged together with all or portions of computational logic 622 configured to facilitate aspects of embodiments described herein to form a System in Package (SiP) or a System on Chip (SoC).
  • SiP System in Package
  • SoC System on Chip
  • the computer device 600 may include or otherwise be associated with a stereographic imagery system that may include components and/or implement methods described with respect to Figs. 1-2, such as the stereographic imagery device 102, the image generation module 106, or the display module 108 as described above.
  • a stereographic imagery system may include components and/or implement methods described with respect to Figs. 1-2, such as the stereographic imagery device 102, the image generation module 106, or the display module 108 as described above.
  • one or more components such as processor 602 may be included as a part of the stereographic imagery device 102.
  • the computer device 600 may comprise one or more components of a data center, a laptop, a netbook, a notebook, an ultrabook, a smartphone, a tablet, a personal digital assistant (PDA), an ultra mobile PC, a mobile phone, or a digital camera.
  • the computer device 600 may be any other electronic device that processes data.
  • Fig. 7 illustrates example computer-readable storage medium 702 having instructions configured to practice all or selected ones of the operations associated with the computer device 600, earlier described with respect to Fig. 6; the system 100 of Fig. 1; the image generation module 106; the display module 108; and/or the other components 120 of Fig. 1, in accordance with various embodiments.
  • computer-readable storage medium 702 may include a number of programming instructions 704.
  • the storage medium 702 may represent a broad range of non-transitory persistent storage medium known in the art, including but not limited to flash memory, dynamic random access memory, static random access memory, an optical disk, a magnetic disk, etc.
  • Programming instructions 704 may be configured to enable a device, e.g., computer 600, system 100, image generation module 106, and/or display module 108 in response to execution of the programming instructions 704, to perform, e.g., but not limited to, various operations described for the image generation module 106, the display module 108, and/or the other components 120 shown in Fig. 1, or operations shown in process 200 of Fig. 2.
  • programming instructions 704 may be disposed on multiple computer- readable storage media 702.
  • storage medium 702 may be transitory, e.g., signals encoded with programming instructions 704.
  • processors 602 may be packaged together with memory having all or portions of computational logic 622 configured to practice aspects described for the image generation module 106, the display module 108, and/or other components of the stereographic imagery device 102 shown in Fig. 1, or operations shown in process 200 of Fig. 2.
  • processors 602 may be packaged together with memory having all or portions of computational logic 622 configured to practice aspects described for the image generation module 106, the display module 108, and/or other components of the stereographic imagery device 102 shown in Fig. 1, or operations shown in process 200 of Fig. 2 to form a System in Package (SiP).
  • SiP System in Package
  • processors 602 may be integrated on the same die with memory having all or portions of computational logic 622 configured to practice aspects described for the image generation module 106, the display module 108, and/or other components of the stereographic imagery device 102 shown in Fig. 1, or operations shown in process 200 of Fig. 2.
  • processors 602 may be packaged together with memory having all or portions of computational logic 622 configured to practice aspects of the image generation module
  • the SoC may be utilized in, e.g., but not limited to, a mobile computing device such as a wearable device and/or a smartphone.
  • Machine-readable media including non-transitory machine-readable media, such as machine-readable storage media
  • methods, systems and devices for performing the above-described techniques are illustrative examples of embodiments disclosed herein. Additionally, other devices in the above-described interactions may be configured to perform various disclosed techniques.
  • Example 1 may include an apparatus to display enhanced stereographic imagery, comprising: one or more processors; an image generation module, to be operated on the one or more processors, to generate an enhanced stereoscopic image of a scene, wherein the image generation module is to generate a first two dimensional (2D) image of the scene and a second 2D image of the same scene, the second 2D image to be visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user at substantially the same time or in a coordinated manner; and a display module, to be operated on the one or more processors, to display the enhanced stereoscopic image of the scene to the user, wherein the display module is to present the first 2D image to the first eye of the user and the visually or optically different second 2D image of the same scene to the second eye of the user at substantially the same time or in a coordinated manner.
  • an apparatus to display enhanced stereographic imagery comprising: one or more
  • Example 2 may include the subject matter of Example 1, wherein the image generation module is to generate the first 2D image based at least in part on a first camera image of a real scene and the image generation module is to generate the second 2D image based at least in part on a second camera image of the real scene.
  • Example 3 may include the subject matter of Example 2, wherein the image generation module is to generate the second 2D image based at least in part on sensor data, wherein the sensor data corresponds to an aspect of the real scene that is not in the visible electromagnetic spectrum, and wherein the image generation module is to generate the first 2D image without using the sensor data.
  • Example 4 may include the subject matter of Example 3, wherein the sensor data corresponds to at least one of ultraviolet or infrared imagery of the real scene.
  • Example 5 may include the subject matter of any one of Examples 1-4, wherein the second 2D image includes a visual element not present in the first 2D image.
  • Example 6 may include the subject matter of of Example 5, wherein the visual element not present in the first 2D image includes a text label.
  • Example 7 may include the subject matter of Example 6, wherein the visual element is a first visual element and the text label is a first text label, wherein the first 2D image includes a second visual element that includes a second text label that is not present in the second 2D image, wherein the first and second text labels do not overlap when viewed stereoscopically.
  • Example 8 may include the subject matter of any one of Examples 1-7, wherein the enhanced stereoscopic image is a first enhanced stereoscopic image, the image generation module is to generate additional enhanced stereoscopic images, and the display module is to successively display the first enhanced stereoscopic image and the additional enhanced stereoscopic images as video stereoscopic imagery.
  • Example 9 may include a system to display enhanced stereographic imagery comprising: a camera; one or more processors coupled with the camera; a display coupled with the one or more processors; an image generation module, to be operated on the one or more processors, to generate an enhanced stereoscopic image of a scene, wherein the image generation module is to generate a first two dimensional (2D) image of the scene and a second 2D image of the same scene based at least in part on one or more camera images captured by the camera, the second 2D image to be visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user at substantially the same time or in a coordinated manner; and a display module, to be operated on the one or more processors, to display the enhanced stereoscopic image to the user on the display, wherein the display module is to present the first 2D image of the scene to the first eye of the user and the second 2D image to the second eye of
  • Example 10 may include the subject matter of Example 9, further comprising a sensor coupled with the one or more processors, wherein the image generation module is to generate the second 2D image based at least in part on one or more camera images captured by the camera and sensor data captured by the sensor.
  • Example 11 may include the subject matter of Example 10, wherein the sensor is an infrared sensor and the sensor data includes infrared image data.
  • Example 12 may include the subject matter of Example 11, wherein the sensor is a first sensor and the system further comprises an ultraviolet sensor coupled with the one or more processors, wherein the image generation module is also to generate the second 2D image based at least in part on ultraviolet image data captured by the ultraviolet sensor.
  • Example 13 may include a method for enhanced stereographic image creation comprising: generating, by a computer device, an enhanced stereoscopic image of a scene having a first two-dimensional (2D) image of the scene and a second 2D image of the same scene, wherein the second 2D image is visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user at substantially the same time or in a coordinated manner; displaying the first 2D image to the first eye of the user; and displaying the second 2D image to the second eye of the user.
  • a method for enhanced stereographic image creation comprising: generating, by a computer device, an enhanced stereoscopic image of a scene having a first two-dimensional (2D) image of the scene and a second 2D image of the same scene, wherein the second 2D image is visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second
  • Example 14 may include the subject matter of Example 13, wherein the enhanced stereoscopic image is generated based at least in part on at least one camera image of a real scene captured by a camera.
  • Example 15 may include the subject matter of Example 14, further comprising sensing at least one aspect of the real scene, wherein the at least one aspect is not in the visible electromagnetic spectrum, and wherein generating the second 2D image is based at least in part on the sensed at least one aspect.
  • Example 16 may include the subject matter of Example 15, wherein sensing the at least one aspect includes capturing at least one of an infrared image or an ultraviolet image of the real scene, and wherein generating the second 2D image is based at least in part on at least one of the infrared image or the ultraviolet image.
  • Example 17 may include the subject matter of any one of Examples 14-16, wherein generating the enhanced stereoscopic image includes: detecting edges of objects in at least one of the at least one camera image; and generating the second 2D image by removing at least some non-edge imagery from the at least one of the at least one camera image and adding a visual element to the second 2D image.
  • Example 18 may include the subject matter of Example 17, wherein the visual element includes a text label.
  • Example 19 may include the subject matter of any one of Examples 17-18, wherein the visual element is a first visual element and the first 2D image includes a second visual element not present in the second 2D image, wherein the first and second visual elements do not overlap when the first and second 2D images are viewed stereoscopically.
  • Example 20 may include one or more computer-readable media comprising instructions that cause a computing device, in response to execution of the instructions by the computing device, to: generate an enhanced stereoscopic image of a scene having a first two-dimensional (2D) image of the scene and a second 2D image of the same scene, wherein the second 2D image is visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user at substantially the same time or in a coordinated manner; display the first 2D image to the first eye of the user; and display the second 2D image to the second eye of the user.
  • 2D two-dimensional
  • Example 21 may include the subject matter of Example 20, wherein the instructions are further to cause the computing device to generate the first 2D image based at least in part on a first camera image of a real scene and to generate the second 2D image based at least in part on a second camera image of the real scene.
  • Example 22 may include the subject matter of Example 21, wherein the instructions are further to cause the computing device to generate the second 2D image based at least in part on sensor data, wherein the sensor data corresponds to an aspect of the real scene that is not in the visible electromagnetic spectrum.
  • Example 23 may include the subject matter of Example 22, wherein the sensor data includes at least one of an infrared image or an ultraviolet image of the real scene and a visual difference between the second 2D image and the first 2D image is generated based at least in part on at least one of the infrared image or the ultraviolet image.
  • Example 24 may include the subject matter of Example 22, wherein the sensor data includes an infrared image and an ultraviolet image of the real scene and a visual difference between the second 2D image and the first 2D image is generated based at least in part on the infrared image and the ultraviolet image.
  • Example 25 may include the subject matter of Example 24, wherein the instructions are further to cause the computing device to display the second 2D image using a red channel, a blue channel, and a green channel, wherein a first one of the red, blue, and green channels is to be used to display imagery based at least in part on the ultraviolet image, a second one of the red, blue, and green channels is to be used to display imagery based at least in part on the infrared image, and a third one of the red, blue, and green channels is to be used to display imagery based at least in part on the second camera image.
  • the instructions are further to cause the computing device to display the second 2D image using a red channel, a blue channel, and a green channel, wherein a first one of the red, blue, and green channels is to be used to display imagery based at least in part on the ultraviolet image, a second one of the red, blue, and green channels is to be used to display imagery based at least in part on the infrared image, and a third one of the
  • Example 26 may include the subject matter of any one of Examples 20-25, wherein the instructions are to cause the computing device to display the first and second 2D images in a virtual reality environment.
  • Example 27 may include the subject matter of any one of Examples 20-25, wherein the instructions are to cause the computing device to display the first and second 2D images in an augmented reality environment.
  • Example 28 may include the subject matter of any one of Examples 20-27, wherein the second 2D image includes a first visual element not present in the first 2D image, wherein the first visual element includes a text label, and wherein the second 2D image includes a second visual element not present in the first 2D image, wherein the second visual element is based at least in part on sensor data, wherein the sensor data corresponds to an aspect of the real scene that is not in the visible electromagnetic spectrum.
  • Example 29 may include an apparatus to display enhanced stereographic imagery comprising: means for generating an enhanced stereoscopic image of a scene having a first two-dimensional (2D) image of the scene and a second 2D image of the same scene, wherein the second 2D image is visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user at substantially the same time or in a coordinated manner; means for displaying the first 2D image to the first eye of the user; and means for displaying the second 2D image to the second eye of the user.
  • 2D two-dimensional
  • Example 30 may include the subject matter of Example 29, wherein the means for generating the enhanced stereoscopic image is to generate the enhanced stereoscopic image based at least in part on at least one camera image of a real scene captured by a camera.
  • Example 31 may include the subject matter of Example 30, further comprising means for sensing at least one aspect of the real scene, wherein the at least one aspect is not in the visible electromagnetic spectrum, and wherein the means for generating the enhanced stereoscopic image is to generate the second 2D image based at least in part on the at least one aspect of the real scene.
  • Example 32 may include the subject matter of Example 31, wherein the means for sensing the at least one aspect of the real scene includes means for capturing at least one of an infrared image or an ultraviolet image of the real scene, and wherein the means for generating the enhanced stereoscopic image is to generate the second 2D image based at least in part on at least one of the infrared image or the ultraviolet image.
  • Example 33 may include the subject matter of any one of Examples 30-32, wherein the means for generating the enhanced stereoscopic image includes: means for detecting edges of objects in at least one of the at least one camera image; means for removing at least some non-edge imagery from the at least one of the at least one camera image; and means for adding the visual element to the second 2D image.
  • Example 34 may include the subject matter Example 33, wherein the visual element includes a text label.
  • Example 35 may include the subject matter of any one of Examples 33-34, wherein the visual element is a first visual element and the first 2D image includes a second visual element not present in the second 2D image, wherein the first and second visual elements do not overlap when the first and second 2D images are viewed stereoscopically.
  • Example 36 may include the subject matter of Example 1, further comprising a camera coupled with the one or more processors; and a display coupled with the one or more processors, wherein the image generation module is to generate the first 2D image of the scene and the second 2D image of the same scene based at least in part on one or more camera images captured by a camera, and wherein the display module is to display the enhanced stereoscopic image of the scene to the user on the display.
  • Example 37 may include the subject matter of Example 36, further comprising: an infrared sensor coupled with the one or more processors; and an ultraviolet sensor coupled with the one or more processors, wherein the image generation module is to generate the second 2D image based at least in part on one or more camera images captured by the camera, infrared image data captured by the infrared sensor, and ultraviolet image data captured by the ultraviolet sensor.
  • Various embodiments may include any suitable combination of the above- described embodiments including alternative (or) embodiments of embodiments that are described in conjunctive form (and) above (e.g., the "and” may be “and/or”).
  • some embodiments may include one or more articles of manufacture (e.g., non-transitory computer-readable media) having instructions, stored thereon, that when executed result in actions of any of the above-described embodiments.
  • some embodiments may include apparatuses or systems having any suitable means for carrying out the various operations of the above-described embodiments.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Computer Graphics (AREA)
  • Electromagnetism (AREA)
  • Geometry (AREA)
  • Computing Systems (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

Embodiments herein relate to the display of enhanced stereographic imagery in augmented or virtual reality. In various embodiments, an apparatus to display enhanced stereographic imagery may include one or more processors, an image generation module to generate an enhanced stereoscopic image of a scene having a first two-dimensional (2D) image of the scene and a second 2D image of the same scene that is visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user, and a display module to display the enhanced stereoscopic image to the user, with the first 2D image presented to the first eye of the user and the second 2D image presented to the second eye of the user. Other embodiments may be described and/or claimed.

Description

PRESENTATION OF SCENES FOR BINOCULAR RIVALRY PERCEPTION
Related Applications
This application claims priority to U.S. Application 15/191,014, entitled "PRESENTATION OF SCENES FOR BINOCULAR RIVALRY PERCEPTION," filed June 23, 2016.
Field
Embodiments of the present disclosure generally relate to the field of augmented or virtual reality and, more particularly, to presentation of scenes for binocular rivalry perception.
Background
In augmented reality applications, it is sometimes desirable to present rich content covering a significant area of the field of view of a real world picture. The rich content information may block the real world picture and prevent interactions and/or activity based on visual input. Previous solutions have tried to minimize the amount of area used by additional information or have used the application of graphic effects such as transparency. However, the previous methods are limited in that they do not preserve the original image data content in the visible light spectrum because they either cover a portion of the original image data content with opaque presentation of the rich content information or alter a portion of the visible light image when transparent presentation is used.
Brief Description of the Drawings
Embodiments of the presentation of information in augmented or virtual reality using binocular rivalry techniques of the present disclosure may overcome these limitations. The techniques will be readily understood by the following detailed description in conjunction with the accompanying drawings. To facilitate this description, like reference numerals designate like structural elements. Embodiments are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings.
Figure 1 is a block diagram of a system to generate and display enhanced stereographic imagery of scenes, according to various embodiments.
Figure 2 is a flow diagram illustrating a method of enhanced stereographic image creation and display, according to various embodiments. Figure 3 is a diagram of an enhanced stereoscopic image, according to various embodiments.
Figure 4 is a representation of an enhanced stereoscopic image, according to various embodiments.
Figure 5 is a representation of another enhanced stereoscopic image, according to various embodiments.
Figure 6 schematically illustrates an example computer device to generate and display enhanced stereographic imagery, according to various embodiments.
Fig. 7 illustrates an example storage medium with instructions configured to enable an apparatus to practice various aspects of the present disclosure, in accordance with various embodiments.
Detailed Description
Embodiments of the present disclosure describe devices, systems, and techniques to generate and display enhanced stereographic imagery in augmented or virtual reality. In various embodiments, an apparatus to display enhanced stereographic imagery may include one or more processors, an image generation module to generate an enhanced stereoscopic image of a scene having a first two-dimensional (2D) image of the scene and a second 2D image of the same scene that is visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user at substantially the same time or in a coordinated manner, and a display module to display the enhanced stereoscopic image of the scene to the user, with the first 2D image of the scene presented to the first eye of the user and the second 2D image of the same scene presented to the second eye of the user at substantially the same time or in a coordinated manner.
In the following description, various aspects of the illustrative implementations will be described using terms commonly employed by those skilled in the art to convey the substance of their work to others skilled in the art. However, it will be apparent to those skilled in the art that embodiments of the present disclosure may be practiced with only some of the described aspects. For purposes of explanation, specific numbers, materials, and configurations are set forth in order to provide a thorough understanding of the illustrative implementations. It will be apparent to one skilled in the art that embodiments of the present disclosure may be practiced without the specific details. In other instances, well-known features are omitted or simplified in order not to obscure the illustrative implementations.
In the following detailed description, reference is made to the accompanying drawings that form a part hereof, wherein like numerals designate like parts throughout, and in which is shown by way of illustration embodiments in which the subject matter of the present disclosure may be practiced. It is to be understood that other embodiments may be utilized and structural or logical changes may be made without departing from the scope of the present disclosure. Therefore, the following detailed description is not to be taken in a limiting sense, and the scope of embodiments is defined by the appended claims and their equivalents.
For the purposes of the present disclosure, the phrase "A and/or B" means (A), (B), or (A and B). For the purposes of the present disclosure, the phrase "A, B, and/or C" means (A), (B), (C), (A and B), (A and C), (B and C), or (A, B, and C).
The description may use perspective-based descriptions such as top/bottom, in/out, over/under, and the like. Such descriptions are merely used to facilitate the discussion and are not intended to restrict the application of embodiments described herein to any particular orientation.
The description may use the phrases "in an embodiment," or "in embodiments," which may each refer to one or more of the same or different
embodiments. Furthermore, the terms "comprising," "including," "having," and the like, as used with respect to embodiments of the present disclosure, are synonymous.
The term "coupled with," along with its derivatives, may be used herein. "Coupled" may mean one or more of the following. "Coupled" may mean that two or more elements are in direct physical or electrical contact. However, "coupled" may also mean that two or more elements indirectly contact each other, but yet still cooperate or interact with each other, and may mean that one or more other elements are coupled or connected between the elements that are said to be coupled with each other. The term "directly coupled" may mean that two or more elements are in direct contact.
As used herein, the term "module" may refer to, be part of, or include an Application Specific Integrated Circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group), and/or memory (shared, dedicated, or group) that execute one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality. Figure 1 is a block diagram of a system 100 to generate and display enhanced stereographic imagery of scenes, according to various embodiments. In some embodiments, the system 100 may include a stereographic imagery device 102 that may include a processor 104 coupled with an image generation module 106 and a display module 108. In various embodiments, the system 100 may further include a camera 110, a first sensor 112, a second sensor 114, and a display 116 coupled with the processor 104. In some embodiments, the first sensor 112 and/or the second sensor 114 may sense aspects of a real scene that are not in the visible electromagnetic spectrum. The first sensor 112 may e.g., be an infrared (IR) sensor and/or the second sensor 114 may e.g., be an ultraviolet (UV) sensor in some embodiments. Although two sensors are shown, it should be understood that a different number of sensors may be present in other embodiments and other types of sensors may be used, such as x-ray sensors, ultrasonic sensors, a depth camera, a 3D camera, or a thermal camera sensor. In some embodiments, more than two sensors may be present.
In various embodiments, the image generation module 106 may be operated on the processor 104 to generate an enhanced stereoscopic image of a scene that may include a first 2D image of the scene and a second 2D image of the same scene based at least in part on one or more camera images captured by the camera 110, where the second 2D image may be visually and/or optically different from the first 2D image. For example, the second 2D image may be a visual representation of a non- visual spectrum of the scene, and/or include a visual element not present in the first 2D image. In various embodiments, color or some other visual representation may be used to represent non-visible aspects of a scene such as infrared or ultraviolet imagery, for example. In some embodiments, the display module 108 may be operated on the processor 104 to display the enhanced stereoscopic image to a user on the display 116. In various embodiments, the display module 108 may present the first 2D image to a first eye of a user and the second 2D image to a second eye of the user at substantially the same time or in a coordinated manner for joint/coordinated perception, thereby facilitating creation of the binocular rivalry effect when the two 2D images are perceived/consumed together. Coordinated manner may include e,g., timed alternate presentation of the two 2D images to the two eyes. Experience has shown that perception/consumption of the two 2D images in this manner may enhance perception of the details of the objects of the scenes within the images. In some embodiments, the first and second 2D images may include sufficient similarity such that stereopsis and 3D perception is achieved when the first and second 2D images are presented to respective first and second eyes of a user. In various embodiments, the first and second 2D images may have at least some common edges on both images, allowing the brain of a user to match the images together when they are presented.
In some embodiments, the image generation module 106 may be configured to generate the second 2D image based at least in part on one or more camera images captured by the camera 110 and sensor data captured by at least one of the first sensor 112 and the second sensor 114. In some embodiments, the image generation module 106 may be configured to generate the second 2D image based at least in part on sensor data captured by more than two sensors. In various embodiments, the visual element not present in the first 2D image may be based at least in part on the sensor data and/or the visual or optical difference between the first 2D image and the second 2D image may be based at least in part on the sensor data.
In some embodiments, the camera 110 may be a camera on a headset, the image generation module 106 may be configured to generate the first 2D image based at least in part on one or more camera images captured by the camera 110, the image generation module 106 may be configured to generate the second 2D image based at least in part on a thermographic image from a thermographic sensor, and the image generation module 106 may align the thermographic image with the one or more camera images. In some embodiments, the first 2D image and the second 2D image may be displayed to a user for applications such as construction and/or maintenance of a building or engineering system to see temperature variations in real-world objects such as hidden wire shorts or overheating due to tension, while allowing the user to simultaneously manipulate the real- world objects as they view them rather than requiring them to shift their view from a thermographic sensor to the real-world object as may be required using previous visualization techniques. In various embodiments, the image generation module 106 may be configured to generate the second 2D image based at least in part on sensor data without including imagery from a camera such as the camera 110 in the second 2D image.
In some embodiments, the image generation module 106 may be configured to generate the first 2D image without using the sensor data. In other embodiments, the image generation module 106 may be configured to generate the first 2D image based at least in part on data from at least one sensor. In various embodiments, the image generation module 106 may be configured to generate additional enhanced stereoscopic images and the display module 108 may be configured to display the enhanced stereoscopic images as video stereoscopic imagery. In various embodiments, the display 116 may include a virtual reality device, a stereoscopic three dimensional (3D) display device that may use polarization or active 3D glasses to display 3D imagery, a device to project imagery directly to a user's eyes, or any other display device configured to display a first 2D image to a first eye of the user and a second 2D image to a second eye of the user.
Figure 2 is a flow diagram illustrating a method 200 of enhanced stereographic image creation and display, according to various embodiments. In embodiments, some or all of the method 200 may be practiced by components of the system 100, including components of the stereographic imagery device 102, described with respect to Figure 1 (optionally, in conjunction with other components of Figure 1).
In some embodiments, the method 200 may include capturing an image of a real scene with a camera (e.g., camera 110 of Fig. 1) at a block 202. In various embodiments, the method 200 may include sensing at least one aspect of the real scene that is not in the visible electromagnetic spectrum at a block 204. In some embodiments, sensing at least one aspect of the real scene may include capturing an infrared image of the real scene (e.g., with first sensor 112 of Fig. 1) and/or capturing an ultraviolet image of the real scene (e.g., with the second sensor 114 of Fig. 1).
In various embodiments, at a block 206, the method 200 may include generating an enhanced stereoscopic image having a first 2D image and a second 2D image, where the second 2D image be visually and/or optically different from the first 2D image. For example, the second 2D image may be a visual representation of a non- visual spectrum of the scene, and/or includes a visual element not present in the first 2D image. In some embodiments, the enhanced stereoscopic image may be generated based at least in part on at least one camera image of a real scene captured by a camera. In various embodiments, generating the second 2D image may be based at least in part on at least one sensed aspect of the real scene. In some embodiments, generating the enhanced stereoscopic image may include detecting edges of objects in at least one camera image of a real scene captured by a camera, and generating the second 2D image may include removing at least some non-edge imagery from at least one of the camera images and adding the visual element not present in the first 2D image to the second 2D image. In some embodiments, the visual element may include a text label. At a block 208, the method 200 may include displaying the first 2D image to a first eye of a user in various embodiments. In some embodiments, the method 200 may include displaying the second 2D image to a second eye of the user at a block 210 for perception at substantially the same time or in a coordinated manner. In some
embodiments, the first and/or second 2D images may be generated by the processor 104 operating the display module 108 to display the 2D images using the display 116. In various embodiments, the method 200 may include performing other actions at a block 212.
Figure 3 is a diagram of an enhanced stereoscopic image 300, according to various embodiments. In various embodiments, the enhanced stereographic image 300 may be generated in a virtual reality environment and may include a first 2D image 302 and a second 2D image 304. Although shown in grayscale, it should be understood that the enhanced stereographic image 300 may be displayed in color in some embodiments.
Although the enhanced stereographic image 300 includes relatively simple two dimensional objects in each of the first and second 2D images, it should be understood that enhanced stereographic images using two 2D representations of more complex three dimensional forms may also be generated and displayed in a VR environment according to some embodiments.
As shown, in some embodiments, the enhanced stereoscopic image may include a text label added to the first 2D image 302, indicated as "Blue" and a second text label added to the second 2D image 304, indicated as "Yellow", where the text labels on each of the first and second 2D images 302-304 do not overlap when viewed
stereoscopically. In some embodiments, other visual elements may also be present in one of the 2D images that is not present in the other. In the first 2D image 302, a first tree 306 is shown with a visual texture, while a second tree 308 in the second 2D image 304 that corresponds with a location of the first tree 306 does not include the visual texture of first tree 306. Experience has shown that joint perception/consumption of the two 2D images 302-304 may enhance perception of the details of the objects of the scenes within the images, when the two images are respectively presented to first and second eyes of a user at substantially the same time or in a coordinated manner.
Figure 4 is a representation of an enhanced stereoscopic image 400, according to various embodiments. In various embodiments, the enhanced stereographic image 400 may be generated in an augmented reality environment and may include a first 2D image 402 and a second 2D image 404. Although shown in grayscale for illustrative purposes, it should be understood that the enhanced stereographic image 400 may be displayed in color in some embodiments. In some embodiments, the first 2D image 402 may be a grayscale representation of a first image having a red (R) channel of a color camera image of a scene inverted to highlight areas in the shade, while the second 2D image 404 may be a grayscale representation of a second image that may use an unaltered color camera image of the same scene. Although the images are shown as grayscale representations for illustrative purposes, it should be understood that color images may be used in various embodiments. Although the enhanced stereographic image 400 includes a black border around the first and second 2D images for clarity, it should be understood that the black border may not be present in some embodiments. Similar to the coordinated presentation of the two complementary 2D images 302-304, experience has shown that joint perception/consumption of the two 2D images 402-404 may enhance perception of the details of the objects of the scenes within the images, when the two images 402-404 are respectively presented to first and second eyes of a user at substantially the same time or in a coordinated manner.
Figure 5 is a representation of another enhanced stereoscopic image 500, according to various embodiments. In various embodiments, the enhanced stereographic image 500 may present multispectral blending using binocular rivalry and may include a first 2D image 502 and a second 2D image 504. In some embodiments, the first 2D image 502 may represent imagery in the visible light range and the second 2D image 504 may represent imagery in a non-visible portion of the electromagnetic spectrum such as the UV range. Although shown in grayscale, it should be understood that the enhanced stereographic image 500 may be displayed in color in some embodiments. Although the enhanced stereographic image 400 includes a black border around the first and second 2D images for clarity, it should be understood that the black border may not be present in some embodiments. Similar to the coordinated presentation of the complementary 2D images 302-304 and 402-404, experience has shown that joint perception/consumption of the two 2D images 502-504 may enhance perception of the details of the objects of the scenes within the images, when the two images 502-504 are respectively presented to first and second eyes of a user at substantially the same time or in a coordinated manner. In various embodiments, the system 100 of Fig. 1 and/or the method 200 of Fig. 2 may be used to generate and display enhanced stereographic images such as the enhanced stereographic image 300, 400, or 500 of Figs. 3-5.
Figure 6 illustrates an example computer device 600 that may include components corresponding to and/or implementing various components and methods of Figures 1-5, such as stereographic imagery device 102 with image generation module 106 and display module 108, described with respect to Fig. 1, in accordance with various embodiments. As shown, computer device 600 may include one or more processors 602, each having one or more processor cores, and system memory 604. The processor 602 may include any type of processors, single or multi-core microprocessors, and the like. The processor 602 may be implemented as an integrated circuit. The computer device 600 may include mass storage devices 606 (such as diskette, hard drive, volatile memory (e.g., dynamic random-access memory (DRAM), compact disc read-only memory (CD-ROM), digital versatile disk (DVD), and so forth). In general, system memory 604 and/or mass storage devices 606 may be temporal and/or persistent storage of any type, including, but not limited to, volatile and non-volatile memory, optical, magnetic, and/or solid state mass storage, and so forth. Volatile memory may include, but is not limited to, static and/or dynamic random access memory. Non-volatile memory may include, but is not limited to, electrically erasable programmable read-only memory, phase change memory, resistive memory, and so forth.
The computer device 600 may further include input/output devices 608
(such as a display (e.g., a touchscreen display), keyboard, cursor control, remote control, gaming controller, image capture device, and so forth) and communication interfaces 610 (such as network interface cards, modems, infrared receivers, radio receivers (e.g., Bluetooth), and so forth). The computer device 600 may include a stereographic system 650 having enhanced stereographic image generation and display capabilities that may include a stereographic imagery device 652 and an image generation module 654. In various embodiments, the stereographic system 650 may be configured similarly to the system 100, the stereographic imagery device 652 may be configured similarly to the stereographic imagery device 102, and/or the image generation module 654 may be configured similarly to the image generation module 106. In some embodiments, the computer device 600 may include a portion of the stereographic system 650, such as the stereographic imagery device 652 and/or the image generation module 654 without including other components of the stereographic system 650. The communication interfaces 610 may include communication chips (not shown) that may be configured to operate the computer device 600 in accordance with a Global System for Mobile Communication (GSM), General Packet Radio Service (GPRS), Universal Mobile Telecommunications System (UMTS), High Speed Packet Access (HSPA), Evolved HSPA (E-HSPA), or Long-Term Evolution (LTE) network. The communication chips may also be configured to operate in accordance with Enhanced Data for GSM Evolution (EDGE), GSM EDGE Radio Access Network (GERAN), Universal Terrestrial Radio Access Network (UTRAN), or Evolved UTRAN (E-UTRAN). The communication chips may be configured to operate in accordance with Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Digital Enhanced Cordless Telecommunications (DECT), Evolution-Data Optimized (EV-DO), derivatives thereof, as well as any other wireless protocols that are designated as 3G, 4G, 5G, and beyond. The communication interfaces 610 may operate in accordance with other wireless protocols in other embodiments.
The above-described computer device 600 elements may be coupled to each other via system bus 612, which may represent one or more buses. In the case of multiple buses, they may be bridged by one or more bus bridges (not shown). Each of these elements may perform its conventional functions known in the art. In particular, system memory 604 and mass storage devices 606 may be employed to store a working copy and a permanent copy of the programming instructions, such as drivers, for the operation of various components of computer device 600, including but not limited to operation of the system 100 of Fig. 1, the image generation module 106 of Fig. 1, the display module 108 of Fig. 1, the processor 104 of Fig. 1, the other components 120 of Fig. 1, an operating system of computer device 600, and/or one or more applications, collectively referred to as computational logic 622. The various elements may be implemented by assembler instructions supported by processor(s) 602 or high-level languages that may be compiled into such instructions.
The permanent copy of the programming instructions may be placed into mass storage devices 606 in the factory or in the field through, for example, a distribution medium (not shown), such as a compact disc (CD), or through communication interface 610 (from a distribution server (not shown)). That is, one or more distribution media having an implementation of the agent program may be employed to distribute the agent and to program various computing devices. The number, capability, and/or capacity of the elements 608, 610, 612 may vary, depending on whether computer device 600 is used as a stationary computing device, such as a set-top box or desktop computer, or a mobile computing device, such as a tablet computing device, laptop computer, game console, or smartphone. Their constitutions are otherwise known, and accordingly will not be further described.
For some embodiments, at least one of processors 602 may be packaged together with all or portions of computational logic 622 configured to facilitate aspects of embodiments described herein to form a System in Package (SiP) or a System on Chip (SoC).
The computer device 600 may include or otherwise be associated with a stereographic imagery system that may include components and/or implement methods described with respect to Figs. 1-2, such as the stereographic imagery device 102, the image generation module 106, or the display module 108 as described above. In some embodiments, one or more components such as processor 602 may be included as a part of the stereographic imagery device 102.
In various implementations, the computer device 600 may comprise one or more components of a data center, a laptop, a netbook, a notebook, an ultrabook, a smartphone, a tablet, a personal digital assistant (PDA), an ultra mobile PC, a mobile phone, or a digital camera. In further implementations, the computer device 600 may be any other electronic device that processes data.
Fig. 7 illustrates example computer-readable storage medium 702 having instructions configured to practice all or selected ones of the operations associated with the computer device 600, earlier described with respect to Fig. 6; the system 100 of Fig. 1; the image generation module 106; the display module 108; and/or the other components 120 of Fig. 1, in accordance with various embodiments. As illustrated, computer-readable storage medium 702 may include a number of programming instructions 704. The storage medium 702 may represent a broad range of non-transitory persistent storage medium known in the art, including but not limited to flash memory, dynamic random access memory, static random access memory, an optical disk, a magnetic disk, etc. Programming instructions 704 may be configured to enable a device, e.g., computer 600, system 100, image generation module 106, and/or display module 108 in response to execution of the programming instructions 704, to perform, e.g., but not limited to, various operations described for the image generation module 106, the display module 108, and/or the other components 120 shown in Fig. 1, or operations shown in process 200 of Fig. 2. In alternate embodiments, programming instructions 704 may be disposed on multiple computer- readable storage media 702. In alternate embodiment, storage medium 702 may be transitory, e.g., signals encoded with programming instructions 704.
Referring back to Fig. 6, for an embodiment, at least one of processors 602 may be packaged together with memory having all or portions of computational logic 622 configured to practice aspects described for the image generation module 106, the display module 108, and/or other components of the stereographic imagery device 102 shown in Fig. 1, or operations shown in process 200 of Fig. 2. For an embodiment, at least one of processors 602 may be packaged together with memory having all or portions of computational logic 622 configured to practice aspects described for the image generation module 106, the display module 108, and/or other components of the stereographic imagery device 102 shown in Fig. 1, or operations shown in process 200 of Fig. 2 to form a System in Package (SiP). For an embodiment, at least one of processors 602 may be integrated on the same die with memory having all or portions of computational logic 622 configured to practice aspects described for the image generation module 106, the display module 108, and/or other components of the stereographic imagery device 102 shown in Fig. 1, or operations shown in process 200 of Fig. 2. For an embodiment, at least one of processors 602 may be packaged together with memory having all or portions of computational logic 622 configured to practice aspects of the image generation module
106, the display module 108, and/or other components of the stereographic imagery device 102 shown in Fig. 1, or operations shown in process 200 of Fig. 2 to form a System on Chip (SoC). For at least one embodiment, the SoC may be utilized in, e.g., but not limited to, a mobile computing device such as a wearable device and/or a smartphone.
Machine-readable media (including non-transitory machine-readable media, such as machine-readable storage media), methods, systems and devices for performing the above-described techniques are illustrative examples of embodiments disclosed herein. Additionally, other devices in the above-described interactions may be configured to perform various disclosed techniques.
EXAMPLES
Example 1 may include an apparatus to display enhanced stereographic imagery, comprising: one or more processors; an image generation module, to be operated on the one or more processors, to generate an enhanced stereoscopic image of a scene, wherein the image generation module is to generate a first two dimensional (2D) image of the scene and a second 2D image of the same scene, the second 2D image to be visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user at substantially the same time or in a coordinated manner; and a display module, to be operated on the one or more processors, to display the enhanced stereoscopic image of the scene to the user, wherein the display module is to present the first 2D image to the first eye of the user and the visually or optically different second 2D image of the same scene to the second eye of the user at substantially the same time or in a coordinated manner.
Example 2 may include the subject matter of Example 1, wherein the image generation module is to generate the first 2D image based at least in part on a first camera image of a real scene and the image generation module is to generate the second 2D image based at least in part on a second camera image of the real scene.
Example 3 may include the subject matter of Example 2, wherein the image generation module is to generate the second 2D image based at least in part on sensor data, wherein the sensor data corresponds to an aspect of the real scene that is not in the visible electromagnetic spectrum, and wherein the image generation module is to generate the first 2D image without using the sensor data.
Example 4 may include the subject matter of Example 3, wherein the sensor data corresponds to at least one of ultraviolet or infrared imagery of the real scene.
Example 5 may include the subject matter of any one of Examples 1-4, wherein the second 2D image includes a visual element not present in the first 2D image.
Example 6 may include the subject matter of of Example 5, wherein the visual element not present in the first 2D image includes a text label.
Example 7 may include the subject matter of Example 6, wherein the visual element is a first visual element and the text label is a first text label, wherein the first 2D image includes a second visual element that includes a second text label that is not present in the second 2D image, wherein the first and second text labels do not overlap when viewed stereoscopically.
Example 8 may include the subject matter of any one of Examples 1-7, wherein the enhanced stereoscopic image is a first enhanced stereoscopic image, the image generation module is to generate additional enhanced stereoscopic images, and the display module is to successively display the first enhanced stereoscopic image and the additional enhanced stereoscopic images as video stereoscopic imagery.
Example 9 may include a system to display enhanced stereographic imagery comprising: a camera; one or more processors coupled with the camera; a display coupled with the one or more processors; an image generation module, to be operated on the one or more processors, to generate an enhanced stereoscopic image of a scene, wherein the image generation module is to generate a first two dimensional (2D) image of the scene and a second 2D image of the same scene based at least in part on one or more camera images captured by the camera, the second 2D image to be visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user at substantially the same time or in a coordinated manner; and a display module, to be operated on the one or more processors, to display the enhanced stereoscopic image to the user on the display, wherein the display module is to present the first 2D image of the scene to the first eye of the user and the second 2D image to the second eye of the user at substantially the same time or in a coordinated manner.
Example 10 may include the subject matter of Example 9, further comprising a sensor coupled with the one or more processors, wherein the image generation module is to generate the second 2D image based at least in part on one or more camera images captured by the camera and sensor data captured by the sensor.
Example 11 may include the subject matter of Example 10, wherein the sensor is an infrared sensor and the sensor data includes infrared image data.
Example 12 may include the subject matter of Example 11, wherein the sensor is a first sensor and the system further comprises an ultraviolet sensor coupled with the one or more processors, wherein the image generation module is also to generate the second 2D image based at least in part on ultraviolet image data captured by the ultraviolet sensor.
Example 13 may include a method for enhanced stereographic image creation comprising: generating, by a computer device, an enhanced stereoscopic image of a scene having a first two-dimensional (2D) image of the scene and a second 2D image of the same scene, wherein the second 2D image is visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user at substantially the same time or in a coordinated manner; displaying the first 2D image to the first eye of the user; and displaying the second 2D image to the second eye of the user.
Example 14 may include the subject matter of Example 13, wherein the enhanced stereoscopic image is generated based at least in part on at least one camera image of a real scene captured by a camera.
Example 15 may include the subject matter of Example 14, further comprising sensing at least one aspect of the real scene, wherein the at least one aspect is not in the visible electromagnetic spectrum, and wherein generating the second 2D image is based at least in part on the sensed at least one aspect.
Example 16 may include the subject matter of Example 15, wherein sensing the at least one aspect includes capturing at least one of an infrared image or an ultraviolet image of the real scene, and wherein generating the second 2D image is based at least in part on at least one of the infrared image or the ultraviolet image.
Example 17 may include the subject matter of any one of Examples 14-16, wherein generating the enhanced stereoscopic image includes: detecting edges of objects in at least one of the at least one camera image; and generating the second 2D image by removing at least some non-edge imagery from the at least one of the at least one camera image and adding a visual element to the second 2D image.
Example 18 may include the subject matter of Example 17, wherein the visual element includes a text label.
Example 19 may include the subject matter of any one of Examples 17-18, wherein the visual element is a first visual element and the first 2D image includes a second visual element not present in the second 2D image, wherein the first and second visual elements do not overlap when the first and second 2D images are viewed stereoscopically.
Example 20 may include one or more computer-readable media comprising instructions that cause a computing device, in response to execution of the instructions by the computing device, to: generate an enhanced stereoscopic image of a scene having a first two-dimensional (2D) image of the scene and a second 2D image of the same scene, wherein the second 2D image is visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user at substantially the same time or in a coordinated manner; display the first 2D image to the first eye of the user; and display the second 2D image to the second eye of the user.
Example 21 may include the subject matter of Example 20, wherein the instructions are further to cause the computing device to generate the first 2D image based at least in part on a first camera image of a real scene and to generate the second 2D image based at least in part on a second camera image of the real scene.
Example 22 may include the subject matter of Example 21, wherein the instructions are further to cause the computing device to generate the second 2D image based at least in part on sensor data, wherein the sensor data corresponds to an aspect of the real scene that is not in the visible electromagnetic spectrum.
Example 23 may include the subject matter of Example 22, wherein the sensor data includes at least one of an infrared image or an ultraviolet image of the real scene and a visual difference between the second 2D image and the first 2D image is generated based at least in part on at least one of the infrared image or the ultraviolet image.
Example 24 may include the subject matter of Example 22, wherein the sensor data includes an infrared image and an ultraviolet image of the real scene and a visual difference between the second 2D image and the first 2D image is generated based at least in part on the infrared image and the ultraviolet image.
Example 25 may include the subject matter of Example 24, wherein the instructions are further to cause the computing device to display the second 2D image using a red channel, a blue channel, and a green channel, wherein a first one of the red, blue, and green channels is to be used to display imagery based at least in part on the ultraviolet image, a second one of the red, blue, and green channels is to be used to display imagery based at least in part on the infrared image, and a third one of the red, blue, and green channels is to be used to display imagery based at least in part on the second camera image.
Example 26 may include the subject matter of any one of Examples 20-25, wherein the instructions are to cause the computing device to display the first and second 2D images in a virtual reality environment.
Example 27 may include the subject matter of any one of Examples 20-25, wherein the instructions are to cause the computing device to display the first and second 2D images in an augmented reality environment. Example 28 may include the subject matter of any one of Examples 20-27, wherein the second 2D image includes a first visual element not present in the first 2D image, wherein the first visual element includes a text label, and wherein the second 2D image includes a second visual element not present in the first 2D image, wherein the second visual element is based at least in part on sensor data, wherein the sensor data corresponds to an aspect of the real scene that is not in the visible electromagnetic spectrum.
Example 29 may include an apparatus to display enhanced stereographic imagery comprising: means for generating an enhanced stereoscopic image of a scene having a first two-dimensional (2D) image of the scene and a second 2D image of the same scene, wherein the second 2D image is visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user at substantially the same time or in a coordinated manner; means for displaying the first 2D image to the first eye of the user; and means for displaying the second 2D image to the second eye of the user.
Example 30 may include the subject matter of Example 29, wherein the means for generating the enhanced stereoscopic image is to generate the enhanced stereoscopic image based at least in part on at least one camera image of a real scene captured by a camera.
Example 31 may include the subject matter of Example 30, further comprising means for sensing at least one aspect of the real scene, wherein the at least one aspect is not in the visible electromagnetic spectrum, and wherein the means for generating the enhanced stereoscopic image is to generate the second 2D image based at least in part on the at least one aspect of the real scene.
Example 32 may include the subject matter of Example 31, wherein the means for sensing the at least one aspect of the real scene includes means for capturing at least one of an infrared image or an ultraviolet image of the real scene, and wherein the means for generating the enhanced stereoscopic image is to generate the second 2D image based at least in part on at least one of the infrared image or the ultraviolet image.
Example 33 may include the subject matter of any one of Examples 30-32, wherein the means for generating the enhanced stereoscopic image includes: means for detecting edges of objects in at least one of the at least one camera image; means for removing at least some non-edge imagery from the at least one of the at least one camera image; and means for adding the visual element to the second 2D image.
Example 34 may include the subject matter Example 33, wherein the visual element includes a text label.
Example 35 may include the subject matter of any one of Examples 33-34, wherein the visual element is a first visual element and the first 2D image includes a second visual element not present in the second 2D image, wherein the first and second visual elements do not overlap when the first and second 2D images are viewed stereoscopically.
Example 36 may include the subject matter of Example 1, further comprising a camera coupled with the one or more processors; and a display coupled with the one or more processors, wherein the image generation module is to generate the first 2D image of the scene and the second 2D image of the same scene based at least in part on one or more camera images captured by a camera, and wherein the display module is to display the enhanced stereoscopic image of the scene to the user on the display.
Example 37 may include the subject matter of Example 36, further comprising: an infrared sensor coupled with the one or more processors; and an ultraviolet sensor coupled with the one or more processors, wherein the image generation module is to generate the second 2D image based at least in part on one or more camera images captured by the camera, infrared image data captured by the infrared sensor, and ultraviolet image data captured by the ultraviolet sensor.
Various embodiments may include any suitable combination of the above- described embodiments including alternative (or) embodiments of embodiments that are described in conjunctive form (and) above (e.g., the "and" may be "and/or"). Furthermore, some embodiments may include one or more articles of manufacture (e.g., non-transitory computer-readable media) having instructions, stored thereon, that when executed result in actions of any of the above-described embodiments. Moreover, some embodiments may include apparatuses or systems having any suitable means for carrying out the various operations of the above-described embodiments.
Although certain embodiments have been illustrated and described herein for purposes of description, a wide variety of alternate and/or equivalent embodiments or implementations calculated to achieve the same purposes may be substituted for the embodiments shown and described without departing from the scope of the present disclosure. This application is intended to cover any adaptations or variations of the embodiments discussed herein. Therefore, it is manifestly intended that embodiments described herein be limited only by the claims.
Where the disclosure recites "a" or "a first" element or the equivalent thereof, such disclosure includes one or more such elements, neither requiring nor excluding two or more such elements. Further, ordinal indicators (e.g., first, second or third) for identified elements are used to distinguish between the elements, and do not indicate or imply a required or limited number of such elements, nor do they indicate a particular position or order of such elements unless otherwise specifically stated.

Claims

Claims What is claimed is:
1. An apparatus to display enhanced stereographic imagery, comprising: one or more processors;
an image generation module, to be operated on the one or more processors, to generate an enhanced stereoscopic image of a scene, wherein the image generation module is to generate a first two dimensional (2D) image of the scene, and a second 2D image of the same scene, the second 2D image to be visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user at substantially the same time or in a coordinated manner; and
a display module, to be operated on the one or more processors, to display the enhanced stereoscopic image of the scene to the user, wherein the display module is to present the first 2D image of the scene to the first eye of the user and the visually or optically different second 2D image of the same scene to the second eye of the user at substantially the same time or in a coordinated manner.
2. The apparatus of claim 1, wherein the image generation module is to generate the first 2D image based at least in part on a first camera image of a real scene and the image generation module is to generate the second 2D image based at least in part on a second camera image of the real scene.
3. The apparatus of claim 2, wherein the image generation module is to generate the second 2D image based at least in part on sensor data, wherein the sensor data corresponds to an aspect of the real scene that is not in the visible electromagnetic spectrum, and wherein the image generation module is to generate the first 2D image without using the sensor data.
4. The apparatus of claim 3, wherein the sensor data corresponds to at least one of ultraviolet or infrared imagery of the real scene.
5. The apparatus of any one of claims 1-4, wherein the second 2D image includes a visual element not present in the first 2D image.
6. The apparatus of claim 5, wherein the visual element not present in the first 2D image includes a text label.
7. The apparatus of claim 6, wherein the visual element is a first visual element and the text label is a first text label, wherein the first 2D image includes a second visual element that includes a second text label that is not present in the second 2D image, wherein the first and second text labels do not overlap when viewed stereoscopically.
8. The apparatus of any one of claims 1-7, wherein the enhanced stereoscopic image is a first enhanced stereoscopic image, the image generation module is to generate additional enhanced stereoscopic images, and the display module is to successively display the first enhanced stereoscopic image and the additional enhanced stereoscopic images as video stereoscopic imagery.
9. A system to display enhanced stereographic imagery comprising:
a camera;
one or more processors coupled with the camera;
a display coupled with the one or more processors;
an image generation module, to be operated on the one or more processors, to generate an enhanced stereoscopic image of a scene, wherein the image generation module is to generate a first two dimensional (2D) image of the scene and a second 2D image of the same scene based at least in part on one or more camera images captured by the camera, the second 2D image to be visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user at substantially the same time or in a coordinated manner; and
a display module, to be operated on the one or more processors, to display the enhanced stereoscopic image to the user on the display, wherein the display module is to present the first 2D image of the scene to the first eye of the user and the second 2D image to the second eye of the user at substantially the same time or in a coordinated manner.
10. The system of claim 9, further comprising a sensor coupled with the one or more processors, wherein the image generation module is to generate the second 2D image based at least in part on one or more camera images captured by the camera and sensor data captured by the sensor.
11. The system of claim 10, wherein the sensor is an infrared sensor and the sensor data includes infrared image data.
12. The system of claim 11, wherein the sensor is a first sensor and the system further comprises an ultraviolet sensor coupled with the one or more processors, wherein the image generation module is also to generate the second 2D image based at least in part on ultraviolet image data captured by the ultraviolet sensor.
13. A method for enhanced stereographic image creation comprising: generating, by a computer device, an enhanced stereoscopic image of a scene having a first two-dimensional (2D) image of the scene and a second 2D image of the same scene, wherein the second 2D image is visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user at substantially the same time or in a coordinated manner;
displaying the first 2D image to the first eye of the user; and displaying the second 2D image to the second eye of the user.
14. The method of claim 13, wherein the enhanced stereoscopic image is generated based at least in part on at least one camera image of a real scene captured by a camera.
15. The method of claim 14, further comprising sensing at least one aspect of the real scene, wherein the at least one aspect is not in the visible electromagnetic spectrum, and wherein generating the second 2D image is based at least in part on the sensed at least one aspect.
16. The method of claim 15, wherein sensing the at least one aspect includes capturing at least one of an infrared image or an ultraviolet image of the real scene, and wherein generating the second 2D image is based at least in part on at least one of the infrared image or the ultraviolet image.
17. The method of any one of claims 14-16, wherein generating the enhanced stereoscopic image includes: detecting edges of objects in at least one of the at least one camera image; and generating the second 2D image by removing at least some non-edge imagery from the at least one of the at least one camera image and adding a visual element to the second 2D image.
18. The method of claim 17, wherein the visual element includes a text label.
19. The method of any one of claims 17-18, wherein the visual element is a first visual element and the first 2D image includes a second visual element not present in the second 2D image, wherein the first and second visual elements do not overlap when the first and second 2D images are viewed stereoscopically.
20. One or more computer-readable media comprising instructions that cause a computing device, in response to execution of the instructions by the computing device, to perform any one of the methods of claims 13-19.
21. An apparatus to display enhanced stereographic imagery comprising: means for generating an enhanced stereoscopic image of a scene having a first two-dimensional (2D) image of the scene and a second 2D image of the same scene, wherein the second 2D image is visually or optically different than the first 2D image to create binocular rivalry perception of the scene when the first and second 2D images are respectively presented to a first and a second eye of a user at substantially the same time or in a coordinated manner;
means for displaying the first 2D image to the first eye of the user; and means for displaying the second 2D image to the second eye of the user.
22. The apparatus of claim 21, wherein the means for generating the enhanced stereoscopic image is to generate the enhanced stereoscopic image based at least in part on at least one camera image of a real scene captured by a camera.
23. The apparatus of claim 22, further comprising means for sensing at least one aspect of the real scene, wherein the at least one aspect is not in the visible electromagnetic spectrum, and wherein the means for generating the enhanced
stereoscopic image is to generate the second 2D image based at least in part on the at least one aspect of the real scene.
24. The apparatus of claim 23, wherein the means for sensing the at least one aspect of the real scene includes means for capturing at least one of an infrared image or an ultraviolet image of the real scene, and wherein the means for generating the enhanced stereoscopic image is to generate the second 2D image based at least in part on at least one of the infrared image or the ultraviolet image.
25. The apparatus of any one of claim 22-24, wherein the means for generating the enhanced stereoscopic image includes: means for detecting edges of objects in at least one of the at least one camera image; means for removing at least some non- edge imagery from the at least one of the at least one camera image; and means for adding a visual element to the second 2D image.
PCT/US2017/031995 2016-06-23 2017-05-10 Presentation of scenes for binocular rivalry perception Ceased WO2017222665A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/191,014 US10762708B2 (en) 2016-06-23 2016-06-23 Presentation of scenes for binocular rivalry perception
US15/191,014 2016-06-23

Publications (2)

Publication Number Publication Date
WO2017222665A2 true WO2017222665A2 (en) 2017-12-28
WO2017222665A3 WO2017222665A3 (en) 2018-07-26

Family

ID=60677752

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2017/031995 Ceased WO2017222665A2 (en) 2016-06-23 2017-05-10 Presentation of scenes for binocular rivalry perception

Country Status (2)

Country Link
US (1) US10762708B2 (en)
WO (1) WO2017222665A2 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11538214B2 (en) * 2020-11-09 2022-12-27 Meta Platforms Technologies, Llc Systems and methods for displaying stereoscopic rendered image data captured from multiple perspectives

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5438989A (en) * 1990-08-10 1995-08-08 Hochman; Darryl Solid tumor, cortical function, and nerve tissue imaging methods and device
US6373965B1 (en) * 1994-06-24 2002-04-16 Angstrom Technologies, Inc. Apparatus and methods for authentication using partially fluorescent graphic images and OCR characters
JP2000307861A (en) * 1999-04-23 2000-11-02 Fujitsu Ltd Halftone processing method and apparatus
NZ505513A (en) * 2000-06-30 2002-05-31 Marc Dawson Anaglyphic 3-D colour imaging with selective colour filtering
EP1271965A1 (en) * 2001-06-23 2003-01-02 Deutsche Thomson-Brandt Gmbh Method and device for processing video frames for stereoscopic display
US7190496B2 (en) * 2003-07-24 2007-03-13 Zebra Imaging, Inc. Enhanced environment visualization using holographic stereograms
US7290878B1 (en) * 2003-10-15 2007-11-06 Albert John Hofeldt Machine for binocular testing and a process of formatting rival and non-rival stimuli
US7612795B2 (en) * 2006-05-12 2009-11-03 Anthony Italo Provitola Enhancement of visual perception III
US20090147073A1 (en) 2007-12-11 2009-06-11 David Getty Methods and Systems for Stereoscopic Three Dimensional Viewing
US8208009B2 (en) * 2008-02-05 2012-06-26 Disney Enterprises, Inc. Stereoscopic image generation using retinal rivalry in scene transitions
US8670607B2 (en) 2008-04-03 2014-03-11 Nlt Technologies, Ltd. Image processing method, image processing device and recording medium
US8538175B1 (en) * 2008-06-19 2013-09-17 Joseph Alan Epstein System and method for representing and coding still and moving images
US8723927B2 (en) * 2009-03-31 2014-05-13 Daniel Rosen Subtitling stereographic imagery
US9122066B2 (en) * 2009-10-30 2015-09-01 Hewlett-Packard Development Company, L.P. Stereo display systems
US9106909B2 (en) * 2010-04-20 2015-08-11 Hewlett-Packard Development Company, L.P. Stereo vision viewing systems
EP2604042A4 (en) * 2010-08-12 2014-01-01 3D Digital Llc Apparatus, method and article for generating a three dimensional effect using active glasses
US20120147228A1 (en) * 2010-12-14 2012-06-14 Duparre Jacques Imaging systems with optical crosstalk suppression structures
US9513490B2 (en) 2011-01-10 2016-12-06 Eastman Kodak Company Three channel delivery of stereo images
GB201101237D0 (en) * 2011-01-25 2011-03-09 Trw Ltd Method of processing images and apparatus
US8823777B2 (en) * 2011-03-30 2014-09-02 Intel Corporation Real-time depth extraction using stereo correspondence
US9805612B2 (en) * 2011-05-04 2017-10-31 Nascent Systems, Inc. Interest-attention feedback method for separating cognitive awareness into different left and right sensor displays
US9111389B2 (en) * 2011-05-12 2015-08-18 Panasonic Intellectual Property Management Co., Ltd. Image generation apparatus and image generation method
JP5430612B2 (en) * 2011-05-31 2014-03-05 Ckd株式会社 3D measuring device
WO2013001165A1 (en) * 2011-06-28 2013-01-03 Nokia Corporation A method, a system, a viewing device and a computer program for picture rendering
US9270875B2 (en) * 2011-07-20 2016-02-23 Broadcom Corporation Dual image capture processing
EP2600616A3 (en) * 2011-11-30 2014-04-30 Thomson Licensing Antighosting method using binocular suppression.
US9237330B2 (en) * 2012-02-21 2016-01-12 Intellectual Ventures Fund 83 Llc Forming a stereoscopic video
US20130293531A1 (en) * 2012-05-01 2013-11-07 Microsoft Corporation User perception of visual effects
WO2014021602A2 (en) * 2012-07-31 2014-02-06 인텔렉추얼디스커버리 주식회사 Wearable electronic device and method for controlling same
US9406105B2 (en) * 2012-08-02 2016-08-02 The Chinese University Of Hong Kong Binocular visual experience enrichment system
US8957892B2 (en) * 2012-08-20 2015-02-17 Disney Enterprises, Inc. Stereo composition based on multiple camera rigs
WO2014197109A2 (en) 2013-03-22 2014-12-11 Seiko Epson Corporation Infrared video display eyewear
US9292906B1 (en) * 2013-09-06 2016-03-22 Google Inc. Two-dimensional image processing based on third dimension data
AU2015220731A1 (en) * 2014-02-21 2016-07-07 Ventana Medical Systems, Inc. Medical image analysis for identifying biomarker-positive tumor cells
US9516295B2 (en) * 2014-06-30 2016-12-06 Aquifi, Inc. Systems and methods for multi-channel imaging based on multiple exposure settings
KR102190230B1 (en) * 2014-07-22 2020-12-14 삼성디스플레이 주식회사 Method of driving display panel and display apparatus for performing the method
US9947215B2 (en) * 2014-09-26 2018-04-17 Harman International Industries, Incorporated Pedestrian information system
US10013796B2 (en) * 2015-01-22 2018-07-03 Ditto Technologies, Inc. Rendering glasses shadows
US10061972B2 (en) * 2015-05-28 2018-08-28 Tokitae Llc Image analysis systems and related methods
CN105096321B (en) * 2015-07-24 2018-05-18 上海小蚁科技有限公司 A kind of low complex degree Motion detection method based on image border
US10261319B2 (en) * 2015-11-03 2019-04-16 Google Llc Display of binocular overlapping images in a head mounted display
US10521920B2 (en) * 2017-09-21 2019-12-31 Intel Corporation Reducing textured IR patterns in stereoscopic depth sensor imaging

Also Published As

Publication number Publication date
WO2017222665A3 (en) 2018-07-26
US20170372517A1 (en) 2017-12-28
US10762708B2 (en) 2020-09-01

Similar Documents

Publication Publication Date Title
KR102903733B1 (en) Dynamic configuration of user interface layout and input for extended reality systems.
EP3552081B1 (en) Display synchronized image warping
JP6886253B2 (en) Rendering methods and equipment for multiple users
US9274676B2 (en) Controlling three-dimensional views of selected portions of content
JP6801263B2 (en) Display control program, display control method and display control device
EP3465630B1 (en) Light-field viewpoint and pixel culling for a head mounted display device
CN111264057B (en) Information processing apparatus, information processing method, and recording medium
US20190311548A1 (en) Apparatus for sharing objects of interest and associated methods
TWI698834B (en) Methods and devices for graphics processing
US9986225B2 (en) Techniques for cut-away stereo content in a stereoscopic display
KR20190095257A (en) System and method for preventing boundary artifacts
EP3113160A1 (en) Method and device for processing a part of an immersive video content according to the position of reference parts
US8824778B2 (en) Systems and methods for depth map generation
US10650488B2 (en) Apparatus, method, and computer program code for producing composite image
CN121488182A (en) Optimized over-rendering and edge-aware smoothing space gain map for suppressing frame boundary artifacts.
KR101841719B1 (en) Multi-display apparatus and the operation method thereof
US10762708B2 (en) Presentation of scenes for binocular rivalry perception
US9143754B2 (en) Systems and methods for modifying stereoscopic images
CN112567430A (en) Image generation device, image generation method, and program
US11962743B2 (en) 3D display system and 3D display method
US20180130262A1 (en) Display device and control method therefor
CN107347150B (en) Method, device, equipment and storage medium for realizing naked eye 3D effect
KR101991401B1 (en) Method and apparatus for displaying augmented reality
TWI923681B (en) Processing data in pixel-to-pixel neural networks
EP4274238A1 (en) Display of video content

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17815860

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17815860

Country of ref document: EP

Kind code of ref document: A2