WO2014164921A1 - System, apparatus, and method for enhancing stereoscopic images - Google Patents

System, apparatus, and method for enhancing stereoscopic images Download PDF

Info

Publication number
WO2014164921A1
WO2014164921A1 PCT/US2014/023799 US2014023799W WO2014164921A1 WO 2014164921 A1 WO2014164921 A1 WO 2014164921A1 US 2014023799 W US2014023799 W US 2014023799W WO 2014164921 A1 WO2014164921 A1 WO 2014164921A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
images
modified
incoming
component
Prior art date
Application number
PCT/US2014/023799
Other languages
French (fr)
Inventor
Allan Thomas EVANS
Edward TANG
Original Assignee
Avegant Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/792,267 external-priority patent/US20130182086A1/en
Priority claimed from US13/792,265 external-priority patent/US20140253698A1/en
Application filed by Avegant Corporation filed Critical Avegant Corporation
Priority to EP14778473.0A priority Critical patent/EP2972564A4/en
Priority to CN201480023811.1A priority patent/CN105474072A/en
Publication of WO2014164921A1 publication Critical patent/WO2014164921A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/133Equalising the characteristics of different image components, e.g. their average brightness or colour balance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/327Calibration thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • G06T2207/10012Stereo images
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00Details of stereoscopic systems
    • H04N2213/008Aspects relating to glasses for viewing stereoscopic images

Definitions

  • the invention is a system, apparatus, and method for enhancing stereoscopic images that includes a right/left differential filter (collectively the "system").
  • Stereoscopic images are commonly referred to as three-dimensional (“3D") images.
  • Stereoscopic means collectively "(1 ) pertaining to three- dimensional vision or (2) any of various processes and devices for giving the illusion of depth from two-dimensional images or reproductions”.
  • Stereoscopic perception can involve actual 3D perception as well as simulated 3D using the fusion of two two-dimensional images.
  • technologies have been developed that allow man-made media to simulate stereoscopic images on a 2-D surface such as a movie screen or television screen. Different configurations of monocular and binocular cues are utilized in different approaches to the display of stereoscopic images on 2-D screens.
  • the perception of stereoscopic images by human beings involves the fusing together of images viewed by the right and left eyes.
  • Human beings rely on a variety of one-eye (“monocular") cues and two-eye (“binocular”) cues in perceiving depth and the stereoscopic images of the physical world.
  • monocular monocular
  • binocular two-eye
  • stereoscopic images Unfortunately, the ability of many people to perceive both actual stereoscopic images and simulated stereoscopic images (collectively "stereoscopic images”) is negatively impacted by differences between their two eyes.
  • the binocular dominance of one eye over the other can cause an image to appear flat.
  • Mono-vision correction can prevent the resolution of depth.
  • Other causes of impairment with respect to man-made or simulated stereoscopic images can include strabismus (the misalignment of where eyes are looking), refractive Amblyopia ("lazy eye"), and other visual development disorders. People with relatively minor cases of such visual disorders are often unaware of the problem and either see a flat image or only the most exaggerated stereoscopic effects when viewing simulated or man-made stereoscopic images.
  • Simulated stereoscopic images are not effectively perceived by people who have significant differences between their left and right eyes.
  • the greater the differential the less likely that the person can effectively perceive a simulated stereoscopic image.
  • the prior art affirmatively teaches away from the treating the left eye differently from the right eye even though 10%-15% of the population will not effectively be able to perceive the stereoscopic nature of such images.
  • U.S. Patent Number 8,284,235 teaches that reducing the disparities (the opposite of purposely differentiation) between unequal eyes reduces the discomfort to the viewer.
  • the prior art affirmatively teaches away from treating the eyes differently even in instances where the right/left differential between the eyes is significant.
  • the invention is a system, apparatus, and method for enhancing stereoscopic images that includes a right/left differential filter (collectively the "system").
  • system By modifying the left eye image and/or the right eye image to compensate for unequal eye capabilities, the ability of a human being to perceive stereoscopic images can be enhanced.
  • the system can be implemented in a wide variety of different electronic- based embodiments as well as non-electronic based embodiments.
  • the system can include a wide range of different types of both relational/relative/dependent and non-relational/non-relative/independent filtration parameters.
  • Figure 1 a is an input-output diagram illustrating an example of an initial image being modified in accordance with a right/left differential.
  • Figure 1 b is a flow chart diagram illustrating an example of a method of enhancing a stereoscopic image using a right/left differential.
  • Figure 1 c is an input-output diagram illustrating an example of a right/left differential modifying a left eye image while leaving the right eye image unmodified.
  • Figure 1 d is an input-output diagram illustrating an example of a right/left differential modifying a right eye image while leaving the left eye image unmodified.
  • Figure 1 e is an input-output diagram illustrating an example of a right/left differential modifying both a right eye image and a left eye image.
  • Figure 1f is an input-out diagram illustrating an example of different types of media components that can be used to implement a right/left differential filter.
  • Figure 2a is a block diagram illustrating an example of how different types of filter parameters can correspond to different types of light attributes relating to the image.
  • Figure 2b is a hierarchy diagram illustrating an example of the different types of light attributes that can be differentiated by the system.
  • Figure 2c is a hierarchy diagram illustrating an example of different types of filter parameters that can be implemented by the system.
  • Figure 3a is a diagram illustrating an example of some of the components of an electronic embodiment of the viewer.
  • Figure 3b is a diagram illustrating an example of some of the components of a non-electronic embodiment of the viewer.
  • Figure 4a is a flow chart diagram illustrating an example of a method for identifying the right/left differential for a user.
  • Figure 4b is a flow chart diagram illustrating an example of a method for enhancing the ability of a user to view stereoscopic images.
  • Figure 5a is a diagram illustrating an example of a non-electronic stereoscopic viewer that can be worn on the head of a user and that involves lenses that are not directly connected to each other.
  • Figure 5b is a diagram illustrating an example of a non-electronic stereoscopic viewer that can be worn on the head of a user and that involves lenses that are directly connected to each other.
  • Figure 5c is a diagram illustrating an example of an electronic stereoscopic viewer that can be worn on the head of a user and that involves lenses that are not directly connected to each other.
  • Figure 5d is a diagram illustrating an example of an electronic stereoscopic viewer that can be worn on the head of a user and that involves lenses that are directly connected to each other.
  • Figure 5e is a diagram illustrating an example of a stereoscopic viewer that can be clipped onto a pair of conventional eye glasses.
  • Figure 5f is a diagram illustrating an example of drop in eye-pieces that can be "dropped into” a stereoscopic viewer.
  • Figure 5g is a diagram illustrating an example of a stereoscopic viewer with slots for "dropping in” replaceable eye pieces.
  • the invention is a system, apparatus, and method for enhancing stereoscopic images that includes a right/left differential (collectively the "system").
  • stereoscopic images Some people are unable to properly perceive simulated stereoscopic images or even natural stereoscopic images (collectively “stereoscopic images") because of differences between the left and right eye (the "right/left differential"). For such individuals, one eye can so dominate the other eye that when the images of the two eyes are fused together, the individual does not perceive the stereoscopic aspects of the image.
  • the system can address the issue of eye domination head on by modifying the incoming image or images to specifically factor in the right/left differential for a particular person. For example, if the right eye is dominant over the left eye for the purposes of perceiving stereoscopic images, the image transmitted to the left eye could be brightened relative to the right eye to facilitate better stereoscopic perception.
  • the image transmitted to the right eye could be darkened relative to the image provided to the left eye to achieve the same or similar outcome.
  • Still another alternative would be to do both, darken the image for the dominant eye and brighten the image for the non-dominant eye to a degree of magnitude that is consistent with the right/left differential for the particular individual.
  • the system can use a right/left differential filter with respect to one or more relational/related/relative/dependent image parameters ("relational image parameters") to selectively modify the images seen by one or more eyes.
  • Relational image parameters relate to the right/left differential of the user of the system.
  • Image or light attributes can be changed in response to the right/left differential of the user in order to enhance the ability of the user to perceive stereoscopic images. For example, the brightness of an image can be enhanced for the right eye image relative to the left eye image when the right/left differential indicates that the left eye is dominant over the right eye.
  • the system can also involve include the additional functionality of selectively modifying images based on one or more non-relational/non- related/independent image parameters ("non-relational image parameters").
  • Non- relational image parameters are parameters that are applied to each eye in absolute terms, not relative to a right/left differential.
  • the modification of one or more non-relational light attributes subject to one or more non-relational filter parameters is an optional add-on to the system functionality of modifying one or more relational light attributes subject to one or more relational filter parameters defined by a right/left differential for the particular viewer.
  • the ability to filter stereoscopic images using one or more relational image parameters can significantly enhance the ability of users to perceive stereoscopic images.
  • the system can also include the ability to filter images on the basis of non-relational image parameters.
  • Examples of light attributes than be modified in accordance with a right/left differential include but are not limited to brightness, hue, saturation, color, location, focus, contrast, magnification, distortion, image size, and resolution. Those same attributes can also be modified as non-relational light attributes.
  • Figure 1 a illustrates an example a system 100 in which an initial image 1 14 is selectively modified by a filter 1 12 into a modified image 1 16 in accordance with a right/left differential 1 18.
  • the system 100 can enhance the ability of a human being to perceive stereoscopic images.
  • the right/left differential 1 18 identifies the viewer as having right eye dominance over the left eye by magnitude or metric "X”
  • the one or more relational attributes can be modified by magnitude or metrix "X" for the image(s) 1 14 perceived by one eye relative to the other eye.
  • Different eyes can be treated differently, in accordance with right/left differential 1 18 that is associated with the particular user of the system 100.
  • the display and perception of stereoscopic images will often involve a system 100 comprising of multiple components.
  • the filter 1 12 embodying the right/left differential 1 18 can be embodied in or more of those component parts of the system 100.
  • a component of the system 100 that includes a filter 1 12 is referred to as the apparatus.
  • Different configurations of the system 100 and different methods of operation that can be implemented by the system 100 are discussed below.
  • Different embodiments of the system 100 can involve different filters 1 12 and different types and numbers of filter parameters.
  • the system 100 can be described in a variety of different ways and implemented in a wide variety of different configurations.
  • the system 100 can be described as a filter 1 12 that receives an initial image 1 14 as an input.
  • the filter 1 12 then applies a right/left differential 1 18 to the initial image 1 14 to generate a modified image 1 16 that is the output of the filter 1 12.
  • the filter 1 12 modifies one or more relational light attributes of the incoming image 1 14 in accordance with the relational parameters embodied in the filter 1 12.
  • the filter 1 12 could be the form of a film or lens that modifies the image without the use of electronic means.
  • the output of the system 100 in that context is a modified image 1 16.
  • the natural unmodified image that hits the sunglasses is the input and the darkened image that comes out the other end is the output.
  • inputs and outputs can involve a potentially wide range of formats and types.
  • the filter 1 12 in Figure 1 a can apply the right/left differential 1 18 to one or more relational light attributes.
  • the filter 1 12 can also modify an image with respect to non-relational light attributes.
  • a wide variety of different light attributes 120 and corresponding filter parameters 150 can be used to configure the functionality of the system 100. Both light attributes 120 and filter parameters 150 can be broken down into categories of "relational” (dependent on the right/left differential 1 18) and "non-relational” (independent of the right/left differential 1 18).
  • a wide range of different types of relational light attributes 122, non-relational light attributes 124, relational filter parameters 152, and nonrelational filter parameters 154 can be incorporated into the system 100.
  • Figure 1 b is a flow chart diagram illustrating an example of a method of enhancing a stereoscopic image 1 14 using a right/left differential 1 18 embodied in a filter 1 12 (which can also be referred to as a "right/left differential filter” or a "right/left differentiation” 1 12).
  • the initial image set comprising of an initial right eye image 1 14 and an initial left eye image 1 14 are inputted to the filter 1 12.
  • These initial or unmodified images are such that given the viewer's right/left differential 1 18, the viewer's ability to perceive the depth and other stereoscopic aspects of the images would be substantially impeded if one or more of the images 1 14 are not modified in accordance with the right/left differential 1 18.
  • the term inputted is used broadly to include both electronic as well as nonelectronic embodiments.
  • the image 1 14 is typically directed to through the filter 1 12 in the same way that light in the physical world is directed through a lens.
  • the inputting of images at 200 can involve the inputting of images 1 14 in the form of digitized data.
  • output and input are used with respect to both electronic as well as non-electronic embodiments of system 100 even though the mechanism of image transmission can vary widely in the various embodiments of the system 100.
  • either one or both of the initial images 1 14 in the image set are selectively modified in accordance with the right/left differential 1 18.
  • the right/left differential 1 18 relates to brightness
  • one image 1 14 may be brightened or darkened with respect to the other. That process involves creating one or more modified images 1 16 with respect to the applicable light attribute 120/filter parameter 150.
  • the filter 1 12 outputs a set of output images that includes one or more modified images 1 16.
  • the output is in the form of modified light.
  • the outputted set of images can be in a wide variety of different forms and formats.
  • the process ends.
  • the process can be performed repetitively for each frame of the video.
  • Figures 1 c - 1 e illustrate three different output variations with respect to the impact of the filter 1 12 on both the initial right eye image 1 14 and the initial left eye image 1 14.
  • the application of the right/left differential 1 18 to the incoming image set results in a modified left eye image 1 16 but the initial right eye image 1 14 is unchanged.
  • the modified left eye image 1 16 can be either darkened or brightened with respect to the initial left eye image 1 14 while the initial right eye image 1 14 is not changed in any way. Similar processing can be performed for any of the light attributes 120 and filter parameters 150 illustrated in Figures 2a-2c or that are discussed below.
  • the application of the right/left differential 1 18 to the incoming image set results in a modified right eye image 1 16 but the initial left eye image 1 14 is unchanged.
  • the modified right eye image 1 16 can be either darkened or brightened with respect to the initial right eye image 1 14 while the initial left eye image 1 14 is not changed in any way. Similar processing can be performed for any of the light attributes 120 and filter parameters 150 illustrated in Figures 2a-2c or that are discussed below.
  • both of the initial images 1 14 are modified in accordance with the right/left differential 1 18.
  • the right/left differential 1 18 calls of a certain magnitude of difference between the right eye image and the left eye image, 50% (or some other percentage) of that outcome can be achieved by modifying the right eye image and 50% (or some other percentage) of that outcome can be achieved by modifying the left eye image.
  • Similar processing can be performed for any of the light attributes 120 and filter parameters 150 illustrated in Figures 2a-2c or that are discussed below.
  • Figure 1f is an input-out diagram illustrating an example of different components of the system 100 that can be used to implement the right/left differential filter 1 12.
  • the filter 1 12 can be exist in any of the different components or even in multiple components.
  • an initial image 1 14 is selectively modified into a modified image 1 16 in accordance with the filter 1 12.
  • Active screen Head gear such programming satellite dish, (TV, monitor, as "3-D” glasses), broadcast from antenna, TV portable if any
  • Video game Video game Active screen Head gear such console, (TV, monitor, as “3-D” glasses), computer, tablet portable if any
  • the distribution chain of media that can be processed by the system 100 can be implemented in a wide variety of different component configurations.
  • a single device can serve the function of more than one component.
  • portable television goggles could constitute a player component 104, a display component 106, and a viewer component 108 as a single unitary device.
  • a source component 102 (or simply the "source” 102 or “media content” 102) is the source of the image or images being enhanced by the operation of the system 100.
  • Figure 1f uses a box diagram to illustrate the source component 102 because the source component 102 is potentially everything in the distribution chain that happens to the media prior to the arrival of the media at the player component 104.
  • Examples of source components 102 can include but are not limited to a disc, film reel, or similar storage mechanism for media; media broadcast on a cable, satellite, or terrestrial television station; and media broadcast via internet streaming.
  • a filter 1 12 that uses a right/left differential 1 18 to modify images can be embedded within the source component 102.
  • a user 1 10 watching the source media 102 on a television in their home could have the modifications embodied in the right/left differential 1 18 implemented directly in the source 102 itself, obviating the need to implement the modifications in the player 104, the display 106, or the viewer 108.
  • a player component 104 is the device used to "play" the source 102.
  • player components 104 can include DVD players, cable boxes, satellite dishes, desktop computers, laptop computers, tablet computers, smart phones, and television sets.
  • the player component 104 and the display component 106 are integrated into the same device.
  • computers with integrated monitors including tablets and smart phones
  • a filter 1 12 that uses a right/left differential 1 18 to modify images can be embedded within the player component 104.
  • One or more player components 104 can be used to deliver media to a display component 106.
  • the player component 104 box in Figure 1f can include multiple devices that communicate with each other, as well as various wires and other transmission capabilities.
  • Figure 1f is illustrated in a block diagram format to emphasize that a multitude of hardware configurations and distribution chain alternatives can benefit from the ability of the system 100 to selectively modify an image 1 14 with respect to one eye relative to another eye on the basis of the right/left differential 1 18 associated with the particular user 1 10.
  • a display component 106 (or "display” 106) is typically some type of screen.
  • the display component 106 can be a passive screen, such as a screen in a movie theater.
  • the display component 106 can also be an active screen, such as the display on a television set, a computer monitor, or the screen on a tablet computer or smart phone.
  • a filter 1 12 that uses a right/left differential 1 18 to modify images can be embedded within the display component 106.
  • the modifications embodied in the right/left differential 1 18 can be implemented within the television set itself, allowing the user 1 10 to use standard viewer components 108 without any modification.
  • the display component 106 is illustrated in the form of a block diagram to emphasize that a wide range of hardware configurations can benefit from the functionality of selectively modifying initial images 1 14 using a right/left differential 1 18 that relates to the eyesight capabilities of the user 1 10.
  • a viewer component 108 is any component or series of components that is between the display 106 and the user 1 10. Examples of viewers can include glasses that are worn to see a "3D" movie as well as other headgear worn by a user 1 10 to perceive the media. Viewer components 108 can also include film coatings placed on a display such as smart phone screen, a tablet screen, or other screen that includes a filter 1 12 that uses a right/left differential 1 18 to modify images.
  • Some viewer components 108 can be powered devices with electronic processors and the ability to modify incoming images 1 14 used various algorithms Other viewer components 108 can function without electricity, such as conventional "3D" glasses that have been modified in accordance with the right/left differential 1 18.
  • the user 1 10 will be a human being with two eyes. In some embodiments of the system 100, other types of two eyed animals could also constitute users 1 10 of the system 100.
  • Figure 2a is a block diagram illustrating an example of the relationship between a light attribute 120 and a filter parameter 150. Subsidiary to that relationship are the corresponding relationships (a) between relational light attributes 122 and relational filter parameters 152 and (b) and between nonrelational light attributes 124 and non-relational filter parameters 154.
  • the application of filter parameters 150 by the system 100 results in modifications to the corresponding light attributes 120.
  • the application of relational filter parameters 152 by the system 100 results in modifications to the corresponding relational light attributes 122 of the images.
  • the application of non-relational parameters 154 by the system 100 results in modifications to the corresponding non-relational light attributes 124 of the images.
  • Stereoscopic viewing involves the right eye and left eye receiving corresponding images 1 14 that are fused together in order to perceive "depth" and other "3D" aspects of the stereoscopic images.
  • the system 100 can selectively modify an incoming image 1 14, transforming that incoming image 1 14 into a modified image 1 16. Modifications are made to incoming or initial images 1 14 with respect to (a) one or more image attributes and/or (b) light attributes corresponding to the incoming image (collectively "light attributes 120"). As mentioned above, modifications to light attributes 120 are triggered by the implementation of corresponding filter parameters 150 into the applicable filter 1 12.
  • Figure 2a is a hierarchy diagram illustrating an example of the different categories of image attributes and light attributes (collectively "light attributes" 120) that can be differentiated by the system 100.
  • Specific examples of light attributes 120 are provided in Figure 2b.
  • Virtually any light attribute 120 can be modified in a manner that is done relative to the right/left differential 1 18 and the image corresponding to the other eye ("relational light attributes" 122).
  • Virtually any light attribute 120 can also be modified in a manner that is not relative to the right/left differential 1 18 and is made without reference to the image corresponding to the other eye (“non-relational light attributes" 124).
  • FIG 2a is a hierarchy diagram illustrating an example of the different categories of filter parameters 150 that can be implemented in one or more filters 1 12 to trigger corresponding modifications to light attributes 120.
  • Specific examples of filter parameters 150 are provided in Figure 2c.
  • Virtually any filter parameter 150 can be implemented in a manner that is relative to the other image for the other eye and the right/left differential 1 18 ("relational filter parameters" 152) as well as in manner that is independent of the processing for the image corresponding to the other eye and the right/left differential 1 18 ("non-relational filter parameters" 154).
  • filter parameters 150 correspond to light attributes 120 in that the filter parameters 150 incorporated into the filter 1 12 of the system 100 will selectively trigger modifications based on those filter parameters 150 to the corresponding light attributes 120.
  • light attributes 120 and filter parameters 150 are to some extent mirror images of each other.
  • Figures 2b and 2c illustrate examples of specific light attributes 120/filter parameters 150.
  • An image 1 14 can be modified with respect to a brightness attribute 126.
  • An image 1 14 can be modified with respect to a hue attribute 128.
  • Hue 128 refers to a gradation of variety of color. Hue 128 can be modified using digital as well as non-digital means.
  • hue 128 can be modified to make the incoming image 1 14 for the weaker eye more distinct with respect to the dominant eye, evening the playing field by the magnitude of the right/left differential 1 18.
  • An image 1 14 can be modified with respect to a saturation attribute 130.
  • Saturation 130 the degree of chroma or purity of a color; the degree of freedom from admixture with white.
  • Saturation 130 can be modified using digital as well as non-digital means.
  • saturation 130 can be modified to make the incoming image 1 14 for the weaker eye more distinct, evening the playing field by the magnitude of the right/left differential 1 18.
  • An image 1 14 can be modified with respect to a color attribute 132.
  • Color 130 is the quality of light usually determined visually by measurement of hue, saturation, and brightness of the reflected light; saturation or chroma; hue the degree of chroma or purity of a color; the degree of freedom from admixture with white. Saturation 130 can be modified using digital as well as non-digital means.
  • saturation 130 can be modified to make the incoming image 1 14 for the weaker eye more distinct, evening the playing field by the magnitude of the right/left differential 1 18. 5.
  • An image 1 14 can be modified with respect to a location attribute 134.
  • Location 134 can adjusted for eye focus position and other physical characteristics such as vertical alignment or pupillary separation differences. This can be accomplished in a variety of ways.
  • Eyepieces 180 can be independently driven and the entire system 10 can be individually aligned to each eye.
  • Another alignment mechanism is to pivot the final optic to redirect the collimated light of the virtual retina display into the eye of the user 1 10.
  • Another adjustment can be to digitally shift the image on the DLP (digital light display), particularly if it is oversized, to correct for the physical location (both horizontally and vertically) of image projection.
  • location 134 can be modified to make the incoming image 1 14 for the weaker eye more distinct, evening the playing field by the magnitude of the right/left differential 1 18.
  • An image 1 14 can be modified with respect to a focus attribute 136.
  • Focus 136 can also be adjusted in many different ways. This is a key technique used to compensate for myopia and/or monovision. In a virtual retina display this can be accomplished by blurring the image in the digital source, adding a diffusive element to the projection path to 'blur' the light, or adjusting the distance the final display optic is from the reflective element. This changes the focus of the virtual image in a manner similar to adjusting the focus on binoculars or a microscope. If this is done uniformly, both images appear in focus. If binocular rivalry prevents this from generating a fused image, the dominant eye can be blurred to force the viewer to use the non-dominant eye and possible achieve fusion and the perception of "3D".
  • focus 136 can be modified to make the incoming image 1 14 for the weaker eye more distinct, evening the playing field by the magnitude of the right/left differential 1 18.
  • An image 1 14 can be modified with respect to a contrast attribute 138.
  • Contrast 138 is the relative difference between light and dark in an image. Contrast 138 can be modified using digital as well as non-digital means. In the context of relational processing, contrast 138 can be modified to make the incoming image 1 14 for the weaker eye more distinct, evening the playing field by the magnitude of the right/left differential 1 18.
  • An image 1 14 can be modified with respect to a magnification attribute
  • Magnification 140 is the ratio in size of an image to the size of the object represented in the image. Magnification 140 can be modified using digital as well as non-digital means.
  • magnification 140 can be modified to make the incoming image 1 14 for the weaker eye more prominent, evening the playing field by the magnitude of the right/left differential 1 18.
  • An image 1 14 can be modified with respect to a distortion attribute 142.
  • Distortion 142 is an aberration of a lens or a system of lenses in which the magnification of the object varies with the lateral distance from the axis of the lens. Distortion 142 can be modified using digital as well as non-digital means.
  • distortion 142 can be modified to make the incoming image 1 14 for the weaker eye more prominent, evening the playing field by the magnitude of the right/left differential 1 18.
  • An image 1 14 can be modified with respect to an image size attribute 144.
  • Image size 144 refers to the size of the area of an image, which is often a function of pixel size in a digital image. Image size 144 can be modified using digital as well as non-digital means.
  • image size 144 can be modified to make the incoming image 1 14 for the weaker eye more prominent, evening the playing field by the magnitude of the right/left differential 1 18.
  • An image 1 14 can be modified with respect to a resolution attribute 146.
  • Resolution size 146 refers to the quality of an image, and is often a function of pixel size in the context of a digital image.
  • Resolution 146 can be modified using digital as well as non-digital means. In the context of relational processing, resolution 146 can be modified to make the incoming image 1 14 for the weaker eye more prominent, evening the playing field by the magnitude of the right/left differential 1 18.
  • An image 1 14 can be modified with respect to a polarity attribute 148 of the light used to transmit the image 1 14.
  • Polarity 148 can be modified using digital as well as non-digital means.
  • polarity 148 can be modified to make the incoming image 1 14 for the weaker eye more prominent, evening the playing field by the magnitude of the right/left differential 1 18.
  • the system 100 can be implemented in a wide variety of different configurations.
  • the filter 1 12 used to modify the incoming images 1 14 will not be an electronic device. In other embodiments, the filter 1 12 will be an electronic device.
  • Figure 3a is a diagram illustrating an example of some of the components of an embodiment of the system 100 that involves a filter apparatus 1 12 that is an electronics-based device utilizing electrical power.
  • Initial images 1 14 can be transmitted to the filter 1 12 in a wide variety of different forms, including the form a digital transmission 164, an analog transmission 166, and as physical light 168.
  • a filter 1 12 can utilize a variety of different components to receive and perform processing on the various input forms 160.
  • a computer processor 170 can be used to to perform virtually any type of processing to the image 1 14.
  • An electronic adjuster 172 is another electronics-based mechanism to provide modifications that does not involve the full fledged flexibility of a computer processor 170.
  • a sensor 174 can used to convert the input 160 into any potentially desired form, including from physical light 168 as well as into physical light 168.
  • Any form of image 1 14 that can be potentially received as an input 160 can also be used to transmit the form/format of the modified image 1 16.
  • Figure 3b is a diagram illustrating an example of some of the components of a non-electronic embodiment of the system 100. It is important to understand that by non-electronic, what is meant that the device implementing the filter 1 12 is not electronic. Other devices in the system 100 may involve electronically powered components. For example, non-electronic "3D" glasses may be used to implement the filter 1 12, but powered devices such as a movie projector or television set are used to deliver the source 102 to the user 1 10
  • the filter 1 12 and electronic embodiments of the filter 1 12 is that the input 160 and output 162 formats of the image will be physical light 168 rather than electronic transmissions.
  • the filter 1 12 is embodied in a set of lenses 178 with one lens corresponding to the left eye and another lens corresponding to the right eye.
  • Lenses 178 can be implemented in a variety of different ways, including a film 176 (such as a thin plastic film placed over a smart phone or similar display component 106) and/or an eyepiece 180, which is illustrated and discussed below.
  • Sets of lenses 178 can be divided in terms of which eye they service. Two lenses 178 can be permanently fused together in one unitary piece while still having different sections devoted to different eyes of the user 1 10.
  • the processing of the system 100 can be broken down into various processes and sub-processes. Such functionality can be performed in a wide variety of different alternative embodiments.
  • Figure 4a is a flow chart diagram illustrating an example of a method for identifying the right/left differential 1 18 for a user 1 10.
  • the user is subjected to one or more tests for a right/left differential 1 18.
  • tests can be fully automated (at kiosk, given to users 1 10 online in the comfort of their own homes, etc), fully manual by an appropriate trained person, or in a manner that is partially automated and partially manual.
  • the right/left differential 1 18 for a specific user 1 10 can be stored so that the user 1 10 is not repeatedly subject to duplicative testing.
  • the right/left differential 1 18 is a specific metric, while in other embodiments it can be a category associated with a range of magnitudes. It is anticipated that kiosks could be set up to test users 1 10 in a convenient manner, but inside and outside of locations such as movie theaters, consumer electronics stores etc.
  • Figure 4b is a flow chart diagram illustrating an example of a method for enhancing the ability of a user 1 10 to view stereoscopic images.
  • the corrective differential is identified. This process is illustrated on a first time basis in Figure 4a, but can also be accessed from an applicable computer network on which the information is stored for the convenience of the user 1 10.
  • the applicable corrective right/left differential 1 18 is implemented in the applicable component of the system 100.
  • enhanced images are viewed by the user 1 10 on the basis of the right/left differential 1 18 associated with the user at 206 and implemented in the applicable device at 208.
  • the filter 1 12 can be implemented in the source component 102, the player component 104, the display component 106, and/or the viewer component 108.
  • the view component 108 will be the desired mechanism for implementing the filter 1 12 because the viewer component 108 is used only by one user 1 10 at a time.
  • Figure 5a is a diagram illustrating an example of a non-electronic stereoscopic viewer 181 that can be worn on the head of a user 1 10 and that involves lenses 178 that are not directly connected to each other. As illustrated in Figure 5a, the lenses 178 are in the form of eyepieces 180.
  • Figure 5b is a diagram illustrating an example of a non-electronic stereoscopic viewer 182 that can be worn on the head of a user 1 10 and that involves lenses 178 that are directly connected to each other. As illustrated in Figure 5b, the lenses 178 are in the form of eyepieces 180.
  • Figure 5c is a diagram illustrating an example of an electronic stereoscopic viewer 183 that can be worn on the head of a user 1 10 and that involves lenses 178 that are not directly connected to each other. As illustrated in Figure 5c, the lenses 178 are in the form of eyepieces 180.
  • Figure 5d is a diagram illustrating an example of an electronic stereoscopic viewer 184 that can be worn on the head of a user 1 10 and that involves lenses 178 that are directly connected to each other. As illustrated in Figure 5d, the lenses 178 are in the form of eyepieces 180.
  • Figure 5e is a diagram illustrating an example of a stereoscopic viewer 185 that can be clipped onto a pair of conventional eye glasses. As illustrated in Figure 5e, the lenses 178 are in the form of eyepieces 180.
  • Figure 5f is a diagram illustrating an example of drop in eye-pieces 186 that can be "dropped into” a stereoscopic viewer as illustrated in Figure 5g. As illustrated in Figure 5g, there are two compartments 188 with accessible slots 189 to hold the drop in eye-piece 186. VII. TREATMENT OF UNDERLYING CONDITION
  • the original motivating factor for the conception of the system 100 was to enhance the ability of a large subset of individuals to perceive stereoscopic images in the context of film, television, video games, and other types of man-made media.
  • the system 100 can also be used to address the underlying the medical condition of the user 1 10 that results in the right/left differential 1 18.
  • the system 100 can be used to change the right/left differential 1 18 of a user 1 10 over time such that the right/left differential 1 18 for that user will be reduced or even essentially eliminated.
  • the system 100 can be used to incrementally strengthen the relative weakness of the weaker eye and/or incrementally weaken the relative dominance of the dominant eye. By compensating for the right/left differential 1 18, the system 100 can over time reduce the magnitude of the right/left differential 1 18, and potentially eliminate the need for such an adjustment in what is displayed to the applicable user 1 10.
  • the original motivating factor for the conception of the system 100 was to enhance the ability of a large subset of individuals to perceive stereoscopic images in the context of film, television, video games and other man-made media.
  • the functionality of the system 100 could be used in reverse to increase the dominance of one eye over the other.
  • the right/left differential 1 18 can be set to increase rather than decrease the inequality between the two eyes.
  • the ability to artificially enhance eye dominance can be particularly useful in activities such as hitting a baseball (where the dominant eye faces the pitcher), hitting a golf bowl (where the dominant eye faces the ball), shooting, and other activities.
  • An apparatus can involve modifying one or more relational light attributes 122 based on one or more relational filter parameters 152.
  • the filter of the apparatus can also involve modifying zero or more non-relational light attributes 124 using zero or more non-relational filter parameters 154.
  • the apparatus can be a source component 102, a player component 104, a display component 106, or a viewer component 108.
  • Some embodiments of the apparatus will exclusively utilize powered electronic means while other embodiments will involve no electronic means. Other embodiments can involve both some electronic and well as non-electronic filtration technologies.
  • the system 100 is the aggregate operating environment that includes an apparatus.
  • a filter 1 12 that selectively modifies at least one relational light attribute 122 on the basis of at least one relational filter parameter 152 can be referred to as "right/left differential filter” 1 12. If brightness 126 was the relational light attribute 122 that is modified by the "right/left differential filter” 1 12 on the basis of brightness 126 as relational filter parameter 152, such a filter 1 12 can be referred to as a "right/left differential brightness filter” 1 12. Similar naming conventions can be used for other attributes 120 and parameters 150. Filters 1 12 can also be used to modify non-relational light attributes 124 based on non-relational filter parameters 152.
  • Media means collectively everything from a singular initial image 1 14 that the system 100 provides for selectively modifying into a modified image 1 16 through to large numbers of initial images 1 14 that are used collectively as video.
  • the distribution chain of media that can be processed by the system 100 can be implemented in a wide variety of different component configurations.
  • a single device can serve the function of more than one component.
  • portable television goggles could constitute a player component 104, a display component 106, and a viewer component 108 as a single unitary device.
  • a source component 102 (or simply the "source” 102) is the source of the image or images being enhanced by the operation of the system 100. As illustrated in Figure 1f, the source component 102 is potentially everything in the distribution chain that happens to the media prior to the arrival of the media at the player component 104. Examples of source components 102 can include but are not limited to a disc or similar storage mechanism for media; media broadcast on a cable, satellite, or terrestrial television station; and media broadcast via internet streaming.
  • a filter 1 12 that uses a right/left differential 1 18 to modify images can be embedded within the source component 102.
  • a player component 104 is the device used to "play" the source 102.
  • player components 104 can include DVD players, cable boxes, satellite dishes, desktop computers, laptop computers, tablet computers, smart phones, and television sets.
  • the player component 104 and the display component 106 are integrated into the same device.
  • computers with integrated monitors including tablets and smart phones
  • a filter 1 12 that uses a right/left differential 1 18 to modify images can be embedded within the player component 104.
  • One or more player components 104 can be used to deliver media to a display component 106.
  • a display component 106 (or "display” 106) is typically some type of screen.
  • the display component 106 can be a passive screen, such as a screen in a movie theater.
  • the display component 106 can also be an active screen, such as the display on a television set, a computer monitor, or the screen on a tablet computer or smart phone.
  • a filter 1 12 that uses a right/left differential 1 18 to modify images can be embedded within the display component 106.
  • a viewer component 108 is any component or series of components that is between the display 106 and the user 1 10. Examples of viewers can include glasses that are worn to see a "3D" movie as well as other headgear worn by a user 1 10 to perceive the media. Viewer components 108 can also include film coatings placed on a display such as smart phone screen, a tablet screen, or other screen that includes a filter 1 12 that uses a right/left differential 1 18 to modify images.

Abstract

The ability of some people to perceive simulated stereoscopic images (114) or even actual stereoscopic images (114) can be enhanced by treating the two eyes differently. The disclosed system (100) can enhance stereoscopic images (114) by selectively modifying the incoming images (114) using right/left differentiation filter (112). The system (100) can also include the capability of filtering images using parameters (150) that for which the right eye and left eye images (114) are treated independently of each other.

Description

SYSTEM, APPARATUS, AND METHOD
FOR ENHANCING STEREOSCOPIC IMAGES
BACKGROUND OF THE INVENTION
This PCT patent application claims priority to the following patent applications which are hereby incorporated by reference in their entirety: (a) U.S. utility patent application titled "SYSTEM, APPARATUS, AND METHOD FOR ENHANCING STEREOSCOPIC IMAGES" (Serial Number 13/792,265) filed on March 1 1 , 2013; and (b) U.S. utility patent application titled "APPARATUS FOR ENHANCING STEREOSCOPIC IMAGES" (Serial Number 13/792,267) filed on March 1 1 , 2013.
BACKGROUND OF THE INVENTION
The invention is a system, apparatus, and method for enhancing stereoscopic images that includes a right/left differential filter (collectively the "system").
Stereoscopic images are commonly referred to as three-dimensional ("3D") images. Stereoscopic means collectively "(1 ) pertaining to three- dimensional vision or (2) any of various processes and devices for giving the illusion of depth from two-dimensional images or reproductions". Stereoscopic perception can involve actual 3D perception as well as simulated 3D using the fusion of two two-dimensional images. Over time, technologies have been developed that allow man-made media to simulate stereoscopic images on a 2-D surface such as a movie screen or television screen. Different configurations of monocular and binocular cues are utilized in different approaches to the display of stereoscopic images on 2-D screens.
The perception of stereoscopic images by human beings involves the fusing together of images viewed by the right and left eyes. Human beings rely on a variety of one-eye ("monocular") cues and two-eye ("binocular") cues in perceiving depth and the stereoscopic images of the physical world. Unfortunately, the ability of many people to perceive both actual stereoscopic images and simulated stereoscopic images (collectively "stereoscopic images") is negatively impacted by differences between their two eyes. There are a variety of different conditions that can result in one eye being too dominant over the other eye. If the differential between the right and left eye (the "right/left differential"), then the ability of that person to perceive stereoscopic images is significantly impeded. In many instances, the person will not even realize the magnitude of their impediment.
Many people with satisfactory depth perception in the context of the physical world are unable to fully or even partially perceive the stereoscopic nature of man-made stereoscopic images. Approximately 10%-15% of the population at large experience headaches while viewing simulated stereoscopic images and/or have difficulty in perceiving the stereoscopic aspects of simulated stereoscopic images.
The binocular dominance of one eye over the other can cause an image to appear flat. Mono-vision correction can prevent the resolution of depth. Other causes of impairment with respect to man-made or simulated stereoscopic images can include strabismus (the misalignment of where eyes are looking), refractive Amblyopia ("lazy eye"), and other visual development disorders. People with relatively minor cases of such visual disorders are often unaware of the problem and either see a flat image or only the most exaggerated stereoscopic effects when viewing simulated or man-made stereoscopic images.
Simulated stereoscopic images are not effectively perceived by people who have significant differences between their left and right eyes. The greater the differential, the less likely that the person can effectively perceive a simulated stereoscopic image. Nonetheless, the prior art affirmatively teaches away from the treating the left eye differently from the right eye even though 10%-15% of the population will not effectively be able to perceive the stereoscopic nature of such images. For example, U.S. Patent Number 8,284,235 teaches that reducing the disparities (the opposite of purposely differentiation) between unequal eyes reduces the discomfort to the viewer. The prior art affirmatively teaches away from treating the eyes differently even in instances where the right/left differential between the eyes is significant.
SUMMARY OF THE INVENTION
The invention is a system, apparatus, and method for enhancing stereoscopic images that includes a right/left differential filter (collectively the "system"). By modifying the left eye image and/or the right eye image to compensate for unequal eye capabilities, the ability of a human being to perceive stereoscopic images can be enhanced. The system can be implemented in a wide variety of different electronic- based embodiments as well as non-electronic based embodiments. The system can include a wide range of different types of both relational/relative/dependent and non-relational/non-relative/independent filtration parameters.
BRIEF DESCRIPTION OF THE DRAWINGS
Many features and inventive aspects of the system are illustrated in the following drawings:
Figure 1 a is an input-output diagram illustrating an example of an initial image being modified in accordance with a right/left differential.
Figure 1 b is a flow chart diagram illustrating an example of a method of enhancing a stereoscopic image using a right/left differential.
Figure 1 c is an input-output diagram illustrating an example of a right/left differential modifying a left eye image while leaving the right eye image unmodified.
Figure 1 d is an input-output diagram illustrating an example of a right/left differential modifying a right eye image while leaving the left eye image unmodified.
Figure 1 e is an input-output diagram illustrating an example of a right/left differential modifying both a right eye image and a left eye image.
Figure 1f is an input-out diagram illustrating an example of different types of media components that can be used to implement a right/left differential filter.
Figure 2a is a block diagram illustrating an example of how different types of filter parameters can correspond to different types of light attributes relating to the image.
Figure 2b is a hierarchy diagram illustrating an example of the different types of light attributes that can be differentiated by the system.
Figure 2c is a hierarchy diagram illustrating an example of different types of filter parameters that can be implemented by the system.
Figure 3a is a diagram illustrating an example of some of the components of an electronic embodiment of the viewer.
Figure 3b is a diagram illustrating an example of some of the components of a non-electronic embodiment of the viewer.
Figure 4a is a flow chart diagram illustrating an example of a method for identifying the right/left differential for a user.
Figure 4b is a flow chart diagram illustrating an example of a method for enhancing the ability of a user to view stereoscopic images. Figure 5a is a diagram illustrating an example of a non-electronic stereoscopic viewer that can be worn on the head of a user and that involves lenses that are not directly connected to each other.
Figure 5b is a diagram illustrating an example of a non-electronic stereoscopic viewer that can be worn on the head of a user and that involves lenses that are directly connected to each other.
Figure 5c is a diagram illustrating an example of an electronic stereoscopic viewer that can be worn on the head of a user and that involves lenses that are not directly connected to each other.
Figure 5d is a diagram illustrating an example of an electronic stereoscopic viewer that can be worn on the head of a user and that involves lenses that are directly connected to each other.
Figure 5e is a diagram illustrating an example of a stereoscopic viewer that can be clipped onto a pair of conventional eye glasses.
Figure 5f is a diagram illustrating an example of drop in eye-pieces that can be "dropped into" a stereoscopic viewer.
Figure 5g is a diagram illustrating an example of a stereoscopic viewer with slots for "dropping in" replaceable eye pieces.
DETAILED DESCRIPTION
The invention is a system, apparatus, and method for enhancing stereoscopic images that includes a right/left differential (collectively the "system").
Some people are unable to properly perceive simulated stereoscopic images or even natural stereoscopic images (collectively "stereoscopic images") because of differences between the left and right eye (the "right/left differential"). For such individuals, one eye can so dominate the other eye that when the images of the two eyes are fused together, the individual does not perceive the stereoscopic aspects of the image. The system can address the issue of eye domination head on by modifying the incoming image or images to specifically factor in the right/left differential for a particular person. For example, if the right eye is dominant over the left eye for the purposes of perceiving stereoscopic images, the image transmitted to the left eye could be brightened relative to the right eye to facilitate better stereoscopic perception. Conversely, the image transmitted to the right eye could be darkened relative to the image provided to the left eye to achieve the same or similar outcome. Still another alternative would be to do both, darken the image for the dominant eye and brighten the image for the non-dominant eye to a degree of magnitude that is consistent with the right/left differential for the particular individual.
Although many people have materially different eyesight capabilities, conventional approaches to simulated stereoscopic images take great strides to ignore the right/left differential. For example, most prior art approaches to the display of simulated stereoscopic images require treating the left eye image identical to the right eye image even though the fusion of the left eye image with the right eye image is substantially impacted by the differential in capabilities of the left and right eye. For example, U.S. Patent Number 8,284,235 teaches that reducing the disparities (the opposite of purposeful differentiation) between unequal eyes reduces the discomfort to the viewer. The prior art affirmatively teaches away from treating the eyes differently even in instances where the right/left differential between the eyes is significant. Contrary to the prior art, the system seeks to address head on instead of avoiding the challenges to proper stereoscopic perception that results when one eye is sufficiently dominant over the other eye.
The system can use a right/left differential filter with respect to one or more relational/related/relative/dependent image parameters ("relational image parameters") to selectively modify the images seen by one or more eyes. Relational image parameters relate to the right/left differential of the user of the system. Image or light attributes can be changed in response to the right/left differential of the user in order to enhance the ability of the user to perceive stereoscopic images. For example, the brightness of an image can be enhanced for the right eye image relative to the left eye image when the right/left differential indicates that the left eye is dominant over the right eye.
The system can also involve include the additional functionality of selectively modifying images based on one or more non-relational/non- related/independent image parameters ("non-relational image parameters"). Non- relational image parameters are parameters that are applied to each eye in absolute terms, not relative to a right/left differential. The modification of one or more non-relational light attributes subject to one or more non-relational filter parameters is an optional add-on to the system functionality of modifying one or more relational light attributes subject to one or more relational filter parameters defined by a right/left differential for the particular viewer.
The ability to filter stereoscopic images using one or more relational image parameters can significantly enhance the ability of users to perceive stereoscopic images. The system can also include the ability to filter images on the basis of non-relational image parameters.
Examples of light attributes than be modified in accordance with a right/left differential include but are not limited to brightness, hue, saturation, color, location, focus, contrast, magnification, distortion, image size, and resolution. Those same attributes can also be modified as non-relational light attributes.
I. ALTERNATIVE EMBODIMENTS
No patent application can expressly disclose in words or in drawings, all of the potential embodiments of an invention. In accordance with the provisions of the patent statutes, the principles and modes of operation of the system are explained and illustrated in certain preferred embodiments. However, it must be understood that the system may be practiced otherwise than is specifically explained and illustrated without departing from its spirit or scope.
The description of the system provided below should be understood to include all novel and non-obvious combination of elements described herein, and claims may be presented in this or a later application to any novel non-obvious combination of these elements. Moreover, the foregoing embodiments are illustrative, and no single feature or element is essential to all possible combinations that may be claimed in this or a later application. The capability of modifying images in accordance with a right/left differential can be implemented using a wide variety of different technologies and components.
II. OVERVIEW
Human beings perceive an image in "3D" by fusing together the image perceived by the right eye with the image perceived by the left eye. If one eye is too dominant with respect to the other eye, the fusing process will not allow the viewer to fully perceive the "3D" nature of the stereoscopic images.
Figure 1 a illustrates an example a system 100 in which an initial image 1 14 is selectively modified by a filter 1 12 into a modified image 1 16 in accordance with a right/left differential 1 18. By selectively modifying the initial image 1 14 in accordance with the right/left differential 1 18, the system 100 can enhance the ability of a human being to perceive stereoscopic images. By way of example, if the right/left differential 1 18 identifies the viewer as having right eye dominance over the left eye by magnitude or metric "X", then the one or more relational attributes can be modified by magnitude or metrix "X" for the image(s) 1 14 perceived by one eye relative to the other eye. Different eyes can be treated differently, in accordance with right/left differential 1 18 that is associated with the particular user of the system 100.
The display and perception of stereoscopic images will often involve a system 100 comprising of multiple components. The filter 1 12 embodying the right/left differential 1 18 can be embodied in or more of those component parts of the system 100. A component of the system 100 that includes a filter 1 12 is referred to as the apparatus. Different configurations of the system 100 and different methods of operation that can be implemented by the system 100 are discussed below.
Different embodiments of the system 100 can involve different filters 1 12 and different types and numbers of filter parameters. The system 100 can be described in a variety of different ways and implemented in a wide variety of different configurations.
A. Input-Output View
As illustrated in Figure 1 a, the system 100 can be described as a filter 1 12 that receives an initial image 1 14 as an input. The filter 1 12 then applies a right/left differential 1 18 to the initial image 1 14 to generate a modified image 1 16 that is the output of the filter 1 12. As discussed below, the filter 1 12 modifies one or more relational light attributes of the incoming image 1 14 in accordance with the relational parameters embodied in the filter 1 12.
Terms such as an input and output are typically used in the context of electronic and computer systems, but the terms are also applicable to nonelectronic embodiments of the system 100. For example, in the context of a nonelectronic embodiment of the system 100, the filter 1 12 could be the form of a film or lens that modifies the image without the use of electronic means. The output of the system 100 in that context is a modified image 1 16. In the context of conventional sun glasses, the natural unmodified image that hits the sunglasses is the input and the darkened image that comes out the other end is the output. In the context of electronic embodiments of the system 100, inputs and outputs can involve a potentially wide range of formats and types.
The filter 1 12 in Figure 1 a can apply the right/left differential 1 18 to one or more relational light attributes. In some embodiments of the system 100, the filter 1 12 can also modify an image with respect to non-relational light attributes. As illustrated in Figures 2a-2c and discussed in greater detail below, a wide variety of different light attributes 120 and corresponding filter parameters 150 can be used to configure the functionality of the system 100. Both light attributes 120 and filter parameters 150 can be broken down into categories of "relational" (dependent on the right/left differential 1 18) and "non-relational" (independent of the right/left differential 1 18). A wide range of different types of relational light attributes 122, non-relational light attributes 124, relational filter parameters 152, and nonrelational filter parameters 154 can be incorporated into the system 100.
B. Process Flow View
Figure 1 b is a flow chart diagram illustrating an example of a method of enhancing a stereoscopic image 1 14 using a right/left differential 1 18 embodied in a filter 1 12 (which can also be referred to as a "right/left differential filter" or a "right/left differentiation" 1 12).
At 200, the initial image set comprising of an initial right eye image 1 14 and an initial left eye image 1 14 are inputted to the filter 1 12. These initial or unmodified images are such that given the viewer's right/left differential 1 18, the viewer's ability to perceive the depth and other stereoscopic aspects of the images would be substantially impeded if one or more of the images 1 14 are not modified in accordance with the right/left differential 1 18.
The term inputted is used broadly to include both electronic as well as nonelectronic embodiments. In the context of non-electronic embodiment of the system 100, the image 1 14 is typically directed to through the filter 1 12 in the same way that light in the physical world is directed through a lens. In the context of electronic embodiments of the system 100, the inputting of images at 200 can involve the inputting of images 1 14 in the form of digitized data. The terms output and input are used with respect to both electronic as well as non-electronic embodiments of system 100 even though the mechanism of image transmission can vary widely in the various embodiments of the system 100. At 202, either one or both of the initial images 1 14 in the image set (comprised of a right eye initial image 1 14 and a left eye initial image 1 14) are selectively modified in accordance with the right/left differential 1 18. So for example, in the context of an embodiment of the system 100 where the right/left differential 1 18 relates to brightness, one image 1 14 may be brightened or darkened with respect to the other. That process involves creating one or more modified images 1 16 with respect to the applicable light attribute 120/filter parameter 150.
At 204, the filter 1 12 outputs a set of output images that includes one or more modified images 1 16. In the case of physical light such as what can be viewed through otherwise conventional stereoscopic glasses at a movie theater, the output is in the form of modified light. In the case of embodiments of the system 100 that process and transmit images in the form of digitized information, the outputted set of images can be in a wide variety of different forms and formats.
After 204, the process ends. However, in the case of video, the process can be performed repetitively for each frame of the video.
C. Variations of Relational Processing based on the Right/Left Differential
Figures 1 c - 1 e illustrate three different output variations with respect to the impact of the filter 1 12 on both the initial right eye image 1 14 and the initial left eye image 1 14.
1. Right Eye Image Unchanged
In the example of Figure 1 c, the application of the right/left differential 1 18 to the incoming image set results in a modified left eye image 1 16 but the initial right eye image 1 14 is unchanged. In an embodiment of the system 100 where brightness is the filter parameter, the modified left eye image 1 16 can be either darkened or brightened with respect to the initial left eye image 1 14 while the initial right eye image 1 14 is not changed in any way. Similar processing can be performed for any of the light attributes 120 and filter parameters 150 illustrated in Figures 2a-2c or that are discussed below.
2. Left Eye Image Unchanged
In the example of Figure 1 d, the application of the right/left differential 1 18 to the incoming image set results in a modified right eye image 1 16 but the initial left eye image 1 14 is unchanged. In an embodiment of the system 100 where brightness is the filter parameter, the modified right eye image 1 16 can be either darkened or brightened with respect to the initial right eye image 1 14 while the initial left eye image 1 14 is not changed in any way. Similar processing can be performed for any of the light attributes 120 and filter parameters 150 illustrated in Figures 2a-2c or that are discussed below.
3. Both Images Modified
In the example of Figure 1 e, both of the initial images 1 14 are modified in accordance with the right/left differential 1 18. So for example, in the context of brightness, if the right/left differential 1 18 calls of a certain magnitude of difference between the right eye image and the left eye image, 50% (or some other percentage) of that outcome can be achieved by modifying the right eye image and 50% (or some other percentage) of that outcome can be achieved by modifying the left eye image. Similar processing can be performed for any of the light attributes 120 and filter parameters 150 illustrated in Figures 2a-2c or that are discussed below.
D. System Components
As discussed above, the system 100 can be implemented in a wide variety of different configurations, including the form a single integrated viewer apparatus. Figure 1f is an input-out diagram illustrating an example of different components of the system 100 that can be used to implement the right/left differential filter 1 12. As illustrated in Figure 1f, the filter 1 12 can be exist in any of the different components or even in multiple components. At some point in the process, an initial image 1 14 is selectively modified into a modified image 1 16 in accordance with the filter 1 12.
Different system 100 configurations are illustrated in Table 1 and are discussed below. The examples are not intended to be comprehensive, but illustrative of contexts of where the system 100 can be incorporated into common prior art supply chains for the delivery of media.
Figure imgf000011_0001
electronic device
with screen)
Movie or Cable box, Active screen Head gear (such programming satellite dish, (TV, monitor, as "3-D" glasses), broadcast from antenna, TV portable if any
satellite, cable, or electronic device
TV station with screen)
Internet streaming Software on Active screen Head gear (such content from computer, tablet, (TV, monitor, as "3-D" glasses), "broadcaster" or smart phone portable if any
that provides for electronic device playing media with screen)
Video game Video game Active screen Head gear (such console, (TV, monitor, as "3-D" glasses), computer, tablet portable if any
computer, smart electronic device phone with screen)
Media streamed or Smart phone, Active screen Film covering the downloaded from tablet computer, (TV, monitor, active screen the Internet other types of portable
computers electronic device
with screen)
Any source of Any device Active screen Film covering the media playable on capable of (TV, monitor, active screen a screen displaying an portable
image on a screen electronic device
with screen)
Table 1 .
The distribution chain of media that can be processed by the system 100 can be implemented in a wide variety of different component configurations. In some instances a single device can serve the function of more than one component. By way of example, portable television goggles could constitute a player component 104, a display component 106, and a viewer component 108 as a single unitary device.
1. Source Component
A source component 102 (or simply the "source" 102 or "media content" 102) is the source of the image or images being enhanced by the operation of the system 100. Figure 1f uses a box diagram to illustrate the source component 102 because the source component 102 is potentially everything in the distribution chain that happens to the media prior to the arrival of the media at the player component 104. Examples of source components 102 can include but are not limited to a disc, film reel, or similar storage mechanism for media; media broadcast on a cable, satellite, or terrestrial television station; and media broadcast via internet streaming. A filter 1 12 that uses a right/left differential 1 18 to modify images can be embedded within the source component 102. So for example, a user 1 10 watching the source media 102 on a television in their home could have the modifications embodied in the right/left differential 1 18 implemented directly in the source 102 itself, obviating the need to implement the modifications in the player 104, the display 106, or the viewer 108.
2. Player Component
A player component 104 is the device used to "play" the source 102. Common examples of player components 104 (or simply "players" 104) can include DVD players, cable boxes, satellite dishes, desktop computers, laptop computers, tablet computers, smart phones, and television sets. In many instances, the player component 104 and the display component 106 are integrated into the same device. For example, computers with integrated monitors (including tablets and smart phones) are both players 104 and displays 106. A filter 1 12 that uses a right/left differential 1 18 to modify images can be embedded within the player component 104. One or more player components 104 can be used to deliver media to a display component 106.
The player component 104 box in Figure 1f can include multiple devices that communicate with each other, as well as various wires and other transmission capabilities. Figure 1f is illustrated in a block diagram format to emphasize that a multitude of hardware configurations and distribution chain alternatives can benefit from the ability of the system 100 to selectively modify an image 1 14 with respect to one eye relative to another eye on the basis of the right/left differential 1 18 associated with the particular user 1 10.
3. Display Component
A display component 106 (or "display" 106) is typically some type of screen. The display component 106 can be a passive screen, such as a screen in a movie theater. The display component 106 can also be an active screen, such as the display on a television set, a computer monitor, or the screen on a tablet computer or smart phone. A filter 1 12 that uses a right/left differential 1 18 to modify images can be embedded within the display component 106. By way of example, the modifications embodied in the right/left differential 1 18 can be implemented within the television set itself, allowing the user 1 10 to use standard viewer components 108 without any modification. As with the other components discussed above, the display component 106 is illustrated in the form of a block diagram to emphasize that a wide range of hardware configurations can benefit from the functionality of selectively modifying initial images 1 14 using a right/left differential 1 18 that relates to the eyesight capabilities of the user 1 10.
4. Viewer Component
A viewer component 108 (or "viewer" 108) is any component or series of components that is between the display 106 and the user 1 10. Examples of viewers can include glasses that are worn to see a "3D" movie as well as other headgear worn by a user 1 10 to perceive the media. Viewer components 108 can also include film coatings placed on a display such as smart phone screen, a tablet screen, or other screen that includes a filter 1 12 that uses a right/left differential 1 18 to modify images.
Some viewer components 108 can be powered devices with electronic processors and the ability to modify incoming images 1 14 used various algorithms Other viewer components 108 can function without electricity, such as conventional "3D" glasses that have been modified in accordance with the right/left differential 1 18.
E. User
In most embodiments of the system 100, the user 1 10 will be a human being with two eyes. In some embodiments of the system 100, other types of two eyed animals could also constitute users 1 10 of the system 100.
III. IMAGE ATTRIBUES AND FILTER PARAMETERS
Figure 2a is a block diagram illustrating an example of the relationship between a light attribute 120 and a filter parameter 150. Subsidiary to that relationship are the corresponding relationships (a) between relational light attributes 122 and relational filter parameters 152 and (b) and between nonrelational light attributes 124 and non-relational filter parameters 154. The application of filter parameters 150 by the system 100 results in modifications to the corresponding light attributes 120. The application of relational filter parameters 152 by the system 100 results in modifications to the corresponding relational light attributes 122 of the images. The application of non-relational parameters 154 by the system 100 results in modifications to the corresponding non-relational light attributes 124 of the images. Stereoscopic viewing involves the right eye and left eye receiving corresponding images 1 14 that are fused together in order to perceive "depth" and other "3D" aspects of the stereoscopic images.
The system 100 can selectively modify an incoming image 1 14, transforming that incoming image 1 14 into a modified image 1 16. Modifications are made to incoming or initial images 1 14 with respect to (a) one or more image attributes and/or (b) light attributes corresponding to the incoming image (collectively "light attributes 120"). As mentioned above, modifications to light attributes 120 are triggered by the implementation of corresponding filter parameters 150 into the applicable filter 1 12.
A. Light Attributes
Figure 2a is a hierarchy diagram illustrating an example of the different categories of image attributes and light attributes (collectively "light attributes" 120) that can be differentiated by the system 100. Specific examples of light attributes 120 are provided in Figure 2b. Virtually any light attribute 120 can be modified in a manner that is done relative to the right/left differential 1 18 and the image corresponding to the other eye ("relational light attributes" 122). Virtually any light attribute 120 can also be modified in a manner that is not relative to the right/left differential 1 18 and is made without reference to the image corresponding to the other eye ("non-relational light attributes" 124).
B. Filter Parameters
Figure 2a is a hierarchy diagram illustrating an example of the different categories of filter parameters 150 that can be implemented in one or more filters 1 12 to trigger corresponding modifications to light attributes 120. Specific examples of filter parameters 150 are provided in Figure 2c. Virtually any filter parameter 150 can be implemented in a manner that is relative to the other image for the other eye and the right/left differential 1 18 ("relational filter parameters" 152) as well as in manner that is independent of the processing for the image corresponding to the other eye and the right/left differential 1 18 ("non-relational filter parameters" 154).
C. Light Attributes/Filter Parameters
As illustrated in Figure 2a, filter parameters 150 correspond to light attributes 120 in that the filter parameters 150 incorporated into the filter 1 12 of the system 100 will selectively trigger modifications based on those filter parameters 150 to the corresponding light attributes 120. Thus, light attributes 120 and filter parameters 150 are to some extent mirror images of each other. Figures 2b and 2c illustrate examples of specific light attributes 120/filter parameters 150.
1. Brightness
An image 1 14 can be modified with respect to a brightness attribute 126.
For digital images, this can be done on pixel by pixel basis. For analog images, this can be done by conventional brightening/darkening methodologies.
Many embodiments of the system 100 that modify only one relational light attribute 122 in accordance with a right/left differential 1 18 will use brightness 126 as the applicable attribute.
2. Hue
An image 1 14 can be modified with respect to a hue attribute 128. Hue 128 refers to a gradation of variety of color. Hue 128 can be modified using digital as well as non-digital means.
In the context of relational processing, hue 128 can be modified to make the incoming image 1 14 for the weaker eye more distinct with respect to the dominant eye, evening the playing field by the magnitude of the right/left differential 1 18.
3. Saturation
An image 1 14 can be modified with respect to a saturation attribute 130. Saturation 130 the degree of chroma or purity of a color; the degree of freedom from admixture with white. Saturation 130 can be modified using digital as well as non-digital means.
In the context of relational processing, saturation 130 can be modified to make the incoming image 1 14 for the weaker eye more distinct, evening the playing field by the magnitude of the right/left differential 1 18.
4. Color
An image 1 14 can be modified with respect to a color attribute 132. Color 130 is the quality of light usually determined visually by measurement of hue, saturation, and brightness of the reflected light; saturation or chroma; hue the degree of chroma or purity of a color; the degree of freedom from admixture with white. Saturation 130 can be modified using digital as well as non-digital means.
In the context of relational processing, saturation 130 can be modified to make the incoming image 1 14 for the weaker eye more distinct, evening the playing field by the magnitude of the right/left differential 1 18. 5. Location
An image 1 14 can be modified with respect to a location attribute 134. Location 134 can adjusted for eye focus position and other physical characteristics such as vertical alignment or pupillary separation differences. This can be accomplished in a variety of ways. Eyepieces 180 can be independently driven and the entire system 10 can be individually aligned to each eye. Another alignment mechanism is to pivot the final optic to redirect the collimated light of the virtual retina display into the eye of the user 1 10. Another adjustment can be to digitally shift the image on the DLP (digital light display), particularly if it is oversized, to correct for the physical location (both horizontally and vertically) of image projection.
In the context of relational processing, location 134 can be modified to make the incoming image 1 14 for the weaker eye more distinct, evening the playing field by the magnitude of the right/left differential 1 18.
6. Focus
An image 1 14 can be modified with respect to a focus attribute 136. Focus 136 can also be adjusted in many different ways. This is a key technique used to compensate for myopia and/or monovision. In a virtual retina display this can be accomplished by blurring the image in the digital source, adding a diffusive element to the projection path to 'blur' the light, or adjusting the distance the final display optic is from the reflective element. This changes the focus of the virtual image in a manner similar to adjusting the focus on binoculars or a microscope. If this is done uniformly, both images appear in focus. If binocular rivalry prevents this from generating a fused image, the dominant eye can be blurred to force the viewer to use the non-dominant eye and possible achieve fusion and the perception of "3D".
In the context of relational processing, focus 136 can be modified to make the incoming image 1 14 for the weaker eye more distinct, evening the playing field by the magnitude of the right/left differential 1 18.
7. Contrast
An image 1 14 can be modified with respect to a contrast attribute 138.
Contrast 138 is the relative difference between light and dark in an image. Contrast 138 can be modified using digital as well as non-digital means. In the context of relational processing, contrast 138 can be modified to make the incoming image 1 14 for the weaker eye more distinct, evening the playing field by the magnitude of the right/left differential 1 18.
8. Magnification
An image 1 14 can be modified with respect to a magnification attribute
140. Magnification 140 is the ratio in size of an image to the size of the object represented in the image. Magnification 140 can be modified using digital as well as non-digital means.
In the context of relational processing, magnification 140 can be modified to make the incoming image 1 14 for the weaker eye more prominent, evening the playing field by the magnitude of the right/left differential 1 18.
9. Distortion
An image 1 14 can be modified with respect to a distortion attribute 142. Distortion 142 is an aberration of a lens or a system of lenses in which the magnification of the object varies with the lateral distance from the axis of the lens. Distortion 142 can be modified using digital as well as non-digital means.
In the context of relational processing, distortion 142 can be modified to make the incoming image 1 14 for the weaker eye more prominent, evening the playing field by the magnitude of the right/left differential 1 18.
10. Image Size
An image 1 14 can be modified with respect to an image size attribute 144. Image size 144 refers to the size of the area of an image, which is often a function of pixel size in a digital image. Image size 144 can be modified using digital as well as non-digital means.
In the context of relational processing, image size 144 can be modified to make the incoming image 1 14 for the weaker eye more prominent, evening the playing field by the magnitude of the right/left differential 1 18.
11. Resolution
An image 1 14 can be modified with respect to a resolution attribute 146. Resolution size 146 refers to the quality of an image, and is often a function of pixel size in the context of a digital image. Resolution 146 can be modified using digital as well as non-digital means. In the context of relational processing, resolution 146 can be modified to make the incoming image 1 14 for the weaker eye more prominent, evening the playing field by the magnitude of the right/left differential 1 18.
12. Polarity
An image 1 14 can be modified with respect to a polarity attribute 148 of the light used to transmit the image 1 14. Polarity 148 can be modified using digital as well as non-digital means.
In the context of relational processing, polarity 148 can be modified to make the incoming image 1 14 for the weaker eye more prominent, evening the playing field by the magnitude of the right/left differential 1 18.
13. Other Attributes/Parameters
Any attribute/parameter that can be used to process or modify an image, or the light used to transmit an image, can potentially serve as a light attribute 120 and filter parameter 150 that is used by the system 100 to selectively modify images.
IV. COMPONENT VIEWS AND DESCRIPTIONS
The system 100 can be implemented in a wide variety of different configurations. In some configurations, the filter 1 12 used to modify the incoming images 1 14 will not be an electronic device. In other embodiments, the filter 1 12 will be an electronic device.
A. Electronic Embodiments
Figure 3a is a diagram illustrating an example of some of the components of an embodiment of the system 100 that involves a filter apparatus 1 12 that is an electronics-based device utilizing electrical power.
1. Input Form/Format
Initial images 1 14 can be transmitted to the filter 1 12 in a wide variety of different forms, including the form a digital transmission 164, an analog transmission 166, and as physical light 168.
2. Filter Components
A filter 1 12 can utilize a variety of different components to receive and perform processing on the various input forms 160. A computer processor 170 can be used to to perform virtually any type of processing to the image 1 14. An electronic adjuster 172 is another electronics-based mechanism to provide modifications that does not involve the full fledged flexibility of a computer processor 170. A sensor 174 can used to convert the input 160 into any potentially desired form, including from physical light 168 as well as into physical light 168.
3. Output Form/Format
Any form of image 1 14 that can be potentially received as an input 160 can also be used to transmit the form/format of the modified image 1 16.
B. Non-Electronic Embodiments
Figure 3b is a diagram illustrating an example of some of the components of a non-electronic embodiment of the system 100. It is important to understand that by non-electronic, what is meant that the device implementing the filter 1 12 is not electronic. Other devices in the system 100 may involve electronically powered components. For example, non-electronic "3D" glasses may be used to implement the filter 1 12, but powered devices such as a movie projector or television set are used to deliver the source 102 to the user 1 10
A. Input/Output Formats
The primary difference between the non-electronic embodiments of the filter
1 12 and electronic embodiments of the filter 1 12 is that the input 160 and output 162 formats of the image will be physical light 168 rather than electronic transmissions.
B. Filter Components
Instead of implementing the filter 1 12 electronically, the filter 1 12 is embodied in a set of lenses 178 with one lens corresponding to the left eye and another lens corresponding to the right eye. Lenses 178 can be implemented in a variety of different ways, including a film 176 (such as a thin plastic film placed over a smart phone or similar display component 106) and/or an eyepiece 180, which is illustrated and discussed below. Sets of lenses 178 can be divided in terms of which eye they service. Two lenses 178 can be permanently fused together in one unitary piece while still having different sections devoted to different eyes of the user 1 10.
V. PROCESS FLOW VIEWS AND DESCRIPTIONS
The processing of the system 100 can be broken down into various processes and sub-processes. Such functionality can be performed in a wide variety of different alternative embodiments. A. Identifying the Right/Left Differential
Figure 4a is a flow chart diagram illustrating an example of a method for identifying the right/left differential 1 18 for a user 1 10.
At 200, the user is subjected to one or more tests for a right/left differential 1 18. These tests can be fully automated (at kiosk, given to users 1 10 online in the comfort of their own homes, etc), fully manual by an appropriate trained person, or in a manner that is partially automated and partially manual.
If no differential condition is indicated at 202, the process ends. If a right/left differential 1 18 condition is identified at 202 (or alternatively, if a condition of sufficient magnitude is identified at 202), the corrective right/left differential 1 18 for that individual user 1 10 is identified at 204 prior to the process completing.
In many embodiments, the right/left differential 1 18 for a specific user 1 10 can be stored so that the user 1 10 is not repeatedly subject to duplicative testing. In some embodiments, the right/left differential 1 18 is a specific metric, while in other embodiments it can be a category associated with a range of magnitudes. It is anticipated that kiosks could be set up to test users 1 10 in a convenient manner, but inside and outside of locations such as movie theaters, consumer electronics stores etc.
B. Process for Enhancing an Image
Figure 4b is a flow chart diagram illustrating an example of a method for enhancing the ability of a user 1 10 to view stereoscopic images.
At 206, the corrective differential is identified. This process is illustrated on a first time basis in Figure 4a, but can also be accessed from an applicable computer network on which the information is stored for the convenience of the user 1 10.
At 208 the applicable corrective right/left differential 1 18 is implemented in the applicable component of the system 100.
At 210, enhanced images are viewed by the user 1 10 on the basis of the right/left differential 1 18 associated with the user at 206 and implemented in the applicable device at 208.
Then the process ends.
VI. VIEWER EMBODIMENTS
As discussed above, the filter 1 12 can be implemented in the source component 102, the player component 104, the display component 106, and/or the viewer component 108. However, as the right/left differential 1 19 is ultimately something that varies from individual to individual, the view component 108 will be be the desired mechanism for implementing the filter 1 12 because the viewer component 108 is used only by one user 1 10 at a time.
A. Non-Electronic Viewer With Separate Lenses
Figure 5a is a diagram illustrating an example of a non-electronic stereoscopic viewer 181 that can be worn on the head of a user 1 10 and that involves lenses 178 that are not directly connected to each other. As illustrated in Figure 5a, the lenses 178 are in the form of eyepieces 180.
B. Non-Electronic Viewer with Connected Lenses
Figure 5b is a diagram illustrating an example of a non-electronic stereoscopic viewer 182 that can be worn on the head of a user 1 10 and that involves lenses 178 that are directly connected to each other. As illustrated in Figure 5b, the lenses 178 are in the form of eyepieces 180.
C. Electronic Viewer With Separate Lenses
Figure 5c is a diagram illustrating an example of an electronic stereoscopic viewer 183 that can be worn on the head of a user 1 10 and that involves lenses 178 that are not directly connected to each other. As illustrated in Figure 5c, the lenses 178 are in the form of eyepieces 180.
D. Electronic Viewer With Connected Lenses
Figure 5d is a diagram illustrating an example of an electronic stereoscopic viewer 184 that can be worn on the head of a user 1 10 and that involves lenses 178 that are directly connected to each other. As illustrated in Figure 5d, the lenses 178 are in the form of eyepieces 180.
E. Clip On Lenses
Figure 5e is a diagram illustrating an example of a stereoscopic viewer 185 that can be clipped onto a pair of conventional eye glasses. As illustrated in Figure 5e, the lenses 178 are in the form of eyepieces 180.
F. Drop-In Lenses
Figure 5f is a diagram illustrating an example of drop in eye-pieces 186 that can be "dropped into" a stereoscopic viewer as illustrated in Figure 5g. As illustrated in Figure 5g, there are two compartments 188 with accessible slots 189 to hold the drop in eye-piece 186. VII. TREATMENT OF UNDERLYING CONDITION
The original motivating factor for the conception of the system 100 was to enhance the ability of a large subset of individuals to perceive stereoscopic images in the context of film, television, video games, and other types of man-made media. However, the system 100 can also be used to address the underlying the medical condition of the user 1 10 that results in the right/left differential 1 18.
By impeding the stronger eye and/or enhancing the weaker eye, the system 100 can be used to change the right/left differential 1 18 of a user 1 10 over time such that the right/left differential 1 18 for that user will be reduced or even essentially eliminated. Instead of strengthening the weaker eye with respect to the stronger eye by completely blocking the stronger eye using an eye patch or similar technology, the system 100 can be used to incrementally strengthen the relative weakness of the weaker eye and/or incrementally weaken the relative dominance of the dominant eye. By compensating for the right/left differential 1 18, the system 100 can over time reduce the magnitude of the right/left differential 1 18, and potentially eliminate the need for such an adjustment in what is displayed to the applicable user 1 10.
VIII. PURPOSEFUL INCREASING OF THE RIGHT/LEFT DIFFERENTIAL
The original motivating factor for the conception of the system 100 was to enhance the ability of a large subset of individuals to perceive stereoscopic images in the context of film, television, video games and other man-made media. However, the functionality of the system 100 could be used in reverse to increase the dominance of one eye over the other.
Put another way, the right/left differential 1 18 can be set to increase rather than decrease the inequality between the two eyes. The ability to artificially enhance eye dominance can be particularly useful in activities such as hitting a baseball (where the dominant eye faces the pitcher), hitting a golf bowl (where the dominant eye faces the ball), shooting, and other activities.
The technical capability to artificially induce and increase eye dominance may also be useful in the context of mimicking certain challenging environments for military, police, and other personnel who may confront different visual environments in stressful situations. VIII. DEFINITIONS/INDEX OF ELEMENTS
The terms below are hereby defined as following for the purposes of understanding the system 100 as disclosed and claimed.
A. Apparatus
Any device that includes a filter 1 12 that provides for selectively modifying images based on a right/left differential 1 18. An apparatus can involve modifying one or more relational light attributes 122 based on one or more relational filter parameters 152. The filter of the apparatus can also involve modifying zero or more non-relational light attributes 124 using zero or more non-relational filter parameters 154. The apparatus can be a source component 102, a player component 104, a display component 106, or a viewer component 108. Some embodiments of the apparatus will exclusively utilize powered electronic means while other embodiments will involve no electronic means. Other embodiments can involve both some electronic and well as non-electronic filtration technologies.
B. System
The system 100 is the aggregate operating environment that includes an apparatus.
C. Filter
Any technology capable of transforming an initial image 1 14 into a modified image 1 16 can serve the system 100 as a filter 1 12. A filter 1 12 that selectively modifies at least one relational light attribute 122 on the basis of at least one relational filter parameter 152 can be referred to as "right/left differential filter" 1 12. If brightness 126 was the relational light attribute 122 that is modified by the "right/left differential filter" 1 12 on the basis of brightness 126 as relational filter parameter 152, such a filter 1 12 can be referred to as a "right/left differential brightness filter" 1 12. Similar naming conventions can be used for other attributes 120 and parameters 150. Filters 1 12 can also be used to modify non-relational light attributes 124 based on non-relational filter parameters 152.
D. Media
Media means collectively everything from a singular initial image 1 14 that the system 100 provides for selectively modifying into a modified image 1 16 through to large numbers of initial images 1 14 that are used collectively as video. E. System Components
The distribution chain of media that can be processed by the system 100 can be implemented in a wide variety of different component configurations. In some instances a single device can serve the function of more than one component. By way of example, portable television goggles could constitute a player component 104, a display component 106, and a viewer component 108 as a single unitary device.
1. Source Component
A source component 102 (or simply the "source" 102) is the source of the image or images being enhanced by the operation of the system 100. As illustrated in Figure 1f, the source component 102 is potentially everything in the distribution chain that happens to the media prior to the arrival of the media at the player component 104. Examples of source components 102 can include but are not limited to a disc or similar storage mechanism for media; media broadcast on a cable, satellite, or terrestrial television station; and media broadcast via internet streaming. A filter 1 12 that uses a right/left differential 1 18 to modify images can be embedded within the source component 102.
2. Player Component
A player component 104 is the device used to "play" the source 102. Common examples of player components 104 (or simply "players" 104) can include DVD players, cable boxes, satellite dishes, desktop computers, laptop computers, tablet computers, smart phones, and television sets. In many instances, the player component 104 and the display component 106 are integrated into the same device. For example, computers with integrated monitors (including tablets and smart phones) are both players 104 and displays 106. A filter 1 12 that uses a right/left differential 1 18 to modify images can be embedded within the player component 104. One or more player components 104 can be used to deliver media to a display component 106.
3. Display Component
A display component 106 (or "display" 106) is typically some type of screen.
The display component 106 can be a passive screen, such as a screen in a movie theater. The display component 106 can also be an active screen, such as the display on a television set, a computer monitor, or the screen on a tablet computer or smart phone. A filter 1 12 that uses a right/left differential 1 18 to modify images can be embedded within the display component 106.
4. Viewer Component
A viewer component 108 (or "viewer" 108) is any component or series of components that is between the display 106 and the user 1 10. Examples of viewers can include glasses that are worn to see a "3D" movie as well as other headgear worn by a user 1 10 to perceive the media. Viewer components 108 can also include film coatings placed on a display such as smart phone screen, a tablet screen, or other screen that includes a filter 1 12 that uses a right/left differential 1 18 to modify images.

Claims

CLAIMS In the claims:
1. A method for enhancing the display of stereoscopic images using a right/left differentiation filter (1 12), comprising:
inputting (200) a plurality of initial images (1 14) to the right/left
differentiation filter (1 18), the plurality of initial images (1 14) including an initial right eye image (1 14) and an initial left eye image (1 14);
modifying (202) an image attribute (120) associated with at least one of the initial images (1 14) using the right/left differentiation filter (1 12) to create a modified image (1 16), wherein the right/left differentiation filter (1 12) is associated with a right/left differential (1 18) corresponding to the image attribute (120) that is modified; and
outputting (204) the modified image (1 16) in place of one of the initial images (1 14).
2. The method of claim 1 , wherein said image attribute (120) that is modified is a brightness attribute (126).
3. The method of claim 2, wherein the modified image (1 16) is brightened.
4. The method of claim 1 , wherein only one of the initial images (1 14) is modified.
5. The method of claim 1 , wherein the right/left differentiation filter (1 12) is not implemented electronically.
6. The method of claim 1 , wherein said plurality of images (1 14) are part of a video.
7. The method of claim 1 , further comprising testing a specific individual to selectively identify the right/left differential (1 18) for that specific individual.
8. The method of claim 1 , further comprising modifying at least one of said initial images (1 14) without reference to said right/left differential (1 18).
9. A system (100) for enhancing the display of stereoscopic images, comprising:
an input source (160) that provides for receiving a plurality of incoming images (1 14), said plurality of incoming images (1 14) including an incoming right eye image (1 14) and an incoming left eye image (1 14), wherein each said incoming image (1 14) includes an image attribute (120) associated with said incoming image (1 14);
a right/left differentiation filter (1 12), said right/left differentiation filter (1 12) including a right/left differential (1 18) relating to said image attribute (120); and a modified image (1 16), wherein said modified image (1 16) is one of said incoming images (1 14) with said image attribute (120) modified in accordance with said right/left differential (1 18) of said right/left differentiation filter (1 12); and an output transmission (162) that includes said modified image (1 16) from said right/left differentiation filter (1 12).
10. The system (100) of claim 9, wherein the right/left differentiation filter (1 12) includes a computer processor (170), wherein said plurality of images (1 14) are communicated to said computer processor (170) as data, and wherein said modified image (1 16) is outputted by said computer processor (170) as data.
1 1 . The system (100) of claim 10, wherein said right/left differentiation filter (1 12) is a media source component (102).
12. The system (100) of claim 10, wherein said right/left differentiation filter (1 12) is a media player component (104).
13. The system (100) of claim 10, wherein said right/left differentiation filter (1 12) is a media display component (104).
14. The system (100) of claim 9, wherein said right/left differentiation filter (1 12) is a viewer component (108).
15. The system (100) of claim 9, wherein each said incoming image (1 14) includes a plurality of image attributes (120) associated with said incoming image (1 14), wherein said plurality of image attributes (120) includes a brightness attribute (126), and wherein said right/left differential (1 18) relates to each of said image attributes (120).
16. The system (100) of claim 15, wherein said plurality of image attributes (120) includes at least one of: (a) a focus attribute (136); and (b) a location attribute (134).
17. The system (100) of claim 9, wherein said right/left differentiation filter (1 12) is a physical film (176).
18. The system (100) of claim 9, wherein said right/left differentiation filter (1 12) leaves at least one of said incoming images (1 14) unchanged.
19. The system (100) of claim 18, wherein said modified image (1 16) is darker than said corresponding incoming image (1 14) from which said modified image (1 16) is created.
20. A system (100) for enhancing the display of stereoscopic images, comprising:
a plurality of images (1 14), said plurality of images (1 14) including a plurality of incoming images (1 14) and a modified image (1 16), said plurality of incoming images (1 14) including a right eye image (1 14) and a left eye image (1 14), wherein said images (1 14) are transmitted electronically, and wherein said modified image (1 16) is created by at least one of: (a) darkening one of said incoming images (1 14); and (b) brightening one of said incoming images (1 14); and
a plurality of media components, said plurality of media components including a electronic adjuster (172), a source component (102), a player component (104), a display component (106), and a headgear component (108), wherein said source component (102) provides for transmitting said images (1 14) to said player component (104), wherein said player component (104) provides for receiving said images (1 14) from said source component (102) and
transmitting said images (1 14) to said display component (106), wherein said display component (106) provides for receiving said images (1 14) from said player component (104) and transmitting said images (1 14) to said headgear component (108) making said images (1 14) accessible to a specific user;
wherein said computer processor (170) provides for creating said modified image (1 16) from at least one of said incoming images (1 14);
wherein said computer processor (170) provides for receiving said incoming images (1 14) from one of said plurality of media components; and
wherein said computer processor (170) provides for transmitting said modified image (1 16) to a different media component than said media component transmitting said incoming images (1 14) to said computer processor (170).
PCT/US2014/023799 2013-03-11 2014-03-11 System, apparatus, and method for enhancing stereoscopic images WO2014164921A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP14778473.0A EP2972564A4 (en) 2013-03-11 2014-03-11 System, apparatus, and method for enhancing stereoscopic images
CN201480023811.1A CN105474072A (en) 2013-03-11 2014-03-11 System, apparatus, and method for enhancing stereoscopic images

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US13/792,267 US20130182086A1 (en) 2013-03-11 2013-03-11 Apparatus for enhancing stereoscopic images
US13/792,267 2013-03-11
US13/792,265 2013-03-11
US13/792,265 US20140253698A1 (en) 2013-03-11 2013-03-11 System, apparatus, and method for enhancing stereoscopic images

Publications (1)

Publication Number Publication Date
WO2014164921A1 true WO2014164921A1 (en) 2014-10-09

Family

ID=51659009

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2014/023799 WO2014164921A1 (en) 2013-03-11 2014-03-11 System, apparatus, and method for enhancing stereoscopic images

Country Status (3)

Country Link
EP (1) EP2972564A4 (en)
CN (1) CN105474072A (en)
WO (1) WO2014164921A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200314411A1 (en) * 2019-03-29 2020-10-01 Alibaba Group Holding Limited Synchronizing an illumination sequence of illumination sources with image capture in rolling shutter mode

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019152838A (en) * 2018-03-06 2019-09-12 シャープ株式会社 Display device, display method and program
CN112972218B (en) * 2021-02-04 2023-04-25 深圳小豆视觉科技有限公司 Naked eye 3D amblyopia rehabilitation intelligent training system
CN116617057A (en) * 2021-02-04 2023-08-22 深圳小豆视觉科技有限公司 Self-adaptive-regulation naked eye 3D amblyopia rehabilitation intelligent training system
CN116650293A (en) * 2021-02-04 2023-08-29 深圳小豆视觉科技有限公司 Realize bore hole 3D amblyopia rehabilitation wisdom training system in combination with high in clouds server
CN116650292A (en) * 2021-02-04 2023-08-29 深圳小豆视觉科技有限公司 Naked eye 3D double-channel amblyopia data processing system
CN112891165B (en) * 2021-02-04 2023-05-26 深圳小豆视觉科技有限公司 Intelligent training system for realizing naked eye 3D amblyopia rehabilitation through intelligent handheld mobile terminal

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110254834A1 (en) * 2010-04-14 2011-10-20 Lg Chem, Ltd. Stereoscopic image display device
US20120084652A1 (en) * 2010-10-04 2012-04-05 Qualcomm Incorporated 3d video control system to adjust 3d video rendering based on user prefernces
US8284235B2 (en) 2009-09-28 2012-10-09 Sharp Laboratories Of America, Inc. Reduction of viewer discomfort for stereoscopic images
US20130002660A1 (en) 2010-03-05 2013-01-03 Takahiro Chikazawa Stereoscopic video display device and operation method of stereoscopic video display device
US20130010055A1 (en) * 2011-07-05 2013-01-10 Texas Instruments Incorporated Method, system and computer program product for coding a sereoscopic network
US20130057961A1 (en) * 2006-04-28 2013-03-07 Sharp Kabushiki Kaisha Display, instrument panel, optical system and optical instrument

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2067354A2 (en) * 2006-09-19 2009-06-10 Koninklijke Philips Electronics N.V. Image viewing using multiple individual settings
TW201119353A (en) * 2009-06-24 2011-06-01 Dolby Lab Licensing Corp Perceptual depth placement for 3D objects
KR101114911B1 (en) * 2010-04-14 2012-02-14 주식회사 엘지화학 A stereoscopic image display device
JP2012253471A (en) * 2011-05-31 2012-12-20 Panasonic Corp Stereoscopic image display device and stereoscopic image display method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130057961A1 (en) * 2006-04-28 2013-03-07 Sharp Kabushiki Kaisha Display, instrument panel, optical system and optical instrument
US8284235B2 (en) 2009-09-28 2012-10-09 Sharp Laboratories Of America, Inc. Reduction of viewer discomfort for stereoscopic images
US20130002660A1 (en) 2010-03-05 2013-01-03 Takahiro Chikazawa Stereoscopic video display device and operation method of stereoscopic video display device
US20110254834A1 (en) * 2010-04-14 2011-10-20 Lg Chem, Ltd. Stereoscopic image display device
US20120084652A1 (en) * 2010-10-04 2012-04-05 Qualcomm Incorporated 3d video control system to adjust 3d video rendering based on user prefernces
US20130010055A1 (en) * 2011-07-05 2013-01-10 Texas Instruments Incorporated Method, system and computer program product for coding a sereoscopic network

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2972564A4

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200314411A1 (en) * 2019-03-29 2020-10-01 Alibaba Group Holding Limited Synchronizing an illumination sequence of illumination sources with image capture in rolling shutter mode

Also Published As

Publication number Publication date
EP2972564A4 (en) 2017-01-11
EP2972564A1 (en) 2016-01-20
CN105474072A (en) 2016-04-06

Similar Documents

Publication Publication Date Title
US20140253698A1 (en) System, apparatus, and method for enhancing stereoscopic images
US20130258463A1 (en) System, method, and apparatus for enhancing stereoscopic images
US20130182086A1 (en) Apparatus for enhancing stereoscopic images
US11531303B2 (en) Video display and method providing vision correction for multiple viewers
WO2014164921A1 (en) System, apparatus, and method for enhancing stereoscopic images
CN113240601B (en) Single depth tracking adjustment-vergence solution
Banks et al. 3D Displays
US20160212404A1 (en) Prevention and Treatment of Myopia
EP2472304A2 (en) Head-mounted display
US20110304689A1 (en) Remote user control for stereoscopic display
US20200252596A1 (en) Wide-Angle Stereoscopic Vision With Cameras Having Different Parameters
WO2007133918A2 (en) Enhancement of visual perception iii
IJsselsteijn et al. Effects of stereoscopic filming parameters and display duration on the subjective assessment of eye strain
JPWO2020008804A1 (en) 3D glasses, how to design spectacle lenses used for them, and how to observe 3D images
US20150356714A1 (en) System and method for using digital displays without optical correction devices
JP2014529225A (en) Apparatus, method and structure for 3D display
Hong et al. Measurement of the lens accommodation in viewing stereoscopic displays
Ukai Human factors for stereoscopic images
JP2012022278A (en) Video virtual feeling glasses
EP3419287A1 (en) An apparatus and a method for displaying a 3d image
Zhang Design of Head mounted displays
Mikšícek Causes of visual fatigue and its improvements in stereoscopy
Liu Methods for generating addressable focus cues in stereoscopic displays
Krasil’nikov Effect of viewing distance on spatial depth reproduced by a stereoscopic image
JP2015529029A (en) Method and apparatus for adapting 3D content to an observer wearing prescription glasses

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201480023811.1

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14778473

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2014778473

Country of ref document: EP