WO2012129594A1 - Method, system and apparatus for use in producing three dimensional imagery - Google Patents

Method, system and apparatus for use in producing three dimensional imagery Download PDF

Info

Publication number
WO2012129594A1
WO2012129594A1 PCT/AU2012/000303 AU2012000303W WO2012129594A1 WO 2012129594 A1 WO2012129594 A1 WO 2012129594A1 AU 2012000303 W AU2012000303 W AU 2012000303W WO 2012129594 A1 WO2012129594 A1 WO 2012129594A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
grid
image
displayed
segments
Prior art date
Application number
PCT/AU2012/000303
Other languages
French (fr)
Inventor
Donald Lewis Maunsell Martin
Original Assignee
Stereo Screen Systems Pty Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Stereo Screen Systems Pty Ltd filed Critical Stereo Screen Systems Pty Ltd
Publication of WO2012129594A1 publication Critical patent/WO2012129594A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/349Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B26/00Optical devices or arrangements for the control of light using movable or deformable optical elements
    • G02B26/08Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/22Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type
    • G02B30/24Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type involving temporal multiplexing, e.g. using sequentially activated left and right shutters
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/26Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
    • G02B30/30Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving parallax barriers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/282Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/302Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H04N13/31Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers
    • H04N13/315Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers the parallax barriers being time-variant

Definitions

  • the present invention relates to a method, system and apparatus for use in producing three-dimensional imagery.
  • the present invention also relates to a computer program product including a computer readable medium having recorded thereon a computer program for producing three-dimensional imagery.
  • three-dimensional imagery is an expression that has been in common use for many years. Since its first use, the meaning of the term has been extended to encompass a wide variety of depth enhancement imagery, as well as imagery that actually contains three visual dimensions, ⁇ ithin the range of relevant methodologies, equipment and effects, there can be said to be two broad and general categories.
  • One of these categories involves imagery containing a single angle of view of an object.
  • the other applies to images that simultaneously comprise two or more angles of view of essentially the same object.
  • Methods and apparatus that enable the presentation of two or more different angles of view of substantially the same objects simultaneously are also referred to as three-dimensional.
  • these arrangements present two spaced angles of view, acquired at distances of 21/4-21/2 inches apart with a common centre, by the use of methods and means that isolate left views to left eyes and right views to right eyes.
  • Left and right view separated systems include spectacles, viewers and visors ranging in sophistication from (as indicated hereinbefore) simple filtered or polarised spectacles to liquid crystal visors synchronised to screen signals.
  • Other techniques for keeping left and right angles of view visible only to the corresponding eye include view differentiating lenses, particularly lenticular arrays, and separated static right and left image strip arrangements.
  • holograms produce three-dimensional imagery containing multiple angles of view. Further, there are many combinations of these various systems.
  • image systems in general include, for example, cinemas, video and computer display units, television screens and the wide variety of monitors used in every day life for functions ranging from medical investigations, to entertainment, to military surveillance.
  • a method of producing three dimensional imagery comprising the steps of: a) displaying on a first screen two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery, one set acquired from an angle of view left of said common centre ("left acquired image segment set”) and one set generated from an angle of view right of said common centre (“right acquired image segment set”), said image segments being displayed in an alternating pattern across the first screen without any dark bands interposed between the image segments such that only half of the image segments from the left acquired image segment set and half of the image segments from the right acquired image segment set are displayed in any one of two screen display positions;
  • each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery, one set acquired from an angle of view left of said common centre ("left acquired image segment set”) and one set generated from an angle of view right of said common centre (“right acquired image segment set”), said image segments being configured for display in an alternating pattern across a display screen without any dark bands interposed between the image segments such that only half of the image segments from the left acquired image segment set and half of the image segments from the right acquired image segment set are displayed in any one of two screen display positions;
  • the first composite image representing the grid in a first position where a first half of the image segments from the left acquired image segment set are observable through said openings from the virtual focal point and a first half of the image segments from the right acquired image segment set are observable through the openings from the virtual focal point
  • the second composite image representing the grid in a second position where a second half of the image segments from the left acquired image segment set are observable through said openings from the virtual focal point and a second half of the image segments from the right acquired image segment set are observable through the openings from the virtual focal point
  • a method of producing three dimensional imagery comprising the steps of: a) displaying on a first screen two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery, one set acquired from an angle of view left of said common centre ("left acquired image segment set”) and one set generated from an angle of view right of said common centre (“right acquired image segment set”), said image segments being displayed in an alternating pattern across the first screen without any dark bands interposed between the image segments such that only half of the image segments from the left acquired image segment set and half of the image segments from the right acquired image segment set are displayed in any one of two screen display positions;
  • an apparatus for production of a coherent three dimensional image comprising:
  • a first screen on which is projected two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery; a segmented grid formed by a series of spaced apart slats and openings placed between a focal point and the first screen at a predetermined distance from the first screen such that the segmented grid creates an appearance of screen image segments in a first grid position;
  • first separated segments of imagery generated left of the common centre of said subject of said imagery are observable through openings of said grid, while second separated segments of imagery generated right of the common centre of said subject of said imagery are captured through the openings of the grid, the first and second separated segments of imagery alternating across the first screen without any dark bands interposed between image segments, such that a first half of the imagery is observable by the right and left eyes of an observer at a first position of the grid;
  • both the grid and the position of the image segments are oscillated relative to one another and in a synchronous fashion at a predetermined frequency such that both the grid and the position of the image segments displayed move from said first position momentarily to a second position thence back to the first position whereupon when the grid is momentarily in said second position during said oscillation a second half of the whole image acquired left of the common centre which was previously not displayed at the first position is observable from the focal point, and a second half of the whole image acquired right of the common centre which was not displayed at the first position is observable from the focal point;
  • a camera for capturing a plurality of images of the displayed screen image segments through the openings of the grid, the plurality of images being captured from the focal point, such that by virtue of the oscillation of both the grid and the image segments at said predetermined frequency, upon the captured images subsequently being displayed on a second display screen, the grid is rendered invisible such that an observer sees a whole coherent three dimensional image by each eye alternately seeing a first half of the image, and then a second half of the image on the screen as the grid and the image segments move between the first and second positions and wherein the whole coherent three dimensional image can be observed from any point within a viewing room in front of the second screen and grid arrangement and is independent of the position of the observer in the viewing room.
  • a system for production of a coherent three dimensional image comprising: a first screen on which is projected two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery;
  • segmented grid formed by a series of spaced apart slats and openings placed between a focal point and the first screen at a predetermined distance from the first screen such that the segmented grid creates an appearance of screen image segments in a first grid position
  • first separated segments of imagery generated left of the common centre of said subject of said imagery are observable through openings of said grid, while second separated segments of imagery generated right of the common centre of said subject of said imagery are captured through the openings of the grid, the first and second separated segments of imagery alternating across the first screen without any dark bands interposed between image segments, such that a first half of the imagery is observable by the right and left eyes of an observer at a first position of the grid; wherein both the grid and the position of the image segments are oscillated relative to one another and in a synchronous fashion at a predetermined frequency such that both the grid and the position of the image segments displayed move from said first position momentarily to a second position thence back to the first position whereupon when the grid is momentarily in said second position during said oscillation a second half of the whole image acquired left of the common centre which was previously not displayed at the first position is observable from the focal point, and a second half of the whole image acquired right of the common centre which was not displayed at the first position is
  • a camera for capturing a plurality of images of the displayed screen image segments through the openings of the grid, the plurality of images being captured from the focal point, such that by virtue of the oscillation of both the grid and the image segments at said predetermined frequency, upon the captured images subsequently being displayed on a second display screen, the grid is rendered invisible such that an observer sees a whole coherent three dimensional image by each eye alternately seeing a first half of the image, and then a second half of the image on the screen as the grid and the image segments move between the first and second positions and wherein the whole coherent three dimensional image can be observed from any point within a viewing room in front of the second screen and grid arrangement and is independent of the position of the observer in the viewing room.
  • an apparatus for producing three dimensional imagery comprising:
  • a first screen on which are displayed two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery, one set acquired from an angle of view left of said common centre ("left acquired image segment set”) and one set generated from an angle of view right of said common centre (“right acquired image segment set”), said image segments being displayed in an alternating pattern across the first screen without any dark bands interposed between the image segments such that only half of the image segments from the left acquired image segment set and half of the image segments from the right acquired image segment set are displayed in any one of two screen display positions;
  • a segmented grid formed by a series of alternate spaced apart slats and openings placed in front of the first screen between a focal point and the first screen such that the image on the first screen is observable from the focal point as separated and segmented
  • the grid is of a size and shape which corresponds to the size of the image segments seen from the focal point and wherein the grid is movable between a first and a second grid position in which the slats and openings exchange positions, wherein the grid is set at a pre-determined distance from the first screen such that;
  • the grid is moved at a predetermined speed in front of the first screen as the image segments are sequentially displayed on the first screen in their first and second screen display positions at that same predetermined frequency;
  • a camera for capturing a plurality of images of the displayed image segments through the openings of the grid as the grid is moved in front of the screen, where the plurality of images are captured from the focal point, such that upon the captured images subsequently being displayed on a second display screen, the grid is rendered invisible and an observer sees a whole coherent three dimensional image by the Observer's left eye sequentially observing first and second halves of the left acquired image segment set and the observer's right eve sequentially observing first and second halves of the right acquired image segment set and wherein the whole coherent three dimensional image can be seen by the observer from any position within a wide arc in front of the second screen.
  • a system for producing three dimensional imagery comprising:'
  • a first screen on which are displayed two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery, one set acquired from an angle of view left of said common centre ("left acquired image segment set”) and one set generated from an angle of view right of said common centre (“right acquired image segment set”), said image segments being displayed in an alternating pattern across the first screen without any dark bands interposed between the image segments such that only half of the image segments from the left acquired image segment set and half of the image segments from the right acquired image segment set are displayed in any one of two screen display positions;
  • a segmented grid formed by a series of alternate spaced apart slats and openings placed in front of the first screen between a focal point and the first screen such that the image on the first screen is observable from the focal point as separated and segmented
  • the grid is of a size and shape which corresponds to the size of the image segments seen from the focal point and wherein the grid is movable between a first and a second grid position in which the slats and openings exchange positions, wherein the grid is set at a pre-determined distance from the first screen such that;
  • a camera for capturing a plurality of images of the displayed image segments through the openings of the grid as the grid is moved in front of the screen, where the plurality of images are captured from the focal point, such that upon the captured images subsequently being displayed on a second display screen, the grid is rendered invisible and an observer sees a whole coherent three dimensional image by the observer's left eye sequentially observing first and second halves of the left acquired image segment set and the observer's right eve sequentially observing first and second halves of the right acquired image segment set and wherein the whole coherent three dimensional image can be seen by the observer from any position within a wide arc in front of the second screen.
  • FIG. 1 is a diagrammatic plan view of a display screen and grid suitable for producing three dimensional imagery
  • FIG. 2 is a diagrammatic plan view of a further display screen and grid suitable for producing three dimensional imagery
  • FIG. 3 is a top-view of a chair showing a left viewpoint and a right viewpoint;
  • FIG. 4 shows the six image segments LI to L6 showing the chair as seen from a left view L;
  • FIG. 5 shows the six image segments Rl to R6 showing the same chair as seen from a right view R;
  • FIG. 6 shows the interleaved left and right screen image segments in a first position
  • FIG. 7 shows the interleaved left and right screen image segments in a second position
  • FIG. 8 shows the actual positions of the grid segments half way in front of image segments on the screen shown in FIG. 6;
  • FIG. 9 is a plan view of two eyeballs viewing the screen through spaces in the grid.
  • FIG. 10 shows the grid segments in a first position as they would be seen by the left eye of a viewer
  • FIG. 11 shows the grid segments in a second position as they would be seen by the left eye of a viewer
  • FIG. 12 shows the grid segments in a second position as they would be seen by the right eye of a viewer
  • FIG. 13 shows the grid segments in a first position as they would be seen by the right eye of a viewer
  • FIG. 14 shows the grid segments in a first position placed in front of the screen; showing image segments in a first position as seen by the left eye of a viewer;
  • FIG. 15 shows the grid segments in a second position placed in front of the screen showing image segments in a second position as seen by the left eye of a viewer;
  • FIG. 16 shows the grid segments in a second position placed in front of the screen showing image segments in a second position as seen by the right eye of a viewer;
  • FIG. 17 shows the grid segments in a first position placed in front of the screen showing image segments in a first position as seen by the right eye of a viewer;
  • FIG. 18 is a top-view of a chair showing two left viewpoints L A and LB and two right viewpoints RA and Rs;
  • FIG. 19 shows the 12 image segments L I -LA 12 acquired from left viewpoint
  • FIG. 20 shows the 12 image segments B I-LB 12 acquired from left viewpoint
  • FIG. 21 shows the 12 image segments RA I -RA 1 acquired from right viewpoint R ⁇ ;
  • FIG. 22 shows the 12 image segments R B ⁇ -RB 12 acquired from right viewpoint
  • FIG. 23 shows the 12 image segments spread evenly across a screen in a first position
  • FIG. 24 shows the 12 image segments spread evenly across a screen in a second position
  • FIG. 25 shows a system for producing three dimensional images in accordance with a further implementation
  • FIG. 26 is a plan view of two eyeballs viewing the screen of the system of FIG. 25 through openings in the grid of the system of FIGS. 1, 2 and 25;
  • FIGS. 27A and 27B collectively form a schematic block diagram representation of a digital camera upon which described arrangements can be practised;
  • FIG. 28 is a schematic flow diagram showing a method of producing three dimensional imagery using the system of FIG. 25;
  • FIG. 29 is a schematic flow diagram showing another method of producing three dimensional imagery using the system of Fig. 25, with the grid means of FIG. 1 or FIG. 2;
  • FIG. 30 is a schematic flow diagram showing another method of producing three dimensional imagery.
  • FIGS. 31A and 3 IB form a schematic block diagram of a general purpose computer system upon which the method of FIG. 30 can be practiced.
  • the present disclosure provides a method, system and an apparatus for producing imagery that may be displayed on a screen and viewed through an oscillating grid or virtual grid so that the imagery appears entirely in three physical dimensions.
  • the present disclosure provides improvements on earlier inventions.
  • the improvements, combined together, produce three-dimensional imagery that is practical and commercially viable for many purposes for which it is desired.
  • a first improvement involves the presentation of three-dimensional imagery on a screen.
  • the long held belief that two or more adjacent angles of view cannot be aligned in three dimensions on a screen for observation by the unaided eyes is fundamentally flawed.
  • the present disclosure provides improvements in technology that overcome the impediment of having to wear viewers to see three-dimensional imagery, or use techniques with equal or greater undesirabilities.
  • the disclosed improvements significantly reduce and may eliminate eye strain caused by wearing such viewers.
  • the Pulseometor comprised two discs of transparency graduated from complete to zero, rotating in opposite directions so that each angle of view projected through the discs fades and brightens in illumination in opposition to the other view.
  • Images comprising two, or more adjacent angles of view can be aligned apparently completely in three dimensions on a screen, providing that the angle between the views and the distances between the foreground and background of the object are sufficiently small.
  • this angle of separation and the distance between the background and the foreground of the object is dependent upon the distance of the object centre; the total depth of field; type of lenses used; centres of focus; and vertical as well as horizontal alignment of the images.
  • the angle is always very small for objects closer than approximately forty (40) yards and the differences between both images difficult to discern; despite the physical separation of the image centres, high quality resolution equipment is essential.
  • this angle of view is less than one quarter of a degree for objects at less than forty yards.
  • This very small angle of displacement can be increased in a flexible way that permits application to most conventional imagery equipment.
  • three-dimensional imagery can be produced by segmenting left and right angles of view of an object and arranging the strips on a flat surface separated by slats, or similar dividers, so that observers can position their eyes to have the left eyes seeing left image strips while the slats block the left eye views of the right image strips and the right eyes see the right image strips, while the slats block the right eye views of the left image strips.
  • This well known arrangement produces a three-dimensional combination but is always limited by the degradation to the overall effect caused by the view differentiating slats.
  • the cyclostereoscope is a further compression of parallax barriers and comprises a circular grid rotating about a screen on to which left and right adjacent angles of view were projected through the grid.
  • Savoye envisaged the grid, alternatively blocking each eye view of a different combination of strips of angles of view and the whole grid rotating to sequentially reveal all segments at a speed that would permit memory and vision to together perceive the strips combined as two whole images in three dimensions.
  • This Savoye achieved partially and prescribed zoned seating arrangements to confine viewers to areas where three- dimensional views were optimised and views of two overlapping images minimised.
  • Images containing two, or more, adjacent angles of view acquired around a common centre of essentially the same object can be aligned in three complete, and coherent, dimensions, except the extreme outer edges, in increasing divergence of angle, with increasing separation between the different images, and the corresponding viewing eyes.
  • the presented image are then viewed through a vertical grid so that left eye views of image segments, positioned on screens right of image segments displaying right eye views, are separated from right eye views of image segments, positioned on screens left of left eye views, in increasing degrees of exclusion as the angles of divergence between the images increase.
  • the system applied to two or adjacent angles of views acquired around a .common centre of an object, where each different viewpoint is horizontally separated from approximately a quarter of an inch to five inches for any two adjacent angles of view.
  • the grid system may be supplied by grids formed with a liquid crystal display synchronised with the segmentation of the imagery.
  • the segmented and separated imagery may be oscillated together in synchronisation so that their functions are maintained at a speed, for example in excess of fifty hertz. At such a speed, the segments merge into a complete, coherent, three dimensional image and the grid lines are oscillating too fast to be seen.
  • This combination produces wide-zone three-dimensional imagery of any angle capable of human perception by widening or narrowing the grid lines, without inertial limitations, or incompatibility with almost all conventional equipment.
  • the eye should in many cases be conceived as something of a dynamic sensor.
  • the eyes of a human being generally see both horizontal and vertical planes substantially simultaneously, together with constantly varying fields of depth and focal points. This essential dynamic sensing, coupled with the memory, maintains impressions of infinitely variable views of everything seen by the eyes.
  • the mind is not given one clear left or one clear right view, but is continually given a range of different partial and adjacent images. These varying partial and adjacent images are combined by the mind or brain of a human being into a single coherent whole which has depth of image and which clearly appears in three dimensions.
  • the eyes of a human are rapidly and continuously scanning. As indicated, they do not, it is believed, continuously focus on one point, giving one right view and one left view.
  • the eyes have a continuously changing field of view and both eyes are continuously shifting over varying points, one crossing over the other's field of view.
  • humans are often continuously moving their heads, and eye balls are often moving within their sockets.
  • the present disclosure describes commercially viable methods and systems for producing three-dimensional imagery, by removing the necessity for wearing view differentiating spectacles and for, in some cases, using other intermediate opticals between the imagery and the observer.
  • the described methods and systems produce wide angle three-dimensional imagery, with comparatively little alteration and addition to existing technology, by containing about a common centre within each image, multiple, adjacent angles of view that are displayed partially and progressively across the screen, in apparent full alignment, as separated image segments, or as a combination of separated image segments, changing to cumulatively reveal the continuously varying spatial displacements between the segments of images on the screen and, at sufficient speed, as constant visual displacements between the subject elements of a steady, single, coherent and complete three-dimensional image.
  • the described methods and systems for producing three dimensional imagery also provide that the angles between the multiple views about a common centre of each image are such that the rapidly changing segments of images containing the angles produce an apparent constant visual displacement between the subject elements of the image, at the same time that the subject elements within the image appear to remain in alignment, so as to prevent or minimise the appearance of more than one image, or multiple imagery within any part of the image.
  • production means acquisition, generation or construction for immediate display upon a screen, or immediate transmission for display, or immediate broadcasting for display.
  • production may mean acquisition, generation, or construction for storage and later display, transmission, broadcasting or projection.
  • Equipment used for acquisition include analog still and video cameras, digital still and video cameras, cine cameras, holographic camera arrangements, or any device capable of acquiring imaging containing multiple, adjacent angles of view about a common centre in a manner such that the acquired imagery may be presented, separated and segmented for display so as to appear three-dimensional on a screen. Segmentation of the multiple adjacent angles of view about a common centre can take place as the imagery is acquired, within a camera-like system, a computing system or anywhere before display such as during, or as part of, film or image processing; storage input or retrieval; or editing; for the production of slides; film prints, ideo tapes, digital images, compact discs (CDs) or digital video discs (DVDs) for release; in transmission or broadcasting; or on reception.
  • analog still and video cameras digital still and video cameras, cine cameras, holographic camera arrangements, or any device capable of acquiring imaging containing multiple, adjacent angles of view about a common centre in a manner such that the acquired imagery may be presented, separated and segmented for display so
  • appropriate segmented imagery may be manufactured in the generation of imagery, such as computer imagery or symbology, or in the production of caricatures.
  • image a single whole image is meant such as contained by a slide; one frame of a film or digital video; one image on a video tape; an x-ray; a digital image or any other clearly definable view capable of being recorded, stored, transmitted, broadcast, displayed, projected, presented or generated to duplicate actual objects, symbols; or represent objects or symbols such as computer generated imagery or caricatures.
  • image or imagery series of single images presenting the same view or continuation of a view are included.
  • display projected, presented, illuminated or generated so as to be visible to the eye.
  • screen any surface upon which the imagery can be displayed, presented, projected or generated so that it becomes visible; or any volume in which imagery can be made to appear.
  • alignment is meant that each imagery is registered apparently exactly upon any , other in size, shape, vertical and horizontal position, so that multiple images appear as differing only in the appearance of depth or dimensionality and never as more than one image, or more than one part of any image, necessarily the same shape, that is revealed progressively across the screen.
  • the size of the segments will vary according to the medium used for acquisition or viewing.
  • the described methods for producing three dimensional imagery provide a method and arrangement, whereby imagery is recorded (or stored) in such a manner that realistic and commercially viable three-dimensional imagery may be subsequently, or substantially simultaneously, be shown on a display screen surface.
  • the imagery may be recorded (or stored) on any appropriate media, such as film, tape, slides, computer readable media (as defined below) including portable and fixed hard drives, compact discs (CD), digital video discs (DVD), holograms and the like.
  • the imagery is recorded on media so that it can be subsequently shown such as in the cinema by way of slides or photographs, on a television, on a video set, on a compact disc (CD) player, a digital video disc (DVD) player, a computer display and the like.
  • means for recording the imagery such as an analog or digital camera or cameras
  • means for recording the imagery are in the form of a camera or cameras which are themselves, or in conjunction with appropriate transmission means, able to immediately transmit the recorded imagery to means such as television sets and the like which will receive and show the recorded imagery on a screen surface.
  • television cameras used in outside broadcast units for television news, sporting events and the like may be used. These are by way of example only.
  • the present disclosure relates to a method and arrangement for the recording of imagery for subsequent or substantially simultaneous viewing on a screen surface.
  • the methods and arrangements described herein require the provision of a lens or lens system, that allows for the recording or acquisition of two or more substantially adjacent, similarly sized angles of view of imagery or objects that are to be recorded. Generally, it is better to acquire or record a plurality of smaller adjacent angle views rather than a smaller number of larger angle views. It should however be appreciated that two or more differing angles of view be recorded in the one or more of the described methods.
  • imagery is recorded for subsequent or simultaneous viewing so that at all times only partial and adjacent sections of each angle of view are acquired or recorded.
  • the partial and adjacent angles of view are recorded in a nonsequential manner, by using the described apparatus and methods.
  • the recording of such non-sequential adjacent and partial angles of view allows for such non-sequential adjacent and partial angles of view to be subsequently shown by means so as to be viewed with depth of imagery and in substantially three dimensions, by the eyes of a viewer.
  • the present disclosure provides that means be provided in association with the lens or camera, or in association with the recording of a multiple angle views, so that the imagery is recorded in a partial, adjacent and spaced apart manner.
  • the described methods for producing three dimensional imagery require the provision of a grid, grid system, separator, angle of view interrupter, light or signal blocking mechanism, switch or process means, as a component or feature, essential to the recording of the imagery, so that the imagery as recorded, is recorded partially and from two or more spaced apart, adjacent angles of view.
  • the methods for producing three dimensional imagery are described with reference to the imagery being recorded from two spaced angles of view-one left angle and the other a right angle. This is however, by way of example only and it should be appreciated that the imagery can be recorded from two or more angles of view.
  • the means for use in recording partial and adjacent multiple angles of view can be separate from the recording means such as a camera or can be incorporated into the camera.
  • a camera can have included into it appropriate means for causing the imagery to be partial and adjacent.
  • Such a means may be in the form of, for example, an interrupter, such as a grid system which can be built into the camera but arranged so as to avoid interference with the shutter or scanning function. Further, any such arrangement should be timed to obviate as far as possible the production of lines, strobing, moire or other optical noise, distortion or image degradation.
  • a camera can be an electronic or digital still or video camera which can be programmed so that it can record partial and adjacent angles of view of the article or articles being recorded.
  • a camera can have a plurality of spaced lenses, or alternatively a plurality of such cameras can be utilised, the recorded imagery thereafter being mixed and processed.
  • an interrupter or grid arrangement might be provided within the camera, such an arrangement can be provided before, within or behind the lens or in any position wherein it positively interrupts the acquisition or recording of imagery, through the lens, so that only partial and adjacent images are recorded on the media or recorded by the camera.
  • the grid or interrupter arrangement may be placed behind a lens, adjacent and as close as possible to the film plane.
  • the grid or interrupter arrangement will be synchronised with the camera shutter or might replace the shutter or be incorporated into the film gate.
  • the effect of the grid or interrupter is to segment recorded imagery.
  • the grid or interrupter may be placed in front of a lens or lenses.
  • the grid or shutter is configured to segment and separate recorded imagery, so that the grid or shutter is recorded in focus with the recorded imagery as a barrier.
  • the barrier visibly segments and separates recorded imagery at slower than display speeds where the grid or shutter may be seen in operation.
  • the barrier has a similar effect at . higher display speeds where the barrier cannot be seen.
  • the recorded multiple angles of view may then be subsequently altered so as to include partial and adjacent angles of view, such as by known mechanical, electro-optical, electrical, or other means, such as for example segmentation mixes and the like.
  • media such as film or tapes, with a programmed grid or pattern applied thereto, or gaps therein, may be used in a camera to simplify the recording componentry.
  • display units presenting image interrupting patterns may be used to mix multiple angle views.
  • a liquid crystal display may be used that presented image segmenting lines or gaps traversing the display of the required speed, to form a dynamic optical grid.
  • the imagery is shown on a screen, as a result of being computer-generated or produced on a screen, or by being displayed on a screen by way of projection.
  • the imagery is shown as being viewed through the grid means ⁇ (to be described further hereinafter).
  • the screen 1 is shown as having a screen surface 2.
  • a grid means 3 is also provided substantially in front of and spaced apart from said screen surface 2.
  • the grid means 3 may be in the form of a liquid crystal display screen, which on operation generates a plurality of oscillating grid sections 4, through which the imagery can be viewed on the screen.
  • Other forms of grids may be used if desired. For example, physical grids extending across the front of a screen, provided with a plurality of slots or openings 4 thereof of varying depth. It is however preferred that the grid means have a plurality of grid sections or openings therein.
  • the grid means 3 may be in the form of a liquid crystal display screen or other appropriate electrical or chemical optical arrangement which provides physical separation of imagery.
  • the liquid crystal display screen is preferably arranged so that the grid 3 oscillates.
  • grid means can move or oscillate by means of additional mechanisms or electric power means.
  • the grid 3 is shown as being separated forwardly from the screen surface 2 and one implementation is shown (diagrammatically) as being embodied into a housing or cover 9 in front of the screen 1.
  • the screen 1 may be a television set, a cinema screen or the like.
  • a plurality of spaced apart grid means 3 may be provided.
  • the spaced apart grid means 3 form channel sections or slots 4 therebetween so that on oscillation or movement thereof, imagery on the screen surface 2 will be seen therethrough in three dimensions.
  • the screen 1 and spaced-apart grid means 3 can be located or housed in a housing 9 so as to be substantially integral. Alternatively, the screen 1 and spaced-apart grid means 3 may be separate one from the other.
  • At least the grid means 3 can be for example in the form of crystalline, liquid crystal or similarly functioning electro-optical materials.
  • the materials may for example be inorganic compounds, such as gilenium arsenide; lithium niobate ⁇ potassium dihydrogen phosphate; and barium borate; as well as organic compounds such as methyl nitroaniline and nitroamiriostilbene; also materials from electron donors, such as amino, methoxy, and hydroxy groups; and electron acceptor groups, such as nitro, cyanide, esther and nitroso groups; polymers; polyenes; and polydiacetglenes or any materials with electro-optical properties; light frequency changing properties; non-centrosymmetric molecular structure; or crystalline structures where anions have been completed replaced by electrons, such as in complex compounds, such as alklide, potassium hexamethyl hyxacyclen sodium.
  • inorganic compounds such as gilenium arsenide; lithium niobate ⁇ potassium dihydrogen phosphate; and barium borate
  • organic compounds such as methyl nitroaniline and nitroamiriostilbene
  • the elctro-optical material may be arranged in single pieces such as blocks, slabs or chips, or in a number of pieces, in large or small pieces of any shape, in films, in thin films, in solutions, in suspensions, sandwiched between other materials, such as glass, as mixtures with other electro-optical compounds, or as mixtures with other materials that are non-electro-optical compounds.
  • the electro-optical materials of the grid are arranged in lines, rods, strips, slats, panels or filaments, these can be positioned in rows, in partial rows, staggered rows, in parallel, in parallel rows, in horizontal or vertical rows (or both) or in f intersecting rows.
  • the electro-optical materials may be of differing lengths and sizes and at different positions within the display.
  • grids such as grids formed of any appropriate material with slots therein, adapted to oscillate or move in an appropriate manner, may be used to perform the described methods for producing three dimensional imagery.
  • the grid 3 which comprises alternate slats and openings is set at a predetermined distance from the screen 1 on which imagery is projected from two or more angles of view.
  • the alternate slats at the same time block some segments of the imagery from view.
  • the grid 3 is oscillated at a predetermined frequency preferably within the range of 50 Hz to 450 Hz depending upon requirements such as screen and thus grid size.
  • the screen thus during oscillation continuously moves between a first position and a second position. It is the movement of the screen from the first position to the second position which exposes the whole image to the observer albeit alternately and in accordance with the description below.
  • the observer's left eye sees via the openings in the grid, half of a whole left image.
  • half of the left image is blocked to the left eye.
  • the right eye sees half of a whole right image but half of the right image is blocked to the right eye.
  • the left eye of the observer sees that half of the left image which was blocked from view to the left eye when the grid was in the first position and no longer sees that remaining half of the left image which was visible to the left eye when the grid was in the first position.
  • the right eye of the observer sees that half of the right image which was blocked to the right eye when the grid was in the first position and no longer sees that remaining half of the right image visible to the right eye right when the grid was in the first position.
  • the grid is oscillated at such speed that it appears invisible to the observer. This enables the viewing of coherent three dimensional imagery by alternate observation of part of the image when the grid is in the first position and the remaining part of the image when the grid is in the second position.
  • the described methods for producing three dimensional imagery allow for the display of three-dimensional imagery and the viewing of three-dimensional imagery (be it generated, produced or projected) such as in the manner described and claimed.
  • the imagery projected onto the screen or generated onto a screen or shown on a screen otherwise, involves displaying imagery on a screen.
  • the displayed imagery includes two or more spaced apart adjacent angles of view about a common centre which are displayed and in a segmented and separated manner, substantially sequentially or alternately on a screen.
  • the separated segments are viewed through sections of a grid, such as described with reference to FIGS. 1 and 2 of the accompanying drawings, which have sections or openings of a size and shape corresponding substantially to the dimensions of the segments of imagery displayed on the screen.
  • the grid means 3 is placed at a distance from the screen 1, such that the segments of imagery acquired left of segments of images acquired right are seen through grid sections substantially by the right eye of a viewer. In this instance, whole image segments acquired right of image segments acquired left of image segments acquired right are seen through grid sections substantially through the left eye of a viewer.
  • the relationship between the left and right segments of imagery, relative to the grid and sections thereof is substantially maintained when the grid sections oscillate.
  • This enables the imagery to be viewed through the oscillating grid, the oscillation being at a speed and in synchronisation with the display of the segments of imagery, such that the imagery appears to the eyes of a viewer (through said grid means) to be coherent, complete and in three dimensions. It has been found that this avoids flickering, whole or partial appearance of any individual angles of view and it has also been found that the grid sections, on oscillating, become substantially invisible as a substantially transparent window between the eyes of a viewer and the screen.
  • the described methods for producing three dimensional imagery are based on a dynamic electro-optical arrangement as are many other prior known methods of producing three-dimensional imagery. Such prior methods have, however, fallen short of the mark.
  • the described methods for producing three dimensional imagery display three dimensional imagery on a screen that can be seen by the unaided eyes from a large viewing arc.
  • Limitations on the viewing arc are determined by the limitations of various display systems on which the imagery may be presented. Some of these systems have no limitations, such as films, while others are limited according to cost or inherent system function. There are, however, no limitations inherent in the improved grid viewing system described herein and current technical limitations are constantly being reduced by price reductions, higher equipment operation speeds and increases in viewing angles of components like liquid crystals.
  • each eye sees a different view through the grid because it is looking through the grid from a different position and from a different angle.
  • the grid is composed of open sections that can be looked through and grid segments that cannot be looked through, the grid segments will not only force both eyes to see different parts of whatever is displayed on the screen, the grid will also block different parts of whatever is displayed on the screen. Furthermore, because the grid sections are in different positions for each eye, the blocking effect will be different for each eye.
  • Views intended for the left eye are positioned on the screen behind the grid to be seen through the sections through which the left eye is not obstructed. 2. Views for the right eye are positioned oh the screen behind the grid to be seeri through the sections through which the right eye is not obstructed.
  • the grid moves into a second position to allow the second halves of each view to be presented on the screen in another position where these second halves can be seen.
  • the second halves of the two views are presented on the screen in a different position from the first position. This second position corresponds to the second position of the grid so that left views are presented to left eyes and right views are presented to right eyes. (If the positions of the second halves of the two views did not reverse with the grid changing positions, then the left views would be seen by right eyes and right views by left eyes.)
  • the described methods for producing three dimensional imagery involves a system which presents half of each view, extended right across the screen, in alternating positions. Each half view is seen through a grid to effect the required separation of appropriate views to appropriate eyes. Moving the grid gives a new viewing position for each eye which is the reverse of the previous viewing position so that the remaining two half views displayed on the screen must also be reversed in their alternating positions so as to match the reversed viewing positions.
  • the alternating segments of left angles of view for left eyes and right angles of view for right eyes will alternate in synchronisation with the oscillation of the grid.
  • Precise alignment of the grid elements with the image segments is important to the effective separation of the left image segments to left eyes and right image segments to right eyes. As well as separating the image segments effectively to each eye, the alignment required to reveal the entire left and right images sequentially in two halves so as to display each picture completely to each eye.
  • the grid lines will be positioned in synchronisation with the image segments to block alternate image segments as shown in FIG. 2.
  • the size of the grid elements and the relative size of the image segments can be varied, or alternated, as required for different viewing .positions as well as the position of the grid elements from the screen.
  • An infinite number of grid positions, grid and image segment sizes may be displayed to an infinite number of viewing positions limited only by the speed of the system, to provide such viewing positions at a speed that does not product flicker and displays both images completely and separately at those positions.
  • More than two images may be displayed using any section of the image segments to display another angle of view.
  • FIGS. 3-17 show the described methods when used to display images acquired from two viewpoints.
  • FIGS. 18-24 show the described methods when used to display images acquired from more than two viewpoints.
  • FIG. 3 there is shown a chair (10) as seen from above.
  • L represents a viewing position slightly to the left of a central point (17).
  • R represents a viewing point slightly to the right of central point (17).
  • FIG. 4 shows the chair as it would be seen from viewpoint L. If the whole angle of view was displayed on a screen, in six segments, the screen would appear as shown in FIG. 4. To more readily identify the parts of the chair, its legs have been labelled as 11, 12, 13 and 14. Image segments LI to L6, acquired from point of view L will be referred to as "left image segments”.
  • FIG. 5 shows the chair (10) as seen from viewing position R. If the whole angle of view was displayed on a screen, in six segments, the screen would appear as shown in FIG. 5. Image segments Rl to R6, acquired from point of view R will be referred to as "right image segments”.
  • image segments are displayed on the screen in a first position and then in a second position.
  • FIG. 6 shows a screen in the first position with left and right image ⁇ segments interleaved with one another.
  • FIG. 7 shows the screen displaying the left and right image segments in a second position.
  • FIG. 8 shows the grid segments at a halfway position in front of the image segments on the screen shown in FIG. 6. (However, this is not how it appears to the eyes.)
  • FIG. 9 shows a plan view of the screen in a first position where the image segments are as shown in FIG. 6, and of a grid having grid segments GO, Gl . . . G7 placed between the screen and a viewer.
  • the viewer has a left eye (15) and right eye (16).
  • the position of the grid segments in relation to the viewer's eyes and the screen segments is such that the left eye (15) can only see left image segments LI and L3, and the right eye (16) can only see right image segments R2 and R4. This is by way of example only and, in practice, the left eye (15) would see a myriad of left image segments and the right eye (16) would see a myriad of right image segments.
  • FIG. 10 shows the grid segments in a first position as the grid segments would be seen by the left and right eyes of the viewer.
  • the image segments are as shown in FIG. 6.
  • the cross hatched segments indicate the grid segments that the viewer can not see through.
  • the unshaded segments are the grid segments that the viewer can see through.
  • FIG. 11 shows the grid segments in a second position as the grid segments would be seen by the left and right eyes of the viewer.
  • the image segments are as shown in FIG. 7.
  • FIG. 12 shows the grid segments in a second position as the grid segments would be seen by the left and right eyes of the viewer.
  • FIG. 13 shows the grid segments in a first position as the grid segments would be seen by the left and right eyes of the viewer.
  • the left eye When the grid in a first position is placed in front of the screen showing the image segments in a first position, the left eye will see half of the left image segments. As seen in FIG. 14, the left eye can see part of the chair displayed in left image segments L3 and L5. The image segments displayed on the screen alternate to a second position at the same time as the grid changes to a second position. The left eye then sees part of the chair displayed in left image segments L2 and L4. This change from a first position to a second position of both the image segments and the grid segments occurs in a fraction of a second and the human brain merges these two images to form one complete image, as seen from left viewpoint L.
  • FIG. 18 shows the chair (10) as seen from above and shows two left viewing positions, L A and LB and two right viewing positions, R ⁇ and R # .
  • FIG. 19 shows the 12 image segments L 1-Ls 12 acquired from left viewpoint
  • FIG. 20 shows the 12 image segments LB I -LB 12 acquired from left viewpoint
  • FIG. 21 shows the 12 image segments RA I-RA 12 acquired from right viewpoint
  • FIG. 22 shows the 12 image segments RB ⁇ -RB 12 acquired from right viewpoint
  • the left and right image segments need to be interleaved across the screen in a uniform manner.
  • FIG. 23 shows the twelve image segments spread evenly across a screen in a first position.
  • FIG. 24 shows the twelve image segments spread evenly across a screen in a second position.
  • the right eye will see a quarter of the image segments acquired from viewpoint R and a quarter of the image segments acquired from viewpoint R B .
  • the left eye When the image segments on the screen are in the second position and the grid segments (not shown) are in the second position, the left eye will then see a second quarter of the image segments acquired from viewpoint L and a second quarter of the image segments acquired from viewpoint L B . At the same time, the right eye will see a second quarter of the image segments acquired from viewpoint and a second quarter of the image segments acquired from viewpoint R B .
  • FIG. 25 shows a system 2500 for producing three dimensional imagery in accordance with a further implementation.
  • the system 2500 comprises the screen 1 having the screen surface 2 as seen in FIGS. 1 and 2.
  • the system 2500 also comprises a grid means 2503.
  • the system 2500 is an improved parallax barrier system.
  • the methods described above use an oscillating grid 3 (e.g., in the form of a liquid crystal display), where the grid segments 4 of the grid 3 oscillate between a first position as shown in Fig. 10 and a second position as shown in Fig. 11.
  • the grid means 2503 comprises a plurality of vertically orientated grid sections 2504 (e.g., as with the grid sections of FIGS. 10 and 11) which are the same as the grid sections 4.
  • the grid segments 2504 of the grid means 2503 may be smaller in size than the grid sections 4.
  • the grid segments 2504 of the grid means 2503 move continuously in a single direction (e.g., from left to right, or from right to left) horizontally in front of the screen 1.
  • the grid segments 2504 of the grid 2503 essentially provide a seamless progression of an infinite number of grid positions.
  • Such an implementation may be achieved through use of the grid 2503 in the form of a liquid crystal display.
  • the liquid crystal display may be configured to simulate a cyclostereoscope or the like comprising grid sections 2504 moving continuously in a single direction in front of the screen 1.
  • the grid 2503 may be in the . form of a cyclostereoscope or a mechanical grid. Again, such a cyclostereoscope or mechanical grid is configured to move continuously in a single direction (e.g., from left to right, or from right to left) horizontally in front of the screen 1.
  • the grid 2503 may be in the form of any suitable optical barrier configured to move continuously in a single direction (e.g., from left to right, or from right to left) horizontally in front of the screen 1.
  • the grid means 2503 may be implemented using a parallax barrier.
  • the system 2500 also comprises a camera 2700.
  • the camera 2700 is a digital video camera which will be described in detail below with reference to FIG. 27.
  • the system 2500 may also use other acquisition means, as described above, including conventional analog film cameras, cine cameras, holographic camera arrangements, or any other suitable device.
  • the camera 2501 may be used to capture and store video images of the three dimensional imagery produced in accordance with the methods described above. .
  • the camera 2700 is positioned in front of the grid means 2503 at a focal point 2601, and the camera 2700 is configured, so that the grid means 2503 and any images displayed on the screen surface 2 are in focus to the camera 2700.
  • location of the focal point 2601 represents a point of intersection of a projection from the left segment LI through the left eye 15 of the viewer and a projection from the right segment R4 through the right eye 16 of the viewer.
  • the focal point 2601 represents a point where first and second separated images (e.g., the screens of FIGS. 14 and 16) seen by the left eye 15 and right eye 16, respectively, of the viewer, through openings 2504 of the grid means 2503, align completely.
  • the focal point 2601 represents a point at which the screens of FIGS. 14 and 16 align.
  • the position of the focal point 2601 is preferably selected as a closest focal point suitable for viewing the images displayed on the screen 2 through the grid means 2503. Positioning the camera 2700 at the focal point 2601 reduces any artefacts caused by interferences in light paths or signal incompatibilities.
  • a method 2800 of producing three dimensional imagery using the system 2500 will be described below with reference to Fig. 28. The method 2800 will be described with reference to the example of FIGS. 3 to 18.
  • Figs. 27A and 27B collectively form a schematic block diagram of camera 2700 including embedded components, upon which one or more steps of the method 2800, and other methods, to be described are desirably practiced.
  • the camera 2700 may be in the form a dedicated digital camera.
  • the digital camera 2700 may be in the form of a mobile phone, smart phone or the like, in which processing resources are limited. Nevertheless, one or more steps of the method 2800 and other methods described herein may also be performed on higher-level devices such as desktop computers, server computers, and other such devices with significantly larger processing resources.
  • the camera 2700 comprises an embedded controller 2702. Accordingly, the camera 2700 may be referred to as an "embedded device.”
  • the controller 2702 has a processing unit (or processor) 2705 which is bi- directionally coupled to an internal storage module 2709.
  • the storage module 2709 may be formed from non-volatile semiconductor read only memory (ROM) 2760 and semiconductor random access memory (RAM) 2770, as seen in Fig. 27B.
  • the RAM 2770 may be volatile, non-volatile or a combination of volatile and non-volatile memory.
  • the camera 2700 includes a display controller 2707, which is connected to a video display 2714, such as a liquid crystal display (LCD) panel or the like.
  • the display controller 2707 is configured for displaying graphical images on the video display 2714 in accordance with instructions received from the embedded controller 2702, to which the display controller 2707 is connected.
  • the camera 2700 also includes user input devices 2713 which are typically formed by keys, a keypad or like controls.
  • the user input devices 2713 may include a touch sensitive panel physically associated with the display 2714 to collectively form a touch-screen.
  • Such a touch-screen may thus operate as one form of graphical user interface (GUI) as opposed to a prompt or menu driven GUI typically used with keypad-display combinations.
  • GUI graphical user interface
  • Other forms of user input devices may also be used, such as a microphone (not illustrated) for voice commands or a joystick/thumb wheel (not illustrated) for ease of navigation about menus.
  • the camera 2700 also comprises a portable memory interface 2706, which is coupled to the processor 2705 via a connection 2719.
  • the portable memory interface 2706 allows a complementary portable memory device 2725 to be coupled to the camera 2700 to act as a source or destination of data or to supplement the internal storage module 2709. Examples of such interfaces permit coupling with portable memory devices such as Universal Serial Bus (USB) memory devices, Secure Digital (SD) cards, Personal Computer Memory Card International Association (PCMIA) cards, optical disks and magnetic disks.
  • the camera 2700 also has a communications interface 2708 to permit coupling of the device 2701 to a computer or communications network 2720 via a connection 2721.
  • the connection 2721 may be wired or wireless.
  • connection 2721 may be radio frequency or optical.
  • An example of a wired connection includes Ethernet.
  • an example of wireless connection includes BluetoothTM type local interconnection, Wi-Fi (including protocols based on the standards of the IEEE 802.11 family), Infrared Data Association (IrDa) and the like.
  • the camera 2700 is configured to perform some special function.
  • the embedded controller 2702 possibly in conjunction with, further special function components 2710, is provided to perform that special function.
  • the components 2710 represent a lens, focus control and image sensor of the camera 2700.
  • the special function components 2710 may also represent a number of encoders and decoders of a type including Joint Photographic Experts Group (JPEG), (Moving Picture Experts Group) MPEG, MPEG-1 Audio Layer 3 (MP3), and the like.
  • JPEG Joint Photographic Experts Group
  • MP3 MPEG-1 Audio Layer 3
  • One or more steps of the method 2800, and other methods described herein, may be implemented using the embedded controller 2702, where the processes of Figs. 28, 29 and 30 may be implemented as one or more software application programs 2733 executable within the embedded controller 2702.
  • the camera 2700 of Fig. 27A implements one more steps of the described methods.
  • one or more of the steps of the described methods are effected by instructions in the software 2733 that are carried out within the controller 2702.
  • the software instructions may be formed as one or more code modules, each for performing one or more particular tasks.
  • the software may also be divided into two separate parts, in which a first part and the corresponding code modules performs the described methods and a second part and the corresponding code modules manage a user interface between the first part and the user.
  • the software 2733 of the embedded controller 2702 is typically stored in the non- volatile ROM 2760 of the internal storage module 2709.
  • the software 2733 stored in the ROM 2760 can be updated when required from a computer readable medium.
  • the software 2733 can be loaded into and executed by the processor 2705.
  • the processor 2705 may execute software instructions that are located in RAM 2770.
  • Software instructions may be loaded into the RAM 2770 by the processor 2705 initiating a copy of one or more code modules from ROM 2760 into RAM 2770.
  • the software instructions of one or more code modules may be pre-installed in a non-volatile region of RAM 2770 by a manufacturer. After one or more code modules have been located in RAM 2770, the processor 2705 may execute software instructions of the one or more code modules.
  • the application program 2733 may be pre-installed and stored in the ROM 2760 by a manufacturer, prior to use of the camera 2700. However, in some instances, the application programs 2733 may be supplied to the user encoded on one or more CD-ROM (not shown) and read via the portable memory interface 2706 of Fig. 27A prior to storage in the internal storage module 2709 or in the portable memory 2725. In another alternative, the software application program 2733 may be read by the processor 2705 from the network 2720, or loaded into the controller 2702 or the portable storage medium 2725 from other computer readable media.
  • Computer readable storage media refers to any non- transitory tangible storage medium that participates in providing instructions and/or data to the controller 2702 for execution and/or processing.
  • Examples of such storage media include floppy disks, magnetic tape, CD-ROM, a hard disk drive, a ROM or integrated circuit, USB memory, a magneto-optical disk, flash memory, or a computer readable card such as a PCMCIA card and the like, whether or not such devices are internal or external of the device 2701.
  • Examples of transitory or non-tangible computer readable transmission media that may also participate in the provision of software, application programs, instructions and/or data to the device 2701 include radio or infra-red transmission channels as well as a network connection to another computer or networked device, and the Internet or Intranets including e-mail transmissions and information recorded on Websites and the like.
  • a computer readable medium having such software or computer program recorded on it is a computer program product.
  • the second part of the application programs 2733 and the corresponding code modules mentioned above may be executed to implement one or more graphical user interfaces (GUIs) to be rendered or otherwise represented upon the display 2714 of Fig. 27A.
  • GUIs graphical user interfaces
  • a user of the device 2701 and the application programs 2733 may manipulate the interface in a functionally adaptable manner to provide controlling commands and/or input to the applications associated with the GUI(s).
  • Other forms of functionally adaptable user interfaces may also be implemented, such as an audio interface utilizing speech prompts output via loudspeakers (not illustrated) and user voice commands input via the microphone (not illustrated).
  • Fig. 27B illustrates in detail the embedded controller 2702 having the processor
  • the processor 2705 for executing the application programs 2733 and the internal storage 2709.
  • the internal storage 2709 comprises read only memory (ROM) 2760 and random access memory (RAM) 2770.
  • the processor 2705 is able to execute the application programs 2733 stored in one or both of the connected memories 2760 and 2770.
  • ROM read only memory
  • RAM random access memory
  • the processor 2705 is able to execute the application programs 2733 stored in one or both of the connected memories 2760 and 2770.
  • the application program 2733 permanently stored in the ROM 2760 is sometimes referred to as "firmware". Execution of the firmware by the processor 2705 may fulfil various functions, including processor management, memory management, device management, storage management and user interface.
  • the processor 2705 typically includes a number of functional modules including a control unit (CU) 2751, an arithmetic logic unit (ALU) 2752 and a local or internal memory comprising a set of registers 2754 which typically contain atomic data elements 2756, 2757, along with internal buffer or cache memory 2755.
  • CU control unit
  • ALU arithmetic logic unit
  • registers 2754 which typically contain atomic data elements 2756, 2757, along with internal buffer or cache memory 2755.
  • One or more internal buses 2759 interconnect these functional modules.
  • the processor 2705 typically also has one or more interfaces 2758 for communicating with external devices via system bus 2781, using a connection 2761.
  • the application program 2733 includes a sequence of instructions 2762 though 2763 that may include conditional branch and loop instructions.
  • the program 2733 may also include data, which is used in execution of the program 2733. This data may be stored as part of the instruction or in a separate location 2764 within the ROM 2760 or RAM 2770.
  • the processor 2705 is given a set of instructions, which are executed therein. This set of instructions may be organised into blocks, which perform specific tasks or handle specific events that occur in the camera 2700. Typically, the application program 2733 waits for events and subsequently executes the block of code associated with that event. Events may be triggered in response to input from a user, via the user input devices 2713 of Fig. 27 A, as detected by the processor 2705. Events may also be triggered in response to other sensors and interfaces in the camera 2700. The execution of a set of the instructions may require numeric variables to be read and modified. Such numeric variables are stored in the RAM 2770. The described methods use input variables 2771 that are stored in known locations 2772, 2773 in the memory 2770.
  • the input variables 2771 are processed to produce output variables 2777 that are stored in known locations 2778, 2779 in the memory 2770.
  • Intermediate variables 2774 may be stored in additional memory locations in locations 2775, 2776 of the memory 2770. Alternatively, some intermediate variables may only exist in the registers 2754 of the processor 2705.
  • the execution of a sequence of instructions is achieved in the processor 2705 by repeated application of a fetch-execute cycle.
  • the control unit 2751 of the processor 2705 maintains a register called the program counter, which contains the address in ROM 2760 or RAM 2770 of the next instruction to be executed.
  • the contents of the memory address indexed by the program counter is loaded into the control unit 2751.
  • the instruction thus loaded controls the subsequent operation of the processor 2705, causing for example, data to be loaded from ROM memory 2760 into processor registers 2754, the contents of a register to be arithmetically combined with the contents of another register, the contents of a register to be written to the location stored in another register and so on.
  • the program counter is updated to point to the next instruction in the system program code. Depending on the instruction just executed this may involve incrementing the address contained in the program counter or loading the program counter with a new address in order to achieve a branch operation.
  • One or more steps or sub-processes in the processes of the methods described herein are associated with one or more segments of the application program 2733, and are performed by repeated execution of a fetch-execute cycle in the processor 2705 or similar programmatic operation of other independent processor blocks in the camera 2700.
  • the method 2800 of producing three dimensional imagery will now be described. As above, the method 2800 will be described with reference to the example of FIGS. 3 to 17. However, the method 2800 is equally applicable to the example of FIGS. 18 to 24, where a plurality of left and right viewpoints are used.
  • One or more steps of the method 2800 may be implemented as code modules of the software application program 2733 resident within the storage module 2709 and being controlled in execution by the processor 2705.
  • the method 2800 begins at step 2801, where imagery including two (or more) spaced apart adjacent angles of view is displayed on the screen 2.
  • the imagery may be projected onto the screen surface 2* generated onto the screen 2 or displayed on the screen 2 otherwise, in a segmented and separated manner, as described above, with reference to FIGS. 3 to 17.
  • the screen of FIG. 6 with left image segments (i.e., L3 and L5) and right image segments (i.e., R2 and R4) interleaved with one another, is displayed on the screen surface 2.
  • the screen of FIG. 6 is displayed on the screen surface 2.
  • left image segments i.e., L2 and L4
  • right image segments i.e., Rl and R3
  • the imagery is displayed on the screen surface 2 continuously in a sequential manner for a predetermined period of time in order to produce the three dimensional imagery.
  • the imagery may be displayed on the screen surface 2 at any suitable cycle speed to achieve a flicker free assemblage of two complete image views over four cycles.
  • the display of the imagery on the screen surface 2 may be stopped at any suitable time by a user, for example, at completion of the method 2800.
  • the vertically orientated grid segments (or openings) 2504 of the grid means 2503 are caused to move continuously in a single horizontal direction (e.g., from left to right, or right to left) in front of the screen 1.
  • the grid means 2503 in the form a liquid crystal display may be configured to cause grid sections 2504, similar to the openings 4, to move continuously in a single direction in front of the screen 1.
  • the grid means 2503 may be in the form of a rotating circular grid (e.g., a cyclostereoscope) and may be caused to begin to rotate in a single direction in front of the screen 1 so that vertically orientated grid sections 2504 move in front of the screen 1.
  • the grid 2503 may be in the form of any suitable optical barrier configured to move continuously in a single direction (e.g., from left to right, or from right to left) horizontally in front of the screen 1.
  • the grid sections 2504 are moved in front of the screen 1 at such a speed that the opaque sections of the grid means 2503 appear invisible to the observer. Accordingly, as with the methods described above, when viewed through the grid sections 2504 the imagery displayed on the screen surface at steps 2801 will be seen as a sequence of three dimensional images.
  • the method 2800 continues at the next step 2805 where the processor 2705 initiates capture of, by the camera 2700 positioned at the focal point 2601, a sequence of video images of the imagery displayed on the screen surface 2, through the open grid segments 2504 of the grid means 2503.
  • the camera 2501 may be configured to continuously capture images as the grid segments 2504 of the grid means 2503 move in front of the screen 1 , producing the essentially infinite number of grid positions.
  • an image of the screen of FIG. 6 will be captured by the camera 2501 through the grid segment (or openings) 2504 of the grid means 2503.
  • the grid segments 2504 of the grid means 2503 may be at any particular position depending on when the image of the screen of FIG. 6 is captured.
  • an image of the screen of FIG. 7 will be captured by the camera 2501 through the grid segments (or openings) 2504 of the grid means 2503.
  • the grid segments 2504 of the grid means 2503 may be any particular position depending on when the image of the screen of FIG. 7 is captured.
  • the focal point 2601 at which the camera 2700 is positioned represents a point where first and second separated images (e.g., the screens of FIGS. 14 and 16) seen by the left eye 15 and right eye 16 of the viewer, align.
  • first and second separated images e.g., the screens of FIGS. 14 and 16
  • the images captured at step 2805 are stored within the storage module 2709.
  • the images stored within the storage module 2709 at steps 2805 may subsequently be transferred to any other storage media including computer readable storage media (i.e., as defined above) including a compact disc (CD), a digital video disc (DVD), a portable hard disk drive or the like.
  • computer readable storage media i.e., as defined above
  • CD compact disc
  • DVD digital video disc
  • portable hard disk drive or the like.
  • the continuously captured sequence of images stored at step 2805 may also be subsequently displayed in a sequential manner at a suitable frequency (e.g., greater than or equal to 180 hertz) on a suitable display means such as a cinema screen, a television screen, a computer display, a video set, a compact disc (CD) player, a digital video disc (DVD) player, and the like.
  • the captured images may also be displayed at lower or higher frequencies than the frequencies of the grid or shutter frequencies depending on required acceptable flicker rates and commercial broadcast or other standards.
  • the displayed sequence of images are seen by a viewer of the displayed images as three dimensional video images.
  • the continuously captured sequence of images may be displayed (e.g., for a cinema audience) for a predetermined period of time (e.g., the length of a movie).
  • the images captured at step 2805 may also be transmitted over conventional analog television networks or digital television networks in an analog or digital form, respectively, for display on a suitable display device.
  • the captured images may also be transmitted over the network 2720 to a remote server, for example, before being displayed on a suitable display device.
  • the images captured at step 2805 may be transmitted over the televisional networks and/or the network 2720 at any suitable frequency (or speed) according to the frequency or speed of the networks.
  • FIG. 29 Another method 2900 of producing three dimensional imagery will now be described with reference to FIG. 29. As above, the method 2900 will be described with reference to the example of FIGS. 3 to 17. However, the method 2900 is equally applicable to the example of FIGS. 18 to 24.
  • One or more steps of the method 2900 may be implemented as code modules of the software application program 2733 resident within the storage module 2709 and being controlled in its execution by the processor 2705.
  • the method 2900 uses the screen 1 and grid means 3 of FIGS. 1 and 2 where the grid segments 4 of the grid means 3 are oscillated between the first position as seen in FIG. 10 and the second position as seen in FIG. 11.
  • the digital video camera 2700 is again positioned at the focal point 2601, as seen in FIG. 26, in front of the screen 1.
  • the method 2900 begins at step 2901, where imagery including two (or more) spaced apart adjacent angles of view are displayed on the screen surface 2. Again, the imagery may be projected onto the screen surface 2, generated onto the screen 2 or displayed on the screen 2 otherwise, in a segmented and separated manner, as described above.
  • the screen of FIG. 6, with left (i.e., L3 and L5) and right image segments (i.e., R2 and R4) image segments interleaved with one another is displayed on the screen surface 2.
  • the minimum cycle speed of the imagery displayed on the screen surface 2 is one hundred and eighty (180) hertz to achieve a flicker free assemblage of two complete image views over four cycles.
  • the processor 2705 initiates capture of an image of the screen of Fig. 6, by the camera 2700, through the grid segments 4 of the grid means 3.
  • the image is captured at step 2903 while the grid segments 4 of the grid 3 are in the first position shown in Fig. 10.
  • the image captured at step 2903 is stored within the storage module 2709.
  • step 2905 further imagery including two (or more) spaced apart adjacent angles of view is displayed on the screen surface 2.
  • the further imagery may be projected onto the screen surface 2, generated onto the screen 2 or displayed on the screen 2 otherwise, in a segmented and separated manner, as described above.
  • the screen of FIG. 7, with left and right image segments interleaved with one another is displayed on the screen surface 2.
  • the processor 2705 initiates capture of an image of the screen of Fig. 7, by the camera 2700, through the grid segments 4 of the grid means 3.
  • the image is captured at step 2907 while the grid segments 4 of the grid means 3 are in the second position as shown in Fig. 1 1.
  • the image captured at step 2907 is stored within the storage module 2709;
  • step 2909 if the processor 2705 determines that more images are required to be captured, then the method 2900 returns to step 2901. Otherwise, the method 2900 concludes.
  • the images stored within the storage module 2709 at steps 2903 and 2907 may subsequently be transferred to any other storage media including computer readable storage media as defined above, including a compact disc (CD), a digital video disc (DVD), a portable hard disk drive or the like.
  • the images stored within the storage module 2709 at steps 2903 and 2907 may subsequently be displayed in a sequential manner at a suitable frequency (e.g., greater than or equal to 180 hertz) on a suitable display means such as a cinema screen, a television screen, a computer display, a video set, a compact disc (CD) player, a digital video disc (DVD) player, and the like.
  • the displayed sequence of images are seen by a viewer of the displayed images as three dimensional video images as with the methods described above, including the method 2800.
  • the images captured at steps 2903 and 2907 may be displayed (e.g., for a cinema audience) for a predetermined period of time (e.g., the length of a movie).
  • the camera 2700 is positioned at the focal point 2601 so as to continuously capture and record (or store) imagery produced by the system 2500.
  • the images displayed on the screen surface 2 are captured by the camera 2 through the open grid segments 2504.
  • the images may be displayed on the screen surface 2, in a segmented and separated manner, at any required display frequency.
  • the grid 2503 may be moved or oscillated at any required frequency. Accordingly, three-dimensional imagery may be produced by the system 2500, based on the displayed images, at any required frequency.
  • the separated and segmented images are aligned (or combined) at the focal point 2601 to form complete, aligned images.
  • the camera 2700 is configured so that the images displayed on the screen surface 2, as well as the grid means 2503, are in focus to the camera 2700, as the displayed images are being captured by the camera 2700 through the grid segments 2504.
  • the camera 2700 is also configured so that any other image segmenting and separating barrier or like device positioned between a recording plane of the camera 2700 and an image plane of the screen surface 2, is also in focus to the camera 2700, as the images are being captured by the camera 2700.
  • the images captured in accordance with the methods 2800 and 2900 may also be transmitted over conventional analog television networks or digital television networks in an analog or digital form, respectively, for display on the suitable display devices.
  • the captured images may also be transmitted over the network 2720 to a remote server, for example, before being displayed on a suitable display device.
  • the images captured in accordance with the methods 2800 and 2900 may be transmitted over the televisional networks and/or the network 2720 at any suitable frequency (or speed) according to the frequency or speed of the networks.
  • the system 2500 implementing the methods 2800 and 2900 provides a number of advantages over conventional systems and methods for producing three dimensional imagery.
  • the display of two separated images captured from a single viewing point i.e., the focal point 2601 permits the display of two images (e.g., the screens of FIGS. 14 and 16) at the same time and exactly aligned avoiding many limitations of conventional systems and methods of producing three dimensional imagery.
  • the images captured by the camera 2700 may be subsequently viewed at any normal viewing position in front of the display device upon which the captured images are subsequently displayed, including the cinema screen, television, computer display, video set, compact disc (CD) player, digital video disc (DVD) player, and the like.
  • the system 2500 and methods 2800, 2900 also effectively eliminate the doubling of transmission and screen operating rates that is required to display two images at equivalents to avoid substandard and unacceptable image flicker.
  • the images captured by the camera 2700 may be subsequently viewed on display devices including the cinema screen, television, computer display, video set, compact disc (CD) player, digital video disc (DVD) player, and the like, without modifications or additions to the display devices.
  • the display devices may also be of any particular size.
  • the system 2500 also allows dimensions of image content components to be increased over such conventional methods.
  • the system 2500 used with a grid means 2503 in the form of a liquid crystal display also eliminates the requirement for components like parallax barriers and barriers of lens arrays together with supporting electronics, which reduces the cost of producing three dimensional imagery over conventional methods.
  • the three dimensional imagery produced using either of the methods 2800 and 2900 and displayed on a suitable display means replicates normal dimensional perception three times more closely than all conventional three dimensional display methods, except holograms.
  • the three dimensional imagery produced using either of the methods 2800 and 2900 also displays imagery more closely replicating normal sight than conventional flat images seen on conventional flat screen display devices.
  • the three dimensional imagery produced using either of the methods 2800 and 2900 and displayed on a suitable display means substantially reduces the well known eye strain inherent in other conventional three dimensional display systems.
  • the methods 2800 and 2900 also allow three dimensional images of objects not previously generated as three dimensional images, such as printed words and computer text, to be displayed as three dimensional images.
  • the method 2800 provides a seamless progression of separated grid positions for three dimensional images.
  • the seamless progression of separated grid positions eliminates the inherent dependence of grid barrier devices on displaying multiples of two image segments combined with two barrier positions at high operation speeds.
  • FIG. 30 Another method 3000 of producing three dimensional imagery will be described below with reference to FIG. 30. As above, the method 3000 will be described with reference to the example of FIGS. 3 to 17. However, the method 3000 is equally applicable to the example of FIGS. 18 to 24, where multiple image viewpoints are used.
  • the method 3000 does not use any physical grid means such as the grid means 3 of FIGS. 1 and 2.
  • the three dimensional imagery is generated as a sequence of composite images.
  • One or more steps of the method 3000 may be implemented on a general-purpose computer system 3100 as seen in FIGS. 31A and 31B.
  • the computer system 3100 includes: a computer module 3101 ; input devices such as a keyboard 3102, a mouse pointer device 3103,. a scanner 3126, a camera 3127, and a microphone 3180; and output devices including a printer 3115, a display device 3114 and loudspeakers 3117.
  • An external Modulator- Demodulator (Modem) transceiver device 31 16 may be used by the computer module 3101 for communicating to and from a communications network 3120 via a connection 3121.
  • the communications network 3120 may be a wide-area network (WAN), such as the Internet, a cellular telecommunications network, or a private WAN.
  • WAN wide-area network
  • the modem 3116 may be a traditional "dial-up" modem.
  • the modem 3116 may be a broadband modem.
  • a wireless modem may also be used for wireless connection to the communications network 3120.
  • the computer module 3101 typically includes at least one processor unit 3105, and a memory unit 3106.
  • the memory unit 3106 may have semiconductor random access memory (RAM) and semiconductor read only memory (ROM).
  • the computer module 3101 also includes an number of input/output (I/O) interfaces including: an audio-video interface 3107 that couples to the video display 3114, loudspeakers 31 17 - and microphone 3180; an I/O interface 31 13 that couples to the keyboard 3102, mouse 3103, scanner 3126, camera 3127 and optionally a joystick or other human interface device (not illustrated); and an interface 3108 for the external modem 31 16 and printer 3115.
  • the modem 3116 may be incorporated within the computer module 3101, for example within the interface 3108.
  • the computer module 3101 also has a local network interface 3111, which permits coupling of the computer system 3100 via a connection 3123 to a local-area communications network 3122, known as a Local Area Network (LAN).
  • LAN Local Area Network
  • the local communications network 3122 may also couple to the wide network 3120 via a connection 3124, which would typically include a so-called "firewall" device or device of similar functionality.
  • the local network interface 3111 may comprise an Ethernet circuit card, a Bluetooth wireless arrangement or an IEEE 802.11 wireless arrangement; however, numerous other types of interfaces may be practiced for the interface 31 1 1.
  • the I/O interfaces 3108 and 3113 may afford either or both of serial and parallel connectivity, the former typically being implemented according to the Universal Serial Bus (USB) standards and having corresponding USB connectors (not illustrated).
  • Storage devices 3109 are provided and typically include a hard disk drive (HDD) 3110. Other storage devices such as a floppy disk drive and a magnetic tape drive (not illustrated) may also be used.
  • An optical disk drive 3112 is typically provided to act as a non- volatile source of data.
  • Portable memory devices such optical disks (e.g., CD-ROM, DVD, Blu-ray DiscTM), USB-RAM, portable, external hard drives, and floppy disks, for example, may be used as appropriate sources of data to the system 3100.
  • the components 3105 to 3113 of the computer module 3101 typically communicate via an interconnected bus 3104 and in a manner that results in a conventional mode of operation of the computer system 3100 known to those in the relevant art.
  • the processor 3105 is coupled to the system bus 3104 using a connection 31 18.
  • the memory 3106 and optical disk drive 3112 are coupled to the system bus 3104 by connections 3119. Examples of computers on which the described arrangements can be practised include IBM-PC's and compatibles, Sun Sparcstations, Apple MacTM or a like computer systems.
  • the method 3000 may be implemented using the computer system 3100 wherein the processes of Fig. 30, to be described, may be implemented as one or more software application programs 3133 executable within the computer system 3100.
  • the steps of the method 3000 are effected by instructions 3131 (see Fig. 3 IB) in the software 3133 that are carried out within the computer system 3100.
  • the software instructions 3131 may be formed as one or more code modules, each for performing one or more particular tasks.
  • the software may also be divided into two separate parts, in which a first part and the corresponding code modules performs the method 3000 and a second part and the corresponding code modules manage a user interface between the first part and the user.
  • the software may be stored in a computer readable medium, including the storage devices described below, for example.
  • the software is loaded into the computer system 3100 from the computer readable medium, and then executed by the computer system 3100.
  • the use of the computer program product in the computer system 3100 preferably effects an advantageous apparatus for implementing the method 3000.
  • the software 3133 is typically stored in the HDD 3110 or the memory 3106.
  • the software is loaded into the computer system 3100 from a computer readable medium, and executed by the computer system 3100.
  • the software 3133 may be stored on an optically readable disk storage medium (e.g., CD-ROM) 3125 that is read by the optical disk drive 31 12.
  • the application programs 3133 may be supplied to the user encoded on one or more CD-ROMs 3125 and read via the corresponding drive 31 12, or alternatively may be read by the user from the networks 3120 or 3122. Still further, the software can also be loaded into the computer system 3100 from other computer readable media.
  • GUIs graphical user interfaces
  • a user of the computer system 3100 and the application may manipulate the interface in a functionally adaptable manner to provide controlling commands and/or input to the applications associated with the GUI(s).
  • Other forms of functionally adaptable user interfaces may also be implemented, such as an audio interface utilizing speech prompts output via the loudspeakers 3117 and user voice commands input via the microphone 3180.
  • FIG. 31B is a detailed schematic block diagram of the processor 3105 and a "memory" 3134.
  • the memory 3134 represents a logical aggregation of all the memory modules (including the HDD 3109 and semiconductor memory 3106) that can be accessed by the computer module 3101 in Fig. 31 A.
  • a power-on self-test (POST) program 3150 executes.
  • the POST program 3150 is typically stored in a ROM 3149 of the semiconductor memory 3106 of Fig. 31 A.
  • a hardware device such as the ROM 3149 storing software is sometimes referred to as firmware.
  • the POST program 3150 examines hardware within the computer module 3101 to ensure proper functioning and typically checks the processor 3105, the memory 3134 (3109, 3106), and a basic input-output systems software (BIOS) module 3151, also typically stored in the ROM 3149, for correct operation. Once the POST program 3150 has run successfully, the BIOS 3151 activates the hard disk drive 3110 of Fig. 31 A.
  • BIOS basic input-output systems software
  • Activation of the hard disk drive 31 10 causes a bootstrap loader program 3152 that is resident on the hard disk drive 31 10 to execute via the processor 3105.
  • the operating system 3153 is a system level application, executable by the processor 3105, to fulfil various high level functions, including processor management, memory management, device management, storage management, software application interface, and generic user interface.
  • the operating system 3153 manages the memory 3134 (3109, 3106) to ensure that each process or application running on the computer module 3101 has sufficient memory in which to execute without colliding with memory allocated to another process. Furthermore, the different types of memory available in the system 3100 of Fig. 31 A must be used properly so that each process can run effectively. Accordingly, the aggregated memory 3134 is not intended to illustrate how particular segments of memory are allocated (unless otherwise stated), but rather to provide a general view of the memory accessible by the computer system 3100 and how such is used.
  • the processor 3105 includes a number of functional modules including a control unit 3139, an arithmetic logic unit (ALU) 3140, and a local or internal memory 3148, sometimes called a cache memory.
  • the cache memory 3148 typically include a number of storage registers 3144 - 3146 in a register section.
  • One or more internal busses 3141 functionally interconnect these functional modules.
  • the processor 3105 typically also has one or more interfaces 3142 for communicating with external devices via the system bus 3104, using a connection 31 18.
  • the memory 3134 is coupled to the bus 3104 using a connection 3119.
  • the application program 3133 includes a sequence of instructions 3131 that may include conditional branch and loop instructions.
  • the program 3133 may also include data 3132 which is used in execution of the program 3133.
  • the " instructions 3131 and the data 3132 are stored in memory locations 3128, 3129, 3130 and 3135, 3136, 3137, respectively.
  • a particular instruction may be stored in a single memory location as depicted by the instruction shown in the memory location 3130.
  • an instruction may be segmented into a number of parts each of which is stored in a separate memory location, as depicted by the instruction segments shown in the memory locations 3128 and 3129.
  • the processor 3105 is given a set of instructions which are executed therein.
  • the processor 1105 waits for a subsequent input, to which the processor 3105 reacts to by executing another set of instructions.
  • Each input may be provided from one or more of a number of sources, including data generated by one or more of the input devices 3102, 3103, data received from an external source across one of the networks 3120, 3102, data retrieved from one of the storage devices 3106, 3109 or data retrieved from a storage medium 3125 inserted into the corresponding reader 31 12, all depicted in Fig. 31 A.
  • the execution of a set of the instructions may in some cases result in output of data. Execution may also involve storing data or variables to the memory 3134.
  • the method 3000 uses input variables 3154, which are stored in the memory 3134 in corresponding memory locations 3155, 3156, 3157.
  • the method 3000 produces output variables 3161, which are stored in the memory 3134 in corresponding memory locations 3162, 3163, 3164.
  • Intermediate variables 3158 may be stored in memory locations 3159, 3160, 3166 and 3167.
  • each fetch, decode, and execute cycle comprises:
  • a further fetch, decode, and execute cycle for the next instruction may be executed.
  • a store cycle may be performed by which the control unit 3139 stores or writes a value to a memory location 3132.
  • Each step or sub-process in the processes of FIG. 30 is associated with one or more segments of the program 3133 and is performed by the register section 3144, 3145, 3147, the ALU 3140, and the control unit 3139 in the processor 3105 working together to perform the fetch, decode, and execute cycles for every instruction in the instruction set for the noted segments of the program 3133.
  • the method 3000 may alternatively be implemented in dedicated hardware such as one or more integrated circuits performing the functions or sub functions of the method 3000.
  • dedicated hardware may include graphic processors, digital signal processors, or one or more microprocessors and associated memories.
  • the method 3000 may be implemented as one or more code modules of the software application 2733 resident in the storage module 2709 and being controlled in its execution by the processor 2705.
  • the method 3000 will be described with reference to the example of FIGS. 3 to 17. However, the method 3000 is equally applicable to the example of FIGS. 18 to 24, where multiple left and right viewpoints are generated.
  • the method begins at step 3001 , where the processor 3105 accesses an image of a subject or scene captured from an angle of view left of a common centre.
  • the image may be accessed from the memory 3106 or the hard disk drive 3110.
  • the image may be captured (or acquired) using the camera 2700, for example, and be stored in the memory 3106 or hard disk drive 31 10 prior, to execution of the method 3000.
  • the image of the chair as it would be seen from viewpoint L, as seen in FIG. 4 is accessed by the processor 3105 at step 3001.
  • the processor 3105 accesses an image of a subject or scene captured from an angle of view right of the common centre. Again, the image may be accessed from the memory 3106 or the hard disk drive 3110. The image accessed at step 3002 may be captured using the camera 2700, for example, and be stored in the memory 3106 or hard disk drive 3110 prior to execution of the method 3000. In accordance with the present example, the image of the chair as it would be seen from viewpoint R, as seen in FIG. 5, is accessed by the processor 3105 at step 3002.
  • the processor 3105 generates two sets of image segments from the images accessed at steps 3001 and 3002.
  • the sets of image segments may be stored in the memory 3106 or the hard disk drive 31 10.
  • the size of each of the image segments is determined according to the size of a display screen upon which the image segments will subsequently be displayed and a viewing position of a viewer.
  • the viewing position of the viewer is taken to be a first focal point such as the focal point 2601.
  • the first focal point may be considered a virtual focal point as it represents a viewing position for the viewing when viewing the display screen upon which the image segments will subsequently be displayed.
  • the processor 3105 generates the image segments LI to L6 as seen in FIG. 4 and the image segments Rl to R6 as seen in FIG. 5.
  • the processor 3105 generates two images where each image comprises an alternating pattern of the image segments generated at steps 3002 and 3003.
  • the images are generated at steps 3004 so that each image comprises half of the image segments from the left generated image segment set interleaved with half of the image segments from the right generated image segments set.
  • an image representing the screen of FIG. 6 and an image representing the screen of FIG. 7 are generated at step 3004.
  • the processor 3105 accesses an image representing a plurality of grid segments.
  • the grid segments of the accessed image are in a first position as the grid segments would be viewed in that first position by the left and right eyes of a viewer positioned at the first focal point (e.g., the focal point 2601), when the grid segments are displayed on the display screen upon which the sets of image segments will subsequently be displayed.
  • Each of the grid segments represents a fully transparent portion of the display screen interleaved between fully opaque grid segments.
  • the size and shape of each of the grid segments is determined according to the size and shape of the display screen and the viewing position (i.e., the first focal point such as the focal point 2601) of the viewer.
  • a physical grid e.g., the grid means 3
  • the display screen e.g., the display screen 1
  • the processor 3105 generates a first composite image representing the image accessed at step 3005 composited over a first one of the images generated at step 3004.
  • the processor 3105 composites the grid segment image accessed at step 3005 over the image representing the screen of FIG. 6.
  • the composite image generated at step 3006 represents a first half of the image segments from the left generated image segment set as displayed on the display screen and seen through the transparent grid segment openings of the grid segment image (i.e., accessed at step 3005) by the left eye (e.g., 15) of the viewer, and a first half of the image segments from the right generated image segment set as displayed on the display screen and seen through the transparent grid segment openings of the grid segment image (i.e., accessed at step 3005) by the right eye (e.g., 16) of the viewer, as the viewer would view the displayed image segments from the viewing position (e.g., the focal point 2601).
  • the first composite image may be stored in the memory 3106 or the hard disk drive 3110.
  • the processor 3105 accesses an image comprising a plurality of opaque and fully transparent grid segments in a second position as the grid segments would be viewed in that second position by the left and right eyes of the viewer (e.g., at the focal point 2601) when the grid segments are displayed on the display screen upon which the sets of image segments will subsequently be displayed.
  • the size and shape of each of the grid segments is the same as the grid segments of the image accessed at step 3005.
  • the processor 3105 generates a second composite image representing the image accessed at step 3007 composited over a second one of the images generated at step 3004.
  • the processor 3105 composites the grid segment image accessed at step 3007 over the image representing the screen of FIG. 7.
  • the composite image generated at step 3008 represents a second half of the image segments from the left generated image segment set as displayed on the display screen and seen through the transparent grid segment openings of the grid segment image (i.e., accessed at step 3007) by the left eye (e.g., 15) of the viewer, and a second half of the image segments from the right generated image segment set as displayed on the display screen and seen through the transparent grid segment openings of the grid segment image (i.e., accessed at step 3007) by the right eye (e.g., 16) of the viewer, as the viewer would view the displayed image segments from the first focal point (e.g.., the focal point 2601).
  • the second composite image may be stored in the memory 3106 or the hard disk drive 31 10.
  • the composite images stored within the memory 3106 or hard disk drive 31 10 at steps 3006 and 3008 may subsequently be transferred to any other storage media including computer readable storage media as defined above, including a compact disc (CD), a digital video disc (DVD), or the like.
  • the composite images may also be transmitted over the network 3120 to a remote server or the like, for example, connected to the network 3120, before being displayed on a suitable display device.
  • the composite images may also be. transmitted over conventional analog television networks or digital television networks in an analog or digital form, respectively, for display on any suitable display device.
  • the composite images stored within the memory or hard disk drive 3110 at steps 3006 and 3008 may subsequently be displayed in a sequential manner at a suitable frequency (e.g., greater than or equal to 180 hertz) on a suitable display means such as a cinema screen, a television screen, a computer display, a video set, a compact disc (CD) player, a digital video disc (DVD) player, and the like.
  • a suitable frequency e.g., greater than or equal to 180 hertz
  • the displayed sequence of images are seen by a viewer of the displayed images as three dimensional video images.
  • the composite images generated at steps 3006 and 3008 may be displayed (e.g., for a cinema audience) for a predetermined period of time (e.g., the length of a movie).
  • the method 3000 is described above with reference to a plurality of grid segments (e.g., as seen in FIG. 8), having a first position and a second position and composite images being determined based on such first and second positions.
  • the grid segments may be configured to have a plurality of grid positions for each of the images generated at step 3004.
  • the method 300 may be configured to move the grid segments across the front of each of the images of step 3004 in a similar manner to the grid means 2503 of the system 2500 which moves continuously in a single direction (e.g., from left to right) horizontally in front of the screen 1.
  • a composite image will be generated at step 3006 for each of the plurality of different grid positions resulting in a plurality of composite images for each of the images generated at step 3004.
  • a plurality of composite images will be generated at step 3008, with a composite image being generated for each of the different grid positions.
  • the plurality of composite images may then be transferred to any other storage media and/or displayed in a sequential manner at a suitable frequency on a suitable display device as described above.
  • Steps 3001 and 3002 have also been described where only one left and right angle of view of the subject are captured. However, in another implementation, a plurality of left and right angles of view of a subject are captured at steps 3001 and 3002 and the left and right angles would be processed in accordance with the method 3000, in a similar manner to the example of FIGS. 18 to 24.
  • the grid 3 is shown as being embodied into a housing or cover 9 in front of the screen 1, be it a screen of a television set, a cinema screen or the like.
  • Such an implementation allows the grid segments to be generated, for example, on a liquid crystal display, while the imagery including two or more spaced apart adjacent angles of view is displayed on the screen 1 behind the liquid crystal display.
  • the physical grid 3 may be replaced by generating and displaying images representing a virtual grid.
  • Such a virtual grid may comprise images of grid segments, similar to those used in the method 3000, being displayed on the screen 1 (e.g., of a television set or cinema screen) while the imagery including two or more spaced apart adjacent angles of view is being displayed on the screen 1 in an oscillating manner as described above.
  • the method 3000 may be implemented as one or more code modules of the software application 2733 resident in the storage module 2709 and being controlled in its execution by the processor 2705.
  • a digital projection camera projecting the imagery including two or more spaced apart adjacent angles of view displayed onto the screen 1 may also project a virtual grid comprising images of grid segments, similar to those used in the method 3000, onto the screen over the displayed imagery in order to produce three dimensional imagery in a similar manner to the images displayed in accordance with FIGS. 1, 2, and 25.
  • the arrangements described are applicable to the computer and data processing industries and particularly for producing three dimensional images. .

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

A system (2500) and method for producing three dimensional imagery are disclosed. The system (2500) comprises a screen (1) having a screen surface (2). The system (2500) also comprises a grid means (2503). The grid means (2503) may be configured to move continuously in a single direction (e.g., from left to right, or from right to left) in front of the screen (1) to provide a seamless progression of grid positions, in accordance with the disclosed methods.

Description

METHOD, SYSTEM AND APPARATUS FOR USE IN PRODUCING THREE
DIMENSIONAL IMAGERY
Technical Field of the Invention
The present invention relates to a method, system and apparatus for use in producing three-dimensional imagery. The present invention also relates to a computer program product including a computer readable medium having recorded thereon a computer program for producing three-dimensional imagery.
Background
Conventionally, three-dimensional imagery has been produced with means that present different aspects of objects to each eye and usually with filtered, polarised or oscillating imagery that can be observed through filtered, polarised and/or oscillating viewers or spectacles. Lenticular arrays, static or dynamic double vision strips and viewing slot arrangements also attempt a similar effect without the use of such viewers or spectacles.
The term "three-dimensional imagery" is an expression that has been in common use for many years. Since its first use, the meaning of the term has been extended to encompass a wide variety of depth enhancement imagery, as well as imagery that actually contains three visual dimensions, ^ithin the range of relevant methodologies, equipment and effects, there can be said to be two broad and general categories.
One of these categories involves imagery containing a single angle of view of an object. The other applies to images that simultaneously comprise two or more angles of view of essentially the same object.
Methods and apparatus that enable the presentation of two or more different angles of view of substantially the same objects simultaneously, are also referred to as three-dimensional. Usually, these arrangements present two spaced angles of view, acquired at distances of 21/4-21/2 inches apart with a common centre, by the use of methods and means that isolate left views to left eyes and right views to right eyes. Left and right view separated systems include spectacles, viewers and visors ranging in sophistication from (as indicated hereinbefore) simple filtered or polarised spectacles to liquid crystal visors synchronised to screen signals. Other techniques for keeping left and right angles of view visible only to the corresponding eye include view differentiating lenses, particularly lenticular arrays, and separated static right and left image strip arrangements.
In addition, holograms produce three-dimensional imagery containing multiple angles of view. Further, there are many combinations of these various systems.
However, despite the abundance of methods and techniques for enhancing image depth and producing imagery containing three visual dimensions, all have very limited application and have had limited commercial and practical success. In particular, none of the known systems are suitable for convenient and unrestricted adaptation, without forcing abnormal visual functions, to most imaging systems in general use. Such image systems in general include, for example, cinemas, video and computer display units, television screens and the wide variety of monitors used in every day life for functions ranging from medical investigations, to entertainment, to military surveillance.
Summar
It is an object of the present invention to substantially overcome, or at least ameliorate, one or more disadvantages of existing arrangements.
According to one aspect of the present disclosure there is provided a method of producing three dimensional imagery, said method comprising the steps of: a) displaying on a first screen two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery, one set acquired from an angle of view left of said common centre ("left acquired image segment set") and one set generated from an angle of view right of said common centre ("right acquired image segment set"), said image segments being displayed in an alternating pattern across the first screen without any dark bands interposed between the image segments such that only half of the image segments from the left acquired image segment set and half of the image segments from the right acquired image segment set are displayed in any one of two screen display positions;
b) placing a segmented grid formed by a series of alternate spaced apart slats and openings in front of the first screen between a focal point and the first screen such that the image on the first screen is observable from the focal point as separated and segmented, wherein the grid is of a size and shape which corresponds to the size of the image segments seen from the focal point and wherein the grid is movable between a first and a second grid position in which the slats and openings exchange positions;
c) setting the grid at a pre-determined distance from the first screen such that;
(i) when the grid is in a first position and the image segments are displayed on the first screen in a first screen display position, a first half of the image segments from the left acquired image segment set are displayed on the first screen and are observable through openings of said grid from the focal point and a first half of the image segments from the right acquired image segment set are displayed on the first screen and are observable from the focal point; and
(ii) when the grid is in a second position and the image segments are displayed on the first screen in a second screen display position, a second half of the segments from the left acquired image segment set are displayed on the first screen and are observable through openings of said grid from the focal point and a second half of the segments from the right acquired image segment set are displayed on the first screen and are observable from the focal point;
d) moving the grid at a predetermined speed in front of the first screen as the image segments are sequentially displayed on the first screen in their first and second screen display positions;
e) capturing a plurality of images of the displayed image segments through the openings of the grid as the grid is moved in front of the screen, where the plurality of images are captured from the focal point, such that upon the captured images subsequently being displayed on a second display screen, the grid is rendered invisible and an observer sees a whole coherent three dimensional image by the observer's left eye sequentially observing first and second halves of the left acquired image segment set and the observer's right eve sequentially observing first and second halves of the right acquired image segment set and wherein the whole coherent three dimensional image can be seen by the observer from any position within a wide arc in front of the second screen.
According to another aspect of the present disclosure there is provided a method of producing three dimensional imagery, said method comprising the steps of:
a) generating two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery, one set acquired from an angle of view left of said common centre ("left acquired image segment set") and one set generated from an angle of view right of said common centre ("right acquired image segment set"), said image segments being configured for display in an alternating pattern across a display screen without any dark bands interposed between the image segments such that only half of the image segments from the left acquired image segment set and half of the image segments from the right acquired image segment set are displayed in any one of two screen display positions;
b) generating a segmented grid image representing a grid comprising a series of alternate spaced apart opaque portions and transparent openings, wherein the grid is of a size and shape which corresponds to the size of the image segments viewed from a virtual focal point on the display screen;
c) compositing the grid image over each set of image segments separately in order to generate at least first and second composite images, the first composite image representing the grid in a first position where a first half of the image segments from the left acquired image segment set are observable through said openings from the virtual focal point and a first half of the image segments from the right acquired image segment set are observable through the openings from the virtual focal point, the second composite image representing the grid in a second position where a second half of the image segments from the left acquired image segment set are observable through said openings from the virtual focal point and a second half of the image segments from the right acquired image segment set are observable through the openings from the virtual focal point;
e) storing the composited images for subsequent display, such that when displayed the grid image is rendered invisible and an observer sees a whole coherent three dimensional image by the observer's left eye sequentially observing first and second halves of the left acquired image segment set and the observer's right eve sequentially observing first and second halves of the right acquired image segment set and wherein the whole coherent three dimensional image can be seen by the observer from any position within a wide arc in front of the display screen. According to still another aspect of the present disclosure there is provided a method of producing three dimensional imagery, said method comprising the steps of: a) displaying on a first screen two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery, one set acquired from an angle of view left of said common centre ("left acquired image segment set") and one set generated from an angle of view right of said common centre ("right acquired image segment set"), said image segments being displayed in an alternating pattern across the first screen without any dark bands interposed between the image segments such that only half of the image segments from the left acquired image segment set and half of the image segments from the right acquired image segment set are displayed in any one of two screen display positions;
b) placing a segmented grid formed by a series of alternate spaced apart slats and openings in front of the first screen between a focal point and the first screen such that the image on the First screen is observable from the focal point as separated and segmented, wherein the grid is of a size and shape which corresponds to the size of the image segments seen from the focal point and wherein the grid is movable between a first and a second grid position in which the slats and openings exchange positions;
c) setting the grid at a pre-determined distance from the first screen such that;
(i) when the grid is in a first position and the image segments are displayed on the first screen in a first screen display position, a first half of the image segments from the left acquired image segment set are displayed on the first screen and are observable through openings of said grid from the focal point and a first half of the image segments from the right acquired image segment set are displayed on the first screen and are observable from the focal point; and (ii) when the grid is in a second position and the image segments are displayed on the first screen in a second screen display position, a second half of ' the segments from the left acquired image segment set are displayed on the first screen and are observable through openings of said grid from the focal point and a second half of the segments from the right acquired image segment set are displayed on the first screen and are observable from the focal point;
d) synchronously oscillating the grid at a predetermined frequency between its first and second positions as the image segments are sequentially displayed on the first screen in their first and second screen display positions at that same predetermined frequency;
e) capturing a plurality of images of the displayed image segments through the openings of the grid as the grid is synchronously oscillating, where the plurality of images are captured from the focal point, such that upon the captured images subsequently being displayed on a second display screen the grid is rendered invisible and an observer sees a whole coherent three dimensional image by the observer's left eye sequentially observing first and second halves of the left acquired image segment set and the observer's right eve sequentially, observing first and second halves of the right acquired image segment set and wherein the whole coherent three dimensional image can be seen by the observer from any position within a wide arc in front of the second screen.
According to still another aspect of the present disclosure there is provided an apparatus for production of a coherent three dimensional image comprising:
a first screen on which is projected two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery; a segmented grid formed by a series of spaced apart slats and openings placed between a focal point and the first screen at a predetermined distance from the first screen such that the segmented grid creates an appearance of screen image segments in a first grid position;
wherein, first separated segments of imagery generated left of the common centre of said subject of said imagery are observable through openings of said grid, while second separated segments of imagery generated right of the common centre of said subject of said imagery are captured through the openings of the grid, the first and second separated segments of imagery alternating across the first screen without any dark bands interposed between image segments, such that a first half of the imagery is observable by the right and left eyes of an observer at a first position of the grid;
wherein both the grid and the position of the image segments are oscillated relative to one another and in a synchronous fashion at a predetermined frequency such that both the grid and the position of the image segments displayed move from said first position momentarily to a second position thence back to the first position whereupon when the grid is momentarily in said second position during said oscillation a second half of the whole image acquired left of the common centre which was previously not displayed at the first position is observable from the focal point, and a second half of the whole image acquired right of the common centre which was not displayed at the first position is observable from the focal point;
a camera for capturing a plurality of images of the displayed screen image segments through the openings of the grid, the plurality of images being captured from the focal point, such that by virtue of the oscillation of both the grid and the image segments at said predetermined frequency, upon the captured images subsequently being displayed on a second display screen, the grid is rendered invisible such that an observer sees a whole coherent three dimensional image by each eye alternately seeing a first half of the image, and then a second half of the image on the screen as the grid and the image segments move between the first and second positions and wherein the whole coherent three dimensional image can be observed from any point within a viewing room in front of the second screen and grid arrangement and is independent of the position of the observer in the viewing room.
According to still another aspect of the present disclosure there is provided a system for production of a coherent three dimensional image, said system comprising: a first screen on which is projected two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery;
a segmented grid formed by a series of spaced apart slats and openings placed between a focal point and the first screen at a predetermined distance from the first screen such that the segmented grid creates an appearance of screen image segments in a first grid position;
wherein, first separated segments of imagery generated left of the common centre of said subject of said imagery are observable through openings of said grid, while second separated segments of imagery generated right of the common centre of said subject of said imagery are captured through the openings of the grid, the first and second separated segments of imagery alternating across the first screen without any dark bands interposed between image segments, such that a first half of the imagery is observable by the right and left eyes of an observer at a first position of the grid; wherein both the grid and the position of the image segments are oscillated relative to one another and in a synchronous fashion at a predetermined frequency such that both the grid and the position of the image segments displayed move from said first position momentarily to a second position thence back to the first position whereupon when the grid is momentarily in said second position during said oscillation a second half of the whole image acquired left of the common centre which was previously not displayed at the first position is observable from the focal point, and a second half of the whole image acquired right of the common centre which was not displayed at the first position is observable from the focal point;
a camera for capturing a plurality of images of the displayed screen image segments through the openings of the grid, the plurality of images being captured from the focal point, such that by virtue of the oscillation of both the grid and the image segments at said predetermined frequency, upon the captured images subsequently being displayed on a second display screen, the grid is rendered invisible such that an observer sees a whole coherent three dimensional image by each eye alternately seeing a first half of the image, and then a second half of the image on the screen as the grid and the image segments move between the first and second positions and wherein the whole coherent three dimensional image can be observed from any point within a viewing room in front of the second screen and grid arrangement and is independent of the position of the observer in the viewing room.
According to still another aspect of the present disclosure there is provided an apparatus for producing three dimensional imagery, said apparatus comprising:
a first screen on which are displayed two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery, one set acquired from an angle of view left of said common centre ("left acquired image segment set") and one set generated from an angle of view right of said common centre ("right acquired image segment set"), said image segments being displayed in an alternating pattern across the first screen without any dark bands interposed between the image segments such that only half of the image segments from the left acquired image segment set and half of the image segments from the right acquired image segment set are displayed in any one of two screen display positions;
a segmented grid formed by a series of alternate spaced apart slats and openings placed in front of the first screen between a focal point and the first screen such that the image on the first screen is observable from the focal point as separated and segmented, wherein the grid is of a size and shape which corresponds to the size of the image segments seen from the focal point and wherein the grid is movable between a first and a second grid position in which the slats and openings exchange positions, wherein the grid is set at a pre-determined distance from the first screen such that;
(i) when the grid is in a first position and the image segments are displayed on the first screen in a first screen display position, a first half of the image segments from the left acquired image segment set are displayed on the first screen and are observable through openings of said grid from the focal point and a first half of the image segments from the right acquired image segment set are displayed on the first screen and are observable from the focal point; and
(ii) when the grid is in a second position and the image segments are displayed on the first screen in a second screen display position, a second half of the segments from the left acquired image segment set are displayed on the first screen and are observable through openings of said grid from the focal point and a second half of the segments from the right acquired image segment set are displayed on the first screen and are observable from the focal point;
wherein the grid is moved at a predetermined speed in front of the first screen as the image segments are sequentially displayed on the first screen in their first and second screen display positions at that same predetermined frequency; and
a camera for capturing a plurality of images of the displayed image segments through the openings of the grid as the grid is moved in front of the screen, where the plurality of images are captured from the focal point, such that upon the captured images subsequently being displayed on a second display screen, the grid is rendered invisible and an observer sees a whole coherent three dimensional image by the Observer's left eye sequentially observing first and second halves of the left acquired image segment set and the observer's right eve sequentially observing first and second halves of the right acquired image segment set and wherein the whole coherent three dimensional image can be seen by the observer from any position within a wide arc in front of the second screen.
According to still another aspect of the present disclosure there is provided a system for producing three dimensional imagery, said apparatus comprising:'
a first screen on which are displayed two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery, one set acquired from an angle of view left of said common centre ("left acquired image segment set") and one set generated from an angle of view right of said common centre ("right acquired image segment set"), said image segments being displayed in an alternating pattern across the first screen without any dark bands interposed between the image segments such that only half of the image segments from the left acquired image segment set and half of the image segments from the right acquired image segment set are displayed in any one of two screen display positions;
a segmented grid formed by a series of alternate spaced apart slats and openings placed in front of the first screen between a focal point and the first screen such that the image on the first screen is observable from the focal point as separated and segmented, wherein the grid is of a size and shape which corresponds to the size of the image segments seen from the focal point and wherein the grid is movable between a first and a second grid position in which the slats and openings exchange positions, wherein the grid is set at a pre-determined distance from the first screen such that;
(i) when the grid is in a first position and the image segments are displayed on the first screen in a first screen display position, a first half of the image segments from the left acquired image segment set are displayed on the first screen and are observable through openings of said grid from the focal point and a first half of the image segments from the right acquired image segment set are displayed on the first screen and are observable from the focal point; and
(ii) when the grid is in a second position and the image segments are displayed on the first screen in a second screen display position, a second half of the segments from the left acquired image segment set are displayed on the first screen and are observable through openings of said grid from the focal point and a second half of the segments from the right acquired image segment set are displayed on the first screen and are observable from the focal point; wherein the grid is moved at a predetermined speed in front of the first screen as the image segments are sequentially displayed on the first screen in their first and second screen display positions at that same predetermined frequency; and
a camera for capturing a plurality of images of the displayed image segments through the openings of the grid as the grid is moved in front of the screen, where the plurality of images are captured from the focal point, such that upon the captured images subsequently being displayed on a second display screen, the grid is rendered invisible and an observer sees a whole coherent three dimensional image by the observer's left eye sequentially observing first and second halves of the left acquired image segment set and the observer's right eve sequentially observing first and second halves of the right acquired image segment set and wherein the whole coherent three dimensional image can be seen by the observer from any position within a wide arc in front of the second screen.
According to still another aspect of the present disclosure there is provided a method of producing three dimensional imagery, said method comprising the steps of:
(a) displaying on a first screen four sets of image segments, each set of said image segments being generated from one of four spaced apart angles of view about a common centre, two sets acquired from an angle of view left of a common centre ("left acquired image segment sets") and two sets generated from an angle of view right of a common centre ("right acquired image segment sets"), said image segments being displayed in an alternating pattern across the first screen without any dark bands interposed between image segments, such that only one quarter of the total number of image segments of each of said four sets of image segments are displayed in any one of four screen display positions;
(b) placing a segmented grid formed by a series of alternate spaced apart slats and openings in front of the first screen between a focal point and the first screen such that the image on the first screen is observable from the focal point as separated and segmented, wherein the grid is of a size and shape which corresponds to the size of the image segments seen from the focal point and wherein the grid is movable between a first and second grid position in which the slats and openings exchange positions;
(c) setting the grid at a predetermined distance from the first screen such that:
(i) when the grid is in a first position and the image segments are displayed on the first screen in a first screen display position, a first quarter of the image segments from each of the two left acquired image segment sets are displayed on the first screen and are observable through openings of said grid from the focal point and a first quarter of the image segments from each of the two right acquired image segment sets are displayed on the first screen and are observable from the focal point;
(ii) when the grid is in a second position and the image segments are displayed on the first screen in a second screen display position, a second quarter of the image segments from each of the two left acquired image segment sets are displayed on the first screen and are observable through openings of said grid from the focal point and a second quarter of the image segments from each of the two right generated image segment sets are displayed on the first screen and are observable from the focal point;
(iii) when the grid returns to its first position and the image segments are displayed on the first screen in a third screen display position, a third quarter of the image segments from each of the two left generated image segment sets are displayed on the first screen and are observable from the focal point through openings of said grid and a third quarter of the image segments from each of the two right generated image segment sets are displayed on the first screen and are observable from the focal point; and ·
(iv) when the grid again moves to its second position and the image segments are displayed on the first screen in a fourth screen display position, a fourth quarter of the image segments from each of the two left generated image segment sets are displayed on the first screen and are observable through openings of said grid and a fourth quarter of the image segments from each of the two right generated image segment sets are displayed on the first screen and are observable from the focal point;
(d) synchronously oscillating the grid at a predetermined frequency between its first and second positions as the image segments are sequentially displayed on the first screen in their first, second, third and fourth screen display position at that same predetermined frequency; and
e) capturing a plurality of images of the displayed image segments through the openings of the grid as the grid is synchronously oscillating, where the plurality of images are captured from the focal point, such that upon the captured images subsequently being displayed on a second display screen, the grid is rendered invisible and an observer sees a whole coherent three dimensional image by the observer's left eye sequentially observing first, second, third and fourth quarters of the two left acquired image segment sets and the observer's right eye sequentially observing first, second, third and fourth quarters of the two right acquired image segment sets and wherein the whole coherent three dimensional image can be seen by the observer from any position within a wide arc in front of the second screen.
Other aspects of the invention are also disclosed. Brief Description of the Drawings
At least one embodiment of the present invention will now be described with reference to the drawings and appendices, in which:
FIG. 1 : is a diagrammatic plan view of a display screen and grid suitable for producing three dimensional imagery;
FIG. 2: is a diagrammatic plan view of a further display screen and grid suitable for producing three dimensional imagery;
FIG. 3 is a top-view of a chair showing a left viewpoint and a right viewpoint; FIG. 4 shows the six image segments LI to L6 showing the chair as seen from a left view L;
FIG. 5 shows the six image segments Rl to R6 showing the same chair as seen from a right view R;
FIG. 6 shows the interleaved left and right screen image segments in a first position;
FIG. 7 shows the interleaved left and right screen image segments in a second position;
FIG. 8 shows the actual positions of the grid segments half way in front of image segments on the screen shown in FIG. 6;
FIG. 9 is a plan view of two eyeballs viewing the screen through spaces in the grid;
FIG. 10 shows the grid segments in a first position as they would be seen by the left eye of a viewer;
FIG. 11 shows the grid segments in a second position as they would be seen by the left eye of a viewer; FIG. 12 shows the grid segments in a second position as they would be seen by the right eye of a viewer;
FIG. 13 shows the grid segments in a first position as they would be seen by the right eye of a viewer;
FIG. 14 shows the grid segments in a first position placed in front of the screen; showing image segments in a first position as seen by the left eye of a viewer;
FIG. 15 shows the grid segments in a second position placed in front of the screen showing image segments in a second position as seen by the left eye of a viewer;
FIG. 16 shows the grid segments in a second position placed in front of the screen showing image segments in a second position as seen by the right eye of a viewer;
FIG. 17 shows the grid segments in a first position placed in front of the screen showing image segments in a first position as seen by the right eye of a viewer;
FIG. 18 is a top-view of a chair showing two left viewpoints LA and LB and two right viewpoints RA and Rs;
FIG. 19 shows the 12 image segments L I -LA 12 acquired from left viewpoint
FIG. 20 shows the 12 image segments B I-LB 12 acquired from left viewpoint
Ls;
FIG. 21 shows the 12 image segments RA I -RA 1 acquired from right viewpoint R^;
FIG. 22 shows the 12 image segments RB \ -RB 12 acquired from right viewpoint FIG. 23 shows the 12 image segments spread evenly across a screen in a first position; FIG. 24 shows the 12 image segments spread evenly across a screen in a second position;
FIG. 25, shows a system for producing three dimensional images in accordance with a further implementation;
FIG. 26 is a plan view of two eyeballs viewing the screen of the system of FIG. 25 through openings in the grid of the system of FIGS. 1, 2 and 25;
FIGS. 27A and 27B collectively form a schematic block diagram representation of a digital camera upon which described arrangements can be practised;
FIG. 28 is a schematic flow diagram showing a method of producing three dimensional imagery using the system of FIG. 25;
FIG. 29 is a schematic flow diagram showing another method of producing three dimensional imagery using the system of Fig. 25, with the grid means of FIG. 1 or FIG. 2;
FIG. 30 is a schematic flow diagram showing another method of producing three dimensional imagery; and
FIGS. 31A and 3 IB form a schematic block diagram of a general purpose computer system upon which the method of FIG. 30 can be practiced.
Detailed Description including Best Mode
Where reference is made in any one or more of the accompanying drawings to steps and/or features, which have the same reference numerals, those steps and/or features have for the purposes of this description the same function(s) or operation(s), unless the contrary intention appears.
As described above, the present disclosure provides a method, system and an apparatus for producing imagery that may be displayed on a screen and viewed through an oscillating grid or virtual grid so that the imagery appears entirely in three physical dimensions.
The present disclosure provides improvements on earlier inventions. The improvements, combined together, produce three-dimensional imagery that is practical and commercially viable for many purposes for which it is desired.
A first improvement involves the presentation of three-dimensional imagery on a screen.
It has been a long held belief that it is not possible to present two, or more, angles of view acquired about a common centre of the same object on a screen, in which all elements of each image are fully in alignment, so that, together, the multiple adjacent angles of view appear as a single coherent three-dimensional image, with the exception of the extreme outer edges of the images.
It seems that there are two reasons for this belief. Firstly, because of a general presumption that, for people, three-dimensional imagery is primarily a function of the human eye span.
Secondly, because describing human vision in terms of solid geometry, demonstrates, necessarily, that either eye must see any identical point on a screen at a different position to the other eye, except the common centre.
In the first case there is no set standard at which the varying distances between the pupils of the human eyes are established as optimised, averaged, or otherwise laid down as generally appropriate for everyone to view three-dimensional imagery.
Despite this, it appears accepted widely that for the purposes of producing three- dimensional imagery, two-and-a-quarter to two-and-a-half inches of separation between image centres is required. Images acquired at this order of separation about a common centre cannot be presented on a screen so that they appear aligned completely ih three dimensions to the unaided eyes.
Further, because solid geometric depiction of human observations show that each eye must see the same point at a different position on a screen, it has been held to follow, therefore, that, except for the centre, no points of two, or more, adjacent images acquired from different angles around a common centre may be seen by both unaided eyes in the same position on a screen and, therefore aligned and in three dimensions.
For both these reasons, it seems to have been accepted generally for many years that two or more images of essentially the same object acquired adjacently, in a manner simulating human eye views, cannot be aligned on a screen and, consequently, may be seen in three dimensions only if the images are seen by the respective eyes quite separated so that neither eye can compare any part of the two views on a screen and thus observe two different images in the same position.
Human perception of three-dimensional imagery has been widely understood through this century, as the separate and separated viewing of two different angles of view of objects, viewed from positions spaced apart at a distance equivalent to the width of the pupils of the eyes, or about two-and-a-half inches.
The production of three-dimensional imagery has therefore followed this appreciation by presenting it mainly through view differentiating spectacles. This presentation of three-dimensional imagery with the requirement to wear appropriate viewers appears to be the main impediment to more widespread use of such imagery, due to public resistance to using such opticals. Other attempts, such as applying lenticular arrays to screens have different drawbacks, such as limited viewing area because of the requirement to keep the eyes at the lens focal centre.
Still more different solutions, like holographic approaches, are limited by cost considerations.
The long held belief that two or more adjacent angles of view cannot be aligned in three dimensions on a screen for observation by the unaided eyes is fundamentally flawed. The present disclosure provides improvements in technology that overcome the impediment of having to wear viewers to see three-dimensional imagery, or use techniques with equal or greater undesirabilities. The disclosed improvements significantly reduce and may eliminate eye strain caused by wearing such viewers.
In 1923, Demetre Daponte demonstrated that two adjacent angles of view, acquired with centres approximately two-and-half inches apart, could be aligned partially in three dimensions on a screen by alternatively dissolving each view in and out against the other.
Daponte's invention demonstrating this discovery was called "The Pulseometor". It comprised two discs of transparency graduated from complete to zero, rotating in opposite directions so that each angle of view projected through the discs fades and brightens in illumination in opposition to the other view.
Deponte's discovery and invention demonstrated only partial alignment of two images in three dimensions, and the proportion of the images so aligned was small, comprising less than one quarter of the horizontal length of the image.
Images comprising two, or more adjacent angles of view, can be aligned apparently completely in three dimensions on a screen, providing that the angle between the views and the distances between the foreground and background of the object are sufficiently small.
In practice, this angle of separation and the distance between the background and the foreground of the object is dependent upon the distance of the object centre; the total depth of field; type of lenses used; centres of focus; and vertical as well as horizontal alignment of the images.
Regardless of all these variables, the angle is always very small for objects closer than approximately forty (40) yards and the differences between both images difficult to discern; despite the physical separation of the image centres, high quality resolution equipment is essential.
As a guide it has been found that this angle of view is less than one quarter of a degree for objects at less than forty yards.
This very small angle of displacement can be increased in a flexible way that permits application to most conventional imagery equipment.
In essence this is accomplished by applying a system of variable separation to the two different images and altering the degree of separation as required.
Like other aspects of three-dimensional imagery, it has been known for more than a century that three-dimensional imagery can be produced by segmenting left and right angles of view of an object and arranging the strips on a flat surface separated by slats, or similar dividers, so that observers can position their eyes to have the left eyes seeing left image strips while the slats block the left eye views of the right image strips and the right eyes see the right image strips, while the slats block the right eye views of the left image strips. This well known arrangement produces a three-dimensional combination but is always limited by the degradation to the overall effect caused by the view differentiating slats.
Another approach was demonstrated by Francois Savoye in the early 1950's, when he produced and applied for a patent for his "Cyclostereoscope".
The cyclostereoscope is a further compression of parallax barriers and comprises a circular grid rotating about a screen on to which left and right adjacent angles of view were projected through the grid.
The concept, described by Savoye, envisaged transposing the approach of view separating visors, worn around the eyes of viewers, to a similarly functioning arrangement operating around the screen.
Savoye envisaged the grid, alternatively blocking each eye view of a different combination of strips of angles of view and the whole grid rotating to sequentially reveal all segments at a speed that would permit memory and vision to together perceive the strips combined as two whole images in three dimensions. This Savoye achieved partially and prescribed zoned seating arrangements to confine viewers to areas where three- dimensional views were optimised and views of two overlapping images minimised.
An improved grid viewing system is described below which overcomes zonal problems of the Savoye idea as well a dispensing with the limitations of a rotating, circular grid.
Images containing two, or more, adjacent angles of view acquired around a common centre of essentially the same object can be aligned in three complete, and coherent, dimensions, except the extreme outer edges, in increasing divergence of angle, with increasing separation between the different images, and the corresponding viewing eyes.
In practice, the images segmented and separated sequentially so that an equal number of equally sized and equally spaced images are presented on a screen. The presented image are then viewed through a vertical grid so that left eye views of image segments, positioned on screens right of image segments displaying right eye views, are separated from right eye views of image segments, positioned on screens left of left eye views, in increasing degrees of exclusion as the angles of divergence between the images increase.
As a guide, the system applied to two or adjacent angles of views acquired around a .common centre of an object, where each different viewpoint is horizontally separated from approximately a quarter of an inch to five inches for any two adjacent angles of view.
For extreme close-up views Or views beyond visual infinity, these positions will be lesser or greater.
To maintain this relationship in a way that overcomes the limitation of a rotating, circular grid, or the inertial forces of an oscillating mechanical grid, the grid system may be supplied by grids formed with a liquid crystal display synchronised with the segmentation of the imagery.
To produce a complete three-dimensional imagery and remove the appearance of grid lines degrading the imagery, the segmented and separated imagery, enhanced in separation by the grids, may be oscillated together in synchronisation so that their functions are maintained at a speed, for example in excess of fifty hertz. At such a speed, the segments merge into a complete, coherent, three dimensional image and the grid lines are oscillating too fast to be seen. This combination produces wide-zone three-dimensional imagery of any angle capable of human perception by widening or narrowing the grid lines, without inertial limitations, or incompatibility with almost all conventional equipment.
Three dimensional imagery has been conventionally created and viewed as what could be termed, "the two separate views" type. This can be done through spectacles, known means and apparatus and the like. Essentially however three-dimensional imagery
\
of the "two separate views" type involving separate right- and left-hand views and the sequential blocking off of these views, is not capable of producing visual realism as people are used to experiencing it. In other words, as the eyes normally communicate the views to the brain. Such three-dimensional imagery tends to be identifiable as imagery and thus unnatural. Further, there are other drawbacks with such known forms of three-dimensional imagery, including for example limitations on the angles from which imagery can be seen. Other drawbacks include incompatibility with conventional equipment, difficulties with transmission and broadcasting, substandard qualities, eye strain and lack of commercial viability and reality, as well as problems with many people who have abnormal vision.
For the purposes of the description and definition herein, it is generally believed that it can be said that the eye should in many cases be conceived as something of a dynamic sensor. The eyes of a human being generally see both horizontal and vertical planes substantially simultaneously, together with constantly varying fields of depth and focal points. This essential dynamic sensing, coupled with the memory, maintains impressions of infinitely variable views of everything seen by the eyes. It is generally believed that the mind is not given one clear left or one clear right view, but is continually given a range of different partial and adjacent images. These varying partial and adjacent images are combined by the mind or brain of a human being into a single coherent whole which has depth of image and which clearly appears in three dimensions.
It is also generally believed that the eyes of a human are rapidly and continuously scanning. As indicated, they do not, it is believed, continuously focus on one point, giving one right view and one left view. The eyes have a continuously changing field of view and both eyes are continuously shifting over varying points, one crossing over the other's field of view. Further, humans are often continuously moving their heads, and eye balls are often moving within their sockets. Thus, far from the mind or brain of a human having transmitted to it, two dissimilar changing views or photographs (one right and one left), that the mind or brain is receiving is continuous partial and adjacent, segmented and separated views of imagery.
It has also been a long held belief that the opticals using the principle of producing two distinct views to simulate the perceptions of three dimensions are limited by inherent restrictions. Such restrictions confine such systems and means to representations of three dimensions in single horizontal planes with fixed field depth and fixed focal length. It will be appreciated from the above that these are not realistic, and are perceived as such. In practice, such known systems are precluded from reproducing realistic three- dimensional imagery.
The present disclosure describes commercially viable methods and systems for producing three-dimensional imagery, by removing the necessity for wearing view differentiating spectacles and for, in some cases, using other intermediate opticals between the imagery and the observer.
The described methods and systems produce wide angle three-dimensional imagery, with comparatively little alteration and addition to existing technology, by containing about a common centre within each image, multiple, adjacent angles of view that are displayed partially and progressively across the screen, in apparent full alignment, as separated image segments, or as a combination of separated image segments, changing to cumulatively reveal the continuously varying spatial displacements between the segments of images on the screen and, at sufficient speed, as constant visual displacements between the subject elements of a steady, single, coherent and complete three-dimensional image.
The described methods and systems for producing three dimensional imagery also provide that the angles between the multiple views about a common centre of each image are such that the rapidly changing segments of images containing the angles produce an apparent constant visual displacement between the subject elements of the image, at the same time that the subject elements within the image appear to remain in alignment, so as to prevent or minimise the appearance of more than one image, or multiple imagery within any part of the image.
The term - "production" means acquisition, generation or construction for immediate display upon a screen, or immediate transmission for display, or immediate broadcasting for display. In addition, "production" may mean acquisition, generation, or construction for storage and later display, transmission, broadcasting or projection.
Equipment used for acquisition include analog still and video cameras, digital still and video cameras, cine cameras, holographic camera arrangements, or any device capable of acquiring imaging containing multiple, adjacent angles of view about a common centre in a manner such that the acquired imagery may be presented, separated and segmented for display so as to appear three-dimensional on a screen. Segmentation of the multiple adjacent angles of view about a common centre can take place as the imagery is acquired, within a camera-like system, a computing system or anywhere before display such as during, or as part of, film or image processing; storage input or retrieval; or editing; for the production of slides; film prints, ideo tapes, digital images, compact discs (CDs) or digital video discs (DVDs) for release; in transmission or broadcasting; or on reception.
In addition, appropriate segmented imagery may be manufactured in the generation of imagery, such as computer imagery or symbology, or in the production of caricatures. ,
By "image", a single whole image is meant such as contained by a slide; one frame of a film or digital video; one image on a video tape; an x-ray; a digital image or any other clearly definable view capable of being recorded, stored, transmitted, broadcast, displayed, projected, presented or generated to duplicate actual objects, symbols; or represent objects or symbols such as computer generated imagery or caricatures. In addition, by image or imagery, series of single images presenting the same view or continuation of a view are included.
. By display is meant projected, presented, illuminated or generated so as to be visible to the eye.
By screen is meant any surface upon which the imagery can be displayed, presented, projected or generated so that it becomes visible; or any volume in which imagery can be made to appear.
By alignment is meant that each imagery is registered apparently exactly upon any , other in size, shape, vertical and horizontal position, so that multiple images appear as differing only in the appearance of depth or dimensionality and never as more than one image, or more than one part of any image, necessarily the same shape, that is revealed progressively across the screen.
In practice the size of the segments will vary according to the medium used for acquisition or viewing.
The described methods for producing three dimensional imagery provide a method and arrangement, whereby imagery is recorded (or stored) in such a manner that realistic and commercially viable three-dimensional imagery may be subsequently, or substantially simultaneously, be shown on a display screen surface. The imagery may be recorded (or stored) on any appropriate media, such as film, tape, slides, computer readable media (as defined below) including portable and fixed hard drives, compact discs (CD), digital video discs (DVD), holograms and the like. In one form the imagery is recorded on media so that it can be subsequently shown such as in the cinema by way of slides or photographs, on a television, on a video set, on a compact disc (CD) player, a digital video disc (DVD) player, a computer display and the like. In further forms, means for recording the imagery, such as an analog or digital camera or cameras, are in the form of a camera or cameras which are themselves, or in conjunction with appropriate transmission means, able to immediately transmit the recorded imagery to means such as television sets and the like which will receive and show the recorded imagery on a screen surface. For example, television cameras used in outside broadcast units for television news, sporting events and the like may be used. These are by way of example only. Thus, it should be appreciated that the present disclosure relates to a method and arrangement for the recording of imagery for subsequent or substantially simultaneous viewing on a screen surface.
The methods and arrangements described herein require the provision of a lens or lens system, that allows for the recording or acquisition of two or more substantially adjacent, similarly sized angles of view of imagery or objects that are to be recorded. Generally, it is better to acquire or record a plurality of smaller adjacent angle views rather than a smaller number of larger angle views. It should however be appreciated that two or more differing angles of view be recorded in the one or more of the described methods.
In addition, the imagery is recorded for subsequent or simultaneous viewing so that at all times only partial and adjacent sections of each angle of view are acquired or recorded. As will be appreciated, this means that when the imagery is displayed, none of the multiple angles of view appear to the eyes completely at any one instant, but rather are revealed only as a sequence of segments, at a speed to the eye which merges the segments together at differing angles, so that when viewed, the recorded imagery is perceived by the eyes to have depth in imagery and to be in three dimensions; that is, in accordance with the normal working or operation of the eyes of a human.
In one form, the partial and adjacent angles of view are recorded in a nonsequential manner, by using the described apparatus and methods. The recording of such non-sequential adjacent and partial angles of view allows for such non-sequential adjacent and partial angles of view to be subsequently shown by means so as to be viewed with depth of imagery and in substantially three dimensions, by the eyes of a viewer.
The present disclosure provides that means be provided in association with the lens or camera, or in association with the recording of a multiple angle views, so that the imagery is recorded in a partial, adjacent and spaced apart manner. To that end, the described methods for producing three dimensional imagery require the provision of a grid, grid system, separator, angle of view interrupter, light or signal blocking mechanism, switch or process means, as a component or feature, essential to the recording of the imagery, so that the imagery as recorded, is recorded partially and from two or more spaced apart, adjacent angles of view.
The methods for producing three dimensional imagery are described with reference to the imagery being recorded from two spaced angles of view-one left angle and the other a right angle. This is however, by way of example only and it should be appreciated that the imagery can be recorded from two or more angles of view.
The means for use in recording partial and adjacent multiple angles of view can be separate from the recording means such as a camera or can be incorporated into the camera. Various implementations will be described hereinafter by way of example only and with reference to the accompanying drawings, but it should be appreciated that these are by way of example only. For example, a camera can have included into it appropriate means for causing the imagery to be partial and adjacent. Such a means may be in the form of, for example, an interrupter, such as a grid system which can be built into the camera but arranged so as to avoid interference with the shutter or scanning function. Further, any such arrangement should be timed to obviate as far as possible the production of lines, strobing, moire or other optical noise, distortion or image degradation.
It is however envisaged that in one form a camera can be an electronic or digital still or video camera which can be programmed so that it can record partial and adjacent angles of view of the article or articles being recorded. Such a camera can have a plurality of spaced lenses, or alternatively a plurality of such cameras can be utilised, the recorded imagery thereafter being mixed and processed.
In implementations where an interrupter or grid arrangement might be provided within the camera, such an arrangement can be provided before, within or behind the lens or in any position wherein it positively interrupts the acquisition or recording of imagery, through the lens, so that only partial and adjacent images are recorded on the media or recorded by the camera.
It is envisaged that when such an arrangement is incorporated into a camera, the grid or interrupter arrangement may be placed behind a lens, adjacent and as close as possible to the film plane. The grid or interrupter arrangement will be synchronised with the camera shutter or might replace the shutter or be incorporated into the film gate. The effect of the grid or interrupter is to segment recorded imagery.
Alternatively, the grid or interrupter may be placed in front of a lens or lenses. In this instance, the grid or shutter is configured to segment and separate recorded imagery, so that the grid or shutter is recorded in focus with the recorded imagery as a barrier. The barrier visibly segments and separates recorded imagery at slower than display speeds where the grid or shutter may be seen in operation. The barrier has a similar effect at . higher display speeds where the barrier cannot be seen.
In various implementations, where a plurality of angles of view have been acquired and recorded by films or electronically (or digitally), the recorded multiple angles of view may then be subsequently altered so as to include partial and adjacent angles of view, such as by known mechanical, electro-optical, electrical, or other means, such as for example segmentation mixes and the like.
It is further envisaged that media, such as film or tapes, with a programmed grid or pattern applied thereto, or gaps therein, may be used in a camera to simplify the recording componentry. In yet a further implementation, it is envisaged that display units presenting image interrupting patterns may be used to mix multiple angle views. For example, a liquid crystal display may be used that presented image segmenting lines or gaps traversing the display of the required speed, to form a dynamic optical grid. The described methods for producing three dimensional imagery will now be further described with reference to the accompanying drawings (as referred to hereinbefore).
In one implementation, the imagery is shown on a screen, as a result of being computer-generated or produced on a screen, or by being displayed on a screen by way of projection. In the accompanying drawings, by way of example only, the imagery is shown as being viewed through the grid means~(to be described further hereinafter).
As seen in Fig. 1, the screen 1 is shown as having a screen surface 2. A grid means 3 is also provided substantially in front of and spaced apart from said screen surface 2. The grid means 3 may be in the form of a liquid crystal display screen, which on operation generates a plurality of oscillating grid sections 4, through which the imagery can be viewed on the screen. Other forms of grids may be used if desired. For example, physical grids extending across the front of a screen, provided with a plurality of slots or openings 4 thereof of varying depth. It is however preferred that the grid means have a plurality of grid sections or openings therein. The grid means 3 may be in the form of a liquid crystal display screen or other appropriate electrical or chemical optical arrangement which provides physical separation of imagery.
The liquid crystal display screen is preferably arranged so that the grid 3 oscillates. In other implementations, grid means can move or oscillate by means of additional mechanisms or electric power means.
By way of example only and referring to FIG. 1 of the accompanying drawings, the grid 3 is shown as being separated forwardly from the screen surface 2 and one implementation is shown (diagrammatically) as being embodied into a housing or cover 9 in front of the screen 1. The screen 1 , may be a television set, a cinema screen or the like. In another implementation, as shown by way of example only with reference to FIG. 2 of the drawings, a plurality of spaced apart grid means 3 may be provided. The spaced apart grid means 3 form channel sections or slots 4 therebetween so that on oscillation or movement thereof, imagery on the screen surface 2 will be seen therethrough in three dimensions.
The screen 1 and spaced-apart grid means 3 can be located or housed in a housing 9 so as to be substantially integral. Alternatively, the screen 1 and spaced-apart grid means 3 may be separate one from the other.
It will be appreciated that at least the grid means 3 can be for example in the form of crystalline, liquid crystal or similarly functioning electro-optical materials.
For use, in forming an appropriate grid or surface, the materials may for example be inorganic compounds, such as gilenium arsenide; lithium niobate^ potassium dihydrogen phosphate; and barium borate; as well as organic compounds such as methyl nitroaniline and nitroamiriostilbene; also materials from electron donors, such as amino, methoxy, and hydroxy groups; and electron acceptor groups, such as nitro, cyanide, esther and nitroso groups; polymers; polyenes; and polydiacetglenes or any materials with electro-optical properties; light frequency changing properties; non-centrosymmetric molecular structure; or crystalline structures where anions have been completed replaced by electrons, such as in complex compounds, such as alklide, potassium hexamethyl hyxacyclen sodium. The elctro-optical material may be arranged in single pieces such as blocks, slabs or chips, or in a number of pieces, in large or small pieces of any shape, in films, in thin films, in solutions, in suspensions, sandwiched between other materials, such as glass, as mixtures with other electro-optical compounds, or as mixtures with other materials that are non-electro-optical compounds. Where, for example, the electro-optical materials of the grid are arranged in lines, rods, strips, slats, panels or filaments, these can be positioned in rows, in partial rows, staggered rows, in parallel, in parallel rows, in horizontal or vertical rows (or both) or in f intersecting rows. Further, the electro-optical materials may be of differing lengths and sizes and at different positions within the display.
As indicated, these are by way of example only and grids such as grids formed of any appropriate material with slots therein, adapted to oscillate or move in an appropriate manner, may be used to perform the described methods for producing three dimensional imagery.
In practice, the apparatus for producing a coherent three dimensional imagery
' works in the following way. The grid 3 which comprises alternate slats and openings is set at a predetermined distance from the screen 1 on which imagery is projected from two or more angles of view. When an observer sees the screen 1 through the openings in the grid the observer observes segments of the imagery commensurate in dimension with the size of the openings in the grid. The alternate slats at the same time block some segments of the imagery from view. Thus, alternately the observer sees with each eye only part of the whole image. In order to enable the observer to view three dimensional imagery, the grid 3 is oscillated at a predetermined frequency preferably within the range of 50 Hz to 450 Hz depending upon requirements such as screen and thus grid size. The screen thus during oscillation continuously moves between a first position and a second position. It is the movement of the screen from the first position to the second position which exposes the whole image to the observer albeit alternately and in accordance with the description below. When the grid is in the first position, the observer's left eye sees via the openings in the grid, half of a whole left image. At that position of the grid, half of the left image is blocked to the left eye. The right eye sees half of a whole right image but half of the right image is blocked to the right eye. When the grid is shifted momentarily to the second position before returning to the first position, the left eye of the observer sees that half of the left image which was blocked from view to the left eye when the grid was in the first position and no longer sees that remaining half of the left image which was visible to the left eye when the grid was in the first position. Also, when the grid is in to the second position, the right eye of the observer sees that half of the right image which was blocked to the right eye when the grid was in the first position and no longer sees that remaining half of the right image visible to the right eye right when the grid was in the first position. To avoid alternate obscuring of part of the image, the grid is oscillated at such speed that it appears invisible to the observer. This enables the viewing of coherent three dimensional imagery by alternate observation of part of the image when the grid is in the first position and the remaining part of the image when the grid is in the second position.
As both the grid and left and right image segments alternately appear in alternating displayed positions on the screen at each movement, no two different segments of imagery acquired right of segments of imagery acquired left of segments acquired for right and left eye views, respectively, are displayed in identical positions at any time. Also, no two segments of imagery acquired of right views for right eyes are displayed in the same position at any time. Thus, -the segmented images that the left and right eyes see alternately, are all seen in different positions.
As will be appreciated, in operation, the described methods for producing three dimensional imagery allow for the display of three-dimensional imagery and the viewing of three-dimensional imagery (be it generated, produced or projected) such as in the manner described and claimed. Thus, the imagery projected onto the screen or generated onto a screen or shown on a screen otherwise, involves displaying imagery on a screen. The displayed imagery includes two or more spaced apart adjacent angles of view about a common centre which are displayed and in a segmented and separated manner, substantially sequentially or alternately on a screen. The separated segments are viewed through sections of a grid, such as described with reference to FIGS. 1 and 2 of the accompanying drawings, which have sections or openings of a size and shape corresponding substantially to the dimensions of the segments of imagery displayed on the screen. The grid means 3 is placed at a distance from the screen 1, such that the segments of imagery acquired left of segments of images acquired right are seen through grid sections substantially by the right eye of a viewer. In this instance, whole image segments acquired right of image segments acquired left of image segments acquired right are seen through grid sections substantially through the left eye of a viewer.
The relationship between the left and right segments of imagery, relative to the grid and sections thereof is substantially maintained when the grid sections oscillate. This enables the imagery to be viewed through the oscillating grid, the oscillation being at a speed and in synchronisation with the display of the segments of imagery, such that the imagery appears to the eyes of a viewer (through said grid means) to be coherent, complete and in three dimensions. It has been found that this avoids flickering, whole or partial appearance of any individual angles of view and it has also been found that the grid sections, on oscillating, become substantially invisible as a substantially transparent window between the eyes of a viewer and the screen. The described methods for producing three dimensional imagery are based on a dynamic electro-optical arrangement as are many other prior known methods of producing three-dimensional imagery. Such prior methods have, however, fallen short of the mark.
The methods for producing three dimensional imagery described herein overcome the well known limitations inherent in grid systems.
In particular, the described methods for producing three dimensional imagery, display three dimensional imagery on a screen that can be seen by the unaided eyes from a large viewing arc. Limitations on the viewing arc are determined by the limitations of various display systems on which the imagery may be presented. Some of these systems have no limitations, such as films, while others are limited according to cost or inherent system function. There are, however, no limitations inherent in the improved grid viewing system described herein and current technical limitations are constantly being reduced by price reductions, higher equipment operation speeds and increases in viewing angles of components like liquid crystals.
If it can be appreciated that to display three dimensional imagery, of the type elaborated at length under the heading "BACKGROUND", it is required that at least two views be displayed. This means that two whole views, of the same size and shape, have to l
be displayed on the same screen at the same time, each of these views filling the screen. In other words, two different views, one for the left eye, one for the right eye, are displayed exactly on top of each other but are separated from each other through a viewing arrangement that permits the two completely superimposed pictures to be seen exclusively by each appropriate eye.
The way in which the two different pictures are presented to the left and right eyes involves the application of a dynamic grid, which can scan across the screen, oscillate across the screen, and may do so either vertically or at forty-five degree angles, switching from left and right of the vertical. The use of such grids has been known for at least three hundred years and they are generally called "parallax barriers".
When such grids are placed in front of a displaying screen, the grid forces the eyes to look through openings in the grid. In such an arrangement, two effects follow:
1. Because the eyes are in different positions in the head, each eye sees a different view through the grid because it is looking through the grid from a different position and from a different angle.
2. Because the grid is composed of open sections that can be looked through and grid segments that cannot be looked through, the grid segments will not only force both eyes to see different parts of whatever is displayed on the screen, the grid will also block different parts of whatever is displayed on the screen. Furthermore, because the grid sections are in different positions for each eye, the blocking effect will be different for each eye.
The grid arrangements described herein are used to separate the two views that appear on the display screen. For this to happen it is clear that if either the left or the right view was displayed at any one time and viewed through the grid then either eye would see only half of the total image displayed on the screen. This is because each eye can see through only half of the grid spaces at any one time.
If the grid is to be used to separate two different views, to each appropriate eye, then the following is required:
1. Views intended for the left eye are positioned on the screen behind the grid to be seen through the sections through which the left eye is not obstructed. 2. Views for the right eye are positioned oh the screen behind the grid to be seeri through the sections through which the right eye is not obstructed.
Such an arrangement will have two inevitable features:
1. Only half of either the right or left view can be displayed at any one time because only half of the grid is available to each eye at any one time.
2. Because the position of the eyes in the head see half of each view in separated positions through the grid, the left and right views seen through the grid will be seen in alternating positions through the grid as illustrated in FIG. 1.
For the complete view to be seen two different things happen:
1. The grid moves into a second position to allow the second halves of each view to be presented on the screen in another position where these second halves can be seen.
2. The second halves of the two views are presented on the screen in a different position from the first position. This second position corresponds to the second position of the grid so that left views are presented to left eyes and right views are presented to right eyes. (If the positions of the second halves of the two views did not reverse with the grid changing positions, then the left views would be seen by right eyes and right views by left eyes.)
In short, the described methods for producing three dimensional imagery involves a system which presents half of each view, extended right across the screen, in alternating positions. Each half view is seen through a grid to effect the required separation of appropriate views to appropriate eyes. Moving the grid gives a new viewing position for each eye which is the reverse of the previous viewing position so that the remaining two half views displayed on the screen must also be reversed in their alternating positions so as to match the reversed viewing positions. In other words: the alternating segments of left angles of view for left eyes and right angles of view for right eyes will alternate in synchronisation with the oscillation of the grid.
Precise alignment of the grid elements with the image segments is important to the effective separation of the left image segments to left eyes and right image segments to right eyes. As well as separating the image segments effectively to each eye, the alignment required to reveal the entire left and right images sequentially in two halves so as to display each picture completely to each eye.
This requirement to completely separate and completely reveal the two complete views can be difficult for known optical grid systems. Such difficulty occurs because it can be impossible in any two grid movements of some grid arrangements to obscure each view totally from the wrong eye and at the same time reveal each view totally to the correct eye. In practice, in such arrangements, to achieve complete separation, the grid can obscure more of each image than the grid reveals at each movement. In such an alignment, the grid cannot achieve full display of each image in any one cycle of two grid movements that combine two image halves in each view in alternating segments. Consequently, in one implementation, the grid segments are repositioned in another position and the images scanned in again from a different viewpoint that includes the parts of the imagery not seen in the first grid cycle. In practice this means the minimum cycle speed of the described system is 180 hertz to achieve a flicker free assemblage of two complete image views over four cycles.
In practice, the grid lines will be positioned in synchronisation with the image segments to block alternate image segments as shown in FIG. 2. The size of the grid elements and the relative size of the image segments can be varied, or alternated, as required for different viewing .positions as well as the position of the grid elements from the screen.
At all times the limitations of the system are constrained but only constrained by the speed of the alternative image segments alteration in synchronisation with the grid ^ oscillation.
An infinite number of grid positions, grid and image segment sizes may be displayed to an infinite number of viewing positions limited only by the speed of the system, to provide such viewing positions at a speed that does not product flicker and displays both images completely and separately at those positions.
More than two images may be displayed using any section of the image segments to display another angle of view.
The described methods for producing three dimensional imagery may be even further enhanced by the use of a number of the drawings appended hereto.
FIGS. 3-17 show the described methods when used to display images acquired from two viewpoints.
FIGS. 18-24 show the described methods when used to display images acquired from more than two viewpoints.
Looking firstly at FIG. 3, there is shown a chair (10) as seen from above. L represents a viewing position slightly to the left of a central point (17). R represents a viewing point slightly to the right of central point (17).
FIG. 4 shows the chair as it would be seen from viewpoint L. If the whole angle of view was displayed on a screen, in six segments, the screen would appear as shown in FIG. 4. To more readily identify the parts of the chair, its legs have been labelled as 11, 12, 13 and 14. Image segments LI to L6, acquired from point of view L will be referred to as "left image segments".
FIG. 5 shows the chair (10) as seen from viewing position R. If the whole angle of view was displayed on a screen, in six segments, the screen would appear as shown in FIG. 5. Image segments Rl to R6, acquired from point of view R will be referred to as "right image segments".
In accordance with the described methods for producing three dimensional imagery, image segments are displayed on the screen in a first position and then in a second position. FIG. 6 shows a screen in the first position with left and right image · segments interleaved with one another. FIG. 7 shows the screen displaying the left and right image segments in a second position.
When an LCD grid is placed in front of the screen, the LCD grid is aligned with the image segments on the screen in such a way that the left eye can only see left image segments positioned right of right image segments and the right eye can only see right image segments positioned left of left image segments. FIG. 8 shows the grid segments at a halfway position in front of the image segments on the screen shown in FIG. 6. (However, this is not how it appears to the eyes.)
FIG. 9 shows a plan view of the screen in a first position where the image segments are as shown in FIG. 6, and of a grid having grid segments GO, Gl . . . G7 placed between the screen and a viewer. The viewer has a left eye (15) and right eye (16). The position of the grid segments in relation to the viewer's eyes and the screen segments is such that the left eye (15) can only see left image segments LI and L3, and the right eye (16) can only see right image segments R2 and R4. This is by way of example only and, in practice, the left eye (15) would see a myriad of left image segments and the right eye (16) would see a myriad of right image segments.
FIG. 10 shows the grid segments in a first position as the grid segments would be seen by the left and right eyes of the viewer. When the grid segments are in a first position, the image segments are as shown in FIG. 6. The cross hatched segments indicate the grid segments that the viewer can not see through. Correspondingly, the unshaded segments are the grid segments that the viewer can see through.
FIG. 11 shows the grid segments in a second position as the grid segments would be seen by the left and right eyes of the viewer. When the grid segments are in a second position, the image segments are as shown in FIG. 7.
FIG. 12 shows the grid segments in a second position as the grid segments would be seen by the left and right eyes of the viewer.
FIG. 13 shows the grid segments in a first position as the grid segments would be seen by the left and right eyes of the viewer.
When the grid in a first position is placed in front of the screen showing the image segments in a first position, the left eye will see half of the left image segments. As seen in FIG. 14, the left eye can see part of the chair displayed in left image segments L3 and L5. The image segments displayed on the screen alternate to a second position at the same time as the grid changes to a second position. The left eye then sees part of the chair displayed in left image segments L2 and L4. This change from a first position to a second position of both the image segments and the grid segments occurs in a fraction of a second and the human brain merges these two images to form one complete image, as seen from left viewpoint L. Similarly, when the grid in a first position is placed in front of the screen showing image segments in a first position, the right eye will see part of the chair displayed in right image segments R2 and R6. This is shown in FIG. 16. A fraction of a second later, both the image segments and the grid segments move to their second position, and the right eye of the viewer then sees that part of the chair displayed in right image segments R3 and R5 in Fig. 17. This happens so quickly that the brain merges the two half right images to form a whole image, as seen from viewing position R.
It will therefore be appreciated that in the normal use the described methods enable an image obtained from a left viewing position to be completely and exclusively displayed to the left eye of the viewer. This occurs as both the image segments and the grid segments oscillate from their respective first positions to their respective second positions and back to their first positions again. Because of the physical separation of the eyes, the same movement of image segments and grid segments also enables an image obtained from a right viewing position to be completely and exclusively displayed to the right eye of a viewer.
When only two angles of view are being displayed on a screen, the described methods allow for the whole of each angle of view to be displayed to the viewer. Previous methods of displaying three-dimensional imagery have only ever displayed partial angles of view to each eye.
The described methods can also be used with more than two angles of view. For example, FIG. 18 shows the chair (10) as seen from above and shows two left viewing positions, LA and LB and two right viewing positions, R^ and R#.
FIG. 19 shows the 12 image segments L 1-Ls 12 acquired from left viewpoint FIG. 20 shows the 12 image segments LB I -LB 12 acquired from left viewpoint
Lfl.
FIG. 21 shows the 12 image segments RA I-RA 12 acquired from right viewpoint FIG. 22 shows the 12 image segments RB \ -RB 12 acquired from right viewpoint
R*.
In order to combine the image segments acquired from all four viewpoints, the left and right image segments need to be interleaved across the screen in a uniform manner.
FIG. 23 shows the twelve image segments spread evenly across a screen in a first position.
FIG. 24 shows the twelve image segments spread evenly across a screen in a second position.
It will be appreciated that when the image segments on the screen are in the first position and the grid segments (not shown) are in the first position, the left eye will see a quarter of the image segments acquired from viewpoint LA and a quarter of the image segments acquired from viewpoint Ls. *
At the same time, the right eye will see a quarter of the image segments acquired from viewpoint R and a quarter of the image segments acquired from viewpoint RB.
When the image segments on the screen are in the second position and the grid segments (not shown) are in the second position, the left eye will then see a second quarter of the image segments acquired from viewpoint L and a second quarter of the image segments acquired from viewpoint LB. At the same time, the right eye will see a second quarter of the image segments acquired from viewpoint and a second quarter of the image segments acquired from viewpoint RB.
In total, when images acquired from four angles of view are displayed, each eye will only ever see half of each angle of view in any one cycle. The described methods have significant advantages over the prior art in that it is able to display more than two angles of view, whereas most known systems can only display two angles of view.
FIG. 25 shows a system 2500 for producing three dimensional imagery in accordance with a further implementation. The system 2500 comprises the screen 1 having the screen surface 2 as seen in FIGS. 1 and 2. The system 2500 also comprises a grid means 2503. In one implementation, the system 2500 is an improved parallax barrier system.
The methods described above use an oscillating grid 3 (e.g., in the form of a liquid crystal display), where the grid segments 4 of the grid 3 oscillate between a first position as shown in Fig. 10 and a second position as shown in Fig. 11. Similarly, the grid means 2503 comprises a plurality of vertically orientated grid sections 2504 (e.g., as with the grid sections of FIGS. 10 and 11) which are the same as the grid sections 4. However, in the system 2500, the grid segments 2504 of the grid means 2503 may be smaller in size than the grid sections 4. Further, in the system 2500, the grid segments 2504 of the grid means 2503 move continuously in a single direction (e.g., from left to right, or from right to left) horizontally in front of the screen 1. In such an implementation, the grid segments 2504 of the grid 2503 essentially provide a seamless progression of an infinite number of grid positions. Such an implementation may be achieved through use of the grid 2503 in the form of a liquid crystal display. The liquid crystal display may be configured to simulate a cyclostereoscope or the like comprising grid sections 2504 moving continuously in a single direction in front of the screen 1.
Alternatively, the grid 2503 may be in the . form of a cyclostereoscope or a mechanical grid. Again, such a cyclostereoscope or mechanical grid is configured to move continuously in a single direction (e.g., from left to right, or from right to left) horizontally in front of the screen 1.
In still another alternative, the grid 2503 may be in the form of any suitable optical barrier configured to move continuously in a single direction (e.g., from left to right, or from right to left) horizontally in front of the screen 1.
In still another alternative, the grid means 2503 may be implemented using a parallax barrier.
The system 2500 also comprises a camera 2700. The camera 2700 is a digital video camera which will be described in detail below with reference to FIG. 27. However, the system 2500 may also use other acquisition means, as described above, including conventional analog film cameras, cine cameras, holographic camera arrangements, or any other suitable device. The camera 2501 may be used to capture and store video images of the three dimensional imagery produced in accordance with the methods described above. .
With reference to FIG. 26, the camera 2700 is positioned in front of the grid means 2503 at a focal point 2601, and the camera 2700 is configured, so that the grid means 2503 and any images displayed on the screen surface 2 are in focus to the camera 2700. As seen in FIG. 26, location of the focal point 2601 represents a point of intersection of a projection from the left segment LI through the left eye 15 of the viewer and a projection from the right segment R4 through the right eye 16 of the viewer. The focal point 2601 represents a point where first and second separated images (e.g., the screens of FIGS. 14 and 16) seen by the left eye 15 and right eye 16, respectively, of the viewer, through openings 2504 of the grid means 2503, align completely. For example, the focal point 2601 represents a point at which the screens of FIGS. 14 and 16 align.
It will be appreciated that there will be an infinite number of focal points suitable for positioning the camera 2700 depending on the position of viewers with respect to the screen 2. However, the position of the focal point 2601 is preferably selected as a closest focal point suitable for viewing the images displayed on the screen 2 through the grid means 2503. Positioning the camera 2700 at the focal point 2601 reduces any artefacts caused by interferences in light paths or signal incompatibilities. A method 2800 of producing three dimensional imagery using the system 2500 will be described below with reference to Fig. 28. The method 2800 will be described with reference to the example of FIGS. 3 to 18.
Figs. 27A and 27B collectively form a schematic block diagram of camera 2700 including embedded components, upon which one or more steps of the method 2800, and other methods, to be described are desirably practiced. The camera 2700 may be in the form a dedicated digital camera. Alternatively, the digital camera 2700 may be in the form of a mobile phone, smart phone or the like, in which processing resources are limited. Nevertheless, one or more steps of the method 2800 and other methods described herein may also be performed on higher-level devices such as desktop computers, server computers, and other such devices with significantly larger processing resources.
As seen in Fig. 27A, the camera 2700 comprises an embedded controller 2702. Accordingly, the camera 2700 may be referred to as an "embedded device." In the present example, the controller 2702 has a processing unit (or processor) 2705 which is bi- directionally coupled to an internal storage module 2709. The storage module 2709 may be formed from non-volatile semiconductor read only memory (ROM) 2760 and semiconductor random access memory (RAM) 2770, as seen in Fig. 27B. The RAM 2770 may be volatile, non-volatile or a combination of volatile and non-volatile memory.
The camera 2700 includes a display controller 2707, which is connected to a video display 2714, such as a liquid crystal display (LCD) panel or the like. The display controller 2707 is configured for displaying graphical images on the video display 2714 in accordance with instructions received from the embedded controller 2702, to which the display controller 2707 is connected.
The camera 2700 also includes user input devices 2713 which are typically formed by keys, a keypad or like controls. In some implementations, the user input devices 2713 may include a touch sensitive panel physically associated with the display 2714 to collectively form a touch-screen. Such a touch-screen may thus operate as one form of graphical user interface (GUI) as opposed to a prompt or menu driven GUI typically used with keypad-display combinations. Other forms of user input devices may also be used, such as a microphone (not illustrated) for voice commands or a joystick/thumb wheel (not illustrated) for ease of navigation about menus.
As seen in Fig. 27A, the camera 2700 also comprises a portable memory interface 2706, which is coupled to the processor 2705 via a connection 2719. The portable memory interface 2706 allows a complementary portable memory device 2725 to be coupled to the camera 2700 to act as a source or destination of data or to supplement the internal storage module 2709. Examples of such interfaces permit coupling with portable memory devices such as Universal Serial Bus (USB) memory devices, Secure Digital (SD) cards, Personal Computer Memory Card International Association (PCMIA) cards, optical disks and magnetic disks. The camera 2700 also has a communications interface 2708 to permit coupling of the device 2701 to a computer or communications network 2720 via a connection 2721. The connection 2721 may be wired or wireless. For example, the connection 2721 may be radio frequency or optical. An example of a wired connection includes Ethernet. Further, an example of wireless connection includes Bluetooth™ type local interconnection, Wi-Fi (including protocols based on the standards of the IEEE 802.11 family), Infrared Data Association (IrDa) and the like.
Typically, the camera 2700 is configured to perform some special function. The embedded controller 2702, possibly in conjunction with, further special function components 2710, is provided to perform that special function. For the digital video camera 2700, the components 2710 represent a lens, focus control and image sensor of the camera 2700. Where the camera 2700 is a portable device, the special function components 2710 may also represent a number of encoders and decoders of a type including Joint Photographic Experts Group (JPEG), (Moving Picture Experts Group) MPEG, MPEG-1 Audio Layer 3 (MP3), and the like.
One or more steps of the method 2800, and other methods described herein, may be implemented using the embedded controller 2702, where the processes of Figs. 28, 29 and 30 may be implemented as one or more software application programs 2733 executable within the embedded controller 2702. The camera 2700 of Fig. 27A implements one more steps of the described methods. In particular, with reference to Fig. 27B, one or more of the steps of the described methods are effected by instructions in the software 2733 that are carried out within the controller 2702. The software instructions may be formed as one or more code modules, each for performing one or more particular tasks. The software may also be divided into two separate parts, in which a first part and the corresponding code modules performs the described methods and a second part and the corresponding code modules manage a user interface between the first part and the user.
The software 2733 of the embedded controller 2702 is typically stored in the non- volatile ROM 2760 of the internal storage module 2709. The software 2733 stored in the ROM 2760 can be updated when required from a computer readable medium. The software 2733 can be loaded into and executed by the processor 2705. In some instances, the processor 2705 may execute software instructions that are located in RAM 2770. Software instructions may be loaded into the RAM 2770 by the processor 2705 initiating a copy of one or more code modules from ROM 2760 into RAM 2770. Alternatively, the software instructions of one or more code modules may be pre-installed in a non-volatile region of RAM 2770 by a manufacturer. After one or more code modules have been located in RAM 2770, the processor 2705 may execute software instructions of the one or more code modules.
The application program 2733 may be pre-installed and stored in the ROM 2760 by a manufacturer, prior to use of the camera 2700. However, in some instances, the application programs 2733 may be supplied to the user encoded on one or more CD-ROM (not shown) and read via the portable memory interface 2706 of Fig. 27A prior to storage in the internal storage module 2709 or in the portable memory 2725. In another alternative, the software application program 2733 may be read by the processor 2705 from the network 2720, or loaded into the controller 2702 or the portable storage medium 2725 from other computer readable media. Computer readable storage media refers to any non- transitory tangible storage medium that participates in providing instructions and/or data to the controller 2702 for execution and/or processing. Examples of such storage media include floppy disks, magnetic tape, CD-ROM, a hard disk drive, a ROM or integrated circuit, USB memory, a magneto-optical disk, flash memory, or a computer readable card such as a PCMCIA card and the like, whether or not such devices are internal or external of the device 2701. Examples of transitory or non-tangible computer readable transmission media that may also participate in the provision of software, application programs, instructions and/or data to the device 2701 include radio or infra-red transmission channels as well as a network connection to another computer or networked device, and the Internet or Intranets including e-mail transmissions and information recorded on Websites and the like. A computer readable medium having such software or computer program recorded on it is a computer program product.
The second part of the application programs 2733 and the corresponding code modules mentioned above may be executed to implement one or more graphical user interfaces (GUIs) to be rendered or otherwise represented upon the display 2714 of Fig. 27A. Through manipulation of the user input device 2713 (e.g., the keypad), a user of the device 2701 and the application programs 2733 may manipulate the interface in a functionally adaptable manner to provide controlling commands and/or input to the applications associated with the GUI(s). Other forms of functionally adaptable user interfaces may also be implemented, such as an audio interface utilizing speech prompts output via loudspeakers (not illustrated) and user voice commands input via the microphone (not illustrated).
Fig. 27B illustrates in detail the embedded controller 2702 having the processor
2705 for executing the application programs 2733 and the internal storage 2709. The internal storage 2709 comprises read only memory (ROM) 2760 and random access memory (RAM) 2770. The processor 2705 is able to execute the application programs 2733 stored in one or both of the connected memories 2760 and 2770. When the camera 2700 is initially powered up, a system program resident in the ROM 2760 is executed. The application program 2733 permanently stored in the ROM 2760 is sometimes referred to as "firmware". Execution of the firmware by the processor 2705 may fulfil various functions, including processor management, memory management, device management, storage management and user interface.
The processor 2705 typically includes a number of functional modules including a control unit (CU) 2751, an arithmetic logic unit (ALU) 2752 and a local or internal memory comprising a set of registers 2754 which typically contain atomic data elements 2756, 2757, along with internal buffer or cache memory 2755. One or more internal buses 2759 interconnect these functional modules. The processor 2705 typically also has one or more interfaces 2758 for communicating with external devices via system bus 2781, using a connection 2761.
The application program 2733 includes a sequence of instructions 2762 though 2763 that may include conditional branch and loop instructions. The program 2733 may also include data, which is used in execution of the program 2733. This data may be stored as part of the instruction or in a separate location 2764 within the ROM 2760 or RAM 2770.
In general, the processor 2705 is given a set of instructions, which are executed therein. This set of instructions may be organised into blocks, which perform specific tasks or handle specific events that occur in the camera 2700. Typically, the application program 2733 waits for events and subsequently executes the block of code associated with that event. Events may be triggered in response to input from a user, via the user input devices 2713 of Fig. 27 A, as detected by the processor 2705. Events may also be triggered in response to other sensors and interfaces in the camera 2700. The execution of a set of the instructions may require numeric variables to be read and modified. Such numeric variables are stored in the RAM 2770. The described methods use input variables 2771 that are stored in known locations 2772, 2773 in the memory 2770. The input variables 2771 are processed to produce output variables 2777 that are stored in known locations 2778, 2779 in the memory 2770. Intermediate variables 2774 may be stored in additional memory locations in locations 2775, 2776 of the memory 2770. Alternatively, some intermediate variables may only exist in the registers 2754 of the processor 2705.
The execution of a sequence of instructions is achieved in the processor 2705 by repeated application of a fetch-execute cycle. The control unit 2751 of the processor 2705 maintains a register called the program counter, which contains the address in ROM 2760 or RAM 2770 of the next instruction to be executed. At the start of the fetch execute cycle, the contents of the memory address indexed by the program counter is loaded into the control unit 2751. The instruction thus loaded controls the subsequent operation of the processor 2705, causing for example, data to be loaded from ROM memory 2760 into processor registers 2754, the contents of a register to be arithmetically combined with the contents of another register, the contents of a register to be written to the location stored in another register and so on. At the end of the fetch execute cycle the program counter is updated to point to the next instruction in the system program code. Depending on the instruction just executed this may involve incrementing the address contained in the program counter or loading the program counter with a new address in order to achieve a branch operation.
One or more steps or sub-processes in the processes of the methods described herein are associated with one or more segments of the application program 2733, and are performed by repeated execution of a fetch-execute cycle in the processor 2705 or similar programmatic operation of other independent processor blocks in the camera 2700.
The method 2800 of producing three dimensional imagery will now be described. As above, the method 2800 will be described with reference to the example of FIGS. 3 to 17. However, the method 2800 is equally applicable to the example of FIGS. 18 to 24, where a plurality of left and right viewpoints are used. One or more steps of the method 2800 may be implemented as code modules of the software application program 2733 resident within the storage module 2709 and being controlled in execution by the processor 2705.
The method 2800 begins at step 2801, where imagery including two (or more) spaced apart adjacent angles of view is displayed on the screen 2. The imagery may be projected onto the screen surface 2* generated onto the screen 2 or displayed on the screen 2 otherwise, in a segmented and separated manner, as described above, with reference to FIGS. 3 to 17. In accordance with the example of FIGS. 3 to 17, at step 2801, the screen of FIG. 6, with left image segments (i.e., L3 and L5) and right image segments (i.e., R2 and R4) interleaved with one another, is displayed on the screen surface 2. Following display of the screen of FIG. 6, the screen of FIG. 7, with left image segments (i.e., L2 and L4) and right image segments (i.e., Rl and R3) interleaved with one another, is displayed on the screen surface 2. The imagery (e.g., in the form of the screens of FIG. 6 and FIG. 7) is displayed on the screen surface 2 continuously in a sequential manner for a predetermined period of time in order to produce the three dimensional imagery.
In contrast to the methods described above, the imagery may be displayed on the screen surface 2 at any suitable cycle speed to achieve a flicker free assemblage of two complete image views over four cycles. The display of the imagery on the screen surface 2 may be stopped at any suitable time by a user, for example, at completion of the method 2800.
Then at step 2803, the vertically orientated grid segments (or openings) 2504 of the grid means 2503 are caused to move continuously in a single horizontal direction (e.g., from left to right, or right to left) in front of the screen 1. For example, the grid means 2503 in the form a liquid crystal display may be configured to cause grid sections 2504, similar to the openings 4, to move continuously in a single direction in front of the screen 1. Alternatively, the grid means 2503 may be in the form of a rotating circular grid (e.g., a cyclostereoscope) and may be caused to begin to rotate in a single direction in front of the screen 1 so that vertically orientated grid sections 2504 move in front of the screen 1. In still another alternative, the grid 2503 may be in the form of any suitable optical barrier configured to move continuously in a single direction (e.g., from left to right, or from right to left) horizontally in front of the screen 1.
The grid sections 2504 are moved in front of the screen 1 at such a speed that the opaque sections of the grid means 2503 appear invisible to the observer. Accordingly, as with the methods described above, when viewed through the grid sections 2504 the imagery displayed on the screen surface at steps 2801 will be seen as a sequence of three dimensional images.
The method 2800 continues at the next step 2805 where the processor 2705 initiates capture of, by the camera 2700 positioned at the focal point 2601, a sequence of video images of the imagery displayed on the screen surface 2, through the open grid segments 2504 of the grid means 2503. The camera 2501 may be configured to continuously capture images as the grid segments 2504 of the grid means 2503 move in front of the screen 1 , producing the essentially infinite number of grid positions. At one point of step 2805, an image of the screen of FIG. 6 will be captured by the camera 2501 through the grid segment (or openings) 2504 of the grid means 2503. The grid segments 2504 of the grid means 2503 may be at any particular position depending on when the image of the screen of FIG. 6 is captured. Similarly, at a following point of step 2805, an image of the screen of FIG. 7 will be captured by the camera 2501 through the grid segments (or openings) 2504 of the grid means 2503. Again, the grid segments 2504 of the grid means 2503 may be any particular position depending on when the image of the screen of FIG. 7 is captured.
As described above, the focal point 2601 at which the camera 2700 is positioned represents a point where first and second separated images (e.g., the screens of FIGS. 14 and 16) seen by the left eye 15 and right eye 16 of the viewer, align.
The images captured at step 2805 are stored within the storage module 2709. The images stored within the storage module 2709 at steps 2805 may subsequently be transferred to any other storage media including computer readable storage media (i.e., as defined above) including a compact disc (CD), a digital video disc (DVD), a portable hard disk drive or the like.
The continuously captured sequence of images stored at step 2805 may also be subsequently displayed in a sequential manner at a suitable frequency (e.g., greater than or equal to 180 hertz) on a suitable display means such as a cinema screen, a television screen, a computer display, a video set, a compact disc (CD) player, a digital video disc (DVD) player, and the like. The captured images may also be displayed at lower or higher frequencies than the frequencies of the grid or shutter frequencies depending on required acceptable flicker rates and commercial broadcast or other standards. When such a continuously captured sequence of images are subsequently displayed in a sequential manner at a suitable frequency, the displayed sequence of images are seen by a viewer of the displayed images as three dimensional video images.
The continuously captured sequence of images may be displayed (e.g., for a cinema audience) for a predetermined period of time (e.g., the length of a movie).
The images captured at step 2805 may also be transmitted over conventional analog television networks or digital television networks in an analog or digital form, respectively, for display on a suitable display device. The captured images may also be transmitted over the network 2720 to a remote server, for example, before being displayed on a suitable display device. The images captured at step 2805 may be transmitted over the televisional networks and/or the network 2720 at any suitable frequency (or speed) according to the frequency or speed of the networks.
Another method 2900 of producing three dimensional imagery will now be described with reference to FIG. 29. As above, the method 2900 will be described with reference to the example of FIGS. 3 to 17. However, the method 2900 is equally applicable to the example of FIGS. 18 to 24. One or more steps of the method 2900 may be implemented as code modules of the software application program 2733 resident within the storage module 2709 and being controlled in its execution by the processor 2705.
In contrast to the method 2800, the method 2900 uses the screen 1 and grid means 3 of FIGS. 1 and 2 where the grid segments 4 of the grid means 3 are oscillated between the first position as seen in FIG. 10 and the second position as seen in FIG. 11. In the method 2900, the digital video camera 2700 is again positioned at the focal point 2601, as seen in FIG. 26, in front of the screen 1.
The method 2900 begins at step 2901, where imagery including two (or more) spaced apart adjacent angles of view are displayed on the screen surface 2. Again, the imagery may be projected onto the screen surface 2, generated onto the screen 2 or displayed on the screen 2 otherwise, in a segmented and separated manner, as described above. In accordance with the example of FIGS. 3 to 17, at step 2901, the screen of FIG. 6, with left (i.e., L3 and L5) and right image segments (i.e., R2 and R4) image segments interleaved with one another, is displayed on the screen surface 2. The minimum cycle speed of the imagery displayed on the screen surface 2 is one hundred and eighty (180) hertz to achieve a flicker free assemblage of two complete image views over four cycles.
Then at step 2903, the processor 2705 initiates capture of an image of the screen of Fig. 6, by the camera 2700, through the grid segments 4 of the grid means 3. The image is captured at step 2903 while the grid segments 4 of the grid 3 are in the first position shown in Fig. 10. The image captured at step 2903 is stored within the storage module 2709.
At the next step 2905, further imagery including two (or more) spaced apart adjacent angles of view is displayed on the screen surface 2. Again, the further imagery ma be projected onto the screen surface 2, generated onto the screen 2 or displayed on the screen 2 otherwise, in a segmented and separated manner, as described above. In accordance with the example of FIGS. 3 to 17, at step 2905, the screen of FIG. 7, with left and right image segments interleaved with one another, is displayed on the screen surface 2. - Then at step 2907, the processor 2705 initiates capture of an image of the screen of Fig. 7, by the camera 2700, through the grid segments 4 of the grid means 3. The image is captured at step 2907 while the grid segments 4 of the grid means 3 are in the second position as shown in Fig. 1 1. The image captured at step 2907 is stored within the storage module 2709; At step 2909, if the processor 2705 determines that more images are required to be captured, then the method 2900 returns to step 2901. Otherwise, the method 2900 concludes.
The images stored within the storage module 2709 at steps 2903 and 2907 may subsequently be transferred to any other storage media including computer readable storage media as defined above, including a compact disc (CD), a digital video disc (DVD), a portable hard disk drive or the like. The images stored within the storage module 2709 at steps 2903 and 2907 may subsequently be displayed in a sequential manner at a suitable frequency (e.g., greater than or equal to 180 hertz) on a suitable display means such as a cinema screen, a television screen, a computer display, a video set, a compact disc (CD) player, a digital video disc (DVD) player, and the like.
When the images captured at steps 2903 and 2907 are subsequently displayed in a sequential manner at a suitable frequency (e.g., greater than or equal to 180 hertz), the displayed sequence of images are seen by a viewer of the displayed images as three dimensional video images as with the methods described above, including the method 2800. The images captured at steps 2903 and 2907 may be displayed (e.g., for a cinema audience) for a predetermined period of time (e.g., the length of a movie).
As described above, the camera 2700 is positioned at the focal point 2601 so as to continuously capture and record (or store) imagery produced by the system 2500. The images displayed on the screen surface 2 are captured by the camera 2 through the open grid segments 2504. The images may be displayed on the screen surface 2, in a segmented and separated manner, at any required display frequency. Further, the grid 2503 may be moved or oscillated at any required frequency. Accordingly, three-dimensional imagery may be produced by the system 2500, based on the displayed images, at any required frequency.
As described above, the separated and segmented images are aligned (or combined) at the focal point 2601 to form complete, aligned images. The camera 2700 is configured so that the images displayed on the screen surface 2, as well as the grid means 2503, are in focus to the camera 2700, as the displayed images are being captured by the camera 2700 through the grid segments 2504. The camera 2700 is also configured so that any other image segmenting and separating barrier or like device positioned between a recording plane of the camera 2700 and an image plane of the screen surface 2, is also in focus to the camera 2700, as the images are being captured by the camera 2700.
The images captured in accordance with the methods 2800 and 2900 may also be transmitted over conventional analog television networks or digital television networks in an analog or digital form, respectively, for display on the suitable display devices. The captured images may also be transmitted over the network 2720 to a remote server, for example, before being displayed on a suitable display device. The images captured in accordance with the methods 2800 and 2900 may be transmitted over the televisional networks and/or the network 2720 at any suitable frequency (or speed) according to the frequency or speed of the networks.
The system 2500 implementing the methods 2800 and 2900 provides a number of advantages over conventional systems and methods for producing three dimensional imagery. The display of two separated images captured from a single viewing point (i.e., the focal point 2601) permits the display of two images (e.g., the screens of FIGS. 14 and 16) at the same time and exactly aligned avoiding many limitations of conventional systems and methods of producing three dimensional imagery. In particular, the images captured by the camera 2700 may be subsequently viewed at any normal viewing position in front of the display device upon which the captured images are subsequently displayed, including the cinema screen, television, computer display, video set, compact disc (CD) player, digital video disc (DVD) player, and the like.
The system 2500 and methods 2800, 2900 also effectively eliminate the doubling of transmission and screen operating rates that is required to display two images at equivalents to avoid substandard and unacceptable image flicker. The images captured by the camera 2700 may be subsequently viewed on display devices including the cinema screen, television, computer display, video set, compact disc (CD) player, digital video disc (DVD) player, and the like, without modifications or additions to the display devices. The display devices may also be of any particular size. The system 2500 also allows dimensions of image content components to be increased over such conventional methods.
The system 2500 used with a grid means 2503 in the form of a liquid crystal display also eliminates the requirement for components like parallax barriers and barriers of lens arrays together with supporting electronics, which reduces the cost of producing three dimensional imagery over conventional methods.
The three dimensional imagery produced using either of the methods 2800 and 2900 and displayed on a suitable display means, replicates normal dimensional perception three times more closely than all conventional three dimensional display methods, except holograms. The three dimensional imagery produced using either of the methods 2800 and 2900 also displays imagery more closely replicating normal sight than conventional flat images seen on conventional flat screen display devices.
Further, the three dimensional imagery produced using either of the methods 2800 and 2900 and displayed on a suitable display means substantially reduces the well known eye strain inherent in other conventional three dimensional display systems. The methods 2800 and 2900 also allow three dimensional images of objects not previously generated as three dimensional images, such as printed words and computer text, to be displayed as three dimensional images.
The method 2800 provides a seamless progression of separated grid positions for three dimensional images. The seamless progression of separated grid positions eliminates the inherent dependence of grid barrier devices on displaying multiples of two image segments combined with two barrier positions at high operation speeds.
Another method 3000 of producing three dimensional imagery will be described below with reference to FIG. 30. As above, the method 3000 will be described with reference to the example of FIGS. 3 to 17. However, the method 3000 is equally applicable to the example of FIGS. 18 to 24, where multiple image viewpoints are used.
In contrast to the method 2800 and 2900, the method 3000 does not use any physical grid means such as the grid means 3 of FIGS. 1 and 2. In the method 3000, the three dimensional imagery is generated as a sequence of composite images. One or more steps of the method 3000 may be implemented on a general-purpose computer system 3100 as seen in FIGS. 31A and 31B.
As seen in Fig. 31 A, the computer system 3100 includes: a computer module 3101 ; input devices such as a keyboard 3102, a mouse pointer device 3103,. a scanner 3126, a camera 3127, and a microphone 3180; and output devices including a printer 3115, a display device 3114 and loudspeakers 3117. An external Modulator- Demodulator (Modem) transceiver device 31 16 may be used by the computer module 3101 for communicating to and from a communications network 3120 via a connection 3121. The communications network 3120 may be a wide-area network (WAN), such as the Internet, a cellular telecommunications network, or a private WAN. Where the connection 3121 is a telephone line, the modem 3116 may be a traditional "dial-up" modem. Alternatively, where the connection 3121 is a high capacity (e.g., cable) connection, the modem 3116 may be a broadband modem. A wireless modem may also be used for wireless connection to the communications network 3120.
The computer module 3101 typically includes at least one processor unit 3105, and a memory unit 3106. For example, the memory unit 3106 may have semiconductor random access memory (RAM) and semiconductor read only memory (ROM). The computer module 3101 also includes an number of input/output (I/O) interfaces including: an audio-video interface 3107 that couples to the video display 3114, loudspeakers 31 17 - and microphone 3180; an I/O interface 31 13 that couples to the keyboard 3102, mouse 3103, scanner 3126, camera 3127 and optionally a joystick or other human interface device (not illustrated); and an interface 3108 for the external modem 31 16 and printer 3115. In some implementations, the modem 3116 may be incorporated within the computer module 3101, for example within the interface 3108. The computer module 3101 also has a local network interface 3111, which permits coupling of the computer system 3100 via a connection 3123 to a local-area communications network 3122, known as a Local Area Network (LAN). As illustrated in Fig. 31 A, the local communications network 3122 may also couple to the wide network 3120 via a connection 3124, which would typically include a so-called "firewall" device or device of similar functionality. The local network interface 3111 may comprise an Ethernet circuit card, a Bluetooth wireless arrangement or an IEEE 802.11 wireless arrangement; however, numerous other types of interfaces may be practiced for the interface 31 1 1. The I/O interfaces 3108 and 3113 may afford either or both of serial and parallel connectivity, the former typically being implemented according to the Universal Serial Bus (USB) standards and having corresponding USB connectors (not illustrated). Storage devices 3109 are provided and typically include a hard disk drive (HDD) 3110. Other storage devices such as a floppy disk drive and a magnetic tape drive (not illustrated) may also be used. An optical disk drive 3112 is typically provided to act as a non- volatile source of data. Portable memory devices, such optical disks (e.g., CD-ROM, DVD, Blu-ray Disc™), USB-RAM, portable, external hard drives, and floppy disks, for example, may be used as appropriate sources of data to the system 3100.
The components 3105 to 3113 of the computer module 3101 typically communicate via an interconnected bus 3104 and in a manner that results in a conventional mode of operation of the computer system 3100 known to those in the relevant art. For example, the processor 3105 is coupled to the system bus 3104 using a connection 31 18. Likewise, the memory 3106 and optical disk drive 3112 are coupled to the system bus 3104 by connections 3119. Examples of computers on which the described arrangements can be practised include IBM-PC's and compatibles, Sun Sparcstations, Apple Mac™ or a like computer systems.
The method 3000 may be implemented using the computer system 3100 wherein the processes of Fig. 30, to be described, may be implemented as one or more software application programs 3133 executable within the computer system 3100. In particular, the steps of the method 3000 are effected by instructions 3131 (see Fig. 3 IB) in the software 3133 that are carried out within the computer system 3100. The software instructions 3131 may be formed as one or more code modules, each for performing one or more particular tasks. The software may also be divided into two separate parts, in which a first part and the corresponding code modules performs the method 3000 and a second part and the corresponding code modules manage a user interface between the first part and the user.
The software may be stored in a computer readable medium, including the storage devices described below, for example. The software is loaded into the computer system 3100 from the computer readable medium, and then executed by the computer system 3100. The use of the computer program product in the computer system 3100 preferably effects an advantageous apparatus for implementing the method 3000.
The software 3133 is typically stored in the HDD 3110 or the memory 3106. The software is loaded into the computer system 3100 from a computer readable medium, and executed by the computer system 3100. Thus, for example, the software 3133 may be stored on an optically readable disk storage medium (e.g., CD-ROM) 3125 that is read by the optical disk drive 31 12.
In some instances, the application programs 3133 may be supplied to the user encoded on one or more CD-ROMs 3125 and read via the corresponding drive 31 12, or alternatively may be read by the user from the networks 3120 or 3122. Still further, the software can also be loaded into the computer system 3100 from other computer readable media.
Again, the second part of the application programs 3133 and the corresponding code modules mentioned above may be executed to implement one Or more graphical user interfaces (GUIs) to be rendered or otherwise represented upon the display 3114. Through manipulation of typically the keyboard 3102 and the mouse 3103, a user of the computer system 3100 and the application may manipulate the interface in a functionally adaptable manner to provide controlling commands and/or input to the applications associated with the GUI(s). Other forms of functionally adaptable user interfaces may also be implemented, such as an audio interface utilizing speech prompts output via the loudspeakers 3117 and user voice commands input via the microphone 3180.
.Fig. 31B is a detailed schematic block diagram of the processor 3105 and a "memory" 3134. The memory 3134 represents a logical aggregation of all the memory modules (including the HDD 3109 and semiconductor memory 3106) that can be accessed by the computer module 3101 in Fig. 31 A.
When the computer module 3101 is initially powered up, a power-on self-test (POST) program 3150 executes. The POST program 3150 is typically stored in a ROM 3149 of the semiconductor memory 3106 of Fig. 31 A. A hardware device such as the ROM 3149 storing software is sometimes referred to as firmware. The POST program 3150 examines hardware within the computer module 3101 to ensure proper functioning and typically checks the processor 3105, the memory 3134 (3109, 3106), and a basic input-output systems software (BIOS) module 3151, also typically stored in the ROM 3149, for correct operation. Once the POST program 3150 has run successfully, the BIOS 3151 activates the hard disk drive 3110 of Fig. 31 A. Activation of the hard disk drive 31 10 causes a bootstrap loader program 3152 that is resident on the hard disk drive 31 10 to execute via the processor 3105. This loads an operating system 3153 into the RAM memory 3106, upon which the operating system 3153 commences operation. The operating system 3153 is a system level application, executable by the processor 3105, to fulfil various high level functions, including processor management, memory management, device management, storage management, software application interface, and generic user interface.
The operating system 3153 manages the memory 3134 (3109, 3106) to ensure that each process or application running on the computer module 3101 has sufficient memory in which to execute without colliding with memory allocated to another process. Furthermore, the different types of memory available in the system 3100 of Fig. 31 A must be used properly so that each process can run effectively. Accordingly, the aggregated memory 3134 is not intended to illustrate how particular segments of memory are allocated (unless otherwise stated), but rather to provide a general view of the memory accessible by the computer system 3100 and how such is used.
As shown in Fig. 3 IB, the processor 3105 includes a number of functional modules including a control unit 3139, an arithmetic logic unit (ALU) 3140, and a local or internal memory 3148, sometimes called a cache memory. The cache memory 3148 typically include a number of storage registers 3144 - 3146 in a register section. One or more internal busses 3141 functionally interconnect these functional modules. The processor 3105 typically also has one or more interfaces 3142 for communicating with external devices via the system bus 3104, using a connection 31 18. The memory 3134 is coupled to the bus 3104 using a connection 3119. "
The application program 3133 includes a sequence of instructions 3131 that may include conditional branch and loop instructions. The program 3133 may also include data 3132 which is used in execution of the program 3133. The "instructions 3131 and the data 3132 are stored in memory locations 3128, 3129, 3130 and 3135, 3136, 3137, respectively. Depending upon the relative size of the instructions 3131 and the memory locations 3128-3130, a particular instruction may be stored in a single memory location as depicted by the instruction shown in the memory location 3130. Alternately, an instruction may be segmented into a number of parts each of which is stored in a separate memory location, as depicted by the instruction segments shown in the memory locations 3128 and 3129. In general, the processor 3105 is given a set of instructions which are executed therein. The processor 1105 waits for a subsequent input, to which the processor 3105 reacts to by executing another set of instructions. Each input may be provided from one or more of a number of sources, including data generated by one or more of the input devices 3102, 3103, data received from an external source across one of the networks 3120, 3102, data retrieved from one of the storage devices 3106, 3109 or data retrieved from a storage medium 3125 inserted into the corresponding reader 31 12, all depicted in Fig. 31 A. The execution of a set of the instructions may in some cases result in output of data. Execution may also involve storing data or variables to the memory 3134.
The method 3000 uses input variables 3154, which are stored in the memory 3134 in corresponding memory locations 3155, 3156, 3157. The method 3000 produces output variables 3161, which are stored in the memory 3134 in corresponding memory locations 3162, 3163, 3164. Intermediate variables 3158 may be stored in memory locations 3159, 3160, 3166 and 3167.
Referring to the processor 3105 of Fig. 31B, the registers 3144, 3145, 3146, the arithmetic logic unit (ALU) 3140, and the control unit 3139 work together to perform sequences of micro-operations needed to perform "fetch, decode, and execute" cycles for every instruction in the instruction set making up the program 3133. Each fetch, decode, and execute cycle comprises:
(a) a fetch operation, which fetches or reads an instruction 3131 from a memory location 3128, 3129, 3130;
(b) a decode operation in which the control unit 3139 determines which instruction has been fetched; and (c) an execute operation in which the control unit 3139 and/or the ALU 3140 execute the instruction.
Thereafter, a further fetch, decode, and execute cycle for the next instruction may be executed. Similarly, a store cycle may be performed by which the control unit 3139 stores or writes a value to a memory location 3132.
Each step or sub-process in the processes of FIG. 30 is associated with one or more segments of the program 3133 and is performed by the register section 3144, 3145, 3147, the ALU 3140, and the control unit 3139 in the processor 3105 working together to perform the fetch, decode, and execute cycles for every instruction in the instruction set for the noted segments of the program 3133.
The method 3000 may alternatively be implemented in dedicated hardware such as one or more integrated circuits performing the functions or sub functions of the method 3000. Such dedicated hardware may include graphic processors, digital signal processors, or one or more microprocessors and associated memories. In another alternative, the method 3000 may be implemented as one or more code modules of the software application 2733 resident in the storage module 2709 and being controlled in its execution by the processor 2705.
The method 3000 will be described with reference to the example of FIGS. 3 to 17. However, the method 3000 is equally applicable to the example of FIGS. 18 to 24, where multiple left and right viewpoints are generated.
The method begins at step 3001 , where the processor 3105 accesses an image of a subject or scene captured from an angle of view left of a common centre. The image may be accessed from the memory 3106 or the hard disk drive 3110. The image may be captured (or acquired) using the camera 2700, for example, and be stored in the memory 3106 or hard disk drive 31 10 prior, to execution of the method 3000. In accordance with the present example, the image of the chair as it would be seen from viewpoint L, as seen in FIG. 4, is accessed by the processor 3105 at step 3001.
At the next step 3002, the processor 3105 accesses an image of a subject or scene captured from an angle of view right of the common centre. Again, the image may be accessed from the memory 3106 or the hard disk drive 3110. The image accessed at step 3002 may be captured using the camera 2700, for example, and be stored in the memory 3106 or hard disk drive 3110 prior to execution of the method 3000. In accordance with the present example, the image of the chair as it would be seen from viewpoint R, as seen in FIG. 5, is accessed by the processor 3105 at step 3002.
Then at the next step 3003, the processor 3105 generates two sets of image segments from the images accessed at steps 3001 and 3002. The sets of image segments may be stored in the memory 3106 or the hard disk drive 31 10. The size of each of the image segments is determined according to the size of a display screen upon which the image segments will subsequently be displayed and a viewing position of a viewer. As described herein, the viewing position of the viewer is taken to be a first focal point such as the focal point 2601. In this instance, the first focal point may be considered a virtual focal point as it represents a viewing position for the viewing when viewing the display screen upon which the image segments will subsequently be displayed. In accordance the present example, the processor 3105 generates the image segments LI to L6 as seen in FIG. 4 and the image segments Rl to R6 as seen in FIG. 5.
At the next step 3004, the processor 3105 generates two images where each image comprises an alternating pattern of the image segments generated at steps 3002 and 3003. The images are generated at steps 3004 so that each image comprises half of the image segments from the left generated image segment set interleaved with half of the image segments from the right generated image segments set. In accordance with the present example, an image representing the screen of FIG. 6 and an image representing the screen of FIG. 7 are generated at step 3004.
At the next step 3005, the processor 3105 accesses an image representing a plurality of grid segments. The grid segments of the accessed image are in a first position as the grid segments would be viewed in that first position by the left and right eyes of a viewer positioned at the first focal point (e.g., the focal point 2601), when the grid segments are displayed on the display screen upon which the sets of image segments will subsequently be displayed. Each of the grid segments represents a fully transparent portion of the display screen interleaved between fully opaque grid segments. The size and shape of each of the grid segments is determined according to the size and shape of the display screen and the viewing position (i.e., the first focal point such as the focal point 2601) of the viewer.
The size and shape of each of the grid segments of the image accessed at step
3005 is also determined in order to simulate a distance between a physical grid (e.g., the grid means 3) and the display screen (e.g., the display screen 1) when such a physical grid 3 is placed in front of the display screen upon which the sets of image segments will subsequently be displayed.
Then at the next step 3006, the processor 3105 generates a first composite image representing the image accessed at step 3005 composited over a first one of the images generated at step 3004. In particular, the processor 3105 composites the grid segment image accessed at step 3005 over the image representing the screen of FIG. 6. The composite image generated at step 3006 represents a first half of the image segments from the left generated image segment set as displayed on the display screen and seen through the transparent grid segment openings of the grid segment image (i.e., accessed at step 3005) by the left eye (e.g., 15) of the viewer, and a first half of the image segments from the right generated image segment set as displayed on the display screen and seen through the transparent grid segment openings of the grid segment image (i.e., accessed at step 3005) by the right eye (e.g., 16) of the viewer, as the viewer would view the displayed image segments from the viewing position (e.g., the focal point 2601). The first composite image may be stored in the memory 3106 or the hard disk drive 3110.
At the next step 3007, the processor 3105 accesses an image comprising a plurality of opaque and fully transparent grid segments in a second position as the grid segments would be viewed in that second position by the left and right eyes of the viewer (e.g., at the focal point 2601) when the grid segments are displayed on the display screen upon which the sets of image segments will subsequently be displayed. Again, the size and shape of each of the grid segments is the same as the grid segments of the image accessed at step 3005.
Then at the next step 3008, the processor 3105 generates a second composite image representing the image accessed at step 3007 composited over a second one of the images generated at step 3004. In the current example, the processor 3105 composites the grid segment image accessed at step 3007 over the image representing the screen of FIG. 7. The composite image generated at step 3008 represents a second half of the image segments from the left generated image segment set as displayed on the display screen and seen through the transparent grid segment openings of the grid segment image (i.e., accessed at step 3007) by the left eye (e.g., 15) of the viewer, and a second half of the image segments from the right generated image segment set as displayed on the display screen and seen through the transparent grid segment openings of the grid segment image (i.e., accessed at step 3007) by the right eye (e.g., 16) of the viewer, as the viewer would view the displayed image segments from the first focal point (e.g.., the focal point 2601). The second composite image may be stored in the memory 3106 or the hard disk drive 31 10.
The composite images stored within the memory 3106 or hard disk drive 31 10 at steps 3006 and 3008 may subsequently be transferred to any other storage media including computer readable storage media as defined above, including a compact disc (CD), a digital video disc (DVD), or the like. The composite images may also be transmitted over the network 3120 to a remote server or the like, for example, connected to the network 3120, before being displayed on a suitable display device. The composite images may also be. transmitted over conventional analog television networks or digital television networks in an analog or digital form, respectively, for display on any suitable display device.
The composite images stored within the memory or hard disk drive 3110 at steps 3006 and 3008 may subsequently be displayed in a sequential manner at a suitable frequency (e.g., greater than or equal to 180 hertz) on a suitable display means such as a cinema screen, a television screen, a computer display, a video set, a compact disc (CD) player, a digital video disc (DVD) player, and the like. When the composite images are subsequently displayed in a sequential manner at a suitable frequency (e.g., greater than or equal to 180 hertz), the displayed sequence of images are seen by a viewer of the displayed images as three dimensional video images. The composite images generated at steps 3006 and 3008 may be displayed (e.g., for a cinema audience) for a predetermined period of time (e.g., the length of a movie). The method 3000 is described above with reference to a plurality of grid segments (e.g., as seen in FIG. 8), having a first position and a second position and composite images being determined based on such first and second positions. However, in another implementation, the grid segments may be configured to have a plurality of grid positions for each of the images generated at step 3004. The method 300 may be configured to move the grid segments across the front of each of the images of step 3004 in a similar manner to the grid means 2503 of the system 2500 which moves continuously in a single direction (e.g., from left to right) horizontally in front of the screen 1. In this instance, a composite image will be generated at step 3006 for each of the plurality of different grid positions resulting in a plurality of composite images for each of the images generated at step 3004. Similarly, a plurality of composite images will be generated at step 3008, with a composite image being generated for each of the different grid positions. The plurality of composite images may then be transferred to any other storage media and/or displayed in a sequential manner at a suitable frequency on a suitable display device as described above.
Steps 3001 and 3002 have also been described where only one left and right angle of view of the subject are captured. However, in another implementation, a plurality of left and right angles of view of a subject are captured at steps 3001 and 3002 and the left and right angles would be processed in accordance with the method 3000, in a similar manner to the example of FIGS. 18 to 24.
As described above with reference to FIG. 1, in one implementation the grid 3 is shown as being embodied into a housing or cover 9 in front of the screen 1, be it a screen of a television set, a cinema screen or the like. Such an implementation allows the grid segments to be generated, for example, on a liquid crystal display, while the imagery including two or more spaced apart adjacent angles of view is displayed on the screen 1 behind the liquid crystal display. However, in a further implementation, the physical grid 3 may be replaced by generating and displaying images representing a virtual grid. Such a virtual grid may comprise images of grid segments, similar to those used in the method 3000, being displayed on the screen 1 (e.g., of a television set or cinema screen) while the imagery including two or more spaced apart adjacent angles of view is being displayed on the screen 1 in an oscillating manner as described above.
As described above, the method 3000 may be implemented as one or more code modules of the software application 2733 resident in the storage module 2709 and being controlled in its execution by the processor 2705. In another implementation, a digital projection camera projecting the imagery including two or more spaced apart adjacent angles of view displayed onto the screen 1 may also project a virtual grid comprising images of grid segments, similar to those used in the method 3000, onto the screen over the displayed imagery in order to produce three dimensional imagery in a similar manner to the images displayed in accordance with FIGS. 1, 2, and 25.
Industrial Applicability
The arrangements described are applicable to the computer and data processing industries and particularly for producing three dimensional images. .
The foregoing describes only some embodiments of the present invention, and modifications and/or changes can be made thereto without departing from the scope and spirit of the invention, the embodiments being illustrative and not restrictive.
In the context of this specification, the word "comprising" means "including principally but not necessarily solely" or "having" or "including", and not "consisting only of. Variations of the word "comprising", such as "comprise" and "comprises" have correspondingly varied meanings.

Claims

Claims:
1. A method of producing three dimensional imagery, said method comprising the 5 steps of:
a) displaying on a first screen two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery, one set acquired from an angle of view left of said common centre ("left acquired image segment set") and one set generated from an angle of0 view right of said common centre ("right acquired image segment set"), said image segments being displayed in an alternating pattern across the first screen without any dark bands interposed between the image segments such that only half of the image segments
j
from the left acquired image segment set and half of the image segments from the right acquired image segment set are displayed in any one of two screen display positions;
5 b) placing a segmented grid formed by a series of alternate spaced apart slats and openings in front of the first screen between a focal point and the first screen such that the image on the first screen is observable from the focal point as separated and segmented, wherein the grid is of a size and shape which corresponds to the size of the image segments seen from the focal point and wherein the grid is movable between a first and a second grid0 position in which the slats and openings exchange positions;
c) setting the grid at a pre-determined distance from the first screen such that;
(i) when the grid is in a first position and the image segments are displayed on the first screen in a first screen display position, a first half of the image segments from the left acquired image segment set are displayed on the first screen and are observable through openings of said grid from the focal point and a first half of the image segments from the right acquired image segment set are displayed on the first screen and are observable from the focal point; and
(ii) when the grid is in a second position and the image segments are displayed on the first screen in a second screen display position, a second half of the segments from the left acquired image segment set are displayed on the first screen and are observable through openings of said grid from the focal point and a second half of the segments from the right acquired image segment set are displayed on the first screen and are observable from the focal point;
d) moving the grid at a predetermined speed in front of the first screen as the image segments are sequentially displayed on the first screen in their first and second screen display positions;
e) capturing a plurality of images of the displayed image segments through the openings of the grid as the grid is moved in front of the screen, where the plurality of images are captured from the focal point, such that upon the captured images subsequently being displayed on a second display screen, the grid is rendered invisible and an observer sees a whole coherent three dimensional image by the observer's left eye sequentially observing first and second halves of the left acquired image segment set and the observer's right eve sequentially observing first and second halves of the right acquired image segment set and wherein the whole coherent three dimensional image can be seen by the observer from any position within a wide arc in front of the second screen.
2. A method according to claim 1 wherein the grid comprises electro-optical materials.
3. A method according to claim 2 wherein the grid size is selected according to the size of the first screen and the viewing distance of the focal point from the first screen.
4. A method according to claim 4 wherein the grid is in the form of a liquid crystal display.
5. A method of producing three dimensional imagery, said method comprising the steps of:
a) generating two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery, one set acquired from an angle of view left of said common centre ("left acquired image segment set") and one set generated from an angle of view right of said common centre ("right acquired image segment set"), said image segments being configured for display in an alternating pattern across a display screen without any dark bands interposed between the image segments such that only half of the image segments from the left acquired image segment set and half of the image segments from the right acquired image segment set are displayed in any one of two screen display positions;
b) generating a segmented grid image representing a grid comprising a series of alternate spaced apart opaque portions and transparent openings, wherein the grid is of a size and shape which corresponds to the size of the image segments viewed from a virtual focal point on the display screen;
c) compositing the grid image over each set of image segments separately in order to generate at least first and second composite images, the first composite image representing the grid in a first position where a first half of the image segments from the left acquired image segment set are observable through said openings from the virtual focal point and a first half of the image segments from the right acquired image segment set are observable through the openings from the virtual focal point, the second composite image representing the grid in a second position where a second half of the image segments from the left acquired image segment set are observable through said openings from the virtual focal point and a second half of the image segments from the right acquired image segment set are observable through the openings from the virtual focal point;
e) storing the composited images for subsequent display* such that when displayed the grid image is rendered invisible and an observer sees a whole coherent three , dimensional image by the observer's left eye sequentially observing first and second halves of the left acquired image segment set and the observer's right eve sequentially observing first and second halves of the right acquired image segment set and wherein the whole coherent three dimensional image can be seen by the observer from any position within a wide arc in front of the display screen.
6. A method of producing three dimensional imagery, said method comprising the steps of:
a) displaying on a first screen two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery, one set acquired from an angle of view left of said common centre ("left acquired image segment set") and one set generated from an angle of view right of said common centre ("right acquired image segment set"), said image segments being displayed in an alternating pattern across the first screen without any dark bands interposed between the image segments such that only half of the image segments from the left acquired image segment set and half of the image segments from the right acquired image segment set are displayed in any one of two screen display positions;
b) placing a segmented grid formed by a series of alternate spaced apart slats and openings in front of the first screen between a focal point and the first screen such that the image on the first screen is observable from the focal point as separated and segmented, wherein the grid is of a size and shape which corresponds to the size of the image segments seen from the focal point and wherein the grid is movable between a first and a second grid position in which the slats and openings exchange positions;
c) setting the grid at a pre-determined distance from the first screen such that;
(i) when the grid is in a first position and the image segments are displayed on the first screen in a first screen display position, a first half of the image segments from the left acquired image segment set are displayed on the first screen and are observable through openings of said grid from the focal point and a first half of the image segments from the right acquired image segment set are displayed on the first screen and are observable from the focal point; and
(ii) when the grid is in a second position and the image segments are displayed on the first screen in a second screen display position, a second half of the segments from the left acquired image segment set are displayed on the first screen and are observable through openings of said grid from the focal point and a second half of the segments from the right acquired image segment set are displayed on the first screen and are observable from the focal point;
d) synchronously oscillating the grid at a predetermined frequency between its first and second positions as the image segments are sequentially displayed on the first screen in their first and second screen display positions at that same predetermined frequency; ·
e) capturing a plurality of images of the displayed image segments through the openings of the grid as the grid is synchronously oscillating, where the plurality of images are captured from the focal point, such that upon the captured images subsequently being displayed on a second display screen the grid is rendered invisible and an observer sees a whole coherent three dimensional, image by the observer's left eye sequentially observing first and second halves of the left acquired image segment set and the observer's right eve sequentially observing first and second halves of the right acquired image segment set and wherein the whole coherent three dimensional image can be seen by the observer from any position within a wide arc in front of the second screen.
7. A method according to claim 6 wherein the grid comprises electro-optical materials.
8. A method according to claim 7 wherein the grid size is selected according to the size of the first screen and the viewing distance of the focal point from the first screen.
9. A method according to claim 8 wherein the grid is oscillated at a frequency within the range 50 Hz to 450 Hz.
10. A method according to claim 8 wherein the grid is in the form of a liquid crystal display.
1 1. An apparatus for production of a coherent three dimensional image comprising: a first screen on which is projected two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery;
a segmented grid formed by a series of spaced apart slats and openings placed between a focal point and the first screen at a predetermined distance from the first screen such that the segmented grid creates an appearance of screen image segments in a first grid position;
wherein, first separated segments of imagery generated left of the common centre of said subject of said imagery are observable through openings of said grid, while second separated segments of imagery generated right of the common centre of said subject of said imagery are captured through the openings of the grid, the first and second separated segments of imagery alternating across the first screen without any dark bands interposed between image segments, such that a first half of the imagery is observable by the right and left eyes of an observer at a first position of the grid;
wherein both the grid and the position of the image segments are oscillated relative to one another and in a synchronous fashion at a predetermined frequency such that both the grid and the position of the image segments displayed move from said first position momentarily to a second position thence back to the first position whereupon when the grid is momentarily in said second position during said oscillation a second half of the whole image acquired left of the common centre which was previously not displayed at the first position is observable from the focal point, and a second half of the whole image acquired right of the common centre which was not displayed at the first position is observable from the focal point; a camera for capturing a plurality of images of the displayed screen image segments through the openings of the grid, the plurality of images being captured from the focal point, such that by virtue of the oscillation of both the grid and the image segments at said predetermined frequency, upon the captured images subsequently being displayed on a second display screen, the grid is rendered invisible such that an observer sees a whole coherent three dimensional image by each eye alternately seeing a first half of the image, and then a second half of the image on the screen as the grid and the image segments move between the first and second positions and wherein the whole coherent three dimensional image can be observed from any point within a viewing room in front of the second screen and grid arrangement and is independent of the position of the observer in the viewing room.
12. An apparatus according to claim 1 1 wherein the grid is of a size and shape which corresponds substantially to the size of the image segments such that the image segments are substantially the same dimension.
13. An apparatus according to claim 12 wherein the grid comprises electro-optical materials.
14. " An apparatus according to claim 13 wherein the grid is oscillated at a frequency within the range 50 Hz-450 Hz.
15. An apparatus according to claim 11 wherein the grid is in the form of a liquid crystal screen. )
16. A system for production of a coherent three dimensional image, said system comprising:
a first screen on which is projected two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery ;
a segmented grid formed by a series of spaced apart slats and openings placed between a focal point and the first screen at a predetermined distance from the first screen such that the segmented grid creates an appearance of screen image segments in a first grid position;
wherein, first separated segments of imagery generated left of the common centre of said subject of said imagery are observable through openings of said grid, while second separated segments of imagery generated right of the common centre of said subject of said imagery are captured through the openings of the grid, the first and second separated segments of imagery alternating across the first screen without any dark bands interposed between image segments, such that a first half of the imagery is observable by the right and left eyes of an observer at a first position of the grid;
wherein both the grid and the position of the image segments are oscillated relative to one another and in a synchronous fashion at a predetermined frequency such that both the grid and the position of the image segments displayed move from said first position momentarily to a second position thence back to the first position whereupon when the grid is momentarily in said second position during said oscillation a second half of the whole image acquired left of the common centre which was previously not displayed at the first position is observable from the focal point, and a second half of the whole image acquired right of the common centre which was not displayed at the first position is observable from the focal point;
a camera for capturing a plurality of images of the displayed screen image segments through the openings of the grid, the plurality of images being captured from the focal point, such that by virtue of the oscillation of both the grid and the image segments at said predetermined frequency, upon the captured images subsequently being displayed on a second display screen, the grid is rendered invisible such that an observer sees a whole coherent three dimensional image by each eye alternately seeing a first half of the image, and then a second half of the image on the screen as the grid and the image segments move between the first and second positions and wherein the whole coherent three dimensional image can be observed from any point within a viewing room in front of the second screen and grid arrangement and is independent of the position of the observer in the viewing room.
17. An apparatus for producing three dimensional imagery, said apparatus comprising:
a first screen on which are displayed two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery, one set acquired from an angle of view left of said common centre ("left acquired image segment set") and one set generated from an angle of view right of said common centre ("right acquired image segment set"), said image segments being displayed in an alternating pattern across the first screen without any dark bands interposed between the image segments such that only half of the image segments from the left acquired image segment set and half of the image segments from the right acquired image segment set are displayed in any one of two screen display positions;
a segmented grid formed by a series of alternate spaced apart slats and openings placed in front of the first screen between a focal point and the first screen such that the image on the first screen is observable from the focal point as separated and segmented, wherein the grid is of a size and shape which corresponds to the size of the image segments seen from the focal point and wherein the grid is movable between a first and a second grid position in which the slats and openings exchange positions, wherein the grid is set at a pre-determined distance from the first screen such that;
(i) when the grid is in a first position and the image segments are displayed on the first screen in a first screen display position, a first half of the image segments from the left acquired image segment set are displayed on the first screen and are observable through openings of said grid from the focal point and a first half of the image segments from the right acquired image segment set are displayed on the first screen and are observable from the focal point; and
(ii) when the grid is in a second position and the image segments are displayed on the first screen in a second screen display position, a second half of the segments from the left acquired image segment set are displayed on the first screen and are observable through openings of said grid from the focal point and a second half of the segments from the right acquired image segment set are displayed on the first screen and are observable from the focal point;
wherein the grid is moved at a predetermined speed in front of the first screen as the image segments are sequentially displayed on the first screen in their first and second screen display positions at that same predetermined frequency; and a camera for capturing a pluralit of images of the displayed image segments through the openings of the grid as the grid is moved in front of the screen, where the plurality of images are captured from the focal point, such that upon the captured images subsequently being displayed on a second display screen, the grid is rendered invisible and an observer sees a whole coherent three dimensional image by the observer's left eye sequentially observing first and second halves of the left acquired image segment set and the observer's right eve sequentially observing first and second halves of the right acquired image segment set and wherein the whole coherent three dimensional image can be seen by the observer from any position within a wide arc in front of the second screen.
18. A system for producing three dimensional imagery, said apparatus comprising: a first screen on which are displayed two sets of image segments, each set of said image segments being generated from one of two spaced apart angles of view about a common centre of a subject of said imagery, one set acquired from an angle of view left of said common centre ("left acquired image segment set") and one set generated from an angle of view right of said common centre ("right acquired image segment set"), said image segments being displayed in an alternating pattern across the first screen without any dark bands interposed between the image segments such that only half of the image segments from the left acquired image segment set and half of the image segments from the right acquired image segment set are displayed in any one of two screen display positions;
a segmented grid formed by a series of alternate spaced apart slats and openings placed in front of the first screen between a focal point and the first screen such that the image on the first screen is observable from the focal point as separated and segmented, wherein the grid is of a size and shape which corresponds to the size of the image segments seen from the focal point and wherein the grid is movable between a first and a second grid position in which the slats and openings exchange positions, wherein the grid is set at a pre-determined distance from the first screen such that;
(i) when the grid is in a first position and the image segments are displayed on the first screen in a first screen display position, a first half of the image segments from the left acquired image segment set are displayed on the first screen and are observable through openings of said grid from the focal point and a first half of the image segments from the right acquired image segment set are displayed on the first screen and are observable from the focal point; and
(ii) when the grid is in a second position and the image segments are displayed on the first screen in a second screen display position, a second half of the segments from the left acquired image segment set are displayed on the first screen and are observable through openings of said grid from the focal point and a second half of the segments from the right acquired image segment set are displayed on the first screen and are observable from the focal point;
wherein the grid is moved at a predetermined speed in front of the first screen as the image segments are sequentially displayed on the first screen in their first and second screen display positions at that same predetermined frequency; and
a camera for capturing a plurality of images of the displayed image segments through the openings of the grid as the grid is moved in front of the screen, where the plurality of images are captured from the focal point, such that upon the captured images subsequently being displayed on a second display screen, the grid is rendered invisible and an observer sees a whole coherent three dimensional image by the observer's left eye sequentially observing first and second halves of the left acquired image segment set and the observer's right eve sequentially observing first and second halves of the right acquired image segment set and wherein the whole coherent three dimensional image can be seen by the observer from any position within a wide arc in front of the second screen.
19. A method of producing three dimensional imagery comprising the steps of:
(a) displaying on a first screen four sets of image segments, each set of said image segments being generated from one of four spaced apart angles of view about a common centre, two sets acquired from an angle of view left of a common centre ("left acquired image segment sets") and two sets generated from an angle of view right of a common centre ("right acquired image segment sets"), said image segments being displayed in an alternating pattern across the first screen without any dark bands interposed between image segments, such that only one quarter of the total number of image segments of each of said four sets of image segments are displayed in any one of four screen display positions;
(b) placing a segmented grid formed by a series of alternate spaced apart slats and openings in front of the first screen between a focal point and the first screen such that the image on the first screen is observable from the focal point as separated and segmented, wherein the grid is of a size and shape which corresponds to the size of the image segments seen from the focal point and wherein the grid is movable between a first and second grid position in which the slats and openings exchange positions;
(c) setting the grid at a predetermined distance from the first screen such that:
(i) when the grid is in a first position and the image segments are displayed on the first screen in a first screen display position, a first quarter of the image segments from each of the two left acquired image segment sets are displayed on the first screen and are observable through openings of said grid from the focal point and a first quarter of the image segments from each of the two right acquired image segment sets are displayed on the first screen and are observable from the focal point;
(ii) when the grid is in a second position and the image segments are displayed on the first screen in a second screen display position, a second quarter of the image segments from each of the two left acquired image segment sets are displayed on the first screen and are observable through openings of said grid from the focal point and a second quarter of the image segments from each of the two right generated image segment sets are displayed on the first screen and are observable from the focal point;
(iii) when the grid returns to its first position and the image segments are displayed on the first screen in a third screen display position, a third quarter of the image segments from each of the two left generated image segment sets are displayed on the first screen and are observable from the focal point through openings of said grid and a third quarter of the image segments from each of the two right generated image segment sets are displayed on the first screen and are observable from the focal point; and
(iv) when the grid again moves to its second position and the image segments are displayed on the first screen in a fourth screen display position, a fourth quarter of the image segments from each of the two left generated image segment sets are displayed on the first screen and are observable through openings of said grid and a fourth quarter of the image segments from each of the two right generated image segment sets are displayed on the first screen and are observable from the focal point;
(d) synchronously oscillating the grid at a predetermined frequency between its first and second positions as the image segments are sequentially displayed on the first screen in their first, second, third and fourth screen display position at that same predetermined frequency; and
e) capturing a plurality of images of the displayed image segments through the openings of the grid as the grid is synchronously oscillating, where the plurality of images are captured from the focal point, such that upon the captured images subsequently being displayed on a second display screen, the grid is rendered invisible and an observer sees a whole coherent three dimensional image by the observer's left eye sequentially observing first, second, third and fourth quarters of the two left acquired image segment sets and the observer's right eye sequentially observing first, second, third and fourth quarters of the two right acquired image segment sets and wherein the whole coherent three dimensional image can be seen by the observer from any position within a wide arc in front of the second screen.
20. A method according to claim 19 wherein the grid comprises electro-optical materials.
21. A method according to claim 20 wherein the grid size is selected according to the size of the screen arid the viewing distance of the observer from the screen.
22. A method according to claim 22 wherein the grid is oscillated at a frequency within the range 50 Hz to 450 Hz.
23. A method according to claim 22 wherein the grid is in the form of a liquid crystal display.
PCT/AU2012/000303 2011-03-30 2012-03-22 Method, system and apparatus for use in producing three dimensional imagery WO2012129594A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201161469252P 2011-03-30 2011-03-30
US61/469,252 2011-03-30

Publications (1)

Publication Number Publication Date
WO2012129594A1 true WO2012129594A1 (en) 2012-10-04

Family

ID=46929207

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU2012/000303 WO2012129594A1 (en) 2011-03-30 2012-03-22 Method, system and apparatus for use in producing three dimensional imagery

Country Status (2)

Country Link
TW (1) TW201246913A (en)
WO (1) WO2012129594A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016522422A (en) * 2013-03-25 2016-07-28 イェーガー、ヨーゼフ Vibration grid type space generator

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6188518B1 (en) * 1993-01-22 2001-02-13 Donald Lewis Maunsell Martin Method and apparatus for use in producing three-dimensional imagery

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6188518B1 (en) * 1993-01-22 2001-02-13 Donald Lewis Maunsell Martin Method and apparatus for use in producing three-dimensional imagery

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016522422A (en) * 2013-03-25 2016-07-28 イェーガー、ヨーゼフ Vibration grid type space generator

Also Published As

Publication number Publication date
TW201246913A (en) 2012-11-16

Similar Documents

Publication Publication Date Title
JP4712872B2 (en) Multidimensional imaging system and method
Devernay et al. Stereoscopic cinema
JP2013214975A (en) Three-dimensional display device and image processing method of the same
US6188518B1 (en) Method and apparatus for use in producing three-dimensional imagery
JPH0756112A (en) Stereoscopic picture display device
US20140015942A1 (en) Adaptive monoscopic and stereoscopic display using an integrated 3d sheet
US20180249145A1 (en) Reducing View Transitions Artifacts In Automultiscopic Displays
CN103051916A (en) Apparatus and method of creating 3 dimension panorama image
US10306208B2 (en) Device for creating and enhancing three-dimensional image effects
CN111771153A (en) Near-eye display device and method of displaying three-dimensional image
CN102457756A (en) Structure and method for 3D (Three Dimensional) video monitoring system capable of watching video in naked eye manner
CN108345121A (en) Display system and its display methods
WO2012129594A1 (en) Method, system and apparatus for use in producing three dimensional imagery
Surman et al. Glasses-free 3-D and augmented reality display advances: from theory to implementation
US20120200793A1 (en) 3-D Cinema and Display Technology
Gardner Dynamic floating window: new creative tool for three-dimensional movies
Richardt et al. Video for virtual reality
CN100406965C (en) Rotating lens type stereoscopic eyeglasses and film and camera tape for same
WO1994017638A1 (en) Method and apparatus for use in producing three-dimensional imagery
KR101746809B1 (en) Three Dimension Display using Rotation Screen and Oprerating Method Thereof
Tanaka et al. A method for the real-time construction of a full parallax light field
Lo et al. Stereoscopic kiosk for virtual museum
WO2012139171A1 (en) Method, system and appratus for producing three dimensional (3d) imagery
Ranieri et al. Transparent stereoscopic display and application
Rakov Unfolding the Assemblage: Towards an Archaeology of 3D Systems

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12765090

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12765090

Country of ref document: EP

Kind code of ref document: A1