AU606575B2 - A system for the recording, projection and comparison of three dimensional motion and static pictures - Google Patents

Description

and year form signed Si neture o Iap Ican IJ Atrail atthk 0" I APPL'C,4Tf.N* ACCEPED AN.D AMENDMENTS flIJfuZa., j ig t THE COMMISSIONER OF PATENTS This form must be accompanied by either a provisional specification (Form 9 and true copy) or by a complete specification (Form 10 and true copy).

A

N PI~. YL> V ~c0 *1> ~jc1L) 0 a a 0 0 0 0 0 0 a 0 0 a 0 0 0 0 a, a 0 o 0O s6 0~c 6 r.90 Thi7ei~~t c-ti.stp Sefcfdetio ri9-jade undcj 1 Sec~un 49 nd Is correct r jpr"inting. O AUST-hAULAN 3 APR 19ll PA1TEN'r OFFICE

APPLICANT:

NUMBER:

FILING DATE: LILY H HUGHES PH 03062 FORM 00 0 a a0 COMMONWEALTH OF AUSTRALIA The Patents Act 1952 COMPLETE SPECIFICATION FOR AN INVENTION ENTITLED: A SYSTEM FOR ThE RECORDING,, PROJECTION AND COMPARISON OF THREE DIMENSIONAL MOTION AND STATIC PICTURES The following statemnent is a full description of this invention, including the best method of performing it known to 11e0: T'iil UUMMISSIONER OF PATE NTS gnatur E Declarant) 0 i 4g

ABSTRACT

This invention relates to a system for producing static and moving, life-like, images, in three dimensions, both in real time and via electro-optically recorded data, consisting of a three dimensional camera module and a laser beam scattering medium module in which the three dimensional images are generated via a sight or a series of rapidly scannable, focussable and multi-coloured laser beam generators.

The invention has applications in the entertainment, 10 medical, fashion, advertising, industry and defence fields.

00 0 0 0 0 0 0 0 o oo 0a 0 a oo 0 0 0 o 0 00 0 0o 0 0 0 0 0 0ooo 0 00 0 0 0 0oo 0 0 0 0 0 0 0 0 oo ooo oooo 0000 0 00 0 0 00 00 0 0

AUSTRALIAN

ONB

3 0 APR 1986 PATENT OFFICE 0 00 0 0 Q 0 00 0 00 0 0o 0 0 0 0 00 0 00 0000 0 0 0 0 o 0 oo 0000 0 t FIELD OF THE INVENTION This invention relates to a system for producing static and moving, life.-like, images, in three dimensions, both in real time and via recorded data, consisting of a three dimensional Co .cr o:-ecA o.>eX- Vc colume containing a medium which scatters or fluoresces /concentrated laser light, and into which is focussed one or more rapidly scannable, variable focus laser beams of a single colour or of the three primary colours, blue, green and red, concurrently or sequentially, generated by one or more lasers 10 of the appropriate power and wavelength range, said laser systems and their output beams being computer controlled so as to restrict said three dimensional images within said volume such that the effect to an observer lookingfi4r said volume C' newa\^ao^o. is that of a three dimensional -inomateaphie- film or 15 television projection. The invention also includes a camera or series of cameras necessary to record the three dimensional nature of the images being projected, said camera being based on laser radar techniques to scan the real image or on a three camera array to determine the three dimensional nature of the image geometrically via incoherent light.

The invention has applications in the entertainment, medical, fashion, advertising, simulation, industrial and defence fields.

SUMMARY OF THE PRIOR ART Prior art three dimensional moving scene displays utilized special two dimensional projectors whose images had to be viewed with special spectacles for the observer to sense a three dimensional effect. These prior art systems have had no significant 1 1 Ip 0 0I oor 00 44 ao 0 04a *0 00 )00 0 OoO e commercially successful utilization in any mass market to date because they are not true three dimensional displayers of either static or moving scenes and demand the audience to wear cumbersome viewers in order to sense such a three dimensional effect. Attempts to achieve three dimensional movie projections with holograms have not been successful in prior art due to the inherent difficulties associated with the conversion of stilllife holographic scenes into moving holographic scenes.

The present invention overcomes the defects of prior art 10 attempts to produce three dimensional movies and at the same time provides for three dimensional real time television displays of motion pictures. This has become possible with the advent of multi-wavelength, rapidly scannable, variable focus, laser beam generators which are computer controlled, together with the advent 15 of advance laser radar techniques which can scan an object three dimensionally and both store and transmit collecced data in real time together with the advent of digitisable electro-optic colour cameras of the charge coupled device format which can record a scene digitally for reproduction in a three dimensional format when incorporated into the present invention.

BACKGROUND OF THE INVENTION The live theatres of ancient Greece provided the ideal forum for the presentation of plays with the audience surrounding the actors for full three dimensional effect. It is the goal of our invention to reproduce the three dimensional quality of the theatres of ancient Greece with life-like, laser beam generated o b a 0 0000 a 0 0 0 0 0000 0 ooo

L=

I o 0 O 0 0' 0 0 0 00 0 00 0 00 0 00 0 0 a 00 0000 0 00 o o 0 0900 0I00 S00.

Soo ooo ooo oo 0 r a aa

D

images instead of real actors. To reproduce the ancient Greek theatre format in recorded or real time format demands the generation of three dimensional motion pictures of a quality such that the real and images performances are indistinguishable from each other to an audience of the theatres of Ancient Greece.

I have pioneered the development of advance laser radar techniques necessary for the realisation of the present invention.

With the advent of the laser in 1960, considerable defence funding was devoted to determine the operating characteristics of laser 10 radar, in particular to determine its advantages over the then well established radars of the microwave region. I was the first to field test a unique aspect of laser radar ne:essary for the recording of scenes for the present invention, namely, the phenominal resolution achievable with laser radar over extended 15 distances. Using a Q-switched ruby laser transmitter and a photomultiplex based optical detection system on the Lark Hill proof range in Southern England in 1964, a rudimentary three dimensional profiling of a tank at a distance of three kilometres was achieved by firing the ruby laser several times whilst 20 profiling the said tank in elevation. The first reflection was off the ground immediately in front of the tank, the second was part ground part track, the third was all off the centre of the tank whilst the fourth shot was partly off the turret and partly off the sloping ground just behind the said tank. Although the laser technology of that time was not advanced enough to allow the tank to be accurately scanned by the laser beam with respect 1. i ~i II c 1 to both its own profile and that relative to its background, this pioneering experiment proved that the resolution of laser radar was sufficient to resolve the three dimensional format of objects along line of sight including tanks and hills, in fact complete outdoor scenes. Over the subsequent twenty-three years, laser radar technology has advanced to the stage represented by the present invention, nevertheless we believe that the first crucial experiments were in fact undertaken by one of us (John Leonard Hughes) in 1964. Of particular significance to the development of the present invention has been the development of oo. phased-array laser radar techniques which provides both the o recording and display techniques based on the extremely rapid 0006 S0m0 manipulation of scalable laser beams.

Technical developments in the motion picture and television o1o 15 industries to date have limited presentations to the two 0 0.

o 00 dimensional format as far as mass produced displays such as films, o real time T.V. and video recordings are concerned. Such prior art, .m.o two dimensional, mass audience displays can be considered as being made up of small dots of light and shade giving either black and white or coloured images depending on the sophistication of the equipment.

High quality two dimensional images can be obtained with arrays of 500 x 500 light dots. If these images are repeated at a rate of 30 times per second, then moving images or flicker free motion pictures can be generated, both in the cinema and on television screens.

L a0 4 o o o b 00o 0 00 0 00 0 00 000 0 0 00 00 0 0000 a0 0 0 0000 t It follows that the prior art, two dimensional motion picture and television industry can be accommodated by 500 x 500 x 30 dots of light per second, that is 7.5 x 106 dots of light per second to give very high quality images.

Since the present invention produces three dimensional motion pictures, a rule of thumb advancement of technology to accommodate such high quality images adds the third dimension's 500 spots of light per second to the problem so that we now require 3.75 x 109 spots of light per second. A preferred laser technology of the present invention allows for laser beam manipulation within the time scale range of 10 9 to 10 12 seconds, that is between one nanosecond and one picosecond laser beam response time. The prefered technology of phased-array lasers is being developed worldwide at present, particularly in the United 15 States and Australia. In the United States, the approach is to deposit semiconductor laser arrays on appropriate substrates whilst in Australia the approach to the manufacture of the new lasers is based on single mode optical fibre bundles which are coherently packed. The relevant techniques of the Australian approach have 20 been reported in "Applied Optics" in July 1978j e -Tg=-and= R-Ie-n =p The phased-array lasers suitable for use in the present invention have to emit a single lobe output beam which can be scanned very rapidly on the nano-to-picosecond 9 to 10 12 second) timescale. Furthermore, said output laser beams have to cover the three basic wavelengths of red, blue and green either via three separate laser systems or by sequential

L,

00 1 o b 0 0 00 0 0 00

DO

oooo 0 0 0 o 00 0 00 00 0 oaoo 0 00 0C0D 0 0 00 00 0 0 00 S00 0000 gogi oo o ooo emissions at the required wavelengths from one laser. It is also advisable to have the red, blue and green emissions over a band of wavelengths in the red, blue and green portions of the electromagnetic spectrum otherwise exceedingly sharp laser emission lines at a single wavelength in the red, blue and green will not give the blending effects that occur in nature without extreme technical complexities. Another preferred technology is that of the free electron laser which allows for a wide tuning range in the blue, green and red.

10 To reproduce the three dimensional images the focussing module for the scanned laser output beam must be capable of rapidly varying the focal lengths of the focussed laser beams and it is also an advantage to have the capability of focussing into spots, lines and planes to simplify the scanning sequences 15 wherever possible. However, the invention can operate by focussing the laser beams only in spots so that the whole picture frame in three dimensions is built up of a series of spots corresponding to where the said laser beams are focussed in said scattering medium. To maximise the visual effect of the three dimensional image one has to reproduce the real scene with the correct intensity and colour distribution. This means that the scattered laser light should emerge from the focus region only, that is laser beam light scattered from the medium before and after the focus spot should be minimal and below visual detection by the audience, that is the scattering process must have an intensity threshold.

For a large three dimensional display more than one set lf laser beam generators, scanners and focusing modules may be required to cover the whole scene section by section until the whole of the three dimensional format is produced. The acoustic sequences would then be synchronised to emanate from a particular section of the three dimensional scene so that a spatial dimension must be added to the temporal sound synchronisation of prior art motion picture systems along the lines of prior art sterej sound recording.

The laser system necessary to reproduce the three dimensional °°images consist of the laser beam generator, laser beam scanner and 0o°o a zoom laser beam focussing module all of which have to be computer controlled in order to achieve the multibillion spots of light per centimeter cube necessary to build up the required image within S00o 15 the scattering medium which may be solid, liquid or gaseous. Tilhe °o oo 0o0oo0 scattering medium should be dust-free and present the minimum 0 00 possible attenuation to the pre and post-focussed laser beam and o00 should only respon in the visual range above a given threshold.

Whether the visual sensing of the laser focussed spot is via 0 directly scattered laser light or via coherent or incoherent scattering or fluorescence processes, interactions between said laser beam and said medium, the eye of the observer will also play a role in building up the required image. With a medium which scatters the laser beam at a given threshold the laser beam intensity can be constant for all colours. However, a fixed wavelength laser could be utilized if the focus spot observation 8 Ji 1

;I

I

r.n

D

n n 0 was intensly dependant for these primary colours. The colour sensitive scattering threshold of the medium provides another channel for transfering the computer stored information to build up the three dimensional scene.

b So far we have discussed the part of the invention necessary to project three dimensional motion pictures. The second part of the invention is the system for recording the three dimensional scenes in the first place. Two types of three dimensional objects can be projected by the invention, one which is generated by a 10 computer and ones that exist naturally.

To record natural scenes in a three dimensional format one has to record the natural colour, the shape of the objects mak;ng up the scene and the distance of the said objects relativ to each other in the said scene. If the objects move relative to each other then the scene has to be recorded about 30 times a second in order to project flicker-free movements in the observed three dimensional recorded image. It follows that our camera system to record the scene has to observe the said scene in the three primary colours of red, blue and green, record said elect- 20 tronically scanned scene in a 500 x 500 dot format with the third 500 dots per frame being recorded in the form of a high precision ranging information to give precise depth of field over the shole image. This implies that each scene is either scanned by a laser ranging beam, via a laser ranging beam and a series of cameras, or via a three dimensional array of CCD cameras. It follows that the scene is recorded in the three primary colours, w C 0 0

L,

i in depth via laser ranging, or multiple cameras, and in time via the electronic scanning sequence used to observe the scene.

This information is then either transmitted directly to the projection unit and/or stored in a computer for subsequent playback.

The fundamental observation necessary to understand the basis of the three dimensional display of the present invention is the scattering of laser light from a focussed laser beam when a wisp of smoke passes through said laser focus spot.

Using cylindrical instead of circular lenses results in the said laser beam having a line focus which is equivalent to a series of spots all in a row. If we scan the spots from side to side we get a line identical to that produced by the cylindrical lens whilst if we scan the line up and down we obtain a plane of light, By varying the shape of the light plane we canproduce rings and circles, triangles and ellipses.

To produce a three dimensional image, we join six planes of scattered light to form a cube. No matter which direction such a cube of light is viewed from it will look identical to a real cube provided the image is reproduced about thirty times per second or the fluorescence is such as to give flicker-free images.

To produce colour cubes one has to project the laser beams of the three primary colours blue, green and red, either above or in combination. Having produced a cube it is a relatively simple matter to produce a sphere and then to build up more p.complex images using these basic units. To display a person, one has to record or view the said person in three dimensional format then drive the display laser beams accordingly.

An example of the application of the invention is to relay a fashion display by real models in Paris, in real time to the major capitals of the world. To achieve such displays, the fashion parade in Paris is scanned by an array of cameras whose images are stored electro-optically and transmitted via optical Sfibre cable to the various world capitals where their data drive the laser beam generators to give real life images of both the fashion house interior and the parading models. The only difference being that one can walk through the said real life images with no ill effects particularly if ones eyes were closed for safety within the direct laser beams, For maximum effect, the laser light in 15 the scanned laser beams should only be scattered from the focus 0 0 region. In particular, beyond the focus region as the beam expands it must not be reflected as it hits the walls or floor of our Greek theatre presentation so that walls, ceilings and floors have to be of strongly absorbing optical quality. Such techniques are well known for the absorption of laser light an example being the supression of parasitiL oscillations in high power laser amplifiers via edge cladding the gain medium by strongly absorbing material.

As lasers and electro-optic recording and display techniques improve, the images of the present invention will also improve.

The invention can be used to record, and subsequently compare, the 11 o 00 CC 0 (000 iO 00 0 o 0: C 06 4 three dimensional profile of a human body in medicine, and tools and products in industry.

OBJECTS OF THE INVENTION It is an object of the invention to record and reproduce lifelike, true colour motion and static picture images in three dimensions.

Another object of the invention is to produce three dimensional television presentation of real time moving images.

An object of the invention is to record and subsequently compare three dimensional images.

A further object of the invention is to reproduce theatrical plays so that the imaged scenes are identical to the original.

Yet another object of the invention is to display a real time fashion show in as many world centres as possible via satellite and optical communication links. Another object of the invention is to advertise a wide range of consumer products in three dimensional motion and static pictures.

An object of the invention is to record the three dimensional nature of a real life scene via laser radar imaging.

An object of the invention is to record the three dimensional nature of a real life scene with an array of charge coupled device (CCD) cameras.

Yet another object of the invention is to record the three dimensional nature of a real life scene via a combination of laser radar and CCD camera technology.

An object of the invention is to achieve scattered light

I

only from the focus region of a scanned laser beam in a scattering medi um.

Another object of the invention is to minimise laser beam reflections which contribute to increasing the ambient light of the displayed scene.

Yet another object of the invention is to provide a displayed image definition corresponding to 10 0G \E60...of light per cubic centimeter or 1015 spots of light per cubic meter of the display medium per second.

BRIEF DESCRIPTION OF THE DRAWINGS A better understanding of the invention may be obtained from the following considerations taken in conjunction with the following drawings which are not meant to restrict the scope of the invention in any way.

o< Figure 1 shows the formation of an image of a cube in the scattering medium as a result of the focussed laser beams scanning out the three dimensional image under computer control.

Figure 2 shows the completed cube image viewed from a particular direction.

Figure 3 shows the invention used to project an image of a fashion parade.

Figure 4is a schematic presentation of a real time military scene in three dimensions.

Figure 5 is a schematic representation of the laser radar camera of the present invention.

Figure 6 is a schematic representation of the three :li i

III

4 'C dimensional recording charge coupled device camera array of the present invention.

DETAILED DESCRIPTION OF THE DRAWINGS In Figure 1, numeral 1 indicates a laser beam focussed in a line indicated by numeral 2 which oscillates up and down to form a plane indicated by numeral 3, the planes indicated by numerals 4, 5 and 6 representing similarly formed planes of scattered laser light from scattering medium, not shown, which go to make up the 0 three dimensional image of a cube in real time.

o00 10 In Figure 2, numeral 7 indicates a completed plane of Ao °o light whilst numeral 8 indicates the edge formed by the intersection 0 0 0 0 0 O 0 oo of said completed planes of light forming a completed cube as 0-0 viewed from a given direction.

In Figure 3, numeral 9 indicates a real time, life like 0 01 0oooo 15 image of a fashion model displaying clothes, shoes and jewellry at O000 o 0 0another place separated by thousands of kilometres. Numeral 0 00indicates a real time image of the stage with a real base of light ooo absorbing material indicated by numeral 11.

SIn Figure 4, numeral 12 indicates an attacking, low flying aircraft firing missiles indicated by numeral 13 with trees 1 indicated by numeral 14 in the foreground, hills indicated by numeral i 15 and distant mountains indicated by numeral 16. Numeral 17 indicates clouds, all the said military scene being a three dimensional projection of a real life scene viewed at a remote site on the battlefield.

In Figure 5, numeral 18 indicates light from a typical outdoor I_ i i ~IIII~IIIICI~ scene, in two dimensional, full colour format, entering a digitizing camera, relevant data being processed in the electro-optic procession indicated by numeral 20. Numeral 21 indicates the laser radar transmitter, whilst numeral 22 indicates the laser output beam which is scanned as indicated by numeral 23. Numeral 24 indicates the reflected laser beam being detected via the optical detector indicated by numeral 25. Numeral 26 indicates the computer which stores the information processed by 20 and either transmits said information to a remote site via optical fibre cable indicated by numeral 27 o a 000 10 or directly controls the laser display system via the link indicated 0 00 o 0by numeral 28.

0 0 0 oroOO 00 00 In Figure 6, numeral 29 indicates an object being recorded a0 0 0 0 0 .00 in full colour by an array of three digitizing cameras indicated 00 0 by numerals 30, 31 and 32 respectively. Numeral 33 indicates an 15 optical processing unit which processes the electro-optic data in o 0 O a 00a three dimension mode where it is then stored in a computer 0 .0 0 00 S00 indicated by numeral 34. Numeral 35 indicates the optical data link .oo to the laser image generating unit (not shown).

Modifications may be made to the invention as described 20 herein without departing from the spirit and scope of the invention.

0 To this extent it is pointed out that the invention is to be given a broad connotation and is not to be restricted to the embodiments specifically described.

c 1.

Claims (11)

1. A system for recording real, full colour, three dimensional objects and displaying their image in a three dimensional format in real time at a remote site, said recording being effected by a digitizing, full colour camera system consisting of a recording and a display module, laser radar transmitter, optical detector, electro-optic processing unit and computer data storage unit, said display being effected by one or more, scannable, variable focus laser beam generators emitting the three primary colours of blue, green and red, said real time images being displayed as per the recorded scene data fed via an optical data link said images being generated via the creation of up to one billion focussed laser beam spots per second per cubic centimetre within a light scattering medium, the boundaries of said medium being of high optical absorbing material to minimise the ambient light.

2. A system as claimed in Claim I wherein the or each scannable, variable focus laser beam generator emits the three primary colours of blue, green and red. a* LIIU LdIiK LU uL ducurciLuly sccuirieu UY LIl idtiur uediii WI L1I retbJeUUL 4 0- 1 i .ii IIIII I- P-L

3. A system as claimed in Claim 1 wherein there are three scannable, variable focus laser beam generators each of which emits one of the three primary colours of blue, green and red. o00 4. A system as claimed in Claim 1 wherein the image o oo o 0 0 producing laser beams are generated and scanned by 0 0o o.o a phased array of laser beam transmitters with a 0 Do o o 0 o°o 0 response time on the nanosecond to picosecond time o. o scales. 0000 0 00 0 0 0 000 0 A system as claimed in Claim I wherein the real time recording module is in a major capital city 0 0 .0 recording a major fashion show and the display 0 00o 0 0 0 units in other capital cities would be projecting o S°oo a real time, three dimensions presentation of the o 0 real show. 0 0 0 6 o

6. A system as claimed in Claim 1 wherein the recording module is in remote battlefields and the three dimension, imaged display is at the control centre positioned well away from the battles.

7. A system as claimed in Claim 1 used to advertise products in a three dimensional format both in real time and via recorded data. 'rf i S 0 0 o 0 0 0 0 0 00 0 0 0 0 0 0 0 0 0 00 0 0 0 0 0 0 0 0 0 0 0000 0000 0 0 a o o o o a 0 0 o o

8. A system as claimed in Claim 1 for the production and display of three dimensional, full colour motion pictures.

9. A system as claimed in Claim I for the production of three dimensional full colour television images.

10. A system as claimed in Claim i for the presentation of ancient Greek theatre programs.

11. A system as claimed in Claim I to record and subsequently compare the three dimensional profile of the whole or part of the human body.

12. A system as claimed in Claim I to record and subsequently compare the three dimensional profile of the whole or part of industrial tools and products.

13. A system as claimed in any one of Claims 1 to 12 substantially as hereinbefore described and illustrated with respect to the accompanying drawings. Dated this 13th day of November, 1990 LILY HARRIET HUGHES 18