GB2218295A - 2-D to 3-D image transformation - Google Patents

Abstract

A method of and apparatus for modifying a picture 11 is disclosed wherein a picture is scanned 12a and converted into a set of digital information and combined, in a creative interactive computerised system 20, with a second set of data representing a three dimensional surface model 29, to produce a third set of data 28 representing a mapping of the two dimensional image onto the three dimensional surface, and using the third set of data to produce a modified image in the form of a print, transparency, or a set of colour separations 30. <IMAGE>

Description

IMAGE MODIFICATION This invention relates to the modification of high quality print images for use, in example, advertising, colour magazines, catalogues or any other comparable field in which a high quality illustration would be required.

In the preparation of an illustration for publication it is not unusual to use a higher resolution scanner/plotter (s/p) (for example the SCITEX (Trade Mark) scanner system which uses a Crossfield 635 I.S. scanner). In such a system a representation of the illustration (for example a photograph) is scanned and the content of the photograph stored digitally in a computer within the s/p. The digital information is stored within the computer of the s/p, and an image of the illustration can be displayed on a high resolution monitor.

Software of the system allows the image to be varied in certain ways, for example by masking, re-touching, or composing using straightforward, although somewhat limited modifications. After modification the digital information within the c.p.u. is fed to the plotter portion of the s/p where it can regulate exposure of a photographic film to produce a continuous tone image for further action or use.

Alternatively the plotter can automatically produce colour separated images, e.g.films for use in the creation of printing cylinders or plates.

It is an object of the present invention to provide a method of picture modification which is of very wide application and extremely flexible in the various effects which can be applied to a printing quality picture.

The invention provides a method of modifying a picture including scanning it using a high resolution scanner to produce a set of digital information representing the picture, feeding that set of information into a computer of a creative interactive system wherein the set of digitial data representing the two dimensional picture can be combined with a second set of data representing a three dimensional model to form a third set of data representing a view of the two dimensional picture projected onto the three dimensional object surface, feeding that third set of information into a high resolution plotter and generating a high quality modified picture.

If the scanner/plotter (s/p) and the creative system are not compitable it is necessary to use software which will allow the transfer of digital information from one system to the other.

In this connection it is convenient to use a Scitex s/p including "Handshake" (Trade Mark) format exchange which will allow the transfer of digital information to the creative system.

The creative system can be a 4D70GT Barco "Creator" system which has been proposed for use in connection with the generation of television/video information and which has software which allows the modification of T.V/video pictures in a variety of ways including their projection onto three dimensional model surfaces. Systems comparable to the Barco Creator system described above have always been used at a relatively low resolution which is compatible with T.V./video systems. For example, when creating a typical item to be displayed by television a screen, will require a resolution of only 625 x 625 (assuming a square screen) will be necessary. However, for printing colour separation films there is required a resolution of at least 4000 x 4000. For creating a transparency a resolution of 4800 x 6100 is required.

The invention includes, of course, a modified picture produced by the invention and it also includes a set of colour separations produced in accordance with the method of the invention.

The invention also provides a method of modifying a picture comprising: a high resolution scanner capable of producing a first set of digital date representing the picture, a creative data management/system allowing combination of the first set of data representing a two dimensional image with a second set of data representing a three dimensions surface to produce a third set of data representing a two dimension view of the picture placed on the three dimensional surface; and a high resolution system for receiving the third set of data and converting it into a modified two dimensional picture.

The invention will be described further, by way of example, with reference to the accompanying drawing wherein the single figure is flow sheet illustrating the process of the invention.

In carrying out the process of the invention two pieces of hardware are used. The first piece of hardware is a laser based high resolutions scanner/plotter (s/p) which can be a "Crossfield 635 IS" apparatus incorporated in a Scitex system including the Scitex interface with "Handshake" format exchange. The combination of these two components which is essentially the apparatus which effects the scanning/printing process of the invention will be referred to as the scanner 10.

In the first step of the method of the invention a picture 11 which can be a high quality colour photographic print or any other piece of artwork is scanned by the high resolution scanner and its contents used to create a first set of digital data. In order that photographic quality can be maintained a resolution of at least 10 ppoints per millimetre (ppmm) but preferably 12 (ppmm) (if colour separations are to be eventually prepared) is desirable. However, higher resolution up to 24 (ppmm) and above is desirable if a colour transparency is to be the output medium. It will be borne in mind that a television screen having a matrix of 625 x 625 pixels will have a resolution of about 1.0 (ppmm).

This first set of data originates from the actual scanning head 12 and is passed into the c.p.u.

13 whence it can be stored into a disc drive 14.

Whilst inside the scanner 10 the information can be displayed on a high resolution monitor 15 and modified using "mask", "edit" and various other techniques as is conventional in the modification of images for alteration, touching-up and/or page creation in the printing of magazines or like material. However, when the SCITEX system is provided with the "Handshake" format exchange it is possible for the digital information to be stored onto a magnetic tape 17 to become a portable item which can be transferred to other vendors equipment.

In carrying out the invention we transfer the digital information from the scanner 10 to a creative system in the form of an electronic image modifier 20. Although it is described that the digital information is transferred by magnetic tape, it will be appreciated that with appropriate interconnections there could be a direct hard-wired connection between the scanner 10 and the modifier 20 or the two could be interconnected by any convenient means of transmission.

The modifier 20 is a piece of hardware which is used in the television/video industry to create modified televisual views of material to be transmitted. For example, if a video film has been taken showing an artiste performing, the modifier 20 can be used to modify that film to produce different images of the artiste by allowing a degree of painting or masking or by altering the image to combine images to give unusual effects, as of the artist being projected onto a curved surface or the picture distorted for dramatic and/or comic effects.

These systems which are often referred to as "modelling and animation" systems have been around for quite some time, but have only been used in the context of television and video pictures to be transmitted by a television screen. For this reason, the resolution of the material processed has not differed significantly from the say 1.0 (ppmm) which is the maximum that can be used successfully in a conventional television picture. This is despite the fact that typical creative systems of this type do have a potential to operate at a much higher resolution.

A typical system which we have found works particularly well in achieving the invention is the Barco "Creator" system which is equipped with three types of software namely the three dimensional modelling and amination software, "Wavefront" and "Creator 2600" and the general peripheral server.

All these types of software operate within the modifier 20 and are compatible and interact during the imaging process. The Creator 2600 is the two dimensional "paint" software (22). This software can be used to re-touch images, to compose images, and to effect such items as masking. The 3-D M & A software 21 is the three dimensional modelling and animation software which allows the special effects of the invention to be created. "Wavefront" is a linking software which allows the softwares 21 and 22 to interact with each other. Inside the modifier 20 the digital information representing the picture 11 (however modified up to this stage) can be further modified using the software 22 to change the way the picture looks. the picture itself is displayed on a high resolution colour monitor 25 and instructions can be entered via the keyboard 26.The software 22 allows the digital information to be modified to give different effects on the picture, for example changing the lighting, the level of lighting, direction of lighting and the inclusion of reflections and multiple images.

In the software 21 an input 27, for example, from a digitizer or from some other source (even from keyboard 26) allows the creation of a three dimensional model, that is to say a three dimensional surface. The combination of softwares 21 and 22 allows the modified picture to be placed onto the created model surface using a "material editor" portion of the software. Thus, if for example the picture is a simple photograph, and the surface created in software 21 is a simple cylinder, the combination of these two sets of data within the modifier can produce a third set of data holding a representation of the photograph imprinted upon the cylinder. Of course, a cylinder is only a simple example and, in fact, the picture can be imprinted onto virtually any created surface.

After the combination of the three-dimensional surface and the two-dimensional picture has been effected, the software 22 can be used to re-modify the picture to eliminate any awkward effects, for example where the system limitations have given an unatural look. Again, the direction of lighting, the level of lighting and even the colour of lighting can be changed to modify the picture still further if necessary. Once the operator is satisfied with the new set of data which constitutes the new image, that image is "rendered" that is to say it is placed into a form where it is suitable for transfer to a magnetic tape 29. The magnetic tape bearing that information is now passed back to the scanner 10.

Again, as has been mentioned previously, the connection need not be by means of tape but there could be a direct hardware connection or transmission via any convenient telecommunication link between the modifier and the scanner.

Back in the scanner (10) the tape is fed to the scanner s c.p.u., and displayed. Here, there is another possibility for modifying the new image, for example, to fit it into a page or simply to make further editorial or re-touch amendments. Thereafter the scanner operates in its plotting mode and produces high resolution output from the second set of data. In the Scitex system the plotter can be operated to produce screen separations for black and white or colour printing or it can produce continuous image in colour or black and white, that is to say produces a separate photograph. Alternatively, the plotter can be operated to produce a colour or black and white transparency.

The images produced by the scanner 10 (acting in its plotter mode) are of quality equal to the quality of the picture which has been entered and can be adequate to produce high quality colour prints for magazines, posters or like purposes. A creative photographer could use time on the system of the invention to produce modified versions of his work with added artistic effect. There is now no need for Salvador Dali to paint his clocks draped over the edges of a cube. Using the system of the invention the artist can simply photograph his clock and project it onto the edge of the cube to give exactly the same effect! The system probably also has applications in the field of design.For example, in designing a mirror to give a specific view (for example a distorting mirror) the system could be used to create a surface and the surface moved to give a particular desired effect on the picture marked onto it. That particular shape of mirror could then be recorded and used to create a three-dimensional model for a mirror to be constructed.

The system could also be used in the field of architecture. Where a building or a group of buildings is to be created it is conventional to rely upon "an artists impression" to see how the final scheme will look. Using the system of the present invention a combination of actual photographs of the different features of the proposed construction (for example buildings, trees, roads, lawns etc., can be combined and modified sufficiently to create a distant view of the arrangement to be created.

However, it is expected that the main field of use for the method of the present invention will be in the manipulation and creation of images for display as book, newspaper and magazine content and as advertising material. The method and apparatus of the invention can be used for the creation of puppets, by projecting images of faces (modified if necessary) onto models constituting facial and/or body surfaces.

Many other variations are possible within the scope of the following claims.

Claims (22)

1. A method of modifying a picture including scanning it using a high resolution scanner to produce a set of digital information representing the picture, feeding that set of information into a computer of a creative interactive system wherein the set of digital data representing the two dimensional picture is combined with a second set of data representing a three dimensional model surface to form a third set of digital information representing a view of the two dimensional picture projected onto the three dimensional model surface, feeding that third set of digital information into a high resolution plotter to generate a modified picture.

2. A method as claimed in claim 1, wherein the scanner and plotter are embodied in a combined scanner/plotter (s/p) system.

3. A method as claimed in claim 2, wherein the s/p system is a SCITEX system.

4. A method as claimed in claim 3, wherein the SCITEX s/p system contains "Handshake" (Trade Mark) format exchange software to allow the transfer of digital information between the creative system via the s/p system.

5. A method as claimed in claims 3 or 4, wherein the s/p system has display and input functions allowing modification of the first set of data before the creative system and/or modification of the third set of data prior to plotting.

6. A method as claimed in any of claims 1 to 5, wherein the creative system is a system proposed for use in connection with the generation of television/video information and which has software which allows the modification of T.V/video pictures in a variety of ways including their projection onto three dimensional model surfaces.

7. A method as claimed in claim 5, wherein the creative system is a BARCO system, for example a BARCO "CREATOR" system using a 4D70 GT system or member of the "Silicon Graphics" family of work stations.

8. A method as claimed in any preceding claim wherein the modified picture is plotted as a transparency.

9. A method as claimed in any of claims 1 to 7 wherein the modified picture is plotted as a print.

10. A method as claimed in any of claims 1 to 7 wherein the modified picture is plotted as a set of colour separations.

11. A method of modifying a picture substantially as hereinbefore described with reference to the accompanying drawing.

12. Apparatus for modifying a picture comprising: a high resolution scanner capable of producing a first set of digital data representing the picture; a creative data management system allowing combination of the first set of data representing a two dimensional image with a second set of data representing a three dimensional surface to produce a third set of data representinga two dimensional view of the picture placed on the three dimensional surface; and a high resolution scanner for receiving the third set of data and converting it into a modified two dimensional picture.

13. Apparatus as claimed in claim 12, wherein the scanner and plotter are part of a combined scanner/plotter (s/p) system.

14. Apparatus as claimed in claim 13, wherein the s/p system includes display and input means enabling the first or third set of data to be modified independently of the creative system.

15. Apparatus as claimed in any of claims 12 to 14, wherein the creative system includes input means capable of receiving data from a variety of sources to form all or part of the second set of data.

16. Apparatus as claimed in claim 15, wherein said variety of sources include a keyboard, and/or a digitizer, and/or magnetic tape and/or a data link.

17. A method as claimed in any of claims 1 to 11, including the step of transmitting the first set of digital information and/or the first set of digital information to and/or from a remote location such as a user's premises.

18. A method as claimed in any of claims 1 to 11 or claim 17, wherein the first set of digital information and/or the third set of digital information is or are stored, prior to further processing.

19. A method as claimed in claim 17, wherein the storage is effected at a remote location.

20. Apparatus for modifying a picture substantially as hereinbefore described with reference to the accompanying drawings.

21. A modified picture produced by the method of any of claims 1 to 11 or by the apparatus of any of claims 12 to 17.

22. A picture as claimed in claim 21, and embodied as a print, a transparency, a set of colour separations or as data on a medium.