AU746180B2 - Lines advisor - Google Patents

Description

S&F Ref: 483420

AUSTRALIA

PATENTS ACT 1990 COMPLETE SPECIFICATION FOR A STANDARD PATENT

ORIGINAL

4 *40*4 4C4* 4* Name and Address of Applicant: Actual Inventor(s): Canon Kabushiki Kaisha 30-2, Shimomaruko 3-chome Ohta-ku Tokyo Japan John Richard Windle, Julie Yan Zhu, Stephen Robert Bruce Address for Service: Spruson Ferguson St Martins Tower 31 Market Street Sydney NSW 2000 Lines Advisor Invention Title: ASSOCIATED PROVISIONAL APPLICATION DETAILS [33] Country [31] Applic. No(s) AU PP9722 [32] Application Date 24 Dec 1998 The following statement is a full description of this invention, including the best method of performing it known to me/us:- 5815c LINES ADVISOR Field of Invention The present invention relates to image manipulation, and more particularly to compositing images with or adjacent each other.

The invention has been developed primarily as an automated means of compositing titles, clip art and the like on or around an initial image, and will be described hereinafter with reference to this application. However, it will be appreciated that the invention is not limited to this field of use.

Background to Invention Graphic artists, and computer graphic artists in particular, bring with them a wide variety of technical and aesthetic skills related to the composing of images from image elements. For example, to generate a brochure for a holiday destination, a graphic artist might incorporate a background image, upon which is composited a title, such a name of a resort, as well as smaller photographs of activities available at the resort. The relative spacings, sizes and orientation of the image elements is made on the basis of experience, although such elements as proportionality and alignment are often consciously considered.

It is an object of the present invention to simplify the task of selecting positions and orientations for sub-images in relation to a main image.

20 Summary of Invention According to one aspect of the present invention there is provided a method of generating a final image based on a first image and a second image, the method comprising the steps of: processing the first image to determine a first orientation of a first linear feature S: 25 therein; processing the second image to determine a second orientation of a second linear S•feature therein; composing the final image by compositing the first image and the second image with, or adjacent to, each other on the basis of the first orientation and the second orientation.

Preferably, the composing step includes a substep of altering a relative rotational orientation of the first image with respect to the second image, such that the first and second orientations are disposed in a predetermined angular relationship to each other.

483420.doc r. .r rr i i i elIt -2- In a preferred embodiment, the second image has a predetermined preferred orientation, and the composing step includes the substep of aligning the preferred orientation of the second image with the first orientation.

According to another aspect of the present invention there is provided an apparatus for generating a final image based on a first image and a second image, the apparatus comprising: processing means for processing the first image to determine a first orientation of a first linear feature therein, and for processing the second image to determine a second orientation of a second linear feature therein; composing means for composing the final image by compositing the first image and the second image with, or adjacent to, each other on the basis of the first orientation and the second orientation.

According to still another aspect of the present invention there is provided a method of providing advice to a user of an image capture device, the method including the steps of: capturing a first image; processing the first image to determine a first orientation and position of a first dominant linear feature therein; and generating composition advice on the basis of the first orientation and position, 20 the composition advice including a direction in which the image capture device should be moved, or the captured image should be manipulated, to generate a final image in which the first dominant linear feature is disposed at a predetermined proportional position therein, wherein said composition advice is based on an orientation of said first dominant linear feature.

25 According to still another aspect of the present invention there is provided an apparatus for providing advice to a user of an image capture device, the apparatus comprising: capturing means for capturing a first image; processing means for processing the first image to determine a first orientation and position of a first dominant linear feature therein; and advice generating means for generating composition advice on the basis of the first orientation and position, the composition advice including a direction in which the image capture device should be moved, or the captured image should be manipulated, to generate a final image in which the first dominant linear feature is disposed at a 483420.doc (J t -3predetermined proportional position therein, wherein said composition advice is based on an orientation of said first dominant linear feature.

According to still another aspect of the present invention there is provided a computer readable medium for storing a program for an apparatus which processes data, said processing comprising a method of generating a final image based on a first image and a second image, said program comprising: code for processing at least the first image to determine a first orientation of a first linear feature therein; code for processing the second image to determine a second orientation of a second linear feature therein; and code for composing the final image by compositing the first image and the second image with, or adjacent to, each other on the basis of the first orientation and the second orientation.

According to still another aspect of the present invention there is provided a computer readable medium for storing a program for an apparatus which processes data, said processing comprising a method of providing advice to a user of an image capture device, said program comprising: code for capturing a first image; code for processing the first image to determine a first orientation and position of 20 a first dominant linear feature therein; and code for generating composition advice on the basis of the first orientation and position, the composition advice including a direction in which the image capture device :'"•"should be moved, or the captured image should be manipulated, to generate a final image in which the first dominant linear feature is disposed at a predetermined proportional 25 position therein, wherein said composition advice is based on an orientation of said first dominant linear feature.

ooo• According to another aspect of the present invention there is provided a method of adding text, image or other visual data to an image, the method comprising the steps of: detecting a first visually relatively dominant line embedded within the image; detecting a second visually relatively dominant line embedded within the text, image or other visual data; adding the text, image or other visual data to the image, wherein a spatial relationship between the image and said text, image or other visual data is 483420.doc determined depending on an orientation of said first and second visually relatively dominant lines; and storing, printing or displaying the image along with the added text, image or other visual data.

Preferably, step includes the sub-step of detecting edges within the image.

Preferably, step further includes the sub-step of applying an edge weighting factor to the detected edges, such that edges having a greater horizontal component are emphasised.

In a preferred embodiment, the text, image or other visual data has a preferred upright viewing orientation, and step includes the sub-step of adding the text, image or other visual data to the image such that the preferred upright viewing orientation is at degrees to the first relatively dominant line.

Preferably, the text, image or other visual data is added to the image a predetermined distance from the first relatively dominant line.

According to still another aspect of the present invention there is provided an apparatus for adding text, image or other visual data to an image, the apparatus comprising: detecting means for detecting a first visually relatively dominant line embedded within the image and for detecting a second visually relatively dominant line embedded 20 within the text, image or other visual data; adding means for adding the text, image or other visual data to the image, wherein a spatial relationship between the image and said text, image or other visual data is determined depending on an orientation of said first and second visually relatively dominant lines; and 25 means for storing, printing or displaying the image along with the added text, image or other visual data.

According to still another aspect of the present invention there is provided a computer readable medium for storing a program for an apparatus which processes data, said processing comprising a method of adding text, image or other visual data to an image, said program comprising: code for detecting a visually relatively dominant line embedded within the image; code for detecting a second visually relatively dominant line embedded within the text, image or other visual data; 483420.doc 4acode for adding the text, image or other visual data to the image, wherein a spatial relationship between the image and said text, image or other visual data is determined depending on an orientation of said first and second visually relatively dominant lines; and code for storing, printing or displaying the image along with the added text, image or other visual data.

Further aspects and embodiments of the invention are disclosed in the following detailed description, and the numbered paragraphs which follow.

Brief Description of Drawings Preferred embodiments of the invention will now be described, by way of example only, with reference to the accompanying drawings, in which: Figure 1 shows a portion of an electronic photo album having an image and a caption, composited together to generate a final image in accordance with the invention; Figure 2 shows a template in an electronic photo album such as that shown in Figure 1, prior to an image being added; Figure 3 shows the template of Figure 3, with a first image added; Figure 4 shows the completed template of Figures 3 and 4, with a title added to the title slot; Figure 5 is a flow diagram setting out a method of generating a final image based 20 on a first image and a second image; Figure 6 is a flow diagram setting out a method of providing advice to a user of :an image capture device, also in accordance with the invention; *o *i 483420.doc :i Figure 7 is an image appearing through a viewfinder associated with an image capture device; Figure 8 is a schematic of a generic computer for use in implementing the invention; and Figure 9 shows an image with a caption and a background image, composited together to generate a final image in accordance with the invention.

Detailed Description It will be appreciated that throughout the following detailed description, the words "compose", "composing" and "composition" refer to technical and aesthetic lo matters relating to arranging image elements in overlapping or adjacent relationship to S. generate a final image. By contrast, the words "composite" and "compositing" relate to the specific process by which image elements are layered upon other image elements or a background in an additive fashion. These terms are well known in the art, and notwithstanding some similarities, have distinct and different meanings which will be Is appreciated by those skilled in the art.

Referring to the drawings, Figure 5 shows a flow diagram 500 of a method of •generating a final image based on a first image and a second image. As shown, a first image 502 and a second image 504 are provided. The first image is processed in a first processing step 506 to determine a first orientation of a first linear feature therein. The 20 first image 502 and the second image 504 are then composited in step 508 to generate a final image 510. In the compositing step 508, the first image 502 and the second 504 are composited with, or adjacent to, each other on the basis of the first orientation of the first linear feature.

In one embodiment, the second image has a predetermined preferred orientation, in which case the compositing step includes the substep of aligning the preferred orientation of the second image with the first orientation. Alternatively, the second image 504 can be processed in a second processing step 512 to determine a second orientation of a second linear feature therein. The compositing step is then implemented on the basis of both the first orientation and the second orientation.

Specific examples of the method of Figure 5 are shown in Figures 1 to 4.

Referring to Figure 1, there is shown an extract 100 from an electronically stored photographic album. In this embodiment, the first image takes the form of a holiday image 102, whilst the second image takes the form of a caption 104. The holiday image 102 includes a number of picture elements, including a tree 106, a person 108 and a horizon 110. The caption 104 in this case takes the form of text. However, it will be CFP1533AU MMedia29 483420 I:\ELEC\CISRA\MM EDIA\MMEDIA29\483420.doc r appreciated that the text could be represented in an image format, oir could even be an image conveying no specific textual information.

In accordance with the first aspect of the invention, the holiday image 102 is processed via an edge transform or the like to determine a first orientation of a first linear feature therein. Usually, the linear feature selected will be that considered most dominant on the basis of a set of rules, as described in greater detail below. In this case, the predominate linear feature is the horizon 110, and so this is selected. On the basis of this selection, the caption 104 is automatically positioned directly adjacent the horizon 110 in the holiday image 102.

It will be appreciated that the particular relationship of the caption 104 to the holiday image 102 is based on a predetermined selection, which, in a preferred form, can be altered. For example, in some cases, it can be preferable to have a bottom edge 112 of the caption 104 positioned adjacent the horizon 110, or to have some predetermined portion of the caption 104 above and below the horizon 110.

s Referring to Figure 2, there is shown a template 200, for use in composing a final image. The template 200 includes a bounding box 202 representing a central area within which a first image can be added, and a floating secondary image box 204. As shown in Figure 3, a first image 206 is imported into the template 200 by some known routine, such as cutting and pasting, dragging and dropping or simply importing or 20 opening the required image. Once inserted into the template 200, the first image 206 is processed to determine the orientation and position of a first linear feature within the first image 206.

In this case, a relatively linear side of a mountain 208 has been determined the most dominant linear feature in the first image 206. Accordingly, the secondary image box 204 is moved into position parallel with and adjacent to the side of the mountain 208.

This positioning of the secondary image box 204 can take place automatically, in which case it is desirable that the preferred embodiment also estimate the best position for the secondary image box 204 to ensure maximal legibility of any information or imagery it contains. For example, in the embodiment shown, the sky 210 surrounding the mountains is relatively clear light blue, and is therefore a good basis upon which to overlay dark text.

Alternatively, the method can simply suggest an appropriate dominant line, rotate the secondary image box 204 parallel with that line, and leave the specific position of the secondary image box 204 along, and normal to, the dominant line to the user's discretion.

Turning to Figure 4, the phrase "SKI!" has been positioned within the secondary image box 204. In this case, the secondary image box 204 is a transparent bounding box CFPI533AU MMedia29 483420 I:\ELEC\CISRA\MMEDIA\MMEDIA29\483420.doc I c~ -T -7only, and so the sky is visible around the word "SKI". In other embodiments, where clip art, a second image or text with a particular background is being imported to the secondary image box 204, the sky or other background will not be visible through the overlayed text or imagery. However, in the event that an image is imported into the secondary image box 204, the embodiment can suggest a position for the secondary image box 204 based on the relative colours of the image and the background image. For example, referring to Figure 9, there is shown a background image 901 having a water line 903, grey storm clouds 905 and a blue sky region 907. The secondary image box 204 has a water line 909, a blue sky region 911 and the word "BOATING". The method, in accordance with the embodiment, can position the secondary image box 204 in order to match the two blue sky regions 907 and 911, being the same colour, rather than positioning the secondary image box 204 over the storm clouds 905 which are of a different colour.

S.,o It will also be appreciated that any second image can also be partially opaque, or 15 can even be an animation where the resultant final image is to be displayed on an active screen such as a computer monitor.

The rules by which the first linear feature (and second linear feature, where appropriate), is selected can be varied from application to application. Typically, factors to be considered will include the relative linearity of the line, its angle relative to the 20 horizontal (or vertical), its width, its contrast in relation to surrounding pixels, whether it represents a junction between a lighter area and a darker area or is a solid line extending o*.o :across a different colour region, the line's proximity to the centre of the viewing area, or any other suitable consideration. The weights applied to these considerations can vary from application to application, and in a preferred form, can be preselected by a user.

A further aspect of the invention is shown in Figure 6, in which there is provided a flow diagram 600. A first image 602 is processed to determine a first orientation of a first linear feature therein in processing step 604. Composition advice is then generated in a step 606 on the basis of the first orientation and position determined in step 604. The composition advice can then be used to generate a final image 608.

In the preferred form, the type of composition advice provided relates to the position of one or more dominant linear features in the first image 602. For example, referring to Figure 7, there is shown a landscape 700, having a tree 702, a house 704, a sun 706 and a horizon 708 in the background. In general terms, it is undesirable to have a relatively dominant linear feature such as the horizon 708 dividing the field of view approximately in half. It is more preferable, for example, that the field of view be moved CFP1533AU MMedia29 483420 I:\ELEC\CISRA\MMEDIA\MMEDIA29\483420.doc prior to capturing the final image such that the horizon is disposed approximately 1/3 of the way from the top or bottom of field of view. Accordingly, in the example shown in Figure 7, an indicator 710 is provided in the right hand side of the field of view, indicating that the image capturing device being used to capture the image should be moved downwardly to provide the image with better composition.

As with the previous embodiment, various rules can be implemented, such as whether the dominant line in question is horizontal or vertical, precisely how dominant the line is in relation to other lines within the image, the line's length, and so on.

Furthermore, where such a dominant line divides an image in half, or is disposed io relatively close to an edge of the image, the suggestion as to which way the image capture device should be moved to better compose the image can be based on issues such as the amount of motion on either side of the line, the relative density of edges, the colour on either side of the line or other factors which might serve to indicate the likely existence of •more interesting subject matter in one direction than in another.

The image capture device (not shown) can take any suitable form. Preferably, •the image capture device is a digital video or still camera, such as a CCD camera with an on-board permanent or removable memory. The final image can then be uploaded to a computer or other device enabling viewing or editing of the final image, Also, it will be appreciated that the method described in relation to Figures 6 and 7 can be implemented in software on a personal computer of the like to provide advice on cropping an image to improve its aesthetic appeal.

In the preferred embodiments, the software for implementing the invention is implemented in a computer application program hosted on the WindowsTM operating system developed by Microsoft Corporation. However, those skilled in the art will recognise that the described embodiment may can be implemented on computer systems hosted by other operating systems. For example, the preferred embodiment can be performed on computer systems running UNIXTM, OS/2TM, DOSTM. The application program has a user interface which includes menu items and controls that respond to mouse and keyboard operations. The application program has the ability to transmit data to one or more printers either directly connected to a host computer or accessed over a network. The application program also has the ability to transmit and receive data to a connected digital communications network (for example the "Internet").

The preferred embodiment of the invention can be practised using a conventional general-purpose (host) computer system, such as the computer system 840 shown in Figure 8, wherein the application program discussed above and to be described with CFP1533AU MMedia29 483420 I:\ELEC\CISRA\M MEDIA\MMEDIA29\483420.doc 7. -9reference to the other drawings is implemented as software executed on the computer system 840. The computer system 840 comprises a computer module 841, input devices such as a keyboard 842 and mouse 843, output devices including a printer 813 and a display device 811. A Modulator-Demodulator (Modem) transceiver device 852 is used by the computer module 841 for communicating to and from a communications network, for example connectable via a telephone line or other functional medium. The modem 852 can be used to obtain access to the Internet, and other network systems.

The computer module 841 typically includes at least one processor unit 845, a memory unit 846, for example formed from semiconductor random access memory (RAM) and read only memory (ROM), input/output interfaces including a video interface 847, and an 1/O interface 848 for the keyboard 842 a mouse 843 and optionally a joystick (not illustrated). A storage device 849 is provided and typically includes a hard disk drive 853 and a floppy disk drive 854. A CD-ROM drive 855 is typically provided as a non-volatile source of data. The components 845 to 849 and 853 to 855 of the computer module 841, typically communicate via an interconnected bus 850 and in a manner which results in a conventional mode of operation of the computer system 840 known to those in the relevant art. Examples of computers on which the embodiments can be practised include IBM-PC's and compatibles, Sun Sparcstations or alike computer systems evolved therefrom. Typically, the application program of the preferred embodiment is resident on a hard disk drive 853 and read and controlled using the •processor 845. Intermediate storage of the program and the print list and any data fetched from the network may be accomplished using the semiconductor memory 846, possibly in concert with the hard disk drive 853. In some instances, the application program may be supplied to the user encoded on a CD-ROM or floppy disk, or alternatively could be read by the user from the network via the modem device 852.

Although the invention has been described with reference to a number of specific examples, it will be appreciated by those skilled in the art that the image can be embodied in many other forms.

In the context of this specification, the word "comprising" means "including principally but not necessarily solely" or "having" or "including" and not "consisting only of'. Variations of the word comprising, such as "comprise" and "comprises" have corresponding meanings.

CFP1533AU MMedia29 483420 I:\ELEC\CISRA\MMEDIA\MMEDIA29\483420.doc

Claims (15)

1. A method of generating a final image based on a first image and a second image, the method comprising the steps of: processing the first image to determine a first orientation of a first linear feature therein; processing the second image to determine a second orientation of a second linear feature therein; and composing the final image by compositing the first image and the second image with, or adjacent to, each other on the basis of the first orientation and the second orientation.

2. A method according to claim 1, wherein the composing step includes the substep of altering a relative rotational orientation of the first image with respect to the second image, such that the first and second orientations are disposed in a predetermined angular relationship to each other.

3. A method according to claim 1, wherein the composing step includes the substep of altering a relative rotational orientation of the first image with respect to the second 20 image, such that the first and second orientations are parallel to each other.

4. A method according to claim 1, wherein the composing step includes the substep of altering a relative rotational orientation of the first image with respect to the second image, such that the first and second orientations are disposed at 90 degrees to each other.

5. A method according to claim 1, wherein the second image has a predetermined preferred orientation and the composing step includes the substep of aligning the preferred orientation of the second image with the first orientation.

6. The method according to claim 1, wherein the first image has a first coloured region and the second image has a second coloured region, and wherein the composing step includes the substep of aligning the first and second images based on said first and second coloured regions.

483420.doc II -11-

7. A method according to any one of the preceding claims, wherein the processing step includes the substep of performing an edge transformation of the main and/or secondary images.

8. An apparatus for generating a final image based on a first image and a second image, the apparatus comprising: processing means for processing the first image to determine a first orientation of a first linear feature therein, and for processing the second image to determine a second orientation of a second linear feature therein; and composing means for composing the final image by compositing the first image and the second image with, or adjacent to, each other on the basis of the first orientation and the second orientation.

9. An apparatus according to claim 8, wherein said composing means alters a relative rotational orientation of the first image with respect to the second image, such that the first and second orientations are disposed in a predetermined angular relationship S"to each other.

10. An apparatus according to claim 8, wherein said composing means alters a S: 20 relative rotational orientation of the first image with respect to the second image, such that the first and second orientations are parallel to each other. oo o•

11. An apparatus according to claim 8, wherein said composing means alters a oooo relative rotational orientation of the first image with respect to the second image, such 25 that the first and second orientations are disposed at 90 degrees to each other.

12. An apparatus according to claim 8, wherein the second image has a predetermined preferred orientation and the composing means aligns the preferred orientation of the second image with the first orientation.

13. The apparatus according to claim 8, wherein the first image has a first coloured region and the second image has a second coloured region, and wherein the composing means aligns the first and second images based on said first and second coloured regions. 483420.doc -12-

14. An apparatus according to claim 8, further comprising output means for outputting the final image composed by said composing means. An apparatus according to claim 14, wherein said output means is a display or a printer. 16. An apparatus according to any one of claim 8 to 15, wherein the processing means performs an edge transformation of the main and/or secondary images. 17. A method of providing advice to a user of an image capture device, the method including the steps of: capturing a first image; processing the first image to determine a first orientation and position of a first dominant linear feature therein; and generating composition advice on the basis of the first orientation and position, the composition advice including a direction in which the image capture device should be moved, or the captured image should be manipulated, to generate a final image in which the first dominant linear feature is disposed at a predetermined proportional position oo, therein, wherein said composition advice is based on an orientation of said first dominant linear feature. 18. A method according to claim 17, wherein said composition advice is based on how dominant said first dominant linear feature is compared to other linear features of the first image. 19. A method according to any one of claims 17 to 18, wherein said composition o advice is based on a magnitude of motion on either side of said first dominant linear feature. 20. A method according to any one of claims 17 to 19, wherein said composition advice is based on the relative density of at least two edges defining features of said first image. 21. The method according to any one of claims 17 to 20, wherein said composition 5 3 dvice is based on a colour of either side of said first dominant linear feature. 483420.doc 4i -13- 22. An apparatus for providing advice to a user of an image capture device, the apparatus comprising: capturing means for capturing a first image; processing means for processing the first image to determine a first orientation and position of a first dominant linear feature therein; and advice generating means for generating composition advice on the basis of the first orientation and position, the composition advice including a direction in which the image capture device should be moved, or the captured image should be manipulated, to generate a final image in which the first dominant linear feature is disposed at a predetermined proportional position therein, wherein said composition advice is based on an orientation of said first dominant linear feature. 23. An apparatus according to claim 23, wherein said composition advice is based on how dominant said first dominant linear feature is compared to other linear features of the first image. 24. An apparatus according to any one of claims 22 to 23, wherein said composition o C advice is based on a magnitude of motion on either side of said first dominant linear feature. An apparatus according to any one of claims 22 to 24, wherein said composition Dose advice is based on the relative density of at least two edges defining features of said first 20 image. go 26. An apparatus according to any one of claims 22 to 25, wherein said composition oooo advice is based on a colour of either side of said first dominant linear feature. 27. A computer readable medium for storing a program for an apparatus which processes data, said processing comprising a method of generating a final image based on a first image and a second image, said program comprising: code for processing at least the first image to determine a first orientation of a first linear feature therein; code for processing the second image to determine a second orientation of a second linear feature therein; and 483420.doc ir-;l li~irii~A o i i I/ 61' 14 -14- code for composing the final image by compositing the first image and the second image with, or adjacent to, each other on the basis of the first orientation and the second orientation. 28. A computer readable medium according to claim 27, said program further comprising code for altering a relative rotational orientation of the first image with respect to the second image, such that the first and second orientations are disposed in a predetermined angular relationship to each other. 29. A computer readable medium according to claim 27, said program further comprising code for altering a relative rotational orientation of the first image with respect to the second image, such that the first and second orientations are parallel to each other. 30. A computer readable medium according to claim 27, said program further :04:0 comprising code for altering a relative rotational orientation of the first image with respect to the second image, such that the first and second orientations are disposed at r degrees to each other. 0S.*@e 20 31. A computer readable medium according to claim 27, wherein the second image has a predetermined preferred orientation and said program includes code for aligning the preferred orientation of the second image with the first orientation. o 6: 32. The computer readable medium according to claim 27, wherein the first image 1, 25 has a first coloured region and the second image has a second coloured region, and wherein said program comprises code for aligning the first and second images based on said first and second coloured regions. 33. A computer readable medium according to any one of claims 27 to 32, said program comprising code for performing an edge transformation of the main and/or secondary images. 34. A computer readable medium for storing a program for an apparatus which Sprocesses data, said processing comprising a method of providing advice to a user of an image capture device, said program comprising: 483420.doc X 71 7-i code for capturing a first image; code for processing the first image to determine a first orientation and position of a first dominant linear feature therein; and code for generating composition advice on the basis of the first orientation and position, the composition advice including a direction in which the image capture device should be moved, or the captured image should be manipulated, to generate a final image in which the first dominant linear feature is disposed at a predetermined proportional position therein, wherein said composition advice is based on an orientation of said first dominant linear feature. A computer readable medium according to claim 34, wherein said composition advice is based on how dominant said first dominant linear feature is compared to other linear features of the first image.

15 36. A computer readable medium according to any one of claims 34 to 35, wherein said composition advice is based on a magnitude of motion on either side of said first dominant linear feature. 37. A computer readable medium according to any one of claims 34 to 36, wherein 20 said composition advice is based on the relative density of at least two edges defining features of said first image. 38. A computer readable medium according to any one of claims 34 to 37, wherein said composition advice is based on the relative density of at least two edges defining 25 features of said first image. 39. A method of adding text, image or other visual data to an image, the method comprising the steps of: detecting a first visually relatively dominant line embedded within the image; detecting a second visually relatively dominant line embedded within the text, image or other visual data; adding the text, image or other visual data to the image, wherein a spatial relationship between the image and said text, image or other visual data is 483420.doc 1:I -16- determined depending on an orientation of said first and second visually relatively dominant lines; and storing, printing or displaying the image along with the added text, image or other visual data. The method according to claim 39, wherein step further includes the sub-step of detecting edges within the image. 41. The method according to claim 40, wherein step further includes the sub-step of applying an edge weighting factor to the detected edges, such that edges having a greater horizontal component are emphasised. 42. The method according to any one of claims 39 to 41, wherein the text, image or other visual data has a preferred upright viewing orientation 43. The method according to claim 42, wherein step includes the sub-step of adding the text, image or other visual data to the image such that the preferred upright viewing orientation is at 90 degrees to the first relatively dominant line. 20 44. The method according to any one of claims 39 to 43, wherein the text, image or other visual data is added to the image at a predetermined distance from the first relatively dominant line. 45. An apparatus for adding text, image or other visual data to an image, the 25 apparatus comprising: detecting means for detecting a first visually relatively dominant line embedded within the image and for detecting a second visually relatively dominant line embedded within the text, image or other visual data; adding means for adding the text, image or other visual data to the image, wherein a spatial relationship between the image and said text, image or other visual data is determined depending on an orientation of said first and second visually relatively dominant lines; and means for storing, printing or displaying the image along with the added text, ,Ki image or other visual data. 483420.doc ru ru. I -17- 46. The apparatus according to claim 45, wherein said detecting means detects edges within the image. 47. The apparatus according to claim 46, wherein said detecting means applies an edge weighting factor to the detected edges, such that edges having a greater horizontal component are emphasised. 48. The apparatus according to any one of claims 45 to 47, wherein the text, image or other visual data has a preferred upright viewing orientation 49. The apparatus according to claim 48, wherein said adding means adds the text, image or other visual data to the image such that the preferred upright viewing orientation is at 90 degrees to the first relatively dominant line. 15 50. The apparatus according to any one of claims 45 to 49, wherein the text, image ooooo or other visual data is added to the image at a predetermined distance from the first relatively dominant line. 51. A computer readable medium for storing a program for an apparatus which 20 processes data, said processing comprising a method of adding text, image or other visual data to an image, said program comprising: code for detecting a visually relatively dominant line embedded within the image; code for detecting a second visually relatively dominant line embedded within 25 the text, image or other visual data; code for adding the text, image or other visual data to the image, wherein a spatial relationship between the image and Said text, image or other visual data is determined depending on an orientation of said first and second visually relatively dominant lines; and code for storing, printing or displaying the image along with the added text, image or other visual data. 52. The computer readable medium according to claim 51, said program further O Pz comprising code for detecting edges within the image. -3 0 483420doc 1( -18- 53. The computer readable medium according to claim 52, said program further including code for applying an edge weighting factor to the detected edges, such that edges having a greater horizontal component are emphasised. 54. The computer readable medium according to any one of claims 51 to 53, wherein the text, image or other visual data has a preferred upright viewing orientation The computer readable medium according to claim 54, said program including code for adding the text, image or other visual data to the image such that the preferred upright viewing orientation is at 90 degrees to the first relatively dominant line. 56. The computer readable medium according to any one of claims 51 to 55, wherein the text, image or other visual data is added to the image at a predetermined distance from the first relatively dominant line. 57. A method of generating a final image based on a first image and a second image, substantially as herein described with reference to anyone of the embodiments as •illustrated in the accompanying drawings. 20 58. An apparatus for generating a final image based on a first image and a second .0.0 image, substantially as herein described with reference to anyone of the embodiments as 0: •illustrated in the accompanying drawings. 59. A method of providing advice to a user of an image capture device, substantially 25 as herein described with reference to anyone of the embodiments as illustrated in the accompanying drawings. An apparatus for providing advice to a user of an image capture device, substantially as herein described with reference to anyone of the embodiments as illustrated in the accompanying drawings. 61. A computer readable medium for storing a program for an apparatus which processes data, said processing comprising a method of generating a final image based on Sa first image and a second image, said program being substantially as herein described 483420.doc -19- with reference to anyone of the embodiments as illustrated in the accompanying drawings. 62. A computer readable medium for storing a program for an apparatus which processes data, said processing comprising a method of providing advice to a user of an image capture device, said program being substantially as herein described with reference to anyone of the embodiments as illustrated in the accompanying drawings. 63. A method of adding text, image or other visual data to an image, substantially as herein described with reference to anyone of the embodiments as illustrated in the accompanying drawings. 64. An apparatus for adding text, image or other visual data to an image, substantially as herein described with reference to anyone of the embodiments as 15 illustrated in the accompanying drawings. 65. A computer readable medium for storing a program for an apparatus which :o:processes data, said processing comprising a method of adding text, image or other visual data to an image, said program being substantially as herein described with reference to 20 anyone of the embodiments as illustrated in the accompanying drawings. a DATED this ninth Day of January, 2002 Canon Kabushiki Kaisha Patent Attorneys for the Applicant 25 SPRUSON FERGUSON a a 483420.doc