JP2001045369A - Method and device for composting image and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a panoramic composite image without requiring special knowledge by providing an arrangement information obtaining process for obtaining inter-image arrangement information where adjacent images include a common subject area and a compositing process for the plurality of images through the use of a mapping system corresponding to arrangement information. SOLUTION: An image input part 101 inputs the plurality of images to be used for compositing. An arrangement information setting part 102 sets the arrangement relation of the plurality of inputted images. A mapping system setting part 103 sets the mapping system when a panoramic image is composited based on arrangement information which is set in the part 102. An image composite processing part 104 generates a compositing parameter between the respective images and generates the synthetic image. A display part 105 displays the image obtained by compositing the plurality of images based on the compositing parameter. By the method, the proper mapping system is easily set and the panoramic composite image is obtained without requiring special knowledge.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a method for synthesizing a plurality of images such that adjacent images have a common subject area,
The present invention relates to a technique for generating a composite image.

[0002]

2. Description of the Related Art Conventionally, as shown in FIG. 10, a plurality of images are synthesized to generate a panoramic image.
2. Description of the Related Art There is known a method in which a subject is divided into a plurality of regions, imaged, and combined into one image using image information of a common subject region. FIG. 11 shows FIG. 10 in the XZ plane. As a method of synthesizing a synthesized image, as shown in FIG. 11, a method of mapping each captured image onto one plane 800 and synthesizing the same (plane mapping method), or a virtual cylindrical surface 8 having a radius f.
01 and a method of combining images (cylindrical mapping method). FIG. 12 is a schematic diagram of a composite image obtained when the image is mapped onto the plane 800.

[0003]

However, in the conventional panoramic image synthesizing method, it is necessary to synthesize the images by a predetermined mapping method or to manually set the mapping method by a user.

[0004] For example, when an image panned in the horizontal direction is to be synthesized by a plane mapping, an image having a remarkable distortion at the end of the synthesized image is generated due to a wide horizontal angle of view as shown in FIG. There was something. In addition, when the composition by the plane mapping method is set for an area having a horizontal angle of view of 180 ° or more, it is impossible to perform the composition by mapping to one plane, which may cause a serious problem in the apparatus. There was sex.

Further, as shown in FIG. 10, not only a method of photographing while rotating (panning) in the horizontal direction but also a method of photographing while rotating (tilting) in the vertical direction as shown in FIG. It is cumbersome to specify an appropriate mapping method corresponding to various shooting methods such as a method of shooting with a mixture of rotations (pan / tilt), and users who do not have sufficient knowledge For
Choosing an appropriate mapping scheme has been difficult.

Accordingly, an object of the present invention is to provide an image synthesizing method, an image synthesizing apparatus, and a recording medium which can easily set a mapping method when performing image synthesizing.

[0007]

In order to solve the above-mentioned problems, a first aspect of the present invention provides an arrangement information acquisition method for acquiring arrangement information between a plurality of images in which adjacent images include a common subject area. And a synthesizing step of synthesizing the plurality of images using a mapping method according to the arrangement information.

Further, the second invention according to the present application further includes a focal length obtaining step of obtaining information on a focal length of an image, and in the synthesizing step, a mapping method according to the information on the focal length and the arrangement information. Is used.

[0009] The third invention according to the present application further comprises:
The method has a changing step of changing the mapping method.

A fourth invention according to the present application provides a warning when an image formed by changing a mapping method in a changing step violates a predetermined condition set in advance according to a mapping method. A step of generating a composite image suitable for predetermined conditions.

A fifth invention according to the present application is characterized in that when displaying a composite image, a rectangular area not including a blank is displayed so as to be cut out.

[0012]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS (First Embodiment) FIG. 1 is a schematic diagram of a panoramic image synthesizing method and apparatus according to a first embodiment of the present invention. In FIG. 1, reference numeral 101 denotes an image input unit for inputting a plurality of images used for synthesis. Reference numeral 102 denotes an arrangement information setting unit which sets the arrangement relationship of a plurality of input images. A mapping method setting unit 103 automatically sets the mapping method of the composite image based on the information of the arrangement information setting unit. Reference numeral 104 denotes an image synthesis processing unit that generates a synthesis parameter between images to generate a synthesized image. 105 is
A display unit for displaying a composite image in which the plurality of images are composited based on the composite parameter; 10
Reference numeral 7 records and stores the synthesized result image on a recording medium or the like.

At 101, a plurality of images are input. The image may be input by reading an image recorded on a recording medium such as a magnetic disk, or by reading from a non-volatile memory or the like that holds an image signal obtained through an imaging system such as a digital camera. The plurality of read images are temporarily stored in the memory 120. The plurality of images are read from the memory 120 and are displayed on the display 12 for arrangement.
2 is displayed. Reference numeral 200 in FIG. 2 is a schematic diagram of a screen for arrangement. The user sets an arrangement between a plurality of images on the screen 200. The setting method is as follows.
It is also possible to set each image by moving it on the screen by an instruction means such as the above, or to input and set a symbol indicating the position of the image.

In a camera or the like, by recording information on the arrangement at the time of photographing, the arrangement information recorded together with the image can be read at the time of image input, and the arrangement information can be automatically set based on this arrangement information. is there.

FIG. 3 shows an arrangement pattern. FIG. 3 (a)
FIG. 3B shows an arrangement in a case where images are taken in a one-dimensional horizontal direction.
FIG. 3C shows the arrangement when the image is taken in a one-dimensional vertical direction, and FIG. 3C shows the arrangement when the image is taken in a two-dimensional tile shape.

The mapping method setting unit 103 sets a mapping method for synthesizing a panoramic image based on the arrangement information set by the arrangement information setting unit 102 described above.

FIG. 3 shows an example of what kind of mapping system is set depending on the arrangement between a plurality of images. In the setting of the mapping method, when the arrangement of a plurality of images is one-dimensional in the horizontal direction, the mapping is performed so as to stick to the surface of the vertical cylinder shown in FIG. When the arrangement is one-dimensional in the vertical direction as shown in FIG. 3B, the composite image is mapped on the surface of the horizontal cylinder in which the cylinder is turned sideways. Furthermore, when they are arranged in a two-dimensional tile as shown in FIG. 3C, they are mapped so as to stick to the surface of the sphere as shown in FIG. 3C.

With the above setting, for example, when the image is taken in a one-dimensional horizontal direction, the horizontal angle of view of the composite image is widened (maximum 360 °), so that the vertical cylinder as shown in FIG. By setting the mapping, the composite image can represent the entire shooting range. In the case of other arrangements as well, by automatically setting an appropriate mapping method in the same manner, it is possible for the composite image to represent the entire photographing range.

When the mapping method is set at 103 as described above, an image synthesizing process is executed at 104 next. After the mapping method is determined, for example, Japanese Patent Application Laid-Open No. 9-32204
The synthesis parameters are generated by the method described in No. 0.
FIG. 5 shows a processing flow of the image synthesis processing unit 104.

At 501, corresponding points between images are extracted using image information of a common subject area between two adjacent images as shown in FIG. A known technique such as a correlation method or a template matching method can be used as a method for extracting corresponding points.

The synthesis parameters are generated using the corresponding point information extracted in 501. The parameters are generated by, for example, as shown in FIG. 4, in two adjacent images, a point P (x, y, z) on the image 401 and a corresponding point on the image 402 are represented by P ′ (x ′, y ′). , z ')

[0022]

[Outside 1] Thus, the relationship between each pixel on two images can be expressed by _eight parameters (m _{1 to} m ₈ ), and the equation (1)
The above eight parameters (m _{1 to} m ₈ ) may be calculated by solving eight simultaneous equations using the coordinates of the corresponding points. Also, by using more corresponding point information,
If optimization processing such as the least square method is performed, parameters can be estimated more accurately.

When the point P 'is mapped on the plane at the same distance 1 as the imaging plane of the point P, (u', v ') as XY coordinates is u'
= x '/ z', v '= y' / z '.

The parameters generated at 502 are:
It is a relational expression between two images. That is, it is obtained as a parameter based on the coordinate system of the image 401 in FIG. In thus 503, parameters with respect to a reference coordinate system in the synthesis of all images the parameter (M ₁ ~
M ₈ ).

At 504 and 505, the reference numeral 103 in FIG.
The processing branches to each of the mapping synthesis processes 506 to 508 in accordance with the mapping method set in.

In the following, each mapping synthesis process will be described.

At 506, vertical cylinder mapping synthesis is executed. The vertical cylinder mapping is for generating a composite image mapped to a vertical cylinder as shown in FIG. FIG. 6 (a)
Is an outline of a vertical cylinder-mapped composite image. Reference numeral 601 denotes a synthesized image, and the horizontal axis represents θ (deg.) And the vertical axis represents v. Therefore, the horizontal direction can represent a range of -180 deg. To +180 deg.

FIG. 7 shows a cross section of a vertical cylinder. In FIG. 7, reference numeral 701 denotes a cross section along a line 610 of the composite image 601 obtained by vertical cylinder mapping in FIG. 6A.
The radius of the cylinder is 1. Point P in FIG.
(θ, v) represents the same point as point P in FIG. In order to perform the mapping synthesis, a point P (θ, v) on the cylindrical surface is defined by XY as follows.
Convert to Z reference coordinate system.

X = sin θ y = v− (2) z = cos θ

From the transformed coordinates (x, y, z), from equation (1),
The coordinates (x ′, y ′, z ′) corresponding to the point P (θ, v) are known, and the coordinates are used to synthesize an image with reference to the pixel value. As described above, conversion of u ′ = x ′ / z ′, v ′ = y ′ / z ′ is performed, and the pixel value of the coordinates (u ′, v ′) of the point P on the image is referred to. Is also good.

In the vertical cylinder mapping synthesis 506, a pixel value of coordinates corresponding to each point (θ, v) in FIG. 6A is generated by the above method to obtain a synthesized image.

The horizontal cylinder mapping synthesis of 507 generates the XYZ coordinates corresponding to the point P (u, φ) on the composite image 602 by the horizontal cylinder mapping of FIG.

X = u y = sin φ− (3) z = cos φ

The horizontal cylinder mapping synthesis obtains the pixel value of the corresponding point by the same calculation as that of the vertical cylinder mapping synthesis described above, and the description thereof will be omitted.

In the spherical mapping synthesis 508, a composite image is generated by spherical mapping as shown in FIG. The horizontal axis of the composite image indicates the horizontal angle of view, the vertical axis indicates the vertical angle of view, and the horizontal direction is
-180deg. To + 180deg., Vertical direction is -90deg. To + 90de
g. can be expressed. Point P (θ,
φ) is converted into XYZ coordinates by the following equation as shown in FIG.

X = cosφsinθ y = sinφ− (4) z = cosφcosθ

The radius of the sphere is 1.

Hereinafter, a synthesized image is generated by obtaining pixel values of corresponding points in the same manner as in the above-described synthesis.

The generated panoramic composite image is displayed on the display 122 by the composite image display unit 105 of FIG.
Further, the image can be recorded and stored in the recording medium 121 such as a magnetic disk by the composite image storage unit 107.

It is needless to say that the recording medium is not limited to the magnetic disk but may be a known one.

As described above, by setting the optimum mapping method based on the image arrangement information, the mapping method can be easily set. In addition, by automatically setting the mapping method based on the arrangement information, it is possible to save the trouble of manually setting the mapping method at the time of combining, and to obtain a panoramic composite image without requiring special knowledge.

Note that an appropriate mapping method may be notified, and then the actual mapping method at the time of image composition may be designated. In this case, the user is required to take some trouble,
After recognizing an appropriate mapping method, it is possible to give flexibility in selecting a mapping method such that a different mapping method can be selected.

(Second Embodiment) FIG. 9 shows a second embodiment according to the present invention.
FIG. 2 is a block diagram of a panoramic image synthesizing method and apparatus according to the embodiment. Characteristic parts in this embodiment are a mapping method setting unit 110, an image synthesis processing unit 109, and a mapping method changing unit 1.
08. Components having the same reference numerals as those in the other first embodiment are the same and will not be described.

Reference numeral 110 denotes a mapping system setting unit, whose basic operation is the same as that of the first embodiment. Based on the arrangement information 102, each mapping of a vertical cylinder in the case of one-dimensional horizontal direction, a horizontal cylinder in the case of one-dimensional vertical direction, and a spherical surface in the case of a two-dimensional tile shape is set. However, the mapping method setting unit 1 of the present embodiment
Numeral 10 obtains information on the focal length of an image from a focal length acquisition unit (not shown). Then, a horizontal angle of view Wh and a vertical angle of view Wv of the image are generated from the focal length information.

Next, when the mapping set by the arrangement information is, for example, a vertical cylinder, the vertical field angle Wv is referred to and compared with a predetermined reference value. Here, when Wv is larger than the reference value, the mapping is changed from a vertical cylinder to a spherical mapping. This is because conversion processing similar to plane mapping is performed in the vertical direction of the vertical cylinder, and when the angle of view is wide, image quality in the periphery is significantly deteriorated. As described above, by setting the mapping method using the information on the focal length and the like, it is possible to select a more accurate mapping method.

In the above example, the mapping system is selected once based on the array information, and then the mapping system can be changed with reference to the horizontal angle of view Wh and the vertical angle of view Wv. From the beginning, the mapping method may be selected using the arrangement information and the information on the angle of view.

The mapping system changing means may be provided separately from the mapping system setting section 110 so that the mapping system can be changed according to an instruction from the user. Using the information on the angle of view, some suitable mapping methods may be automatically selected, and the user may be able to select from them.

In such a configuration, a suitable mapping method can be selected even when the mapping method is changed.

An image synthesizing unit 109 has the same basic operation as that of the first embodiment. Synthesis processing unit 1 of the present embodiment
FIG. 13 is a schematic diagram of the vertical cylinder map synthesis according to the embodiment 09. In FIG. 13A, a hatched portion is a blank portion, and indicates a region not included in the visual field of the captured image. The composite image is basically generated as an image including a margin as shown in FIG. However, a rectangular image area 900 that does not include a margin at the same time.
Is calculated and displayed together with the synthesized image by a dotted line or the like as shown in FIG.

In the image combining / storing unit 107, it is also possible to selectively save only the inside of the dotted line area. As a result, it is possible to print or save only an area having no margin.

Further, a region occupied by each of the N images in the composite image is generated and stored in an angle expression. That is, the area Sk occupied by the image k is (θmin, φmin, θmax, φmax)
And stored in a memory or the like (not shown).

Reference numeral 108 denotes a mapping system changing unit which arbitrarily changes the mapping of the composite image. The basic mapping method is automatically set by 110, but it is possible to convert the image into an arbitrary mapping after confirming the generated composite image.

Here, the operation of 108 will be described.

FIG. 14 shows a case where the image obtained by combining the vertical cylinder map shown in FIG. 13A is changed to a plane map. As shown in FIG. 14, the image converted to the planar mapping becomes an image that is greatly enlarged as the angle of view becomes wider. In the plane mapping method, the theoretical angle of view range is less than -90 deg. To less than +90 deg., And is substantially narrower. Therefore, in the mapping change unit, the displayable angle of view range is set in advance according to the type of the mapping to be changed. Then, when the mapping is changed, a warning is issued if a predetermined displayable angle of view range set in accordance with the type of the mapping is exceeded by referring to the area Sk occupied in the entire image range of each image generated in 109. Emits. Then, only a composite image within a predetermined angle of view range is generated and displayed. Thus, even when the mapping method is inappropriately changed, the user can obtain a composite image while recognizing the abnormal operation.

FIG. 15 is a schematic diagram of the image changed to the plane mapping in 108, and generates only a composite image within the displayable angle of view Rθ. Further, the image area not including the margin is also recalculated at the same time and is shown by a dotted line.

The composite image display unit 105 displays the size of the composite image as image information not only in pixels but also in units of angles. FIG. 16 is an outline of displayed image information. Further, the user sets the image range to be stored by the input unit 111 in pixel units or angle units. The set image range is indicated by a dotted line on the composite image on the composite image display unit 105.

Further, according to the set image range, the image synthesizing and storing unit 107 records and stores the synthesized image on a recording medium or the like. It is also possible to convert the image size to an arbitrary scale at the time of storage and record it.

(Third Embodiment) In a panoramic image synthesizing method and apparatus according to a third embodiment of the present invention, the mapping selected with respect to the above-described embodiment is divided into two types, a plane mapping and a vertical cylinder mapping. It is limited. This is because it is possible to reduce the processing load by limiting the types of mapping.

FIG. 17 is a block diagram showing a panoramic image synthesizing method and apparatus according to the present invention. In this embodiment,
Since the types of mapping are limited to plane and vertical cylinder mapping, the mapping method setting unit 130 is different from the other embodiments. Hereinafter, the operation of 130 will be described.

At 130, the number of horizontal and vertical images is calculated based on the arrangement information set at 102. For longitudinal n Like wherein laterally m sheets, the comparison process is performed with a reference value T _m and T _n in the lateral and longitudinal number set in advance. The mapping method is set as follows based on the result of the comparison. 1) m ≦ T plane mapping 2 when _m and n ≦ T _n) vertical cylindrical mapping that is, when other than the above, the angle of the synthesized image in the case the number of images is less it is expected that not so large, In other words, it is thought that the distortion of the image around the composite image will not be large,
When the number of images is equal to or less than the reference value, the plane mapping is selected. However, when the value exceeds the reference value, the possibility of deterioration due to distortion increases, so that the vertical cylindrical mapping is selected.

In the case of the vertical cylindrical mapping, the vertical direction of the composite image is subjected to the same coordinate conversion processing as that of the plane mapping. Therefore, when the vertical angle of view of the composite image is widened, the image quality of the peripheral portion is deteriorated, and Sometimes it doesn't make sense. Therefore, as shown in the second embodiment, a reference value of a viewable angle of view may be provided, and only an image within the reference value may be generated as a composite image.

In the above method, the mapping is set using only the arrangement information of the image. However, the focal length f at the time of photographing is obtained by means not shown, and m ≦ T _m and n ≦ T _n and f When ≧ T _f Planar mapping In cases other than the above It is also possible to set the mapping method as a vertical cylindrical mapping.

Further, although a plane mapping and a vertical cylinder mapping are set here as a combination of mappings, it goes without saying that other mapping combinations may be used. For example m ≧ T _m and may be set with n ≦ T _n if the vertical cylindrical mapping m ≦ T _m and the horizontal cylindrical mapping if n ≧ T _n. Also, it is naturally possible to add a plane mapping to the mappings of the first and second embodiments so that the plane mapping can be set by the above-described method. By using the vertical and horizontal numbers of images as the arrangement information, the mapping method can be determined by a simple calculation process.

The present invention can be applied to a system composed of a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.) or an apparatus composed of one device (for example, a copying machine, a facsimile machine). May be applied.

In order to operate various devices so as to realize the functions of the above-described embodiment, a computer connected to the various devices or a computer in a system is provided with software for realizing the functions of the above-described embodiments. The present invention includes a program code supplied and executed by operating a computer (CPU or MPU) of the system or apparatus according to a stored program to operate the various devices.

In this case, the program code of the software implements the functions of the above-described embodiment, and the program code itself and means for supplying the program code to the computer, for example, the program code The storage medium storing the information constitutes the present invention.

As a storage medium for storing such a program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, magnetic tape, nonvolatile memory card, ROM or the like can be used.

When the computer executes the supplied program code, not only the functions of the above-described embodiment are realized, but also the program code is
Needless to say, even when the functions of the above-described embodiments are realized in cooperation with an OS (operating system) running on a computer or other application software, such program codes are included in the embodiments of the present invention. No.

Further, the supplied program code is stored in a memory provided in a function expansion board of the computer or a function expansion unit connected to the computer, and then stored in the function expansion board or the function storage unit based on the instruction of the program code. It is needless to say that the present invention also includes a case where a provided CPU or the like performs a part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

[0070]

As described above, the first embodiment according to the present application is described.
According to the invention of the above, the plurality of images are synthesized using an arrangement information acquiring step of acquiring arrangement information between a plurality of images in which adjacent images include a common subject area, and a mapping method according to the arrangement information. With this configuration, an appropriate mapping method can be easily set, and a panoramic composite image can be obtained without requiring special knowledge.

According to the second aspect of the present invention,
There is a focal length acquisition step of acquiring information on the focal length of the image. In the synthesizing step, a mapping method according to the information on the focal length and the arrangement information is used, so that a more accurate mapping method can be selected.

According to the third invention of the present application,
Furthermore, since there is a change step for changing the mapping method, it is possible to provide flexibility in selecting a mapping method, for example, a different mapping method can be selected.

According to the fourth aspect of the present invention,
Since the image formed by changing the mapping method in the changing step is to issue a warning when a predetermined condition set in advance according to the mapping method is violated, and has a step of generating a composite image suitable for the predetermined condition, Even when the mapping method is inappropriately changed, the user can obtain a composite image while recognizing the abnormal operation.

According to the fifth invention of the present application,
When displaying the composite image, a rectangular area that does not include a margin is displayed so as to be cut out, so that only an area without a margin can be cut out and printed or saved.

[Brief description of the drawings]

FIG. 1 is a block diagram of a first embodiment.

FIG. 2 is a schematic diagram of an arrangement screen.

FIG. 3 is a schematic diagram of a mapping method setting.

FIG. 4 is an explanatory diagram of synthesis parameters.

FIG. 5 is a processing flow of the first embodiment.

FIG. 6 is a schematic diagram of a mapped composite image.

FIG. 7 is an explanatory diagram of a vertical cylinder mapping.

FIG. 8 is an explanatory diagram of a spherical mapping.

FIG. 9 is a block diagram of a second embodiment.

FIG. 10 is a schematic diagram of photographing.

FIG. 11 is a schematic diagram of mapping synthesis.

FIG. 12 is a schematic diagram of plane map synthesis.

FIG. 13 is a schematic diagram of a composite image.

FIG. 14 is a schematic diagram of a plane mapping.

FIG. 15 is a schematic diagram of a displayable range.

FIG. 16 is a schematic diagram of displayable range setting.

FIG. 17 is a block diagram of a third embodiment.

[Explanation of symbols]

 Reference Signs List 101 image input unit 102 arrangement information setting unit 103 mapping method setting unit 104 image synthesis processing unit 105 synthesized image display unit 107 synthesized image storage

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Kenji Hatori 3-30-2 Shimomaruko, Ota-ku, Tokyo Inside Canon Inc. (72) Inventor Kotaro Yano 3-30-2 Shimomaruko, Ota-ku, Tokyo Incorporated F term (reference) 5B057 CD20 CE10 DA07 5C023 AA11 AA14 AA34 AA37 AA38 BA11 BA13 CA01 DA01 DA04 DA08

Claims (13)

[Claims] An arrangement information acquiring step of acquiring arrangement information between a plurality of images in which adjacent images include a common subject region, and combining the plurality of images using a mapping method according to the arrangement information. A synthesizing step. 2. The image synthesizing method further includes a focal length obtaining step of obtaining information on a focal length of an image,
2. The image synthesizing method according to claim 1, wherein the synthesizing step uses a mapping method according to the information on the focal length and the arrangement information. 3. The image synthesizing method according to claim 1, further comprising a changing step of changing a mapping method. 4. The image synthesizing method further includes issuing a warning when an image formed by changing the mapping method in the changing step violates a predetermined condition set in advance according to the mapping method. 4. The method according to claim 3, further comprising the step of generating a composite image suitable for the image processing. 5. The image synthesizing method according to claim 1, further comprising displaying a rectangular area that does not include a margin in the synthesized image so as to be able to be cut out. 6. An arrangement information acquisition unit for acquiring arrangement information between a plurality of images in which adjacent images include a common subject area, and combining the plurality of images using a mapping method according to the arrangement information. An image synthesizing apparatus, comprising: synthesizing means. 7. The image synthesizing apparatus further includes a focal length obtaining unit configured to obtain information on a focal length of an image,
The image synthesizing apparatus according to claim 6, wherein the synthesizing unit uses a mapping method according to the information on the focal length and the arrangement information. 8. The image synthesizing apparatus according to claim 6, further comprising changing means for changing a mapping method. 9. The image synthesizing apparatus further issues a warning when an image formed by changing a mapping method by the mapping method changing means violates a predetermined condition set in advance according to a mapping method, 9. The image synthesizing apparatus according to claim 8, further comprising a step of generating a synthesized image suitable for a predetermined condition. 10. The image synthesizing apparatus according to claim 6, wherein a rectangular area not including a margin is displayed so as to be able to be cut out in the synthesized image. 11. A storage medium storing a program for causing an image synthesizing method for synthesizing a plurality of images to be read and executed by a computer, wherein an adjacent image includes a plurality of images including a common subject area. A storage medium storing a program for causing an arrangement information acquiring step of acquiring arrangement information and a combining step of combining the plurality of images using a mapping method according to the arrangement information. 12. A method according to claim 11, further comprising a focal length obtaining step of obtaining information on a focal length of the image, wherein said synthesizing step uses a mapping method according to the information on the focal length and the arrangement information. The storage medium according to claim 11. 13. The recording medium according to claim 11, further comprising a changing step of changing a mapping method.