JP2000215301A - Image processor, image processing method and computer readable recording medium recording program for making computer execute the method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow even a beginner to produce a pan-focus image with a simple operation in an image processor which is provided with a displaying part displaying an image on a display screen and edits and processes the image displayed on the displaying part. SOLUTION: This image processor is provided with a display controlling part 307 which controls a displaying part 308 and simultaneously shows plural images photographed at almost the same position, a designating part 401 which designates plural optional common points of the plural images with one another shown by the part 307, a positioning means part 402 which positions the plural images with one another on the basis of the coordinates positions of the plural designated optional common points, a pan-focus image generating part 403 which generates one or plural pan-focus images on the basis of the positioned images and an image data storing part 104 which stores one or plural generated pan-focus images.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus, an image processing method, and an image processing method for displaying an image on a display screen, editing the displayed image, and retrieving the edited image. The present invention relates to a computer-readable recording medium storing a program to be executed by a computer.

[0002]

2. Description of the Related Art In recent years, in digital color images, which are mainly used in a multimedia society, it has been considered that a use form in which a plurality of persons simultaneously observe a large screen and a high definition image will increase. Since the image to be used in such an application may have a different portion to be noticed depending on the person, it is important that the entire image be in focus, that is, a pan-focus image.

In order to realize this pan-focus image,
A method of synthesizing a single omnifocal image from a plurality of images having different focal lengths has been considered (for example, “Kodama, Naito, Aizawa, Toba:“ Reconstruction ", 1995 Annual Conference of the Institute of Television Engineers of Japan, PP. 149-150").

[0004] In this method, two images are used, one of which is photographed with the focus adjusted to the statistics, and the other is photographed with the focus adjusted to the foreground. The scaling process is performed so that the size of the same subject in the two images captured in this manner is exactly equal. Then, both images are superimposed exactly and scanned while comparing in pixel units. At this time, the target pixel areas of the quantity images are compared, and the pixel with the higher sharpness is adopted as the composite image.

[0005]

However, in the above-mentioned prior art, it is easy to make the size of the subject the same by photographing the same subject from the same distance. In order to accurately superimpose images, it is common that an operator compares a plurality of images, extracts a feature point common to the plurality of images, and designates the feature point. . This operation is extremely difficult for a beginner to perform these operations efficiently, regardless of the skilled person. In particular, since the plurality of images have different focuses, that is, one of them is out of focus, even a skilled person can efficiently extract feature points common to the images accurately. However, there is a problem that the working efficiency is reduced.

SUMMARY OF THE INVENTION The present invention solves the above-described problems of the prior art, and enables an image processing apparatus, an image processing method, and a computer to execute a pan-focus image by a simple operation even for a beginner. It is an object of the present invention to provide a computer-readable recording medium on which a program is recorded.

[0007]

Means for Solving the Problems The above-mentioned problems are solved,
In order to achieve the object, an image processing apparatus according to the present invention comprises a display unit for displaying an image on a display screen, wherein the image processing apparatus edits and processes an image displayed on the display unit. Display control means for controlling the means and simultaneously displaying a plurality of images taken from substantially the same position, and designation means for designating a plurality of arbitrary common points between the plurality of images displayed by the display control means. Positioning means for performing positioning between the plurality of images based on the coordinate positions of arbitrary common points specified by the plurality of specifying means; and one or more based on the images positioned by the positioning means. Pan focus image generating means for generating a pan focus image, and one or more pan focus images generated by the pan focus generating means A pan-focus image storage means for storing, and further comprising a.

According to the first aspect of the present invention, when a common point is specified, a plurality of common points can be specified, and respective results can be displayed, so that optimum alignment can be easily performed. be able to.

The image processing apparatus according to a second aspect of the present invention is characterized in that, in the first aspect of the present invention, the display control means further displays a grid on the plurality of images.

According to the second aspect of the present invention, since the grid is displayed, it can be used as a guide when specifying the common point, and the common point can be specified more easily.

An image processing apparatus according to a third aspect of the present invention is the image processing apparatus, further comprising display means for displaying an image on a display screen, and editing and processing the image displayed on the display means. A first display control means for simultaneously displaying a plurality of images taken from substantially the same position, and a plurality of images displayed by the first display control means in a divided area of a predetermined size for each image. Image partitioning means for partitioning, designating means for designating an arbitrary common partitioned area among the displayed images among the partitioned areas partitioned by the image sorting means, and a plurality of designated by the designating means. A positioning unit that performs positioning between the plurality of images based on a coordinate position of an arbitrary common partitioned area; and an image that is positioned by the positioning unit. A pan-focus image generating means for generating a down-focus image, comprising the.

According to the third aspect of the present invention, when a common point is specified, it can be specified not by a point (point) but by a predetermined area, so that optimum alignment can be performed by an easier operation. Can be.

According to a fourth aspect of the present invention, in the image processing apparatus according to the third aspect of the present invention, the image processing apparatus further controls the display means to enlarge and display the common section area designated by the designation means. A display control means is provided.

According to the fourth aspect of the present invention, the specified predetermined area can be enlarged and displayed, so that the alignment can be performed more reliably by referring to the enlarged display.

According to a fifth aspect of the present invention, there is provided the image processing apparatus, further comprising: display means for displaying the image on a display screen, wherein the image processing apparatus edits and processes the image displayed on the display means. And a display control means for simultaneously displaying the first and second images taken from substantially the same position, and an optional common part of the first image and the second image displayed by the display control means. A designating means for designating a point, and positioning of the plurality of images based on a coordinate position of an arbitrary common point designated by the designating means, and a coordinate position near an arbitrary common point of the second image Positioning means for positioning the plurality of images based on the plurality of images, and a pan for generating a plurality of pan-focus images based on the plurality of images aligned by the positioning means. And scum image generating means, characterized in that and a pan-focus image storage means for storing a plurality of pan-focus image produced by the pan-focus generating means.

According to the fifth aspect of the present invention, by specifying an arbitrary point, points in the vicinity thereof are simultaneously specified,
By comparing the results, alignment can be easily performed.

An image processing apparatus according to a sixth aspect of the present invention is the image processing apparatus, further comprising display means for displaying an image on a display screen, wherein the image processing apparatus edits and processes the image displayed on the display means. To simultaneously display the first and second images taken from substantially the same position.
Display control means, designating means for designating any common point between the first and second images displayed by the first display control means, and display means for the first and second images designated by the designating means. A first coordinate position storage unit that stores a coordinate position of an arbitrary common point as a coordinate position for generating a reference image; and a first coordinate position storage unit that stores an arbitrary common point of the second image stored by the first coordinate position storage unit. A second coordinate position storing means for storing a coordinate position shifted by a predetermined coordinate in the vertical axis direction and / or the horizontal axis direction with respect to the coordinate position; and a coordinate position stored by the first coordinate position storing means. A first alignment unit that aligns the first and second images, and a second alignment unit that aligns the first and second images based on the coordinate positions stored by the second coordinate position storage unit. Positioning means, first pan-focus image generating means for generating a pan-focus image serving as the reference image based on the image positioned by the first positioning means, and positioning by the second positioning means A second pan-focus image generating means for generating a pan-focus image serving as a peripheral image based on the image thus obtained, and controlling the display means to generate a pan-focus image at a predetermined position on the display screen by the first pan-focus image generating means. Displaying the reference image thus obtained, and displaying the peripheral image generated by the second pan-focus image generating means with the coordinate position for generating the reference image stored by the first and second coordinate position storage means and the peripheral position. Around the reference image around the reference image corresponding to the relationship with the coordinate position for generating the image A second display control means for displaying the serial reference image to place in a state of surrounding the n layer, characterized by comprising a.

According to the sixth aspect of the present invention, it is possible to change the parameter value of the reference image while referring to the peripheral image. In particular, since the peripheral images are arranged near the reference image along the vertical and horizontal axes, it is possible to intuitively recognize the shift of the common point, and to generate an optimal pan-focus image. It can be done efficiently.

The image processing apparatus according to a seventh aspect of the present invention is the image processing apparatus according to the sixth aspect, further comprising: a peripheral image designation for designating one peripheral image from a plurality of peripheral images displayed on the display means. Means, wherein the first coordinate position storage means determines a coordinate position for generating a peripheral image designated by the peripheral image designation means among the coordinate positions stored by the second coordinate position storage means as a reference image. Is stored as a coordinate position for generating.

According to the seventh aspect of the present invention, a desired image can be efficiently obtained because the peripheral image can be easily changed.

According to an eighth aspect of the present invention, in the image processing apparatus according to the seventh aspect of the present invention, there is provided a pan-focus image storage for storing the pan-focus images generated by the first and second pan-focus image generating means. Means, wherein the second display control means, if the pan focus image stored by the storage means as the peripheral image when the peripheral image is specified by the peripheral image specifying means, the corresponding pan focus image Is displayed as a peripheral image.

According to the eighth aspect of the present invention, when the peripheral image is redisplayed, the already generated peripheral image can be used, so that the processing speed of the redisplay can be improved.

According to a ninth aspect of the present invention, in the image processing method of displaying an image on a display screen and editing the displayed image, a plurality of images taken from substantially the same position are provided. Simultaneously displaying, a specifying step of specifying a plurality of arbitrary common points among a plurality of images displayed by the displaying step, and a coordinate position of an arbitrary common point specified by the specifying step. A positioning step of positioning the plurality of images, and a pan-focus image generating step of generating one or more pan-focus images based on the images aligned in the positioning step. Features.

According to the ninth aspect of the present invention, when specifying a common point, a plurality of common points can be specified and the respective results can be displayed, so that optimum alignment can be easily performed. be able to.

According to a tenth aspect of the present invention, in the image processing method according to the ninth aspect, the display control step includes the step of:
Further, a grid is displayed on the plurality of images.

According to the tenth aspect of the present invention, since the grid is displayed, it can be used as a guide when specifying a common point, and the common point can be specified more easily.

An image processing method according to an eleventh aspect of the present invention is the image processing method of displaying an image on a display screen and editing and processing the displayed image. A first display step of simultaneously displaying
An image division step of dividing the plurality of images displayed by the first display step into division areas of a predetermined size for each image;
A designation step of designating an arbitrary common division area between the displayed plurality of images among the division areas divided by the image division step; and coordinates of the plurality of arbitrary common division areas designated by the designation step A positioning step of performing positioning of the plurality of images based on a position, and a pan-focus image generating step of generating a pan-focus image based on the image positioned by the positioning step. Features.

According to the eleventh aspect of the present invention, when specifying a common point, it is possible to specify not a point but a predetermined area, so that optimum positioning can be performed by an easier operation. Can be.

The image processing method according to a twelfth aspect of the present invention is the image processing method according to the eleventh aspect, further comprising a second display step of enlarging and displaying the common section area specified by the specifying step. And

According to the twelfth aspect of the present invention, the specified predetermined area can be displayed in an enlarged manner, so that the alignment can be performed more reliably by referring to the enlarged display.

An image processing method according to a thirteenth aspect of the present invention is the image processing method of displaying an image on a display screen and editing and processing the displayed image. A display step of simultaneously displaying a second image; and a first image and a second image displayed by the display step.
A specifying step of specifying an arbitrary common point of the images, and performing position alignment of the plurality of images based on a coordinate position of the arbitrary common point specified by the specifying step, and performing an arbitrary common point of the second image. An alignment step of aligning the plurality of images based on coordinate positions near a point, and a pan-focus image generating step of generating a plurality of pan-focus images based on the plurality of images aligned in the alignment step And a step.

According to the thirteenth aspect of the present invention, any one
By specifying a point, points in the vicinity of the point are specified at the same time, and the results can be compared to easily perform alignment.

An image processing method according to a fourteenth aspect of the present invention is an image processing method for displaying an image on a display screen and editing and processing the displayed image. A first display step of displaying the second image simultaneously; a designation step of designating any common point of the first and second images displayed by the first display step;
The coordinate position of an arbitrary common point of the first and second images specified in the specifying step is set as a coordinate position for generating a reference image, and the first and second images are aligned based on the coordinate position. And a coordinate position shifted by a predetermined coordinate in the vertical axis direction and / or the horizontal axis direction with respect to the coordinate position of an arbitrary common point of the second image specified in the specifying step. A second alignment step of aligning the first and second images based on the first and second images, and a first focusing step of generating a pan-focus image serving as the reference image based on the images aligned in the first alignment step. A pan-focus image generating step, and a second pan-focuser for generating a pan-focus image serving as a peripheral image based on the image aligned in the second alignment step An image generating step, and displays the reference image generated by the first pan-focus image generation step in a predetermined position on said display screen, said second
The peripheral image generated in the pan-focus image generating step is related to the relationship between the coordinate position for generating the reference image and the coordinate position for generating the peripheral image, and the reference image is centered on the reference image. And a second display step of displaying the reference image so as to surround the reference image in n layers.

According to the fourteenth aspect, the parameter value of the reference image can be changed while referring to the peripheral image. In particular, the vertical axis near the reference image
Since peripheral images are arranged corresponding to the horizontal axis,
It is possible to intuitively recognize the shift of the common point, and it is possible to efficiently generate an optimal pan-focus image.

The image processing method according to a fifteenth aspect of the present invention is the image processing method according to the fourteenth aspect, further comprising the step of specifying one peripheral image from the plurality of peripheral images displayed in the second display step. A coordinate position for generating a peripheral image specified by the peripheral image specifying step, among coordinate positions for performing alignment in the second positioning step, including an image specifying step; Is a coordinate position for generating a reference image.

According to the fifteenth aspect, a desired image can be obtained efficiently because the peripheral image can be easily changed.

According to a sixteenth aspect of the present invention, in the image processing method according to the fifteenth aspect, the second display step means sets the peripheral image as the peripheral image when the peripheral image is designated by the peripheral image finger step. When the stored pan-focus image generated by the first and second pan-focus image generation steps is applicable, the corresponding pan-focus image is displayed as a peripheral image.

According to the sixteenth aspect, when the peripheral image is redisplayed, the already generated peripheral image can be used, so that the processing speed of the redisplay can be improved.

In the storage medium according to the seventeenth aspect of the present invention, a program for causing a computer to execute the method according to any one of the ninth to sixteenth aspects is recorded, so that the program becomes machine-readable. Item 9
Operations 16 to 16 can be realized by a computer.

[0040]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of an image processing apparatus, an image processing method, and a computer readable recording medium according to the present invention are described below with reference to the accompanying drawings. The form will be described in detail.

(Embodiment 1) First, the configuration of an entire image-attached document creation system including an image processing apparatus according to Embodiment 1 of the present invention will be described. FIG. 1 is an explanatory diagram functionally showing the configuration of an entire image-attached document creation system including an image processing apparatus according to Embodiment 1 of the present invention. As shown functionally in FIG. 1, this image-attached document creation system includes an input unit 101 and a processing unit 102.
And an image processing apparatus 100 comprising an output unit 103
And the host computer system 105 via a network such as a LAN.

The input unit 101 performs an image capturing process, and includes, for example, a scanner, an IC card, a digital still camera, a photo CD reader, and the like. The input unit 101 captures an image and converts the captured image into a predetermined file format.
Send to 2.

The processing section 102 performs processing such as registration, deletion, and modification of an image captured by the input section 101, and is performed using, for example, a personal computer (PC). The image data storage unit 104 provided in the processing unit 102 or externally attached to the processing unit 102 includes, for example, a hard disk, a floppy disk, a rewritable CD-ROM, an MO, and a DVD built in the PC. For example, the image data processed by the processing unit 102 is stored.

Further, the processing unit 102 searches the image data stored in the image data storage unit 104, pastes the searched image data to another document, and performs display control such that the document is displayed on a display. Print control is performed so as to print on the output unit 103.

The output unit 103 prints the image data and the document including the image data, the printing of which is controlled by the processing unit 102. For example, a laser printer or a digital copier capable of printing in black and white and full color is included. The output unit 103 also includes a printer having a function of printing a business card or printing a card such as an ID card and then laminating the card.

The host computer system 105 is connected to the PC as the processing section 102 via a network such as a LAN, and includes a host computer 106 and a plurality of terminal devices 107 connected to the host computer 106 via the network. The host computer 106 stores, for example, a personnel information file 108 regarding personnel information in the company, and each terminal device 107 can access the personnel information file 108.

The processing unit 102 and the personnel information file 1
08 can be linked to each other, and by inputting personnel information such as an employee number from the terminal device 107, the information is stored in the image data storage unit 104 of the processing unit 102 via the personnel information file 108. It is also possible to search for the image data.

As a specific application example of the document-with-image creation system, for example, a business card creation system for creating a business card with a face photograph, and a postcard such as a guide letter on which a product photograph and a staff portrait are posted are created. An ID for creating a postcard creation system or an ID card with a photo
A card creation system, a leaflet creation system for creating a leaflet such as a plan book, an advertisement flyer, a catalog, and the like, a card creation system for creating a card with a photograph, and the like are included.

Further, for example, a personal account book with a face photograph such as a photograph, a resume, and a self-report of an employee, an address, a map, etc. are created.
HR information system to manage, used car search system to search information with photos of used cars, purchasing information planning and purchasing system to manage purchasing information, process management, system for civil engineering construction by combining with construction ledger, The system includes a system for predicting construction completion by combining with a three-dimensional CAD. Of course, these systems can also be used as color systems for creating and managing using color images such as color photographs.

Next, the hardware configuration of the image processing apparatus 100 will be described. FIG. 2 is a block diagram illustrating a hardware configuration of the image processing apparatus according to the first embodiment.

In FIG. 2, reference numeral 201 denotes a CPU for controlling the entire system; 202, a ROM storing a boot program and the like; 203, a RAM used as a work area of the CPU; A hard disk drive (HDD) 205 controls the reading / writing of data to / from a hard disk (205), an HD 205 stores data written under the control of the HDD 204, and a data 206 to an FD (floppy disk) 207 under the control of the CPU 201. 20 is a floppy disk drive (FDD) for controlling read / write of the FDD, and 207 is a detachable FD for storing data written under the control of the FDD 206.
Reference numeral 8 denotes a display for displaying a document including characters, images, and the like, function information, and the like.

Reference numeral 209 is connected to the network NET via the communication line 210, and the network NET is connected to the network NET.
And the interface that controls the internal interface (I
/ F), 211 is a keyboard provided with keys for inputting characters, numerical values, various instructions, etc., 212 is a mouse for moving a cursor and selecting a range, etc., and 213 is for taking an image using a CCD. Digital still camera, 21
Reference numeral 4 denotes a printer for printing a document or the like, and 215 denotes a bus for connecting the above-described units. Note that a scanner 213 may optically read an image.

FIG. 3 is a block diagram functionally showing the configuration of image processing apparatus 100 according to the first embodiment.
In FIG. 3, the processing unit 102 includes an image data storage unit 10.
4, an operation instruction unit 301, an image registration unit 302,
An image deletion unit 303, an image change unit 304, an image search unit 305, an image pasting unit 306, a display control unit 307,
The configuration includes a display unit 308, a print control unit 309, and the like.

The operation instructing unit 301 includes an image registering unit 302 and an image deleting unit 30 according to the contents displayed on the display unit 308.
3, for instructing the image change unit 304, the image search unit 305, the image pasting unit 306, the display control unit 307, and the print control unit 309 to operate. For example, it includes a pointing device such as a keyboard 211 and a mouse 212.

The image registration unit 302 registers the image data transmitted from the input unit 101 as an image data file by adding predetermined data such as a file name.
This is stored in the image data storage unit 104. The image deletion unit 303 deletes the image data already stored in the image data storage unit 104 from the image data storage unit 104 according to a deletion instruction from the operation instruction unit 301.

The image change unit 304 changes the image data of the image data file already stored in the image data storage unit 104 in accordance with the change instruction from the operation instructing unit 301, and converts the changed image data into an image again. This is stored in the data storage unit 104. Details of the image changing unit 304 will be described later.

The image search unit 305 searches for a desired image data file among the image data files already stored in the image data storage unit 104 in accordance with a search instruction from the operation instruction unit 301. The image pasting unit 306 pastes image data already stored in the image data storage unit 104 onto a document in accordance with an image pasting instruction from the operation instruction unit 301.

The display control unit 307 displays the image of the image data file stored in the image data storage unit 104 or a reduced image obtained by reducing the image in accordance with the display instruction from the operation instruction unit 301 on the display screen of the display unit 308. It is controlled so as to be displayed above. Details of the display control unit 307 will be described later.

The print control unit 309 transmits print data such as image data or a document with an image to the output unit 103 in accordance with a print instruction from the operation instruction unit 301. Further, the operation control of the output unit, for example, the setting of the number of prints and the like is also performed according to the operation instruction from the operation instruction unit 301.

Image registration unit 302, image deletion unit 303, image change unit 304, image search unit 305, image pasting unit 30
6, the display control unit 307 and the print control unit 309 are respectively
ROM 202, RAM 203 or hard disk 20
5. The functions of each unit are realized by the CPU 201 or the like executing the instruction processing according to the instructions described in the programs such as the OS and the application programs recorded on the recording medium such as the floppy disk 207.

The display unit 308 includes a display control unit 307
And displays a document or the like containing an image or a character string based on the display control by. For example, display 2
08, and the display 208 includes a CRT, a liquid crystal display, and the like.

Next, the configurations of the image data storage unit 104, the image change unit 304, and the display control unit 307 will be described in more detail. FIG. 4 is a block diagram functionally showing the configuration of the image data storage unit 104, the image change unit 304, the display control unit 307, and their peripheral parts of the image processing apparatus according to the first embodiment.

As shown in FIG. 4, the display control unit 307
By controlling the display unit 308, the digital still camera 213 is controlled.
And so on, a plurality of images taken from substantially the same position are displayed simultaneously. Further, the display control unit 307 can display a grid 903 described later on the plurality of images.

The image changing unit 304 includes a designation unit 401
, A positioning unit 402, and a pan-focus image generation unit 403. Here, the designation unit 40
Reference numeral 1 designates a plurality of arbitrary common points among a plurality of images displayed by the display control unit 307.

The positioning unit 402 performs positioning of the plurality of images based on the coordinate positions of arbitrary common points specified by the specifying unit 401. The pan-focus image generating unit 403 includes a positioning unit 402
Generate one or a plurality of pan-focus images based on the images aligned by.

The image data storage unit 104 stores one or a plurality of pan-focus images generated by the pan-focus generation unit 403. Specifically, a file name is given, and the image data is stored in the image data storage unit 104 by the given file name.

The designation unit 401 and the positioning unit 40
2. Specific contents of the processing of the pan focus image generation unit 403 will be described later.

The designation unit 401, the positioning unit 402, and the pan focus image generation unit 403
2. A function that realizes the function of each unit by the CPU 201 or the like executing a command process in accordance with a command described in a program such as an OS or an application program recorded on a recording medium such as the RAM 203 or the hard disk 205 or the floppy disk 207. It is.

Next, the contents of the operation of the image processing apparatus and the contents of the display screen will be described using a specific display example. FIG. 5 is an explanatory diagram illustrating an example of a display screen displayed on the display unit 308 of the image processing device according to the first embodiment.

The display screen shown in FIG. 5 is a basic display screen of the image processing apparatus according to the first embodiment. In FIG. 5, the display screen includes a file name display area 501 occupying substantially the upper left half of the screen, It is composed of three areas, a reduced image display area 502 occupying the lower side of the file name display area 501 and a selected image display area 503 occupying substantially the right half of the screen.

These areas are not displayed by the multi-window but are used as fixed areas. The positions and sizes of these areas cannot be changed. Therefore, since the screens having the same configuration are always displayed, the operator can view these areas as one screen. Therefore, the operator can use the image processing apparatus intuitively without being confused at the time of operation and without having to learn complicated operation procedures, and can efficiently perform image editing processing.

The file name display area 501 is stored in the image data storage unit 104, specifically, for example, in the hard disk 20.
5 and the file names stored in the floppy disk 207 are displayed hierarchically. File name display area 501
The user can select a desired image data file by looking up the file name of the image data file displayed in (1) and searching for and specifying the desired image data file from the file name.

The reduced image display area 502 is composed of a plurality of reduced images. The actual image data is reduced at a predetermined magnification, and the reduced image is viewed to determine which file is the image data file. Is instantaneously recognized. The file name of the image data file of the reduced image is also displayed below the reduced image.

Instead of specifying the file name in the file name display area 501, a desired image can be selected by moving the cursor to the reduced image itself and clicking a button such as the mouse 212. In this case, the operator can quickly and easily select a desired image data file based on the reduced image even if the file name is not accurately stored.

If a predetermined keyword, for example, a keyword such as "person", "landscape" or "business" or "personal" is added to each image data file and registered, the keyword is determined based on the keyword. The display order of the reduced images can be changed and displayed. As a result, even if the number of registered image data files increases, it is possible to search for a desired image data file at high speed by rearranging by keyword.

In the display example of FIG. 5, the number of reduced images to be displayed is set to 24 in 8 × 3 rows. However, the number of reduced images depends on the resolution of the display device, the content of the displayed image, or the search method. It is possible to change the display arrangement and the number of displayed reduced images.

The selected image display area 503 is an area for displaying an image of the image data file selected from the file name in the file name display area 501 or the image data file selected from the thumbnail in the reduced image display area 502. As the display format, a standard display in which the image is displayed in a standard size, an entire display in which the image is enlarged or reduced in order to display the entire image, and a magnification display in which the operator displays the image at a desired magnification can be considered. The magnification is designated by inputting the percentage of the magnification, and the magnification becomes equal at 100%. When a numerical value smaller than that is input, the magnification is reduced, and when a larger numerical value is input, the magnification is enlarged.

The selected image display area 503 is displayed on the entire display screen by designating a command from a predetermined menu or by double-clicking the image itself. The currently displayed image can be displayed so as to be hidden. As a result, the editing work can be performed more efficiently.

This is particularly effective for large images.
When the editing processing is completed, the original image area can be returned to the original image area by specifying a command from a predetermined menu or by double-clicking the image itself again. The image display area 502 is displayed again.

Next, the contents of the operation of designating a plurality of images for which a pan-focus image is to be generated will be described. FIG. 6 is an explanatory diagram showing another example of the display screen displayed on the display unit 308 of the image processing device according to the first embodiment. In FIG. 6, the number of reduced images in the reduced image display area 502 is eight for convenience of explanation.

In FIG. 6, a plurality of images for which a pan-focus image is to be generated are designated from the reduced images in the reduced image display area 502. As a designation method, there is a method of inputting a file name of a reduced image to be designated from the keyboard 211 or the like. In this case, a pointing device such as a mouse 212 is used to move a cursor to a display area of the reduced image and a mouse 212 Specify by clicking a button such as.

Since a plurality of reduced images must be specified at the same time, for example, the shift
By clicking a button such as the mouse 212 while pressing a specific key such as a key, a plurality of reduced images can be easily specified.

In FIG. 6, reduced images 601, 602
2 shows a state in which the two images are designated as objects to generate a pan-focus image. In the designated reduced image, the displayed file name portion is highlighted, or the frame of the reduced image is displayed in a bold frame so that the operator can recognize that the reduced image has been designated. It is good to

Here, the contents of the designated image will be described. FIGS. 7 and 8 are explanatory diagrams showing the contents of an image to be subjected to pan-focus image generation by the image processing apparatus according to the first embodiment. In FIG. 7, an image 701 is a first image on which a pan-focus image is generated.

An image 701 is an image captured by the image digital still camera 213. A person (female) 702 is shown on the right side of the image 701, and on the left side of the image is
The background (mountain) 703 is shown. Further, in the image 701, the person (woman) 702 is in focus,
The background (mountain) 703 shows a state where the subject is out of focus (the subject is out of focus).

On the other hand, in FIG. 8, an image 801 is a second image on which a pan-focus image is generated. An image 801 is also an image captured by the digital still camera 213, and is captured from substantially the same position as the image 701 in FIG. Therefore, image 7 in FIG.
01, a person (female) 802 on the right side of the image 801
, And a background (mountain) 803 is shown on the left side of the image. Further, in the image 801, the image 701
On the contrary, the background 803 is in focus, and the person (female) 802 is out of focus (out of focus).

After designating the reduced image, the user moves the cursor to the “image correction” menu 604 in the menu bar in FIG. 6 and clicks a button of the mouse 212 or the like to display one of the pull-down menus. The selection is made by further clicking the “pan focus image generation” menu 605. Thereby, a pan focus image generation processing window 900 as shown in FIG. 9 is displayed.

Next, the contents of the designation operation by the designation unit 401 will be described. 9 to 11 are explanatory diagrams illustrating another example of the display screen displayed on the display unit 308 of the image processing device according to the first embodiment.

Pan focus image generation processing window 9
00 denotes a common point designation area 901 and a common point switching unit 902
, “Enlarge” button 903 and “Reduce” button 904
"Start" button 905 and "Cancel" button 9
06 and a “grid display” check box 910.

In the common point designation area 901, an image designated on the display screen of FIG. 6 is displayed. 9, the same images as the reduced images 601 and 602 designated in FIG. 6 are displayed at a predetermined reduction magnification (image 70).
1, image 802).

The common point switching unit 902 has radio buttons 907 so that “common point 1”, “common point 2”, or “common point 3” can be selected as a common point designation mode.
To 909 are displayed. Details of the designated common points will be described later. Although three common point designation modes are provided in FIG. 9, the number of designation modes is not limited to three.

An “enlarge” button 903 is a button for enlarging the size of an image displayed on the common point designation area 901. By pressing the “enlarge” button 903 once, that is, moving the cursor onto the “enlarge” button 903 and clicking a button such as the mouse 212 once, the image is enlarged at a predetermined magnification,
The enlarged image is displayed on the common point designation area 901. This makes it easier for the operator to specify common points.

FIG. 10 is an explanatory diagram showing another example of the display screen displayed on the display unit 308 of the image processing apparatus according to the first embodiment. In FIG.
3 is pressed only once.

The “Reduce” button 904 is different from the “Enlarge” button 903 in that the “Enlarge” button
Is reduced at the same magnification as a predetermined magnification. Therefore, the “reduce” button 904 is set to “enlarge”.
By pressing the same number of times as the number of times the button 903 is pressed, the image returns to the original size. In FIG. 9, there is no need to further reduce the size of the image,
The “reduce” button 904 is grayed out and cannot be pressed.

A "start" button 905 is a button for giving an instruction to start a pan-focus image generation process. At present, since the common point has not been designated yet, the “start” button 905 is grayed out and cannot be pressed.

A "cancel" button 906 is a button for giving an instruction to cancel the pan-focus image generation processing. When the “cancel” button 906 is pressed, the common point designation processing that has been performed so far is stopped, and the pan-focus image generation processing window 900 is displayed.
Is closed.

The “grid display” check box 910 is displayed in the image 701 and / or 801 when the check is turned on, and is displayed when the check is turned off. The grid is erased. How to check the check box is the same as the normal check box,
The description is omitted. The details of the grid display will be described later.

Next, the contents of the common point designation process will be described. FIG. 11 is an explanatory diagram showing a part of the display screen (common point designation area 901) displayed on the display unit 308 of the image processing apparatus according to the first embodiment. In FIG. 11, the first image 701 and the second image 801 displayed on the common point designation area 901 are displayed in a size suitable for specifying the common point.

In FIG. 11, a point 11 of a circle (印) on the head of a person (female) on the right side of the first image 701
01 indicates a designated point of “common point 1”. In addition, point 1 of a square mark (□) on the left side of the first image 701
Reference numeral 102 denotes a designated point of “common point 2”. Similarly, point 11 of a circle (印) on the right side of the second image
03 denotes another designated point of “common point 1”, and a point 1104 of a square mark (□) at the vertex of the background (mountain) on the left side of the second image 801 is “common point 1”. 2 "indicates another designated point.

As described above, by designating the designated point indicating the common point in a different shape for each common point, differentiation from other common points can be achieved. Instead of having different shapes, the color may be changed for each common point. For example, “common point 1” may be red, “common point 2” may be green, and “common point 3” may be blue. When the color is changed, it is more preferable to select a color that makes the difference from the background color clear each time.

A specific method of specifying common points will be described. In FIG. 9, when no common point is specified, the radio button 907 of the common point switching unit 902 is specified as an initial value, and "common point 1" can be specified. In this state, the common point designation area 9
After moving the cursor to a desired position as a common point on the image 701 displayed on the screen 01, the user clicks the button of the mouse 212, as shown in FIG. A circle point 1101 is displayed at the cursor display position, and “common point 1” in the first image 701 is specified.

Next, after moving the cursor to a position on the second image 801 at which the same image as the image designated as the common point in the first image is displayed, the mouse 212 By clicking the button, a circle point 1103 is displayed at the cursor display position on the second image 801, and “common point 1” in the second image 801 is specified. First image 701
The designation of the “common point 1” is completed by the designation of the image of the second image 801.

However, when the radio button 907 of the common point switching unit 902 is selected, the first or second image 70
The cursor is moved to a point 1101, and a button of the mouse 212 is clicked.
1 or 1103 is changed to the cursor display position. This operation is the same when radio button 908 or 909 is selected. Therefore, until the selection of the radio button is switched or the “start” button 905 is pressed, the designation of the common point can be changed any number of times.

FIG. 12 is an explanatory diagram showing another example of a part of the display screen (common point designation area 901) displayed on the display unit 308 of the image processing apparatus according to the first embodiment. In FIG. 12, on a first screen 701 and a second screen 801,
This shows a state in which a grid 1201 in a grid shape is displayed. Displaying the grid 1201 in this manner serves as a guide when the operator specifies a common point.

This grid-like grid 1201 displays / displays
Non-display can be switched, and only the first image 701 or only the second image 801 can be displayed. In addition, the grid width of the grid 1201 can be freely changed for each image according to the content of the displayed image, and the color of the grid 1201 can be freely changed so that the color of the image does not make recognition difficult. is there.

After the designation of the common point is completed, the “start” button 905 is pressed next to execute the pan-focus image generation processing. When the pan focus image generation processing is completed, the window 1300 is opened, and the processed image 1301 is displayed in the window 1300.

FIG. 13 is an explanatory diagram illustrating an example of a window displayed on the display unit 308 of the image processing apparatus according to the first embodiment. In FIG. 13, an "OK" button 13
When 02 is pressed, the pan-focus image is given a file name and stored in the image data storage unit 104. On the other hand, when the “cancel” button 1303 is pressed, the pan focus image is discarded (or a temporary file name is given and stored in the image data storage unit 104), and the pan focus image is generated based on the common point 2 Is started.

The “enlarge” button 1304 and “reduce” button 1305 are buttons for enlarging or reducing the pan-focus image 1301. "Enlarge" button 13
04 and the “reduce” button 1305 are the “enlarge” button 903 and the “reduce” button 90 described in FIG.
4 has the same function as that of No. 4, and the description thereof is omitted.

Although illustration is omitted, the pan-focus image generated based on the common point 2 is displayed in the same window as in FIG. When “cancel” is pressed in the window displaying the pan-focus image generated based on the common point 2, the pan-focus image generation processing is started based on the common point 3, and when the processing is completed. , Window 1400 is opened,
The processed image 1401 is displayed in the window 1400.

FIG. 14 is an explanatory diagram for explaining another example of the window displayed on the display unit 308 of the image processing apparatus according to the first embodiment. In FIG. 14, when an “OK” button 1402 is pressed, a pan-focus image is given a file name and stored in the image data storage unit 104.

On the other hand, when the “cancel” button 1303 is pressed, the pan-focus image is discarded (or a temporary file name is added and stored in the image data storage unit 104), and immediately before the start button 905 is pressed. Returning to the screen, the common point designation process can be performed again.

The “enlarge” button 1404 and “reduce” button 1405 are buttons for enlarging or reducing the pan-focus image 1401. "Enlarge" button 14
04 and the “reduce” button 1405 are the “enlarge” button 1304 and the “reduce” button 1340 in FIG.
5, the "enlarge" button 90 described in FIG.
3 and a function similar to that of the “reduce” button 904, and a description thereof will be omitted.

Next, the pan focus image generation unit 403
Will be described in detail. S is the first image
1. The second image is defined as S2, and images having the same coordinate values of S1 and S2 are compared. Since the optical axis of both images is the center of each image, if this center is set as the origin of the images, each image is represented by S1
(X, y) and S2 (x ', y').

S1 (x, y) and S2 (x ', y') pixels (x, y) and the peripheral area of (x ', y'), for example, 3
The × 3 pixel area is compared, and the pixel having the larger change amount within the area is adopted as the corrected image.

That is, the sharpness evaluation values d1 and d2 proposed by the following equations (1) and (2) are compared, and d1 ≧ d2
If so, let S1 (x, y) be the output image S0; otherwise, let S2 (x ', y') be the output image S0. d1 = | 4S1 (x, y)-{S1 (x-1, y) + S1 (x + 1, y) + S (x, y-1) + S1 (x, y + 1)} | (1 ) D2 = │4S2 (x ', y')-｛S1 (x'-1, y ') + S1 (x' + 1, y ') + S (x', y'-1) + S1 (x ', y' + 1)｝ | (2)

One output image S0 whose blur has been corrected is generated from such two images S1 and S2. As described above, the sharpness evaluation values d1 and d2 according to the equations (1) and (2) are obtained.
, The pan focus output image S0 is determined.

Next, a description will be given of a procedure of a common point designation process in a series of processes of the image changing unit 304 and the display control unit 307 in the first embodiment. FIG. 15 is a flowchart showing a procedure of a common point designation process among the processes of the image changing unit and the display control unit according to the first embodiment.

In the flowchart of FIG. 15, first,
It is determined whether two or more images have been specified (step S1501). After waiting for designation of two or more images (Yes at Step S1501), it is determined whether or not an instruction to generate a pan-focus image has been given (Step S1502).

In step S1502, when there is no instruction for the bonding process (No in step S1502)
Determines whether there is an instruction for another process, for example, an instruction for an image deletion process or the like (step S150).
3). Here, if there is no instruction for another process (No at Step S1503), the process proceeds to Step S1501, and the same process is repeated thereafter. On the other hand, step S1
If another process is instructed in step 503 (Yes at step S1353), the other process is executed (step S1504), and the process ends.

In step S1502, when there is an instruction to generate a pan-focus image (step S15)
(02 affirmative), an image arrangement process of the designated image is performed (step S1505).

Thereafter, it is determined whether or not the common mode has been changed (step S1506). Here, when the common mode is changed (Yes at Step S1506).
Changes the common mode (step S150).
7), proceed to step S1506.

If there is no change in the common point mode in step S1506 (No in step S1506), it is determined whether a common point has already been designated on the first image 701 (step S1508). If not specified (No at Step S1508), it is determined whether a common point has been specified on the first image 701 (Step S1509).

In step S1509, the process waits for the designation of the common point, and if the common point is designated (Yes in step S1509), the coordinate data of the common point on the first image 701 designated in step S1509 Is held (step S1510).

Next, it is determined whether or not the common point designated on the first image 701 has been changed (step S15).
11) When there is a change (Yes in step S1511)
Shifts to step S1510, and rewrites the coordinate data. On the other hand, when there is no change (step S1511
If not, it is determined whether a common point has already been designated on the second image 801 (step S1512).

If it is determined in step S1512 that a common point has not been specified (No in step S1512), it is determined whether a common point has been specified on the second image 801 (step S1513). Here, waiting for the common point to be designated, and when the common point is designated (Yes at Step S1513), the coordinate data of the common point on the second image 801 designated at Step S1513 is held (Step S1513). Step S1514).

Next, it is determined whether or not the common point designated on the second image 801 has been changed (step S15).
15) When there is a change (Yes at step S1515)
Shifts to step S1514, and rewrites the coordinate data. On the other hand, when there is no change (step S1515
If not, it is determined whether the “start” button 905 has been pressed (step S1516).

If the “start” button 905 has been pressed in step S1516 (Yes in step S1516), the process of generating a pan-focus image is started.
The details will be described with reference to FIG.

On the other hand, in step S1516, when the “start” button 905 is not pressed (step S15
(No at 16) moves to step S1506. In this case, since the common point has already been specified on the first image 701 in step S1508, step S15
Move to 11. Similarly, in step S1512, since a common point has already been specified on the second image 801, the process proceeds to step S1515.

Next, a procedure of the grid display processing of the display control unit 307 according to the first embodiment will be described. FIG. 16 is a flowchart illustrating a procedure of a grid display process of the display control unit according to the first embodiment. In the flowchart of FIG. 15, first, it is determined whether the check box of the grid display is checked (step S).
1601).

If the grid display check box is checked in step S1601 (Yes in step S1601), it is determined whether the grid is already displayed as shown in FIG. 12 (step S1).
602) If not displayed (step S1602)
(No), a grid is displayed (step S1603).
Then, control goes to a step S1601. Step S160
2, if it is already displayed (step S1
602), the process proceeds to step S1601 without doing anything.

In step S1602, if the check box for grid display is unchecked (No in step S1601), it is determined whether an image is already displayed on the grid (step S1612). (Yes at Step S1612), the displayed grid is deleted (Step S1613),
The process proceeds to step S1601. If no display is made in step S1612 (step S1612
If not, the process moves to step S1601 without doing anything.

Thereafter, until the designation of the common point is completed, the same operation as described above is repeated each time the check box of the grid display is changed. In this way, the display / non-display of the grid is controlled.

Next, among the processing of the image changing unit 304 and the display control unit 307 in the first embodiment, the processing procedure after the common point designation processing will be described. FIG. 17 is a flowchart illustrating a procedure of a process after the process of designating a common point among the processes of the image changing unit 304 and the display control unit 307 according to the first embodiment.

In the flowchart of FIG. 17, first,
When the "start" button is pressed, a positioning process is performed based on the coordinate position of the common point 1 (step S1).
701). Next, a pan-focus image generation process is performed using the image adjusted by the alignment process in step S1701 (step S1702). The details of the pan focus image generation processing are as described above.

When the pan focus image generation processing is completed, the pan focus image as a result is displayed (step S1703), that is, the window 1300 in FIG. 13 is displayed, and the processed image 1301 is displayed therein. You. Here, it is determined whether the result is OK. That is, it is determined whether “OK” button 1302 has been pressed or “Cancel” button 1303 has been pressed.

In step S1704, the result is OK.
(Yes at step S1704), that is, "OK"
When the button 1302 is pressed, the pan focus image 1301 as a result is stored.
11), all processing ends.

On the other hand, if the result is not OK in step S1704 (No in step S1704), that is, if the “cancel” button 1303 is pressed,
A position alignment process and a pan-focus image generation process are executed based on the coordinate position of the common point 2 (step S17).
05). The content of this processing is the same processing as the positioning processing in step S1701 and the pan-focus image generation processing in step S1702.

After the processing in step S1705 is completed, a pan focus image as a result is displayed (step S1706). OK with the displayed pan focus image
It is determined whether or not this is the case (step S1707).
The process moves to step S1711 as in step 3.

On the other hand, if the result is not OK in step S1707 (No in step S1707), position adjustment processing and pan-focus image generation processing are subsequently executed based on the coordinate position of the common point 3 (step S1708). The contents of this processing are also described in step S17.
As in the case of S05, the processing is the same as the positioning processing in step S1701 and the pan-focus image generation processing in step S1702.

After the processing of step S1708 is completed, a pan focus image as a result is displayed (step S1).
709). This corresponds to window 1400 in FIG.
Is displayed. Next, the result is O
It is determined whether it is K (step S1710). Here, when the result is OK (Yes at Step S1710)
Shifts to step S1711, stores the result (step S1711), and ends all the processing.

On the other hand, if the result is not OK, that is,
If the “cancel” button 1403 has been pressed (No in step S1710), the process proceeds to a state before the “start” button 905 in FIG. 9 is pressed, that is, to step 1506 in FIG.

As described above, according to the first embodiment, when a common point is specified, a plurality of common points can be specified and their results can be displayed. The alignment can be easily performed.

Further, since the grid is displayed, it can be used as a guide when specifying the common point, and the common point can be specified more easily.

(Embodiment 2) In Embodiment 1 described above, the common point is designated by points (points). However, as in Embodiment 2 described below, the common point is designated. This may be performed by using a partition area of a predetermined size.

Since the entire document-with-image creation system including the image processing apparatus according to the second embodiment of the present invention and the hardware configuration of the image processing apparatus 100 are the same as those of the first embodiment, description thereof will be omitted. Also,
The other components of the image processing apparatus 100, except for the image changing unit 304 and the display control unit 307, have the same configuration as in the first embodiment, and a description thereof will be omitted.

Next, the image changing unit 304 will be described. FIG. 18 is a block diagram functionally showing the configuration of the image changing unit 304 and its peripheral parts of the image processing apparatus according to the second embodiment of the present invention. As shown in FIG. 18, the image changing unit 304 includes an image dividing unit 1801 and a specifying unit 1802.
, A positioning unit 1803, and a pan-focus image generation unit 1804.

The image dividing section 1801 divides a plurality of displayed images into divided areas of a predetermined size for each image. In addition, the specifying unit 1802 specifies an arbitrary common partitioned area between the displayed images among the partitioned areas partitioned by the image sorting unit 1801.

The positioning unit 1803 includes a designation unit 1802
A plurality of images are aligned based on the coordinate positions of a plurality of arbitrary common division areas specified by.
The pan-focus image generating unit 1804 generates a pan-focus image based on the image positioned by the positioning unit 1802. Note that the detailed contents of the pan-focus image generation unit 1804 are the same as those of the pan-focus 403 of the first embodiment shown in FIG.

Further, the display control unit 307 includes a first display control unit 1805 and a second display control unit 1806. The first display control unit 1805 controls the display unit 308 to simultaneously display a plurality of images captured from substantially the same position. Also, the second display control unit 1806 controls the display unit 30
8 is enlarged to display the common section area specified by the specifying unit 1802.

The image dividing section 1801, the specifying section 1802, the positioning section 1803, the pan-focus image generating section, the first
The display control unit 1805 and the second display control unit 1806 are executed by the CPU 201 or the like in accordance with instructions written in programs such as an OS or an application program recorded on a recording medium such as the ROM 202, the RAM 203 or the hard disk 205 and the floppy disk 207, respectively. By executing the processing, the function of each unit is realized.

Next, the contents of the designation operation by the image section 1801 and the designation section 1802 will be described. FIG.
Reference numerals 9 and 20 denote display units 3 of the image processing apparatus according to the second embodiment.
It is explanatory drawing which shows an example of the display screen displayed on 08.

Pan focus image generation processing window 1
Reference numeral 900 denotes a common point designation area 1901 and a common point switching unit 1
902, an “Enlarge” button 1903, a “Reduce” button 1904, a “Start” button 1905, a “Cancel” button 1906, a “Grid display” check box 1910, and enlarged display areas 1911 and 1912. It is.

In the common point designation area 1901, an image designated on the display screen of FIG. 6 is displayed as in the first embodiment. In FIG. 19, the same images as the reduced images 601 and 602 designated in FIG. 6 are displayed at a predetermined reduction magnification (image 701, image 801).

The common point switching unit 1902 has radio buttons 190 so that “common point 1”, “common point 2”, or “common point 3” can be selected as a common point designation mode.
7 to 1909 are displayed. Details of the designated common points will be described later. Although three common point designation modes are provided in FIG. 9, the number of designation modes is not limited to three.

An "enlarge" button 1903 is a button for enlarging the size of the image displayed on the common point designation area 1901. By pressing the “enlarge” button 1903 once, that is, by moving the cursor to the “enlarge” button 9
By moving the mouse over the 193 and clicking a button such as the mouse 212 once, the image is enlarged at a predetermined magnification, and the enlarged image is displayed on the common point designation area 901. This makes it easier for the operator to specify common points.

The “Reduce” button 1904 is different from the “Enlarge” button 1903 in that the “Enlarge” button 1
In 903, the image is reduced at the same magnification as a predetermined magnification. Therefore, by pressing the “reduce” button 1904 the same number of times as the “enlarge” button 1903, the original image size is restored. In FIG. 19, since there is no need to further reduce the size of the image, the “reduce” button 1904 is grayed out and cannot be pressed.

A "start" button 1905 is a button for instructing start of a pan-focus image generation process. A “cancel” button 1906 is a button for giving an instruction to cancel the pan focus image generation processing. When the “cancel” button 1906 is pressed, the common point designation processing that has been performed so far is stopped, and the pan-focus image generation processing window 1
900 is closed.

A “grid display” check box 1910 is displayed in the image 701 and / or 801 by turning on the check box, and is displayed by turning off the check box. The grid is erased. How to check the check box is the same as the normal check box,
The description is omitted.

Next, the contents of the common point designation processing will be described. FIG. 20 is an explanatory diagram showing a part of the display screen (common point designation area 1901) displayed on the display unit 308 of the image processing apparatus according to the second embodiment. In FIG. 20,
First image 70 displayed in 1901 in common point designation area
The first and second images 801 are displayed in a size suitable for specifying a common point.

In FIG. 20, the point 2001 on the head of the person (female) on the right side of the first image 701 is
The designated section area of “common point 1” is shown. Similarly, a point 2002 on the right side of the second image indicates another designated section area of “common point 1”.

The designated section areas 2001 and 2002 are:
It has a predetermined size, and its shape and size are the same. The division area is set over the entire image when the image is arranged in the common point designation area 1901. At this time, the size, shape, and the like of the divided area can be arbitrarily set.

A specific method of specifying common points will be described. In FIG. 19, when no common point is designated, the radio button 1907 of the common point switching unit 1902 is designated as an initial value, and "common point 1" can be designated. In this state, after moving the cursor to a desired position as a common point on the image 701 displayed in the common point designation area 901, the mouse 21
By clicking the button 2, as shown in FIG. 20, a point 2001 is displayed at the cursor display position on the first screen 701, and “common point 1” in the first image 701 is specified. .

Here, the designation by the cursor is performed for the divided area. That is, the partition area to which the position where the cursor is displayed belongs is selected. As a result, it is possible to easily select a desired partitioned area only by designating a position near a certain degree.

Next, after moving the cursor to a position on the second image 801 where the same image as the image at the position designated as the common point in the first image is considered to be displayed, the mouse 212 By clicking the button, a point 2002 is displayed at the cursor display position on the second image 801, and the section area of “common point 1” in the second image 801 can be specified. First image 7
The designation of the “common point 1” is completed by the designation of the image 01 and the second image 801.

However, as in the first embodiment, the designation of the common point can be changed any number of times until the “start” button 1905 is pressed.

As in the first embodiment, a grid-like grid as shown in FIG. 12 can be displayed.
Further, if the grid of the grid is made to coincide with the divided area, the operability of the designation processing of the common divided area is further improved.

After the designation of the common section area is completed, the “start” button 1905 is pressed next to execute the pan focus image generation processing.

Here, when performing positioning, the positioning unit 1803 calculates a coordinate position which is the center of the designated divided areas, and executes a positioning process based on the coordinate position. Subsequent steps are the same as in the first embodiment, and a description thereof will not be repeated.

Next, the enlarged display of the designated section area will be described. When the designated area is specified, the second display control means enlarges the image of the area at a predetermined magnification and displays the image in the enlarged display area 1911 or 1912. Thereby, the operator can display the enlarged display areas 1911 and 1912.
, The designated section area can be easily changed.

In addition to or instead of being displayed in the enlarged display areas 1911 and 1912, the designated section areas 2001 and 200 of the common point designation processing area 1901 are displayed.
For example, enlarged display areas 2011 and 2012 may be displayed in the vicinity of 2 in a display form such as a balloon.

Further, the blurred image may be sharpened to some extent by processing the enlarged and displayed image. For example, image processing such as edge enhancement by applying a predetermined filter makes the contents of an unclear image clear to some extent. Alternatively, processing such as conversion of a color image into a monochrome image or binarization of the image may be performed.

Specifically, a sharpness adjustment bar is provided, and the bar is moved, and when the image becomes clear to some extent, the adjustment bar is stopped, thereby making it easier to specify the common point. can do. Note that the image processing may be performed on the image displayed in the enlarged display area, or may be performed on the entire image.

Next, a description will be given of a procedure of a common point designation process in a series of processes of the image changing unit 304 and the display control unit 307 in the second embodiment. FIG. 21 is a flowchart illustrating a procedure of a common point designation process in the processes of the image changing unit 304 and the display control unit 307 according to the second embodiment.

In the flowchart of FIG. 21, first,
It is determined whether two or more images have been designated (step S2101). After waiting for designation of two or more images (Yes at Step S2101), it is determined whether an instruction for the pan-focus image generation processing has been given (Step S2102).

In step S2102, when there is no instruction for the bonding process (No in step S2102)
Determines whether there is an instruction for another process, for example, an instruction for an image deletion process or the like (step S210).
3). Here, if there is no instruction for another process (No at Step S2103), the process proceeds to Step S2101 and the same process is repeated thereafter. On the other hand, step S2
In 103, if there is an instruction for another process (Yes at Step S1353), the other process is executed (Step S2104), and the process ends.

In step S2102, when there is an instruction to generate a pan-focus image (step S21)
(02 affirmative), an image arrangement process of the designated image is performed (step S2105).

Thereafter, it is determined whether or not the common mode has been changed (step S2106). Here, when there is a change in the common point mode (Yes at Step S2106)
Changes the common point mode (step S210)
7), proceed to step S2106.

If there is no change in the common point mode in step S2106 (No in step S2106), it is next determined whether or not a common section area has already been designated on the first image 701 (step S2108). If it is not specified (No at Step S2108), it is determined whether or not a common section area is specified on the first image 701 (Step S2109).

If it is determined in step S2109 that the common partition area has been designated (YES in step S2109), the process proceeds to step S210.
9, the coordinate data of the common section area on the first image 701 designated is held (step S2110), and the common section area is displayed in enlarged display areas 1902 and 1912.
Alternatively, it is displayed in the enlarged display areas 2011 and 2012 (step 2111).

Next, it is determined whether or not the common section area specified on the first image 701 has been changed (step S2112), and if there has been a change (step S2112).
If affirmative, the process moves to step S2110, and the coordinate data is rewritten. On the other hand, if there is no change (step S2
112 is negative), it is determined whether or not the common division area has already been designated on the second image 801 (step S21).
13).

In step S2113, when the common section area is not designated (No in step S2113)
Determines whether a common section area has been designated on the second image 801 (step S2114). Here, after waiting for the designation of the common division area, if the common division area is designated (Yes at step S2114), the second image 801 designated at step S2114 is determined.
The coordinate data of the upper common section area is held (step S
2115) together with the enlarged display area 19
02, 1912 or the enlarged display area 2011, 201
2 (step 2116).

Next, it is determined whether or not the common section area designated on the second image 801 has been changed (step S2117), and if there has been a change (step S2117).
Affirmative) moves to step S2115, and rewrites the coordinate data. On the other hand, if there is no change (step S2
(No at 117) determines whether or not “start” button 1905 has been pressed (step S2118).

If the “start” button 1905 has been pressed in step S2118 (Yes in step S2118), the pan focus image generation processing is started.
The contents will be described with reference to FIG.

On the other hand, if the “start” button 1905 has not been pressed in step S2118 (step S2118).
(118 No), the process moves to step S2106. In this case, in step S2108, the first image 701
Since the common partition area has already been specified above, the flow shifts to step S2112. Similarly, step S2113
In, since the common point has already been specified on the second image 801, the process shifts to step S2116.

Next, among the processing of the image changing unit 304 and the display control unit 307 in the second embodiment, the processing procedure after the common point designation processing will be described. FIG. 22 is a flowchart illustrating a procedure of a process after the process of designating a common point among the processes of the image changing unit 304 and the display control unit 308 according to the second embodiment.

In the flowchart of FIG. 22, first,
When the “start” button is pressed, the coordinate position of the center of the common point 1 division area is calculated (step S2201).
Next, a positioning process is performed based on the calculated coordinate position (step S2202). Subsequent steps are the same as the processing of the first embodiment shown in FIG. 17, and a description thereof will be omitted.

As described above, according to the second embodiment, when specifying a common point, it is possible to specify a common area by using a predetermined area instead of a point. Positioning can be performed.

Further, according to the second embodiment, the designated predetermined area can be displayed in an enlarged manner, so that the position can be more reliably aligned by referring to the enlarged display.

(Embodiment 3) In Embodiment 1 or 2 described above, one or a plurality of common points are all specified by the operator, but as in Embodiment 3 described below. By specifying an arbitrary point to
It is also possible to specify points in the vicinity at the same time and compare their results.

The entire image-attached document creation system including the image processing apparatus according to the third embodiment of the present invention and the hardware configuration of image processing apparatus 100 are the same as those in the first embodiment, and a description thereof is omitted. Also,
The other components of the image processing apparatus 100, except for the image changing unit 304 and the display control unit 307, have the same configuration as in the first embodiment, and a description thereof will be omitted.

Next, the image changing unit 304 will be described. FIG. 23 is a block diagram functionally showing a configuration of an image changing unit 304, a display control unit 307, and peripheral components of an image processing apparatus according to Embodiment 3 of the present invention. As shown in FIG. 23, the image changing unit 304 includes a designation unit 2301, a positioning unit 2302, a pan-focus image generation unit 230
5, a first coordinate position storage unit 2308, a second coordinate position storage unit 2309, and a peripheral image designating unit 2310.

Further, the positioning unit 2302 includes a first positioning unit 2303 and a second positioning unit 2304.
A pan focus image generation unit 2306 and a second pan focus image generation unit 2307 are included.

The display control section 307 includes a first display control section 2311 and a second display control section 2312. Here, the first display control unit 2311 includes the display unit 308
And simultaneously display the first and second images captured from substantially the same position.

The specifying section 2301 specifies an arbitrary common point between the displayed first image and the displayed second image. The alignment unit 2302 performs alignment of a plurality of images based on the coordinate position of an arbitrary common point specified by the specifying unit 2301, and based on coordinate positions near an arbitrary common point of the second image. To align multiple images. Further, the pan-focus image generation unit 2305 generates a plurality of pan-focus images based on the plurality of images aligned by the alignment unit 2302.

The first coordinate position storage unit 2308 stores the coordinate position of an arbitrary common point between the first and second images specified by the specifying unit 2301 as a coordinate position for generating a reference image.

The second coordinate position storage unit 2309 stores a predetermined coordinate in the vertical axis direction and / or the horizontal axis direction with respect to the coordinate position of an arbitrary common point of the second image stored in the first coordinate position storage unit 2308. The coordinate position shifted by the amount, that is, the peripheral coordinate position of the coordinate position of an arbitrary common point of the second image stored in the first coordinate storage unit 2308 is stored. The distance to be shifted can be freely set in consideration of the type of image and the like.

The first alignment unit 2303 aligns the first and second images based on the coordinate positions stored in the first coordinate position storage unit 2308. The second alignment unit 2304 aligns the first and second images based on the coordinate positions stored in the second coordinate position storage unit 2309.

First pan-focus image generator 2306
Generates a pan-focus image serving as a reference image based on the image positioned by the first positioning unit 2303. Also, the second pan-focus image generation unit 2307
Generates a pan-focus image serving as a peripheral image based on the image positioned by the second positioning unit 2304.

Further, second display control section 2312 controls display section 308 to display the reference image generated by first pan focus image generation section 2306 at a predetermined position on the display screen, and to display the second pan focus image. Focus image generation unit 2
The reference image corresponding to the relationship between the coordinate position for generating the reference image stored in the first and second coordinate position storage units 2308 and 2309 and the coordinate position for generating the peripheral image is stored in the first and second coordinate position storage units 2308 and 2309. The reference image is displayed so as to be arranged in a state of surrounding the n-layer around the reference image around the image.

[0200] The peripheral image designating section 2309 includes a display section 308.
Is specified from among the plurality of peripheral images displayed in. In addition, the first coordinate position storage unit 2308 generates a reference image based on the coordinate position for generating the peripheral image specified by the peripheral image specifying unit 2309 among the coordinate positions stored in the second coordinate position storage unit 2309. Is stored as a coordinate position for performing the operation.

Further, if the pan-focus image stored in the image data storage unit 104 corresponds to the peripheral image when the peripheral image is specified by the peripheral image specifying unit 2309, the second display control unit 2312 corresponds to the case. The pan focus image is displayed as a peripheral image.

The designation section 2301, the positioning section 2302,
Pan focus image generation unit 2305, first coordinate position storage unit 2308, second coordinate position storage unit 2309, peripheral image designation unit 2310, first alignment unit 2303, second alignment unit 2304, first pan focus image generation unit 230
6, the second pan-focus image generation unit 2307, the first display control unit 2311, and the second display control unit 2312, respectively.
ROM 202, RAM 203 or hard disk 20
5. The functions of each unit are realized by the CPU 201 and the like executing the instruction processing according to the instructions described in the programs such as the OS and the application programs recorded on the recording medium such as the floppy disk 207.

Next, control contents of the second display control unit 2312 will be described. FIG. 24 is an explanatory diagram illustrating an example of a window displayed on the display unit 308 of the image processing device according to the third embodiment. In FIG. 24, a window 2400 displays nine images in a 3 × 3 matrix. The image displayed so as to be arranged at the center thereof is the reference image 2401, and the reference image 2401
Are displayed around eight images 2402 to 2409.

The position of the common point which forms the basis of the peripheral image 2402 is as shown in FIG. FIG. 25 is an explanatory diagram showing common points on the second image of the image processing device according to the third embodiment. The position of the peripheral image arranged in window 2400 is determined based on the position of the common point on the second image.

That is, centering on the reference image 2401, the peripheral image 24 generated on the upper left based on the common point 2502
02 is arranged. Similarly, the arrangement of the peripheral images is determined based on the relationship shown in FIG. FIG. 26 is an explanatory diagram showing the relationship between common points of the image processing apparatus according to the third embodiment and peripheral images. FIG. 26 shows the relationship between the coordinate position of each common point and the arrangement of the corresponding peripheral images.

In FIG. 24, eight peripheral images of one layer are displayed centering on the reference image 2401, but the display is not limited to one layer and may be displayed so as to form a plurality of layers. The number of layers can be freely set based on the performance of the display screen or the content of the displayed image.

The “OK” button 2410 in FIG.
The “Cancel” button 2411 is the “OK” button 1402 of the first embodiment shown in FIG.
It has the same function as the button 1403, and a description thereof will be omitted.

The operator selects an optimum image as the pan focus image from the nine images. As a selection method, a cursor is moved to a position where a desired image is displayed, and a mouse button is pressed (single click). By pressing the mouse button, the pressed image is reversed or the color / shape of the edge of the image changes,
The state indicates that the image has been selected. In that state,
By pressing an “OK” button 2410, the selection of an image is completed. Before pressing the "OK" button 2410, another image can be selected again by moving the cursor and pressing the mouse button.

Next, a reference image 2401 performed by the second display control unit 2312 of the image processing apparatus according to the third embodiment is described.
And the procedure of display control processing of the peripheral images 2402 to 2409 will be described. FIG. 27 is a flowchart illustrating a procedure of a display control process of the image processing apparatus according to the third embodiment.

In the flowchart of FIG. 27, first,
A generation process of the reference image 2401 is executed (Step S2)
701). In step S2701, a reference image 2401 is generated by performing a positioning process and a pan-focus image generation process.

Next, generation processing of the peripheral image (upper left) 2402 is executed (step S2702). Step S2
Also in 702, similarly to step S2701, the peripheral image 2402 is generated by performing the alignment processing and the pan-focus image generation processing.

Similarly, the peripheral images 2403 to 24
09 (Steps S2703 to S2)
709). However, the execution order of the peripheral image generation processing is not limited to this.

Then, the reference image 2401 generated in step S2401 is displayed on the window 2400 (step S2710), and the peripheral image 2402 is displayed.
To 2409 are displayed around the reference image 2401 (step S 27121, and the display control process ends).

Note that all peripheral images 2402 to 240
9 is completed, the reference image 2401 is displayed.
It does not matter even before creation of 402 to 2409. Further, the peripheral images 2402 to 2409 are also displayed after all the peripheral images have been created. However, the peripheral images may be sequentially displayed from the created peripheral images.

Next, the contents of the peripheral image designating process and the reference image extracting process of the peripheral image designating unit 2310 will be described. FIG. 28 is an explanatory diagram showing a part of the display screen displayed on the display unit 308 of the image processing device according to the third embodiment. In FIG. 28A, a reference image and peripheral images are displayed in a 3 × 3 matrix. Numbers A1 to C3 are added to these images for convenience of explanation. Therefore, the reference image is B1.

The mouse cursor 2801 moves on the display screen by operating the mouse 212. The shape of the mouse cursor 2801 changes depending on the moved position. In FIG. 28 (a), the peripheral image A3 is located at the position of the peripheral image A3, and the peripheral image A3 moves obliquely to the left and downward when specified, so that the shape of the mouse cursor 2801 is oblique to the left so as to indicate the moving direction. It has a shape with arrows pointing downward and obliquely upward. When the mouse cursor is moved to the position of the peripheral image C1, the mouse cursor has the same shape.

Similarly, when the mouse cursor 2801 is moved to the position of the peripheral image B1 or B2, it becomes a mouse cursor having a left-right arrow, and the peripheral image A
When the mouse cursor is moved to the position 2 or C2, the mouse cursor becomes a shape having an up-down arrow. When the mouse cursor is moved to the position of the peripheral image A1 or C3, a mouse cursor is formed with an obliquely downward right and an obliquely left upward arrow. Mouse cursor.

Here, the mouse cursor 2801 is clicked in the display area of the peripheral image A3 arranged on the upper right side of the reference image. FIG. 28B shows the display state of the display screen after clicking. It can be seen that the peripheral image A3 has moved to the position where the reference image is arranged. With this movement, B2, which was the reference image, has moved to the lower left side. That is, the entire image has moved to the lower left by one image due to the designation of the peripheral image on the upper right side. In this way, the entire image moves so that the designated peripheral image moves to the position of the reference image.

Next, a description will be given of a procedure of a peripheral image designating process and a reference image extracting process of the image processing apparatus according to the third embodiment. FIG. 29 is a flowchart showing the procedure of the peripheral image designating process and the reference image extracting process of the image processing apparatus according to the third embodiment. In the flowchart of FIG. 29, first, the peripheral image specifying unit 2310 determines whether or not an image has been specified (step S290).
1).

Here, designation of an image is performed by double-clicking the mouse 212 or the like. Thereby, the operation is distinguished from the operation in which the image is determined by pressing the “OK” button 2410 after the single click.

Next, it is determined whether or not the designated image is a peripheral image (step S2902). Here, when the designated image is a peripheral image (step S290)
If “2” is affirmative, it is determined whether or not all the newly arranged peripheral images are stored in the image data storage unit 104 (step S2903).

If there is an image not stored in the image data storage unit 104 in step S2903 (No in step S2903), a process for generating an image not stored is executed (step S2904). After that, the flow shifts to step S2905, where the peripheral image is displayed again (step S2905), and the flow shifts to step S2901.

On the other hand, if all the images are stored in the image data storage unit 104 in step S2903 (Yes in step S2903), the stored image is used without performing the peripheral image generation processing. Is displayed again (step S2905), and step S29 is displayed.
Move to 01.

If the designated image is the reference image in step S2902 (No in step S2902)
Stores the reference image (step S2906), and ends all the processing.

As described above, according to the third embodiment, it is possible to change the parameter value of the reference image while referring to the peripheral image. In particular, since the peripheral images are arranged near the reference image along the vertical and horizontal axes, it is possible to intuitively recognize the shift of the common point, and to generate an optimal pan-focus image. It can be done efficiently.

The image processing method described in the present embodiment is realized by executing a prepared program on a computer such as a personal computer or a workstation. This program includes hard disk, floppy disk, CD-ROM, M
The program is recorded on a computer-readable recording medium such as O and DVD, and is executed by being read from the recording medium by the computer. This program can be distributed via the recording medium and a network such as the Internet.

[0227]

As described above, according to the first aspect of the present invention, the display control means controls the display means to simultaneously display a plurality of images taken from substantially the same position, and Specifies a plurality of arbitrary common points among the plurality of images displayed by the display control means, and the positioning means determines the plurality of common points based on the coordinate positions of the plurality of arbitrary common points specified by the specifying means. The images are aligned with each other, and the pan focus generating means generates one or a plurality of pan focus images based on the images aligned by the positioning means. Since one or a plurality of pan-focus images generated by the generation unit are stored, a plurality of common points can be specified when specifying a common point. Can be displayed, so that the optimal alignment can be easily performed, thereby obtaining an image processing apparatus capable of creating a pan-focus image by a simple operation even for a beginner. To play.

According to the invention of claim 2, according to claim 1,
In the invention, the display control means further displays a grid on the plurality of images, so that it can be used as a guide when specifying a common point, and the common point can be specified more easily. Thus, there is an effect that an image processing apparatus capable of creating a pan-focus image by a simple operation even for a beginner can be obtained.

[0229] According to the invention of claim 3, the first display control means controls the display means to simultaneously display a plurality of images photographed from substantially the same position.
Dividing the plurality of images displayed by the first display control means into divided areas of a predetermined size for each image;
Among the divided areas divided by the image dividing means, an arbitrary common divided area between the displayed plurality of images is specified, and the positioning means determines a plurality of arbitrary common divided areas specified by the specifying means. The plurality of images are aligned based on the coordinate position of the image, and the pan-focus image generating unit generates a pan-focus image based on the image aligned by the alignment unit. At this time, it is possible to specify not a point but a predetermined area, and it is possible to perform an optimal alignment by an easier operation.
As a result, there is an effect that an image processing apparatus that can create a pan-focus image by a simple operation even for a beginner is obtained.

Further, according to the invention of claim 4, according to claim 3,
In the invention, the second display control means controls the display means to enlarge and display the common section area designated by the designation means, so that the designated predetermined area can be enlarged and displayed, and the enlarged display , It is possible to perform the alignment more reliably. As a result, there is an effect that an image processing apparatus that can create a pan-focus image by a simple operation even for a beginner is obtained.

According to the fifth aspect of the present invention, the display control means controls the display means to simultaneously display the first and second images photographed from substantially the same position, and Designating an arbitrary common point between the first image and the second image displayed by the display control means,
The plurality of images are aligned based on a coordinate position of an arbitrary common point specified by the specifying unit, and the plurality of images are aligned based on a coordinate position near an arbitrary common point of the second image. Performing positioning, pan focus image generating means generates a plurality of pan focus images based on the plurality of images aligned by the positioning means, pan focus is organ back means,
Since a plurality of pan-focus images generated by the pan-focus generating means are stored, an arbitrary point is specified, points in the vicinity thereof are specified at the same time, and their results are compared to adjust the position. As a result, an image processing apparatus that can create a pan-focus image by a simple operation even for a beginner can be obtained.

According to the invention of claim 6, the first display control means controls the display means to simultaneously display the first and second images photographed from substantially the same position, and Designates an arbitrary common point of the first and second images displayed by the first display control means, and the first coordinate position storage means stores the first and second images designated by the designation means. The coordinate position of an arbitrary common point of the image is stored as a coordinate position for generating a reference image, and the second coordinate position storage unit stores an arbitrary position of the second image stored by the first coordinate position storage unit. A coordinate position shifted by a predetermined coordinate in the vertical axis direction and / or the horizontal axis direction with respect to the coordinate position of the common point is stored, and the first alignment unit stores the coordinate position stored by the first coordinate position storage unit. The first and second images based on The second alignment unit performs alignment of the first and second images based on the coordinate position stored by the second coordinate position storage unit, and the first pan-focus image generation unit performs alignment. Generating a pan-focus image serving as the reference image on the basis of the image aligned by the first alignment unit;
A pan-focus image serving as a peripheral image is generated based on the image aligned by the alignment unit, and the second display control unit controls the display unit to move the first pan image to a predetermined position on the display screen. The reference image generated by the focus image generation means is displayed, and the peripheral image generated by the second pan focus image generation means is generated by the first and second coordinate position storage means to generate the reference image. Therefore, the reference image is displayed so as to be arranged in a state of surrounding the reference image with n layers around the reference image in correspondence with the relationship between the coordinate position and the coordinate position for generating the peripheral image. When changing the parameter values of the reference image, it is possible to refer to the peripheral image, and in particular, the vertical and horizontal axes correspond to the vicinity of the reference image. Since so as to place the peripheral image Te, it is possible to intuitively recognize the deviation of the common point, and can efficiently perform the formation of optimal pan focus image. As a result, there is an effect that an image processing apparatus that can create a pan-focus image by a simple operation even for a beginner is obtained.

[0233] According to the invention of claim 7, according to claim 6,
In the invention, the peripheral image designating means designates one peripheral image from the plurality of peripheral images displayed on the display means, and the first coordinate position storing means stores the peripheral image by the second coordinate position storing means. Since the coordinate position for generating the peripheral image designated by the peripheral image designating unit is stored as the coordinate position for generating the reference image, the peripheral image can be easily changed. As a result, a desired image can be efficiently obtained, whereby an image processing apparatus that can create a pan-focus image by a simple operation even for a beginner is obtained.

According to the invention of claim 8, according to claim 7,
In the invention, the pan-focus image storage unit stores the pan-focus images generated by the first and second pan-focus image generation units, and the second display control unit sets the peripheral image by the peripheral image designation unit. When the pan-focus image stored by the storage unit is applicable as the peripheral image when is designated, the corresponding pan-focus image is displayed as the peripheral image. Since the image can be used, the processing speed of the re-display can be improved, thereby providing an image processing apparatus that can create a pan-focus image by a simple operation even for a beginner. Play.

According to the ninth aspect of the present invention, a plurality of images photographed from substantially the same position are simultaneously displayed, and a plurality of arbitrary common points between the displayed plurality of images are designated. The plurality of images are aligned based on the coordinate position of an arbitrary common point, and one or more pan-focus images are generated based on the aligned images. Can be specified in common, each result can be displayed, optimal alignment can be easily performed,
As a result, there is an effect that an image processing method that allows a beginner to create a pan-focus image by a simple operation is obtained.

According to the tenth aspect of the present invention, in the ninth aspect of the present invention, a grid is displayed on the plurality of images, so that it can be used as a guide when specifying a common point. Point designation can be performed more easily, thereby providing an effect that an image processing method that enables a beginner to create a pan-focus image by a simple operation is obtained.

According to the eleventh aspect of the present invention, a plurality of images taken from substantially the same position are simultaneously displayed, and the displayed plurality of images are divided into divided areas of a predetermined size for each image. Among the divided areas, an arbitrary common area of the displayed plurality of images is specified, and the positions of the plurality of images are aligned based on the coordinate positions of the specified plurality of arbitrary common areas. Since the pan focus image is generated based on the aligned image, when specifying the common point, instead of the point (point),
Since it is possible to specify the area by using a predetermined area, it is possible to perform an optimal alignment by an easier operation. As a result, there is an effect that an image processing method that allows a beginner to create a pan-focus image by a simple operation is obtained.

According to the twelfth aspect of the present invention, in the eleventh aspect of the present invention, the designated common section area is further enlarged and displayed.
It is possible to perform the alignment more reliably, and thereby, there is an effect that an image processing method that enables a beginner to create a pan-focus image by a simple operation is obtained.

According to the thirteenth aspect of the present invention, the first and second images photographed from substantially the same position are displayed at the same time, and the displayed first and second images can be arbitrarily shared. A point is designated, the plurality of images are aligned based on the coordinate position of the designated arbitrary common point, and the plurality of images are aligned based on the coordinate position near the arbitrary common point of the second image. Is performed, and a plurality of pan-focus images are generated based on the plurality of aligned images. By specifying an arbitrary point, simultaneously specifying points in the vicinity thereof and comparing the results thereof By doing so, it is possible to easily perform the alignment, and thereby an advantage is provided in that an image processing method that enables a beginner to create a pan-focus image by a simple operation is obtained.

According to the fourteenth aspect of the present invention, the first and second images photographed from substantially the same position are simultaneously displayed, and any common points between the displayed first and second images are displayed. Is designated, and the coordinate position of an arbitrary common point of the designated first and second images is set as a coordinate position for generating a reference image, and the first and second images are aligned based on the coordinate position. Is performed, and the first and second images are shifted based on a coordinate position shifted by a predetermined coordinate in the vertical axis direction and / or the horizontal axis direction with respect to the coordinate position of an arbitrary common point of the designated second image. Performing a position adjustment, generating a pan-focus image serving as the reference image based on the aligned image, generating a pan-focus image serving as a peripheral image based on the aligned image, Predetermined The generated reference image is displayed on the display, and the generated peripheral image is associated with the relationship between the coordinate position for generating the reference image and the coordinate position for generating the peripheral image. Is displayed around the reference image around the reference image so that the reference image is arranged so as to surround the n layers, so that it is possible to change the parameter values of the reference image while referring to the peripheral image, Peripheral images are arranged near the reference image along the vertical and horizontal axes, so that a common point shift can be intuitively recognized, and efficient pan-focus image generation can be performed efficiently. Can be performed. As a result, there is an effect that an image processing method that allows a beginner to create a pan-focus image by a simple operation is obtained.

According to a fifteenth aspect of the present invention, in the fourteenth aspect of the present invention, further, one peripheral image is designated from among the displayed plural peripheral images, and the coordinate position of the coordinate position for performing the alignment is further determined. Since the coordinate position for generating the designated peripheral image is set as the coordinate position for generating the reference image, it is possible to easily change the peripheral image and efficiently obtain a desired image. As a result, there is an effect that an image processing method capable of creating a pan-focus image by a simple operation even for a beginner can be obtained.

According to a sixteenth aspect of the present invention, in the fifteenth aspect, the generated pan focus image is stored, and the pan focus image is generated and stored as a peripheral image when the peripheral image is designated. When an image is applicable, the corresponding pan-focus image is displayed as a peripheral image, so that when redisplaying the peripheral image, the already generated peripheral image can be used, thereby improving the processing speed of the redisplay. As a result, there is an effect that an image processing method capable of creating a pan-focus image by a simple operation even for a beginner can be obtained.

The storage medium according to the seventeenth aspect of the present invention records a program for causing a computer to execute the method according to any one of the ninth to sixteenth aspects, thereby making the program readable by a machine. Item 9
It is possible to obtain a recording medium capable of realizing the operations (1) to (16) by a computer.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram functionally showing the configuration of an entire image-attached document creation system including an image processing apparatus according to Embodiment 1 of the present invention.

FIG. 2 is a block diagram illustrating a hardware configuration of the image processing apparatus according to the first embodiment;

FIG. 3 is a block diagram functionally showing the configuration of the image processing apparatus according to the first embodiment.

FIG. 4 is a block diagram functionally showing a configuration of an image data storage unit, an image change unit, a display control unit, and peripheral units thereof in the image processing apparatus according to the first embodiment.

FIG. 5 is an explanatory diagram showing an example of a display screen displayed on the display unit of the image processing device according to the first embodiment.

FIG. 6 is an explanatory diagram showing another example of the display screen displayed on the display unit of the image processing device according to the first embodiment.

FIG. 7 is an explanatory diagram showing the content of an image to be subjected to pan focus image generation by the image processing apparatus according to the first embodiment;

FIG. 8 is an explanatory diagram showing the contents of another image that is a target of the pan-focus image generation of the image processing device according to the first embodiment.

FIG. 9 is an explanatory diagram showing another example of the display screen displayed on the display unit of the image processing device according to the first embodiment.

FIG. 10 is an explanatory diagram showing another example of the display screen displayed on the display unit of the image processing device according to the first embodiment.

FIG. 11 is an explanatory diagram showing another example of the display screen displayed on the display unit of the image processing device according to the first embodiment.

FIG. 12 is an explanatory diagram showing another example of the display screen displayed on the display unit of the image processing device according to the first embodiment.

FIG. 13 is an explanatory diagram illustrating an example of a window displayed on the display unit of the image processing device according to the first embodiment.

FIG. 14 is an explanatory diagram illustrating another example of a window displayed on the display unit of the image processing device according to the first embodiment.

FIG. 15 is a flowchart illustrating a procedure of a process of designating a common point among processes of the image changing unit and the display control unit according to the first embodiment;

FIG. 16 is a flowchart illustrating a procedure of a grid display process of the display control unit according to the first embodiment.

FIG. 17 is a flowchart illustrating a procedure of a process after a process of designating a common point in the processes of the image changing unit and the display control unit according to the first embodiment;

FIG. 18 is a block diagram functionally showing the configuration of an image changing unit and its peripheral parts of an image processing apparatus according to Embodiment 2 of the present invention.

FIG. 19 is an explanatory diagram illustrating an example of a display screen displayed on the display unit of the image processing device according to the second embodiment.

FIG. 20 is an explanatory diagram showing another example of the display screen displayed on the display unit of the image processing device according to the second embodiment.

FIG. 21 is a flowchart illustrating a procedure of a process of designating a common point among processes of the image changing unit and the display control unit according to the second embodiment;

FIG. 22 is a flowchart illustrating a procedure of a process after a process of designating a common point among processes of the image changing unit and the display control unit according to the second embodiment.

FIG. 23 is a block diagram functionally showing a configuration of an image changing unit, a display control unit, and peripheral components of the image processing apparatus according to the third embodiment of the present invention.

FIG. 24 is an explanatory diagram illustrating an example of a window displayed on the display unit of the image processing device according to the third embodiment.

FIG. 25 is an explanatory diagram showing common points on a second image of the image processing apparatus according to the third embodiment.

FIG. 26 is an explanatory diagram showing a relationship between common points and peripheral images of the image processing apparatus according to the third embodiment.

FIG. 27 is a flowchart illustrating a procedure of a display control process of the image processing apparatus according to the third embodiment.

FIG. 28 is an explanatory diagram showing a part of the display screen displayed on the display unit of the image processing device according to the third embodiment.

FIG. 29 is a flowchart showing a procedure of a peripheral image designation process and a reference image extraction process of the image processing apparatus according to the third embodiment.

[Explanation of symbols]

 REFERENCE SIGNS LIST 100 image processing device 101 input unit 102 processing unit 103 output unit 104 image data storage unit 201 CPU 205 HD 207 FD 208 display 211 keyboard 212 mouse 213 digital still camera 301 operation instruction unit 304 image change unit 307 display control unit 308 display unit 401 Designation unit 402 Position adjustment unit 403 Pan focus image generation unit 1801 Image classification unit 1802 Designation unit 1803 Position alignment unit 1804 Pan focus image generation unit 1805 First display control unit 1806 Second display control unit 2301 Designation unit 2302 Position alignment unit 2303 1 alignment unit 2304 second alignment unit 2305 pan-focus image generation unit 2306 first pan-focus image generation unit 2307 second pan-focus image generation unit 2308 1 coordinate position storage unit 2309 second coordinate position storage unit 2310 surrounding image enacted 2311 first display control section 2312 second display control section

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Toshinori Takagi 1-3-6 Nakamagome, Ota-ku, Tokyo F-term in Ricoh Co., Ltd. 5B057 CA08 CA12 CA16 CB08 CB12 CB16 CD05 CE08 CE10 DA07 5C076 AA19 AA21 AA36 BA06 CA02 5E501 AC15 AC33 AC34 EB06 EB12 EB14 FB04 FB22

Claims (17)

[Claims] 1. An image processing apparatus, comprising: display means for displaying an image on a display screen, wherein the image processing apparatus edits and processes an image displayed on the display means. Display control means for simultaneously displaying a plurality of images, specifying means for specifying a plurality of arbitrary common points among the plurality of images displayed by the display control means, and arbitrary common points specified by the specifying means. Positioning means for performing positioning between the plurality of images based on the coordinate position of; and pan-focus image generating means for generating one or more pan-focus images based on the images positioned by the positioning means. A pan focus image storage unit that stores one or a plurality of pan focus images generated by the pan focus generation unit; An image processing apparatus comprising: 2. The image processing apparatus according to claim 1, wherein the display control unit further displays a grid on the plurality of images. 3. An image processing apparatus, comprising: display means for displaying an image on a display screen, wherein the image processing apparatus edits and processes the image displayed on the display means. First display control means for simultaneously displaying the plurality of images, image division means for dividing the plurality of images displayed by the first display control means into divided areas of a predetermined size for each image, Specifying means for specifying an arbitrary common partitioned area between the displayed plurality of images among the divided partitioned areas; and a coordinate unit based on a coordinate position of the plurality of arbitrary common partitioned areas specified by the specifying means. Positioning means for positioning a plurality of images; and a pan for generating a pan-focus image based on the images positioned by the positioning means. The image processing apparatus characterized by comprising: a scan image generating means. 4. The image processing apparatus according to claim 3, further comprising a second display control unit that controls the display unit to enlarge and display the common section area designated by the designation unit. apparatus. 5. An image processing apparatus, comprising: display means for displaying an image on a display screen, wherein the image processing apparatus edits and processes the image displayed on the display means. Display control means for simultaneously displaying the first and second images, designating means for designating any common point between the first image and the second image displayed by the display control means, Alignment of the plurality of images is performed based on a coordinate position of a specified arbitrary common point, and alignment of the plurality of images is performed based on a coordinate position near an arbitrary common point of the second image. Positioning means; pan-focus image generating means for generating a plurality of pan-focus images based on the plurality of images aligned by the positioning means; The image processing apparatus comprising: the pan-focus image storage means for storing a plurality of pan-focus image generated by the generating means, further comprising: a. 6. An image processing apparatus, comprising: display means for displaying an image on a display screen, wherein the image processing apparatus edits and processes the image displayed on the display means. First display control means for simultaneously displaying the first and second images, and designating means for designating any common point of the first and second images displayed by the first display control means; A first coordinate position storing means for storing a coordinate position of an arbitrary common point of the first and second images specified by the specifying means as a coordinate position for generating a reference image; and a first coordinate position storing means. The vertical axis direction and / or the coordinate position of any common point of the stored second image
Alternatively, a second coordinate position storage unit that stores a coordinate position shifted by a predetermined coordinate amount in the horizontal axis direction, and a position of the first and second images based on the coordinate position stored by the first coordinate position storage unit. First alignment means for performing alignment; second alignment means for performing alignment of the first and second images based on the coordinate position stored by the second coordinate position storage means; and the first position A first pan-focus image generating unit that generates a pan-focus image serving as the reference image based on the image aligned by the aligning unit; and a peripheral image based on the image aligned by the second aligning unit. A second pan-focus image generating unit for generating a pan-focus image; and controlling the display unit to control the first pan-focus image at a predetermined position on the display screen. The reference image generated by the in-focus image generating means is displayed, and the peripheral image generated by the second pan-focus image generating means is generated by the first and second coordinate position storing means. In order to correspond to the relationship between the coordinate position and the coordinate position for generating the peripheral image, the reference image is displayed so as to be arranged in a state surrounding the reference image and surrounding the reference image with n layers around the reference image. An image processing apparatus comprising: a second display control unit. 7. A peripheral image designating unit for designating one peripheral image from a plurality of peripheral images displayed on the display unit, wherein the first coordinate position storing unit stores the second coordinate position. 7. The method according to claim 6, wherein, among the coordinate positions stored by said means, a coordinate position for generating a peripheral image specified by said peripheral image specifying means is stored as a coordinate position for generating a reference image. An image processing apparatus as described in the above. 8. A pan-focus image storage unit for storing a pan-focus image generated by the first and second pan-focus image generation units, wherein the second display control unit performs a peripheral operation by the peripheral image designation unit. 8. The image processing apparatus according to claim 7, wherein when a pan-focus image stored by the storage unit corresponds to the peripheral image when the image is designated, the corresponding pan-focus image is displayed as the peripheral image. apparatus. 9. An image processing method for displaying an image on a display screen and editing and processing the displayed image, wherein a display step of simultaneously displaying a plurality of images photographed from substantially the same position; A designation step of designating a plurality of arbitrary common points between the displayed plurality of images; and a positioning step of positioning the plurality of images based on the coordinate positions of the arbitrary common points designated in the designation step. And a pan-focus image generating step of generating one or a plurality of pan-focus images based on the images aligned in the alignment step. 10. The image processing method according to claim 9, wherein the display control step further displays a grid on the plurality of images. 11. An image processing method for displaying an image on a display screen and editing and processing the displayed image, wherein: a first display step of simultaneously displaying a plurality of images photographed from substantially the same position; An image dividing step of dividing a plurality of images displayed by one display step into divided areas of a predetermined size for each image; and an arbitrary one of the displayed plurality of images among the divided areas divided by the image dividing step. A designating step of designating a common partitioned area of the plurality of images; a positioning step of performing alignment of the plurality of images based on coordinate positions of a plurality of arbitrary common partitioned areas designated in the designating step; And a pan-focus image generating step of generating a pan-focus image based on the image aligned by the method. 12. The image processing method according to claim 11, further comprising a second display step of enlarging and displaying the common section area specified in the specifying step. 13. An image processing method for displaying an image on a display screen and editing and processing the displayed image, wherein a display step of simultaneously displaying first and second images photographed from substantially the same position; A designation step of designating an arbitrary common point between the first image and the second image displayed in the display step; and a position of the plurality of images based on a coordinate position of the arbitrary common point designated in the designation step Performing alignment, and a positioning step of performing alignment of the plurality of images based on a coordinate position near an arbitrary common point of the second image; and a plurality of images aligned by the alignment step. A pan-focus image generating step of generating a plurality of pan-focus images based on the pan-focus image. 14. An image processing method for displaying an image on a display screen and editing and processing the displayed image, wherein a first display step of simultaneously displaying first and second images photographed from substantially the same position. A designation step of designating an arbitrary common point between the first and second images displayed by the first display step; and an arbitrary common point between the first and second images designated by the designation step. As a coordinate position for generating a reference image, a first alignment step of aligning the first and second images based on the coordinate position, and a second alignment step designated by the designation step The first position is determined based on a coordinate position shifted by a predetermined coordinate in a vertical axis direction and / or a horizontal axis direction with respect to a coordinate position of an arbitrary common point of an image.
And a second alignment step of aligning the second image, and a first pan-focus image generation step of generating a pan-focus image serving as the reference image based on the image aligned in the first alignment step A second pan-focus image generating step of generating a pan-focus image serving as a peripheral image based on the image aligned in the second alignment step; and the first pan-focus image at a predetermined position on the display screen The reference image generated in the generating step is displayed, and the peripheral image generated in the second pan-focus image generating step is displayed in a coordinate position for generating the reference image and a coordinate position for generating the peripheral image. And surrounding the reference image in n layers around the reference image with the reference image as the center corresponding to the relationship Image processing method characterized by including a second display step of displaying to place in state, the. 15. A peripheral image specifying step of specifying one peripheral image from a plurality of peripheral images displayed in the second displaying step, wherein the first positioning step includes the second positioning step. The coordinate position for generating a reference image, wherein a coordinate position for generating a peripheral image specified in the peripheral image specifying step is set as a coordinate position for generating a reference image among coordinate positions for performing alignment in the step. 15. The image processing method according to 14. 16. The pan display apparatus according to claim 1, wherein the second display step includes generating and storing pans generated by the first and second pan-focus image generation steps as a peripheral image when a peripheral image is designated by the peripheral image fingering step. 16. The image processing method according to claim 15, wherein when the focus image is applicable, the corresponding pan focus image is displayed as a peripheral image. 17. A computer-readable recording medium on which a program for causing a computer to execute the method according to claim 9 is recorded.