JP2005284685A - Image composing device, image copying device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To compose divided images in fine appearance so that a boundary line is not conspicuous. <P>SOLUTION: An image input means 2 receives the input of a first image and a second image which are divided images, and an image composing means 3 forms a composite image with the first image and second image composed in a state of a clearance existing between the first image and the second image. A straight line setting means 4 sets a plurality of straight lines L passing an examination point γ in the clearance provided in the composite image. An intersection computing means 5 computes intersections P between a clearance side edge part α of the first image and the straight lines L and intersections Q between a clearance side edge part β of the second image and the straight lines L. A straight line selecting means 6 selects a straight line L' minimizing the difference of color information of the intersections P, Q, out of the straight lines L. A color information determining means 7 determines color information of the examination point γ using the color information of the intersections P', Q' of the selected straight line L'. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to the field of image processing, and more particularly, to an image composition device, an image copying device, and a program for composing a plurality of divided images.

In recent years, with the spread of personal computers, scanners, digital cameras, and the like, it has become common for individual users to perform digital image editing themselves. Such image editing is normally performed using image editing software, and by using its various editing functions, it is possible for an individual user who does not have specialized knowledge to easily perform image editing at a high level. (For example, refer nonpatent literature 1.).
Adobe Systems, “Adobe Photoshop”, [online], [March 26, 2004 search], Internet <URL: http: // www. Adobe. co. jp / products / photoshop / csnfh / main. html>

  However, conventionally, there has been no method for a person who does not have specialized knowledge to synthesize a picture that has been divided into a plurality of parts.

  For example, in a spread page of a magazine or the like, when the left and right images are read separately with a scanner and a single image is generated by avoiding the center binding portion, the combined portion of the two images is not acceptable. It will be continuous and will not look good composite images. Also, even when shooting subjects that do not fit in a single photograph, such as aerial photographs, divided into areas and combining them, a discontinuous part occurs in the combined part, and it looks good It is not a composite image.

  Usually, in order to appropriately correct such discontinuous portions and make the boundaries inconspicuous, specialized knowledge about image processing is required. For this reason, it is difficult for a general user who does not have such expertise to synthesize the image divided into a plurality of images in such a manner.

The present invention has been made in view of the above points, and by providing an image composition device that enables a person who does not have specialized knowledge to synthesize a divided image with a good appearance. is there.
Another object of the present invention is to provide an image copying apparatus to which this image composition apparatus is applied.

  In the first aspect of the present invention, in order to solve the above-described problem, the image input means for receiving the input of the first image and the second image, and a gap exists between the first image and the second image. Image combining means for generating a combined image obtained by combining the first image and the second image, straight line setting means for setting a plurality of straight lines L passing through the investigation point γ in the air gap, and the air gap side edge of the first image Intersection point calculating means for calculating the intersection point P between the part α and the straight line L and the intersection point Q between the gap-side edge part β of the second image and the straight line L; Color information for determining the color information of the survey point γ using the straight line selection means for selecting the straight line L ′ that minimizes the difference and the color information of the intersections P ′ and Q ′ of the straight line L ′ selected by the straight line selection means. And an image synthesizing apparatus.

Here, in the image composition means, a composite image in which a gap exists between the first image and the second image is generated, and a composite image is generated using image information from which the discontinuous portion of the image is excluded. be able to.
Further, the straight line selection means selects a straight line L ′ that minimizes the color information difference between the intersection points P and Q from the straight line L, and the color information determination means selects the color information of the intersection points P ′ and Q ′ of the straight line L ′. By determining the color information of the investigation point γ in the gap using, the gap can be complemented more appropriately.
As described above, it is possible to combine the divided images with a good appearance.

  In the second aspect of the present invention, the input of an image is received, and an image input means and a rectangular gap that passes through the central portion of the image and crosses the image are generated. This image is converted into the first image and the second image. A gap generating means for dividing the image into an image; a straight line setting means for setting a plurality of straight lines L passing through the investigation points γ in the gap; an intersection P between the gap-side edge α of the first image and the straight line L; An intersection calculation means for calculating the intersection point Q between the gap side edge portion β of the image and the straight line L, and a straight line selection means for selecting, from the straight line L, a straight line L ′ that minimizes the color information difference between the intersection points P and Q. And color information determining means for determining the color information of the investigation point γ using the color information of the intersections P ′ and Q ′ of the straight line L ′ selected by the straight line selecting means.

Here, the image input means accepts the input of the image, and the gap generation means generates a rectangular gap that passes through the central portion of the image and crosses the image, thereby discontinuous portions that cross the central portion of the image. (For example, a binding portion of a spread page) can be eliminated.
Further, the straight line selection means selects a straight line L ′ that minimizes the color information difference between the intersection points P and Q from the straight line L, and the color information determination means selects the color information of the intersection points P ′ and Q ′ of the straight line L ′. By determining the color information of the investigation point γ in the gap, the generated gap can be complemented more appropriately.
As described above, it is possible to eliminate a discontinuous portion such as a binding portion from a read image and generate a good-looking copy image.

In the present invention, a straight line L ′ that minimizes the difference in color information between the intersection points P and Q is selected from the straight line L, and the investigation point γ in the gap is used using the color information of the intersection points P ′ and Q ′ of the straight line L ′. By determining the color information, it is possible to more appropriately complement the gap between the divided images. As a result, even a person who does not have specialized knowledge can synthesize the divided images with good appearance.
Also, by applying this, it is possible to eliminate the discontinuous portion from the read image and generate a good-looking copy image.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[First Embodiment]
First, a first embodiment of the present invention will be described.

<Overview>
FIG. 1 is a diagram for explaining an outline of an image composition device 1 according to the present embodiment. Hereinafter, the outline of the image composition device 1 according to this embodiment will be described with reference to FIG.
The image composition device 1 generates a composite image of a plurality of input images (first image and second image).
When performing this image composition, first, the image composition device 1 receives the input of the first image and the second image in the image input means 2, sends them to the image composition means 3, and in the image composition means 3, A composite image is generated by combining the first image and the second image in a state where a gap (gap) exists between the first image and the second image. Then, the straight line setting means 4 receives this composite image, and sets a plurality of straight lines L passing through the investigation points γ in the gaps included in the composite image. The composite image and the set plurality of straight lines L are sent to the intersection calculation means 5, and the intersection calculation means 5 determines the intersection P between the gap-side edge portion α of the first image and the straight line L and the second from the information. The intersection point Q between the gap side edge portion β of the image and the straight line L is calculated. Information on the calculated intersection points P and Q is sent to the straight line selection means, and the straight line selection means 6 selects a straight line L ′ from the straight line L that minimizes the difference in color information between the intersection points P and Q. Then, the color information determination means 7 receives the color information of the intersections P ′ and Q ′ of the selected straight line L ′ and uses these to determine the color information of the survey point γ.
Similarly, the color information of each investigation point γ in the gap is sequentially determined, and the gap is complemented with the determined color information.
The gap between the divided images can be more appropriately complemented by the above processing. As a result, even a person who does not have specialized knowledge can synthesize the divided images with good appearance (so that connected portions of the images are not conspicuous).

<Details>
Next, details in this embodiment will be described.

<Hardware configuration>
FIG. 2 is a block diagram illustrating a hardware configuration of the image composition device 100 according to this embodiment.
As illustrated in FIG. 2, the image composition device 100 of this example includes a CPU (Central Processing Unit) 10, a RAM (Random Access Memory) 30, a ROM (Read Only Memory) 40, a hard disk (HD) device 50, and a scanner 61. , A mouse 62, a keyboard 63, and a display 70, and are connected to each other through a bus 80 so that they can communicate with each other. The CPU 10 implements the following processing functions by reading a program stored in the hard disk (HD) device 50 and executing processing according to the program.

<Functional configuration>
FIG. 3 is a block diagram illustrating a processing function constructed by causing the CPU 10 to execute the above-described program and a data configuration in the RAM 30.

  As illustrated in FIG. 3, by executing this program, the CPU 10 causes the image input unit 12, the image output unit 13, the boundary information input unit 14, the adjustment information input unit 15, the image adjustment unit 16, the image composition unit 17, Image duplicating means 18, filter means 19, straight line setting means 20, intersection calculating means 21, straight line selecting means 22, color information determining means 23, complementing means 24, singular point image generating means 25, image cutting means 26, singular point adding means 27 and control means 28 are constructed. Each of these means performs each calculation process in cooperation with the control of the control means 28. 3 indicates the flow of information, but the flow of control information from the control means 28 is omitted. In the course of each process of the CPU 10, each data is stored in each data area 30 a to 30 j in the RAM 30 and used for each process of the CPU 10.

FIG. 4 is a block diagram illustrating a detailed functional configuration of the image adjustment unit 16.
As illustrated in FIG. 4, the image adjusting unit 16 in this example includes a histogram generating unit 16a, a brightness adjusting unit 16b, a contrast adjusting unit 16c, a trimming unit 16d, and an image position adjusting unit 16e.

<Processing>
Next, processing of the image composition device 100 in this embodiment will be described.

<Pretreatment>
First, the user reads the first image and the second image using the scanner 61. Here, the first image and the second image are divided images of one image. That is, for example, the images of the left and right pages sandwiching the binding portion such as a magazine spread page correspond to the first image (for example, the left page) and the second image (for example, the right page).
The first image and the second image read in this way are sent to the hard disk device 50 through the bus 80 and stored therein.

<Overall processing>
5 to 7 are flowcharts for explaining the overall processing of the image composition apparatus 100. FIG. The overall processing of the image composition device 100 will be described below with reference to these drawings.

[Step S1]
Under the control of the control means 28 (FIG. 3), each data in the RAM 30 and the CPU 10 is initialized.

[Step S2]
Then, the image output unit 13 generates information constituting the main screen and displays it on the display 70 through the bus 80.

FIG. 16 is a diagram illustrating the configuration of the main screen 200 displayed on the display 70 as a result.
As illustrated in FIG. 16, an “image 1” button 201, an “image 2” button 202, a “trim 1” button 203, and a “trim 2” button 204 are displayed at the top of the main screen 200 in this example. , A “composite” button 205, a “clear” button 206, a “boundary” button 207, an “add” button 208, and a “delete” button 209.
In addition, an image display unit 210 that displays the first image and the second image side by side is arranged at the center of the main screen 200 in this example.

  Further, a first image contrast / brightness adjustment unit 220 and a second image contrast / brightness adjustment unit 230 are displayed at the bottom of the main screen 200 in this example. Here, the first image contrast / brightness adjustment unit 220 includes a histogram display unit 221, a type unit 222, an adjustment unit 223, a display unit 224, an adjustment lever 225, an automatic adjustment button 226 (“automatic contrast / brightness adjustment”). ”) Is displayed, and the second image contrast / brightness adjustment unit 230 includes a histogram display unit 231, a type unit 232, an adjustment unit 233, a display unit 234, an adjustment lever 235, and an automatic adjustment button 236 (“ automatic contrast / brightness ”). Brightness adjustment ") is displayed. In addition, in each type portion 222, 232, "brightness", "red", "green", and "blue" columns are displayed, and corresponding active portions 222a to 222d and 232a to 232d are displayed. In addition, in each of the adjustment units 223 and 233, columns of “contrast” and “brightness” are displayed, and corresponding active portions 223a, 223b, 233a, and 233b are displayed. Further, in each of the display units 224 and 234, columns of “entire” and “connection place” are displayed, and corresponding active portions 224a, 224b, 234a, and 234b are displayed.

[Step S3]
Under the control of the control means 28 (FIG. 3), an input operation on the mouse 62 and the keyboard 63 is accepted.

[Step S4]
In the control means 28, it is determined whether or not the “image 1” button 201 or the “image 2” button 202 (FIG. 16) is clicked by the operation of the mouse 62. If it is determined that the “image 1” button 201 has been clicked, the process proceeds to step S5. If it is determined that the “image 2” button 202 has been clicked, the process proceeds to step S7. If so, the process proceeds to step S10.

[Step S5]
Under the control of the control means 28 (FIG. 3), input of selection information (for example, file name) of the first image (g ₁ ) is received by the mouse 62, and the selection information is sent to the image input means 12, and step S6. Proceed to

[Step S6]
The image input means 12 accesses the hard disk device 50 through the bus 80 based on the selection information sent from the mouse 62, extracts the _first image (g ₁ ) stored therein, and accepts the input. The input first image (g ₁ ) is sent to the RAM 30 and stored in the storage area 30b. Thereafter, the process proceeds to step S9.

[Step S7]
Under the control of the control means 28 (FIG. 3), input of selection information (for example, a file name) of the second image (g ₂ ) is received by the mouse 62, and the selection information is sent to the image input means 12, and step S8. Proceed to

[Step S8]
Based on the selection information sent from the mouse 62, the image input means 12 accesses the hard disk device 50 through the bus 80, extracts the _second image (g ₂ ) stored therein, and inputs it. Accept. The input second image (g ₂ ) is sent to the RAM 30 and stored in the storage area 30b. Thereafter, the process proceeds to step S9.

[Step S9]
The image adjusting means 16 extracts the first image (g ₁ ) and the second image (g ₂ ) from the storage area 30b of the RAM 30, and the histogram generating means 16a extracts the first image and the second image. A histogram (H ₁ , H ₂ ) of the luminance and the number of pixels having the luminance (count number) (for example, a histogram having the horizontal axis as the luminance and the vertical axis as the count number) is generated. The generated histograms (H ₁ , H ₂ ) are sent to the RAM 30 and stored in the storage area 30c.

Thereafter, the process proceeds to step S2, and the image output means 13 extracts the first image (g ₁ ), the second image (g ₂ ), and the histogram (H ₁ , H ₂ ) from the storage area 30c of the RAM 30, and extracts them. , Output and display on the display 70 through the bus 80. Specifically, for example, the first image (g ₁ ) and the second image (g ₂ ) are displayed in a specified positional relationship (initial positional relationship) on the image display unit 210 (FIG. 16) of the main screen 200. The histogram display unit 221 displays the first image histogram (H ₁ ), and the histogram display unit 231 displays the second image histogram (H ₂ ).

[Step S10]
In the control means 28, it is determined whether or not the “trim 1” button 203 or the “trim 2” button 203 (FIG. 16) is clicked by the operation of the mouse 62. If it is determined that the “trim 1” button 203 has been clicked, the process proceeds to step S11. If it is determined that the “trim 2” button 204 has been clicked, the process proceeds to step S13. If so, the process proceeds to step S15.

[Step S11]
First, under the control of the control means 28 (FIG. 3), the mouse 62 or the keyboard 63 receives input of trim information (ad ₅ ) of the first image (g ₁ ). The input trim information (ad ₅ ) is sent to the adjustment information input means 15 through the bus 80, and from there to the trim means 16d (FIG. 4) of the image adjustment means 16. Then, the process proceeds to step S12. The “trim information” is information for specifying an image deletion area (trimming area). For example, in the case of a magazine spread page, the edge portion of the page is designated as a “trim area”.

[Step S12]
The trim unit 16d extracts the _first image (g ₁ ) from the storage area 30b of the RAM 30, and trims the first image (g ₁ ) according to the trim information (ad ₅ ) sent in step S11. Hereinafter, the first image on which the predetermined process has been performed is expressed as “g ₁ ′”. The first image (g ₁ ′) is sent to the RAM 30 and stored in the storage area 30d. Then, the process returns to step S2.

[Step S13]
First, under the control of the control means 28 (FIG. 3), input of trim information (ad ₆ ) of the second image (g ₂ ) is accepted by the mouse 62 or the keyboard 63. The input trim information (ad ₆ ) is sent to the adjustment information input means 15 through the bus 80 and from there to the trim means 16 d (FIG. 4) of the image adjustment means 16. Then, the process proceeds to step S13.

[Step S14]
The trim means 16d extracts the _second image (g ₂ ) from the storage area 30b of the RAM 30, and trims the second image (g ₂ ) according to the trim information (ad ₆ ) sent in step S13. Hereinafter, the second image on which the predetermined process has been performed is expressed as “g ₂ ′”. The second image (g ₂ ′) is sent to the RAM 30 and stored in the storage area 30d. Then, the process returns to step S2.

[Step S15]
In the control means 28, it is determined whether or not the direction key of the keyboard 63 has been operated. If it is determined that the direction key has been operated, the process proceeds to step S16. If it is determined that the direction key has not been operated, the process proceeds to step S17.

[Step S16]
The adjustment information input means 15 receives the direction key input information (ad ₇ ) of the keyboard 63 through the bus 80 and sends it to the image position adjustment means 16 e (FIG. 4) of the image adjustment means 16. The image position adjusting unit 16e sets a variation (LC) from the default position relationship (initial position relationship) of the second image to the first image in accordance with the received direction key input information (ad ₇ ). The data is stored in the storage area 30d of the RAM 30. Then, the process returns to step S2. Thereafter, the first image and the second image output from the image output unit 13 are displayed on the display 70 in the relative positional relationship of the initial positional relationship + the variation (LC).

[Step S17]
In the control means 28, it is determined whether or not the “add” button 208 (FIG. 16) has been clicked by the user's operation of the mouse 62. If it is determined that the “add” button 208 has been clicked, the process proceeds to step S18. If not, the process proceeds to step S20.

[Step S18]
Under the control of the control means 28 (FIG. 3), the mouse 62 receives input of boundary information (BL). The input boundary information (BL) is sent to the boundary information input means 14 through the bus 80, and the boundary information input means 14 receives this.

  Here, “boundary information” means information indicating the boundary of an object in the first image and the second image. And this boundary information is used in order to restrict | limit the inclination range of the straight line L which passes along the specific investigation point (gamma) (after-mentioned).

FIG. 17 is a diagram visually showing boundary information (BL) input in this way.
In this example, it is assumed that the first image 301 and the second image 302 are arranged on the image display unit 210 (FIG. 16) of the main screen 200 with a gap 303 as shown in FIG. The first image 301 and the second image 302 in this example are composed of objects 301a and 302a and backgrounds 301b and 302b, respectively. Here, the first image 301 and the second image 302 are images obtained by dividing one image, and the objects 301a and 302a are originally integrated. Therefore, the boundary 301c between the object 301a and the background 301b and the boundary 302c between the object 302a and the background 302b are originally connected. If the width w of the gap 303 is sufficiently small, this connecting portion can be approximated by a straight line. The boundary information (BL) is information for designating the connected portion by a straight line. The boundary information (BL) is set by the user operating the mouse 62 and designating (clicking) the end point 304a on the gap 303 side of the boundary 301c and the end point 304b on the gap side of the boundary 302c. Is called. That is, the straight line 304 connecting these end points 304a and 304b is the boundary information (BL).
When the boundary information input unit 14 receives the input of boundary information (BL), the process proceeds to step S19.

[Step S19]
The boundary information (BL) input to the boundary information input means 14 is sent to the RAM 30 and stored in the storage area 30a. Further, the image output means 13 extracts boundary information (BL) from the storage area 30a, sends it to the display 70, and displays it. Then, it returns to step S2.

[Step S20]
In the control means 28, it is determined whether or not the “delete” button 209 (FIG. 16) is clicked by the user's operation of the mouse 62. If it is determined that the “delete” button 209 has been clicked, the process proceeds to step S21. If not, the process proceeds to step S23.

[Step S21]
Under the control of the control means 28 (FIG. 3), input of information specifying boundary information (BL) with the mouse 62 (for example, information specifying the straight line 304 of FIG. 17 determined by clicking or the like) is accepted. Information specifying the input boundary information (BL) is sent to the boundary information input means 14 through the bus 80, and the boundary information input means 14 accepts the information. Then, it sends to step S22.

[Step S22]
The boundary information input means 14 that has received the information specifying the boundary information (BL) accesses the RAM 30 and deletes the boundary information (BL) specified by this information from the storage area 30a. Then, it returns to step S2.

[Step S23]
In the control means 28, it is determined whether or not the “boundary” button 207 (FIG. 16) has been clicked by the user's operation of the mouse 62. If it is determined that the “boundary” button 207 has been clicked, the process proceeds to step S24. If not, the process proceeds to step S29.

[Step S24]
In the control unit 28 determines whether the variable _{f 1} is 0 stored in the storage area 30j of the RAM 30. If the variable f ₁ = 0 (including the initial state in which the variable f ₁ is not stored in the storage area 30j), the process proceeds to step S25. Otherwise, the process proceeds to step S27.

[Step S25]
In the image output means 13, the boundary information (BL) displayed on the display 70 is not displayed, and the process proceeds to step S26.

[Step S26]
In the control means 28, 1 is substituted into the variable f ₁ and stored in the storage area 30j of the RAM 30. Then, it returns to step S2.

[Step S27]
In the image output means 13, the boundary information (BL) is displayed on the display 70, and the process proceeds to step S28.

[Step S28]
In the control means 28, 0 is substituted into the variable f ₁ and stored in the storage area 30j of the RAM 30. Then, it returns to step S2.

[Step S29]
In the control unit 28, it is determined whether any active part in the first image contrast / brightness adjustment unit 220 is clicked by the user's operation of the mouse 62. If it is determined that any active part in the first image contrast / brightness adjustment unit 220 has been clicked, the process proceeds to step S30. If not, the process proceeds to step S31.

[Step S30]
The contrast and brightness of the first image are adjusted, and the process returns to step S2. Details of this process will be described later.

[Step S31]
In the control means 28, it is determined whether any active part in the second image contrast / brightness adjusting unit 230 has been clicked by the user's operation of the mouse 62. If it is determined that any active part in the second image contrast / brightness adjustment unit 230 has been clicked, the process proceeds to step S32. Otherwise, the process proceeds to step S33.

[Step S32]
The contrast and brightness of the second image are adjusted, and the process returns to step S2. Details of this process will be described later.

[Step S33]
In the control means 28, it is determined whether or not the “composite” button 205 (FIG. 16) has been clicked by the user's operation of the mouse 62. If it is determined that the “composite” button 205 has been clicked, the process proceeds to step S34. If not, the process proceeds to step S35.

[Step S34]
Image composition processing is performed, and the process returns to step S2. Details of the image composition processing will be described later.

[Step S35]
In the control means 28, it is determined whether or not the “clear” button 206 (FIG. 16) has been clicked by the user's operation of the mouse 62. If it is determined that the “clear” button 206 has been clicked, the process proceeds to step S36. If not, the process returns to step S2.

[Step S36]
The result of the image composition processing performed in step S34 is cleared (the storage areas 30e to 30i of the RAM 30 are initialized), and the process returns to step S2.

<First image contrast / brightness adjustment processing>
Next, details of the first image contrast / brightness adjustment process (FIG. 7: step S30) will be described.
8 and 9 are flowcharts for explaining the details of the contrast / brightness adjustment processing of the first image. Hereinafter, description will be given along this flowchart.

[Step S41]
In the control means 28, it is determined whether or not the active part of the adjustment unit 223 (FIG. 16) has been clicked by the user's operation of the mouse 62. If the active part 223a corresponding to “contrast” is clicked, the process proceeds to step S42. If the active part 223b corresponding to “brightness” is clicked, the process proceeds to step S43. Then, the process proceeds to step S44.

[Step S42]
In the control unit 28 substitutes 0 for the variable _{f 2,} and stores the variable _{f 2} in the storage area 30j of the RAM 30. Then, the contrast / brightness adjustment processing (step S30) of the first image ends.

[Step S43]
In the control unit 28 substitutes 1 into the variable _{f 2,} and stores the variable _{f 2} in the storage area 30j of the RAM 30. Then, the contrast / brightness adjustment processing (step S30) of the first image ends.

[Step S44]
In the control means 28, it is determined whether or not the active part of the display unit 224 (FIG. 16) has been clicked by the user's operation of the mouse 62. If the active part 224a corresponding to “whole” is clicked, the process proceeds to step S45. If the active part 224b corresponding to “connection place” is clicked, the process proceeds to step S46. Then, the process proceeds to step S47.

[Step S45]
In the control unit 28 substitutes 0 for the variable _{f 3,} and stores the variable _{f 3} in the storage area 30j of the RAM 30. Then, the process proceeds to step S54.

[Step S46]
In the control unit 28 substitutes 1 into the variable _{f 3,} and stores the variable _{f 3} in the storage area 30j of the RAM 30. Then, the process proceeds to step S54.

[Step S47]
In the control means 28, it is determined whether or not the active portion of the type portion 222 (FIG. 16) has been clicked by the user's operation of the mouse 62. Here, when the active part of any kind part 222 is clicked, it progresses to step S48, and when that is not right, it progresses to step S55.

[Step S48]
The control means 28 determines which active part of the type part 222 has been clicked. If the active part 222a corresponding to “luminance” is clicked, the process proceeds to step S49. If the active part 222b corresponding to “red” is clicked, the process proceeds to step S50. Advances to step S51.

[Step S49]
In the control unit 28 substitutes 0 for the variable _{f 4,} and stores the variable _{f 4} in a storage area 30j of the RAM 30. Then, the process proceeds to step S54.

[Step S50]
In the control unit 28 substitutes 1 into the variable _{f 4,} and stores the variable _{f 4} in a storage area 30j of the RAM 30. Then, the process proceeds to step S54.

[Step S51]
The control means 28 determines which active part of the type part 222 has been clicked. If the active portion 222c corresponding to “green” is clicked, the process proceeds to step S52. If the active portion 222d corresponding to “blue” is clicked, the process proceeds to step S53.

[Step S52]
In the control unit 28 substitutes 2 for the variable _{f 4,} and stores the variable _{f 4} in a storage area 30j of the RAM 30. Then, the process proceeds to step S54.

[Step S53]
In the control unit 28 substitutes the variable _{f 4} to 3, and stores the variable _{f 4} in a storage area 30j of the RAM 30. Then, the process proceeds to step S54.

[Step S54]
In the histogram generating means 16a (FIG. 4), the first image (g ₁ (g ₁ ′ after processing the first image)) is extracted from the storage area 30b or 30d of the RAM 30, and the variables f ₃ and f ₄ are set. Extracted from the storage area 30j of the RAM 30. Then, the following histogram (H ₁ ) is generated according to the values of the variables f ₃ and f ₄ and stored in the storage area 30 c of the RAM 30.

f ₃ = 0: A histogram (H ₁ ) of the entire first image is generated.
f ₃ = 1: A histogram (H ₁ ) of a connection portion (gap side edge portion) with the second image in the first image is generated.
f ₄ = 0: A histogram (H ₁ ) of all hues of the first image is generated.
f ₄ = 1: A histogram (H ₁ ) of the red element of the first image is generated.
f ₄ = 2: A histogram (H ₁ ) of the green element of the first image is generated.
f ₄ = 3: A histogram (H ₁ ) of the blue element of the first image is generated.
The histogram (H ₁ ) stored in the storage area 30 c is extracted by the image output means 13 and output to the display 70. The display 70 displays the histogram (H ₁ ) on the histogram display unit 221 illustrated in FIG. Thereafter, the contrast / brightness adjustment processing (step S30) of the first image is ended.

[Step S55]
In the control means 28, it is determined whether or not the adjustment lever 225 (FIG. 16) has been dragged by the user's operation of the mouse 62. If the control means 28 determines that the adjustment lever 225 is not dragged, the process proceeds to step S60. On the other hand, when the adjustment lever 225 is determined to be dragged, the control unit 28 extracts the value of the variable f ₂ stored in the storage area 30j of the memory in the RAM 30, when it is 0 ( the included) if the variable f ₂ is not stored proceeds to step S56, in the case was 1, the process proceeds to step S58.

[Step S56]
In the adjustment information input means 15, information related to the drag of the adjustment lever 225 (corresponding to “adjustment information for changing the brightness of the image”) is received from the mouse 62 (accepts input) through the bus 80. Then, the adjustment information input means 15 determines the brightness of the image based on this adjustment information, sends it to the image adjustment means 16 as brightness adjustment information (ad ₁ ). Then, the process proceeds to step S57.

[Step S57]
The brightness adjustment unit 16b of the image adjustment unit 16 receives the brightness adjustment information (ad ₁ ). Further, the brightness adjustment unit 16b extracts the first image (g ₁ (g ₁ ′ after processing the first image)) from the storage area 30b or 30d of the RAM 30, and the brightness of the first image. Is changed to the brightness indicated by the brightness adjustment information (ad ₁ ) (that is, “the brightness of the first image is changed based on the adjustment information”). Then, the brightness adjusting unit 16b sends the first image (g ₁ ′) whose brightness has been changed to the RAM 30 and stores it in the storage area 30d. Then, the process proceeds to step S61.

[Step S58]
In the adjustment information input means 15, information related to the drag of the adjustment lever 225 (corresponding to “adjustment information for changing the contrast of the image”) is received from the mouse 62 through the bus 80 (input is received). Then, the adjustment information input means 15 determines the contrast of the image based on this adjustment information, sends it as contrast adjustment information (ad ₃ ), and sends it to the image adjustment means 16. Then, the process proceeds to step S59.

[Step S59]
The contrast adjustment unit 16c of the image adjustment unit 16 receives the contrast adjustment information (ad ₃ ). Further, the contrast adjusting unit 16c extracts the first image (g ₁ (g ₁ ′ after processing the first image)) from the storage area 30b or 30d of the RAM 30, and the contrast of the first image is determined as the contrast. Change to the contrast indicated by the adjustment information (ad ₃ ) (that is, “change the contrast of the first image based on the adjustment information”). Then, the contrast adjusting means 16c sends the first image (g ₁ ′) whose contrast has been changed to the RAM 30 and stores it in the storage area 30d. Then, the process proceeds to step S61.

[Step S60]
The process proceeds to this step when the automatic adjustment button 226 (FIG. 16) is clicked. In this step, the image adjustment unit 16 performs automatic adjustment of the first image, and the process proceeds to step S61. Details of this processing will be described later.

[Step S61]
In the image output means 13 (FIG. 3), the first image (g ₁ ′) and the second image (g ₂ ′) are extracted from the storage area 30 d of the RAM 30, and these are extracted to the display 70 through the bus 80. Output. Then, the display 70 displays the first image (g ₁ ′) and the second image (g ₂ ′) on the image display unit 210 (FIG. 16).

<Automatic adjustment of the first image>
Next, details of the first image automatic adjustment process (FIG. 9: step S60) will be described.

  FIG. 10 is a flowchart for explaining the details of the automatic adjustment of the first image. Hereinafter, description will be given along this flowchart.

[Step S71]
In the histogram generation means 16a (FIG. 4) of the image adjustment means 16, the first image (g ₁ (g ₁ ′ after processing the first image)) and the second image (g ₂ (second image After processing, g ₂ ′)) is extracted from the storage area 30b or 30d of the RAM 30, and for the first image and the second image, a histogram of the luminance and the number of pixels having the luminance (count number) (H ₁ , H ₂ ).

These histograms (H ₁ , H ₂ ) are for adjusting the brightness and contrast of the first image, and the purpose of the adjustment is to make the first image and the second image look good. Synthesizing (so that the binding part is not noticeable). Therefore, it is desirable that these histograms (H ₁ , H ₂ ) are histograms on the connection portion side (connection portion) of the first image and the second image. That is, for example, when the first image and the second image have left and right pages sandwiching the binding portion of the magazine spread page, these histograms (H ₁ , H ₂ ) are displayed on the binding portion side of the left page. The histogram of the image and the histogram of the binding portion side image on the right page are desirable.

The histograms (H ₁ , H ₂ ) generated by the histogram generation unit 16a are sent to the brightness adjustment unit 16b and the contrast adjustment unit 16c, and the process proceeds to step S72.

[Step S72]
In the contrast adjusting unit 16c, the difference between the width (a ₃ ) of the histogram H ₁ corresponding to the first image and the width (b ₃ ) of the histogram H ₂ corresponding to the second image is within an allowable range (p ₁ ≧ 0) is determined. That is,
| Width of H ₁ (a ₃ ) −Width of H ₂ (b ₃ ) | ≦ p ₁
It is determined whether or not. The “histogram width” means a value obtained by subtracting the minimum luminance value with the count number equal to or greater than the threshold value from the maximum luminance value with the count number equal to or greater than the threshold value.

(A) of FIG. 18 is illustrative of the histogram H ₁ corresponding to the first image, (b) are exemplary of a histogram H ₂ corresponding to the second image. Note that the horizontal axis of these histograms is the luminance, and the vertical axis is the number of pixels having the luminance (count number) (the same applies to (c) and (d) of FIG. 18 described later).

In the case of the histogram H _{1 in} this example, the maximum value of the luminance with the count number equal to or greater than the threshold is a ₂ , the minimum value of the luminance with the count number equal to or greater than the threshold is a ₁ , and its width a ₃ is a ₃ = a ₂ −a ₁ ((a) of FIG. 18). In the case of the histogram H _{2 in} this example, the maximum value of the luminance with the count number equal to or greater than the threshold is b ₂ , and the minimum value of the luminance with the count number equal to or greater than the threshold is b ₁ , The width b ₃ is b ₃ = b ₂ −b ₁ ((b) in FIG. 18).

Here, the contrast adjustment unit 16c, | _{H 1} having a width _(a 3) -H ₂ width _(b 3) | When it is determined that satisfy ≦ _{p 1,} the process proceeds to step S75. On the other hand, if this is not satisfied and the width of H ₁ (a ₃ ) −the width of H ₂ (b ₃ )> p ₁ , the process proceeds to step S73 and the width of H ₂ (b ₃ ) −H _1. If the width (a ₃ )> p ₁ is satisfied, the process proceeds to step S74.

For example, in the example of FIGS. 18A and 18B, if the allowable range p ₁ = 0, the width of H ₁ (a ₃ ) −the width of H ₂ (b ₃ )> p ₁ , Proceed to S73.

[Step S73]
In the contrast adjusting unit 16c, the first image (g ₁ (g ₁ ′ after processing the first image)) is extracted from the storage area 30b or 30d of the RAM 30, and the contrast is reduced (reduced) by a predetermined value. ). Then, in the contrast adjusting unit 16c, the first image (g ₁ ′) is stored in the storage area 30d of the RAM 30, and the process returns to step S71.

[Step S74]
In the contrast adjusting means 16c, the first image (g ₁ (g ₁ ′ after processing the first image)) is extracted from the storage area 30b or 30d of the RAM 30, and the contrast is increased by a predetermined value (addition). To do). Then, in the contrast adjusting unit 16c, the first image (g ₁ ′) is stored in the storage area 30d of the RAM 30, and the process returns to step S71.

[Step S75]
In the brightness adjusting unit 16b, the difference between the position of the histogram of H ₂ histograms H ₁ determines whether it is within the allowable range (p ₂ ≧ 0). That is,
| H ₁ position (a ₁ ) −H ₂ position (b ₁ ) | ≦ p ₂
It is determined whether or not. Note that the “histogram position” in this example means the minimum value of luminance at which the count number is equal to or greater than a threshold value.

(C) in FIG. 18, with respect to the first image and the second image of (a) histogram illustrated in _{(b) (H 1, H} 2), repeats the processing of steps S71 to S74, in step S72 | H ₁ width (a ₃ ) −H ₂ width (b ₃ ) | ≦ p ₁ is an illustration of the histogram H ₁ of the first image determined to be p ₁ .

For example (c) of FIG. 18, the position of the histogram H ₁ is the minimum value a ₁ of luminance count is equal to or greater than a threshold value. The position of the histogram H ₂ illustrated in (b) is the minimum value b ₁ of the luminance count is equal to or greater than a threshold value.

Here, the brightness adjusting unit 16b, | position of _{H 1 (a} 1) position of -H _{2 (b} 1) | When it is determined that satisfy ≦ _{p 2,} the automatic generation processing of the first image (Step S60) is terminated. On the other hand, if this is not satisfied and the position of H ₁ (a ₁ ) −the position of H ₂ (b ₁ )> p ₂ , the process proceeds to step S76 and the position of H ₂ (b ₁ ) −H _1. If the position (a ₁ )> p ₂ , the process proceeds to step S77.

For example, in the example of FIGS. 18B and 18C, if the allowable range p ₂ = 0, the position of H ₂ (b ₁ ) −the position of H ₁ (a ₁ )> p ₂ , Proceed to S77.
In this example, the histogram H ₁ of the first image determined to satisfy the position of | H ₁ (a ₁ ) −the position of H ₂ (b ₁ ) | ≦ p ₂ is shown in FIG. As described above, the histogram H2 of the _second image illustrated in (b), the contrast, and the brightness are within the allowable range (in this example, coincident).

In this example, the minimum luminance value with a count number equal to or greater than the threshold value is defined as “histogram position”, but the maximum luminance value with the count number equal to or greater than the threshold value ((b) in FIG. 18 ( It is possible to treat a ₂ and b2) in c) as “histogram positions”.

[Step S76]
In the brightness adjustment means 16b, the first image (g ₁ ′) is extracted from the storage area 30d of the RAM 30, and the brightness is reduced (reduced) by a predetermined value. Then, the brightness adjusting means 16b stores the first image (g ₁ ′) in the storage area 30d of the RAM 30, and the process returns to step S71.

[Step S77]
In the brightness adjustment unit 16b, the first image (g ₁ ′) is extracted from the storage area 30d of the RAM 30, and the brightness is increased (added) by a predetermined value. Then, the brightness adjusting means 16b stores the first image (g ₁ ′) in the storage area 30d of the RAM 30, and the process returns to step S71.

<Second image contrast / brightness adjustment processing>
Next, details of the second image contrast / brightness adjustment process (FIG. 7: step S32) will be described.

  11 and 12 are flowcharts for explaining details of the contrast / brightness adjustment processing of the second image. Hereinafter, description will be given along this flowchart.

[Step S81]
In the control means 28, it is determined whether or not the active part of the adjustment unit 233 (FIG. 16) has been clicked by the user's operation of the mouse 62. If the active part 233a corresponding to “contrast” is clicked, the process proceeds to step S82. If the active part 233b corresponding to “brightness” is clicked, the process proceeds to step S83. Then, the process proceeds to step S84.

[Step S82]
In the control unit 28 substitutes the variable _{f 5} to 0, and stores the variable _{f 5} in the storage area 30j of the RAM 30. Then, the contrast / brightness adjustment process (step S32) of the second image ends.

[Step S83]
In the control unit 28 substitutes 1 into the variable _{f 5,} and stores the variable _{f 5} in the storage area 30j of the RAM 30. Then, the contrast / brightness adjustment process (step S32) of the second image ends.

[Step S84]
In the control means 28, it is determined whether or not the active part of the display unit 234 (FIG. 16) has been clicked by the user's operation of the mouse 62. If the active part 234a corresponding to “whole” is clicked, the process proceeds to step S85. If the active part 234b corresponding to “connection place” is clicked, the process proceeds to step S86. Then, the process proceeds to step S87.

[Step S85]
In the control unit 28 substitutes 0 for the variable _{f 6,} and stores the variable _{f 6} in the storage area 30j of the RAM 30. Then, the process proceeds to step S94.

[Step S86]
In the control unit 28 substitutes 1 into the variable _{f 6,} and stores the variable _{f 6} in the storage area 30j of the RAM 30. Then, the process proceeds to step S94.

[Step S87]
In the control means 28, it is determined whether or not the active portion of the type portion 232 (FIG. 16) has been clicked by the user's operation of the mouse 62. Here, when the active part of any kind part 232 is clicked, it progresses to step S88, and when that is not right, it progresses to step S95.

[Step S88]
The control means 28 determines which active part of the type part 232 has been clicked. If the active part 232a corresponding to “luminance” is clicked, the process proceeds to step S89. If the active part 232b corresponding to “red” is clicked, the process proceeds to step S90. Advances to step S91.

[Step S89]
In the control unit 28 substitutes 0 for the variable _{f 7,} and stores the variable _{f 7} in the storage area 30j of the RAM 30. Then, the process proceeds to step S94.

[Step S90]
In the control unit 28 substitutes 1 into the variable _{f 7,} and stores the variable _{f 7} in the storage area 30j of the RAM 30. Then, the process proceeds to step S94.

[Step S91]
The control means 28 determines which active part of the type part 232 has been clicked. If the active part 232c corresponding to “green” is clicked, the process proceeds to step S92. If the active part 232d corresponding to “blue” is clicked, the process proceeds to step S93.

[Step S92]
In the control unit 28 substitutes 2 for the variable _{f 7,} and stores the variable _{f 7} in the storage area 30j of the RAM 30. Then, the process proceeds to step S94.

[Step S93]
In the control unit 28 substitutes 3 to the variable _{f 7,} and stores the variable _{f 7} in the storage area 30j of the RAM 30. Then, the process proceeds to step S94.

[Step S94]
In the histogram generation means 16a (FIG. 4), the second image (g ₂ (g ₂ ′ after the processing of the second image)) is extracted from the storage area 30b or 30d of the RAM 30, and the variables f ₆ and f ₇ are set. Extracted from the storage area 30j of the RAM 30. Then, the following histogram (H ₂ ) is generated according to the values of the variables f ₆ and f ₇ and stored in the storage area 30 c of the RAM 30.

f ₆ = 0: A histogram (H ₂ ) of the entire second image is generated.
f ₆ = 1: A histogram (H ₂ ) of a connection portion (gap side edge portion) with the first image in the second image is generated.
f ₇ = 0: A histogram (H ₂ ) of all hues of the second image is generated.
f ₇ = 1: A histogram (H ₂ ) of the red element of the second image is generated.
f ₇ = 2: A histogram (H ₂ ) of the green element of the second image is generated.
f ₇ = 3: A histogram (H ₂ ) of the blue element of the second image is generated.
The histogram (H ₂ ) stored in the storage area 30 c is extracted by the image output means 13 and output to the display 70. The display 70 displays the histogram (H ₂ ) on the histogram display unit 231 illustrated in FIG. Thereafter, the contrast / brightness adjustment processing (step S32) of the first image ends.

[Step S95]
In the control means 28, it is determined whether or not the adjustment lever 235 (FIG. 16) has been dragged by the user's operation of the mouse 62. If the control means 28 determines that the adjustment lever 235 has not been dragged, the process proceeds to step S100. On the other hand, if it is determined that the adjustment lever 235 is dragged, the control means 28 extracts the value of the variable f ₅ stored in the storage area 30j of the RAM 30 and if it is 0 ( the included) if the variable f ₅ is not stored proceeds to step S96, in the case were 1 proceeds to step S98.

[Step S96]
In the adjustment information input means 15, information related to the drag of the adjustment lever 235 (corresponding to “adjustment information for changing the brightness of the image”) is received from the mouse 62 via the bus 80 (input is received). Then, the adjustment information input means 15 determines the brightness of the image based on this adjustment information, sends it to the image adjustment means 16 as brightness adjustment information (ad ₂ ). Then, the process proceeds to step S97.

[Step S97]
The brightness adjustment unit 16b of the image adjustment unit 16 receives the brightness adjustment information (ad ₂ ). Further, the brightness adjusting unit 16b extracts the second image (g ₂ (g ₂ ′ after processing the second image)) from the storage area 30b or 30d of the RAM 30, and the brightness of the second image. Is changed to the brightness indicated by the brightness adjustment information (ad ₂ ) (that is, “the brightness of the second image is changed based on the adjustment information”). Then, the brightness adjustment unit 16b sends the second image (g ₂ ′) whose brightness is changed to the RAM 30 and stores it in the storage area 30d. Then, the process proceeds to step S101.

[Step S98]
In the adjustment information input means 15, information related to the drag of the adjustment lever 235 (corresponding to “adjustment information for changing the contrast of the image”) is received from the mouse 62 through the bus 80 (input is received). Then, the adjustment information input means 15 determines the contrast of the image based on this adjustment information, sends it as contrast adjustment information (ad ₄ ), and sends it to the image adjustment means 16. Then, the process proceeds to step S99.

[Step S99]
The contrast adjustment means 16c of the image adjustment means 16 receives the contrast adjustment information (ad ₄ ). Further, the contrast adjusting unit 16c extracts the second image (g ₂ (g ₂ ′ after processing the second image)) from the storage area 30b or 30d of the RAM 30, and the contrast of the second image is determined as the contrast. Change to the contrast indicated by the adjustment information (ad ₄ ) (that is, “change the contrast of the second image based on the adjustment information”). Then, the contrast adjusting unit 16c sends the second image (g ₂ ′) whose contrast has been changed to the RAM 30 and stores it in the storage area 30d. Then, the process proceeds to step S101.

[Step S100]
The process proceeds to this step when the automatic adjustment button 236 (FIG. 16) is clicked. In this step, the image adjustment unit 16 performs automatic adjustment of the second image, and the process proceeds to step S101. Details of this processing will be described later.

[Step S101]
In the image output means 13 (FIG. 3), the first image (g ₁ ′) and the second image (g ₂ ′) are extracted from the storage area 30 d of the RAM 30, and these are extracted to the display 70 through the bus 80. Output. Then, the display 70 displays the first image (g ₁ ′) and the second image (g ₂ ′) on the image display unit 210 (FIG. 16).

<Automatic adjustment of second image>
Next, details of the second image automatic adjustment process (FIG. 12: step S100) will be described.
FIG. 13 is a flowchart for explaining details of the automatic adjustment of the second image. Hereinafter, description will be given along this flowchart.

[Step S111]
In the histogram generation means 16a (FIG. 4) of the image adjustment means 16, the first image (g ₁ (g ₁ ′ after processing the first image)) and the second image (g ₂ (second image After processing, g ₂ ′)) is extracted from the storage area 30b or 30d of the RAM 30, and for the first image and the second image, a histogram of the luminance and the number of pixels having the luminance (count number) (H ₁ , H ₂ ).

The histograms (H ₁ , H ₂ ) generated by the histogram generation unit 16a are sent to the brightness adjustment unit 16b and the contrast adjustment unit 16c, and the process proceeds to step S112.

[Step S112]
In the contrast adjusting unit 16c, the difference between the width (a ₃ ) of the histogram H ₁ corresponding to the first image and the width (b ₃ ) of the histogram H ₂ corresponding to the second image is within an allowable range (p ₁ ≧ 0) is determined. That is,
| Width of H ₁ (a ₃ ) −Width of H ₂ (b ₃ ) | ≦ p ₁
It is determined whether or not.

Here, the contrast adjustment unit 16c, | _{H 1} having a width _(a 3) -H ₂ width _(b 3) | When it is determined that satisfy ≦ _{p 1,} the process proceeds to step S115. On the other hand, if this is not satisfied and if the width of H ₂ (b ₃ ) −the width of H ₁ (a ₃ )> p ₁ , the process proceeds to step S113 and the width of H ₁ (a ₃ ) −H _2. If the width (b ₃ )> p ₁ is satisfied, the process proceeds to step S114.

[Step S113]
In the contrast adjusting unit 16c, the second image (g ₂ (g ₂ ′ after processing the second image)) is extracted from the storage area 30b or 30d of the RAM 30, and the contrast is lowered (reduced) by a predetermined value. ). Then, the second image (g ₂ ′) is stored in the storage area 30d of the RAM 30 in the contrast adjusting unit 16c, and the process returns to step S111.

[Step S114]
In the contrast adjusting unit 16c, the second image (g ₂ (g ₂ ′ after processing the second image)) is extracted from the storage area 30b or 30d of the RAM 30, and the contrast is increased by a predetermined value (addition). To do). Then, the second image (g ₂ ′) is stored in the storage area 30d of the RAM 30 in the contrast adjusting unit 16c, and the process returns to step S111.

[Step S115]
In the brightness adjusting unit 16b, the difference between the position of the histogram of H ₂ histograms H ₁ determines whether it is within the allowable range (p ₂ ≧ 0). That is,
| H ₁ position (a ₁ ) −H ₂ position (b ₁ ) | ≦ p ₂
It is determined whether or not.

Here, the brightness adjusting unit 16b, | position of _{H 1 (a 1)} position of -H _{2 (b} 1) | When it is determined that satisfy ≦ _{p 2,} the automatic generation processing of the second image (Step S100) is terminated. On the other hand, if this is not satisfied and the position of H ₂ (b ₁ ) −the position of H ₁ (a ₁ )> p ₂ , the process proceeds to step S116 and the position of H ₁ (a ₁ ) −H _2. If the position (b ₁ )> p ₂ , the process proceeds to step S117.

[Step S116]
In the brightness adjustment means 16b, the second image (g ₂ ′) is extracted from the storage area 30d of the RAM 30, and the brightness is lowered (reduced) by a predetermined value. Then, the brightness adjusting unit 16b stores the second image (g ₂ ′) in the storage area 30d of the RAM 30, and the process returns to step S111.

[Step S117]
In the brightness adjustment unit 16b, the second image (g ₂ ′) is extracted from the storage area 30d of the RAM 30, and the brightness is increased (added) by a predetermined value. Then, the brightness adjusting unit 16b stores the second image (g ₂ ′) in the storage area 30d of the RAM 30, and the process returns to step S111.

<Image composition processing>
Next, details of the image composition processing (FIG. 7: step S34) will be described.
FIG. 14 is a flowchart for explaining the details of this image composition processing. Hereinafter, description will be made along this flowchart.

[Step S121]
In the image composition means 17 (FIG. 3), the first image (g ₁ (g ₁ ′ after processing the first image)) and the second image (g ₂ ( _first ) are stored from the storage area 30b or 30d of the RAM 30. After processing the second image, g ₂ ′)) and the variation (LC) are extracted, and the first image and the second image in a state where there is a gap between the first image and the second image. To generate a composite image A.

FIG. 19A is a diagram conceptually illustrating this process. As illustrated in this figure, in this step, the first image 311 and the second image 312 are arranged via the gap 313, thereby forming a composite image (A) 310. Note that the positional relationship between the first image 311 and the second image 312, the width of the gap 313, and the like are determined using a predetermined value set as a standard value and a variation (LC) extracted from the storage area 30 d of the RAM 30. Is set.
The generated composite image A is sent to the RAM 30, stored in the storage area 30e, and sent to the image duplicating means 18 (FIG. 3), and the process proceeds to the next step S122.

[Step S122]
In the image duplicating means 18, a duplicate composite image B (corresponding to “composite image”), which is duplicate data of the received composite image A, is generated.

FIG. 19B is a diagram conceptually illustrating this process. As illustrated in this figure, in this step, a duplicated composite image (B) 320 composed of a first image 321, a second image 322, and a gap 323, which is duplicated data of the composite image (A) 310, is generated. The
The generated duplicate composite image B is sent to the filter means 19 (FIG. 3) and proceeds to the next step S123.

[Step S123]
The filter means 19 generates a singularity-removed image B ′ (corresponding to “composite image”) from which the singularity (noise) of the received duplicate composite image B has been removed. Specifically, for example, a median filter (for example, “Takeshi Aoiin, Tomoharu Nagao,“ Image processing and recognition ”, Shosodo, first published on November 25, 1992), etc.) is applied to the duplicate composite image B. Then, the singularity removal image B ′ is generated.

  FIG. 19C conceptually illustrates this process. As illustrated in this figure, in this step, the singular point removed image (B ′) including the first image 331, the second image 332, and the gap 333, from which the singular point (noise) of the duplicate composite image B is removed. 330 is generated.

  The generated singularity-removed image B ′ is sent to the RAM 30 (FIG. 3) and stored in the storage area 30f.

[Step S124]
In the straight line setting means 20, first, the singular point removal image B ′ is extracted from the storage area 30f of the RAM 30, and the boundary information BL is extracted from the storage area 30a (when the boundary information BL is stored in the storage area 30a). And the straight line setting means 20 specifies each investigation point (gamma) ₁ , ..., (gamma) _n in a space | gap. Here, “investigation point” means each pixel in the air gap, and n indicates the number of pixels in the air gap.

FIG. 20 is a diagram conceptually illustrating the singularity removal image (B ′) 330.
As shown in this figure, the singular point removal image (B ′) 330 in this example is configured by 17 columns (X1 to X17) and 9 rows (Y1 to Y9) of pill cells 330a arranged in a matrix. The first image 331 is configured by the pixels 330a of (X1, Y1) to (X6, Y9), and the air gap 333 is configured by the pixels 330a of (X7, Y1) to (X11, Y9), and (X12, The second image 332 is constituted by the pixels 330a of Y9) to (X17, Y9). Here, the region of X6 rows (X6, Y1 to Y9) of the first image 331 is referred to as an edge portion (α) 331b (corresponding to “a gap side edge portion α of the first image”), and the second image An area of X12 rows (X12, Y1 to Y9) 332 is referred to as an edge part (β) 332b (corresponding to “a gap side edge part β of the second image”). In this step, each pixel 330a in the gap 333 ((X7, Y1) to (X11, Y9)) sandwiched between the edge portion (α) 331b and the edge portion (β) 332b is specified as an investigation point. In the example of FIG. 20, 5 × 9 = 45 survey points are specified, and each survey point is designated as γ ₁ to γ ₄₅ .
When the investigation points γ ₁ ,..., Γ _n are specified, the process proceeds to the next step S125.

[Step S125]
In the straight line setting means 20, 1 is substituted into the variable i, and the process proceeds to step S126. Note that the value of the variable i is stored in a cache memory (not shown) in the CPU 10, for example.

[Step S126]
The straight line setting means 20 sets a plurality of straight lines L passing through the investigation points γ _i in the gap 333 of the singular point removal image (B ′) 330.

  FIG. 21 is a conceptual diagram illustrating a plurality of straight lines (L) 401 to 405 set for one survey point 333a (X8, Y5).

In this example, to survey point _{(γ i) 333a (X8,} Y5), the survey point (gamma _i) 333a plurality of straight lines (L) 401 to 405 through the (X8, Y5) is set. Each straight line (L) is specified by the coordinates of the survey point (γ _i ) and the slope u of the straight line. Details of this processing will be described later.

The straight line L (for example, information on the coordinates of the survey point (γ _i ) and the slope u of the straight line) and the singular point removal image (B ′) 330 passing through the set survey point γ _i are the intersection calculation means 21 (FIG. 3). The process proceeds to the next step S127.

[Step S127]
In the intersection calculation means 21, the intersection P between the gap-side edge portion α of the first image (in the singular point removal image B ′) and the straight line L, and the gap side in the second image (in the singular point removal image B ′). An intersection point Q between the edge portion β and the straight line L is calculated.

  Further, the intersection calculation means 21 specifies the color information of the obtained intersections P and Q. Here, “color information of intersections P and Q” means, for example, color information of pixels in integer coordinates obtained by rounding down the decimal points of the coordinates of intersections P and Q. Note that the pixels at the intersections P and Q may be specified by rounding off or rounding up instead of rounding off the decimal part.

  In the case of the example of FIG. 21, the intersections (P) 401a to 405a between the straight lines (L) 401 to 405 and the edge portion 331b, and the intersections (Q) 401b to 405b between the straight lines (L) 401 to 405 and the edge portion 332b. calculate. And the color information of each intersection P and Q is specified as follows.

Intersection (P) 401a: Color information of pixel at (X6, Y7) Intersection (P) 402a: Color information of pixel at (X6, Y6) Intersection (P) 403a: Color information of pixel at (X6, Y5) Intersection ( P) 404a: Color information of pixel of (X6, Y4) Intersection (P) 405a: Color information of pixel of (X6, Y3) Intersection (Q) 401b: Color information of pixel of (X12, Y1) Intersection (Q) 402b: Color information of pixel (X12, Y3) Intersection (Q) 403b: Color information of pixel of (X12, Y5) Intersection (Q) 404b: Color information of pixel of (X12, Y7) Intersection (Q) 405b: Color information of the pixel of (X12, Y9) Each straight line L, the calculated intersection points P and Q, and the respective color information are sent to the straight line selection means 22 (FIG. 3), and the process proceeds to the next step S128.

[Step S128]
The straight line selection unit 22 selects a straight line L ′ that minimizes the difference in color information between the intersections P and Q from the sent straight line L.
This is because the slope u of the straight line L passing through the investigation point (γ _i ) is moved in a predetermined step, and each component (red, green, blue) of the color information (pixelP) at the intersection P and the color information (pixelQ) at the intersection Q ) Is equivalent to obtaining the slope u when the sum of the differences (nHensa) is minimized. NHensa is expressed as follows.
nHensa = abs (pixelP [R] -pixelQ [R]) + abs (pixelP [G] -pixelQ [G]) + abs (pixelP [B] -pixelQ [B])
Where abs is an absolute value, pixelP [R] is the red component at the intersection P, pixelP [G] is the green component at the intersection P, pixelP [B] is the blue component at the intersection P, and pixelQ [R] is the red component at the intersection Q , PixelQ [G] indicates the green component at the intersection Q, and pixelQ [B] indicates the blue component at the intersection Q.

  In the case of the example in FIG. 21, the difference in color information between the intersection (P) 401a and the intersection (Q) 401b (corresponding to the straight line (L) 401), and the difference in color information between the intersection (P) 402a and the intersection (Q) 402b ( The color information of the intersection (P) 403a and the intersection (Q) 403b (corresponding to the straight line (L) 403), the color information of the intersection (P) 404a and the intersection (Q) 404b. The difference (corresponding to the straight line (L) 404), the color information difference between the intersection (P) 405a and the intersection (Q) 405b (corresponding to the straight line (L) 405) is calculated, and the difference between the calculated color information is the smallest. Straight lines (L) 401 to 405 (straight line L ′) are calculated by a known rearrangement algorithm or the like. In this example, it is assumed that a straight line (L) 404 is calculated as a straight line L ′ as shown in FIG.

  When the straight line L ′ is selected, the intersections P ′ and Q ′ of the straight line L ′ and the color information thereof are sent to the color information determining means 23 (FIG. 3). In the case of the example in FIG. 22, the intersection (P) 404a, the intersection (Q) 404b, and the color information of the pixel 331ba at (X6, Y4) corresponding to the intersection (P) 404a, corresponding to the intersection (Q) 404b (X12). , Y7), the color information of the pixel 332ba is sent to the color information determination means 23. Then, the process proceeds to next Step S129.

[Step S129]
In the color information determination unit 23, 'the intersection P' of the straight line L which is selected in the linear selecting means 22, using the color information of the Q ', determines the color information C _i survey points gamma _i. At this time, the color information determination unit 23 weights the color information of the intersections P and Q according to the distance between the survey point γ _i and the intersections P and Q, and determines the color information of the survey point γ _i . The weight assigned to the color information of the intersection points P and Q is larger as the intersection points P and Q are closer to the survey point γ _i . Specifically, for example, performs weighting such as: study point gamma _i of color information C _{i =} (red component pixelγ _{i [R],} green component pixelγ _{i [G],} and blue components pixelγ _{i [B])} To decide.
Red component (pixel γ [R]) of survey point γ _i :
pixelγ _i [R] = {pixelP [R] · (w- (x-α _x )) / w} + {pixelQ [R] · (w- (β _x -x)) / w}
Green component (pixel γ [G]) of survey point γ _i :
pixelγ _i [G] = {pixelP [G] · (w- (x-α _x )) / w} + {pixelQ [G] · (w- (β _x -x)) / w}
Blue component (pixel γ [B]) of survey point γ _i :
pixelγ _i [B] = {pixelP [B] · (w- (x-α _x )) / w} + {pixelQ [B] · (w- (β _x -x)) / w}
Where x represents the x coordinate of the survey point γ _i , α _x represents the x coordinate of the air gap side edge portion α of the first image, and β _x represents the x coordinate of the air gap side edge portion β of the second image. W represents the width of the air gap (w = β _x -α _x ).

Incidentally, the above processing, by using the color information of the singular point (noise) components are removed singular point removal image B ', so that the color information C _i survey points gamma _i is determined. Therefore, without the color information C _i survey points gamma _i based on singularity component is determined, as the color information C _i survey points gamma _i, nor that unnatural color is selected (the As a result, the line does not run due to noise in the complement part).
The color information C _i of the survey point γ _i set in this way is sent to the RAM 30 and stored in the storage area 30g. Then, the process proceeds to next Step S130.

[Step S130]
In the straight line setting means 20, it is determined whether or not the value of the variable i stored in the cache memory (not shown) described above (step S125) is n. If i = n, the process proceeds to step S132; otherwise, the process proceeds to step S131.

[Step S131]
In the straight line setting means 20, i + 1 is substituted into the variable i, and the substituted value i is stored in, for example, a cache memory (not shown). Then, the process returns to step S126.

[Step S132]
In complementing means 24 (FIG. 3), each survey point gamma ₁ from the storage area 30g of the RAM 30, ..., gamma color information C ₁ of _{n, ...,} the color information of _{C n} ( "determined investigated point gamma And a composite image A is extracted from the storage area 30e. Then, the complementary means 24, the respective survey point gamma _1, ..., the color information C ₁ of gamma _{n, ...,} by C _n, to generate a complementary image A 'which complements the voids of the composite image A.

FIG. 25A shows an example of the complementary image (A ′) 340 generated in this way.
As illustrated in this figure, the complementary image (A ′) 340 includes a first image 311 and a second image 312 before singular point removal, and complementary information 343 (each investigation point γ ₁₎ arranged in the gap. , ..., γ _n color information C _{1, ...,} C _n ). As described above, the complementary information 343 is determined using the color information of the singular point removed image B ′ from which the singular point component has been removed by the filter unit 19. Therefore, the complementary information 343 does not have a singular point component that the first image 311 and the second image 312 normally have.
The generated complementary image A ′ is sent to the RAM 30 and stored in the storage area 30h. Then, the process proceeds to next Step S133.

[Step S133]
The singular point image generation means 25 generates a singular point image D composed of the singular point components of the first image or the second image.
Specifically, for example, in the singularity image generation means 25, the first image g ₁ ′ (image before singularity removal) is extracted from the storage area 30d of the RAM 30, and the singularity (noise) component is extracted by a median filter or the like. A filtered image g ₁ ″ from which is removed is generated. The generated filter image g ₁ ″ is stored, for example, in a cache memory (not shown) in the CPU 10, and the singular point image generation means 25 again returns the first image g ₁ ′ (from the storage area 30 d of the RAM 30. Image before singular point removal) is extracted. Then, the singular point image generation means 25, for example, from the first image g ₁ ′ (image before singular point removal) extracted from the storage area 30d, the filter image g ₁ ″ stored in a cache memory (not shown). To generate a singularity image D consisting only of singularity components.
The generated singular point image (D) is sent to the image cutout means 26 (FIG. 3), and proceeds to the next step S134.

[Step S134]
The image cutout means 26 cuts out an image (hereinafter referred to as “additional image E”) having the same shape as a gap (for example, a gap in the composite image A) from the singular point image D.

FIG. 25B is a conceptual diagram showing this state.
As illustrated in this figure, the image cutout means 26 preferably cuts out the gap side edge portion 351 of the singular point image (D) 350 as the additional image (E) 352. As a result, an additional image (E) 352 that is close to the distribution of singular points that the original image (the image to be restored) will have in the void portion is obtained. FIG. 25B shows an example in which the singular point image (D) is generated based on the first image (image arranged on the left side of the second image). In this case, the position of the gap existing between the first image and the second image corresponds to the position on the right side of the singular point image (D). Therefore, in the case of this example, the “air gap side edge portion” means a region of the right edge portion toward (b) in FIG.
The additional image E generated as described above is sent to the singular point adding means 27 (FIG. 3) and proceeds to the next step S135.

[Step S135]
In the singularity adding means 27, the complementary image A ′ is extracted from the storage area 30h of the RAM 30, and the additional image E sent from the image cutting means 26 is combined with the complementary portion of the complementary image A ′. Generate '. Note that "complementary part", the complementary means 24, each survey point gamma _1, ..., the color information C ₁ of gamma _{n, ...,} there in complemented by _{C n} (step S132) based on the air gap Means the part.

FIG. 25C is a conceptual diagram illustrating the generated complementary composite image (A ″) 360.
As shown in this figure, an additional image E is added to a complementary portion between the first image 311 and the second image 312 (a singularity added image 363 is formed), and a complementary composite image (A ″) 360 is obtained. Complete.
More preferably, the singularity adding unit 27 reduces the luminance value of the additional image E, and then synthesizes the additional image E with the complementary portion of the complementary image A ′. Specifically, for example, the singular point adding means 27 obtains the maximum value of the luminance of each pixel of the additional image E for each row (same y coordinate), and (the luminance of each pixel of the additional image E) − (each row The additional image of the maximum value) / 2 is synthesized with the complementary portion of the complementary image A ′.

That is, for example, the luminance data of the additional image E is
X7 X8 X9 X10 X11
Y1 2 5 3 6 1
In this case, the maximum value of the luminance of this row is 6, and half of that is 3. Therefore, the luminance data of the additional image E added to the Y1 row is
X7 X8 X9 X10 X11
Y1 -1 2 0 3 -2
It becomes. As a result, not only positive but also negative singularities (noise) can be added, and more natural singularities can be added.

<Details of the straight line L setting process on the survey point _{X i>}
Details of the straight line L setting process relating to the survey point X _i (step S126) will be described.

Figure 15 is a flowchart for illustrating details line L setting process Details regarding this study point X _i. Hereinafter, description will be given along this flowchart.

[Step S141]
In the straight line setting means 20 (FIG. 3), it is determined whether or not boundary information is set. Specifically, for example, it is determined whether the boundary information BL is stored in the storage area 30 a of the RAM 30. If it is determined that the boundary information is set, the process proceeds to step S148. If not, the process proceeds to step S142.

[Step S142]
In the straight line setting means 20, the minimum inclination value u _min is substituted into the inclination variable u _j and the value is stored in a cache memory (not shown), for example. Here, as the minimum inclination value u _min , for example, −3 can be exemplified. Then, the process proceeds to step S143.

[Step S143]
In the straight line setting means 20, for example, a slope u _j is extracted from a cache memory (not shown), and a straight line L (y = u _j · x + v (x, y are variables, v is a variable) of the slope u _j passing through the investigation point X _i. , A constant determined by the slope variable u _j and the survey point X _i )) and set it in a cache memory (not shown), for example. Then, the process proceeds to step S144.

[Step S144]
In the straight line setting means 20, for example, it is determined whether or not an inclination variable u _j stored in a cache memory (not shown) exceeds an inclination maximum value u _max (u _j > u _min ). The maximum value u _max can be exemplified by 3, for example.
If it is determined that u _j > u _min , the straight line L setting process for the survey point X _i is terminated. If it is determined that u _j > u _min , the process proceeds to step S145.

[Step S145]
In the straight line setting means 20, for example, a value obtained by adding us (us is a constant, for example, 0.1 can be exemplified) to an inclination variable u _j stored in a cache memory (not shown) is assigned to the inclination variable u _j . This is stored in a cache memory (not shown), for example. Then, the process returns to step S143.

[Step S148]
In the straight line setting means 20, it is determined whether or not the investigation point γ _i is on the boundary information BL that is a straight line. If it is determined that the survey point γ _i is on the boundary information, the process proceeds to step S149, and if not, the process proceeds to step S150.

[Step S149]
In the straight line setting means 20, the boundary information BL which is the boundary information is set as a straight line L corresponding to the investigation point γ _i .

FIG. 23 is a conceptual diagram illustrating this situation.
In the example of FIG. 23, the investigation point (γ _i ) 333a of the coordinates (X8, Y5) exists on the boundary information (BL) 500 that is a straight line. In this case, the boundary information (BL) 500 is a straight line L corresponding to the investigation point (γ _i ) 333a.
As a result, in the process of step S129 described above, a color suitable for the boundary of the object is selected as the color information C _i of the survey point γ _i .
The set straight line L is sent to the intersection calculation means 21 and the straight line L setting process for the survey point X _i is terminated.

[Step S150]
In the straight line setting means 20, the minimum inclination value u _min is substituted into the inclination variable u _j and the value is stored in a cache memory (not shown), for example. Then, the process proceeds to step S151.

[Step S151]
In the straight line setting means 20, for example, a slope u _j is extracted from a cache memory (not shown), and a straight line L (y = u _j · x + v (x, y are variables, v is a variable) of the slope u _j passing through the investigation point X _i. , A constant determined by the slope variable u _j and the survey point X _i )). Then, the process proceeds to step S152.

[Step S152]
In the straight line setting means 20, it is determined whether or not the straight line L set in step S151 and the boundary information BL that is a straight line intersect each other in the gap. Here, if it is determined that the straight line L and the boundary information BL do not intersect within the gap, the process proceeds to step S153. On the other hand, if it is determined that the straight line L and the boundary information BL intersect within the gap, the process proceeds to step S154.

FIG. 24 is a conceptual diagram for explaining this situation.
In the example of FIG. 24, the coordinate (X8, Y3) survey point (γ _i ) 333 b is not located on the boundary information (BL) 500. Here, it is assumed that a straight line (L) 406 is generated in step S152. In this case, the straight line (L) 406 does not intersect the boundary information (BL) 500 within the gap 333. Therefore, the straight line setting unit 20 determines to proceed to the process of step S153. On the other hand, it is assumed that a straight line (L) 407 is generated in step S152. In this case, the straight line (L) 407 intersects the boundary information (BL) 500 within the gap 333. Therefore, the straight line setting unit 20 determines to proceed to the process of step S154.
[Step S153]
The straight line L set in step S151 is stored in a cache memory (not shown), for example, and the process proceeds to step S155.

[Step S154]
The straight line L set in step S151 is discarded, and the process proceeds to step S155.

Through the processes in steps S152 to S154 described above, the straight line setting unit 20 sets the straight line L passing through the specific investigation point γ _i within the limit range specified by the boundary information BL. Thereby, in the process of step S129 described above, the color information C _i of the survey point γ _i that makes the boundary of the object clear is selected.

[Step S155]
In the straight line setting means 20, for example, it is determined whether or not an inclination variable u _j stored in a cache memory (not shown) exceeds an inclination maximum value u _max (u _j > u _min ). If it is determined that u _j > u _min , the straight line L setting process for the survey point X _i is terminated. If it is determined that u _j > u _min , the process proceeds to step S156.

[Step S156]
In the straight line setting means 20, for example, a value obtained by adding us (us is a constant, for example, 0.1 can be exemplified) to an inclination variable u _j stored in a cache memory (not shown) is assigned to the inclination variable u _j . This is stored in a cache memory (not shown), for example. Then, the process returns to step S151.

<Features of this embodiment>
As described above, in the present embodiment, the image input unit 12 receives the input of the first image and the second image that do not include the discontinuous portion of the image (for example, the binding portion of the spread page), and the image composition unit 17. , A composite image in which a gap exists between the first image and the second image is generated. Therefore, a composite image can be generated using image information that excludes discontinuous portions of the image.

Further, the straight line selection means 20 selects a straight line L ′ that minimizes the difference in color information between the intersection points P and Q from the straight line L, and the color information determination means 23 selects the intersection points P ′ and Q ′ of the straight line L ′. The color information is used to determine the color information of the investigation point γ in the gap. Therefore, a space | gap can be complemented more appropriately.
As described above, it is possible to combine the divided images with a good appearance.

[Second Embodiment]
Next, a second embodiment of the present invention will be described.

  This embodiment is a modification of the first embodiment, and is an example in which the present invention is applied to an image copying apparatus for copying an image. Below, it demonstrates centering on difference with 1st Embodiment, and abbreviate | omits description about the matter which is common in 1st Embodiment.

<Hardware configuration>
FIG. 26 is a block diagram illustrating a hardware configuration of the image copying apparatus 600 according to this embodiment.
As illustrated in FIG. 26, the image copying apparatus 600 of this example includes a CPU 610, a RAM 630, a ROM 640, a scanner 650, an input key 660, and a printer 670, which are connected so as to communicate with each other via a bus 680. ing. The CPU 610 reads the program stored in the ROM 640 and executes processing according to the program, thereby realizing each processing function shown below.

<Functional configuration>
FIG. 27 is a block diagram illustrating a processing function constructed by causing the CPU 610 to execute the above-described program and a data configuration in the RAM 630. In FIG. 27, the same reference numerals as those in FIG.

  As illustrated in FIG. 27, by executing the above-described program, the CPU 610 causes the image input unit 612, the image output unit 613, the gap generation unit 617, the image duplication unit 18, the filter unit 19, the straight line setting unit 20, and the intersection calculation unit. 21, a straight line selection unit 22, a color information determination unit 23, a complementing unit 24, a singular point image generation unit 25, an image cutout unit 26, a singular point addition unit 27, and a control unit 28 are constructed. Each of these means performs each calculation process in cooperation with the control of the control means 28. Further, the arrows in FIG. 27 indicate the flow of information, but the flow of control information from the control means 28 is omitted.

<Processing>
FIG. 28A is a flowchart for explaining processing of the image copying apparatus 600. Hereinafter, the processing of the image copying apparatus 600 will be described with reference to these drawings.

[Step S161]
The image is read by the scanner 650 (FIG. 26). The image _{A 0} read sent to CPU 610 via the bus 680, the image input unit 612 of CPU 610 (FIG. 27) receives an input of the image _{A 0.} Then, the image input unit 612 stores the image _{A 0} in the storage area 630a of the RAM 630, and proceeds to the next step S162.

[Step S162]
In the void generation unit 617 extracts the image _{A 0} from the storage area 630a of the RAM 630, through the center portion of the image _{A 0,} and generates a rectangular gap across the image _{A 0,} the image _{A 0} first image _{g 1} between the split second in the image _{g 2.} In addition, an image including the first image g ₁ , the second image g _2, and the gap is referred to as a composite image A.
FIG. 28B is a conceptual diagram for explaining the processing of this step.

As illustrated in this figure, the gap generation means 617 generates a rectangular gap 720 that passes through the center portion 730 of the image (A ₀ ) 700 (for example, the binding portion of the spread page) and crosses the image A _0. To do. The gap A 720 divides the image A ₀ into a first image (g ₁ ) 711 and a second image (g ₂ ) 712, and the first image (g ₁ ) 711 and the second image (g ₂ ) A composite image (A) 710 composed of 712 and a gap 720 is generated.

The generated composite image A is sent to the image duplicating unit 18 in addition to being stored in the storage area 30e of the RAM 630. The first image g ₁ and the second image g ₂ are also stored in the storage area 30 b of the RAM 630. Then, the process proceeds to next Step S163.

[Step S163]
Image duplicating means 18, filter means 19, straight line setting means 20, intersection calculating means 21, straight line selecting means 22, color information determining means 23, complementing means 24, singular point image generating means 25, image cutting means 26 and singular point adding means in 27, by the same process as step S122~S135 of FIG. 14, performs image combining processing to complement a gap (although, in the process of step S133, the point of using the first image _{g 1} stored in the storage area 30b Is different.)

  The complementary composite image A ″ thus generated is stored in the storage area 30i of the RAM 630, and the process proceeds to the next step S164.

[Step S164]
The image output unit 613 extracts the complementary composite image A ″ from the storage area 30 i of the RAM 630 and sends it to the printer 670 through the bus 680. The printer 670 prints this complementary composite image A ″ on paper and outputs it.

<Features of this embodiment>
As described above, in the present embodiment, the image input unit 612 receives an input of an image read by the scanner 650, and the gap generation unit 617 passes through the central portion of the input image and crosses the image. It was decided to generate a void. Thereby, a discontinuous portion (for example, a binding portion of a spread page) that crosses the center portion of the image read by the scanner 650 can be eliminated.

Further, the straight line selection means 20 selects a straight line L ′ that minimizes the color information difference between the intersection points P and Q from the straight line L, and the color information determination means selects the color of the intersection points P ′ and Q ′ of the straight line L ′. The information is used to determine the color information of the survey point γ in the gap. Thereby, the space | gap produced | generated in the space | gap production | generation means 617 can be complemented more appropriately.
As described above, it is possible to eliminate a discontinuous portion such as a binding portion from a read image and generate a good-looking copy image.

  Note that the present invention is not limited to the above-described embodiments, and it is needless to say that modifications can be made as appropriate without departing from the spirit of the present invention. For example, the various processes described above are not only executed in time series according to the description, but may also be executed in parallel or individually as required by the processing capability of the apparatus that executes the processes.

  Further, when the above-described configuration is realized by a computer, processing contents of functions that each device should have are described by a program. The processing functions are realized on the computer by executing the program on the computer.

  The program describing the processing contents can be recorded on a computer-readable recording medium. The computer-readable recording medium may be any medium such as a magnetic recording device, an optical disk, a magneto-optical recording medium, or a semiconductor memory. Specifically, for example, the magnetic recording device may be a hard disk device or a flexible Discs, magnetic tapes, etc. as optical disks, DVD (Digital Versatile Disc), DVD-RAM (Random Access Memory), CD-ROM (Compact Disc Read Only Memory), CD-R (Recordable) / RW (ReWritable), etc. As the magneto-optical recording medium, MO (Magneto-Optical disc) or the like can be used, and as the semiconductor memory, EEP-ROM (Electronically Erasable and Programmable-Read Only Memory) or the like can be used.

  The program is distributed by selling, transferring, or lending a portable recording medium such as a DVD or CD-ROM in which the program is recorded. Furthermore, the program may be distributed by storing the program in a storage device of the server computer and transferring the program from the server computer to another computer via a network.

  A computer that executes such a program first stores, for example, a program recorded on a portable recording medium or a program transferred from a server computer in its storage device. When executing the process, the computer reads the program stored in its own recording medium and executes the process according to the read program. As another execution form of the program, the computer may directly read the program from the portable recording medium and execute processing according to the program, and the program is transferred from the server computer to the computer. Each time, the processing according to the received program may be executed sequentially. Also, the program is not transferred from the server computer to the computer, and the above-described processing is executed by a so-called ASP (Application Service Provider) type service that realizes the processing function only by the execution instruction and result acquisition. It may be Note that the program in this embodiment includes information that is used for processing by an electronic computer and that conforms to the program (data that is not a direct command to the computer but has a property that defines the processing of the computer).

  In this embodiment, the present apparatus is configured by executing a predetermined program on a computer. However, at least a part of these processing contents may be realized by hardware.

  Examples of the industrial application field of the present invention include software for synthesizing spread pages such as magazines described above and aerial photographs, and a color digital copier that automatically repairs a binding portion of a color spread page. In addition, the image composition device of the present invention and a terminal device such as a personal computer are connected via the Internet or the like, and an image sent from the terminal device is composed by the image composition device of the present invention and returned to the terminal device. Service forms are also conceivable.

The figure for demonstrating the outline | summary of the image synthesizing | combining apparatus in 1st Embodiment. 1 is a block diagram illustrating a hardware configuration of an image composition device according to a first embodiment. The block diagram which illustrated the processing function constructed | assembled by making CPU execute a program in 1st Embodiment, and the data structure in RAM. The block diagram which illustrated the detailed functional composition of the image adjustment means in a 1st embodiment. 3 is a flowchart for explaining overall processing of the image composition device according to the first embodiment. 3 is a flowchart for explaining overall processing of the image composition device according to the first embodiment. 3 is a flowchart for explaining overall processing of the image composition device according to the first embodiment. 6 is a flowchart for explaining details of contrast / brightness adjustment processing of a first image. 6 is a flowchart for explaining details of contrast / brightness adjustment processing of a first image. The flowchart for demonstrating the detail of the automatic adjustment of a 1st image. 12 is a flowchart for explaining details of contrast / brightness adjustment processing of a second image. 12 is a flowchart for explaining details of contrast / brightness adjustment processing of a second image. 12 is a flowchart for explaining details of automatic adjustment of a second image. The flowchart for demonstrating the detail of an image composition process. Flowchart for explaining details regarding investigation points X _i straight line L of the set processing details. The figure which illustrated the composition of the main screen displayed on a display in a 1st embodiment. The figure which showed boundary information (BL) visually. An example of a histogram H ₁ corresponding to the _first image and a histogram H ₂ corresponding to the second image. The figure which illustrated image composition processing notionally. The figure which illustrated the singular point removal image (B ') notionally. The conceptual diagram which illustrated the some straight line (L) set about one investigation point. The conceptual diagram which illustrated the selected straight line L '. The conceptual diagram for demonstrating the process of step S149. The conceptual diagram for demonstrating the process of step S152. The figure which illustrated image composition processing notionally. FIG. 6 is a block diagram illustrating a hardware configuration of an image copying apparatus according to a second embodiment. FIG. 6 is a block diagram illustrating a processing function constructed by causing a CPU to execute a predetermined program and a data configuration in a RAM according to the second embodiment. FIG. 6A is a flowchart for explaining processing of the image copying apparatus according to the second embodiment. (B) is a conceptual diagram for demonstrating the process of step S162.

Explanation of symbols

1,100 image synthesizing apparatus 600 image copying apparatus

Claims (12)

An image composition device for compositing a plurality of images,
Image input means for receiving input of the first image and the second image;
Image synthesizing means for generating a synthesized image obtained by synthesizing the first image and the second image in a state where a gap exists between the first image and the second image;
Straight line setting means for setting a plurality of straight lines L passing through the investigation point γ in the gap;
An intersection calculation means for calculating an intersection P between the gap-side edge portion α of the first image and the straight line L and an intersection point Q of the gap-side edge portion β of the second image and the straight line L;
Straight line selection means for selecting, from the straight line L, a straight line L ′ that minimizes the difference in color information between the intersection points P and Q;
Color information determination means for determining color information of the survey point γ using color information of intersections P ′ and Q ′ of the straight line L ′ selected by the straight line selection means;
An image synthesizing apparatus comprising: The image composition apparatus according to claim 1,
The color information determining means is
A means for weighting the color information of the intersection points P and Q according to the distance between the investigation point γ and the intersection points P and Q, and determining the color information of the investigation point γ,
The weight given to the color information of the intersections P and Q is
The intersections P and Q are larger as they are closer to the survey point γ.
An image composition device characterized by the above. The image composition apparatus according to claim 1,
Image output means for outputting the first image and the second image;
Adjustment information input means for receiving input of adjustment information for changing the contrast or brightness of the image;
Image adjusting means for changing at least one of contrast and brightness of at least one of the first image and the second image based on the adjustment information;
Further comprising
The image composition means
Means for generating the composite image using the first image or the second image in which at least one of contrast and brightness is changed in the image adjusting means;
An image composition device characterized by the above. The image composition apparatus according to claim 1,
Histogram generation means for generating a histogram of the luminance and the number of pixels having the luminance (count number) for the first image and the second image;
The first image to the histogram H ₁ corresponding width (the maximum value of the luminance has become the count number is equal to or greater than the threshold, minus the minimum value of the luminance which the count is greater than or equal to the threshold value) If, until the width of the histogram H ₂ corresponding to the second image, the difference is made within an allowable range, a contrast adjusting means for changing at least one of contrast of the first image and the second image ,
Position of the histogram H ₁ and (minimum value or maximum value of the luminance that is the above-mentioned counted number threshold or more), until the difference, and the position of the histogram H ₂ is within the allowable range, the first image Brightness adjusting means for changing the brightness of at least one of the second image, and
In addition,
The image composition means
In the contrast adjustment unit and the brightness adjustment unit, the first image or the second image in which at least one of contrast and brightness is changed is used to generate the composite image.
An image composition device characterized by the above. The image composition apparatus according to claim 1,
Boundary information input means for receiving input of boundary information that limits the inclination range of the straight line L passing through the specific survey point γ,
The straight line setting means includes:
A means for setting a straight line L passing through the specific investigation point γ within the limit range specified by the boundary information.
An image composition device characterized by the above. An image composition device for compositing a plurality of images,
Image input means for receiving input of the first image and the second image;
Image synthesizing means for generating a synthesized image A obtained by synthesizing the first image and the second image in a state where a gap exists between the first image and the second image;
Image duplicating means for creating a duplicate composite image B which is duplicate data of the composite image A;
Filter means for generating a singularity-removed image B ′ from which the singularity of the duplicate composite image B has been removed;
Straight line setting means for setting a plurality of straight lines L passing through the investigation points γ in the gap of the singular point removal image B ′;
The intersection P between the air gap side edge portion α of the first image (in the singular point removal image B ′) and the straight line L, and the air gap side edge of the second image (in the singular point removal image B ′). Intersection calculating means for calculating an intersection Q between the part β and the straight line L;
Straight line selection means for selecting, from the straight line L, a straight line L ′ that minimizes the difference in color information between the intersection points P and Q;
Color information determination means for determining color information of the survey point γ using color information of intersections P ′ and Q ′ of the straight line L ′ selected by the straight line selection means;
Complementing means for generating a complementary image A ′ that complements the gap of the composite image A by the set of color information of the determined survey point γ,
An image synthesizing apparatus comprising: The image composition apparatus according to claim 6,
Singularity image generation means for generating a singularity image D comprising the singularity component of the first image or the second image;
Image cutting means for cutting an image having the same shape as the void (hereinafter referred to as “additional image E”) from the singular point image D;
Singularity adding means for synthesizing the additional image E with a complementary portion of the complementary image A ′;
An image synthesizing apparatus further comprising: The image composition device according to claim 7,
The additional image E is
The gap side edge portion of the singular point image D,
An image composition device characterized by the above. The image composition device according to claim 7,
The singularity adding means is
Means for reducing the luminance value of the additional image E and then combining the additional image E with a complementary portion of the complementary image A ′;
An image composition device characterized by the above. An image copying apparatus for copying an image,
Image input means for receiving image input;
A void generating means for generating a rectangular void passing through the central portion of the image and crossing the image, and dividing the image into a first image and a second image;
Straight line setting means for setting a plurality of straight lines L passing through the investigation point γ in the gap;
An intersection calculation means for calculating an intersection P between the gap-side edge portion α of the first image and the straight line L and an intersection point Q of the gap-side edge portion β of the second image and the straight line L;
Straight line selection means for selecting, from the straight line L, a straight line L ′ that minimizes the difference in color information between the intersection points P and Q;
Color information determination means for determining color information of the survey point γ using color information of intersections P ′ and Q ′ of the straight line L ′ selected by the straight line selection means;
An image copying apparatus comprising: A program for causing a computer to function as the image composition device according to claim 1. A program for causing a computer to function as the image copying apparatus according to claim 10.

Images