JP4301526B1 - Image generating apparatus, image generating method, and program - Google Patents

Abstract

An image generating apparatus capable of generating an image corresponding to one paper constituting a book bound by a bag is provided.
A first page image, which is an image of one page, and a second page image, which is an image of the other page, are formed by folding one sheet of paper in a book that is bound in a bag. The stored image storage unit 13, the position determination unit 14 that determines the position at which the side of the first page image that is folded in two and the side of the second page image that is folded in half are located, and the position determination unit 14 Is connected to the side of the first page image that is folded in two and the side of the second page image that is folded into two, so that the image corresponds to one piece of paper that has been bound. An image generation unit 15 that generates a single image and an image output unit 16 that outputs a single image generated by the image generation unit 15 are provided.
[Selection] Figure 1

Description

  The present invention relates to an image generation apparatus that generates an image related to a book that has been bound by a bag.

  Conventionally, bag binding has been used as a simple bookbinding method. For example, there are old documents, official documents, old land ledgers, and the like bound by bag binding. In addition, the book bound in the bag was copied by a copy machine or the like.

A method of easily obtaining an accurate transfer drawing using a digital camera when performing such copying is also known (see, for example, Patent Document 1).
Japanese Patent No. 3981644

  However, even if a book bound in a bag is copied, an image corresponding to one paper constituting the book bound in a bag cannot be obtained. That is because one sheet of a book bound in a book is folded in half, and the two pages included in the one sheet are front and back, so both pages cannot be copied together. It is.

  For example, if the spread of a book bound in a bag is copied as it is, the image of one page included in the first paper in the book bound in a bag is included in a second paper different from the first paper. It was only possible to copy an image on one page. In addition, even if you copy the spread of a book that has been bound in a bag, there will be a certain amount of curvature in the page of the spread book, and you will be able to obtain exactly the same image as each page of a book that has been bound in a bag. There wasn't.

  The present invention has been made to solve such problems, and one object of the present invention is to generate an image that can generate an image corresponding to a piece of paper constituting a bound book. It is to provide a device or the like. Another object of the present invention is to provide an image generation apparatus that can generate an appropriate image corresponding to one paper even from a curved book page.

  In order to achieve at least one of the above objects, an image generation apparatus according to the present invention is a first page image that is an image of one page, which is formed by folding a sheet of paper in a book that has been bound into a bag. A second page image that is an image of the other page, a side of the first page image that is folded in two, and a side of the second page image that is folded in half A position determining unit that determines a position to connect the image, and a position that is determined by the position determining unit to connect the second folded side of the first page image and the second folded side of the second page image. An image generation unit that generates a single image that is an image corresponding to the one paper that has been bound by a bag, and an image output unit that outputs the single image generated by the image generation unit. It is.

  With such a configuration, it is possible to generate a single image corresponding to one paper constituting a book bound by a booklet. As a result, by using the generated single image, for example, research on the book can be performed, or a complete reproduction of the book can be created.

  In the image generation apparatus according to the present invention, the image generation unit may include a side of the first page image that is folded in half and a side of the second page image that is folded in half of the one-image. The single image may be generated so as to be a center line.

  With such a configuration, by appropriately printing the single image, the original folded line is matched with the folded line when the printed paper is folded in half. Can be. As a result, by using the paper, it becomes possible to easily create a duplicate of the book bound and bound.

Further, in the image generating apparatus according to the present invention, there is a figure that spans both pages on the folded line of the one paper, and the position determination unit is configured to display the figure included in the first page image. The position may be determined so that the portion and the portion of the graphic included in the second page image are connected.
With such a configuration, it is considered that a more precise position can be determined.

  In the image generation apparatus according to the present invention, the position determination unit may include a pixel row on a side of the first page image that is folded in two and a pixel row on the side of the second page image that is folded in half. A positional relationship changing unit that changes a positional relationship in the side direction, a similarity information calculating unit that calculates similarity information that is information relating to the similarity between both pixel columns whose positional relationship has been changed by the positional relationship changing unit, and the similarity Positional relationship specifying means for specifying the positional relationship between the two pixel columns having the highest similarity according to the information, and the positional relationship between the two pixel columns specified by the positional relationship specifying means is the second positional relationship of the first page image. A positional relationship may be established in which the side of the folded side and the side of the folded second side of the second page image are connected.

  With such a configuration, it is assumed that when a certain figure is divided into two pages on a folded line, the pixel columns on the folded side of both pages will be substantially the same. It will be possible to appropriately determine the position where the two pages are connected.

In the image generating apparatus according to the present invention, the position determining unit may connect the end point of the second folded side of the first page image to the end point of the second folded side of the second page image. Alternatively, the position may be determined.
With such a configuration, even when there is no figure that spans both pages, it is possible to determine the position at which the two pages are connected using the end points of the side that is folded in half.

In the image generation apparatus according to the present invention, the first captured image that is an image captured by arranging a reference point on the page corresponding to the first page image, and the page corresponding to the second page image. An image receiving unit that receives a second captured image that is an image captured by arranging a reference point, and a shooting direction of the first captured image and the second captured image received by the image receiving unit using the reference point An image correcting unit that generates the first page image and the second page image and stores the first page image and the second page image in the image storage unit.
With such a configuration, a page image can be obtained by correcting a photographed image photographed by a digital camera or the like. In particular, when a book that is to be photographed is bound and bound, the book cannot be disassembled, for example, Japanese-bound bookbinding (yarn-bound bookbinding). However, an appropriate page image can be obtained by correcting the captured image in this way. For example, even if the page is curved at the time of shooting, the curvature can be corrected appropriately.

  According to the image generating apparatus and the like according to the present invention, it is possible to generate an image corresponding to one piece of paper constituting a book bound by a bag. As a result, for example, it is possible to create a complete replica of a book that has been bound by a bag (this is also a book that has been bound by a bag).

  Hereinafter, an image generation apparatus according to the present invention will be described using embodiments. In the following embodiments, components and steps denoted by the same reference numerals are the same or equivalent, and repetitive description may be omitted.

(Embodiment 1)
An image generation apparatus according to Embodiment 1 of the present invention will be described with reference to the drawings. The image generation apparatus according to the present embodiment generates an image corresponding to one paper constituting a book bound by a bag.

  FIG. 1 is a block diagram showing a configuration of an image generation apparatus 1 according to the present embodiment. The image generation apparatus 1 according to the present embodiment includes an image reception unit 11, an image correction unit 12, an image storage unit 13, a position determination unit 14, an image generation unit 15, and an image output unit 16.

  The image receiving unit 11 includes a first captured image that is an image that is captured with a reference point placed on the first page, and a second captured image that is an image that is captured with the reference point disposed on the second page. And accept. Here, in a book that has been bound in a bag (this book may not be dismantled, that is, it cannot be separated into pages), it is included in one folded paper. One page to be printed is the first page, and the other page is the second page. That is, the first page and the second page are two pages included in one paper in a book bound by a book and constitute the front and back sides of the page of the book bound by a book. The method for arranging the reference points on the page is not limited. For example, a plurality of reference points may be arranged on a page by overlapping a transparent sheet on which a plurality of reference points are provided in advance on the page, or transparent, translucent, Alternatively, a small piece of an opaque sheet may be prepared, and the plurality of small pieces may be arranged on the page.

  When the image receiving unit 11 receives three or more photographed images, it is possible to identify two pairs of photographed images, that is, the first photographed image and the second photographed image. Is preferred. There is no limitation on a method for specifying two captured images that form a pair. For example, there are a method that uses the order of acceptance and a method that uses information associated with the captured images.

  In the method using the order of acceptance, for example, the first photographed image accepted by the image accepting unit 11 and the second photographed image are two photographed images, the third photographed image, and the fourth photographed image. It may be determined that the two captured images are a pair of the captured images. And the image reception part 11 may provide the information which shows that both are a group with respect to the picked-up image used as a group. The information may be included, for example, in the header of the captured image.

  In the method using information associated with a captured image, for example, the information is included in the header of each captured image. The information associated with the captured image may be, for example, information that associates two captured images that form a group. The information associated with the two captured images may be, for example, the same information given to the paired captured images, or information having a predetermined relationship. In the former case, the information for associating the two captured images may be, for example, set identification information “H001” assigned to each of the two captured images that form a set. However, different group identification information is given for each group. In the latter case, the information for linking the two captured images includes, for example, a page number “P001” assigned to one of the two captured images in the set and a page number “ P002 "or the like. Then, it may be determined that the captured image is a set of two captured images corresponding to the page number “PN” and the page number “PN + 1”, respectively. However, N is an integer of 1 or more expressed in three digits. In the latter case, the information that links the two photographed images may be, for example, a file name given to the photographed image at the time of photographing. Usually, when shooting with a digital camera, a file name is assigned to each shot image, and the file name is incremented by one for each shot. Therefore, when the plurality of photographed images received by the image receiving unit 11 are sorted in ascending order of the file names, the two photographed images from the head after the sorting become two photographed images that form a group. In this case, it is assumed that photographing is performed for every two photographed images forming a set.

  It should be noted that the information that can specify the two captured images that form a pair is preferably retained as it is when the captured image is converted into a page image by the image correction unit 12 described later. This is because it is possible to specify two page images that form a set.

  For example, the image receiving unit 11 may receive a captured image input from a device (for example, a digital camera), may receive a captured image transmitted via a wired or wireless communication line, The captured image read from the recording medium (for example, an optical disk, a magnetic disk, a semiconductor memory, etc.) may be received. The image receiving unit 11 may or may not include a device (for example, a modem or a network card) for receiving. The image receiving unit 11 may be realized by hardware, or may be realized by software such as a driver that drives a predetermined device.

  The image correction unit 12 generates the first page image and the second page image by correcting the first captured image and the second captured image received by the image receiving unit 11 with respect to the shooting direction using a reference point. . Then, the image correction unit 12 accumulates the generated first and second page images in the image storage unit 13. The first page image is an image corresponding to the first page, and is the same image as the first page that can be superimposed on the first page, which is the original drawing, at the same magnification or by enlargement / reduction. It can be an image. Further, the second page image is an image corresponding to the second page, and is an image that can be superimposed on the second page that is the original drawing by equal magnification or by enlarging or reducing, that is, the second page. Can be the same image. The image correction unit 12 can perform the correction by performing a two-dimensional projective transformation or the like. In addition, the correction can also simultaneously correct an error (distortion) due to lens aberration of the camera that captured the captured image. For the method by which the image correction unit 12 performs this image correction, see the above-mentioned Patent Document 1.

  The image correction unit 12 may perform processing other than correction related to the shooting direction. For example, after correcting the shooting direction for the first and second captured images, a process of cutting out only the areas corresponding to the first and second pages may be performed. The processing may be performed before correction related to the shooting direction. The process of cutting out only the regions corresponding to the first and second pages may be performed using, for example, a contour extraction technique. For example, the image correction unit 12 acquires the background color in the first and second pages, identifies the pixel area having an approximate value of the background color, and includes a rectangular shape including all the identified areas (in this case, The areas corresponding to the first and second pages may be specified by specifying the areas on the assumption that each page is rectangular. The process of cutting out only the specified area is already known as a process of trimming. As a method for specifying the background color, for example, there is the following method. First, a random color (only luminance gradation may be used; the same applies hereinafter) is sampled. Then, the sampled colors are grouped (for example, a data clustering method may be used or grouped for each color having a predetermined width), and the group with the most elements corresponds to the background color. The background color that is the average value of the colors included in the group may be specified. This is because it is considered that the background color is most sampled when appropriately random sampling is performed. Note that the image correction unit 12 may cut out the areas corresponding to the first and second pages with the aspect ratio and length and width corresponding to each page of the book.

  Further, the image correction unit 12 may perform correction related to the size of the image. For example, measure and register in advance the size of the page to be photographed (it may be the length of the back of the book, or it may be both vertical and horizontal) The page image may be corrected (specifically, enlarged or reduced) so as to be the size of the registered page. In this way, when two page images are connected by the image generation unit 15 described later, it is possible to avoid a situation where the sizes of the two page images are different. It should be noted that the aspect ratio is preferably fixed at the time of enlargement / reduction, but this need not be the case.

  Further, the image correction unit 12 may perform a process of deleting the reference graphic after performing the image correction using the reference point indicated by the reference graphic. By doing so, it is possible to delete the reference graphic from the captured image or the page image. The process of deleting the reference graphic may be performed, for example, by replacing the pixel value of the reference graphic with the value of the pixel adjacent to the pixel of the reference graphic, or may be performed by other methods.

  In addition, the image correction unit 12 may perform correction to match the color tone and contrast of two page images that form a set. First, correction for matching color tones will be described. Here, a case where the color tone of the second page image is matched with the color tone of the first page image will be described, but the opposite may be possible. First, an average value of all pixels is calculated for each of R, G, and B for each of the first and second page images that form a set. Then, for each of R, G, and B, a difference is calculated by subtracting the average value of the second page image from the average value of the first page image. Thereafter, for the second page image, the difference between the calculated average values for R, G, and B is added to each pixel for each of R, G, and B. As a result, the average values for the R, G, and B of the first and second page images can be matched, and the colors of both images can be matched. Further, in order to match the contrast, the contrast gain of one page image is acquired, and the contrast of the other page image may be adjusted so that the same contrast gain is obtained. This method of adjusting the contrast is already known and will not be described in detail. Here, the correction for matching the color tones of the two page images has been described. However, when there are three or more page images, all the pages are obtained by performing such processing two by two. It is also possible to match the tone of the image. For example, the process of matching the color tone of the Nth page image with the color tone of the (N−1) th page image may be executed up to N = 2, 3,. Here, M is the total number of page images.

  In the image storage unit 13, a first page image that is an image of one page and a second page image that is an image of the other page, which are configured by folding a single sheet in a book that has been bound into a bag. Is memorized. The first and second page images are accumulated by the image correction unit 12.

  It should be noted that in each page image stored in the image storage unit 13, it is preferable that the side that is folded in half is known. Therefore, for example, in each page image, information indicating which side is folded in half (that is, which side is the upper side, the left side, the right side, or the lower side) is included in the header or the like. It may be determined that the specific side is the side that is folded in advance, and if there is a figure that spans both pages on the line that is folded in half as described later, You may detect the side folded in half by detecting the figure contained in the pixel of the outermost edge. When detecting the folded side, for example, in the pixel array at the outermost edge of each side, change in luminance between adjacent pixels is calculated, and the change in luminance for each side is predetermined from the largest. The average value of the quantity (for example, four) may be calculated, and it may be detected that the side with the largest average value is the side that is folded in half. This is because if there is a figure on the side that is folded in half, it is considered that there are at least two points where the luminance changes greatly depending on the figure. Needless to say, other methods may be used.

  Various information may be associated with each page image. For example, information about a page of a book that is bound and bound to a bag in which each page image is captured may be associated with each page image. The information related to the page of a book bound by bookbinding may be, for example, the page number or the page number of another book corresponding to the page. In the latter case, the information related to the page of the book bound and bound may be information on a link to a corresponding page image of another book, for example. Thus, the information associated with each page image may be included in, for example, the header of each page image, or managed as being associated with the page image as other information. Also good. In addition, it is preferable that the information associated with each page image is retained even when the page image is connected by the image generation unit 15 described later to generate a single image. In that case, it may be held as information corresponding to a single image, or may be held as information corresponding to a page included in the single image. Needless to say, the latter is preferred.

  Storage in the image storage unit 13 may be temporary storage in a RAM or the like, or may be long-term storage. The image storage unit 13 can be realized by a predetermined recording medium (for example, a semiconductor memory, a magnetic disk, an optical disk, etc.).

  The position determination unit 14 determines a position at which the side of the first page image that is folded in half and the side of the second page image that is folded in half are connected. The “position where the sides are connected” is a position in the length direction of the side. Determining the position may be, for example, specifying information that can connect the first page image and the second page image on a folded line. Specifying information may be, for example, storing the information in a recording medium (not shown), or setting a flag or the like in association with the information. The information may be, for example, information indicating how much the first page image is shifted with respect to the second page image (or the first page image and the second page image may be reversed). The information to be specified does not matter as long as it is information indicating the position for connecting the two page images as a result. For example, even if the information indicates the relative positional relationship (for example, the amount of relative displacement) between the side of the first page image that is folded in two and the side of the second page image that is folded in half. Well, or even in the reference coordinate system, information indicating the position of the side of the first page image folded in half and information indicating the position of the side of the second page image folded in half Good. In addition, as a result, if the positional relationship between the two-fold sides of both page images is known, for example, information indicating the positional relationship between the points on each side may be specified.

  For example, when there is a figure that spans both pages on a line that is folded in two on one paper (that is, on the line of the folded fold), the position determination unit 14 selects the figure included in the first page image. The position may be determined so that the portion and the graphic portion included in the second page image are connected. In this embodiment, this case will be described. The figure extending over both pages may be, for example, a character that extends over both pages (in this case, it is folded in half on the character), and the number of one paper that includes both pages. The figure may be a figure (similar to the number of pages) or other figure. This figure, for example, may be provided with a purpose such as a paper number, and it is spread across both pages by accidentally being folded in half like that of a character. It may be a thing. In addition, the position determination unit 14 folds the end point of the side of the first page image that is folded in half (for example, the end point on the top side of the book or the end point on the side of the book) and the second page image. The position may be determined so as to be connected to the end point of the side (for example, the end point on the top side of the book or the end point on the ground side of the book). The heaven of a book is the top of the book's three sides. In addition, the book ground is the lower part of the three sides of the book. The forehead is the three sides of the book, except for the back of the book. As a method for detecting the end points of the two-fold sides of the first and second page images, for example, as described above, after the regions corresponding to the first and second pages are cut out, they are cut out The detection may be performed by detecting both end points (rectangular vertices) of the side corresponding to the side of the half-fold in the rectangular shape. In addition, when the above-mentioned reference point is set as the end point, it is performed by specifying a point in the first and second page images corresponding to the reference point detected in the first and second captured images. Also good. In addition, when a corner portion of a page is torn, the end point of the side of the first page image or the second page image that is folded in half using the corner portion of the lower page of the page. May be detected. This is because the position of the end point on the side of the folded side is considered to be substantially the same even for a page that is lower by one page.

  As described above, the position determination unit 14 according to the present embodiment determines a position where the first and second page images are connected using a graphic that spans both pages. As illustrated in FIG. A relationship changing unit 21, a similar information calculating unit 22, a similar information storing unit 23, and a positional relationship specifying unit 24 are provided.

  The positional relationship changing means 21 changes the positional relationship in the side direction between the pixel row on the side of the first page image that is folded in two and the pixel row on the side of the second page image that is folded in half. The positional relationship changing means 21 may change the positional relationship of all the pixel columns on the side that is folded in half, or may change a partial positional relationship. Changing the positional relationship means shifting both pixel columns in order. Specifically, the positional relationship changing means 21 may determine an amount indicating “deviation” between both pixel columns (in this embodiment, “ε”) and store it in a recording medium (not shown). .

  The similarity information calculation unit 22 calculates similarity information that is information related to the similarity between both pixel columns whose positional relationship has been changed by the positional relationship change unit 21. It is assumed that the similarity information calculation unit 22 calculates the similarity information of both pixel columns having a plurality of positional relationships whose positional relationship change unit 21 has changed the positional relationship. Preferably, the similarity information calculating unit 22 calculates the similarity information of both pixel columns each time the positional relationship changing unit 21 changes the positional relationship between both pixel columns little by little (for example, one pixel at a time). Also good. When the positional relationship between both page images before the positional relationship changing unit 21 changes the positional relationship is determined, the similar information calculating unit 22 calculates the similar information of both pixel columns in the positional relationship. May be.

  Note that the similarity information may be information having a higher similarity when the value is larger, or information having a higher similarity when the value is smaller. That is, the similarity information may be, for example, a similarity degree or a difference degree as long as it is information indicating whether or not they are similar as a result. Further, the similar information calculation means 22 may calculate similar information using information regarding the luminance of both pixel columns, may calculate similar information using gradations of RGB colors of both pixel columns, Similar information may be calculated using information on the colors of both pixel columns (for example, information on hue and saturation).

  The similar information calculation unit 22 accumulates the calculated similar information in the similar information storage unit 23. Note that the similar information calculation unit 22 may store the similar information in association with information (for example, the value of ε described above) indicating the positional relationship between the two pixel columns at the time when the similar information is calculated.

  The similar information storage unit 23 stores the similar information accumulated by the similar information calculation unit 22. As described above, the similar information is stored in association with the information indicating the positional relationship between the two pixel columns on the two-fold side of the first and second page images when the similar information is calculated. May be. The storage in the similar information storage means 23 may be temporary storage in a RAM or the like, or may be long-term storage. The similar information storage means 23 can be realized by a predetermined recording medium (for example, a semiconductor memory, a magnetic disk, an optical disk, etc.).

  The positional relationship specifying unit 24 specifies the positional relationship between the two pixel columns having the highest similarity according to the similar information. When the similar information and the information indicating the positional relationship corresponding to the similar information are stored in the similar information storage unit 23, the positional relationship specifying unit 24, for example, uses the similar information indicating the highest similarity (usually, Information indicating a positional relationship corresponding to the largest value or the smallest value may be specified. Specifying information indicating the positional relationship may be, for example, storing the information in a recording medium (not shown) or setting a flag or the like in association with the information. The positional relationship between the two pixel columns identified in this way is a positional relationship connecting the side of the first page image that is folded in two and the side of the second page image that is folded in half.

  According to the position determined by the position determination unit 14, the image generation unit 15 is bound to the bag by binding the half-fold side of the first page image and the half-fold side of the second page image. A single image that is an image corresponding to one paper is generated. The image generation unit 15 may generate one file of a single image using, for example, a first page image file and a second page image file. Note that the data format of the single image is not limited as long as it results in an image in which both the first page and the second page are connected by the sides of the two folded sides. For example, the single image may be a single file as described above, or may be composed of a first page image, a second page image, and information for appropriately connecting the two images. . The information for appropriately connecting both images may be information for appropriately connecting both images by linking both page images.

  In addition, the image generation unit 15 generates a single image so that the side of the first page image that is folded in two and the side of the second page image that is folded in half are the center line of the single image. May be. By doing so, the same image as the book in which the first and second photographed images corresponding to the first and second page images are photographed by printing the one image and folding it in half at the center line. You will be able to make books. In this case, as a result, the image generation unit 15 has the half-fold side of the first page image and the half-fold side of the second page image as the center line of the single image. The process is not particularly limited as long as a single image is generated. For example, after the image generation unit 15 connects the first and second page images, the image may be clipped so that the side of each page image that is folded in half becomes the center line, or a margin may be added. Good. Alternatively, in the cropping when the image correction unit 12 generates the page image, the first and second page images are folded in half by cutting in advance in the aspect ratio and the length and width corresponding to each page of the book. In an image in which the sides are connected, a fold line may be automatically positioned on the center line of the image.

  When the magnification (scale) of the first page image is different from that of the second page image, the image generation unit 15 enlarges / reduces one or both of the first and second page images. A single image may be generated. In addition, when the first page image and the second page image are connected to form a step on the folded line, the image generation unit 15 changes the shape of one image to the side of one page, for example. It may be a rectangle that extends (a side that is perpendicular to the fold-folded side) or a rectangle at another position (this process will be described later with reference to FIG. 14).

  The image output unit 16 outputs the single image generated by the image generation unit 15. Here, the output may be, for example, display on a display device (for example, a CRT or a liquid crystal display), transmission via a communication line to a predetermined device, printing by a printer, or output to a recording medium. It may be accumulated or delivered to another component. The image output unit 16 may or may not include an output device (for example, a display device or a printer). The image output unit 16 may be realized by hardware, or may be realized by software such as a driver that drives these devices.

  Note that the image storage unit 13 and the similar information storage unit 23 may be realized by the same recording medium, or may be realized by separate recording media. In the former case, the area storing the page image is the image storage unit 13, and the area storing the similar information is the similar information storage means 23.

  Next, the operation of the image generation apparatus 1 according to the present embodiment will be described using the flowchart of FIG.

  (Step S101) The image reception unit 11 determines whether a captured image has been received. If a captured image is received, the process proceeds to step S102. If not, the process proceeds to step S104.

  (Step S <b> 102) The image correction unit 12 generates a page image by correcting the accepted captured image.

  (Step S <b> 103) The image correction unit 12 accumulates the generated page image in the image storage unit 13. Then, the process returns to step S101.

  (Step S104) The image generation unit 15 determines whether or not to perform processing for generating a single image. And when performing the production | generation process, it progresses to step S105, and when that is not right, it returns to step S101. Note that the image generation unit 15 may determine that the process of generating a single image is performed when the image generation apparatus 1 receives an instruction to perform the process of generating a single image, for example. It may be determined that the process of generating a single image is performed at the timing.

  (Step S <b> 105) The image generation unit 15 determines whether or not two page images to be paired, that is, the first page image and the second page image are stored in the image storage unit 13. If it is stored, the process proceeds to step S106. Otherwise, the single image cannot be generated, and the process returns to step S101.

  (Step S106) The position determination unit 14 determines a position where the sides of the first and second page images that are the basis for generating a single image are connected to each other. Details of this processing will be described later with reference to the flowchart of FIG.

  (Step S <b> 107) The image generation unit 15 generates a single image by connecting the first and second page images according to the position determined by the position determination unit 14.

  (Step S108) The image output unit 16 outputs the single image generated by the image generation unit 15. Then, the process returns to step S101.

  In the flowchart of FIG. 3, the process ends when the power is turned off or the process is terminated. When the image receiving unit 11 receives two or more captured images, the image correcting unit 12 repeats the processes in steps S102 and S103 for the number of captured images.

  If there are two or more sets of page images in the image storage unit 13, the process of steps S106 and S107 is repeated for each set of page images to generate two or more single images. In S108, the two or more single images may be output.

  FIG. 4 is a flowchart showing details of position determination (step S106) in the flowchart of FIG.

  (Step S201) The positional relationship changing means 21 detects a figure range for each pixel row on the side of the two-fold side in the first and second page images. The range of a figure is a range corresponding to a figure that spans both pages. The detection of this range is performed by, for example, specifying a pixel whose luminance is darker than a threshold value in each pixel row, and a range from the most celestial pixel to the most ground pixel among the specified pixels. It may be performed by detecting. The threshold value may be determined in advance, or may be an average value or an intermediate value of luminance in each pixel column.

  (Step S202) The positional relationship changing means 21 sets the positional relationship between both pixel columns, that is, ε indicating the amount of deviation (number of pixels) to an initial value. Here, the initial value is the top end point of the graphic range (referred to as “first graphic range”) in the first page image detected in step S201, and the graphic range in the second page image. The amount of deviation when matching the ground-side end point of this (referred to as "second graphic range"), or the ground-side end point of the first graphic range and the top side of the second graphic range Either of the amounts of deviation in the case of matching with the end point of may be used.

  (Step S203) The similar information calculation means 22 calculates similar information in the positional relationship between both pixel columns indicated by ε at that time.

  (Step S204) The similar information calculation means 22 stores the calculated similar information in the similar information storage means 23 in association with the value of ε at that time.

  (Step S205) The positional relationship changing means 21 increments or decrements the value of ε by 1. If ε increases when the positional relationship between the two pixel columns is changed from the state where ε is the initial value to the one where the overlap between the ranges of the first and second figures is larger, in this step, the value of ε is set to Increment by one. On the other hand, if ε becomes smaller when the positional relationship between the two pixel columns is changed from the state where ε is the initial value to the one where the overlap between the ranges of the first and second figures is larger, in this step, Decrement the value by 1.

  (Step S206) The positional relationship changing means 21 determines whether or not there is an overlap between the range of the first graphic and the range of the second graphic in the positional relationship indicated by ε at that time. If there is an overlap, the process returns to step S203, and if not, the process proceeds to step S207.

  (Step S207) The positional relationship specifying unit 24 specifies ε having the highest similarity. For example, the positional relationship specifying unit 24 sorts the pairs of ε and similar information stored in the similar information storage unit 23 so that the similarity of the similar information is in descending order, and is similar to the first ε after the sorting. You may specify the epsilon with the highest similarity which is the epsilon included in a set with information. And it returns to the flowchart of FIG.

  In the flowchart of FIG. 4, the case where the similar information is calculated after detecting the graphic range has been described. However, the similar information may be calculated without detecting the graphic range. In that case, similar information is calculated using all the pixels in each pixel column.

Next, the operation of the image generation apparatus 1 according to the present embodiment will be described using a specific example.
FIG. 5 is a diagram illustrating an example of a book 30 that is bound into a bag. As shown in FIG. 5, the book is a method of binding the back side of a piece of paper that is folded in half into a bag shape. For example, it can be seen in a Japanese-style book or a simple bookbinding book.

  First, as shown in FIG. 6, the user takes a picture with the digital camera 31 for each page with the book 30 opened. At the time of photographing, as shown in FIG. 7, it is assumed that a transparent sheet 40 on which five reference figures are displayed is placed on each page for photographing. The point where the crosses of each reference figure intersect is the reference point. In FIG. 7, characters and the like described on the first page 41 are omitted for convenience of explanation. Further, as shown in FIG. 7, it is preferable that these reference graphics are arranged as evenly as possible on each page. In FIG. 7, as described in Patent Document 1, a reference figure may be easily recognized by placing a translucent reference point position recognition body on each reference figure. The translucent reference point position recognition body may be a translucent color mark, for example.

  When shooting with the digital camera 31 is completed, the user takes out the memory from the digital camera 31 and attaches the memory to the image generation apparatus 1. Then, the image reception unit 11 reads the first captured image “IMG — 00102” and the second captured image “IMG — 00103” captured from the memory, and passes them to the image correction unit 12 (step S101). In this specific example, a case where only two captured images are received will be described for convenience of explanation.

  Further, in this specific example, it is assumed that the file names of captured images are grouped in units of two in order from the youngest. Further, of the two units of captured images, it is assumed that the half-folded side is left in the photographed image with the younger file name, and the half-folded side is right in the other captured image.

  The image correction unit 12 detects a reference point of the first captured image and performs correction using the five reference points, thereby correcting the shooting direction. As a result, an image as shown in FIG. 8 can be obtained. Further, as described above, the image correction unit 12 cuts out only the page area and generates the first page image 43 as shown in FIG. 9 (step S102). Then, the first page image 43 is stored in the image storage unit 13 (step S103). The image correcting unit 12 performs the same process for the second captured image of the second page (step S102), and accumulates the second page image 44 shown in FIG. 10 in the image storage unit 13 (step S103). . It should be noted that the figure present on the side of the first page image 43 in FIG. 9 (left side) and the side of the second page image 44 in FIG. The figure to be displayed is the figure of the number displayed on the half-folded line of one paper composed of the first and second page images 43, 44, that is, the figure in which two Chinese numerals are circled. It is.

  Next, it is assumed that the user inputs an instruction to execute a process for generating a single image by operating an input device such as a mouse or a keyboard. Then, the image generation unit 15 determines that it is time to generate a single image (step S104), and determines whether there are two page images to be paired in the image storage unit 13 (step S105). In this case, since the first and second page images 43 and 44 are stored, the image generation unit 15 determines that there are two page images to be paired, and determines the position in the position determination unit 14. To execute the process to be executed.

  In response to the instruction, the position determination unit 14 executes processing for determining the position (step S106). It is assumed that the pixel row on the half-fold side of the first page image 43 and the pixel row on the half-fold side of the second page image 44 are as shown in FIG. For convenience of explanation, the case where the number of pixels is very small and each pixel is a monochrome binary is shown, but more pixels are originally included in each pixel column. Each pixel may have a gradation or may be a color (for example, each pixel may have a gradation for RGB).

  First, the positional relationship changing unit 21 of the position determining unit 14 detects a figure range for each pixel column (step S201). Specifically, the positional relationship changing unit 21 determines whether or not each pixel column is a black pixel in order from the end point on the ground side. Set to the ground end point of the range. Setting a pixel as an end point on the ground side of a graphic range means that information (address) that can identify the pixel is accumulated in an area for storing information that specifies an end point on the ground side of a recording medium (not shown). There may be. Further, the positional relationship changing means 21 further determines whether or not the pixel is a black pixel in order toward the top side, and when it becomes a black pixel, the pixel is set as the top end point of the figure range. Set. In addition, after that, the determination is continued in order toward the top side, and if a black pixel exists, the pixel is reset to the top end point of the figure range. Then, this determination is performed up to the pixel at the end point on the top side. In this way, it is possible to specify the end point on the ground side and the end point on the top side of the figure range, and the range from the end point on the ground side to the end point on the top side becomes the range of the figure. In FIG. 11, it is assumed that the figure range is detected as described in the figure.

  In this specific example, the pixel number of the first page image 43 shifted from the pixel column of the second page image 44 to the top (right side in FIG. 11) is ε. In this specific example, the maximum value of ε when the ranges of both figures have an overlap is set as the initial value. Therefore, the positional relationship changing unit 21 sets the value ε “5” in a state where the end point on the ground side of the pixel column of the first page image 43 and the end point on the top side of the pixel column of the second page image 44 overlap. The calculated value is set as the initial value of ε (step S202).

In this specific example, the degree of difference is used as the similarity information. That is, the smaller the value indicated by the similar information, the higher the similarity. The difference degree is calculated by the following equation.
Degree of difference = Σ _i {(L1) _i − (L2) _i } ²

Note that i is a value that is incremented by 1 every time one pixel is shifted to the top side, assuming that the end point on the ground side of the range of both figures in a state shifted by the value of ε at that time is 1. This i designates the position of the pixel. Therefore, the upper limit of i in the sum (Σ) is a value corresponding to the top end point of the range of both figures in a state shifted by the value of ε at that time. Further, (L1) _i is the value of the pixel column of the first page image 43 at the pixel specified by i. If it ’s a black pixel,
(L1) _i = 1, and if it is a white pixel, (L1) _i = 0. (L2) _i is the value of the pixel column of the second page image 44 at the pixel specified by i. If it ’s a black pixel,
(L2) _i = 1, and if it is a white pixel, (L2) _i = 0. Further, it is assumed that the values of (L1) _i and (L2) _i outside the figure range are “0”.

  Then, as shown in FIG. 12, when ε is set to the initial value “5”, the similar information calculation means 22 calculates the degree of difference “6” which is similar information (step S203). = 5 and stored in the similar information storage unit 23 (step S204). Further, the positional relationship changing means 21 decrements ε by 1 (step S205), and in that case also determines that there is an overlap in the figure range (step S206). Specifically, when the top end point of the graphic range of the first page image 43 or the end point of the ground side is at the same position as any pixel in the graphic range of the second page image 44, It may be determined that there is an overlap, and if not, it may be determined that there is no overlap. The first page image 43 and the second page image may be reversed.

  Thereafter, as shown in FIG. 12, the calculation, accumulation, and decrement of similarity information that is the degree of difference in each positional relationship are repeatedly executed (steps S203 to S206). Finally, it is assumed that the information shown in FIG. 13 is stored in the similar information storage unit 23.

  In the information of FIG. 13, the positional relationship specifying unit 24 sorts the records so that the similar information (difference degree) is in ascending order, that is, the descending order of similarity, and the similar information (difference degree). Ε = “− 3” indicating the positional relationship of the smallest record is stored in a recording medium (not shown) (step S207). Then, the image generation unit 15 reads the value “−3” of ε, and displays the first page image 43 in FIG. 9 and the second page image 44 in FIG. 10 as three pixels with the first page image as the ground side. It joins at the position moved by the amount (step S107). If the images are connected as they are, the image after the connection is not a rectangle but a figure having a step on the side. Therefore, as described above, the image generation unit 15 may form a rectangular image after joining the first and second page images 43 and 44. At that time, a rectangle may be set in accordance with the first page image 43 as shown by a one-dot chain line in FIG. 14, and a second page image 44 may be set as shown by a two-dot chain line in FIG. A rectangle may be set together, and a rectangle may be set between the first page image 43 and the second page image 44 as indicated by a broken line in FIG. In FIG. 14, for convenience of explanation, the solid line, the broken line, and the chain line are written while being shifted, but originally at least a part (for example, a vertical line part) coincides. Further, the single image 45 after the whole is set to a rectangle is as shown in FIG. The broken line in FIG. 15 is for the sake of convenience indicating the position of the folded side. In practice, this broken line may not be present in the single image 45.

  The image output unit 16 outputs the single image 45 shown in FIG. 15 (step S108). The output may be a printout, for example. In the printout, when the size of the single image 45 and the size of the print paper do not match, the single image 45 corresponding to the side of the first and second page images 43 and 44 that is folded in half. The automatic enlargement / reduction according to the print paper and the automatic center placement may be performed so that the center line of the image coincides with the center line of the print paper.

  Note that the similar information described in this specific example is merely an example, and it goes without saying that the similar information may be calculated by other methods. In this specific example, when calculating similar information using each pixel column on the side of the first and second page images that is folded in half, either one of the pixel columns is enlarged or reduced. Similar information may be calculated by resampling and using the resampled pixel column. In that case, the similar information having the highest similarity is identified from the similar information calculated using the enlarged / reduced pixel column and the similar information calculated without performing the enlargement / reduction. The position when connecting the first and second page images 43 and 44 and the enlargement / reduction magnification of one page image may be determined using the positional relationship corresponding to the similar information and the enlargement / reduction magnification. .

  As described above, according to the image generation apparatus 1 according to the present embodiment, a single image that is an image obtained by appropriately connecting two page images existing on the front and back sides in a book bound by a booklet is generated. be able to. As a result, for example, by printing out the single image, it is also possible to create a replica (replica) that is exactly the same as the original book that has been bound to the bag. In addition, since each paper before being bound into a bag can be completely restored, it is possible to know what balance each paper has been described in, and what layout it was in. It is thought that it will contribute to the progress of research on old documents.

  Further, by generating a page image from a photographed image taken with a digital camera or the like, the page image can be obtained with a simple device. For example, old documents, official documents, old land ledgers and the like are generally prohibited from being taken out even if they are permitted to be browsed. Moreover, in such a place where browsing is permitted, it is often impossible to secure a space for installing a flat head scanner or the like. Therefore, it is difficult to bring in a flat head scanner or the like, and a photographed image can be easily obtained with a digital camera or the like, which improves the convenience for the operator. Further, such old documents are very fragile due to worm-eaten and paper alteration, and it may be difficult to extend them flat on a flat head scanner. Even in such a case, photographing with a digital camera or the like can be performed, and a photographed image can be obtained without damaging the book. Also, if it is difficult to disassemble easily, such as thread binding or wireless binding, or if it is not permitted to disassemble due to the nature of the book, A page image corresponding to the page can be easily obtained.

  Note that a camera that captures a book that has been bound into a bag is usually a digital still camera, but this need not be the case. For example, a digital video camera that shoots a moving image may be used, and one frame of the moving image may be used as one captured image. Alternatively, a photograph taken with a silver salt camera and an image recorded on a film or an image burned on a photographic paper digitized using an optical device such as a scanner may be used as a photographed image.

  In the present embodiment, the position determination unit 14 has the configuration shown in FIG. 2, and uses the similarity of each pixel column on the side of the first and second page images that is folded in half. Although the case where the positional relationship is determined has been described, this need not be the case. For example, in each of the pixel rows on the sides of the first and second page images that are folded in half, the range of the figure is detected as described above, and the top side of the detected figure range and / or The positional relationship between the two pixel columns may be determined so that the end points on the ground side coincide. Needless to say, the position determination unit 14 may determine the position at which the sides of the first and second page images to be folded are connected by a method other than that described in the present embodiment.

  Further, in the present embodiment, a case has been described in which a captured image captured by a camera is received and corrected to generate a page image, but the page image is stored in the image storage unit 13. The process does not matter. For example, a page image may be generated from a read image obtained by reading each page of a book bound and bound by a flat head scanner and stored in the image storage unit 13. In this case, the page image portion may be cut out from the read image. Alternatively, if only the page portion is set in advance, the read image may be the page image as it is. . In that case, the image generating apparatus 1 may not include the image receiving unit 11 and the image correcting unit 12. Moreover, the process in which such a page image is memorize | stored in the image memory | storage part 13 is not ask | required. For example, a page image may be stored in the image storage unit 13 via a recording medium, or a page image transmitted via a communication line or the like may be stored in the image storage unit 13. Alternatively, a page image input from a flat head scanner or the like may be stored in the image storage unit 13.

  Further, in the case where a sheet of paper is folded in half, strictly speaking, the surface (or linear region) that is perpendicular to the first and second pages is minute on the folded line. Will exist. Therefore, when the image generation unit 15 connects the first and second page images, the linear region folded in half may be corrected. For example, the image generation unit 15 is a pixel row corresponding to the number of pixels corresponding to the linear region folded in half, and the pixel row on the side of the first page image that is folded in half, or the second A pixel row on the side of the page image that is folded in half may be added between the first page image and the second page image to connect the first and second page images. The number of pixels corresponding to the linear region folded in half (depending on the resolution of the image, for example, may be about 1 to 5 pixels) is determined in advance, and the value is shown in the figure. The image generation unit 15 may perform the above-described processing by reading the value. By doing so, it is possible to make the single image closer to the paper contained in the book that has been bound by the bag.

  In the present embodiment, the image correction unit 12 may perform a process of removing the background color of the page image. For example, the image correction unit 12 compares the luminance of each pixel of each page image with a threshold value, and if the luminance is brighter than the threshold value, the gradation and color information of the pixel is deleted. You can also set the background color to a predetermined background color or a background color obtained from any page image, or set the alpha value (transparency information) for that pixel to be completely transparent (colorless). May be. The background color correction may be performed on two page images constituting a single image, or may be performed on a plurality of page images acquired from one book. In the former case, the background color can be unified in both pages of a single image, and in the latter case, the background color can be unified in a plurality of single images corresponding to one book. In the latter case, only one of the pages may be shot with high accuracy, and the background color may be corrected by taking in information about the background color from the shot image. Here, the information regarding the background color may be, for example, any one or more information of luminance, hue, saturation, and the like.

  In the above embodiment, the case where the image generation apparatus 1 is a stand-alone has been described. However, the image generation apparatus 1 may be a stand-alone apparatus or a server apparatus in a server / client system. In the latter case, the output unit or the reception unit may receive input or output information via a communication line.

  In the above embodiment, each process or each function may be realized by centralized processing by a single device or a single system, or may be distributedly processed by a plurality of devices or a plurality of systems. It may be realized by doing.

  In the above embodiment, information related to processing executed by each component, for example, information received, acquired, selected, generated, transmitted, or received by each component In addition, information such as threshold values, mathematical formulas, addresses, etc. used by each component in processing is retained temporarily or over a long period of time on a recording medium (not shown) even when not explicitly stated in the above description. It may be. Further, the storage of information in the recording medium (not shown) may be performed by each component or a storage unit (not shown). Further, reading of information from the recording medium (not shown) may be performed by each component or a reading unit (not shown).

  In the above embodiment, when information used by each component, for example, information such as a threshold value, an address, and various setting values used by each component may be changed by the user Even if it is not specified in the above description, the user may be able to change the information as appropriate, or it may not be. If the information can be changed by the user, the change is realized by, for example, a not-shown receiving unit that receives a change instruction from the user and a changing unit (not shown) that changes the information in accordance with the change instruction. May be. The change instruction received by the receiving unit (not shown) may be received from an input device, information received via a communication line, or information read from a predetermined recording medium, for example. .

  In the above embodiment, when two or more constituent elements included in the image generation apparatus 1 include a communication device, an input device, or the like, the two or more constituent elements may physically include a single device. Or you may have separate devices.

  In the above embodiment, each component may be configured by dedicated hardware, or a component that can be realized by software may be realized by executing a program. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. Note that the software that implements the image generation apparatus 1 in the above embodiment is the following program. In other words, this program causes the computer to form a first page image, which is an image of one page, and an image of the other page. A position for determining a position at which the side of the second fold side of the first page image is connected to the side of the second fold side of the second page image stored in the image storage unit in which the two-page image is stored According to the position determined by the determining unit and the position determining unit, the two-folded side of the first page image and the two-folded side of the second page image are connected to each other to bind the bag. It is a program for functioning as an image generation unit that generates a single image that is an image corresponding to one paper, and an image output unit that outputs a single image generated by the image generation unit.

  Further, in this program, the computer is configured such that a reference is placed on a first photographed image that is a photograph taken by arranging a reference point on a page corresponding to the first page image, and on a page corresponding to the second page image. An image receiving unit that receives a second captured image that is an image captured by arranging points, and a correction related to the capturing direction of the first captured image and the second captured image received by the image receiving unit using the reference point By performing the above, the first page image and the second page image may be generated and further functioned as an image correction unit that accumulates in the image storage unit.

  In the program, the functions realized by the program do not include functions that can be realized only by hardware. For example, functions that can be realized only by hardware such as a modem and an interface card in a reception unit that receives information and an output unit that outputs information are not included in at least the functions realized by the program.

  Further, this program may be executed by being downloaded from a server or the like, and a program recorded on a predetermined recording medium (for example, an optical disk such as a CD-ROM, a magnetic disk, a semiconductor memory, or the like) is read out. May be executed by Further, this program may be used as a program constituting a program product.

  Further, the computer that executes this program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

  FIG. 16 is a schematic diagram illustrating an example of an external appearance of a computer that executes the program and realizes the image generation apparatus 1 according to the embodiment. The above-described embodiment can be realized by computer hardware and a computer program executed on the computer hardware.

  In FIG. 16, a computer system 900 includes a computer 901 including a CD-ROM (Compact Disk Read Only Memory) drive 905, an FD (Floppy (registered trademark) Disk) drive 906, a keyboard 902, a mouse 903, a monitor 904, and the like. Is provided.

  FIG. 17 is a diagram showing an internal configuration of the computer system 900. In FIG. 17, in addition to the CD-ROM drive 905 and the FD drive 906, a computer 901 is connected to an MPU (Micro Processing Unit) 911, a ROM 912 for storing a program such as a bootup program, and the MPU 911. A RAM (Random Access Memory) 913 that temporarily stores program instructions and provides a temporary storage space, a hard disk 914 that stores application programs, system programs, and data, and an MPU 911 and a ROM 912 are interconnected. And a bus 915. The computer 901 may include a network card (not shown) that provides connection to the LAN.

  A program that causes the computer system 900 to execute the functions of the image generation apparatus 1 according to the above embodiment is stored in the CD-ROM 921 or the FD 922, inserted into the CD-ROM drive 905 or the FD drive 906, and stored in the hard disk 914. May be forwarded. Instead, the program may be transmitted to the computer 901 via a network (not shown) and stored in the hard disk 914. The program is loaded into the RAM 913 when executed. The program may be loaded directly from the CD-ROM 921, the FD 922, or the network.

  The program does not necessarily include an operating system (OS) or a third-party program that causes the computer 901 to execute the functions of the image generation apparatus 1 according to the above-described embodiment. The program may include only a part of an instruction that calls an appropriate function (module) in a controlled manner and obtains a desired result. How the computer system 900 operates is well known and will not be described in detail.

  Further, the present invention is not limited to the above-described embodiment, and various modifications are possible, and it goes without saying that these are also included in the scope of the present invention.

  As described above, according to the image generating apparatus and the like according to the present invention, an effect that it is possible to generate an image corresponding to one piece of paper constituting a book bound by a book is obtained. It can be used to create a replica of a document or old land ledger.

1 is a block diagram showing a configuration of an image generation apparatus according to Embodiment 1 of the present invention. The block diagram which shows the structure of the position determination part by the embodiment The flowchart which shows operation | movement of the image generation apparatus by the embodiment The flowchart which shows operation | movement of the image generation apparatus by the embodiment The figure which shows an example of the book bound by the bag in the embodiment The figure for demonstrating photography of the book in the embodiment The figure for demonstrating photography of the book in the embodiment The figure which shows an example of the picked-up image in the embodiment The figure which shows an example of the 1st page image in the embodiment The figure which shows an example of the 2nd page image in the embodiment The figure for demonstrating the determination of the position in the embodiment The figure for demonstrating the determination of the position in the embodiment The figure which shows an example of the similar information in the embodiment The figure for demonstrating the production | generation of the single image in the embodiment The figure which shows an example of the single image in the embodiment Schematic diagram showing an example of the appearance of the computer system in the embodiment The figure which shows an example of a structure of the computer system in the embodiment

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image generation apparatus 11 Image reception part 12 Image correction | amendment part 13 Image memory | storage part 14 Position determination part 15 Image generation part 16 Image output part 21 Positional relationship change means 22 Similar information calculation means 23 Similar information storage means 24 Positional relationship specification means

Claims (4)

Photographed by placing a reference point on a page corresponding to the first page image , which is an image of one page, in which a single sheet of paper is folded in a book that has not been disassembled and is bound and bound An image receiving unit that receives a first captured image that is an image and a second captured image that is an image captured by arranging a reference point on a page corresponding to a second page image that is an image of the other page ;
An image storage unit for storing the first page image and the second page image ;
The first page image and the second page image are generated by correcting the first shot image and the second shot image received by the image receiving unit with respect to the shooting direction using the reference point, and the image An image correction unit stored in the storage unit;
A position determination unit that determines a position at which the side of the first page image that is folded in two and the side of the second page image that is folded in two are connected;
According to the position determined by the position determination unit, the one sheet of paper that has been bound into a bag is connected to the side of the first page image that is folded in half and the side of the second page image that is folded in half. An image generation unit that generates a single image that is an image corresponding to
An image output unit that outputs a single image generated by the image generation unit ,
On the folded line of the one paper, there is a figure that spans both pages,
The position determination unit determines a position so that the part of the graphic included in the first page image and the part of the graphic included in the second page image are connected,
The image generation unit includes the single image so that a half-fold side of the first page image and a half-fold side of the second page image are the center line of the single image. An image generation device for generating The position determination unit
A positional relationship changing means for changing a positional relationship in a side direction between the pixel row on the side of the first page image folded in two and the pixel row on the side of the second page image folded in two;
Similarity information calculation means for calculating similarity information that is information relating to the similarity between both pixel columns whose positional relationship has been changed by the positional relationship change means;
A positional relationship specifying means for specifying a positional relationship between both pixel columns having the highest similarity according to the similar information,
The positional relationship between the two pixel columns specified by the positional relationship specifying means is a positional relationship connecting the side of the first page image folded in two and the side of the second page image folded in half. The image generation apparatus according to claim 1 . A first page image that is an image of one page and an image of the other page that are configured by folding an image reception unit and a book that is not disassembled into a bound and bound book. An image generation method that is processed using an image storage unit that stores a two-page image, an image correction unit, a position determination unit, an image generation unit, and an image output unit,
The image receiving unit arranges a reference point on a page corresponding to the second page image, and a first photographed image taken by arranging a reference point on the page corresponding to the first page image. An image receiving step of receiving a second captured image that is an image captured
The first image and the second page image are corrected by the image correction unit using the reference point to correct the first shooting image and the second shooting image received in the image receiving step. An image correction step of generating and storing in the image storage unit;
A position determining step for determining a position at which the position determining unit connects the side of the first page image folded in two and the side of the second page image folded in two;
According to the position determined in the position determining step, the image generation unit connects the side of the first page image folded in two and the side of the second page image folded in two, thereby binding the booklet into a booklet. An image generation step of generating a single image that is an image corresponding to the one paper that has been performed;
The image output unit includes an image output step of outputting the single image generated in the image generation step ,
On the folded line of the one paper, there is a figure that spans both pages,
In the position determining step, the position is determined so that the graphic part included in the first page image and the graphic part included in the second page image are connected,
In the image generation step, the single image is such that a side of the first page image that is folded in half and a side of the second page image that is folded in half are the center line of the single image. A method of generating an image. Computer
Photographed by placing a reference point on a page corresponding to the first page image , which is an image of one page, in which a single paper is folded in a book that has not been disassembled and is bound and bound An image receiving unit that receives a first captured image that is an image and a second captured image that is an image captured by placing a reference point on a page corresponding to a second page image that is an image of the other page ;
The first page image and the second page image are generated by correcting the first shot image and the second shot image received by the image receiving unit with respect to the shooting direction using the reference point, and storing the image. Image correction unit to be stored in the unit,
Position determining portion that determines the position to connect the clamshell sides of the first page image stored in the image storage unit, and a clamshell sides of the second page image,
According to the position determined by the position determination unit, the one sheet of paper that has been bound into a bag is connected to the side of the first page image that is folded in half and the side of the second page image that is folded in half. An image generation unit that generates a single image that is an image corresponding to
Function as an image output unit that outputs a single image generated by the image generation unit ,
On the folded line of the one paper, there is a figure that spans both pages,
The position determination unit determines a position so that the part of the graphic included in the first page image and the part of the graphic included in the second page image are connected,
The image generation unit includes the single image so that a half-fold side of the first page image and a half-fold side of the second page image are the center line of the single image. Generate a program.

Images