JP4306075B2 - Image synthesizer - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an apparatus for collecting partial images of information obtained by dividing information on a single read medium into a plurality of portions and combining the collected partial images into a single whole image.
[0002]
[Prior art]
Conventionally, an image obtained by reading information on a medium to be read by a reading device such as a scanner has been used for various purposes, for example, processing of an image on a computer. Further, it is also used as an input means to an optical character reader (hereinafter referred to as an OCR (Optical Character Reader) device) that has made remarkable technological progress in recent years. In the OCR apparatus, particularly in the financial industry, technical development is actively performed because labor saving and efficiency improvement by systematization of various data input operations (data entry) is an urgent task.
[0003]
This reading apparatus is classified into a contact type and a non-contact type depending on whether or not a medium to be read contacts with a light source and a light receiving element of the reading apparatus. As the contact type, for example, there is a normal scanner, which is widely used as an OA device. As a non-contact type, for example, there is one that takes a picture with a digital camera with a built-in CCD. When reading information on a form in the financial industry, the form is thick and bulky, so a non-contact type is convenient.
[0004]
However, in a scanner, the size of a medium to be read that can capture an image is determined. Therefore, for a medium to be read that is larger than that, an image of information is not captured in multiple steps. must not. At this time, the image captured at one time is a partial information image of the read medium. However, as described above, for example, in order to perform character recognition with an OCR device, it is necessary to input the entire image. Therefore, it is necessary to synthesize the captured partial information images into one whole image.
[0005]
[Problems to be solved by the invention]
However, conventionally, there is no image synthesizing device that can automatically synthesize a plurality of partial information images into one whole image on software and can use the whole image as it is for an OCR device or the like. It was. That is, since the partial images are simply superimposed, the joints of the partial images can be understood, and the character recognition ability in the OCR device is low. When used in an OCR device, if the joint of the image is shifted even a little, it is recognized as another character and the recognition rate is lowered. Therefore, in a system such as a financial institution, there is a problem in reliability and it cannot be used for an OCR device.
[0006]
The present invention has been made in view of the above points. Therefore, an object of the present invention is to automatically create a high-accuracy composite image that can be recognized with a high recognition rate by an OCR device on software. Another object of the present invention is to provide an image synthesizing apparatus and a read medium used for the image synthesizing apparatus.
[0007]
[Means for Solving the Problems]
  In order to achieve this object, according to the first image composition device of the present invention, the information fetched from one read medium in which information and a plurality of collating thin lines are written are a plurality of portions. An image synthesizing apparatus that synthesizes the partial image divided into a single whole image of the information includes a first image capturing unit, a second image capturing unit, a first image combining processing unit, and a second image combining unit. A processing unit; and an image coincidence determination unit, wherein the first image capturing unit captures, as a first partial image, a partial image including the thin line from a plurality of partial divided regions of the read medium. The second image capturing unit captures the partial image of the information other than the thin line as the second partial image from the partial division region, The one image composition processing unit performs rotation, magnification change, and parallel movement processing on each of the first partial images using the image including the thin line included in each of the plurality of first partial images. By performing the above-described processing, the second whole image is synthesized from the second partial image in accordance with the synthesis method substantially the same as the first image synthesis processing unit. The whole image is synthesized, and the image match determination unit matches the first whole image with reference to the amount of deviation between fine lines other than the fine lines used in the first whole image synthesis process. Make a judgmentWith
The first image capturing unit and the second image capturing unit are configured to maintain the same state except for the target of the captured image.It is characterized by that.
[0008]
  Here, the information is an image (including characters, numbers, symbols, figures, etc.) necessary for some purpose, for example, OCR recognition. On the other hand, since the thin line is dummy information necessary only for the image composition processing of the present invention, it is different from the information here. A plurality of partial divided areas is not an area in which a single read medium is divided without overlapping at all. Near the boundary of each partial divided area, the same part of the read medium is partially overlapped. It means that it contains. This is because, in the present invention, since the images are synthesized based on the overlapping areas, the images cannot be synthesized unless the partial images partially include images in the same area. At least the fine wireincludingThe partial image includes an image of only a thin line and an image of a thin line and information. Further, a partial image of a thin line is hereinafter abbreviated as a partial thin line image in this specification, and similarly, a partial image of information is abbreviated as a partial information image.
[0009]
  With such a configuration, even for a large read medium that cannot capture an image at one time, a second entire image equivalent to that obtained by capturing an image of a single read medium at one time is displayed on the software. Can be configured automatically. Further, the formed second whole image does not include the fine line image, and becomes an image of only the target information.
  Also, with this configuration, the image composition process is repeated many times until the determination criterion for determining that the images match is reached, so that a highly accurate first whole image can be formed.
[0010]
In carrying out the present invention, preferably, the thin line is a thin line written with an invisible material.
[0011]
Here, the invisible material means a material that does not absorb visible light but absorbs ultraviolet light or infrared light. If the fine line is written with an invisible material, the fine line on the read medium is not recognized by the human eye, and the aesthetic appearance is not impaired. However, since it is recognized on the image composition device, it can be a reference for image composition.
[0012]
  In carrying out the present invention, preferably, the first partial image isThe partial image of the thin line from the plurality of partial divided areas of the read mediumGood to include only.
[0013]
  With this configuration, the first image composition processPartWhen the synthesis process is performed, the partial information image is not included and only the partial thin line image is included, so that the synthesis process is easy to perform.
[0014]
  Also, the first and second image capture in the first image composition apparatus of the present inventionPartIs preferably configured as follows.
(A) Capture the first imagePartComprises a light source that emits light of a first wavelength absorbed by the thin line and the information constituent material, and a light receiving unit that senses the light of the first wavelength, and captures the second image.PartComprises a light source that emits a second wavelength that is absorbed by the information constituent material, and a light receiving unit that senses the light of the second wavelength.
(B) Capture the first imagePartComprises a light source that emits light of a first wavelength that is absorbed by the constituent material of the thin wire, and a light receiving unit that senses light of the first wavelength, and the second image capturingPartComprises a light source that emits a second wavelength that is absorbed by the information constituent material, and a light receiving unit that senses the light of the second wavelength.
(C) capturing the first imagePartIs a light source that emits light of a first wavelength that is absorbed by at least the constituent material of the fine wire, and a light receiving device that senses light of the second wavelength that is emitted when the constituent material of the fine wire absorbs the light of the first wavelength. The second image capturePartComprises a light source that emits a third wavelength that is absorbed by the material constituting the information, and a light receiving unit that senses the light of the third wavelength. Here, the fact that at least the constituent material of the thin line absorbs means that the constituent material of information may absorb other than the thin line.
[0015]
By providing the configuration of (a), the partial thin line image and the partial information image can be obtained as the first partial image and the partial information image as the second partial image, and the configurations of (b) and (c) can be obtained. By providing, a partial thin line image is obtained as a first partial image, and a partial information image is obtained as a second partial image.
[0016]
  According to the second image composition device of the present invention,Information and multiple thin lines for verification are writtenOne read mediumTaken fromThe information is divided into partsPartMinute image, one pieceAboveAn image synthesizer that synthesizes the entire image of informationIncludes a first image capturing unit, a first image composition processing unit, a dropout processing unit, and an image match determination unit.From the plurality of partial divided regions of the read medium, the thin lineincludingPartial imageGAnd partial image of the informationThe, Each as a first partial imageOnly,The first image composition processing unit has a plurality ofThe first partial imageIncluded in each ofin frontDetaillineincludingUsing imagesBy subjecting each of the first partial images to rotation, magnification change, and translation processing,Performs composition processing of the first whole imageNo,The dropout processing partFrom the first overall image, the previousDetaillineContaining partDrop out only the image before it remainsEmotionNewsPart ofImage with the second whole imageThe image match determination unit determines whether or not the first overall images match based on a shift amount of fine lines other than the thin lines used in the synthesis process of the first overall image. Characterized by.
[0017]
Dropout here means erasing data from the machine memory.
[0018]
With such a configuration, even for a large read medium that cannot capture an image at one time, a second entire image equivalent to that obtained by capturing an image of a single read medium at one time is displayed on the software. Can be configured automatically. Further, since only the fine line image is dropped out from the first whole image, the thin line image disappears from the formed second whole image, and only the target information image is obtained.
[0019]
In carrying out the present invention, preferably, the thin line is a thin line written with an invisible material.
[0020]
If the fine line is written with an invisible material, the fine line on the read medium is not recognized by the human eye, and the aesthetic appearance is not impaired. However, since it is recognized on the image composition device, it can be a reference for image composition.
[0021]
Further, the image capturing device in the second image composition device of the present invention is preferably configured as follows.
(D) a light source that emits light having a wavelength that is absorbed by the constituent material of the thin line and information, and a light receiving unit that senses the light having the wavelength.
[0022]
By providing such a configuration, a partial thin line image and a partial information image are obtained as the first partial image.
[0023]
  Also, a first image composition process in the first and second image composition apparatuses of the present invention.PartShould contain the following structure:
(A)Each said1st partOf the image, any of the horizontal or vertical directionsPart containing fine linesA first rotation processing unit configured to rotate the first partial image so that the image is parallel to the X axis or the Y axis;
(B)For each said first partial image,Part containing fine linesA first magnification change processing unit that determines the corresponding fine lines of the image and changes the magnification of the first partial image so that the distances between the thin lines coincide with each other.
(C)Corresponding saidPart containing fine linesSo that the images overlap at the correct position.1st partA first translation processing unit that translates an image.
[0024]
  Also,(B)In the above, the determination of the corresponding thin line may be performed by the following method depending on how the thin line is written on the read medium.
(1) The abovePart containing fine linesJudgment is made by recognizing the positional relationship according to the number of vertical or horizontal thin lines included in the image.
(2)When the thin lines for verification having different thicknesses are written on the read medium,SaidPart containing fine linesJudgment is based on the thickness of the thin lines included in the image.
(3)When the thin lines for verification with different intervals are written on the read medium,SaidPart containing fine linesJudgment is made based on the distance between fine lines included in the image.
[0025]
(1) is effective for a read medium in which fine lines are written in a grid pattern, and (2) is effective for a read medium written by changing the thickness of the fine lines. (3) is effective for a read medium written by changing the distance between the thin lines.
[0028]
Further, when implementing the first and second image synthesizing apparatuses of the present invention, a character recognition processing unit for recognizing characters of the synthesized image may be provided.
[0029]
With this configuration, an integrated apparatus capable of performing character recognition of the synthesized second whole image.
[0030]
  Further, in implementing the first and second image composition apparatuses of the present invention, the first image composition processing when the image coincidence determination unit determines that the first whole images do not coincide with each other. It is preferable that the unit performs the first overall image composition process again using a thin line other than the thin line used for the composition process of the first entire image.
[0035]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of the present invention will be described below with reference to the drawings. In the drawings, the size, shape, and arrangement relationship of each component are shown only schematically to the extent that the present invention can be understood, and the numerical conditions described below are merely examples. .
[0036]
In this embodiment, an image composition apparatus, an image composition method using the image composition apparatus, and a read medium used in the image composition apparatus will be specifically described.
[0037]
The image synthesizing apparatus of the present invention includes a first image synthesizing apparatus and a second image synthesizing apparatus, and embodiments of the respective apparatuses will be described. FIG. 1 is a block diagram showing the configuration of the first embodiment of the image composition apparatus, and FIG. 2 is a block diagram showing the configuration of the embodiment of the second image composition apparatus.
[0038]
The first image synthesizing device includes first and second image capturing devices 10 and 12, first and second image synthesizing processing devices 14 and 16, and further, an image match determination unit 18, first and second parts. Image storage units 20 and 22, first and second overall image storage units 24 and 26, and a composition processing storage unit 27 are provided. The first image composition processing device 14 includes a first rotation processing unit 28, a first magnification change processing unit 32, and a first parallel movement processing unit 36. The second image composition processing device 16 includes a second rotation processing unit 30, a second magnification change processing unit 34, and a second parallel movement processing unit 38.
[0039]
The second image composition device includes a first image capture device 40, a first image composition processing device 42, and a dropout processing device 44, and further includes an image match determination unit 46, a first partial image storage unit 48, 2 The entire image storage unit 50 is provided. The first image composition processing device 42 includes a first rotation processing unit 52, a first magnification change processing unit 54, and a first parallel movement processing unit 56.
[0040]
Among these, the first image synthesizing apparatus that is operated by the microcomputer is the first and second image capturing apparatuses 10 and 12, the first and second image synthesizing processing apparatuses 14 and 16 (ie, the first and second image synthesizing apparatuses). 2 rotation processing units 28 and 30, first and second magnification change processing units 32 and 34, first and second translation processing units 36 and 38), and image coincidence determination unit 18.
[0041]
Further, in the second image composition device, the microcomputer operates the first image capturing device 40, the first image composition processing device 42 (that is, the first rotation processing unit 52, the first magnification change processing unit 54, A first translation processing unit 56), a dropout processing device 44, and an image match determination unit 46.
[0042]
1. Embodiment of Read Medium Used for Image Composition Device (Description 1)
First, an embodiment of a read medium used in the image composition apparatus of the present invention will be described.
[0043]
Thin lines are written on the read medium. This fine line is preferably written in advance before information is written on the read medium. In this embodiment, a thin line written using an invisible material will be described. Since the thin line in this embodiment is written with an invisible material, the thin line is not perceived by the human eye. However, when the image composition is performed by the image composition apparatus according to the present invention, the image composition is performed based on the image of the thin line, and therefore, it must be an invisible material that allows the image composition apparatus to recognize the thin line.
[0044]
There are two types of invisible materials used for the read medium of the present embodiment. The first material absorbs ultraviolet light and emits visible light as fluorescence or phosphorescence by absorbing the ultraviolet light. The specific absorption wavelength range and emission wavelength are limited by the relationship with the absorption wavelength range of the information constituent material. That is, it is necessary that the emission wavelength range of the invisible material does not overlap with the absorption wavelength range of the information constituent material. When a read medium on which fine lines using such an invisible material are written is used, when a partial image is captured by an image capturing device described later, a first partial image consisting of the partial thin line image and a partial information image To obtain a second partial image. Information constituent materials include, for example, graphite pencils, ballpoint pens, fountain pens, printing inks, etc. When selecting invisible materials, select them as a combination considering the optical characteristics of the information constituent materials. It is good to do.
[0045]
The second material absorbs ultraviolet light or infrared light. There are two specific absorption wavelength ranges in relation to the absorption wavelength range of the information constituent material. That is, there is a wavelength range in which only the invisible material is absorbed without absorbing the information portion, or there is no wavelength range in which only the invisible material is absorbed. When the read medium on which fine lines using the former invisible material are written is used, when a partial image is captured by an image capturing device described later, the first partial image composed of the partial thin line image and the partial information image The second partial image is obtained. When a read medium on which fine lines using the latter invisible material are written is used, when a partial image is captured by an image capturing device described later, a first partial image composed of a partial thin line image and a partial information image; A second partial image made up of partial information images (the second partial image is not present in the second image composition device) is obtained.
[0046]
Any material that satisfies the above-mentioned two material conditions can be used as the invisible material of the present invention, and is not limited to a specific material.
[0047]
Further, as the medium to be read, if it is a white medium that does not absorb light in the absorption wavelength range of the invisible material and the information material, for example, ordinary paper may be used.
[0048]
As a result, fine lines are not perceived by the naked eye, but can be recognized when a partial image of the medium to be read is captured by an image capturing device. Therefore, based on the thin lines, image synthesis is performed on the entire image. can do.
[0049]
Next, a thin line writing method will be described with reference to the drawings. FIG. 3A shows a state in which fine lines composed of several straight line groups are actually written on the read medium. In the figure, 58 indicates a thin line, and 60 indicates the outline of the medium 62 to be read. Actually, since the thin line 58 of this embodiment is invisible, it does not look like this figure, but the thin line 58 is conceptually shown. Fine lines 58 are written as straight lines in the vertical direction and the horizontal direction on the read medium 62. The thickness and length of the thin line 58 are not particularly limited. However, if the line is too thick, it is difficult to determine the center coordinates of the thin line 58 in an image composition apparatus to be described later, and if the line 58 is too thin, the thin line 58 may not be recognized. There is. Accordingly, an appropriate thickness is preferable, but in this embodiment, a straight line having a thickness of about 0.5 mm is used. Further, it is desirable that the thin line 58 is a straight line that penetrates the read medium 62. This is because the portion where the thin line 58 is not written cannot be image-synthesized. Further, it is desirable that the single thin wire 58 has a uniform thickness and a straight line. This is because this condition is necessary to synthesize the image of the thin line 58 in the image synthesizing apparatus described later.
[0050]
Further, the thin line 58 is a set of two straight lines arranged in parallel at a moderately small interval, and these straight line groups are preferably orthogonal to each other. This is because when the read medium 62 on which the thin lines 58 are written is divided and taken into partial images, the entire image is synthesized two-dimensionally with reference to the thin lines 58 in each partial image. In this embodiment, the thin lines 58 are written in a lattice shape, and the interval between the lattices is, for example, 1 cm for both the vertical and horizontal thin lines 58. Note that the direction of the thin line 58 in the vertical direction and the horizontal direction is preferably parallel to each side if the read medium 62 is rectangular. This is because information to be written later is often written in a direction parallel to one side of the read medium 62, so that the image of information synthesized on the image synthesizing apparatus does not become oblique.
[0051]
A modification of the thin line 58 writing method is shown in FIGS. FIG. 4A shows an example in which both vertical and horizontal thin lines 64 are written with straight lines having different intervals. FIG. 4B shows an example in which both vertical and horizontal thin lines 66 are written as straight lines having different thicknesses. These modifications have the effect of making it easier to determine the corresponding thin line when the read medium is taken into small partial images.
[0052]
FIG. 5A shows a thin line writing method when the read medium is used in the second image composition apparatus. As will be described in detail later, the second image synthesizing apparatus can be used when a position 70 where information is to be recorded later is determined on the read medium 68. Therefore, the thin line 72 is not written at that position. I have to do so. That is, the information 74 and the thin line 72 are not overlapped. At this time, the first partial image including both the information 74 and the thin line 72 is captured by the first image capturing device 40 of the second image composition device. Thereafter, only the thin line 72 can be dropped out from the synthesized first whole image.
[0053]
As a method for writing a thin line on the read medium, any method such as a normal printing method may be used.
[0054]
In this embodiment, the thin line is written using an invisible material, but even a visible material can be used in the present invention. However, in actual application, thin lines are visible to the human eye, which impairs the aesthetics of the read medium and is inconvenient to use.
[0055]
2. Embodiment of image capturing device in first image composition device (Description 2)
Next, an embodiment of an image capturing device which is a part of the first image composition device of the present invention will be described with reference to the drawings.
[0056]
The image capturing device includes a first image capturing device 10 that captures at least a fine thin line image as a first partial image from a plurality of partial divided regions of a read medium, and a partial information image from the partial divided region. Are included as second partial images, respectively.
[0057]
Here, since the first partial image and the second partial image are captured from the same partial divided area, the first image capturing device 10 and the second image capturing device 12 are objects of the captured image (thin lines or information). Other than that, it must remain the same. That is, it means that the positions, functions, and conditions of the read medium, the light source, and the light receiving element are kept the same. However, since the objects are different, only one of the wavelength range of light emitted from each light source and the wavelength range of light recognized by the light receiving element is changed.
[0058]
Specifically, both the first image capturing device 10 and the second image capturing device 12 include a light source that irradiates light to a read medium and a light receiving element that senses reflected light or emitted light from the read medium. Yes. Examples of the image capturing device include a contact type scanner and a non-contact type scanner using a digital camera including a light receiving element constituted by a CCD.
[0059]
In this embodiment, the configuration of three types of image capturing devices that can be considered by combining the two types of invisible materials described in the embodiment (Description 1) and the materials used for writing information will be described below. To do. Note that the first image capturing device 10 and the second image capturing device 12 must perform image detection for the same partial divided region while keeping the positions, functions, and conditions of the light source and the light receiving element in the same state. Therefore, both devices must be considered in a structurally combined configuration.
[0060]
In the first image capturing device, the first image capturing device 10 includes a light source that emits light of a first wavelength that is absorbed by a thin line and a constituent material of information, and a light receiving unit that senses light of the first wavelength. Have. The second image capturing device 12 includes a light source that emits a second wavelength absorbed by the information constituent material, and a light receiving unit that senses light of the second wavelength.
[0061]
In such a configuration, the constituent material of the thin line is an invisible material and absorbs ultraviolet light or infrared light. Further, of the light from the light source, only the constituent material of the thin line is absorbed. This is the case.
[0062]
As a result, both the partial thin line image and the partial information image can be captured as the first partial image by the first image capturing device 10, and the partial information image is captured as the second partial image by the second image capturing device 12. Can do.
[0063]
Since the first image capturing device has a combination structure of the first image capturing device 10 and the second image capturing device 12, more specifically, the following two types of configurations are conceivable. Both have the device configuration having both functions of the first image capturing device 10 and the second image capturing device 12.
[0064]
In the first type of apparatus, the light source is a light source that emits both the first wavelength and the second wavelength, and the light receiving unit is a light receiving element that includes a CCD having both an element part that senses the first wavelength and an element part that senses the second wavelength. To do. Therefore, an image captured by the element portion sensing the first wavelength can be used as the first partial image, and an image captured by the element portion sensing the second wavelength can be used as the second partial image. Note that the first image capturing device 10 and the second image capturing device 12 are the same as described above in order to simultaneously capture the first partial image and the second partial image for the same partial divided area of the read medium. Keeps the state.
[0065]
The second type of device has two types of light sources, one that emits the first wavelength and one that emits the second wavelength, and the light receiving unit has an element portion that senses both the first wavelength and the second wavelength. A light receiving element composed of a CCD is provided. Therefore, an image captured using a light source that emits a first wavelength can be used as a first partial image, and an image captured using a light source that emits a second wavelength can be used as a second partial image. Here, in order to capture the first partial image and the second partial image in two portions, the first image capturing device 10 and the second image capturing device 12 must maintain the same state. That is, the positional relationship between the light receiving element and the read medium must be the same.
[0066]
In the second image capturing device, the first image capturing device 10 includes a light source that emits light having a first wavelength absorbed by a constituent material of a thin line, and a light receiving unit that senses light having the first wavelength. The second image capturing device 12 includes a light source that emits a second wavelength absorbed by the information constituent material, and a light receiving unit that senses light of the second wavelength.
[0067]
In such a configuration, the constituent material of the thin line is an invisible material and absorbs ultraviolet light or infrared light, and further, the constituent material of information out of the light from the light source does not absorb the fine line. This is a case where there is a wavelength range in which only the constituent material is absorbed.
[0068]
As a result, the first image capturing device 10 can capture the partial thin line image as the first partial image, and the second image capturing device 12 can capture the partial information image as the second partial image.
[0069]
Since the second image capturing device is a combination structure of the first image capturing device 10 and the second image capturing device 12, more specifically, two types of configurations can be considered. Since it is exactly the same as the capturing device, description thereof is omitted.
[0070]
In the third image capturing device, the first image capturing device 10 includes a light source that emits light of a first wavelength that is absorbed by at least a thin line constituent material, and a thin line constituent material that absorbs light of a first wavelength. A light receiving unit that senses light of a second wavelength that is sometimes emitted, and the second image capturing device 12 senses a light source that emits a third wavelength that is absorbed by the information constituent material and light of the third wavelength. And a light receiving portion.
[0071]
Such a configuration is used when the constituent material of the thin wire is an invisible material, absorbs ultraviolet light, and emits visible light, and further, the emission wavelength range of the constituent material of the thin wire Is the case where it does not overlap with the absorption wavelength range of the information constituent material.
[0072]
As a result, the first image capturing device 10 can capture the partial thin line image as the first partial image, and the second image capturing device 12 can capture the partial information image as the second partial image.
[0073]
Since the third image capturing device has a combination structure of the first image capturing device 10 and the second image capturing device 12, more specifically, the following two types of configurations are conceivable. Both have the device configuration having both functions of the first image capturing device 10 and the second image capturing device 12.
[0074]
In the first type of apparatus, the light source is a light source that emits both the first wavelength and the third wavelength, and the light receiving unit is a light receiving element composed of a CCD having both an element part that senses the second wavelength and an element part that senses the third wavelength. To do. Therefore, an image captured by the element portion sensing the second wavelength can be used as the first partial image, and an image captured by the element portion sensing the third wavelength can be used as the second partial image. Here, since the first partial image and the second partial image are captured at the same time, the first image capturing device 10 and the second image capturing device 12 maintain the same state.
[0075]
The second type of device comprises two types of light sources, one that emits the first wavelength and one that emits the third wavelength, and the light receiving unit is a CCD having an element portion that senses both the second wavelength and the third wavelength. The light receiving element is as follows. Therefore, an image captured using a light source that emits a first wavelength can be used as a first partial image, and an image captured using a light source that emits a third wavelength can be used as a second partial image. Here, in order to capture the first partial image and the second partial image twice, the first image capturing device 10 and the second image capturing device 12 must maintain the same state. That is, it is necessary to make the positional relationship between the light receiving element and the read medium the same.
[0076]
The first partial image capturing device 10 and the second partial image capturing device 12 of the present invention are not limited to the above-described configuration example, and further modifications are conceivable depending on combinations of thin lines and information constituent materials.
[0077]
Next, the concept of capturing an image with the image capturing device of this embodiment and the captured image will be described with reference to the drawings. FIG. 3 is a diagram showing the concept of capturing a partial image of the read medium 62 with an image capturing device. In this embodiment, since the invisible material is used for the thin line 58, it is not actually visible, but in FIG. 3, it is shown by a solid line for easy understanding.
[0078]
In this embodiment, thin lines written in a lattice shape are used as the thin lines 58 of the read medium 62 (FIG. 3A). When information 76 is written on the read medium 62, the state shown in FIG. Only the information 76 can be seen with the naked eye as described above. FIG. 3C shows a state in which a partial image of the read medium 62 shown in FIG. Two rectangular frames 78 and 80 indicate the range that can be captured by the first and second image capture devices 10 and 12. In this embodiment, the read medium 62 is divided into two parts, and two partial images are captured. Here, it is necessary to capture the partial images so that the boundary between the two partial images overlaps. This is because, in order to synthesize the captured partial images, the images of the overlapping portions are used as a basis. Therefore, even when the read medium 62 is divided into three or more parts and three or more partial images are captured, the boundary images are captured so that the boundary portions overlap. FIG. 3D shows the state of the two partial images captured by FIG. You can see that the borders overlap. Of these, the left partial image 81a is A, and the right partial image 81b is B. A and B are captured by the first and second image capture devices 10 and 12, respectively. Of A, the partial image 81a captured by the first image capturing device 10 is defined as a first partial image A1, and the partial image 81a captured by the second image capturing device 12 is defined as a second partial image A2. Similarly, a partial image 81b captured by the first image capturing device 10 in B is defined as a first partial image B1, and a partial image 81b captured by the second image capturing device 12 is defined as a second partial image B2.
[0079]
Next, the first or second partial image A1 or A2 captured by the image capturing device of this embodiment will be described with reference to the drawings. FIG. 6 is a diagram showing a partial image captured by the first image composition device. FIG. 6A is a diagram showing a first partial image A1 in the image capturing device having the first configuration described above, and includes an image of a thin line 58 and information 76. FIG. FIG. 6B is a diagram showing the first partial image A1 in the second and third configurations described above, and includes an image of only the thin line 58. FIG. FIG. 6C is a diagram showing the second partial image A2 in all the above-described configurations, and includes an image of only the information 76.
[0080]
The first partial image and the second partial image captured by the image capturing device of this embodiment are stored in the storage units 20 and 22 for the first and second partial images.
[0081]
The image capturing device in the first image composition device requires two devices, the first and second image capture devices 10 and 12, which are more complicated than the second image composition device described later. The second image capture device 12 can obtain a second overall image of information only, thus eliminating the need for a dropout processor 44. Further, there is an advantage that the second whole image can be obtained even when the thin line 58 and the information 76 are overlapped on the read medium 62.
[0082]
3. Embodiment of image capturing device in second image composition device (Description 3)
Next, an embodiment of an image capturing device which is a part of the second image composition device of the present invention will be described with reference to the drawings.
[0083]
The image capturing device includes a first image capturing device 40 that captures a partial thin line image and a partial information image as a first partial image from a plurality of partial division regions of a read medium.
[0084]
Specifically, it includes a light source that emits light of a wavelength that is absorbed by the thin line and the information portion, and a light receiving unit that senses the light of that wavelength. Examples of the first image capturing device include a contact type scanner and a non-contact type scanner using a digital camera provided with a light receiving element constituted by a CCD.
[0085]
The second image synthesizing apparatus is used when the constituent material of the thin line is an invisible material and there is no wavelength range in which only the constituent material of the thin line absorbs the light from the light source, or image capturing There are cases where the structure of the device takes advantage of simple advantages. As a result, the first partial image including both the partial thin line image and the partial information image can be captured by the first image capturing device 40.
[0086]
The first image capturing device 40 of the present invention is not limited to the above-described one, and further modifications may be conceived depending on the combination of the invisible material and the material used for writing information.
[0087]
The concept of capturing an image with the image capturing device of this embodiment and the captured image will be described with reference to the drawings. FIG. 5 is a diagram showing a concept of capturing a partial image of the read medium 68 by the first image capturing device 40. In this embodiment, since the invisible material is used for the thin line 72, it is not actually visible, but in FIG. 5A, it is shown by a solid line for easy understanding.
[0088]
In this embodiment, the information shown in FIG. 5A in which information 74 is written on the read medium 68 in which the thin line 72 described in the first embodiment is written is used. At this time, the thin line 72 and the information 74 do not overlap. A partial image is captured from the read medium 68 by the same method as described in the embodiment (description 2). In this embodiment, the read medium 68 is divided into two parts, and two partial images are captured. Here, it is necessary to capture the partial images so that the boundary between the two partial images overlaps. This is because, in order to synthesize the captured partial images, the images of the overlapping portions are used as a basis. Therefore, even when the read medium 68 is divided into three or more parts and three or more partial images are captured, the boundary images are captured so that the boundary portions overlap.
[0089]
Next, the first partial image captured by the image capturing device of this embodiment will be described with reference to the drawings. FIG. 5B is a diagram illustrating a partial image captured by the image composition device. You can see that the borders overlap. Among these, the left partial image 75a is A, and the right partial image 75b is B. A and B are captured by the first image capturing device 40 described above. A first partial image A1 and B first partial image B1. It can be seen that both A1 and B1 contain both fine line 72 and information 74 images.
[0090]
The first partial image captured by the first image capturing device 40 of this embodiment is stored in the first partial image storage unit 48.
[0091]
Since the first image capturing device 40 in the second image synthesizing device has a simple configuration, it is effective when the thin line 72 and the information 74 do not overlap on the read medium 68.
[0092]
4). Embodiment of image composition processing apparatus in first image composition apparatus (description 4)
Next, an embodiment of an image composition processing apparatus which is a part of the first image composition apparatus of the present invention will be described with reference to the drawings.
[0093]
This image composition processing device is substantially the same as the first image composition processing device 14 and the first image composition processing device 14 that perform composition processing of the first whole image from the first partial image using the partial thin line image. A second image composition processing device 16 that performs composition processing of the second whole image from the second partial image according to the same composition processing method is provided.
[0094]
Among these, the first image composition processing device 14 rotates the first partial image so that an arbitrary partial thin line image in the horizontal direction or the vertical direction among the partial thin line images is parallel to the X axis or the Y axis. The first rotation processing unit 28 and the first magnification for changing the magnification of the first partial image so as to determine the corresponding fine line of the partial thin line image for each first partial image and to match the distance between the thin lines It includes a change processing unit 32 and a first translation processing unit 36 that translates the partial thin line images so that the corresponding partial thin line images overlap at the correct position (FIG. 1).
[0095]
Further, the second image composition processing device 16 rotates the first partial image so that an arbitrary partial thin line image in the horizontal direction or the vertical direction among the partial thin line images is parallel to the X axis or the Y axis. The second rotation processing unit 30 and the second magnification for changing the magnification of the first partial image so as to determine the corresponding fine line of the partial thin line image for each first partial image and to match the distance between the thin lines It includes a change processing unit 34 and a second translation processing unit 38 that translates the partial thin line images so that the corresponding partial thin line images overlap at the correct position.
[0096]
Here, “substantially the same composition processing method” is performed in each of the first rotation processing unit 28, the first magnification change processing unit 32, and the first parallel movement processing unit 36 of the first image composition processing device 14. This means that the method is substantially the same as the following processing method. That is, the total rotation angle in the first rotation processing unit 28, the ratio of the magnification change in the first magnification change processing unit 32, and the parallel movement in the X axis direction and the Y axis direction in the first translation processing unit 36. This is the coordinate amount. For this reason, these composition processing methods performed by the first image composition processing device 14 are stored in the composition processing storage unit 27, and this composition processing method is performed when the second image composition processing device 16 performs composition processing. Is appropriately extracted from the storage unit 27 of the synthesis process.
[0097]
First, the first rotation processing unit 28 will be described with reference to FIG. FIG. 7A is a diagram showing a state in which the first partial image 88 is taken out from the storage unit 20 for the first partial image. The outer frame 82 is a range that can be processed by the image composition device, and is the same as the range of the captured partial image. In the first rotation processing unit 28, there are an X axis 84 and a Y axis 86 orthogonal to the X axis 84. First, the first partial image 88 is projected on the Y axis 86 in the X axis 84 direction. The first partial image 88 is composed of a large number of pixels. When the Y coordinate is constant, the first partial image 88 has a projected pixel intensity I corresponding to the number of pixels when the X coordinate is changed. The pixel intensity I with respect to this Y coordinate is shown in FIG. At this time, when one of the vertical or horizontal partial images of the grid-like thin lines 90 is not parallel to the X axis 84, that is, the partial images of the thin lines 90 are coordinate axes of the first rotation processing unit 28. When tilted with respect to 84 and 86, the projected peak has a width and therefore the pixel intensity I is small. Therefore, in order to make the partial image of the thin line 90 parallel to the X axis 84, the image is rotated by a certain angle θ (an angle formed with the X axis 84) in an arbitrary direction around the origin of the coordinate axis. When the pixel intensity I after rotation is large, the partial image of the thin line 90 is closer to parallel to the X axis 84 than before the rotation. On the contrary, when the pixel intensity I after rotation is small, the pixel intensity I is far from parallel, and thereafter, the pixel intensity I is rotated in the opposite direction. As the rotation is repeated several times, the peak width 92 decreases and at the same time the pixel intensity I increases. As a result, the pixel intensity I has a certain constant value I_S Is exceeded, it is determined that the partial image of the thin line 90 is parallel to the X axis 84 (that is, the partial image of the other thin line 90 is parallel to the Y axis 86). This I_S Since the accuracy of parallelism is determined by the magnitude of the value of, the I_S What is necessary is just to decide the magnitude of the value of. If the rotation angle θ is too large, it cannot be accurately adjusted to the parallel state, and if it is small, the rotation process must be repeated many times before reaching the parallel state. Therefore, in practice, when θ is initially increased and rotated, and it is determined that the rotation is approaching parallel, θ may be gradually decreased to make fine adjustment.
[0098]
However, in this method, one of the vertical or horizontal partial images of the grid-like thin lines 90 is rotated so as to be parallel to the X axis 84, and which is parallel to the X axis 84. May cause the partial images to be shifted by 90 °. In order to prevent this, for example, there are the following methods. First, when the first partial image 88 is captured by the first image capturing device 10, the direction of the read medium 82 is not changed so much. Furthermore, it may be controlled so that the total rotation angle rotated by the rotation process does not exceed 45 °.
[0099]
This rotation process is performed for all the first partial images 88. In this embodiment, there are two first partial images 88, A1 and B1, and therefore rotation processing is performed for A1 and B1.
[0100]
Here, as shown in FIG. 7A, when the first partial image 88 is only a thin line, the rotation process may be performed as described above. However, as described in the embodiment (description 2), the first partial image 88 When the image 88 includes both a thin line and information, a peak of information also appears in the pixel projection intensity I in FIG. In this case, when one of the vertical or horizontal partial thin line images is not parallel to the X axis, the pixel projection intensity of information with respect to the pixel intensity of the thin line cannot be ignored. However, when approaching parallel, the pixel intensity of the thin line becomes very large, and the pixel projection intensity of information becomes negligible. Therefore, also in this case, the rotation process can be performed, and although the description is omitted, a magnification change process and a parallel movement process, which will be described later, can also be performed.
[0101]
The data subjected to the rotation processing in the first rotation processing unit 28 described above, that is, the total number of rotations performed on each of the first partial images 88 is stored in the synthesis processing storage unit 27.
[0102]
The rotation processing method in the first rotation processing unit 28 described above is an example, and any other suitable rotation processing method can be applied to the present invention.
[0103]
Next, the first magnification change processing unit 32 will be described with reference to FIG.
[0104]
The first magnification change processing unit 32 performs the magnification change processing on a plurality of first partial images 88 that are processed by the first rotation processing unit 28 and one of the vertical or horizontal partial thin line images is parallel to the X axis. I do. In this embodiment, there are two first partial images 88, A1 and B1. In both A1 and B1, the above-described first rotation processing unit 28 projects the partial thin line image on the Y axis in the X axis direction. This is shown in FIG. FIG. 8A shows a pixel projection for A1, and FIG. 8B shows a pixel projection for B1.
[0105]
First, for A1 and B1, the corresponding thin line is determined. A1 and B1 are first partial images captured by the first image capturing device 10 as shown in FIG. 3, and there are four fine lines written in the horizontal direction. In the first image capturing device 10, the positional relationship of each first partial image with respect to the read medium is stored in the first partial image storage unit 20. Accordingly, for example, the fact that the longitudinal direction of the read medium is not divided into a plurality of portions but only the lateral direction is divided into two is stored. As is clear from FIG. 8, there are four peaks of pixel projection on the Y axis. Therefore, in FIGS. 8A and 8B, if peaks 1 to 4 are sequentially set from the top, it can be determined that peaks with the same number correspond to the same thin line.
[0106]
In the above-described method, pixels are projected in the X-axis direction on the Y-axis. However, the present invention is not limited to this, and pixels may be projected in the Y-axis direction on the X-axis by paying attention to the vertical thin lines.
[0107]
At this time, as can be seen from FIG. 3C, each of the projections of A1 and B1 has four peaks. However, since the number of fine lines written in the vertical direction of the read medium cannot be recognized, it is input artificially that the number of fine lines is 7, or the fine lines written in the vertical direction as the read medium in advance. For example, it may be stored in the storage unit 20 of the first partial image. At this time, as shown in FIG. 9, if it is determined that the peak at the right end of A1 shown in FIG. 9A corresponds to the peak at the left end of B1 shown in FIG. The net number of peaks is seven, and therefore coincides with seven, which is the number of fine lines on the read medium. In this way, when the number of partial images is small, the corresponding fine line peak can be determined.
[0108]
However, when the number of partial images increases, it becomes difficult to determine the peak of the corresponding thin line by the above-described method. At this time, for example, there are the following two methods as possible countermeasures.
[0109]
In the first method, when the first partial image is captured, the position of the portion to be captured with respect to the read medium is stored in the storage unit 20 for the first partial image. When this method is used, it is possible to know which portion of the read medium has been captured, so that an approximate standard can be obtained when determining the corresponding thin line. However, it is difficult to accurately determine the corresponding thin line. In addition, when this method is used, the position of the portion to be captured can be determined by the movement of the digital camera in a non-contact type scanner using a digital camera. In many cases, this method cannot be used.
[0110]
On the other hand, the second method devises how to write the thin line itself on the read medium. As a specific example, there is the one shown in FIG. 4 described in the modification of the embodiment of the medium to be read. In FIG. 4A, the interval between the thin lines 64 is changed. Therefore, when the first partial image of the read medium is captured, the first partial images having the shortest distance between the thin lines 64 may be determined as corresponding thin lines. In addition, what is shown in FIG. 4B is obtained by changing the thickness of the thin line 66. Accordingly, when the first partial image of the read medium is taken in, it is only necessary to determine the thin line 66 having the closest thickness between the first partial images as the corresponding thin line 66. As a method for recognizing the thickness of the thin line 66, the width of the peak of pixel projection in an embodiment of dropout processing described later may be determined as the thickness.
[0111]
If the corresponding thin line can be determined by the above-described method for determining the corresponding thin line, next, the magnification change process is performed.
[0112]
In this embodiment, first, the distance between corresponding thin lines is obtained. As shown in FIG._A12And 1_B12Is the distance between the corresponding thin lines. Here, because the peak of the pixel projection has a width, 1_A12Or 1_B12In order to recognize such distances, it becomes a problem where the distance is used as a reference. Since the Y coordinate of the center line of the thin line should be used as a reference, the Y coordinate corresponding to the center line of the thin line is recognized among the peaks of the pixel projection. For example, there are two recognition methods. The first method is to consider the Y coordinate at which the peak intensity of pixel projection reaches the maximum as the center line of each thin line. The other is a method that considers the distribution of pixels included in each peak in the Y coordinate, and considers the average Y coordinate of the pixels as the center line of each thin line. The average value of the distances is obtained from the distance between the thin lines thus determined. That is, 1_A121_A23And 1_A34To A1 average value 1_A1_B121_B23And 1_B34To B1 average value 1_BIs obtained.
[0113]
Next, since the distances between corresponding thin lines should be equal, A1 or B1 is enlarged or reduced so that the distances are equal. That is, average value 1 of A1_A And the average value of B1 1_B Ratio 1 with_A/ 1_BIf B1 is enlarged or reduced only by this, the average value of the distances A1 and B1 becomes equal.
[0114]
In addition to the above-described method for obtaining the average value of distances, the second method is to use a corresponding one distance ratio, for example, 1_A12/ 1_B12Only B1 may be enlarged or reduced. However, the method using the average value is preferable because it easily matches over the entire partial thin line image in the parallel movement process described later.
[0115]
In this embodiment, the distance between the partial thin line images is calculated by projecting the pixel to the Y coordinate, but may be performed by projecting the pixel to the X coordinate, and more preferably in both the X coordinate and the Y coordinate. It is preferable to calculate the average value to obtain the magnification.
[0116]
In this embodiment, since the number of the first partial images is two, it is sufficient to perform the magnification changing process by the ratio of the distances. However, when the number of the first partial images is three or more, it is simply used. Cannot be done. However, for example, when the number of first partial images is three (A1, B1, C1), the average value of the respective distances is set to 1._A1_BAnd 1_c(1_A<1_B<1_C), A1 is 1_B/ 1_ADouble C1 to 1_B/ 1_CWhen doubled, the average value of the distances is the same for all partial images. Similar processing may be performed when there are four or more.
[0117]
The data subjected to the magnification change processing in the first magnification change processing unit 32 described above, that is, how many times the first partial image has been enlarged or reduced, is stored in the storage unit 27 of the synthesis process.
[0118]
Note that the magnification change processing method in the first magnification change processing unit 32 described above is an example, and any other suitable magnification change processing method can be applied to the present invention.
[0119]
Next, the first translation processing unit 36 will be described with reference to FIG.
[0120]
In the first translation processing unit 36, by performing the translation processing on the plurality of first partial images in which the intervals of the corresponding partial thin line images are equalized by performing the processing in the first magnification change processing unit 32 described above, Composite to the first overall image.
[0121]
First, as shown in FIG. 9A, pixel projection on the X-axis and the Y-axis is performed on the partial thin line image of the first partial image A1 (first rotation processing unit 28 or first magnification change processing unit). If you have already done it in 32, you can use it). Thereafter, the center coordinates of each partial thin line image are obtained by the method already described in the embodiment of the magnification change processing unit. Similarly, as shown in FIG. 9B, pixel projection on the X-axis and Y-axis is performed on the partial thin line image for B1, and then the center coordinates of each partial thin line image are obtained.
[0122]
Next, B1 (which may be A1) is translated in the X-axis direction. At this time, as described in the embodiment of the first magnification change processing unit 32, the peak of the pixel projection of the thin line corresponding to A1 and B1 is known. In this case, since the peak at the right end of A1 corresponds to the peak at the left end of B1, the X coordinate of B1 is X of A1._S4B1 is translated so that
[0123]
Next, B1 (which may be A1) is translated in the Y-axis direction. In this case, since the peak of the pixel projection projected in the Y-axis direction corresponds in order from the top, the Y coordinate of any corresponding peak is made to coincide. For example, if the peak with the largest Y coordinate is used as a reference, the Y coordinate of B1 is Y_S4B1 is translated so that
[0124]
Next, by combining A1 and B1 on one screen (one data), a combined first overall image is obtained.
[0125]
In this embodiment, A1 and B1 are translated after being translated on different screens (different data), but A1 and B1 are translated and then translated to produce the first overall image. You may do it.
[0126]
In addition, the translation in the X-axis direction is followed by the translation in the Y-axis direction. However, the translation in the X-axis direction may be performed after the translation in the Y-axis direction.
[0127]
In addition, if A1 and B1 are combined on one screen (one data), they may not fit on the screen. For example, before A1 and B1 are combined before or after being translated in advance, B1 may be reduced at the same magnification.
[0128]
The data subjected to the translation processing in the first translation processing unit 36 described above, that is, how much the respective first partial images are translated in the X-axis and Y-axis directions, etc., is stored in the synthesis processing storage unit 27. To remember.
[0129]
The synthesized first whole image is sent to the image matching judgment unit 18 when it is present, and is stored in the first whole image storage unit 24 when it is absent.
[0130]
The translation processing method in the first translation processing unit 36 described above is an example, and any other suitable translation processing method can be applied to the present invention.
[0131]
Next, the second image composition processing device 16 will be described.
[0132]
The second partial images captured by the second image capturing device 12 are designated as A2 and B2. For each of A2 and B2, if the same processing as the above-described combining processing performed on the first partial image, that is, rotation processing, magnification change processing, and parallel movement processing is performed, A2 and B2 are combined. The second overall image is obtained. The substantially same composition processing method in this case refers to rotation, enlargement or reduction, and translation performed on the coordinate axes without including pixel projection or the like. In this case, the same processing can be performed on the second partial image by taking out the data of the rotation processing, magnification change processing, and parallel movement processing performed on the first partial image described above from the storage unit 27 of the synthesis processing. it can.
[0133]
Therefore, the synthesized second overall image is a synthesized image that matches to the same extent as the first overall image.
[0134]
The second whole image is stored in the second whole image storage unit 26.
[0135]
5). Embodiment of image composition processing apparatus in second image composition apparatus (Description 5)
Next, an embodiment of the first image composition processing device 42 which is a part of the second image composition device of the present invention will be described.
[0136]
The first image composition processing device 42 performs composition processing of the first whole image using the partial thin line image from the first partial image captured by the first image capturing device 40.
[0137]
The first image composition processing device 42 rotates the first partial image so that an arbitrary partial thin line image in the horizontal direction or the vertical direction among the partial thin line images is parallel to the X axis or the Y axis. For the first rotation processing unit 52 and each first partial image, the corresponding fine line of the partial thin line image is determined, and the first magnification change is performed to change the magnification of the first partial image so that the distances between the thin lines match. It includes a processing unit 54 and a first translation processing unit 56 that translates the partial thin line images so that the corresponding partial thin line images overlap at the correct position (FIG. 2).
[0138]
As described in the embodiment (Description 1), the second image composition apparatus can be used when a read medium having a structure in which the partial thin line image and the partial information image do not overlap is used. Therefore, the pixel projection of the partial information image hardly affects the peak when the partial thin line image is projected onto the X axis or the Y axis. Therefore, after the first partial image is extracted from the storage unit 48 of the first partial image, the partial thin line image of the first partial image is used as a reference in the same manner as the method described in the embodiment (description 4). The first rotation processing unit 52, the first magnification change processing unit 54, and the first parallel movement processing unit 56 perform synthesis processing. In this embodiment, since there is only the first partial image, the processing in the second partial image composition device is not performed. By performing these processes, the first overall image is synthesized.
[0139]
The synthesized first whole image is sent to the image matching judgment unit 46 when there is an image matching judgment unit 46, and sent to the dropout processing unit 44 when there is no image matching judgment unit 46.
[0140]
6). Embodiment of image match determination unit (description 6)
Next, an embodiment of the image coincidence determination units 18 and 46 which are a part of the first and second image composition apparatuses of the present invention will be described with reference to the drawings.
[0141]
The image coincidence determination units 18 and 46 determine that the first whole images synthesized by the first and second image synthesizing apparatuses match.
[0142]
For this determination, a peak obtained by pixel-projecting the first partial images A1 and B1 before synthesis on the Y axis is used instead of the first whole image synthesized by the first translation processing units 36 and 56. This peak is used in the parallel movement process. In the above translation processing, B1 is translated in the Y-axis direction, and the Y coordinate is Y_S4The corresponding partial thin line images were superimposed at the position of. Therefore, the remaining three corresponding partial thin line images may not overlap completely. Conversely, if the remaining three images are completely overlapped, the first entire image shown in FIG. 9C also overlaps at the joint portion of the partial images, and therefore is completely matched. You may judge. Therefore, it is determined whether or not they match by using the remaining three deviations as a reference. In this embodiment, the magnitude of the shift of the corresponding thin line is expressed as (YAi−YBi) (i = 1, 2, 3). For example, the magnitude is less than ± α. If what fits is more than a certain percentage, it can be determined that they match. As specific numerical values, for example, α may be set to 0.2 mm, and a certain ratio may be set to 80%.
[0143]
In this embodiment, since the two partial images are synthesized, there are only three thin lines that serve as the determination criteria at the joint of the partial images. However, when more partial images are combined, the number of joints increases, and accordingly, the number of thin lines that serve as a determination criterion also increases. However, in this case as well, in the same manner as in this embodiment, it is only necessary to calculate the magnitude of deviation for all the corresponding thin lines and determine whether or not they match according to the above-described determination criteria.
[0144]
In this embodiment, since the partial images A1 and B1 are obtained by dividing thin lines parallel to the X axis, the image matching determination is performed using the peak projected on the Y axis. However, when the partial image is obtained by dividing a thin line parallel to the Y axis, the image matching determination may be performed by the same method as described above using the peak of the pixel projected on the X axis.
[0145]
The image match determination units 18 and 46 can obtain a first whole image with high accuracy.
[0146]
Note that the above-described image matching determination method is an example, and any other suitable image matching determination method can be applied to the present invention.
[0147]
7. Embodiment of dropout processing apparatus in second image composition apparatus (Description 7)
Next, an embodiment of a dropout processing device 44 which is a part of the second image composition device of the present invention will be described with reference to the drawings.
[0148]
The dropout processing device 44 has a function of dropping out only the partial thin line image from the first whole image and setting the remaining partial information image as the second whole image.
[0149]
As described in the embodiment (description 5), the first whole image synthesized by the first image synthesis processing device 42 of the second image synthesis device is a synthesis of the first partial image. Includes both fine line images and informational images. However, since the partial thin line image and the partial information image have a structure that does not overlap, when the pixel is projected on the X axis or the Y axis, the image of the thin line 72 and the information 74 is displayed as shown in FIG. Pixel projection peaks do not overlap. Accordingly, the peak of the pixel projection corresponding to the image of the thin line 72 can be eliminated.
[0150]
Specifically, the dropout method will be described. First, the center coordinates in FIG.₁ Consider eliminating the peak that is. Therefore, the X coordinate range of this peak must first be recognized. That is, an X coordinate range where the intensity of the pixel projection is not 0 (X in the range₁ Are included in the X coordinate range of the peak. Thereafter, all pixels in the X coordinate range are erased. If these processes are performed on the peak of the pixel projection corresponding to all the images of the thin lines 72, only the image of the thin lines 72 can be dropped out. As a result, it is possible to obtain a second whole image having only information 74 as shown in FIG.
[0151]
The completed second whole image is stored in the second whole image storage unit 50.
[0152]
The above dropout processing method is an example, and any other suitable dropout processing method can be applied to the present invention.
[0153]
8). Embodiment of image composition method using first image composition apparatus (description 8)
In the above description, the configurations of the first and second image synthesizing apparatuses of the present invention have been described. Here, an embodiment of a method for synthesizing an image using the first image synthesizing apparatus is described on the apparatus. The description will focus on the flow of image processing. FIG. 11 is a flowchart showing an image composition method using the first image composition apparatus.
[0154]
The steps of capturing the first and second partial images of the read medium by the first and second image capturing devices 10 and 12 and storing them in the storage units 20 and 22 of the first and second partial images, respectively, are as follows. Since it explained in the form (Description 2) and the embodiment (Description 3), it is omitted. Also in this embodiment, the first partial images captured by the first image capturing device 10 are two, A1 and B1. Accordingly, there are two second partial images captured by the second image capturing device 12, which are designated as A2 and B2.
[0155]
First, A1 and B1, which are the first partial images, are taken out from the storage unit 20 for the first partial images (S1). The A1 and B1 are respectively rotated by the first rotation processor 28 (S2: details are as described in the embodiment (description 4)). Although not shown, the S2 processing method is stored in the synthesis processing storage unit 27 thereafter. At this time, according to the order of this flowchart, A1 and B1 are once taken out on the microcomputer that performs the subsequent work (S1 process for A1 and B1), and then the rotation process (S2 process) for A1 and B1. However, the present invention is not limited to this, and only A1 is extracted (S1 processing for A1) and rotated (S2 processing for A1), and then B1 is extracted (S1 for B1). Processing) Rotation processing may be performed (S2 processing for B1). Next, the magnification change processing for A1 and B1 is performed by the first magnification change processing unit 32 (S3: details are as described in the embodiment (description 4)). Although not shown, the S3 processing method is stored in the synthesis processing storage unit 27 thereafter. As described above, since the magnification change process is performed by comparing the sizes of the partial images A1 and B1, the rotation process of S2 must be completed for both. Next, the parallel movement process is performed by the first parallel movement processing unit 36 (S4: details are as described in the embodiment (description 4)). Although not shown, the S4 processing method is stored in the synthesis processing storage unit 27 thereafter. As a result, a first overall image that is a combination of A1 and B1 is completed.
[0156]
Next, in this embodiment, the image matching determination unit 18 determines whether or not the first whole images match (S5: details are as described in the embodiment (description 6)). If it is determined that they match, the process proceeds to S6. If it is determined that they do not match, the process returns to S2. That is, the rotation process for A1 and B1 is performed again. At this time, A1 and B1 are not those after processing in S2, S3, and S4, but S2 processing is performed on A1 and B1 that are first extracted from the storage unit 20 of the first partial image in S1. However, if A1 and B1 are processed in S2, S3, and S4 in exactly the same way as the first time, the same result is obtained, and the image matching judgment unit 18 in S5 matches the first whole image again. There is a possibility that it will be judged. Therefore, it is necessary to change the processing conditions described in the embodiment (description 4) to perform the processing more precisely. Therefore, in S2, for example, the rotation angle may be made smaller and the criterion for determining that the rotation angle is parallel to the X axis or the Y axis may be strict. In S3, for example, a method of calculating the average value of the distance between the thin lines in consideration of all pixel projections on the X axis and the Y axis may be used. In S4, for example, it is preferable to change the thin line to be processed in the first time to another thin line. In the present embodiment, the flow returns to the processing of S2 when it is determined that they do not match in S5, but other flows are also conceivable. For example, returning to S4, the thin line to be overlapped may be changed to another thin line, or A1 and B1 may be captured again by the first and second image capturing devices 10 and 12.
[0157]
If it is determined in S5 that they match, the second partial images A2 and B2 are extracted from the second partial image storage unit 22 (S6). For the extracted A2 and B2, the synthesizing process substantially the same as S2 (the S2 processing technique is extracted from the synthesizing process storage unit 27) is performed (S7). Here, the substantially same composition processing is as described in the embodiment (Description 4). Regarding S6 and S7, the order regarding A2 and B2 may be changed as in S1 and S2 described above. Next, A2 and B2 are subjected to the same processing as S3 (the S3 processing technique is extracted from the storage unit 27 of the synthesis processing) (S8). Next, the second entire image is completed by performing the same process as S4 (the S4 processing method is extracted from the storage unit 27 of the synthesis process) (S9). Since the second whole image is an image composed only of information, the apparatus of the present invention cannot determine whether the images match. However, since the same composition processing is performed as the first whole image determined to match the images, the second whole image should theoretically match. Finally, the second whole image is stored in the second whole image storage unit 26 (S10), and the image composition of this embodiment is finished.
[0158]
The above-described image composition method is an example, and any other suitable image composition method can be applied to the present invention. For example, after this, the second entire image may be output on the screen, and a step of determining whether the images match with human eyes may be provided, or a structure in which image data is output by a printer or the like It is also good. In addition, the image composition device may further include a character recognition processing unit that performs character recognition of the synthesized image. In this case, a step of performing character recognition of the second whole image is added.
[0159]
9. Embodiment of image composition method using second image composition device (Description 9)
Next, an embodiment of an image composition method using the second image composition apparatus will be described focusing on the flow of image processing on the apparatus. FIG. 12 is a flowchart showing an image composition method using the second image composition apparatus.
[0160]
Since the steps from S11 to S15 are exactly the same as the steps from S1 to S5 described above, description thereof is omitted. If it is determined in S15 that the first whole images match, the dropout processing unit 44 performs dropout processing of the first whole image (S16: the details are described in the embodiment (description 7)). This completes the second overall image consisting only of the information image. The second whole image is stored in the second whole image storage unit 50 (S17), and the image composition processing of this embodiment is terminated.
[0161]
The above-described image composition method is an example, and any other suitable image composition method can be applied to the present invention. For example, after this, as in the case of the first image composition device, a step of determining whether the second whole image is output on the screen and the images match with human eyes may be provided. Alternatively, the image data may be output by a printer or the like. In addition, the image composition device may further include a character recognition processing unit that performs character recognition of the synthesized image. In this case, a step of performing character recognition of the second whole image is added.
[0162]
【The invention's effect】
As described above in detail, according to the image composition device of the present invention, the first image capturing device that captures at least a partial thin line image, and the image that performs the composition process on the first whole image using the thin lines of the first partial image. Since it is equipped with a composition processing device, even for a large read medium that cannot capture an image at one time, an entire image equivalent to a single read medium image is automatically captured on the software. Can be formed.
[0163]
In addition, since the first image composition device includes the second image capturing device and the second image composition processing device, and the second image composition device includes the dropout processing device, the formed second whole image is a thin line image. Disappears and becomes an image of information only.
[0164]
The obtained second whole image is recognized by the OCR device with a high recognition rate.
[0165]
Furthermore, if an image matching judgment part is provided, it will become a 2nd whole image with higher precision.
[0166]
Further, by using a medium to be read in which fine lines are written with an invisible material, the fine lines are not perceived by human eyes, and the appearance is not impaired.
[Brief description of the drawings]
FIG. 1 is a block diagram showing an embodiment of a first image composition device.
FIG. 2 is a block diagram showing an embodiment of a second image composition device.
FIG. 3 is a diagram showing a concept of capturing a partial image (1).
FIG. 4 is a diagram showing a modification of how to draw a thin line
FIG. 5 is a diagram showing a concept of capturing a partial image (2)
FIG. 6 is a diagram showing a partial image in the first image composition device;
FIG. 7 is a diagram showing rotation processing;
FIG. 8 is a diagram showing magnification change processing;
FIG. 9 is a diagram showing parallel movement processing;
FIG. 10 is a diagram showing dropout processing;
FIG. 11 is a flowchart showing a first image composition method;
FIG. 12 is a flowchart illustrating a second image composition method.
[Explanation of symbols]
14: First image composition processing device
16: Second image composition processing device
42: First image composition processing device
58: Fine wire
60: Outline of read medium
62: Read medium
64: Fine line (changed width between fine lines)
66: Thin line (thick line with different thickness)
68: Read medium
70: Position for recording information
72: Fine wire
74: Information
75a: Partial image A
75b: Partial image B
76: Information
78, 80: Range that can be captured by the first and second image capturing devices
81a: Partial image A 81b: Partial image B
82: Range that can be processed by the image composition processing device
84: X axis
86: Y axis
88: First partial image
90: Fine wire
92: Peak width of pixel projection

Claims (15)

An image in which a partial image obtained by dividing the information taken from one read medium on which information and a plurality of thin lines for verification are divided into a plurality of portions is combined into a single whole image of the information The composition device includes a first image capturing unit, a second image capturing unit, a first image composition processing unit, a second image composition processing unit, and an image match determination unit,
The first image capturing unit captures a partial image including the thin line as a first partial image from a plurality of partial divided regions of the read medium,
The second image capturing unit captures a partial image of the information other than the thin line as a second partial image from the partial divided region,
The first image composition processing unit performs rotation, magnification change, and parallel movement on each of the first partial images using an image including the thin line included in each of the plurality of first partial images. By performing processing, the first overall image is synthesized,
The second image composition processing unit performs composition processing of a second whole image from the second partial image according to a composition processing method substantially the same as the first image composition processing unit,
The image matching determination unit determines whether or not the first entire image matches based on the amount of deviation between thin lines other than the thin lines used in the synthesis process of the first entire image .
An image synthesizing apparatus, wherein the first image capturing unit and the second image capturing unit are configured to maintain the same state except the target of the captured image . The image composition device according to claim 1,
The image synthesizing apparatus, wherein the thin line is written with an invisible material. In the image composition device according to claim 1 or 2,
The image synthesizing apparatus according to claim 1, wherein the first partial image includes only the partial image of the thin line captured from the plurality of partial divided regions of the read medium . In the image composition device according to claim 1 or 2,
The first image capturing unit includes a light source that emits light of a first wavelength absorbed by the thin line and the information constituent material, and a light receiving unit that senses the light of the first wavelength.
The second image capturing unit includes a light source that emits light of a second wavelength absorbed by the information constituent material, and a light receiving unit that senses the light of the second wavelength. . In the image composition device according to any one of claims 1 to 3,
The first image capturing unit includes a light source that emits light having a first wavelength that is absorbed by the constituent material of the thin wire, and a light receiving unit that senses light having the first wavelength.
The second image capturing unit includes a light source that emits light of a second wavelength absorbed by the information constituent material, and a light receiving unit that senses the light of the second wavelength. . In the image composition device according to any one of claims 1 to 3,
The first image capturing unit includes at least a light source that emits light of a first wavelength that is absorbed by the constituent material of the thin line, and a second wavelength that is emitted when the constituent material of the thin line absorbs light of the first wavelength. And a light receiving part that senses the light of
The image synthesizing apparatus, wherein the second image capturing unit includes a light source that emits a third wavelength absorbed by the constituent material of the information, and a light receiving unit that senses light of the third wavelength. Information and a plurality of thin lines and by the end with the image dividing the information is captured from one of the reading medium that is written in a plurality of portions for matching to synthesize the entire image of one of said information The image composition device includes a first image capturing unit, a first image composition processing unit, a dropout processing unit, and an image match determination unit,
The first image capturing unit, a plurality of partial divided regions of the the medium to be read, partial images including the thin line, the partial images of 及 beauty the information, as a first image parts, see write-up, respectively,
The first image synthesizing section, using the image containing the KiHoso line before being included in each of the plurality of the first image parts, for each of the first image parts, rotation, magnification change and translation processing by the applied, have rows synthesis process of the first entire image,
Drop-out processing unit, from the first entire image, only the image parts including the fine line by dropout, the partial image before Kijo paper remaining a second entire image,
The image coincidence determination unit determines whether or not the first entire images are matched based on a shift amount of thin lines other than the thin lines used in the synthesis process of the first entire image. An image composition device. The image composition device according to claim 7,
The image synthesizing apparatus, wherein the thin line is written with an invisible material. The image composition device according to claim 7 or 8,
The image synthesizing apparatus, wherein the first image capturing unit includes a light source that emits light having a wavelength that is absorbed by the thin line and information constituent materials, and a light receiving unit that senses the light having the wavelength. In the image composition device according to any one of claims 1 to 9,
The first image composition processing unit
Of each of the first image parts, so that the portion include any of the fine line in the lateral direction or longitudinal image is parallel to the X-axis or Y-axis, the first rotating unit which rotates the first image parts When,
For each of the first partial images, a first thin line change process is performed to determine a thin line corresponding to the partial image including the thin line, and to change the magnification of the first partial image so that the distance between the thin lines matches. And
An image synthesizing apparatus comprising: a first translation processing unit configured to translate the first partial image so that the corresponding partial images including the thin line overlap at a correct position. The image composition device according to claim 10.
The determination of the corresponding thin line is performed by recognizing and determining the positional relationship based on the number of vertical or horizontal thin lines included in the partial image including the thin line. The image composition device according to claim 10.
When the thin lines for verification having different thicknesses are written on the read medium,
The determination of the corresponding thin line is made based on the thickness of the thin line included in the partial image including the thin line. The image composition device according to claim 10.
When the thin lines for verification with different intervals are written on the read medium,
The determination of the corresponding fine line is made based on a distance between the fine lines included in the partial image including the fine line. In the image synthesis apparatus according to any one of claims 1 to 1 3,
And a character recognition processing unit for recognizing characters of the synthesized image. In the image composition device according to any one of claims 1 to 13,
When the image match determination unit determines that the first entire image does not match, the first image composition processing unit
An image synthesizing apparatus that performs the synthesis process of the first whole image again using a thin line other than the thin line used in the synthesis process of the first whole image.

Images