JP5168084B2 - Image processing apparatus, program, and image processing method - Google Patents

Description

  The present invention relates to an image processing apparatus, a program, and an image processing method.

  In recent years, a scanner that reads a document image, a copying machine that prints a document image read by the scanner, a printer or facsimile machine that prints image data input from an external device, or a so-called MFP (Multi Function Peripheral) that combines these functions ) Is used.

  In this type of multifunction device, scanned copies, facsimile originals, and image data input from external devices are stored in an HDD (Hard Disk Drive) and re-outputted or retransmitted as necessary. Some of them have a document box function. According to such a document box function, work efficiency can be greatly improved and paperless can be realized.

  By the way, when proofreading a document in the document box function of the multifunction device, the image data in the HDD is output to paper for document proofreading, and the proofreading contents are added to the paper by hand. Become. In this case, the proofreading contents added on paper are reflected manually on the original image data. Usability differs between information printed on paper and information stored as electronic data. The information written on the paper can be referred to and added and corrected in many places if there are paper and writing tools, with few restrictions on the place of use. However, in the case of electronic data, an electronic device for handling it is necessary. In some cases, a power source may be required, and the place of use may be limited. However, the functions of correction and editing are excellent. However, complex editing may be difficult if you are not familiar with the electronic equipment you are using.

  Therefore, in order to solve such a problem, information to be added or replaced by the user from the contents added to the paper manuscript is reflected in the image data of the reading source, thereby adding information to the image data. A technique that can improve convenience has been proposed (see, for example, Patent Document 1).

  In the technique described in Patent Document 1, image data to be a document is displayed in order to facilitate editing work, and handwriting input is performed on the screen with a stylus pen or the like to perform editing work. More specifically, Patent Document 1 describes a technology that recognizes a command close to a pre-registered edit symbol as a command and allows an additional part to be input by kana-kanji conversion. As described above, according to Patent Document 1, it is possible to work on an edit symbol that has been conventionally used in a paper document by using a display screen of an electronic device.

Japanese Patent No. 3398981

  However, according to the technique described in Patent Document 1, the instruction for editing instruction is limited to some registered instructions. In addition, there is a limitation in designating the edit target area. Here, the problem is how to reflect the content added to the paper document on the electronic file. For example, when a line is drawn in the text of the document, it is necessary to determine whether it is an underline that means highlighting or a strikethrough that means deletion.

  In addition, when the size of the added paper is larger than a scanner that reads additional information, such as a drawing or a poster, the scanner may not be used. In this case, the process of reading the added information and the process of making the added part correspond to the original image data become complicated.

  The present invention has been made in view of the above, and can improve the convenience of adding or deleting information from a paper original to the original original image when the original original image is calibrated on the paper original. An object is to provide an image processing apparatus, a program, and an image processing method.

The present invention was made in view of the above, the image processing apparatus of the present invention, the coordinate information, the identification information including link information indicating the storage position of the original document image is, the of the said original document image the originals the image printed on the coordinates indicated in the coordinate information, the partial document image acquiring means for acquiring the partial document image including a part of the area containing the identification information, the link information included in the partial original image according, said original said the original document image acquiring means for acquiring the original document image to obtain the coordinate position before the SL original document image according to the coordinate information included in the partial original image, according to the obtained the coordinate position identify the coordinate position corresponding to the partial document image in the document image by taking the difference between the partial document image and the original document image in accordance with the coordinate position, and revision information that is retouched against said original document image The retouched part A revision information acquiring means for acquiring and to coordinate positions, and the block information obtaining means for obtaining image construction block and the coordinate position defining an image structure of the original document image, the retouched portion acquired by the revision information acquiring means Processing target block selecting means for selecting the image constituent block to be processed based on the coordinate position of the image, and the contents of each of the selected one or a plurality of selected processing target block and the added portion, And processing instruction selection means for selecting a processing instruction according to a relative position between the image configuration block and the writing information, and image processing means for processing the original document image according to the selected processing instruction.

Program of the present invention, a computer, and the coordinate information, the identification information including link information indicating the storage position of the original document image, the originals the image printed on the coordinates indicated in the coordinate information of said original document image A partial document image acquisition unit that acquires a partial document image including a partial area including the identification information; and an original document image acquisition unit that acquires the original document image according to the link information included in the partial document image. If a specific coordinate position corresponding to the partial original image in said original document image to get the coordinate position before the SL original document image according to the obtained the coordinate position in accordance with the coordinate information included in the partial original image Categories information, and by taking the difference between the partial document image and the original document image in accordance with the coordinate position, to obtain the coordinate position indicating the revision information and retouched portions that are retouched against said original document image An acquisition unit; an image configuration block that defines an image configuration of the original document image; a block information acquisition unit that acquires a coordinate position thereof; and a processing target based on the coordinate position of the additional portion acquired by the additional information acquisition unit. Processing target block selection means for selecting the image constituent block, the contents of each of the selected image constituent block and the additional portion to be processed, and the image constituent block and the additional information And a processing instruction selection unit that selects a processing instruction according to the relative position of the image processing unit, and an image processing unit that processes the original document image according to the selected processing instruction.

An image processing method according to the present invention is an image processing method executed by an image processing apparatus, and the image processing apparatus includes a control unit and a storage unit, and includes coordinate information and an original document executed by the control unit. identification information including link information indicating the storage location of the image, part document that contains the printed originals image coordinates indicated in the coordinate information of said original document image, a part of the area containing the identification information a partial original image acquiring step of acquiring an image, the in accordance with the link information included in the partial original image, and the original document image acquisition step of acquiring the original document image, in accordance with the coordinate information included in the partial original image get the coordinate position before the SL original document image, identifies the coordinate position corresponding to the partial original image in said original document image according to the obtained the coordinate position, the partial document image in accordance with said coordinate position and said Motohara By obtaining a difference between images, and revision information acquisition step of acquiring a coordinate position indicating the revision information and retouched portions that are retouched against said original document image, the image configuration defining an image structure of the original document image A block information acquisition step for acquiring a block and its coordinate position, a processing target block selection step for selecting the image constituent block to be processed based on the coordinate position of the additional portion acquired by the additional information acquisition means, and a selection A processing instruction for selecting a processing instruction according to the contents of each of the one or more processed image composition blocks and the retouched portion, and the relative positions of the image composition block and the retouching information A selection step; and an image processing step for processing the original document image according to the selected processing instruction. .

  According to the present invention, when the original document image is calibrated on a paper document, only the added part of the paper document is acquired by the digital camera, and the difference between the partial document image and the original document image is obtained. And the image composition blocks (characters, morphemes, sentences, paragraphs, figures, photographs, etc.) to be processed that are selected based on the position of the additional information on the original image. Select processing instructions (“Delete”, “Highlight”, “Enlarge”, etc.) according to the contents and the relative positions of the image composition block and the retouched information, and the original document image according to the selected processing instructions When the original document image is calibrated on a paper document, the processing instruction is selected according to the relative position between the image configuration block to be processed and the additional information, and the paper document is processed. The additional information of Since utilized as command so that it is possible to reflect the intention of the user based on the original image, it is possible to improve the convenience of the information addition or deletion for the original document image from a paper document, an effect that.

  Exemplary embodiments of an image processing apparatus, a program, and an image processing method according to the present invention will be explained below in detail with reference to the accompanying drawings.

(First embodiment)
A first embodiment will be described with reference to FIGS. In this embodiment, as an image processing apparatus, a copy function, a facsimile (FAX) function, a print function, a scanner function, an input image (a document image read by a scanner function, an image input by a printer or a FAX function), etc. This is an example in which a so-called MFP (Multi Function Peripheral) that is a combination of the above is applied.

  FIG. 1 is a block diagram schematically showing a digital multi-function peripheral 1000 according to an embodiment of the present invention. A digital multi-function peripheral 1000 according to the present embodiment includes a finisher 100 that is a post-processing device, a scanner unit 200 that is an image reading device, and a printer unit 300 that is an image printing device.

  The digital multi-function peripheral 1000 according to the present embodiment can select a document box function, a copy function, a printer function, and a facsimile function by sequentially switching with an application switching key of the operation unit 400 (see FIG. 2). It has become. The document box mode is selected when the document box function is selected, the copy mode is selected when the copy function is selected, the printer mode is selected when the printer function is selected, and the facsimile mode is selected when the facsimile mode is selected. Here, an example of the flow of image formation in the copy mode will be described with reference to FIG.

  First, the scanner unit 200 of the digital multi-function peripheral 1000 will be described. The scanner unit 200 generally includes an automatic document feeder (hereinafter referred to as ADF (Auto Document Feeder)) 1 and a reading unit 50.

  A document bundle placed on the document table 2 of the ADF 1 with the image surface of the document facing up, when a print key (not shown) on the operation unit 400 is pressed, starts with the feed roller 3 from the bottom document. The sheet is fed to a predetermined position on the contact glass 6 by the feeding belt 4. The digital multi-function peripheral 1000 has a counting function that counts up the number of documents each time a document is fed to a predetermined position on the contact glass 6.

  A document fed to a predetermined position on the contact glass 6 is read by the reading unit 50 as image data.

  Here, the reading unit 50 will be described in detail. The reading unit 50 includes a contact glass 6 on which an original is placed and an optical scanning system. The optical scanning system includes an exposure lamp 51, which is an illumination means, a first mirror 52, a lens 53, a CCD image sensor 54, and the like. The exposure lamp 51 and the first mirror 52 are fixed on a first carriage (not shown), and the second mirror 55 and the third mirror 56 are fixed on a first carriage (not shown). This optical scanning system is driven by a scanner drive motor M1 (see FIG. 3). The reading unit 50 of this embodiment turns on the exposure lamp 51 when a document is mounted on the contact glass 6, and moves and scans the first carriage and the second carriage, which are traveling bodies, to the right by the scanner drive motor M1. The reading method for reading the original and the reading method for reading the original conveyed by the ADF 1 while the exposure lamp 51 is turned on and the first carriage and the second carriage are stopped can be selected. In a reading method in which the first carriage and the second carriage are moved and scanned in the right direction by the scanner drive motor M1 to read the original, when reading the original image, the first carriage and the second carriage are not changed so that the optical path length does not change. The carriage is mechanically scanned in the sub-scanning direction at a relative speed of 2: 1. The document image is read by the CCD image sensor 54, converted into an electrical signal, and output. An output signal from the CCD image sensor 54 is converted into digital data (image data) by an AD converter.

  When the original image converted into digital data is sent to the printer unit 300 and output as a print output, for example, or sent to a storage device (for example, the HDD 1118 shown in FIG. 2) and stored. Etc., and are used as information of each scanner unit 200. A document image darkened in a storage device (for example, HDD 1118 shown in FIG. 2) can be re-outputted in the document box mode. According to such a document box function, work efficiency can be greatly improved and paperless can be realized.

  The document whose image data has been read by the reading unit 50 is discharged by the feeding belt 4 and the discharge roller 5.

  Further, when it is detected by the document set detection 7 that the next document is present on the document table 2, the next document is fed onto the contact glass 6 in the same manner as the previous document.

  The above-described feeding roller 3, feeding belt 4, and discharging roller 5 are each driven by a conveyance motor M2 (see FIG. 3).

  Next, the printer unit 300 of the digital multi-function peripheral 1000 will be described. The printer unit 300 generally includes an image forming station 70, a fixing unit 17, a paper feeding unit 80, and a double-sided paper feeding unit 111.

  The image forming station 70 forms an image by an electrophotographic method, and mainly includes a writing unit 57, a photoconductor 15, a developing unit 19, and a conveyance belt 16 that also functions as a transfer unit.

  The paper feed unit 80 includes a first tray 8, a second tray 9, a third tray 10, a first paper feeder 11, a second paper feeder 12, a third paper feeder 13, and a vertical transport unit 14. ing. The transfer sheets P stacked on the first tray 8, the second tray 9, and the third tray 10 are fed by the first sheet feeder 11, the second sheet feeder 12, and the third sheet feeder 13, respectively. It is conveyed to a position where it abuts on the photoreceptor 15 by the conveyance unit 14.

  The image data read by the reading unit 50 is written on the photoconductor 15 by the laser beam output from the writing unit 57 and passes through the developing unit 19 to form a toner image. The writing unit 57 is composed of a laser output unit 58, an imaging lens 59, and a mirror 60. Inside the laser output unit 58, a polygon mirror (polygon) that rotates at a constant high speed by a laser diode and a motor as a laser light source. Mirror). Although not particularly illustrated, a beam sensor that generates a main scanning synchronization signal is disposed at a position where a laser beam near one end of the photoconductor 15 is irradiated.

  The toner image on the photoconductor 15 is transferred to the transfer paper P conveyed by the conveyance belt 16 at the same speed as the rotation of the photoconductor 15. Thereafter, the transfer paper P that has been transported to the fixing unit 17 and on which the image has been fixed is discharged by the paper discharge unit 18 to the finisher 100 as a post-processing device.

  The finisher 100 of the post-processing apparatus can guide the transfer paper P conveyed by the paper discharge roller 18a of the paper discharge unit 18 by switching between the normal paper discharge roller 102 direction and the staple processing unit direction. More specifically, the finisher 100 as a post-processing device can discharge the transfer paper P to the normal paper discharge tray 104 side via the transport roller 103 by switching the switching plate 101 upward. By switching the switching plate 101 downward, the transfer paper P can be conveyed to the staple table 108 via the conveying rollers 105 and 107.

  The transfer paper P loaded on the staple table 108 is aligned by the paper jogger 109 each time it is discharged, and is bound by the stapler 106 upon completion of a partial copy. The group of transfer sheets P bound by the stapler 106 is stored in the staple completion discharge tray 110 by its own weight.

  On the other hand, the normal paper discharge tray 104 of the finisher 100 is a paper discharge tray that can move back and forth. The paper discharge tray 104 that can be moved back and forth moves forward and backward for each original document or for each copy section sorted by the image memory, and sorts copy paper that is simply discharged.

  The digital multifunction peripheral 1000 according to the present embodiment can form images on both sides of the transfer paper P. When images are formed on both sides of the transfer paper P, the path of the paper discharge unit 18 is switched without guiding the transfer paper P fed from each of the paper feed trays 8 to 10 to the paper discharge tray 104 side. By setting the branching claw 112 for the upper side to the upper side, the paper is once stocked in the duplex feeding unit 111. Thereafter, the transfer paper P stocked on the double-sided paper feeding unit 111 is re-fed from the double-sided paper feeding unit 111 in a reversed state in order to transfer the toner image formed on the photosensitive member 15 again, The paper is guided to the paper discharge tray 104 via the branching claw 112 set on the side. As described above, the duplex feeding unit 111 is used when images are created on both sides of the transfer sheet P. Further, the front and back sides of the transfer paper P can be changed using the double-sided paper feeding unit 111 when printing on the back surface of the transfer paper P on which an image is placed.

  FIG. 2 is a block diagram illustrating a hardware configuration of the digital multi-function peripheral 1000. As shown in FIG. 2, the digital multi-function peripheral 1000 has a configuration in which a controller 1101, a printer unit 300, and a scanner unit 200 are connected by a PCI (Peripheral Component Interconnect) bus. A controller 1101 is a controller that controls the entire digital multifunction peripheral 1000 and controls drawing, communication, and input from the operation unit 400. The printer unit 300 or the scanner unit 200 includes image processing parts such as error diffusion and gamma conversion.

  The controller 1101 includes a CPU (Central Processing Unit) 1111, a system memory (MEM-P) 1112, a north bridge (NB) 1113, a south bridge (SB) 1114, and an ASIC (Application Specific Integrated). Circuit) 1116, local memory (MEM-C) 1117, and hard disk drive (HDD) 1118, and NB 1113 and ASIC 1116 are connected by an AGP (Accelerated Graphics Port) bus 1115. The MEM-P 1112 further includes a ROM (Read Only Memory) 1112a and a RAM (Random Access Memory) 1112b.

  The CPU 1111 controls the entire digital multi-function peripheral 1000, has a chip set including the NB 1113, the MEM-P 1112, and the SB 1114, and is connected to other devices via the chip set.

  The NB 1113 is a bridge for connecting the CPU 1111, the MEM-P 1112, the SB 1114, and the AGP bus 1115, and includes a memory controller that controls read / write to the MEM-P 1112, a PCI master, and an AGP target.

  The MEM-P 1112 is a system memory used as a memory for storing programs and data, a memory for developing programs and data, a memory for drawing a printer, and the like, and includes a ROM 1112a and a RAM 1112b. The ROM 1112a is a read-only memory used as a memory for storing programs and data for controlling the operation of the CPU 1111. The RAM 1112b is a writable and readable memory used as a program and data development memory, a printer drawing memory, and the like. It is.

  The SB 1114 is a bridge for connecting the NB 1113 to a PCI device and peripheral devices. The SB 1114 is connected to the NB 1113 via a PCI bus, and a network interface (I / F) unit 1104 and the like are also connected to the PCI bus.

  The ASIC 1116 is an IC (Integrated Circuit) for image processing applications having hardware elements for image processing, and has a role of a bridge for connecting the AGP bus 1115, the PCI bus, the HDD 1118, and the MEM-C 1117. The ASIC 1116 includes a PCI target and an AGP master, an arbiter (ARB) that forms the core of the ASIC 1116, a memory controller that controls the MEM-C 1117, and a plurality of DMACs (Direct Memory) that perform rotation of image data by hardware logic and the like. Access Controller) and a PCI unit that performs data transfer between the printer unit 300 and the scanner unit 200 via the PCI bus. The ASIC 1116 is connected to an FCU (Fax Control Unit) 1121, a USB (Universal Serial Bus) 1122, and an IEEE 1394 (the Institute of Electrical and Electronics Engineers 1394) interface 1123 via a PCI bus.

  A MEM-C 1117 is a local memory used as an image buffer for copying and a code buffer, and an HDD 1118 is a storage for storing image data, storing programs for controlling the operation of the CPU 1111, storing font data, and storing forms. It is.

  The AGP bus 1115 is a bus interface for a graphics accelerator card proposed for speeding up graphics processing. The AGP bus 1115 speeds up the graphics accelerator card by directly accessing the MEM-P 1112 with high throughput. .

  Next, an image processing process at the time of selecting a document box function which is a characteristic function realized by the controller 1101 of the digital multi-function peripheral 1000 according to the present embodiment according to a program will be described.

  Here, FIG. 3 is a block diagram showing a functional configuration related to the image processing when the document box function is selected, and FIG. 4 is a flowchart showing the flow of the image processing. As illustrated in FIG. 3, the digital multifunction peripheral 1000 includes a partial original image acquisition unit 21, an original original information acquisition unit 22, a block information acquisition unit 23, a writing information acquisition unit 24, according to a program executed by the CPU 1111. The processing target block selecting unit 26, the processing instruction selecting unit 26, and the image processing unit 27 are realized.

  The partial document image acquisition unit 21 acquires a partial document image from a digital camera (not shown) connected to the USB 1122 (step S1 shown in FIG. 4). The partial document image obtained in this way is used for rewriting correction of the document image stored in the HDD 1118.

  Here, FIG. 5 shows an example of a document used for correction of a document image stored in the HDD 1118 first. As shown in FIG. 5, the document A is entirely formed in a sheet shape, and for example, an A3 size document is used. In the original A, various original images stored in the HDD 1118 of the digital multi-function peripheral 1000 are printed in advance by the printer unit 300 in units of one screen, and as described later, the digital multi-function peripheral 1000 at the time of printing is printed. Identification information including link information indicating a document image in the HDD 1118 and coordinate information indicating coordinates on the document image is printed at a plurality of locations in the form of a two-dimensional code C.

  The identification information (two-dimensional code C) printed on the document A will be described. As described above, the two-dimensional code C includes link information indicating that the document image printed on the document A is a document image in the HDD 1118 and coordinate information specifying the coordinate position in the original document image. Here, as for the link information, information for specifying the same document A is all given to the plurality of two-dimensional codes. On the other hand, regarding the coordinate information, since each two-dimensional code has a different position in the document A, individual coordinate information corresponding to the arrangement location is assigned. The link information represents, for example, a document name, a page number, a device name, its IP address, etc., and “¥¥ device name (device IP address) ¥ drive name ¥ folder name ¥ document name ¥ page” The directory structure as described above may be used as long as it can uniquely specify the location (information storage location) where the document (minimum is one page) is stored. The coordinate information can be expressed by, for example, (100, 200) using an orthogonal coordinate system in which the upper left corner of the original document image is the origin (horizontal, vertical) = (0,0) and the unit is 1 pixel. It is sufficient that the coordinate position in the original document image can be specified by specifying the coordinates of the link information.

  The code symbol for storing the identification information may be a one-dimensional barcode or the like, but it is necessary to classify a wide variety of documents for document ID, and the number of classifications is insufficient for the one-dimensional barcode or the like. In view of this, it is desirable to use a two-dimensional code C having a remarkably large capacity as in the present embodiment.

  Further, as a mode in which the two-dimensional code C is printed on the document A, the two-dimensional code C may be printed scattered on the entire surface of the document A, or may be printed only on the background of the document A as described below. It may be printed only on the foreground such as characters and graphics printed on the original.

  Next, a case where the identification information is used as an identification pattern and printed only on the background of the document will be described. FIGS. 6A to 6C are examples of identification patterns printed on the background of the document A. FIGS. In FIG. 6A, a plurality of two-dimensional codes are printed on the background of the document. The identification information including the link information and the coordinate information is given to these two-dimensional codes as described above. In FIG. 6B, the texture is printed on the background of the document, and in FIG. 6C, the gradation is printed on the background of the document. In each texture and gradation, identification information is embedded in pixels for each predetermined range, and the same link information and individual coordinate information are given to the identification information, as in the case of a two-dimensional code. Has been.

  When the identification pattern is printed only on the background, the characters and symbols can be read more clearly than when the identification information is printed on the entire surface of the document without distinguishing between the character and the background. The readability of the symbol can be improved.

  A case where the identification pattern is printed only on the foreground of the document will be described. Here, the foreground is a character, symbol, figure, ruled line, or the like printed on the background of the document. For example, an identification pattern can be printed on a ruled line in the paper. In the identification pattern printed on the foreground, the same link information and individual coordinate information that differs depending on the arrangement of characters in the document are embedded as in the identification pattern assigned to the background.

  When an identification pattern is printed on the background, it becomes difficult to interpret the characters and symbols if the shape, size, color, etc. of the added letters and symbols are similar to the identification pattern printed on the background. However, especially when the identification pattern is printed only on the ruled lines in the paper, the characters and symbols can be read more accurately than when the identification pattern is printed on the background. Can be further increased.

  Next, FIG. 7 shows an example of a partial image captured by the digital camera, which is the portion of the original A that has been subjected to the correction of writing. As shown in FIG. 7, the document B is a partial document obtained by photographing the lower right portion of the document A with the underline X and the deletion line Y added, by a digital camera. The document B holds the same identification information as the identification information printed on the document A described above.

  The original document information acquisition unit 22 acquires an original document image (original document image) from the HDD 1118 according to the link information given to the identification information included in the partial document image acquired by the partial document image acquisition unit 21 ( Step S2) shown in FIG. More specifically, the original document information acquisition unit 22 acquires link information by decoding the two-dimensional code C given to a predetermined position of the acquired partial document image, and the original document information is obtained according to the acquired link information. Original image is acquired from the HDD 1118.

  The block information acquisition unit 23 acquires the contents of the original document image acquired by the original document information acquisition unit 22 (step S3 shown in FIG. 4). More specifically, the area of the original document image acquired by the original document information acquisition unit 22 is extracted, thereby obtaining a hierarchical structure of image configuration blocks that define the image configuration of the original document image. Here, the image configuration block is a character, a morpheme, a sentence, a paragraph, a figure, a photograph, or the like on an original (original image) D. In addition, coordinate information on the original document image is assigned to each image configuration block. The area extraction processing is performed after various image analysis values such as OCR processing for performing optical character recognition on the original document image are executed to calculate various image characteristic values representing the image attributes of the document image. The image constituent blocks are extracted based on the various image characteristic values. FIG. 8 shows an example of extraction of image constituent blocks in the original document image shown in FIG. Note that the content of the original document image (image configuration block) may be included in the original document image as meta information.

  The rewriting information acquisition means 24 takes the difference between the partial original image acquired by the partial original image acquisition means 21 and the original original image acquired by the original original information acquisition means 22 and uses this difference as additional information (FIG. Step S4) shown in FIG. The additional information in the present embodiment is a figure represented by “◯” or “×”. Although details will be described later, this figure becomes a command for correcting correction of the original image stored in the HDD 1118. More specifically, first, the coordinate information of the original document image is obtained by decoding the two-dimensional code C given to a predetermined position of the obtained partial document image, and the original document is obtained according to the obtained coordinate information. A coordinate position corresponding to the partial document image in the image is specified.

  The processing target block selection unit 26 selects an image configuration block to be processed from among the image configuration blocks acquired by the block information acquisition unit 23 based on the coordinate position of the writing information acquired by the writing information acquisition unit 24 on the original image. Select (step S5 shown in FIG. 4).

The processing instruction selection means 26 includes the contents of one or a plurality of processing target image configuration blocks selected by the processing target block selection means 25 and the retouching information acquired by the retouching information acquisition means 24, and the image configuration blocks. A processing instruction is selected according to the relative position of the writing information and the writing information (step S6 shown in FIG. 4). In the following, the selection of processing instructions according to the contents of the image composition block and the additional information and the relative positions of the image constituent block and the additional information will be described as an example.
(1) The processing instruction selection unit 26 selects a processing instruction according to whether or not the additional information intersects with the region of the image constituent block to be processed. Specifically, the image constituent block on the original document image is deleted or highlighted depending on whether the added line segment, closed curve, or the like intersects with the image constituent block. When a figure (image configuration block) is drawn on a part of the document, and the figure part and a large amount of additional information intersect, the user can predict that this figure is desired to be operated. In addition, since the range of the corresponding figure can be obtained by the image content analysis means 23, the user can select the target figure accurately without drawing so as to surround the target figure accurately. A range can be selected for a character string in a sentence by surrounding the corresponding character string.
(2) The processing instruction selection unit 26 selects a different processing instruction according to the size (for example, the size of “circle”, the thickness of the line, etc.) that is the feature information of the image included in the writing information. Specifically, the enhancement level of the image of the selected image configuration block is changed according to the size of the added “circle” or the like. As a result, the emphasis level of the image composition block can be changed by a simple operation, and when the paper document is digitized, the image composition block is emphasized according to the added content, and the convenience of adding information to the original document image is improved.
(3) The processing instruction selection unit 26 selects different processing instructions according to the multiplicity (superimposition of line segments and superimposition of closed curves) that is the feature information of the image included in the writing information. Specifically, the multiplicity of images is a double circle or the like. Specifically, the enhancement level of the image of the selected image configuration block is changed according to the multiplicity (double circle, triple circle, etc.) of the added “circle” or the like. As a result, the emphasis level of the image composition block can be changed by a simple operation, and when the paper document is digitized, the image composition block is emphasized according to the added content, and the convenience of adding information to the original document image is improved.
(4) The processing instruction selection unit 26 determines whether the image constituent block to be processed is a character, a photograph, or a figure, and selects a different processing instruction according to the determination result. For example, by changing the processing of added lines and circles according to the image composition block (characters, morphemes, sentences, paragraphs, figures, photos, etc.) to be processed, line segments will not appear on the added lines on the figure. Since a different processing instruction can be selected such that deletion is performed on the added line on the character and deletion is performed, the convenience of adding and deleting information to the original document image is improved according to the addition target.
(5) The processing instruction selecting means 26 deletes the original document image, changes the display method of the original document image (font enlargement / reduction, emphasis display), enlargement / reduction of the original document image, and trimming. Choose.

  The image processing means 27 processes the original document image in the HDD 1118 acquired based on the link information in accordance with the processing instruction selected by the processing instruction selection means 26, and stores it as the original in the HDD 1118 (step S7 shown in FIG. 4). ).

  Here, an example of processing in the processing instruction selection unit 26 and the image processing unit 27 will be described.

  Here, FIG. 7 is a front view showing an example of the writing information, and FIG. 9 is a front view showing the processing result. In the example shown in FIG. 9, for example, in the case where the image configuration block is a character line, writing is performed on a plain portion between lines (X in FIG. 7), and a line is drawn on the character (FIG. 7). Y). In these cases, the user's intention is different. The former often emphasizes the vicinity and makes it an index target, while the latter often is a deletion target. Accordingly, the processing instruction selection means 26 selects a processing instruction according to whether or not the additional information intersects with the area of the processing target image constituent block. That is, as indicated by X in FIG. 7, when the retouching information does not intersect the region of the image composition block to be processed, the processing instruction selecting means 26 selects a processing instruction that emphasizes the vicinity of the retouching information. The image processing means 27 highlights the image constituent blocks as indicated by Z in FIG. On the other hand, as indicated by Y in FIG. 7, when the retouching information intersects the region of the image constituent block to be processed, the processing instruction selection means 26 selects the deletion processing instruction, and the image processing means 27 As shown in FIG. 9, the image composition block instructed to be deleted is deleted.

  In other words, in the present embodiment, the edit target range can be selected by analyzing on which image configuration block on the original (original image) A the added locus is located. In addition, by enclosing a lot of the periphery of the chart or itself, it is possible to feel the intention to select the chart. For this reason, the intention of the processing method of the writing information can be estimated depending on which image configuration block on the original (original image) A the handwritten additional information passes.

  As described above, according to the present embodiment, the correction information acquired by taking the difference between the original image and the original image when the original image is calibrated on the paper original, and the original image of the additional information. The contents of one or more image composition blocks (characters, morphemes, sentences, paragraphs, figures, photos, etc.) to be processed selected based on the above position, and the image composition blocks and additional information A processing instruction (“deletion”, “highlighting”, “enlargement”, etc.) is selected according to the relative position, and the original document image is processed according to the selected processing instruction. As a result, when the original document image is calibrated on a paper document, the information to be added to the paper document is selected by selecting a processing instruction according to the relative position between the image configuration block to be processed and the additional information. As a command, the user's intention can be reflected in the original document image, so that the convenience of adding or deleting information from the paper document to the original document image can be improved.

  In the present embodiment, the original document image in the HDD 1118 provided in the digital multi-function peripheral 1000 is processed. However, the present invention is not limited to this, and the network I / F unit 1104 is not limited to this. An original document image in a storage unit such as an HDD provided in an external device connected via the USB 1122, the IEEE 1394 interface 1123, or the like can be processed.

  The program executed in the digital multi-function peripheral 1000 according to the present embodiment is a file in an installable or executable format, and is a CD-ROM, flexible disk (FD), CD-R, DVD (Digital Versatile Disk). For example, the program may be recorded on a computer-readable recording medium.

  The program executed by the digital multifunction peripheral 1000 according to the present embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Further, the program executed by the digital multi-function peripheral 1000 according to the present embodiment may be provided or distributed via a network such as the Internet.

  Furthermore, in this embodiment, the digital multi-function peripheral 1000 called MFP is applied as the image processing apparatus, but the present invention is not limited to this. For example, a printer device 1202 that is an image printing device and a scanner device 1204 that is an image reading device are connected to a personal computer 1201 via a cable 1203 and a storage device such as an HDD of the personal computer 1201 that is the image processing device (see FIG. By installing a predetermined program in (not shown) and operating a CPU (not shown) of the personal computer 1201 in accordance with this program, the same effects as the various effects described above can be obtained.

(Second Embodiment)
FIG. 10 is a block diagram illustrating a functional configuration of the digital multi-function peripheral 2000 according to the second embodiment. In the digital multi-function peripheral 1000 according to the first embodiment, as described with reference to FIG. 3, the digital multi-function peripheral 1000 causes the CPU 1111 to follow the program so that the partial manuscript image acquisition unit 21, the original manuscript information acquisition unit 22, and the like. The block information acquisition unit 23, the additional information acquisition unit 24, the processing target block selection unit 25, the processing instruction selection unit 26, and the image processing unit 27 are realized. On the other hand, the digital multi-function peripheral 2000 according to the present embodiment has a partial document image acquisition unit 21, an original document information acquisition unit 31, a coordinate position acquisition unit 23, a block information acquisition unit 23, and a writing information acquisition unit. 24, processing target block selecting means 25, processing instruction selecting means 26, and image processing means 27, an acquisition result notifying means 32 is also realized.

  Note that the configuration of the digital multifunction peripheral 2000 according to the present embodiment, which includes the finisher 100, the scanner unit 200, and the printer unit 300, is the same as that of FIG. 1 described in the first embodiment, and therefore will be described. Omitted. The hardware configuration of the digital multi-function peripheral 2000 according to the present embodiment is also the same as that of FIG. 2 described in the first embodiment, and a description thereof will be omitted.

  Among the functional configurations shown in FIG. 10, partial document image acquisition means 21, block information acquisition means 23, additional information acquisition means 24, processing target block selection means 25, processing instruction selection means 26, and image processing means 27. Is the same as in the first embodiment, and a description thereof will be omitted.

  The original document information acquisition unit 31 acquires an original document image (original document image) from the HDD 1118 according to the link information given to the identification information included in the partial document image acquired by the partial document image acquisition unit 21 ( Step S2) shown in FIG. When the original document information acquisition unit 31 acquires link information by decoding the two-dimensional code C and acquires an original document image from the HDD 1118 according to the acquired link information, the acquisition result notification unit 32 receives the link information. Send successful information.

  The acquisition result notification unit 32 confirms whether the original document information acquisition unit 31 has acquired the original document image from the HDD 1118 and notifies the acquisition result. More specifically, when the acquisition / acquisition result notifying unit 32 receives information from the original document information acquiring unit 22 that the original document image has been successfully acquired, the acquisition / acquisition result notifying unit 32 displays the acquisition success on the operation screen, for example. On the other hand, when information that succeeds in acquiring the original document image is not received from the original document information acquisition unit 31, an acquisition failure is displayed.

  In this way, by notifying the operation screen of the acquisition result of the original document image, the user can easily confirm the presence or absence of the original document image stored in the HDD 1118. The convenience of adding or deleting information to the image can be improved.

1 is a configuration diagram schematically illustrating a digital multifunction peripheral according to an embodiment of the present invention. FIG. 2 is a block diagram illustrating a hardware configuration of a digital multifunction peripheral. FIG. It is a block diagram which shows the function structure concerning an image process. It is a flowchart which shows the flow of an image process. It is a front view which shows an example of the original document used for correction correction of original image. It is a figure which shows an example of an identification information pattern. It is a figure which shows an example of an identification information pattern. It is a figure which shows an example of an identification information pattern. It is a figure which shows the added partial image. It is a schematic diagram which shows the example of extraction of an image structure block. It is a front view which shows a process result. It is a block diagram which shows the function structure concerning an image process. 1 is a block diagram illustrating a schematic configuration example of an image processing system.

Explanation of symbols

21 partial original image acquisition means 22, 31 original original information acquisition means 23 block information acquisition means 24 additional information acquisition means 25 processing target block selection means 26 processing instruction selection means 27 image processing means 32 acquisition result notification means 100 finisher 1201 personal computer A Document B Partial document C Identification information

Claims (7)

And coordinate information, the identification information including link information indicating the storage position of the original document image, the printed originals image coordinates indicated in the coordinate information of said original document image, a portion including the identification information Partial document image acquisition means for acquiring a partial document image including the area of
Original document image acquisition means for acquiring the original document image according to the link information included in the partial document image;
Said portion obtains a coordinate position before Symbol original document image according to the coordinate information included in the document image, identifies the coordinate position corresponding to the partial original image in said original document image according to the obtained the coordinate position, by obtaining a difference between the partial document image and the original document image in accordance with the coordinate position, and revision information obtaining means for obtaining a coordinate position indicating the revision information and retouched portions that are retouched against said original document image,
An image configuration block that defines an image configuration of the original document image and a block information acquisition unit that acquires a coordinate position thereof;
Processing target block selection means for selecting the image constituent block to be processed based on the coordinate position of the retouched part acquired by the retouching information acquisition means;
Processing for selecting a processing instruction according to the contents of each of the selected image constituent block and the additional portion to be processed and the relative positions of the image constituent block and the additional information. An instruction selection means;
Image processing means for processing the original document image in accordance with the selected processing instruction;
An image processing apparatus comprising: An acquisition result notifying unit for determining whether or not the original document image has been acquired by the original document acquiring unit;
The image processing apparatus according to claim 1, further comprising: The identification information is a two-dimensional code;
The image processing apparatus according to claim 1, wherein: The identification information is an identification pattern given to the background of the document;
The image processing apparatus according to claim 1, wherein: The identification information is an identification pattern given to the foreground of the document;
The image processing apparatus according to claim 1, wherein: Computer
And coordinate information, the identification information including link information indicating the storage position of the original document image, the printed originals image coordinates indicated in the coordinate information of said original document image, a portion including the identification information Partial document image acquisition means for acquiring a partial document image including the area of
Original document image acquisition means for acquiring the original document image according to the link information included in the partial document image;
Said portion obtains a coordinate position before Symbol original document image according to the coordinate information included in the document image, identifies the coordinate position corresponding to the partial original image in said original document image according to the obtained the coordinate position, by obtaining a difference between the partial document image and the original document image in accordance with the coordinate position, and revision information obtaining means for obtaining a coordinate position indicating the revision information and retouched portions that are retouched against said original document image,
An image configuration block that defines an image configuration of the original document image and a block information acquisition unit that acquires a coordinate position thereof;
Processing target block selection means for selecting the image constituent block to be processed based on the coordinate position of the retouched part acquired by the retouching information acquisition means;
Processing for selecting a processing instruction according to the contents of each of the selected image constituent block and the additional portion to be processed and the relative positions of the image constituent block and the additional information. An instruction selection means;
Image processing means for processing the original document image in accordance with the selected processing instruction;
Program to function as. An image processing method executed by an image processing apparatus,
The image processing apparatus includes a control unit and a storage unit,
Executed in the control unit,
And coordinate information, the identification information including link information indicating the storage position of the original document image, the printed originals image coordinates indicated in the coordinate information of said original document image, a portion including the identification information A partial document image acquisition step for acquiring a partial document image including the area of
An original document image acquisition step of acquiring the original document image according to the link information included in the partial document image;
Said portion obtains a coordinate position before Symbol original document image according to the coordinate information included in the document image, identifies the coordinate position corresponding to the partial original image in said original document image according to the obtained the coordinate position, by obtaining a difference between the partial document image and the original document image in accordance with the coordinate position, and revision information acquisition step of acquiring a coordinate position indicating the revision information and retouched portions that are retouched against said original document image,
An image configuration block that defines an image configuration of the original document image and a block information acquisition step of acquiring the coordinate position thereof;
A processing target block selection step of selecting the image constituent block to be processed based on the coordinate position of the retouched part acquired by the retouching information acquisition means;
Processing for selecting a processing instruction according to the contents of each of the selected image constituent block and the additional portion to be processed and the relative positions of the image constituent block and the additional information. An instruction selection step;
An image processing step of processing the original document image in accordance with the selected processing instruction;
An image processing method comprising:

Images