JP4801616B2 - Image processing apparatus, program, and image processing method - Google Patents

Description

  The present invention relates to an image processing apparatus, a program, and an image processing method.

  In recent years, a scanner that reads a document image, a copying machine that prints a document image read by the scanner, a printer or facsimile machine that prints image data input from an external device, or a so-called MFP (Multi Function Peripheral) that combines these functions ) Is used.

  In this type of multifunction device, scanned copies, facsimile originals, and image data input from external devices are stored in an HDD (Hard Disk Drive) and re-outputted or retransmitted as necessary. Some of them have a document box function. According to such a document box function, work efficiency can be greatly improved and paperless can be realized.

  By the way, when proofreading a document in the document box function of the multifunction device, the image data in the HDD is output to paper for document proofreading, and the proofreading contents are added to the paper by hand. Become. In this case, the proofreading contents added on paper are reflected manually on the original image data. Usability differs between information printed on paper and information stored as electronic data. The information written on the paper can be referred to and added and corrected in many places if there are paper and writing tools, with few restrictions on the place of use. However, in the case of electronic data, an electronic device for handling it is necessary. In some cases, a power source may be required, and the place of use may be limited. However, the functions of correction and editing are excellent. However, complex editing may be difficult if you are not familiar with the electronic equipment you are using.

  Therefore, in order to solve such a problem, information to be added or replaced by the user from the contents added to the paper manuscript is reflected in the image data of the reading source, thereby adding information to the image data. A technique that can improve convenience has been proposed (see, for example, Patent Document 1).

  In the technique described in Patent Document 1, image data to be a document is displayed in order to facilitate editing work, and handwriting input is performed on the screen with a stylus pen or the like to perform editing work. More specifically, Patent Document 1 describes a technology that recognizes a command close to a pre-registered edit symbol as a command and allows an additional part to be input by kana-kanji conversion. As described above, according to Patent Document 1, it is possible to work on an edit symbol that has been conventionally used in a paper document by using a display screen of an electronic device.

Japanese Patent No. 3398981

  However, according to the technique described in Patent Document 1, the instruction for editing instruction is limited to some registered instructions. In addition, there is a limitation in designating the edit target area. Here, the problem is how to reflect the content added to the paper document on the electronic file. For example, when a line is drawn in the text of the document, it is necessary to determine whether it is an underline that means highlighting or a strikethrough that means deletion.

  The present invention has been made in view of the above, and improves the convenience of adding or deleting information from a paper document to the original document image information when the original document image information is calibrated on the paper document. An object is to provide an image processing apparatus, a program, and an image processing method.

In order to solve the above-described problems and achieve the object, an image processing apparatus according to a first aspect of the present invention relates to a document on which original document image information and link information indicating a storage position of the original document image information are printed. Document image information generating means for generating document image information, original document information acquiring means for acquiring the original document image information according to the link information of the document image information, and an image defining an image configuration of the original document image information Image content analysis means for analyzing the constituent blocks; retouching information acquisition means for acquiring rewriting information by taking the difference between the original image information and the original original image information; and the position of the rewriting information on the original image information A processing target block selecting unit that selects the image constituent block to be processed based on the image processing block, and the one or more selected processing target block. Click the respective contents of the revision information, and the processing instruction selection means for the revision information to select the processing instruction depending on whether or not to intersect with the image building blocks to be processed, the selected processing instruction And an image processing means for processing the original document image information according to the above.

The invention according to Claim 2, in the image processing apparatus of claim 1, wherein the processing instruction selection means selects the different processing instructions in accordance with feature information of the image included in the revision information.

According to a third aspect of the present invention, in the image processing apparatus according to the first or second aspect , the processing instruction selection unit selects a different processing instruction according to the type of the image constituent block to be processed.

According to a fourth aspect of the present invention, in the image processing apparatus according to any one of the first to third aspects, the processing instruction selection unit deletes the original document image information and displays the original document image information as the processing instruction. Select one of change of method, enlargement / reduction of image of original document image information, and trimming.

According to a fifth aspect of the present invention, there is provided a program for generating document image information for a document on which original document image information and link information indicating a storage position of the original document image information are printed; An original document information acquisition function for acquiring the original document image information in accordance with the link information of the document image information, an image content analysis function for analyzing an image configuration block defining an image configuration of the original document image information, and the document image A rewrite information acquisition function for acquiring rewrite information by taking a difference between the information and the original document image information, and selecting the image configuration block to be processed based on the position of the retouch information on the document image information Processing target block selection function, and the contents of the selected one or more processing target image composition blocks and the additional information, Image processing function for processing the original document image information and processing instruction selection function Preliminary the revision information to select the processing instruction depending on whether or not to intersect with the image building blocks to be processed according to the selected processing instruction And make the computer execute.

According to a sixth aspect of the present invention, in the program according to the fifth aspect , the processing instruction selection function selects a different processing instruction according to image feature information included in the additional information.

According to a seventh aspect of the invention, in the program according to the fifth or sixth aspect , the processing instruction selection function selects a different processing instruction according to the type of the image constituent block to be processed.

According to an eighth aspect of the present invention, in the program according to any one of the fifth to seventh aspects, the processing instruction selection function includes a method of deleting original document image information and a method of displaying original document image information as a processing instruction. Select one of change, enlargement / reduction of the original document image information, and trimming.

According to a ninth aspect of the present invention, there is provided an image processing method for generating document image information for a document on which original document image information and link information indicating a storage position of the original document image information are printed. An original document information acquisition step for acquiring the original document image information according to the link information of the document image information, an image content analysis step for analyzing an image configuration block that defines an image configuration of the original document image information, A retouching information acquisition step of acquiring rewriting information by taking a difference between the original image information and the original original image information, and the image configuration block to be processed based on the position of the rewriting information on the original image information. Processing target block selection step to be selected, and the contents of the selected one or a plurality of selected processing target image blocks and the additional information And a processing instruction selection step of the revision information to select the processing instruction depending on whether or not to intersect with the image building blocks to be processed, the image processing step of processing the original document image information in accordance with the selected processing instruction And including.

According to a tenth aspect of the present invention, in the image processing method according to the ninth aspect , the processing instruction selecting step selects a different processing instruction according to image feature information included in the additional information.

According to an eleventh aspect of the present invention, in the image processing method according to the ninth or tenth aspect , the processing instruction selection step selects a different processing instruction according to the type of the image constituent block to be processed.

According to a twelfth aspect of the present invention, in the image processing method according to any one of the ninth to eleventh aspects, the processing instruction selection step includes deleting the original document image information and displaying the original document image information as a processing instruction. Select one of change of method, enlargement / reduction of image of original document image information, and trimming.

According to the first, fifth , and ninth aspects of the present invention, the additional information acquired by taking the difference between the original image information and the original original image information when the original original image information is calibrated on the paper original, and The contents of one or more image constituent blocks (characters, morphemes, sentences, paragraphs, figures, photographs, etc.) selected based on the position of the additional information on the original image information, and additional writing A processing instruction (“delete”, “highlighted”, “enlarged”, etc.) is selected according to whether the information intersects with the image composition block to be processed, and the original document image information is selected according to the selected processing instruction. By processing, when original document image information is calibrated on a paper document, the user's intention can be reflected in the original document image information by using the information added to the paper document as a command. So, paper original It is possible to improve the information addition or deletion of convenience to the original document image information from an effect that.

In particular, by selecting different processing instructions according to whether or not the retouching information intersects with the image composition block to be processed, it becomes possible to delete the image composition block with a simple operation, and the original document image When the information is calibrated with a paper document, it is possible to easily reflect the original document image information from the paper document and reduce the load when digitizing the content of the document calibration.

Further, according to the inventions according to claims 2 , 6 , and 10 , by selecting different processing instructions according to the image feature information included in the retouching information, it is possible to change the emphasis level of the image constituting block by a simple operation, and When the original is digitized, the image composition block is emphasized according to the added content, and the convenience of adding information to the original original image information is improved.

According to the inventions according to claims 3 , 7 , and 11 , different processing instructions are selected according to the type of image constituent block to be processed, for example, an image constituent block (character, morpheme, sentence, paragraph, By changing the processing of the added lines and circles according to the figure, photograph, etc., line segments are added to the added lines on the figure, and deletion is executed on the added lines on the text, etc. Since different processing instructions can be selected, the convenience of adding and deleting information to the original document image information is improved according to the object to be added.

According to the inventions according to claims 4 , 8 , and 12 , as processing instructions, deletion of original document image information, change of a display method of original document image information, enlargement / reduction of an image of original document image information, trimming are performed. By selecting either one, there is an effect that the convenience of adding and deleting information to the original document image information is improved.

  Exemplary embodiments of an image processing apparatus, a program, and an image processing method according to the present invention are explained in detail below with reference to the accompanying drawings.

  An embodiment of the present invention will be described with reference to FIGS. In this embodiment, as an image processing apparatus, a copy function, a facsimile (FAX) function, a print function, a scanner function, an input image (a document image read by a scanner function, an image input by a printer or a FAX function), etc. This is an example in which a so-called MFP (Multi Function Peripheral) that is a combination of the above is applied.

  FIG. 1 is a block diagram schematically showing a digital multi-function peripheral 1000 according to an embodiment of the present invention. A digital multi-function peripheral 1000 according to the present embodiment includes a finisher 100 that is a post-processing device, a scanner unit 200 that is an image reading device, and a printer unit 300 that is an image printing device.

  The digital multi-function peripheral 1000 according to the present embodiment can select a document box function, a copy function, a printer function, and a facsimile function by sequentially switching with an application switching key of the operation unit 400 (see FIG. 2). It has become. The document box mode is selected when the document box function is selected, the copy mode is selected when the copy function is selected, the printer mode is selected when the printer function is selected, and the facsimile mode is selected when the facsimile mode is selected. Here, an example of the flow of image formation in the copy mode will be described with reference to FIG.

  First, the scanner unit 200 of the digital multi-function peripheral 1000 will be described. The scanner unit 200 generally includes an automatic document feeder (hereinafter referred to as ADF (Auto Document Feeder)) 1 and a reading unit 50.

  A document bundle placed on the document table 2 of the ADF 1 with the image surface of the document facing up, when a print key (not shown) on the operation unit 400 is pressed, starts with the feed roller 3 from the bottom document. The sheet is fed to a predetermined position on the contact glass 6 by the feeding belt 4. The digital multi-function peripheral 1000 has a counting function that counts up the number of documents each time a document is fed to a predetermined position on the contact glass 6.

  A document fed to a predetermined position on the contact glass 6 is read by the reading unit 50 as image data.

  Here, the reading unit 50 will be described in detail. The reading unit 50 includes a contact glass 6 on which an original is placed and an optical scanning system. The optical scanning system includes an exposure lamp 51, which is an illumination means, a first mirror 52, a lens 53, a CCD image sensor 54, and the like. The exposure lamp 51 and the first mirror 52 are fixed on a first carriage (not shown), and the second mirror 55 and the third mirror 56 are fixed on a first carriage (not shown). This optical scanning system is driven by a scanner drive motor M1 (see FIG. 3). The reading unit 50 of this embodiment turns on the exposure lamp 51 when a document is mounted on the contact glass 6, and moves and scans the first carriage and the second carriage, which are traveling bodies, to the right by the scanner drive motor M1. The reading method for reading the original and the reading method for reading the original conveyed by the ADF 1 while the exposure lamp 51 is turned on and the first carriage and the second carriage are stopped can be selected. In a reading method in which the first carriage and the second carriage are moved and scanned in the right direction by the scanner drive motor M1 to read the original, when reading the original image, the first carriage and the second carriage are not changed so that the optical path length does not change. The carriage is mechanically scanned in the sub-scanning direction at a relative speed of 2: 1. The document image is read by the CCD image sensor 54, converted into an electrical signal, and output. An output signal from the CCD image sensor 54 is converted into digital data (image data) by an AD converter.

  The document image information converted into digital data is sent to, for example, the printer unit 300 to output the image information as a print output, or sent to and stored in a storage device (for example, the HDD 1118 shown in FIG. 2). The information is used as information of each scanner unit 200. The document image information darkened in the storage device (for example, HDD 1118 shown in FIG. 2) can be re-outputted in the document box mode. According to such a document box function, work efficiency can be greatly improved and paperless can be realized.

  The document whose image data has been read by the reading unit 50 is discharged by the feeding belt 4 and the discharge roller 5.

  Further, when it is detected by the document set detection 7 that the next document is present on the document table 2, the next document is fed onto the contact glass 6 in the same manner as the previous document.

  The above-described feeding roller 3, feeding belt 4, and discharging roller 5 are each driven by a conveyance motor M2 (see FIG. 3).

  Next, the printer unit 300 of the digital multi-function peripheral 1000 will be described. The printer unit 300 generally includes an image forming station 70, a fixing unit 17, a paper feeding unit 80, and a double-sided paper feeding unit 111.

  The image forming station 70 forms an image by an electrophotographic method, and mainly includes a writing unit 57, a photoconductor 15, a developing unit 19, and a conveyance belt 16 that also functions as a transfer unit.

  The paper feed unit 80 includes a first tray 8, a second tray 9, a third tray 10, a first paper feeder 11, a second paper feeder 12, a third paper feeder 13, and a vertical transport unit 14. ing. The transfer sheets P stacked on the first tray 8, the second tray 9, and the third tray 10 are fed by the first sheet feeder 11, the second sheet feeder 12, and the third sheet feeder 13, respectively. It is conveyed to a position where it abuts on the photoreceptor 15 by the conveyance unit 14.

  The image data read by the reading unit 50 is written on the photoconductor 15 by the laser beam output from the writing unit 57 and passes through the developing unit 19 to form a toner image. The writing unit 57 is composed of a laser output unit 58, an imaging lens 59, and a mirror 60. Inside the laser output unit 58, a polygon mirror (polygon) that rotates at a constant high speed by a laser diode and a motor as a laser light source. Mirror). Although not particularly illustrated, a beam sensor that generates a main scanning synchronization signal is disposed at a position where a laser beam near one end of the photoconductor 15 is irradiated.

  The toner image on the photoconductor 15 is transferred to the transfer paper P conveyed by the conveyance belt 16 at the same speed as the rotation of the photoconductor 15. Thereafter, the transfer paper P that has been transported to the fixing unit 17 and on which the image has been fixed is discharged by the paper discharge unit 18 to the finisher 100 that is a post-processing device.

  The finisher 100 of the post-processing apparatus can guide the transfer paper P conveyed by the paper discharge roller 18a of the paper discharge unit 18 by switching between the normal paper discharge roller 102 direction and the staple processing unit direction. More specifically, the finisher 100 as a post-processing device can discharge the transfer paper P to the normal paper discharge tray 104 side via the transport roller 103 by switching the switching plate 101 upward. By switching the switching plate 101 downward, the transfer paper P can be conveyed to the staple table 108 via the conveying rollers 105 and 107.

  The transfer paper P loaded on the staple table 108 is aligned by the paper jogger 109 each time it is discharged, and is bound by the stapler 106 upon completion of a partial copy. The group of transfer sheets P bound by the stapler 106 is stored in the staple completion discharge tray 110 by its own weight.

  On the other hand, the normal paper discharge tray 104 of the finisher 100 is a paper discharge tray that can move back and forth. The paper discharge tray 104 that can be moved back and forth moves forward and backward for each original document or for each copy section sorted by the image memory, and sorts copy paper that is simply discharged.

  The digital multifunction peripheral 1000 according to the present embodiment can form images on both sides of the transfer paper P. When images are formed on both sides of the transfer paper P, the path of the paper discharge unit 18 is switched without guiding the transfer paper P fed from each of the paper feed trays 8 to 10 to the paper discharge tray 104 side. By setting the branching claw 112 for the upper side to the upper side, the paper is once stocked in the duplex feeding unit 111. Thereafter, the transfer paper P stocked on the double-sided paper feeding unit 111 is re-fed from the double-sided paper feeding unit 111 in a reversed state in order to transfer the toner image formed on the photosensitive member 15 again, The paper is guided to the paper discharge tray 104 via the branching claw 112 set on the side. As described above, the duplex feeding unit 111 is used when images are created on both sides of the transfer sheet P. Further, the front and back sides of the transfer paper P can be changed using the double-sided paper feeding unit 111 when printing on the back surface of the transfer paper P on which an image is placed.

  FIG. 2 is a block diagram illustrating a hardware configuration of the digital multi-function peripheral 1000. As shown in FIG. 2, the digital multi-function peripheral 1000 has a configuration in which a controller 1101, a printer unit 300, and a scanner unit 200 are connected by a PCI (Peripheral Component Interconnect) bus. A controller 1101 is a controller that controls the entire digital multifunction peripheral 1000 and controls drawing, communication, and input from the operation unit 400. The printer unit 300 or the scanner unit 200 includes image processing parts such as error diffusion and gamma conversion.

  The controller 1101 includes a CPU (Central Processing Unit) 1111, a system memory (MEM-P) 1112, a north bridge (NB) 1113, a south bridge (SB) 1114, and an ASIC (Application Specific Integrated). Circuit) 1116, local memory (MEM-C) 1117, and hard disk drive (HDD) 1118, and NB 1113 and ASIC 1116 are connected by an AGP (Accelerated Graphics Port) bus 1115. The MEM-P 1112 further includes a ROM (Read Only Memory) 1112a and a RAM (Random Access Memory) 1112b.

  The CPU 1111 controls the entire digital multi-function peripheral 1000, has a chip set including the NB 1113, the MEM-P 1112, and the SB 1114, and is connected to other devices via the chip set.

  The NB 1113 is a bridge for connecting the CPU 1111, the MEM-P 1112, the SB 1114, and the AGP bus 1115, and includes a memory controller that controls read / write to the MEM-P 1112, a PCI master, and an AGP target.

  The MEM-P 1112 is a system memory used as a memory for storing programs and data, a memory for developing programs and data, a memory for drawing a printer, and the like, and includes a ROM 1112a and a RAM 1112b. The ROM 1112a is a read-only memory used as a memory for storing programs and data for controlling the operation of the CPU 1111. The RAM 1112b is a writable and readable memory used as a program and data development memory, a printer drawing memory, and the like. It is.

  The SB 1114 is a bridge for connecting the NB 1113 to a PCI device and peripheral devices. The SB 1114 is connected to the NB 1113 via a PCI bus, and a network interface (I / F) unit 1104 and the like are also connected to the PCI bus.

  The ASIC 1116 is an IC (Integrated Circuit) for image processing applications having hardware elements for image processing, and has a role of a bridge for connecting the AGP bus 1115, the PCI bus, the HDD 1118, and the MEM-C 1117. The ASIC 1116 includes a PCI target and an AGP master, an arbiter (ARB) that forms the core of the ASIC 1116, a memory controller that controls the MEM-C 1117, and a plurality of DMACs (Direct Memory) that perform rotation of image data by hardware logic and the like. Access Controller) and a PCI unit that performs data transfer between the printer unit 300 and the scanner unit 200 via the PCI bus. The ASIC 1116 is connected to an FCU (Fax Control Unit) 1121, a USB (Universal Serial Bus) 1122, and an IEEE 1394 (the Institute of Electrical and Electronics Engineers 1394) interface 1123 via a PCI bus.

  A MEM-C 1117 is a local memory used as an image buffer for copying and a code buffer, and an HDD 1118 is a storage for storing image data, storing programs for controlling the operation of the CPU 1111, storing font data, and storing forms. It is.

  The AGP bus 1115 is a bus interface for a graphics accelerator card proposed for speeding up graphics processing. The AGP bus 1115 speeds up the graphics accelerator card by directly accessing the MEM-P 1112 with high throughput. .

  Next, an image processing process at the time of selecting a document box function which is a characteristic function realized by the controller 1101 of the digital multi-function peripheral 1000 according to the present embodiment according to a program will be described.

  Here, FIG. 3 is a block diagram showing a functional configuration related to the image processing when the document box function is selected, and FIG. 4 is a flowchart showing the flow of the image processing. As illustrated in FIG. 3, the digital multifunction peripheral 1000 includes a document image information generation unit 21, an original document information acquisition unit 22, an image content analysis unit 23, a writing information acquisition unit 24, according to a program executed by the CPU 1111. A processing target block selection unit 25, a processing instruction selection unit 26, and an image processing unit 27 are realized.

  The document image information generating unit 21 generates document image information based on the document read by operating the scanner unit 200 (step S1 shown in FIG. 4). When the document box function is selected, the document image information generated in this way may be stored in the HDD 1118 or may be used for retouching the document image information stored in the HDD 1118. Here, it is assumed that the document image information has been generated in order to modify the document image information stored in the HDD 1118.

  Here, FIG. 5 shows an example of a document used for rewriting correction of document image information stored in the HDD 1118. As shown in FIG. 5, the document D is entirely formed in a sheet shape, and for example, an A4 size document is used. On these originals D, various original image information stored in the HDD 1118 of the digital multi-function peripheral 1000 is printed in advance by the printer unit 300 in units of one screen. Link information indicating that it is document image information in the HDD 1118 of the machine 1000 is printed in the form of a two-dimensional code C.

  The link information (two-dimensional code C) printed on the document D will be described. The two-dimensional code C indicates that the original image information printed on the original D is the original image information in the HDD 1118 as described above. For example, there are a document name, a page number, a device name, its IP address, etc., and the document has a directory structure such as “¥¥ device name (IP address of device) ¥ drive name ¥ folder name ¥ document name ¥ page”. It is sufficient that the location (information accumulation location) stored (minimum is for one page) can be uniquely identified.

  The code symbol for storing the link information may be a one-dimensional barcode or the like, but it is necessary to classify a wide variety of documents for the document ID, and the number of classifications is insufficient for the one-dimensional barcode or the like. In view of this, it is desirable to use a two-dimensional code C having a remarkably large capacity as in the present embodiment.

  The original document information acquisition unit 22 acquires original document image information (original document image information) from the HDD 1118 according to the link information given to the document image information generated by the document image information generation unit 21 (see FIG. 4). Step S2). More specifically, the original document information obtaining unit 22 obtains link information by decoding the two-dimensional code C given to a predetermined position of the read document image information, and the original document information is obtained according to the obtained link information. Original image information is acquired from the HDD 1118.

  The image content analysis unit 23 analyzes the content of the original document image information acquired by the original document information acquisition unit 22 (step S3 shown in FIG. 4). More specifically, by performing an area extraction process of the original document image information acquired by the original document information acquisition unit 22, the hierarchical structure of the image configuration block that defines the image configuration of the original document image information is obtained. Here, the image configuration block is a character, morpheme, sentence, paragraph, figure, photograph, or the like on the document (document image information) D. The area extraction processing is performed after various image analysis values such as OCR processing for performing optical character recognition on original document image information are executed to calculate various image characteristic values representing image attributes of the document image. The image constituent block is extracted based on the various image characteristic values. FIG. 6 shows an example of extraction of image constituent blocks in the original document image information shown in FIG. Note that the content of the original document image information (image configuration block) may be included in the original document image information as meta information.

  The rewriting information acquisition means 24 takes the difference between the original image information generated by the original image information generation means 21 and the original original image information acquired by the original original information acquisition means 22 and uses this difference as additional information ( Step S4) shown in FIG. The additional information in the present embodiment is a figure represented by “◯” or “×”. Although details will be described later, this figure becomes a command for rewriting correction of the document image information stored in the HDD 1118.

  The processing target block selection unit 25 selects an image configuration block to be processed from among the image configuration blocks analyzed by the image content analysis unit 23 based on the position of the writing information acquired by the writing information acquisition unit 24 on the document image information. Select (step S5 shown in FIG. 4).

The processing instruction selection means 26 includes the contents of one or a plurality of processing target image configuration blocks selected by the processing target block selection means 25 and the retouching information acquired by the retouching information acquisition means 24, and the image configuration blocks. A processing instruction is selected according to the relative position of the writing information and the writing information (step S6 shown in FIG. 4). In the following, the selection of processing instructions according to the contents of the image composition block and the additional information and the relative positions of the image constituent block and the additional information will be described as an example.
(1) The processing instruction selection unit 26 selects a processing instruction according to whether or not the additional information intersects with the region of the image constituent block to be processed. Specifically, the image constituent block on the original document image information is deleted or highlighted depending on whether the added line segment, closed curve, or the like intersects with the image constituent block. When a figure (image configuration block) is drawn on a part of the document, and the figure part and a large amount of additional information intersect, the user can predict that this figure is desired to be operated. In addition, since the range of the corresponding figure can be obtained by the image content analysis means 23, the user can select the target figure accurately without drawing so as to surround the target figure accurately. A range can be selected for a character string in a sentence by surrounding the corresponding character string.
(2) The processing instruction selection unit 26 selects a different processing instruction according to the size (for example, the size of “circle”, the thickness of the line, etc.) that is the feature information of the image included in the writing information. Specifically, the enhancement level of the image of the selected image configuration block is changed according to the size of the added “circle” or the like. As a result, the emphasis level of the image composition block can be changed by a simple operation, and when the paper document is digitized, the image composition block is emphasized according to the added content, and the convenience of adding information to the original document image information is improved. .
(3) The processing instruction selection unit 26 selects different processing instructions according to the multiplicity (superimposition of line segments and superimposition of closed curves) that is the feature information of the image included in the writing information. Specifically, the multiplicity of images is a double circle or the like. Specifically, the enhancement level of the image of the selected image configuration block is changed according to the multiplicity (double circle, triple circle, etc.) of the added “circle” or the like. As a result, the emphasis level of the image composition block can be changed by a simple operation, and when the paper document is digitized, the image composition block is emphasized according to the added content, and the convenience of adding information to the original document image information is improved. .
(4) The processing instruction selection unit 26 determines whether the image constituent block to be processed is a character, a photograph, or a figure, and selects a different processing instruction according to the determination result. For example, by changing the processing of added lines and circles according to the image composition block (characters, morphemes, sentences, paragraphs, figures, photos, etc.) to be processed, line segments will not appear on the added lines on the figure. Since different processing instructions can be selected such that deletion is performed on the added line on the character and deletion is performed, the convenience of adding and deleting information to the original document image information is improved according to the addition target.
(5) The processing instruction selection means 26 deletes the original document image information, changes the display method of the original document image information (font enlargement / reduction, highlighting), and enlarges / reduces the image of the original document image information. Select either reduction or trimming.

  The image processing means 27 processes the original document image information in the HDD 1118 acquired based on the link information in accordance with the processing instruction selected by the processing instruction selection means 26, and stores it as the original in the HDD 1118 (step shown in FIG. 4). S7).

  Here, an example of processing in the processing instruction selection unit 26 and the image processing unit 27 will be described.

  Here, FIG. 7 is a front view showing an example of the writing information, and FIG. 8 is a front view showing the processing result. In the example shown in FIG. 7, for example, when the image configuration block is a character line, when writing in a plain portion between lines (X in FIG. 7), or when drawing a line on the character (in FIG. 7) Y). In these cases, the user's intention is different. The former often emphasizes the vicinity and makes it an index target, while the latter often is a deletion target. Accordingly, the processing instruction selection means 26 selects a processing instruction according to whether or not the additional information intersects with the area of the processing target image constituent block. That is, as indicated by X in FIG. 7, when the retouching information does not intersect the region of the image composition block to be processed, the processing instruction selecting means 26 selects a processing instruction that emphasizes the vicinity of the retouching information. The image processing means 27 highlights the image constituent blocks as indicated by Z in FIG. On the other hand, as indicated by Y in FIG. 7, when the retouching information intersects the region of the image constituent block to be processed, the processing instruction selection means 26 selects the deletion processing instruction, and the image processing means 27 As shown in FIG. 8, the image composition block instructed to be deleted is deleted.

  That is, in the present embodiment, the edit target range can be selected by analyzing on which image configuration block on the original (original image information) D the added locus is located. . In addition, by enclosing a lot of the periphery of the chart or itself, it is possible to feel the intention to select the chart. For this reason, the intention of the processing method of the writing information can be inferred depending on which image configuration block on the original (original image information) D the handwritten additional information passes.

  As described above, according to the present embodiment, the retouching information acquired by obtaining the difference between the original image information and the original original image information when the original original image information is calibrated on the paper original, and the additional information. Content of image processing blocks (characters, morphemes, sentences, paragraphs, figures, photographs, etc.) to be processed and selected based on the position on the original image information, and image configuration blocks; A processing instruction (“delete”, “highlighted”, “enlarged”, etc.) is selected according to the position relative to the writing information, and the original document image information is processed according to the selected processing instruction. As a result, when the original document image information is calibrated on the paper document, the processing instruction is selected according to the relative position between the image configuration block to be processed and the additional information, and the paper document is rewritten. Since the user's intention can be reflected in the original document image information using the information as a command, the convenience of adding or deleting information from the paper document to the original document image information can be improved.

  In the present embodiment, the original document image information in the HDD 1118 provided in the digital multi-function peripheral 1000 is processed. However, the present invention is not limited to this, and the network I / F unit is not limited to the digital multi-function peripheral 1000. Original document image information in a storage unit such as an HDD provided in an external device connected via the 1104, the USB 1122, the IEEE 1394 interface 1123, or the like can be processed.

  The program executed in the digital multi-function peripheral 1000 according to the present embodiment is a file in an installable or executable format, and is a CD-ROM, flexible disk (FD), CD-R, DVD (Digital Versatile Disk). For example, the program may be recorded on a computer-readable recording medium.

  The program executed by the digital multifunction peripheral 1000 according to the present embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Further, the program executed by the digital multi-function peripheral 1000 according to the present embodiment may be provided or distributed via a network such as the Internet.

  Furthermore, in this embodiment, the digital multi-function peripheral 1000 called MFP is applied as the image processing apparatus, but the present invention is not limited to this. For example, a printer device 1202 that is an image printing device and a scanner device 1204 that is an image reading device are connected to a personal computer 1201 via a cable 1203 and a storage device such as an HDD of the personal computer 1201 that is the image processing device (see FIG. By installing a predetermined program in (not shown) and operating a CPU (not shown) of the personal computer 1201 in accordance with this program, the same effects as the various effects described above can be obtained.

1 is a configuration diagram schematically illustrating a digital multifunction peripheral according to an embodiment of the present invention. FIG. 2 is a block diagram illustrating a hardware configuration of a digital multifunction peripheral. FIG. It is a block diagram which shows the function structure concerning an image process. It is a flowchart which shows the flow of an image process. It is a front view which shows an example of the original document used for correction correction of original image information. It is a schematic diagram which shows the example of extraction of an image structure block. It is a front view which shows an example of writing information. It is a front view which shows a process result. 1 is a block diagram illustrating a schematic configuration example of an image processing system.

Explanation of symbols

DESCRIPTION OF SYMBOLS 21 Document image information generation means 22 Original document information acquisition means 23 Image content analysis means 24 Writing information acquisition means 25 Processing object block selection means 26 Processing instruction selection means 27 Image processing means 1000, 1201 Image processing apparatus C Link information D Document

Claims (12)

Document image information generating means for generating document image information for a document on which original document image information and link information indicating a storage position of the original document image information are printed;
Original document information acquisition means for acquiring the original document image information according to the link information of the document image information;
Image content analysis means for analyzing an image configuration block defining an image configuration of the original document image information;
Rewriting information acquisition means for acquiring rewriting information by taking a difference between the original image information and the original original image information;
Processing target block selection means for selecting the image constituent block to be processed based on the position of the writing information on the document image information;
Processing instructions depending on the contents of each of the selected one or more processing target image composition blocks and the additional information, and whether the additional information intersects with the target image processing blocks Processing instruction selection means for selecting,
Image processing means for processing the original document image information in accordance with the selected processing instruction;
An image processing apparatus comprising: The processing instruction selection means selects a different processing instruction according to image feature information included in the retouching information.
The image processing apparatus according to claim 1. The processing instruction selection means selects a different processing instruction according to the type of the image constituent block to be processed.
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The processing instruction selection means selects, as a processing instruction, any one of deletion of original document image information, change of a display method of original document image information, enlargement / reduction of an image of original document image information, and trimming,
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. A document image information generation function for generating document image information for a document on which original document image information and link information indicating the storage position of the original document image information are printed;
An original document information acquisition function for acquiring the original document image information according to the link information of the document image information;
An image content analysis function for analyzing an image configuration block defining an image configuration of the original document image information;
A rewriting information acquisition function for acquiring rewriting information by taking a difference between the original image information and the original original image information;
A processing target block selection function for selecting the image constituent block to be processed based on the position of the writing information on the original image information;
Processing instructions depending on the contents of each of the selected one or more processing target image composition blocks and the additional information, and whether the additional information intersects with the target image processing blocks A processing instruction selection function for selecting
An image processing function for processing the original document image information in accordance with the selected processing instruction;
A program that causes a computer to execute. The processing instruction selection function selects a different processing instruction according to image feature information included in the additional information.
6. The program according to claim 5, wherein: The processing instruction selection function selects a different processing instruction according to the type of the image constituent block to be processed.
The program according to claim 5 or 6, characterized in that: The processing instruction selection function selects, as a processing instruction, any one of deletion of original document image information, change of a display method of original document image information, enlargement / reduction of an image of original document image information, and trimming,
A program according to any one of claims 5 to 7 , characterized in that A document image information generation step of generating document image information for a document on which original document image information and link information indicating a storage position of the original document image information are printed;
An original document information acquisition step of acquiring the original document image information according to the link information of the document image information;
An image content analysis step of analyzing an image configuration block defining an image configuration of the original document image information;
A rewriting information acquisition step of acquiring rewriting information by taking a difference between the original image information and the original original image information;
A processing target block selection step of selecting the image constituent block to be processed based on the position of the writing information on the document image information;
Processing instructions depending on the contents of each of the selected one or more processing target image composition blocks and the additional information, and whether the additional information intersects with the target image processing blocks A process instruction selection process for selecting
An image processing step of processing the original document image information in accordance with the selected processing instruction;
An image processing method comprising: The processing instruction selection step selects a different processing instruction according to image feature information included in the retouching information.
The image processing method according to claim 9. The processing instruction selection step selects a different processing instruction according to the type of the image constituent block to be processed.
The image processing method according to claim 9 or 10, wherein: The processing instruction selection step selects, as a processing instruction, any one of deletion of original document image information, change of a display method of original document image information, enlargement / reduction of an image of original document image information, and trimming,
12. The image processing method according to claim 9, wherein the image processing method is any one of the above.

Images