JP2006109142A - Image processing device and method therefor, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing device for performing image processing without spoiling a manuscript by a simple method. <P>SOLUTION: The image processing device includes an image reading means for reading the image of a manuscript, an image storing means for storing image information, and a printing means for printing the image information on a sheet of paper. The image processing device is provided with memory image recognizing means for recognizing to which stored image information the image information, which was read after the stored image information was added as a postscript on a printed sheet of paper, is added as a postscript; an edition instruction recognizing means for separating the added edition instruction information from the image information before the edition instruction by using the read-out added image information, and recognizing the region as an object of the edition instruction and what edition is required thereon by the instruction; and an image edition means for performing the edition, in which the image data located in the recognized regional information is recognized, on the image information stored in the recognized storing means. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to image processing performed in a digital copying machine or the like, and more particularly to an image processing apparatus, an image processing system, and a storage medium.

  Conventionally, several methods for editing and printing an image input by an input device such as a scanner in a digital copying machine or the like have been proposed.

  Mark the area to be edited on the document using a marker pen, etc., input the marked document with a scanner, recognize the marked area, and use the menu for the image in the recognized area. There is one that performs an instructed editing process (color change, painting, clipping, etc.) (see, for example, Patent Document 1).

  However, since the original is marked with a marker pen, the original is made dirty. A method of marking only on a sheet different from the document (for example, refer to Patent Document 2) or a method of performing marking using a coordinate input device such as a digitizer so as not to contaminate the document (for example, Patent Document 3).

  From the point of view of what kind of editing is to be instructed, a method of hand-editing editing instructions with symbols or the like on the marked paper or at a place marked by a digitizer (see, for example, Patent Document 4) or editing There is a method of selecting an instruction by a menu displayed on a console or the like.

  Hereinafter, a conventional image editing method will be described with reference to the drawings. FIG. 10 schematically shows an operation method in the conventional image editing method. In the figure, reference numeral 10010 denotes a digital multi-function peripheral that reads an original, performs image editing processing, and prints; 10020, an operation screen displayed on an operation panel that instructs operation of the digital multi-function peripheral 10010; and 10030, an original to be edited. Reference numeral 10040 denotes a marking sheet for designating an editing target range. Reference numeral 10050 denotes a printing result obtained by reading the original 10030 and the marking sheet 10040 into the digital multi-function peripheral 10010, performing editing processing, and printing.

  Hereinafter, the processing method will be described in time series.

  1) A marking sheet 10040 and a document 10030 are set to be read in this order in a document feeder to be sent to a scanner for reading a document of the digital multifunction peripheral 10010.

  2) Call up an operation screen 10020 for editing on the operation panel of the digital multifunction peripheral 10010. Select what kind of editing to perform on the called operation screen. In this description, it is assumed that “fill” is selected.

  3) When the edit button is selected and the execution button is pressed, the marking sheet 10040 and the original 10030 set in the document feeder are read, and each image is formed.

  4) From the image obtained from the marking sheet 10040, a rectangular area marked as an edit target area is detected. The detection of the rectangular area is performed by approximating a curved line that seems to be each side of the rectangular area of the image image with a horizontal line or a vertical line, and recognizing a portion surrounded by them as a rectangular area.

  5) The filled image is superimposed on a portion corresponding to the rectangular area extracted from the marking sheet 10040 of the original image formed from the original 10030.

6) The print result 10050 is printed by using the print function of the digital multi-function peripheral 10010 for the image image in which the fill image is superimposed on the original image.
Japanese Patent Laid-Open No. 5-211600 Japanese Patent No. 3214510 JP-A-6-113108 JP-A-5-244387

  In the method of directly marking the original document, the original document is soiled by the marking. In the method of marking only by using another paper so as not to stain the original document, the marking paper is overlaid on the original for marking. If the marking paper is misaligned or not transparent, the original There is a problem that marking is difficult, such as it is difficult to confirm.

  In addition, if a device such as a touch panel or digitizer provided on the device is used instead of marking paper, the device will be occupied during the editing instruction, and other users will not be able to use it. Since it is necessary to add hardware for instruction, there is a problem that the cost of the entire apparatus increases.

  In addition, when another area is used to specify only the area on the document and what kind of editing is to be performed, there is a problem that it is difficult to give different editing instructions to individual areas.

  It is an object of the present invention to provide a simple image editing means without polluting an original document and without occupying equipment.

In order to achieve the above object, an image processing apparatus according to claim 1 includes an image reading unit that reads an image of a document, an image storage unit that stores image information formed by the image reading unit and other units, In an image processing apparatus having a printing means for printing image information on paper,
The image information read by the image reading means after the image information stored by the image storage means is additionally written on the paper printed by the printing means is added to any image information stored in the storage means. A stored image identifying unit for identifying whether the image is a recorded image, and separating the added editing instruction information from the image information before the editing instruction from the added image information read by the image reading unit; An editing instruction identifying means for identifying the target area and what kind of editing is instructed there;
An image to be edited by the editing instruction identifying means identifying image data existing in the area information identified by the editing instruction identifying means for the image information stored in the storage means identified by the stored image identifying means. It has an editing means.

  An image processing apparatus according to a second aspect of the present invention is the image processing apparatus according to the first aspect, further comprising a deletion unit that deletes an image stored in the storage unit, and the storage unit performs the editing / printing when the editing / printing is completed. The stored image information is deleted.

  The image processing apparatus according to claim 3 is the image processing apparatus according to claim 1, wherein the printing unit prints a plurality of images stored in the image storage unit on a single sheet, Recognizing that the edit instruction recognizing means is an edit instruction given to an image printed on a single sheet in a multi-faceted manner as an edit instruction for an image stored in a different image storage means. Features.

  An image processing apparatus according to a fourth aspect of the present invention is the image processing apparatus according to the first aspect, further comprising an image storage destination designating unit for designating a location in the previous storage unit for storing image information, wherein The image is read by the reading means and stored in a location specified by the image storage destination specifying means different from the image stored by the image storage means.

  The image processing apparatus according to claim 5 is the image processing apparatus according to claim 1, wherein the image that has been edited is read by the reading unit, and stored in a place different from the image stored by the image storage unit, The image editing history managing means for recognizing as an image editing history is provided, and the image before editing is taken out by the image editing history means.

  The image processing apparatus according to claim 6 is the image processing apparatus according to claim 1, wherein the edit that can be recognized by the editing instruction recognition unit is area designation and enlargement, reduction, movement, trimming, and color change of the designated area. , Masking (filling).

  As described above, according to the present invention, an image processing apparatus can be instructed to edit an image image without staining the original document with a marker or the like.

  In addition, since it is not necessary to connect a device having a special function to the apparatus, and it is not necessary to occupy the apparatus when performing an editing instruction, it is possible to provide an image editing apparatus that is inexpensive and has high operational efficiency.

  In addition, by using paper that has been familiar with editing instructions for many years, we can provide more detailed editing instructions and provide an image editing device that can be used easily even by unfamiliar users. can do. Since editing instructions are directly written on the paper on which the original image is printed, the editing instructions can be given while checking the original, and the editing instructions are given without worrying that the stacked papers will shift because the editing paper is not stacked. be able to.

  Furthermore, it is possible to instruct to perform different editing processes on different editing target areas at a time.

  Examples of the present invention will be described.

  FIG. 1 is a schematic diagram showing the concept of this embodiment.

  In the figure, 1010 is a digital multi-function peripheral having a function of editing and printing an image obtained by scanning a document, 1020 is an original manuscript to be edited by the digital multi-function peripheral 1010, and 1030 is output for editing. The edited edit sheet, 1040 is a written edit sheet in which an edit instruction is written on the edit sheet 1030, and 1050 is an edit result obtained by reading the edited edit sheet 1040 into the digital multifunction peripheral 1010, performing editing, and printing the edited version. It is.

  An image editing operation method will be described with reference to FIG.

  1) Set an original document 1020 to be edited on the scanner of the digital multifunction peripheral 1010.

  2) The digital multi-function peripheral 1010 reads the original as an object to be edited and simultaneously prints the editing sheet 1030.

  3) Mark the place to be edited on the printed editing sheet 1030 and enter a command representing the editing content in the marking. This entry becomes the written edit sheet 1040.

  4) The digital multifunction peripheral 1010 reads the edited edit sheet 1040.

  5) The designated editing is performed on the designated area on the written editing sheet 1040, and the editing result 1050 obtained as a result is printed.

  FIG. 2 is an overall hardware configuration diagram of the digital multifunction peripheral 1010.

  In the figure, a controller unit 2010 is connected to a scanner 2170 that is an image input device and a printer 2180 that is an image output device, while a LAN 2120 and a public line (WAN) 2140. By connecting, image information and device information are input and output.

  A CPU 2020 is a controller that controls the entire system. A RAM 2030 is a system work memory for the CPU 2020 to operate, and is also an image memory for temporarily storing image data. A ROM 2040 is a boot ROM, which stores a system boot program. An HDD 2050 is a hard disk drive that stores system software and image data.

  An operation unit I / F 2070 is an interface unit with the operation unit 2080, and outputs image data to be displayed on the operation unit 2080 to the operation unit 2080. Also, it plays a role of transmitting information input by the system user from the operation unit 2080 to the CPU 2020. A network 2110 is connected to the LAN 2120 to input / output information. A modem 2130 is connected to the public line 2140 and inputs / outputs information. The above devices are arranged on the system bus 2090.

  An image bus I / F 2060 is a bus bridge that connects a system bus 2090 and an image bus 2100 that transfers image data at high speed, and converts a data structure. The image bus 2100 is configured by a PCI bus or IEEE1394. The following devices are arranged on the image bus 2100. A RIP (raster image processor) 2150 expands the PDL code into a bitmap image. A device I / F unit 2160 connects an image input / output device such as a scanner 2170 or a printer 2180 to the controller 2010, and performs synchronous / asynchronous conversion of image data.

  A scanner image processing unit 2190 corrects, processes, and edits input image data. A printer image processing unit 2200 performs printer correction, resolution conversion, and the like on print output image data.

  Next, an image input / output device constituting the digital multifunction peripheral 1010 is shown in FIG. A scanner unit 2170 serving as an image input device illuminates an image on paper as a document, and scans a CCD line sensor (not shown), thereby converting the image into an electrical signal as raster image data. The manuscript paper is set on the tray 3020 of the manuscript feeder 3010, and when the apparatus user gives a reading start instruction from the operation unit 2080, the controller CPU 2020 gives an instruction to the scanner 2170, and the manuscript feeder 3010 feeds manuscript paper one by one. The original image is read.

  The printer unit 2180, which is an image output device, is a part that converts raster image data into an image on paper. The method is an electrophotographic method using a photosensitive drum or a photosensitive belt, and ink is ejected from a micro nozzle array. There is an ink jet method for printing an image directly on paper, but any method may be used. The activation of the printing operation is started by an instruction from the controller CPU 2020. The printer unit 2180 has a plurality of paper feed stages so that different paper sizes or different paper orientations can be selected, and has a paper cassette 3040 corresponding thereto. The paper discharge tray 3030 receives paper that has been printed.

  Next, the configuration of the operation unit 2080 is shown in FIG. The LCD display unit 4010 has a touch panel sheet pasted on the LCD, displays a system operation screen, and transmits the position information to the controller CPU 2020 when a displayed key is pressed. A start key 4020 is used when starting a document image reading operation. At the center of the start key 4020, there is a green and red two-color LED 4030, which indicates whether or not the start key 4020 can be used. The stop key 4040 serves to stop the operation during operation. The ID key 4050 is used when inputting the user ID of the user. A reset key 4060 is used when initializing settings from the operation unit.

  FIG. 5 shows a user interface displayed on the LCD display unit 4010 of the operation unit 2080 in this embodiment. By operating this user interface, the user instructs the processing of this embodiment. The user switches the application using an application switching button 5010 and calls an application interface that implements the present embodiment. Only one of the original manuscript button 5020 and the editing sheet button 5030 is valid and designates whether the document to be scanned is an original manuscript or an editing sheet obtained by copying the original manuscript. A document deletion switch 5040 is specified only when the edit sheet button 5030 is selected, and is specified when deleting data of an original document that has been scanned and stored. When the original document button 5020 is selected, the document deletion switch 5040 is invalid and displayed as a dim display.

  FIG. 6 is a block diagram of software in the present embodiment. In the figure, a control unit 6010 that performs overall control, an HDD 2050, a storage unit 6020 that manages data stored in the RAM 2030, an image editing unit 6030 that edits image data, and an LCD 4010 of the operation unit 2080 are displayed. A user interface unit 6040 for managing a user interface to be performed, an OCR processing unit 6050 for performing OCR processing for extracting a character string portion from image data and converting it to a character code, a reading processing unit 6060 for reading image data using a scanner 2170, and a printer The print processing unit 6070 that prints image data using the 2180 and a communication unit that communicates with the outside using the network 2110 and the modem 2130 are included.

  FIG. 7 is a flowchart showing the processing of this embodiment.

  Hereinafter, processing performed in the present embodiment will be described with reference to this flowchart.

Step S7010:
The user sets a document or edit sheet to be edited on the tray 3020 of the document feeder 3010, and selects the original document button 5020 or the edit sheet button 5030 according to whether the document set on the tray 3020 is an original document or an edit sheet. Then, the start key 4020 of the operation unit 2080 is pressed. When the start key 4020 is pressed, an interrupt from the operation unit 2070 notifies the control unit 6010 that the start key 4020 has been pressed.
The control unit 6010 instructs the reading processing unit 6060 to read, and the reading processing unit moves the scanner 2170 using the device I / F 2160, feeds the document by the document feeder 3010, and reads the document. The reading processing unit 6060 receives the read image image via the image bus I / F 2060, notifies the control unit 6010 that the reading process has been completed, and sends the read image data to the control unit 6010.

Step S7020:
The control unit 6010 uses the user interface unit 6040 to know whether the user has selected the original document button 5020 or the edit sheet button 5030. If the original document button 5020 is selected, the process proceeds to step S7030. If the edit sheet button 5030 is selected, the process proceeds to step S7060.

Step S7030:
The image read in step S7010 is requested to the storage unit 6020 and stored in the HDD 2050. A document identification number consisting of a date number and a sequential number that is initialized every day and a page number (which indicates the number of image data scanned in the scan job) is assigned to the image of the read document. Is done. For example, the number 253121200050025 is assigned to the 25th page of the fifth read document on December 12, 2003. The storage location in the HDD 2050 of the document identification number and the document image is stored in the HDD 2050 as a set.

Step S7040:
The control unit 6010 takes out the image image stored in the HDD 2050 by the storage unit 6020. The document identification number is rendered using the minimum size font that can be recognized by the OCR processing unit 6050 on the image image that has been instructed and taken out by the image processing unit 6030. The place to render is at the top left of the document, just below the printable area that the printer 2180 can print.

Step S7050:
The editing sheet image generated in step S 7040 is printed by the printer 2180 by instructing the print processing unit 6070. The edit sheet image is rendered by the RIP 2150, subjected to image conversion by the printer image processing 2200, and sent from the device I / F 2160 to the printer 2160 for printing. When printing is completed, the generated editing sheet image is deleted.

Step S7060:
The image read in step S7010 is requested to the storage unit 6020 and temporarily stored in the RAM 2030.

Step S7070:
For the sake of simplicity, the image stored in step S7030 is referred to as OI (original image), and the image stored in step S7060 is referred to as EI (edited image).

  The editing target area, editing type, and document identification number given to the EI are extracted.

  The document identification number should be at the upper left of the image as shown in step S7040. This portion is subjected to OSR processing by the OCR processing unit 6050 to obtain a document identification number. If acquisition fails, there is a possibility that the document is placed in the wrong direction when it is placed on the tray 3020 in step S7010, or a document that is not an edit sheet may be placed. Displayed on the LCD 4010 of the operation unit 2080 using the unit 6040 and the processing is stopped.

  When the difference for each pixel of EI and OI is calculated, the image added by the user and the document identification number added to the EI remain. Delete the image of the part where the document identification number existed from the difference. Depending on the accuracy of the document feeder 3010 of the scanner 2170, correction of the EI may be necessary due to skew or distortion. Also, noise is added to the EI when printing or reading the EI, but the noise is reduced by applying a filter. The image generated in this way is called SI (difference image).

  The edit command is expressed by a plurality of rectangles, character strings, and arrows. Therefore, the OCR processing unit 6050 extracts rectangles, arrows, and character strings from the SI.

  FIG. 8 summarizes the designation method used when an editing instruction is given. Enlargement is expressed by the original area, the enlarging area surrounding it, and an outward arrow. Reduction is expressed by an original area, a reduced area included in the original area, and an inward arrow. The movement is expressed by an arrow indicating the original area and the movement destination, and the area designated so that the root of the arrow moves to the tip of the arrow moves in parallel. Trimming is expressed by two rectangles in which one of them completely encloses one, and the image data of the portion corresponding to the inside of the outer rectangle outside the inner rectangle is erased. The color change is expressed by a rectangle indicating the target area, the character string “Iro” inside it and the name of the color that follows it, and the color of the pixel for which significant color information in the specified surface area is set Is changed to the specified color information. If no color is specified, it is recognized that black is specified. Filling is expressed by a rectangle indicating the target area, a character string "Nuri" inside it, and the name of the color that follows it. Color information for all the pixels in the specified area is set. Is done. If the color name is not specified, it is processed as if black was specified.

  The editing command designated by the user is recognized from the rectangle, arrow, and character string extracted by the OCR processing unit 6050, and a command list is created. In the command list, a command type and necessary information different for each command type are set. For example, in enlargement, information on the original rectangular area and the edited rectangular area is set in the list.

Step S7080:
Edit the OI based on the command list. Editing is performed in the image editing unit 6030.

Step S7090:
The image edited in step S7080 is instructed to the print processing unit 6070 to be printed by the printer 2180. The edited image is rendered by the RIP 2150, subjected to image conversion by the printer image processing 2200, and sent from the device I / F 2160 to the printer 2160 for printing. When printing is completed, the generated edited image is deleted.

Step S7100:
The user interface unit 6040 checks whether the document deletion switch 5040 is set. If set, the process advances to step S7110.

Step S7110:
The original document image data stored together with the document identification number recognized in step S7070 is deleted from the HDD 2050 by the storage unit 6020.

  With the configuration described above, it is possible to edit an image with a simple operation.

  In this embodiment, the document identification number for identifying the edit sheet is printed using a character string. However, the document identification number is printed using a one-dimensional barcode or a two-dimensional barcode, and is scanned with a scanner. Can be recognized as a document identification number.

  In this embodiment, an edit sheet is generated by outputting a one-page original image per leaf. However, as shown in FIG. 9, multi-page assignment is performed to assign a plurality of pages per leaf, and the edit sheet is output. In addition, the number of sheets output as an edit sheet can be reduced.

  In this case, it is necessary to add information indicating how many documents are printed per leaf to the document identification number.

  Further, in this embodiment, the edited image is printed as it is, but the operation unit 2080 is used for the user whether to print before reading the editing sheet, or where to store it when not printing. It is also possible to configure to store in a location instructed by the user and designated by the user.

  Furthermore, in this embodiment, the document image that has been edited and printed is deleted. However, the document image and the edited image are stored in the HDD 2050 by the storage unit 6020, thereby leaving an editing history. It is possible to output an image before editing.

System conceptual diagram of the embodiment Hardware diagram of digital multifunction device Image input / output device configuration diagram of a digital multifunction device Configuration diagram of the operation unit of a digital multifunction device The figure which shows the operation section indication of the digital compound machine Software configuration diagram of the embodiment Processing flowchart of the embodiment Diagram showing a list of editing instructions Figure showing a multi-sheet editing sheet System conceptual diagram of a conventional example

Explanation of symbols

1010 Digital MFP 1020 Original Document 1030 Edit Sheet 1040 Edited Edit Sheet 1050 Edit Result 2080 Operation Unit 2170 Scanner 2180 Printer

Claims (8)

In an image processing apparatus having an image reading means for reading an image of a document, an image storage means for storing image information formed by the image reading means or other means, and a printing means for printing image information on paper,
The image information read by the image reading means after the image information stored by the image storage means is additionally written on the paper printed by the printing means is added to any image information stored in the storage means. A stored image identifying unit for identifying whether the image is a recorded image, and separating the added editing instruction information from the image information before the editing instruction from the added image information read by the image reading unit; An editing instruction identifying means for identifying the target area and what kind of editing is instructed there;
An image to be edited by the editing instruction identifying means identifying image data existing in the area information identified by the editing instruction identifying means for the image information stored in the storage means identified by the stored image identifying means. An image processing apparatus comprising an editing unit. Deleting means for deleting the image stored by the storage means;
The image processing apparatus according to claim 1, wherein the image information that is the object of editing stored in the storage unit when editing and printing are completed is deleted.   The printing means prints a plurality of images stored in the image storage means on a single sheet in a multifaceted manner, and the editing instruction recognition means prints the images on a single sheet in a multifaceted manner. The image processing apparatus according to claim 1, wherein an editing instruction given to the image is recognized as an editing instruction for an image stored in the different image storage unit.   It has an image storage destination designating unit for designating a place in the previous term storage unit for storing image information, and the edited image is read by the reading unit and is different from the image stored by the image storing unit The image processing apparatus according to claim 1, wherein the image processing apparatus is stored in a location designated by the image storage destination designation unit.   An image editing history management unit that reads an image that has been edited by the reading unit, stores the image at a location different from the image stored by the image storage unit, and recognizes the edited image as an image editing history; The image processing apparatus according to claim 1, wherein an image before editing is taken out by the means.   2. The image processing according to claim 1, wherein the editing that can be recognized by the editing instruction recognition unit is area designation and enlargement, reduction, movement, trimming, color change, and masking (filling) of the designated area. apparatus. In an image processing method for reading an image of a document, storing the read image information, and printing the image information on paper,
Identify the stored image information for which the image information read from the recorded image information added on the printed paper is identified, and the read editing instructions are added Separating the added editing instruction information from the image information before the editing instruction, identifying the area to be edited and what kind of editing is instructed there,
An image processing method characterized by performing identified editing on image data existing in identified area information with respect to identified stored image information.   A storage medium storing software for realizing the image processing method according to claim 7.