JP5935376B2 - Copy machine - Google Patents

Description

  The present invention is a series of a method in which a person enters a handwritten image with a writing tool such as a pen or a pencil on a printed matter on which a printed image is formed with toner or ink, and then copies a mixed original in which the printed image and the handwritten image are mixed. The present invention relates to a copying apparatus that can follow the revised copy history even if the revised copy act is repeated.

  According to Patent Literature 1, type image data and handwritten image data are subjected to region separation from image data in which type characters and handwritten characters are mixed, and character recognition processing is performed on each of the characters. There is known a document management support apparatus that can create an index and search based on the index.

  According to Patent Document 2, a handwritten part and an electronic document part are separated from the scanned image data in which the handwritten part and the electronic document part are mixed, and the electronic document part is stored as an original, whereby the handwritten part is obtained from the scanned image data. 2. Description of the Related Art A control device is known that handles scanned image data as an original related document if an electronic document portion excluding the image and the original match.

  According to Patent Literature 3, when a mixed original is scanned by separating the handwritten annotation and the printed text line from the scanned image data in which the handwritten annotation and the printed text line are mixed, and storing the printed text line as an original. A method is known in which a printed text line is compared with an original to determine whether the same original exists, and if the original exists, the scanned image data is printed as a related document with a different version of the original. Yes.

  In addition, as a method for detecting a handwritten image written on a printed material with a writing tool from scanned image data, (1) a method for detecting a handwritten image by taking a difference between the scanned image data and the original image data; Instead, a method is known in which pattern matching is performed between a handwritten image and previously stored character information data of a type, and if the similarity is high, it is determined as a type, and if the similarity is low, it is determined as handwriting.

  In the method (1), since the scanned image data and the original image data are collated, if the original image data is not stored in advance, it is necessary to scan both the scanned image data and the original image data. In addition, high positional accuracy is required when reading a document. In the method (2), it is not necessary to store the original image data, but it is necessary to store the character image data for pattern matching. Depending on the number of characters in the document, the pattern matching process takes time, Furthermore, unless pre-processing is performed, it is difficult to determine data other than characters such as printed ruled lines and frame lines as printed characters.

  On the other hand, in Patent Document 4 and Patent Document 5, it is not necessary to store original image data and character image data in advance, and a print image (toner or ink) is considered in consideration of the degree of shading of multi-value image data. A technique for distinguishing between an image printed in (1) and a handwritten image by a writing instrument is described. According to this technique, the ruled lines and frame lines of the printed material can be distinguished from the printed image, and can be distinguished from the handwritten image. In the scanned image data, the original handwritten image portion can be determined as a print image.

JP 2007-011683 A JP 2011-146852 A Japanese Patent No. 3623200 JP 2011-061473 A JP 2011-070327 A

The problem to be solved by the present invention is that a person enters a handwritten image with a writing instrument such as a pen or pencil on a printed matter on which a printed image is formed with toner or ink, and then the mixed image in which the printed image and the handwritten image are mixed. Even if a series of revision copying operations for copying a manuscript is repeated, the revision history is desired to be traced.
Further, the problem to be solved by the present invention is that it is possible to arrive at the scanned image data of the past history by scanning the document and reprint the target past scanned image data.

  The present invention relates to a scanner unit capable of reading a mixed original in which a handwritten image by a writing tool is written on a printed matter on which a printed image is formed with toner or ink and creating multi-value image data, and the multi-value image read by the scanner unit. The present invention relates to a copying apparatus including an image data storage unit that temporarily or continuously stores data, and a printing unit that prints multi-valued image data stored in the image data storage unit on a recording sheet, and preferably One aspect includes an object image extraction unit, an attribute addition unit, a handwriting attribute determination unit, an identification information determination unit, and a copy history management unit. The object image extraction unit extracts an object image from the multivalued image data. The attribute assigning unit assigns a printed product attribute or a handwritten attribute to each object image, taking into account the degree of shade difference between the plurality of pixels constituting the object image. The handwriting attribute determination unit determines whether at least one handwriting attribute exists. The identification information determination unit determines whether or not the identification information exists in the multi-value image data temporarily stored in the image data storage unit when a handwriting attribute exists. When it is determined that the identification information does not exist, the copy history management unit continuously stores the multi-value image data and handwritten image data including only an object image having a handwriting attribute in the image data storage unit. The image ID and identification information are newly created, the multi-value image data, the handwritten image data, and the identification information are associated with the image ID, and the multi-value image data in which the identification information is embedded in the printing unit Print on recording paper.

Further , in the present invention , when the identification information determination unit determines that the identification information exists in the multi-value image data temporarily stored in the image data storage unit, the copy history management unit The image ID associated with the information is called, and the image data storage unit continuously stores the multi-value image data from which only the identification information is deleted and the handwritten image data including only the object image having the handwriting attribute. The ID is associated with multi-valued image data from which the identification information has been deleted, handwritten image data consisting of only handwritten attribute object images, and newly created identification information, and the newly created identification information is embedded in the printing unit. The multi-value image data is printed on recording paper.

  In a further preferred aspect of the present invention, when the handwriting attribute determination unit determines that the multivalued image data temporarily stored in the image data storage unit does not have a handwriting attribute, the copy history management unit Causes the printing unit to print the multi-value image data as it is on a recording sheet.

  In a further preferred aspect of the invention, the identification information is a date and time when the scanner device created the multi-value image data.

  According to a further preferred aspect of the present invention, the apparatus further includes an operation display unit for providing information related to the copying apparatus to a user of the copying apparatus and receiving an operation instruction from the user. Further, when the identification information determination unit determines that the identification information exists in the multi-value image data temporarily stored in the image data storage unit, the copy history management unit associates the identification information with the identification information. The operation display unit displays a display for causing the user to select multi-valued image data and handwritten image data associated with the image ID, and selects the user from the operation display unit. The multi-valued image data or the handwritten image data is printed out by the printing unit.

A person repeats a series of revisions in which he or she writes a handwritten image on a printed material on which a printed image of toner or ink is formed using a writing instrument such as a pen or pencil, and then copies a mixed original containing the printed image and the handwritten image. But you can follow the revision history.
Furthermore, by scanning a mixed original in which a print image and a handwritten image are mixed, it is possible to arrive at the scan image data of the past history, and it is possible to reprint the target past scan image data.

1 is a diagram showing a configuration of a network system including a copying apparatus according to an embodiment of the present invention. FIG. 2 is a block diagram showing a hardware configuration in a copying apparatus. FIG. 3 is a software block diagram showing a functional configuration of revision history processing in the copying apparatus. It is a figure which shows the external appearance of an operation panel part. It is a flowchart which shows the process at the time of producing a revision copy log | history. 6 is a flowchart illustrating processing when a revised copy history is called and reprinted. It is a figure which shows the specific example when the first handwritten entry is given to the original original with the writing implement, and the primary revised copy is created. It is a figure for demonstrating the specific example when the 2nd handwritten entry is given to the primary revision copy with a writing implement, and the secondary revision copy is produced. It is a figure for demonstrating the specific example when the 3rd handwritten entry is given to a secondary revision copy with a writing implement and the 3rd revision copy is produced. It is a figure which shows the multi-value image data of a primary revised copy. It is a figure which shows the handwritten image data of a primary revised copy. It is a figure which shows the multi-value image data of a secondary revised copy. It is a figure which shows the handwritten image data of a secondary revised copy. It is a figure which shows the multi-value image data of a tertiary revised copy. It is a figure which shows the handwritten image data of a tertiary revised copy.

  The present invention will be described as a plurality of preferred embodiments with reference to FIGS. 1 to 15, but the technical scope of the present invention should be determined by the description of the scope of claims. The description should not be construed as limiting.

  FIG. 1 is a diagram illustrating a configuration of a network system 1000 according to an embodiment. As shown in FIG. 1, a network system 1000 includes an MFP (Multi Function Peripheral) 100, a terminal device 201, a terminal device 202, and a router 60 as a copying apparatus according to an embodiment of the present invention.

  In addition to the copy function, the MFP 100 has a plurality of functions such as a FAX function, a printer function, and a scanner function. The copying apparatus 100 is not limited to an MFP, and may be an apparatus having only a copying function.

  The terminal device 201 and the terminal device 202 are PCs (Personal Computers). MFP 100, terminal device 201, terminal device 202, and router 60 are connected to network 20. The network 20 is, for example, a LAN (Local Area Network).

  The router 60 has a function of connecting the network 20 and the Internet 70. Each of terminal device 201 and terminal device 202 performs data communication with MFP 100 via network 20.

  Note that at least one of the terminal device 201 and the terminal device 202 may not be included in the network system 1000. The terminal device 201 and the terminal device 202 may not be included in the network system 1000.

  Further, the MFP 100 performs data communication with other MFPs 101 using a PSTN (Public Switched Telephone Network) 40. The MFP 101 may be an apparatus having the same configuration and function as the MFP 100.

  FIG. 2 is a block diagram showing a hardware configuration in MFP 100. Note that FIG. 2 also shows a recording medium 50 for explanation. On the recording medium 50, a program 51 to be described later is recorded. That is, the program 51 is recorded on a medium or the like and distributed as a program product. The recording medium 50 is also distributed as a program product. The program 51 includes a program that realizes a copy history management process, which is a feature of the present invention described later, and a functional block diagram of this copy history management process program is shown in FIG.

  As illustrated in FIG. 2, the MFP 100 includes a control unit 110, a RAM (Random Access Memory) 120, a storage unit 122, and a storage medium access unit 130. Control unit 110, RAM 120, storage unit 122, and storage medium access unit 130 are connected to data bus 102.

  The control unit 110 is a CPU (Central Processing Unit). The control unit 110 is not limited to the CPU, and may be another circuit having an arithmetic function.

  The RAM 120 is a volatile memory. The RAM 120 is data-accessed by the control unit 110. The RAM 120 has a function as a work memory that temporarily stores data.

  The storage unit 122 is a nonvolatile memory. The storage unit 122 is, for example, a hard disk drive. The storage unit 122 is not limited to a hard disk drive, and may be another memory (for example, a flash memory) as long as it is a nonvolatile memory. The storage unit 122 is accessed by the control unit 110. The storage unit 122 stores the program 51 and other various data.

  Control unit 110 executes program 51 stored in storage unit 122, and performs various processes, arithmetic processes, and the like for each unit in MFP 100 based on program 51.

  The storage medium access unit 130 has a function of reading the program 51 from the recording medium 50 in which the program 51 is stored in accordance with an instruction from the control unit 110. The program 51 stored in the recording medium 50 is read by the storage medium access unit 130 and stored in the storage unit 122 by an installation process performed by the control unit 110. This installation processing program is stored in the storage unit 122 in advance. The installation process is performed by the control unit 110 based on an installation process program.

  The recording medium 50 is an SD (Secure Digital) memory card. Note that the recording medium 50 is not limited to an SD memory card, and may be another medium capable of recording data in a nonvolatile manner.

  The MFP 100 further includes an operation panel unit 300 as an operation display unit. The operation panel unit 300 is connected to the data bus 102. The operation panel unit 300 includes a display unit 310 and an input unit 320.

FIG. 4 is a diagram illustrating an appearance of the operation panel unit 300. The display unit 310 has a function of displaying characters, images, and the like. The display unit 310 is provided with a display surface for displaying characters, images, and the like. On this display surface, the image data to be copied can be displayed as it is or in a thumbnail format. The display unit 310 is a device that uses an LCD panel (Liquid Crystal Display Panel). Note that the display unit 310 may be a device using a panel of a display method other than the above.

  Further, the display unit 310 has a touch panel on which information can be input when the user directly touches the display surface, and the display unit 310 transmits position information of the user touching the display surface to the control unit 110. Control unit 110 performs predetermined processing based on the received position information. That is, display unit 310 is an interface for the user to operate MFP 100.

  The input unit 320 includes a number button group 322. The number button group 322 includes a plurality of number buttons. Each of the plurality of number buttons included in the number button group 322 is a button for inputting a number when pressed by the user. Input unit 320 further includes a plurality of buttons for operating image forming apparatus 100.

  The input unit 320 transmits to the control unit 110 a button signal corresponding to a button pressed by the user among the plurality of buttons included in the input unit 320. Control unit 110 performs predetermined processing based on the received button signal. That is, input unit 320 is an interface for the user to operate MFP 100.

  Referring again to FIG. 2, MFP 100 further includes a scanner unit 150, a printing unit 160, a communication unit 170, a modem 172, and an NCU 174.

  The scanner unit 150 has a function of acquiring multi-value or binary image data by reading a document. The read multi-value or binary image data is temporarily or continuously stored in the storage unit 122 that controls the function of the image data storage unit. The manuscript is, for example, a recording medium such as paper, and is a printed material in which a printed image is formed with toner or ink, or a mixed manuscript in which a handwritten image with a writing instrument is written on the printed material.

  The printing unit 160 has a function (hereinafter referred to as a printing function) for printing multi-value or binary image data stored in the storage unit 122 and printing it out on a medium such as paper.

  The recording medium in the printing process may be any medium as long as it can form an image, such as paper or an OHP (Over Head Projector) film.

  The communication unit 170 has a function of performing data communication with a device connected to the network 20 using a wired technology or a wireless technology. The wired technology is, for example, technology based on Ethernet (registered trademark). The wired technology is not limited to a technology based on Ethernet (registered trademark), and may be another wired technology.

  The radio technology is a technology based on, for example, IEEE 802.11g. Note that the wireless technology is not limited to the technology based on IEEE 802.11g, and may be another wireless technology.

  The modem 172 has a function of performing communication according to the facsimile standard (hereinafter referred to as facsimile communication). The modem 172 modulates image data to be transmitted in facsimile communication. The modem 172 demodulates image data received from the outside in facsimile communication.

  The NCU 174 is a line termination device connected to the PSTN 40.

  Referring to FIG. 3, copy history management is executed by each software function block of object image extraction unit 401, attribute assignment unit 402, handwriting attribute determination unit 403, identification information determination unit 404, and copy history management unit 405.

  When the mixed original of the print image and the handwritten image is scanned by the scanner unit 150, the multi-value image data is stored in the image data storage unit 122. The object image extraction unit 401 extracts an object image from the stored multi-value image data. The attribute assigning unit 402 assigns a print attribute or a handwriting attribute to the object image in each object image, taking into consideration the degree of shading of a plurality of pixels constituting the object image. The processing performed by the object image extraction unit 401 and the attribute assignment unit 402 is described in detail in Japanese Patent Application Laid-Open No. 2011-61473 (Patent Document 4) and Japanese Patent Application Laid-Open No. 2011-70327 (Patent Document 5). Although detailed description is omitted here, the technical contents described in Patent Documents 4 and 5 are included in the scope of the present invention.

  The handwriting attribute determination unit 403 determines whether or not there is a handwritten image in the multi-valued image data by determining whether or not at least one handwriting attribute exists among the attributes provided by the attribute adding unit 402. . When the handwriting attribute exists in the multivalued image data, the identification information determination unit 404 multivalued image data temporarily stored in the image data storage unit 122 (multiple print image data and handwritten image data are mixed). It is determined whether or not a time stamp as identification information exists in the value image data). Specifically, the time stamp can be the time when the scanner unit 150 reads a document to create multi-value image data or the time when the multi-value image data is stored in the storage unit 122. Is a numerical value determined by one, and can be completely distinguished from other time stamps in the MFP 100.

  When it is determined that there is no time stamp, the copy history management unit 405 causes the image data storage unit 122 to continuously store multi-valued image data and handwritten image data consisting only of handwritten attribute object images. Further, the copy history management unit 405 newly creates an image ID and a time stamp, and associates the multi-value image data, handwritten image data, and time stamp with the image ID. Thereafter, the copy history management unit 405 causes the printing unit 160 to print the multi-value image data in which the created time stamp is embedded. This printed matter is composed only of a printed image unless handwritten entry is made with a writing instrument, and the multi-value image data when this printed matter is scanned again by the scanner unit 150 is composed only of an object image having a printed matter attribute.

  When the identification information determination unit 404 determines that a time stamp exists in the multivalued image data temporarily stored in the image data storage unit 122, the copy history management unit 405 associates the time stamp with the time stamp. Recall image ID. Then, the copy history management unit 405 erases only the time stamp image from the multivalued image data temporarily stored in the image data storage unit 122, and the handwritten image data including only the erased multivalued image data and the handwritten attribute object image. And memorize continuously. In addition, the copy history management unit 405 creates a new time stamp, associates the multi-valued image data with the time stamp erased, handwritten image data, and the newly created time stamp with this image ID, and creates a new time stamp. The multivalued image data in which the time stamp is embedded is printed on the printing unit 160. This printed matter is also composed only of an object image having a printed matter attribute.

  If the handwriting attribute determination unit 403 determines that the multivalued image data temporarily stored in the image data storage unit 122 does not have the handwriting attribute, the copy history management unit 405 stores the temporary storage data. The value image data is printed on the printing unit 160 as it is. This printed matter is also composed only of an object image having a printed matter attribute.

  When the identification information determination unit 404 determines that a time stamp exists in the multivalued image data temporarily stored in the image data storage unit 122, the copy history management unit 405 associates the time stamp with the time stamp. Call the specified image ID. Then, the copy history management unit 405 causes the display unit 310 to display a display for allowing the user to select multi-value image data and handwritten image data associated with the image ID, for example, in a thumbnail format. When the user selects a target multi-value image data or a thumbnail image of handwritten image data from the touch panel of the display unit 310, the copy history management unit 405 sends the selected multi-value image data or handwritten image data to the printing unit 160. Print out.

  Next, referring to FIG. 5 and FIG. 7 to FIG. 15, the user enters a handwritten image with a writing instrument such as a pen or pencil on a printed matter on which a printed image with toner or ink is formed, and then the printed image. A description will be given of the control of the copy history management unit 405 when performing a series of revised copy processing for copying a mixed manuscript in which a handwritten image is mixed.

  FIGS. 7 to 9 show an original document (a), a handwritten entry document (b), and a copy (c) thereof in primary to tertiary revision copies, respectively, and a dark image indicates a printed image using toner or ink. A thin image shows an image handwritten with a writing instrument. In FIGS. 7 to 9, the print images at the upper and lower ends are time stamps. The time stamp includes the processing date / time (scanned date / time) of the nth-order (n> 1) revision copy and the revision order (n). Further, FIG. 10 shows multi-value image data of the primary revised copy, FIG. 11 shows hand-written image data of the primary revised copy, FIG. 12 shows multi-value image data of the secondary revised copy, and FIG. FIG. 14 shows multi-value image data of the third revised copy, and FIG. 15 shows handwritten image data of the third revised copy.

  When the user of MFP 100 starts copying processing in step S0, the document is read by scanner unit 150 in step S1, and multi-value image data is stored in image storage unit 122. In step S <b> 2, the object image extraction unit 401 extracts an object image from the multivalued image data, and the attribute assigning unit 402 determines the degree of contrast of the plurality of pixels constituting the object image with respect to all the extracted object images. As a consideration element, a print attribute or a handwriting attribute is given.

  In step S3, the handwriting attribute determination unit 403 determines whether or not there is at least one handwritten attribute object image, and when there is no handwritten attribute object image ((a) in FIGS. 7 to 9). ), Since the user has not entered anything on the manuscript by hand, the process proceeds to step S10, and the multi-valued image data temporarily stored in the image data storage unit 122 is not subjected to any image processing and is directly printed by the printing unit 160. After that, the multi-valued image data temporarily stored is deleted from the image data storage unit 122. In step S3, when at least one object image having the handwriting attribute exists (FIG. 7 to FIG. 9B), since the user has added handwriting with a writing tool, the process proceeds to step S4. .

  In step S <b> 4, the identification information determination unit 404 analyzes all the object images having the print attribute in the multi-value image data temporarily stored in the image data storage unit 122 and determines whether or not a time stamp exists. If there is no time stamp (FIG. 7B), this is the primary revision copy process, so the process proceeds to step S11, a new image ID is created, and the process proceeds to step S6.

  In step S6, the copy history management unit 405 continuously stores (saves) multi-valued image data (FIG. 10) and handwritten image data (FIG. 11) consisting only of handwritten attribute object images in the image data storage unit 122. Let Then, the process proceeds to step S7, and the time stamp, continuously stored multi-value image data (FIG. 10) and handwritten image data (FIG. 11) are associated with the created image ID. Then, the process proceeds to step S8, and the image data in which the time stamp is embedded in the multi-value image data is printed on the printing unit 160. In this way, a primary revised copy (FIG. 7C) is obtained.

  In step S4, if a time stamp exists (FIG. 8 and FIG. 9B), since the secondary and subsequent revision copy processing has already created the image ID, the process proceeds to step S5. In step S5, the time stamp is analyzed, the image ID associated with the time stamp is identified and called, and the process proceeds to step S6.

  In step S6, the copy history management unit 405 causes the image data storage unit 122 to continuously store (save) the multi-value image data (FIGS. 12 and 14) and the handwritten image data (FIGS. 13 and 15). Then, the process proceeds to step S7, where a time stamp indicating the creation date and time and the revision order of the n-th revised copy (n> 1), the stored multi-value image data (FIGS. 12 and 14), and handwritten image data ( 13 and 15) are associated with the called image ID. Then, the process proceeds to step S8, and the image data in which the time stamp is embedded in the multi-value image data (FIGS. 12 and 14) is printed on the printing unit 160. In this way, an nth revised copy (FIG. 8 and FIG. 9C) is obtained. Through the above processing, a person enters a handwritten image with a writing tool such as a pen or a pencil on a printed matter on which a printed image is formed with toner or ink, and then copies a mixed original in which the printed image and the handwritten image are mixed. Even if the revised copy act is repeated, the revision history can be traced.

  Next, the control of the copy management unit 405 when the revised copy history is called and reprint processing is performed will be described with reference to FIG.

  In step S101, the scanner unit 150 reads the document on which the time stamp is printed, and then in step S102, the presence of the time stamp that is a printed image is detected. In step 110, the user inputs the input unit 320 of the operation panel unit 300. When the time stamp is directly input from the copy management unit 405, the process proceeds to step S103, and the image ID associated with the time stamp is called.

  Then, the process proceeds to step S104, and the copy management unit 405 displays part or all of the multi-value image data and handwritten image data of the 1st to nth revisions in the thumbnail format on the display unit 310 of the operation panel unit 300, The process proceeds to step S105. In step S105, when the user selects the revision order desired to be reprinted from the touch panel of the display unit 310, the process proceeds to step S106, and the copy management unit 405 displays a screen for inquiring whether or not to print on the display unit 310. And wait for input from the user.

  When the user inputs a print instruction from the touch panel of the display unit 310, the process proceeds to step S107, and the copy management unit 405 asks the display unit 310 whether to print multi-value image data or handwritten image data. And wait for input from the user. When the user instructs printing of the multi-value image data from the touch panel of the display unit 310, the copy management unit 405 advances the processing to step S108, and embeds the time stamp of the revision order in the multi-value image data of the target revision order. The multi-value image data is printed on the printing unit 160. In step S107, when the user instructs printing of handwritten image data from the touch panel of the display unit 310, the copy management unit 405 advances the processing to step S108, and causes the printing unit 160 to print the handwritten image data of the target revision order. In the printing of handwritten image data, a time stamp is not given to avoid losing the consistency of the history. Through the above process, by scanning a document with a time stamp attached or inputting a time stamp, it is possible to arrive at the revised image data of the past history and the handwritten image data, and reprint the image data. can do.

  Although the embodiments of the present invention have been described above, any of the embodiments is illustrative and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

100 MFP as a copying machine
DESCRIPTION OF SYMBOLS 122 Image data memory | storage part 150 Scanner part 160 Printing part 300 Operation panel part as operation display part 401 Object image extraction part 402 Attribute provision part 403 Handwritten attribute determination part 404 Identification information determination part 405 Copying history management part

Claims (4)

A scanner unit capable of reading a mixed original in which a handwritten image by a writing tool is written on a printed matter on which a printed image of toner or ink is formed, and creating multi-value image data; and the multi-value image data read by the scanner unit is temporarily stored In a copying apparatus comprising: an image data storage unit that stores the image data continuously or continuously; and a printing unit that prints the multi-value image data stored in the image data storage unit on a recording sheet.
An object image extraction unit for extracting an object image from multi-value image data;
In each object image, an attribute adding unit that gives a print attribute or a handwriting attribute to the object image, taking into account the degree of shading of a plurality of pixels constituting the object image,
A handwriting attribute determination unit that determines whether or not at least one handwriting attribute exists;
An identification information determination unit that determines whether identification information exists in the multi-valued image data temporarily stored in the image data storage unit when a handwriting attribute exists;
When it is determined that the identification information does not exist, the image data storage unit continuously stores the multi-value image data and handwritten image data including only an object image having a handwriting attribute, while the image ID and the identification information Is newly created, and the multi-value image data, the handwritten image data, and the identification information are associated with the image ID, and the multi-value image data in which the identification information is embedded in the printing unit is printed on a recording sheet. A history management unit ,
When the identification information determination unit determines that the identification information exists in the multivalued image data temporarily stored in the image data storage unit, the copy history management unit determines that the image associated with the identification information The ID is called and the image data storage unit continuously stores the multi-value image data from which only the identification information is deleted and the handwritten image data including only the object image having the handwriting attribute, while the image ID includes the identification The multi-valued image data in which the multi-valued image data from which the information is erased, the hand-written image data consisting only of the handwritten attribute object image, and the newly created identification information are associated and the newly created identification information is embedded in the printing unit A copying apparatus characterized in that the image is printed on recording paper . When the handwriting attribute determination unit determines that the multivalued image data temporarily stored in the image data storage unit does not have a handwriting attribute, the copy history management unit stores the multivalued image data in the printing unit. 2. The copying apparatus according to claim 1 , wherein the value image data is directly printed on a recording sheet. The identification information is a date and time at which the scanner device creates the multivalued image data, a copying apparatus according to claim 1 or 2, characterized in that. An operation display unit for providing information related to the copying apparatus to a user of the copying apparatus and receiving an operation instruction from the user,
When the identification information determination unit determines that the identification information exists in the multivalued image data temporarily stored in the image data storage unit, the copy history management unit is associated with the identification information. An image ID is called, and a display for allowing the user to select multi-value image data and handwritten image data associated with the image ID is displayed on the operation display unit, while the operation display unit selects the user. copying apparatus according to any one of claims 1 to 3, multivalued image data or handwritten image data to the print output to the printing unit, characterized in that.