JP2017063332A - Image formation apparatus and image formation method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To correct position relation between two images through simple work while letting a user view a composite image before printing when an image formation apparatus puts together the two images at least one of which is read by a document read part.SOLUTION: An image formation apparatus 1 comprises an original platen where an original is placed, an original read part for reading an image of the original, and a display part. It is determined that at least one of a first image and a second image is an image read by the original read part, and the mounted original is an original on which one image is based when the one image is read or an original on which the image read later is based when both images are read. The image formation apparatus 1 comprises: a composition processing part 10a which puts together the first image and second image and makes the display part display the composite image with the mounted original left on the original platen as it is, and a re-composition processing part 10b which corrects the position relation between the first image and second image and performs composition again with the mounted original left on the original platen, and makes the display part display the re-composed image.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image forming apparatus and an image forming method.

  An image forming apparatus such as a copying machine or a multifunction peripheral (MFP) is configured to optically read and print an image of a document placed on a document table. There has also been proposed a technique in which such a document table is constituted by a light-transmitting liquid crystal panel and a character image input by a user or a scanned image is displayed on the liquid crystal panel (see, for example, Patent Document 1). Patent Document 1 also discloses a technique for printing a combined image by placing and scanning an original with an image such as the character displayed on the liquid crystal panel.

JP 7-84233 A

  However, when trying to obtain a composite image using the technique described in Patent Document 1, if the image to be composited is scanned and the print result as the composite result is not satisfactory, a series of operations need to be performed again, which is inconvenient. It is.

  The present invention has been made in view of the above-described actual situation, and an object of the present invention is to combine with a user before printing when combining two images at least one of which is read by the document reading unit in the image forming apparatus. The purpose is to allow the positional relationship between two images to be corrected by a simple operation while visually recognizing the images.

  In order to solve the above-described problems, a first technical means of the present invention is an image forming apparatus including a document table on which a document is placed, a document reading unit that reads an image of the document, and a display unit. An apparatus, wherein at least one of the first image and the second image is an image read by the document reading unit from a document placed on the document table, and (I) the first image or the second image When one of the images is read by the original reading unit, the original from which the one image is read is determined as (II) both the first image and the second image are read from the original. If the original from which the image read later is read is a placed original, the first image is placed on the original table with the placed original placed on the original table. And a synthesis processing unit that synthesizes the second image and displays the second image on the display unit, When a change in the placement position of the placed original is detected, recomposition is performed by correcting the positional relationship between the first image and the second image and performing recombination, and displaying the recombined image on the display unit. And a processing unit.

According to a second technical means, in the first technical means, the recombination processing unit causes the original reading unit to re-read the previous placement document in which the change of the previous placement position is detected, The image after rereading is used for the recombination.
According to a third technical means, in the first technical means, the recombination processing unit corrects the positional relationship by the amount corresponding to the change in the placement position and performs the recombination.

  According to a fourth technical means, there is provided an image forming apparatus including a document table on which a document is placed, a document reading unit that reads an image of the document, a display unit, and an operation unit. And at least one of the second images is an image read by the document reading unit from the document placed on the document table, the first image and the second image are combined and displayed on the display unit. A recombining unit that corrects the positional relationship between the first image and the second image according to a user operation received by the operation unit, recombines, and displays the recombined image on the display unit. And a processing unit.

According to a fifth technical means, in any one of the first to fourth technical means, the composition processing unit specifies an area in which a character is placed in one of the first image and the second image. In the case of a character arrangement image, character recognition processing is performed on the other image of the first image and the second image, and the other image is combined with the region of the character arrangement image. .
In a sixth technical means, in any one of the first to fourth technical means, the composition processing unit specifies an area in which a character is placed in one of the first image and the second image. In the case of a character arrangement image, character recognition processing is performed on both the first image and the second image, the upper and lower sides of the character are determined, and the upper and lower sides of the character arrangement image are aligned with each other. The other image of the first image and the second image is synthesized.
A seventh technical means is the technical means according to any one of the first to fourth technical means, wherein the composition processing unit performs character recognition processing on both the first image and the second image, The first image and the second image are synthesized so that the upper and lower sides are determined and the upper and lower sides are aligned.

According to an eighth technical means, in any one of the first to seventh technical means, when one of the first image and the second image is not an image read by the document reading unit, One image is an image received from the outside or an image stored in advance in the image forming apparatus.
According to a ninth technical means, in any one of the first to eighth technical means, the display unit includes a light-transmitting display panel provided on the document table.
A tenth technical means according to any one of the first to ninth technical means includes an operation unit, and the display unit includes a display panel provided in the operation unit.

  An eleventh technical means is an image forming method in an image forming apparatus including a document table on which a document is placed, a document reading unit that reads an image of the document, and a display unit. And at least one of the second images is an image read by the document reading unit from the document placed on the document table, and (I) one of the first image and the second image is the document. When read by the reading unit, the original from which the one image is read is (II) when both the first image and the second image are read by the original reading unit. If the original from which the image read later is read is a placed original, the composition processing unit places the first image and the first in a state where the above-described original is placed on the original table. Combining two images and displaying them on the display unit; When the processing unit detects a change in the placement position of the placed document, the processing unit re-synthesizes the positional relationship between the first image and the second image, and the re-synthesized image is displayed on the display. And a step of displaying on the part.

  A twelfth technical means is an image forming method in an image forming apparatus comprising a document table on which a document is placed, a document reading unit that reads an image of the document, a display unit, and an operation unit. When at least one of the first image and the second image is an image read by the document reading unit from the document placed on the document table, the synthesis processing unit is configured to display the first image and the second image. And re-synthesizing the positional relationship between the first image and the second image according to a user operation received by the operation unit, And displaying the recombined image on the display unit.

  According to the present invention, in the image forming apparatus, when two images obtained by reading at least one of them with the document reading unit are combined, the positional relationship between the two images can be determined by a simple operation while allowing the user to visually recognize the combined image before printing. You can fix it.

1 is a block diagram illustrating a configuration example of an image forming apparatus according to a first embodiment of the present invention. FIG. 2 is a diagram illustrating an example of a document to be read by the image forming apparatus in FIG. 1. FIG. 6 is a diagram illustrating another example of a document to be read by the image forming apparatus in FIG. 1. 2B is a diagram illustrating an example of a state of a document table when the document of FIG. 2B is read after the document of FIG. 2A is read by the image forming apparatus of FIG. 2B is a diagram illustrating another example of the state of the document table when the document of FIG. 2B is read after the document of FIG. 2A is read by the image forming apparatus of FIG. FIG. 2D is a diagram illustrating an example of a state where the document of FIG. 2B is moved on the document table of FIG. 2C. FIG. 2 is a flowchart for explaining an example of an image composition printing process in the image forming apparatus of FIG. 1. FIG. 4 is a flowchart for explaining an example of a condition determination process in the image composition printing process of FIG. 3. FIG. 10 is a flowchart for explaining an example of an image composition printing process in an image forming apparatus according to a second embodiment of the present invention. FIG. 10 is a flowchart for explaining an example of an image composition printing process in an image forming apparatus according to a third embodiment of the present invention. FIG. 10 is a flowchart for explaining an example of an image composition printing process in an image forming apparatus according to a fourth embodiment of the present invention. FIG. 10 is a flowchart for explaining an example of an image composition printing process in an image forming apparatus according to a fifth embodiment of the present invention.

  The image forming apparatus according to the present invention is an apparatus such as a copying machine or a multifunction peripheral (MFP) having a document table and a printing unit. The MFP is a device having a plurality of functions such as a document reading function, a copy function, a print function, and a facsimile (FAX) function. Hereinafter, various embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
A first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a block diagram illustrating a configuration example of an image forming apparatus according to the present embodiment. 2A and 2B are diagrams showing examples of originals to be read by the image forming apparatus in FIG. 1, and FIG. 2C is an example of reading the original in FIG. 2B after reading the original in FIG. 2A in the image forming apparatus in FIG. FIG. 2D is a diagram showing an example of the state of the original platen when reading the original of FIG. 2B after reading the original of FIG. 2A in the image forming apparatus of FIG. 2E is a diagram illustrating an example of a state where the document of FIG. 2B is moved on the document table of FIG. 2C.

  The image forming apparatus 1 according to the present embodiment includes a control unit 10 that controls the whole, and includes an image input unit 11, an operation unit 12, a document table side display panel 13, and a printing unit 14. In this example, it is assumed that the control unit 10 includes an image processing unit that performs image processing on image data to be printed. This image processing includes processing for converting the image data input from the image input unit 11 into a format that is not printable by the printing unit 14.

  For example, the control unit 10 stores a control program (firmware) for controlling the entire image forming apparatus 1 in the program storage area, and performs various controls by operating the control program. For example, the control unit 10 includes a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), a RAM (Random Access Memory) as a work area, and a control device such as a storage device that stores the control program and various settings. It can also be mounted as an integrated circuit (IC) / IC chipset. Examples of the storage device include a flash ROM (Read Only Memory), an EEPROM (Electrically Erasable and Programmable ROM), an HDD (Hard Disk Drive), etc., and a storage unit (not shown) such as an HDD for storing images. Can also be used. Further, the image processing unit can be separated from the control unit 10 and mounted as an ASIC (Application Specific Integrated Circuit) or the like.

  The image input unit 11 is a part for inputting image data, and this image data may be either monochrome or color. The image input unit 11 may include at least a document reading unit, but may include a communication unit, an external memory connection unit, and the like. Thus, it is preferable that the image input unit 11 is configured to be able to input image data from a plurality of acquisition routes.

  The document reading unit is provided on a lower surface of a document table on which a document (paper) to be read is placed, optically reads an image of the document (document image on the paper) placed on the document table, This is a part for passing to the image processing unit and is also called a scanner unit. However, the document reading unit is not limited to a scan type having a line sensor (line scan camera) generally provided in the MFP, and may be a camera that captures a two-dimensional image from below the document table. Good. Furthermore, a line sensor and a camera can be provided side by side, and the camera can be used as an auxiliary. The image forming apparatus 1 can also be provided with an ADF (Auto Document Feeder) on the document table. The ADF is a device for automatically transporting a document, and an image of the automatically transported document is read by a document reading unit. Of course, a separate document reading unit may be provided in the ADF.

  The communication unit is a wired network interface for communicating with a computer such as an external PC (Personal Computer) or a server device. Examples of the server device include a server device using FTP (File Transfer Protocol) and a protocol derived therefrom. Moreover, as a communication part, the radio | wireless communication part which performs short-distance wireless communication with a mobile phone (including what is called a smart phone) can also be employ | adopted, for example. By providing such a communication unit, the image forming apparatus 1 can receive a print job from a PC or a mobile phone, or can access a server device to acquire a file to be printed.

  The external memory connection unit is a connection interface for connecting an external memory such as a universal serial bus (USB: registered trademark, hereinafter the same) memory or an SD (registered trademark) card to the image forming apparatus 1. The image forming apparatus 1 can obtain a file (electronic data) stored in the external memory for printing by providing the external memory connection unit.

  The operation unit 12 is a part for accepting an operation input from a user. In FIG. 1, an example having a key operation unit 12a and a touch panel unit 12b is given. The user can input setting values and the like and execute processing when using the image forming apparatus 1 from the operation unit 12.

  The key operation unit 12a is a hardware key for accepting a user operation, and includes, for example, a power key, a power saving key, and a transition key to the home screen, but is not limited thereto, and a start key for starting copying Other keys such as a numeric key group for inputting numbers and a cross key for moving up, down, left and right may be provided.

  The touch panel unit 12b includes a display panel such as a liquid crystal panel or an organic electroluminescence panel, and a touch sensor unit that detects a touch operation on a display area of the display panel by a user. Examples of the sensor provided as the touch sensor unit include a capacitance type sensor and a resistance film type sensor. A UI (User Interface) image (not shown) is displayed on the display panel, and when a touch is detected with respect to the displayed UI image by the touch sensor unit, an image in the UI image corresponding to the touch position is indicated. The processing is executed, and the UI image is changed as necessary. Of course, the touch panel unit 12b may be configured only by a display panel. In that case, an operation input may be received only from the key operation unit 12a.

  The document table side display panel 13 is a display panel provided on the document table. The document table side display panel 13 is mounted so as to be embedded in the document table glass, and is required to have light transmittance for reading a document image by the document reading unit. Examples of such a display panel include various types such as an edge light type transmissive liquid crystal panel, a transmissive organic electroluminescence display panel, and a transparent electrode is used. These display panels can be controlled to be transparent (or substantially transparent) when not displayed, and do not hinder reading of a document image.

  The printing unit (image forming unit) 14 is a part that prints image data to be printed on a recording medium such as paper (printing paper) and outputs it. Usually, after image processing is performed by the image processing unit. Image data is input, and the image indicated by the image data is printed on paper in color or monochrome. Of course, the printing unit 14 may be configured to allow only monochrome printing. Examples of the printing method in the printing unit 14 include, but are not limited to, an electrophotographic method and an inkjet method. Examples of the image data include document image data read by the document reading unit, image data received via the communication unit and the external memory connection unit, or image data stored in the storage unit in the image forming apparatus 1. It is done. In addition, the image forming apparatus 1 is also provided with an output unit such as a paper discharge tray for discharging and placing printed sheets (outputs) from the printing unit 14.

  As a main feature of this embodiment, the image forming apparatus 1 includes a composition processing unit 10a and a recomposition processing unit 10b. The composition processing unit 10a and the recomposition processing unit 10b are included in the image processing unit. Here, an example included in the control unit 10 will be described.

  The composition processing unit 10a composes the first image and the second image and displays them on the document table side display panel 13 in a state where the placed document is placed on the document table (as it is at the time of reading). For example, if the original 21 shown in FIG. 2A is the original from which the first image is read, and the original 22 shown in FIG. 2B is the original from which the second image is read, as illustrated in FIG. 2C, An image obtained by synthesizing the second image 24 is displayed on the platen side display panel 13. In order to obtain the combined display state as shown in FIG. 2C, the user reads the document 21 with the document reading unit, thereby viewing the first image 23 displayed on the document table display panel 13 while viewing the document 22. What is necessary is just to mount in the area | region where the 1st image 23 on a platen is not displayed.

  In this example, the first image 23 is displayed close to the corner of the document table side display panel 13 and does not depend on the placement position of the document 22 (however, other than the display area of the first image 23). The images (upper left in terms of the original) are combined so that they are in the corners. However, what rules may be used to arbitrarily display the first image 23 and the second image 24 may be determined. For example, the second image 24 may be synthesized so as to match the position where the document 22 is placed (if the document 21 is A4, the position within the A4 size viewing display area adjacent to the document 21). . In that case, the second image 24 is synthesized and displayed near the lower right (or lower left) of the center of the first image 23. As another example, the example of FIG. 2D will be described. In this example, the first image 23 is displayed near the right side so that the corner of the platen side display panel 13 is opened (and an area of the same A4 size as the size of the first image 23 is secured). The original 22 is placed as a reference (placed outside the display area of the first image 23), and the upper right image (upper left in terms of the original surface) of the original 22 is combined so that the upper right image of the first image 23 is located. .

  Here, an example is given in which both the first image 23 and the second image 24 are read by the document reading unit, but at least one of the first image and the second image is placed on the document table. Any image read from the original by the original reading unit of the image input unit 11 may be used. That is, the composition processing unit 10a reads and acquires the first image and / or the second image from the document placed on the document table by the document reading unit.

  Further, the above-described placed original is (I) an original from which one of the first image and the second image is read by the original reading unit, and (II) ) When both the first image and the second image are read by the original reading unit, the original is the original from which the image read later is read.

  When one of the first image and the second image is not an image read by the document reading unit, the one image is stored in advance in an image received from the outside or in the image forming apparatus 1. Images. This image may be a character image. An image received from the outside is, for example, an image indicated by a print target file (document file or image file) read from an external memory connected to the external memory connection unit, or a print target file received via the communication unit. Refers to images.

  The recombination processing unit 10b corrects the positional relationship between the first image and the second image when a change in the placement position of the placed document (that is, movement of the document on the document table) is detected. Recombining is performed, and the recombined image is displayed on the platen side display panel 13. The correction of the positional relationship corresponds to the alignment of the second image with respect to the first image or the alignment of the first image with respect to the second image.

  In particular, in the present embodiment, the recombination processing unit 10b causes the original reading unit to re-read the placed original in which the change of the placement position is detected, and the image after the re-reading is used for the re-composition. Use. The position of one corner of the document (reference position) and the position of the corner on the diagonal line (end position) are detected at the time of reading by the composition processing unit 10a, and the recombination processing unit 10b performs a periodic check at the document reading unit. By executing the reading, it is possible to detect that the placement position has been changed when the reference position and the end position are shifted. Alternatively, the size of the document may be detected at the time of reading by the composition processing unit 10a, and the document reading unit may perform rereading according to the size at the time of processing by the recomposition processing unit 10b.

  As an example of recombination from the state of FIG. 2C, when the user moves the document 22 as illustrated in FIG. 2E, the result of re-reading results in a shift width in the horizontal direction (X direction) and vertical direction (Y direction). The composition position of the second image 24 on the first image 23 is shifted from the corner by the amount corresponding to the second image 24a.

  In the image forming apparatus 1 having the above-described configuration, when two images, at least one of which is read by the document reading unit, are combined, a combined image is displayed to the user in a state where the document to be printed is placed on the document table. The positional relationship between the two images can be corrected and recombined with a simple operation while being visually recognized.

  The first image and the second image used for composition and recombination may be those obtained by performing thinning or interpolation as necessary from the read image according to the display resolution of the document table display panel 13. In addition, the first image and the second image used for composition and recombination may be different from the resolution transmitted to the printing unit 14 after recombination, or of course, different from the print resolution to be printed. May be. Further, when a camera is provided as an auxiliary, the second image may be acquired by the camera that does not take time to acquire, and reading by the line sensor may be executed at the stage of executing printing.

  Next, a processing example in the image forming apparatus 1 will be described with reference to the flowchart of FIG. Here, an example of a process of combining and printing two images in the image forming apparatus 1 (referred to as an image combination printing process) will be described. This image composition printing process is executed based on an instruction from the operation unit 12 by the user, for example. Of course, the image forming apparatus 1 is configured to be capable of normal printing without such composition. Further, in the flowchart of FIG. 3 and flowcharts in other embodiments described later, even if the second image is an image obtained by reading a document and the first image is an image obtained by reading a document, Although it is assumed that the image is an image read later, processing can be performed in other scenes by appropriately changing the processing procedure.

  First, the composition processing unit 10a determines whether or not the first image exists (step S1). If the first image does not exist, the user designates the target file from the operation unit 12 (or causes the original to be read). Thus, the first image data indicating the first image is acquired (step S2). After the process in step S2 and in the case of YES in step S1, the composition processing unit 10a displays the first image on the platen side display panel 13 (step S3).

  Next, the composition processing unit 10a causes the document reading unit to read the image of the document serving as the reading source of the second image, and receives the read data (second image data) (step S4). At this time, the user may instruct the image forming apparatus 1 to read by placing a document as a reading source of the second image on the document table and pressing a reading execution button or the like.

  Next, the composition processing unit 10a calculates the reference coordinates and end coordinates of the effective image (which becomes the second image) from the second image data (step S5), and ends the first image data from the reference coordinates of the second image data. A second image that is an image up to the coordinates is synthesized (step S6). In step S6, the first image data may be overwritten from the position where the valid image data of the second image data is shifted by the reference coordinate.

  The effective image may be an image in a range surrounded by the edge by detecting the outer edge (edge) of the document from the second image data (obtaining document edge information). In the example of FIG. It becomes. It should be noted that even when a document holding white plate (for example, an OC mat) is placed on the document table and reading is performed, it is only necessary to have a detection accuracy capable of distinguishing the white plate from the surface of the document 22. When there is no such detection accuracy, for example, the same size as the first image 22 (A4 size in this example) is handled as the second image, and then the reference coordinates and the end point are touched by the touch panel unit 12b of the operation unit 12 or the like. The coordinates may be specified by the user. As in this example, the valid image may be an image in a range surrounded by the edge detected from the document edge information, or the range may be designated by a user operation from the operation unit 12.

  It should be noted that not only in this embodiment but also in other embodiments, it is assumed that the second image is synthesized at the same scale as the first image, but the second image is scaled (reduced or enlarged) and synthesized. In such a case, it is possible to change the magnification at the scaling factor of the default value or the user setting value, or to specify the composition destination area and automatically change the magnification to match the specified destination. Good.

  After the processing in step S6, the image synthesized by the synthesis processing unit 10a in step S6 is displayed on the original table display panel 13 (step S7), and the control unit 10 performs a job execution confirmation operation (print execution operation) in the operation unit 12. (Step S8). If YES in step S8, the control unit 10 transmits the recombined image to the printing unit 14, instructs printing of the image, and the printing unit 14 executes printing (step S9).

  While waiting for a job execution confirmation operation in step S8 (NO in step S8), the recombination processing unit 10b determines whether or not a document redisplay condition (that is, an image recombination condition) is satisfied (step S8). S10), NO returns to step S8. Although the document redisplay condition will be described later, in the present embodiment, it refers to a condition that the placed document moves.

  If YES in step S10, the recombination processing unit 10b first reacquires the first image data in order to execute redisplay (step S11). After the processing in step S11, the process returns to step S3 to redisplay the first image, and proceeds to step S4 to reread the second image data. Thereafter, the processing after step S5 is executed in the same manner as in the first synthesis processing. However, the re-synthesis processing unit 10b executes the processes after step S3 after the second time.

  As described above, since the synthesis process itself of the process of the re-synthesis process unit 10b overlaps with the synthesis process of the process of the synthesis process unit 10a, the parts for performing the overlapping synthesis process should be shared. That's fine.

  In this way, when the user confirms the synthesized image or the re-synthesized image (which may be the re-synthesized image of any number of times) and determines that there is no problem with printing, step S8 becomes YES and printing is executed. Will be. Therefore, even if the position of the original serving as the reading source of the second image is wrong, the recovery can be facilitated, and a composite image desired by the user can be printed.

An example of the document redisplay condition determination process will be described with reference to the flowchart of FIG.
The recombination processing unit 10b acquires document edge information of the second image being displayed in step S7 and stores it in the internal buffer A (step S21).

  Here, if the document edge information of the second image has already been acquired in step S5, it can be used initially. However, in the processing examples of FIGS. Reading by the document reading unit is necessary until a confirmation operation is performed. Therefore, since it takes time to read a document by the line sensor, it is preferable to provide a camera for photographing from the bottom of the document table as a document reading unit or an auxiliary document reading unit. By regularly shooting with the camera and determining the edge of the shot image, the document edge information of the second image can be periodically acquired. The document edge information acquired in step S21 is not limited to this example. For example, a separate monitoring camera is provided in a document cover housing or the like provided with a document holding white plate, and images are taken periodically by the camera. It can also be obtained by determining the edge of the image.

  Next, the recombination processing unit 10b determines whether or not the document edge information has been updated depending on whether or not it is a periodic camera shooting timing (step S22). If NO, the condition is not satisfied. The process returns to step S8. If YES in step S22, the recombination processing unit 10b compares the acquired document edge information with the previously acquired document edge information stored in the buffer A (step S23), and determines whether there is a difference. (Step S24). If there is no difference, it is not established and the process returns to step S8. If there is a difference, it is established and the process proceeds to step S11.

  Through the processing described above, the recombination processing unit 10b causes the original reading unit to re-read the placed document in which the change of the placement position is detected, and re-synthesizes the image after the re-reading. If the job execution confirmation operation is performed when the user is satisfied with the recombination result, composite printing can be performed with a positional relationship that matches the recombination result.

  In the above, an example in which the image forming apparatus 1 is provided with the document table side display panel 13 as a display unit (hereinafter referred to as an image display unit) has been described. However, another image display unit is combined with the document table side display panel 13. An image display unit may be provided instead of the document table side display panel 13.

  Such an image display unit may be a projection display device (projector device) that projects an image onto a document pressing white plate placed on a document table. The projector device can also be configured to use a display panel such as a liquid crystal panel embedded in the document table, such as the document table side display panel 13, as a projection screen. When a display panel embedded in the document table is used as the projection screen, the display panel need only be white when performing display, and a simple two-color panel can be used.

  Further, as the image display unit, a display panel provided on the non-white plate side (that is, the upper side of the document cover) of the document pressing white plate may be employed. When the image forming apparatus 1 includes the operation unit 12 as in the present embodiment, a display panel provided in the operation unit 12 may be employed as the image display unit.

  In the case where a plurality of image display units are provided, the operation unit 12 may be able to specify where the composite image or the recombined image is to be displayed. Alternatively, when an image display unit that cannot be displayed unless the document cover such as the document table side display panel 13 is opened and an image display unit that can be displayed are provided, a sensor for detecting the opening / closing angle of the document cover is provided. According to the detection result, when displaying a composite image or a recombined image, if the document cover is open, it is displayed on the former image display unit, and if it is closed, it is displayed on the latter image display unit. You may control.

(Second Embodiment)
The second embodiment of the present invention will be described focusing on the differences from the first embodiment with reference to FIG. 5, but various application examples described in the first embodiment can also be applied. FIG. 5 is a flowchart for explaining an example of the image composition printing process in the image forming apparatus according to the present embodiment.

  In the image forming apparatus 1 according to the present embodiment, when the placement position is changed as in the first embodiment, the image forming apparatus 1 performs processing using only image data instead of performing re-reading. That is, the recombination processing unit 10b corrects the positional relationship as much as the placement position is changed, and performs recombination.

  Explaining with a specific example, after performing the same processing as steps S1 to S4 in FIG. 3 (steps S31 to S34), the composite image processing unit 10a stores the acquired second image data in the buffer α. Thereafter, the same processing as steps S5 and S6 (steps S36 and S37) is performed. Next, after the composition processing unit 10a (recombination processing unit 10b at the time of repetition) holds the arrangement coordinates of each image at the time of composition (step S38), the composite image (repetition is repeated on the document table side display panel 13 as in step S7) (Sometimes meaning a recombined image) is displayed (step S39).

  Thereafter, processing similar to that in steps S8 to S10 (including the processing illustrated in FIG. 4) is performed (steps S40 to S42). If YES in step S42, that is, if the document redisplay condition is satisfied, recombining is performed. The processing unit 10b calculates the coordinates of the movement destination for the document from which the second image is read from the comparison result of the document edge information in step S23 (step S43). Next, the recombination processing unit 10b reacquires the first image data (step S44) and reacquires the second image data from the buffer α (step S45). The order of steps S43 to S45 is not limited, but when all the steps are completed, the process returns to step S36 to perform recombination processing.

  As described above, in the present embodiment, since the image data that has been read once is followed, in addition to the effects of the first embodiment, it is possible to perform processing quickly as much as re-reading is unnecessary.

(Third embodiment)
The third embodiment of the present invention will be described mainly with respect to differences from the first and second embodiments with reference to FIG. 6 as well, but the various embodiments described in the first and second embodiments will be described. Application examples can also be used as appropriate. FIG. 6 is a flowchart for explaining an example of the image composition printing process in the image forming apparatus according to the present embodiment.

  In the image forming apparatus 1 according to the present embodiment, an operation unit (illustrated by the operation unit 12) is indispensable, and placement / non-mounting of a placed document on the document table in the composition processing unit 10a and the recomposition processing unit 10b is performed. Regardless of the placement, the synthesis processing unit 10a and the recombination processing unit 10b are different from the first and second embodiments in that the following processing is performed.

  In the present embodiment, the composition processing unit 10a composes the first image and the second image and displays them on the display unit (hereinafter also exemplified by the document table side display panel 13). The recombination processing unit 10b according to the present embodiment corrects the positional relationship between the first image and the second image in accordance with a user operation received by the operation unit 12 and recombines the recombined image. To display. In particular, the operation unit 12 can be easily operated by providing a cross key, a joystick, or the like.

  Explaining with a specific example, when the same processing as steps S31 to S41 in FIG. 5 (steps S51 to S61) is NO in step S60 (when there is no job execution confirmation operation), the resynthesis processing unit 10b. However, it is determined whether or not there is an update of the composite coordinate image information (operation for moving the composite image) by the operation key of the operation unit 12 (step S62). If NO in step S62, the process returns to step S60.

  If YES in step S62, the recombination processing unit 10b acquires the combined coordinates after movement from the updated composite coordinate image information (step S63), and reacquires the first image data (step S64). The second image data is reacquired from the buffer α (step S65). Next, the recombination processing unit 10b calculates the rearrangement coordinates of the effective image (second image) from the information on the arrangement coordinates at the time of synthesis held in step S58 and the synthesized coordinates after movement acquired in step S63 (step S66). ), An image (second image) from the reference coordinates to the end coordinates of the second image data is synthesized with the first image data (step S67). In step S67, the valid image data of the second image data may be overwritten from the rearranged coordinates to the first image data.

  After step S67, the process returns to step S58, and the recombined image can be displayed in step S59. Note that the processes in steps S64 and S65 are YES in step S62, and may be executed out of the order exemplified here as long as the process returns to step S58.

  As described above, in the present embodiment, if the first image and the second image are obtained, the positional relationship between them can be corrected by the operation unit 12, and the correction process is performed only by the image data. Therefore, compared with the first and second embodiments, the present embodiment does not require that the original is placed on the original table, and the composite position can be adjusted after the original is read. There are advantages. In addition, the image forming apparatus 1 according to the present embodiment may be configured to be able to perform the processes of the first and second embodiments, and in that case, which process the user performs according to the usage scene. You should be able to choose. Note that the acceptance of the movement operation in the present embodiment can also be used as a redisplay condition in the flowchart of FIG. 3, for example.

(Fourth embodiment)
The fourth embodiment of the present invention will be described with a focus on differences from the first embodiment with reference to FIG. 7 as well, but various application examples described in the first to third embodiments are also included. Applicable. FIG. 7 is a flowchart for explaining an example of the image composition printing process in the image forming apparatus according to the present embodiment.

  In the image forming apparatus 1 according to the present embodiment, when the composition processing unit 10a is a character arrangement image in which either one of the first image and the second image designates a region in which a character is arranged, the first image and the second image are displayed. Character recognition processing is performed on the other of the two images, and the other image is combined with the region of the character arrangement image.

  A specific example in which the character layout image is the first image will be described. First, processing similar to steps S1 to S4 in FIG. 3 is performed (steps S71 to S74). However, since it is assumed that the first image data is data for which character composite coordinates are designated, in step S72, character composite coordinate data indicating the designated coordinates is also acquired. The designated coordinates may be designated in advance by the operation unit 12 or the PC that generated the first image.

  After the process of step S74, the composition processing unit 10a performs OCR (Optical Character Recognition) processing on the second image data, and acquires a character string and an image of the character string determined area (hereinafter referred to as a character string image portion) (step S75). ) The character string image portion is synthesized with the first image in accordance with the character synthesis coordinate data of the first image data (step S76). Next, the compositing processing unit 10a displays the composite image obtained in this way (meaning a recombined image when repeated) on the platen side display panel 13 as in step S7 (step S77). At the time of repetition, the re-synthesis processing unit 10b executes these processes instead of the synthesis processing unit 10a.

  Thereafter, processing similar to that in steps S8 to S10 (including the processing illustrated in FIG. 4) is performed (steps S78 to S80). If YES in step S80, that is, if the document redisplay condition is satisfied, recombining is performed. The processing unit 10b re-acquires the first image data and the character image coordinate data (step S81), returns to step S73, and performs recombination and redisplay processing.

  As described above, in the present embodiment, the second image can be automatically arranged there by simply designating the character composition coordinates in advance in the character arrangement image (first image in the above example), Further, when the composite content is different from the user's desire, the original as the reading source of the second image can be moved as in the first to third embodiments.

(Fifth embodiment)
The fifth embodiment of the present invention will be described focusing on the differences from the fourth embodiment with reference to FIG. 8 as well, but various application examples described in the first to fourth embodiments are also included. Applicable. FIG. 8 is a flowchart for explaining an example of the image composition printing process in the image forming apparatus according to the present embodiment.

  In the image forming apparatus 1 according to the present embodiment, when the composition processing unit 10a is a character arrangement image in which either one of the first image and the second image designates a region in which a character is arranged, the first image and the second image are displayed. Character recognition processing is performed on both of the two images, the upper and lower sides of the character are determined, and the other image of the first image and the second image is combined with the region of the character arrangement image so that the upper and lower sides are aligned. To do.

  Explaining with a specific example, first, the same processing as steps S71 and S72 of FIG. 7 is performed (steps S91 and S92). Thereafter, the composition processing unit 10a performs OCR processing on the first image data, acquires the character string information obtained thereby and the top and bottom information as a result of determining the top and bottom of the character string (step S93), and acquires the first image. It is displayed on the document table (step S94). When displaying, based on the top and bottom information, the top and bottom of the characters are displayed so that the user can visually recognize them correctly. Next, the composition processing unit 10a reads the second image data into the document reading unit (step S95), performs OCR processing on the second image data, and acquires character string information and top and bottom information by the same processing as step S93. (Step S96).

  Next, the composition processing unit 10a determines whether or not the top and bottom indicated by the top and bottom information is reversed between the first image data and the second image data (step S97). If the top and bottom are reversed, the same processing as step S76 is performed. If it is not the reverse (step S98), the same processing as step S76 is executed by designating the read address of the data of the character string image portion from the reverse (step S99). After the processes of steps S98 and S99, the composition processing unit 10a displays the composite image obtained in this way (meaning a recombined image when repeated) on the document table side display panel 13 as in step S7 (step S100). ). At the time of repetition, the re-synthesis processing unit 10b executes these processes instead of the synthesis processing unit 10a.

  Thereafter, the same processing as in steps S78 to S81 is performed (steps S101 to S104), and after the processing in step S104, the process returns to step S94, and recombination and redisplay processing are executed.

  As described above, in the present embodiment, by simply specifying the character composition coordinates in advance in the character arrangement image (the first image in the above example), the second image is automatically aligned with the top and bottom of the image. Further, when the content of the composition is different from the user's desire, the original as the reading source of the second image can be moved as in the first to third embodiments.

  Further, the effect of aligning the top and bottom as in the present embodiment can be applied to the case where none of the images is a character layout image. In this case, the composition processing unit 10a performs character recognition processing on both the first image and the second image, determines the upper and lower sides of the characters, and combines the first image and the second image so as to match the upper and lower sides. Can be done.

(Other)
As described in the flow of processing in the image forming apparatus as the first to fifth embodiments, the present invention provides a document table on which a document is placed, a document reading unit that reads an image of the document, and a display unit. And an image forming method in an image forming apparatus including the above and a form as a program for causing a computer of a control unit of the image forming apparatus to execute the image forming method.

  In the image forming method corresponding to the first embodiment, the synthesis processing unit synthesizes the first image and the second image and displays the synthesized image on the display unit in a state where the placed document is placed on the document table. When the change of the placement position of the above-described original document is detected, the recombination processing unit corrects the positional relationship between the first image and the second image, recombines, and recombines Displaying an image on the display unit. Here, at least one of the first image and the second image is an image read by the original reading unit from the original placed on the original table. Further, the above-described placed original is (I) an original from which one of the first image and the second image is read by the original reading unit, II) When both the first image and the second image are read by the original reading unit, the original is the original from which the image read later is read. Other application examples are the same as those described in the first embodiment and the description thereof is omitted.

  The image forming method corresponding to the third embodiment is based on the premise that the image forming apparatus includes an operation unit, and the combining processing unit combines the first image and the second image and displays the combined image on the display unit. A step of re-synthesizing and re-synthesizing the positional relationship between the first image and the second image according to a user operation received by the operation unit, and displaying the re-synthesized image on the display unit; Have. Here, at least one of the first image and the second image is an image read by the document reading unit from the document placed on the document table. Other application examples are the same as those described in the third embodiment and the description thereof is omitted.

  A program (firmware) for causing the computer of the control unit of the image forming apparatus to execute various image forming methods as described above is a program for causing the computer of the control unit to execute the above-described steps. I can say that. Further, it is possible to easily understand the form as a computer-readable recording medium (non-temporary recording medium) in which the above-described program (firmware) is recorded. As this computer, various forms of computers such as a microcomputer functioning as a control unit of the image forming apparatus and a programmable general-purpose integrated circuit / chip set can be applied. Examples of the recording medium include various media such as an optical disk such as a CD-ROM or DVD-ROM, a nonvolatile semiconductor memory such as a memory card, and a hard disk. These firmwares are not limited to being distributed via a portable recording medium, but can also be distributed via a network such as the Internet or via a broadcast wave. Receiving via a network means receiving by downloading a program recorded in a storage device of an external server device or the like.

DESCRIPTION OF SYMBOLS 1 ... Image forming apparatus, 10 ... Control part, 10a ... Composition processing part, 10b ... Recomposition processing part, 11 ... Image input part, 12 ... Operation part, 12a ... Key operation part, 12b ... Touch panel part, 13 ... Document stand Side display panel, 14... Printing section.

Claims (12)

An image forming apparatus comprising a document table on which a document is placed, a document reading unit that reads an image of the document, and a display unit,
At least one of the first image and the second image is an image read by the document reading unit from a document placed on the document table,
(I) When one image of the first image or the second image is read by the document reading unit, the document from which the one image is read is changed to (II) the first image and the second image When both the images of the second image are read by the original reading unit, if the original from which the image read later is read is a placed original,
A synthesis processing unit that synthesizes the first image and the second image and displays the synthesized image on the display unit in a state where the placed document is placed on the document table;
When a change in the placement position of the above-described document is detected, the positional relationship between the first image and the second image is corrected and recombined, and the recombined image is displayed on the display unit. A resynthesis processing unit;
An image forming apparatus further comprising:   The re-composition processing unit causes the original reading unit to re-read the previously placed document in which the change of the placement position is detected, and uses the image after the re-read for the re-composition. The image forming apparatus according to claim 1.   The image forming apparatus according to claim 1, wherein the recombination processing unit corrects the positional relationship by an amount corresponding to the change in the placement position and performs the recombination. An image forming apparatus comprising a document table for placing a document, a document reading unit that reads an image of the document, a display unit, and an operation unit,
When at least one of the first image and the second image is an image read by the document reading unit from a document placed on the document table,
A synthesis processing unit that synthesizes the first image and the second image and displays the synthesized image on the display unit;
A recomposition processing unit that corrects and recombines the positional relationship between the first image and the second image according to a user operation received by the operation unit, and displays the recombined image on the display unit;
An image forming apparatus further comprising:   When one of the first image and the second image is a character arrangement image in which an area for arranging characters is designated, the composition processing unit is configured to select the other of the first image and the second image. 5. The image forming apparatus according to claim 1, wherein a character recognition process is performed on the image, and the other image is combined with the region of the character arrangement image. 6.   In the case where either one of the first image and the second image is a character arrangement image in which a region where a character is arranged is designated, the composition processing unit is configured to detect both the first image and the second image. The character recognition process is performed, the upper and lower sides of the character are determined, and the other image of the first image and the second image is combined with the region of the character arrangement image so as to match the upper and lower sides. The image forming apparatus according to claim 1.   The synthesis processing unit performs character recognition processing on both the first image and the second image, determines the upper and lower sides of the character, and matches the upper and lower sides with the first image and the second image. 5. The image forming apparatus according to claim 1, wherein the image forming apparatus performs combining of the following.   When one of the first image and the second image is not an image read by the document reading unit, the one image is an image received from the outside or an image stored in advance in the image forming apparatus. The image forming apparatus according to claim 1, wherein the image forming apparatus is an image forming apparatus.   The image forming apparatus according to claim 1, wherein the display unit includes a light-transmitting display panel provided on the document table. It has an operation part,
The image forming apparatus according to claim 1, wherein the display unit includes a display panel provided in the operation unit. An image forming method in an image forming apparatus, comprising: a document table for placing a document; a document reading unit that reads an image of the document; and a display unit,
At least one of the first image and the second image is an image read by the document reading unit from a document placed on the document table,
(I) When one image of the first image or the second image is read by the document reading unit, the document from which the one image is read is changed to (II) the first image and the second image When both the images of the second image are read by the original reading unit, if the original from which the image read later is read is a placed original,
A step of combining the first image and the second image and displaying the combined image on the display unit in a state where the combining document is placed on the document table;
When the recomposition processing unit detects a change in the placement position of the placed document, the recomposition process corrects the positional relationship between the first image and the second image and performs recomposition. Displaying on the display unit;
An image forming method comprising: An image forming method in an image forming apparatus comprising: a document table for placing a document; a document reading unit that reads an image of the document; a display unit; and an operation unit.
When at least one of the first image and the second image is an image read by the document reading unit from a document placed on the document table,
A combining processing unit combining the first image and the second image and causing the display unit to display the combined image;
A step of re-synthesizing and re-synthesizing the positional relationship between the first image and the second image according to a user operation received by the operation unit, and displaying the re-synthesized image on the display unit; ,
An image forming method comprising:

Images