JP6624027B2 - Image processing apparatus and image forming apparatus - Google Patents

Description

  The present invention relates to an image processing apparatus and an image forming apparatus, and more particularly to a technique for processing a read image of a document.

  In the image forming apparatus, for example, an original in a predetermined format for inputting necessary items such as various notification sheets is read, and image data such as characters and ruled lines indicating the read original is used as a template for the original as an HDD. And the like. The image forming apparatus prints an image of a document on a recording medium based on such a template.

Further, as shown in Patent Document 1 below, for example, when storing the template of the original, an image that acquires and stores data of an image indicating a rectangle as an input area in which the necessary items are entered (input) There is a processing unit. Further, in this image processing apparatus, reading another document that describes the input character data, and images of the input character data this to read, and the data of an image showing a rectangle character data the input is inputted The template is stored in the storage unit as a template for the another document. In this image processing apparatus, there has been proposed a technique of automatically synthesizing corresponding input character data in an area of an image indicating a rectangle based on data of an image indicating the rectangle stored in a storage unit. I have.

JP 2008-131381 A

  However, in the image processing apparatus as described above, it is difficult to change the input content of the input character data in the area of the image showing the rectangle as the input area. That is, in this image processing apparatus, when the user changes the input content of the input character data, the user needs to read a document in a new format in which the input content has been changed and create a new template. . Further, the user needs to read another document in which the input character data corresponding to the change of the input content is described. Thus, in this image processing apparatus, when the user changes the input content of the input character data, it is necessary to perform a new reading operation of two types of originals.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to make it possible to easily synthesize input character data with an image for which input of input character data is required. I do.

  An image processing apparatus according to one aspect of the present invention includes a display unit, an image reading unit that reads an image of a document, and extracting an image representing a rectangle from a document image obtained by reading by the image reading unit. A rectangle extracting unit that detects the size and position of the image indicating the image in the document image, an identification information allocating unit that sequentially allocates identification information to the image indicating the rectangle extracted by the rectangle extracting unit, the document image, A display control unit for displaying, on the display unit, an image indicating the rectangle extracted by the rectangle extraction unit in the document image, an operation receiving unit for receiving an operation instruction from a user, and a user displaying the image on the display unit When the operation accepting unit accepts a designation request for designating an image indicating a rectangle as a box which is an input area into which input character data is input, the designation request is received. The image indicating the rectangle specified in the box, the size and position of the image indicating the rectangle in the document image, and the identification information assigned to the image indicating the rectangle are associated with each other, and the box information of the box is set. A box information creating unit to be created as a storage unit; and a control unit that, when the box information creating unit creates the box information, stores the original image and the box information in the storage unit as a template including the box information. And

  An image forming apparatus according to another aspect of the present invention includes the image processing apparatus described above and an image forming unit that forms a document image obtained by reading by the image reading unit on a recording medium. .

  According to the present invention, it is possible to easily combine input character data with an image for which input of input character data is required.

FIG. 1 is a diagram showing an entire image forming system using an image forming apparatus according to an embodiment of the present invention. FIG. 2 is a functional block diagram illustrating a main configuration of the image forming apparatus. FIG. 2 is a functional block diagram illustrating a configuration of a main part of a PC. 5 is a flowchart illustrating a flow of a process of creating a template of a document image in the image forming apparatus. 5 is a flowchart illustrating a flow of processing in the PC. 5 is a flowchart illustrating a flow of a process of creating a synthesis result image in the image forming apparatus. FIG. 5 is a diagram illustrating an example of a document image obtained by reading by an image reading unit. FIG. 5 is a diagram illustrating a specific example of an image indicating an extracted rectangle and identification information assigned to the image indicating the rectangle in a document image obtained by reading by an image reading unit. FIG. 3 is a diagram illustrating an example of a display screen displayed on a display unit of the image forming apparatus. It is a figure showing the example of box information. FIG. 3 is a diagram illustrating an example of a display screen displayed on a display unit of the image forming apparatus. FIG. 3 is a diagram illustrating an example of a display screen displayed on a display unit of the image forming apparatus. FIG. 4 is a diagram illustrating an example of a display screen displayed on a display unit of a PC. FIG. 3 is a diagram illustrating a specific example of document data stored in an HDD of a PC. FIG. 4 is a diagram illustrating an example of a display screen displayed on a display unit of a PC. FIG. 3 is a diagram illustrating a specific example of a template and an input data file stored in a storage unit of the image forming apparatus. FIG. 3 is a diagram illustrating an example of a display screen displayed on a display unit of the image forming apparatus. FIG. 4 is a diagram illustrating a specific example of a template to be combined and an input data file. FIG. 3 is a diagram illustrating an example of a display screen displayed on a display unit of the image forming apparatus.

  Hereinafter, an embodiment of an image processing apparatus and an image forming apparatus according to the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating an entire image forming system using an image forming apparatus according to an embodiment of the present invention. FIG. 2 is a functional block diagram illustrating a main configuration of the image forming apparatus. FIG. 3 is a functional block diagram showing a main configuration of the PC.

  The image forming system 100 includes a personal computer (hereinafter, referred to as a PC) 1 as an information processing apparatus and an image forming apparatus 2 as an image processing apparatus according to an embodiment of the present disclosure. The PC 1 and the image forming apparatus 2 are connected to each other by a network 3 such as the Internet or a LAN.

  Further, in the image forming system 100, for example, a print job is transmitted from the PC 1 to the image forming apparatus 2 in response to an operation instruction from a user, and the image forming apparatus 2 performs print processing (image processing) using the print job. Formation processing) is performed. Further, in the image forming system 100, as will be described in detail later, the input character data created on the PC 1 side is sent to the image forming apparatus 2, and the image forming apparatus 2 transmits a box associated with identification information described later. In the area of (input area where the input character data is input), a synthesizing process of synthesizing the input character data associated with the same identification information as the identification information is performed.

  The image forming apparatus 2 is, for example, an MFP (multifunction peripheral) having a plurality of functions such as a copy function, a printer function, a scanner function, and a facsimile function. The image forming apparatus 2 includes a control unit 11, a display unit 12, an image memory 13, an operation unit 14, a touch panel 15, a communication unit 16, an image reading unit 17, an image forming unit 18, a storage unit 19 is provided. These components can transmit and receive data or signals to each other via a bus.

  The image reading unit 17 includes a scanner that optically reads a document, generates image data indicating an image of the read document, and stores the image data in the image memory 13 and the storage unit 19.

  The image forming unit 18 uniformly charges the surface of the photosensitive drum (not shown), exposes the surface of the photosensitive drum, forms an electrostatic latent image on the surface of the photosensitive drum, and forms a static image on the surface of the photosensitive drum. The electrostatic latent image is developed into a toner image, the toner image (image) on the surface of the photosensitive drum is transferred to a recording sheet via an intermediate transfer belt, the toner image on the recording sheet is fixed, and the recording sheet is discharged. . For example, an image represented by the image data generated by the image reading unit 17 is printed on recording paper.

  The display unit 12 includes a liquid crystal display (LCD: Liquid Crystal Display), an organic EL (OLED: Organic Light-Emitting Diode) display, and the like.

  On the screen of the display unit 12, a touch panel 15 is arranged. The touch panel 15 is a so-called resistive or capacitive touch panel, and detects a touch (touch) of the user's finger or the like on the touch panel 15 together with the contact position and a detection signal indicating the coordinates of the contact position. Is output to the control unit 21 of the control unit 11, which will be described later. Therefore, the touch panel 15 functions as an operation unit to which a user operation on the screen of the display unit 12 is input.

  The operation unit 14 includes hard keys such as an enter key and a start key.

  The communication unit 16 is a communication interface including a communication module.

  The storage unit 19 is a large-capacity storage device such as a hard disk drive (HDD).

  The control unit 11 includes a processor, a random access memory (RAM), a read only memory (ROM), and the like. The processor is, for example, a CPU (Central Processing Unit), an MPU, an ASIC, or the like. When the image processing program stored in the ROM or the storage unit 19 is executed by the processor, the control unit 11 controls the control unit 21, the display control unit 22, the rectangle extraction unit 23, and the identification information allocation unit 24. , A box information creation unit 25, an input character data acquisition unit 26, and an image processing unit 27. The control unit 21, the display control unit 22, the rectangle extracting unit 23, the identification information allocating unit 24, the box information creating unit 25, the input character data acquiring unit 26, and the image processing unit 27 of the control unit 11 are based on a program. Instead of the operation, each may be constituted by a hardware circuit.

  The control unit 21 controls the overall operation of the image forming apparatus 1. The control unit 21 has a function of receiving a user operation on the touch panel 15 based on a detection signal output from the touch panel 15. Further, the control unit 21 has a function of receiving a user operation on a hard key of the operation unit 14. Note that the operation unit 14 and the touch panel 15 are examples of an operation reception unit in the claims.

  Further, the control unit 21 has a function of controlling a communication operation by the communication unit 16. The communication unit 16 transmits and receives data to and from the PC 1 and the like via the network 3 under the control of the control unit 21.

  The display control unit 22 controls the operation of the display unit 12. The display control unit 22 includes, for example, an input screen for setting detailed items for a box or the like, which is an input area in which input character data is input, used for the synthesis processing, an input screen for information, Alternatively, operation guidance of the image forming apparatus 2 is displayed.

  The rectangle extracting unit 23 performs pattern matching on an original image obtained by reading by the image reading unit 17 using an image indicating a predetermined rectangle stored in the storage unit 19 or the like, An image indicating a rectangle (a square including a rectangle or a rectangle) is extracted from the document image. Further, the rectangle extracting unit 23 detects the size and position of the image representing the rectangle based on the coordinate position of the image representing the rectangle in the document image. The image indicating the extracted rectangle is used as the box according to an operation instruction from the user, as described in detail later.

  When the image indicating the rectangle is specified by the user in the box and the input area is set as the input area where the character data for input is input, the image processing unit 27 determines the box based on the size and position of the box in the document image. Input character data is input (combined) in the box area. Thus, input character data to be input can be reliably input to the input area (box).

  The identification information allocating unit 24 sequentially allocates the identification information to the image indicating the rectangle extracted by the rectangle extracting unit 23.

  When the identification information allocating unit 24 sequentially allocates the identification information to the image indicating the extracted rectangle, the control unit 21 performs the rectangle extraction on the image indicating the rectangle extracted by the rectangle extracting unit 23 and the image indicating the rectangle. The size and position in the document image detected by the unit 23 and the identification information assigned to the image indicating the rectangle are stored in the storage unit 19 in association with each other. When displaying the document image read by the image reading unit 17 on the display unit 12, the display control unit 22 superimposes the identification information associated with the image indicating the rectangle extracted by the rectangle extraction unit 23. To be displayed on the display unit 12.

  The box information creating unit 25 issues a designation request for designating an image indicating a rectangle displayed on the display unit 12 by the user as a box which is an input area into which the input character data is input. When the touch panel 15) accepts the image, the image indicating the rectangle specified in the box in the specification request is associated with the identification information assigned to the image indicating the rectangle, and is created as box information of the box. Further, the box information includes the size and position of the image indicating the rectangle specified in the box in the specification request in the document image.

In addition, the box information creation unit 25 receives, from the user, the above specification request and the type of box specified by the specification request, (i) a standard box in which at least one character is input as the input character data, (ii) Any of the following: a connection box in which a plurality of boxes in which the input character data is input are connected as one box; and (iii) a check box in which a predetermined check mark is input as the input character data. When the operation receiving unit receives the selection request for selecting the image, an image indicating the rectangle specified in the box in the specification request, the size and position of the rectangle in the document image, and an image indicating the rectangle The identification information allocated to the box is further associated with the type of the box selected by the selection request, and the box of the box is assigned. To create as scan information.

  In addition, when the box information creating unit 25 creates the box information and displays the original image on the display unit 12, the display control unit 22 causes the boxes to be displayed in different display methods for each type of box.

  When the box information creation unit 25 creates the box information, the control unit 21 stores the document image read by the image reading unit 17 and the box information in the storage unit 19 as a template. Further, the control unit 21 causes the communication unit 16 to transmit the template of the document image stored in the storage unit 19 and the instruction signal to the PC 1 via the network 3. The instruction signal is displayed on the display unit 82 of the PC 1 by associating the image indicating the rectangle specified in the box with the identification information allocated to the image indicating the rectangle, and identifying the image indicating the rectangle and the identification information. This is to instruct that the input image be displayed as an input screen superimposed on the document image indicated by the template.

  Further, when the control unit 21 causes the communication unit 16 to transmit the template of the document image stored in the storage unit 19 via the network 3 to the PC 1, the control unit 21 transmits the instruction to the PC 1 as the document image. Along with the signal, an image included in the template and having a different display method for each box type is transmitted to the communication unit 16 and displayed on the display unit 82 of the PC 1 as an input screen.

  After the operation receiving unit (the operating unit 14 and the touch panel 15) receives a specification request for specifying a box from the user, the display control unit 22 sets the size of the box, that is, the height and width of the box. The display unit 12 displays an image for accepting the change from the user.

  Then, when the operation receiving unit (the operation unit 14 and the touch panel 15) receives a change instruction by inputting a value specifying the size of the box, the control unit 21 changes the size indicated by the received change instruction into the box. Is stored in the storage unit 19 as the size in the document image of the image indicating the rectangle designated as the box information.

  The input character data acquisition unit 26 transmits the input character data input to the box from the PC 1 via the network 3 and the identification information associated with the input character data via the communication unit 16. To get.

  When the input character data obtaining unit 26 obtains the input character data and the identification information associated therewith, the control unit 21 uses the obtained input character data and the identification information as an input data file. It is stored in the storage unit 19. It is sufficient that the storage unit 19 stores at least one of the templates. In the present embodiment, it is assumed that the storage unit 19 stores a plurality of templates. It is sufficient that the storage unit 19 stores at least one of the input data files. In the present embodiment, it is assumed that the storage unit 19 stores a plurality of input data files. Then, the display control unit 22 causes the display unit 12 to display a list of templates stored in the storage unit 19 and a list of input data files stored in the storage unit 19.

  The image processing unit 27 performs various types of image processing on image data in the image memory 13 such as a document image obtained by reading a document by the image reading unit 17. Further, the image processing unit 27 combines the input character data included in the input data file stored in the storage unit 19 with the image indicating the rectangle as the box specified by the specification request. For example, the image processing unit 27 synthesizes input character data included in the input data file and associated with the same identification information as the identification information allocated to the box, in the area of the box in the document image indicated by the template. Process to create a composite result image.

  When the display control unit 22 causes the display unit 12 to display the list of templates and the list of input data files, the operation reception unit selects the template from the list of templates according to an operation instruction from the user. If an instruction to specify one selected template and one input data file selected from the list of input data files is received, the image processing unit 27 executes the above-described original image indicated by the selected one template. In the area of the image indicating the rectangle specified in the box indicated by the identification information, the input characters included in the selected one input data file and associated with the same identification information as the identification information The data is synthesized to create a synthesized result image.

  The display control unit 22 causes the display unit 12 to display the synthesis result image created by the image processing unit 27.

  The PC 1 includes a control unit 70, an operation unit 81, a display unit 82, a transmission / reception unit 83, and an HDD 84. These units can mutually transmit and receive data or signals via a CPU bus.

  The operation unit 81 has a keyboard, a mouse, or a touch panel. The operation unit 81 allows the user to specify print data (print job) to be printed and a print instruction to specify the image forming apparatus 2 used for the print data. Is entered.

  The display unit 82 is composed of an LCD (Liquid Crystal Display) or the like, and displays operation guidance and the like for the user.

  The transmission / reception unit 83 includes a communication module such as a LAN board, and transmits / receives various data and signals to / from the image forming apparatus 2 via the network 3 connected to the transmission / reception unit 83. The transmission / reception unit 83 receives a document image template from the image forming apparatus 2.

  The control unit 70 includes a processor, a random access memory (RAM), a read only memory (ROM), and the like. The processor is, for example, a CPU (Central Processing Unit), an MPU, or an ASIC. The control unit 70 executes the input character data creation program stored in the HDD 84 or the like by the above processor, so that the control unit 71, the display control unit 72, the reception unit 73, and the print job generation unit 74 Function. Note that the control unit 71, the display control unit 72, the reception unit 73, and the print job generation unit 74 of the control unit 70 may each be configured by a hardware circuit without depending on the operation based on the input character data creation program. . Hereinafter, the same applies to each embodiment unless otherwise specified.

  The control unit 71 controls the overall operation of the PC 1.

  The display control unit 72 controls the operation of the display unit 82. In addition, the display control unit 72 performs control and the like to display an input screen described later on the display unit 82 according to the instruction signal received by the receiving unit 73.

  The receiving unit 73 receives the instruction signal for instructing the display method of the template on the display unit 82 from the image forming apparatus 2 via the transmitting / receiving unit 83 (details will be described later).

  Further, the control unit 71 reads out document data stored in the HDD 84 or document data from the outside of the PC 1, for example, a USB memory connected to the USB port of the PC 1 in response to a user operation on the operation unit 81. .

  The document data is data including Japanese characters such as hiragana and kanji, alphabets, numbers, and special characters such as at marks and postal marks created by an application such as a word processor executed on the PC 1.

  The print job generation unit 74 generates a print job from the document data read by the control unit 71. For example, the print job generation unit 74 operates in accordance with the printer driver stored in the HDD 84, converts the document data into a format in a printer language suitable for the image forming apparatus 2, and converts the document data into print data (for example, a PRN file). Then, a print job for print processing including the print data is generated. The print job has the print data (that is, input character data converted into the format) and identification information associated with the input character data (details will be described later).

  Hereinafter, the operation of the image forming system 100 configured as described above will be specifically described with reference to FIGS. FIG. 4 is a flowchart illustrating a flow of a process of creating a template of a document image in the image forming apparatus. FIG. 5 is a flowchart showing the flow of processing on the PC. FIG. 6 is a flowchart illustrating a flow of a process of creating a synthesis result image in the image forming apparatus.

  First, in the image forming apparatus 2, when the user sets the document G shown in FIG. 7 on the image reading unit 17 and operates the start key of the operation unit 14, the document reading instruction is received by the control unit 21, and the control is performed. The unit 21 causes the image reading unit 17 to read an image of the document G, and stores image data (document image G1) indicating the read image of the document G in the image memory 13 (step S1).

  Subsequently, the rectangle extracting unit 23 extracts an image indicating a rectangle from the document image G1 of the document G obtained by reading (step S2). The rectangle extracting unit 23 extracts an image indicating the rectangle from the document image, and detects the size and position of the image indicating the rectangle in the document image.

  Here, if the rectangle extracting unit 23 cannot extract any image indicating a rectangle from the document image G1 (NO in step S2), the process ends.

  On the other hand, if the rectangle extracting unit 23 has been able to extract at least one image representing a rectangle from the document image G1 (YES in step S2), the identification information allocating unit 24 returns to the rectangle extracted by the rectangle extracting unit 23. Are sequentially assigned to each image indicating (step S3). For example, when an image indicating 30 rectangles is extracted by the rectangle extracting unit 23 in the document image G1, as shown in FIG. 8, the images indicating each of the 30 rectangles are added in accordance with the extraction order. The identification information allocating unit 24 allocates each of the identification information items (1) to (30) to the position of the image indicating the corresponding rectangle.

  Further, as shown in FIG. 9, the display control unit 22 displays the document image G1 read by the image reading unit 17 on the display unit 12 and indicates a rectangle included in the template stored in the storage unit 19. The image and the identification information assigned to the image indicating the rectangle are superimposed on the document image G1 and displayed on the display unit 12 (step S4).

  Subsequently, the control unit 21 determines whether or not the touch panel (operation receiving unit) 15 has received a designation request for designating an image indicating a rectangle in the document image G1 as the box (step S5). For example, on the display screen (input screen) shown in FIG. 9, when a part displaying an image indicating a rectangle specified as a box is pressed by the user and this is detected by the touch panel 15, the control unit 21 transmits the specification request to the above. It is determined that it has been accepted. If the control unit 21 determines that the designation request has not been accepted, the process ends (NO in step S5).

  In addition to the above description, when the user designates the image indicating the rectangle as the box, the user is assigned to the image indicating the rectangle among the not-shown numeric keys provided on the operation unit 14. By pressing a numeric key corresponding to the identification information, an instruction indicating a number may be input, and the control unit 21 may determine that the input number indicates an image indicating a rectangle as a designated box.

  On the other hand, when determining that the specification request has been received (YES in step S5), control unit 21 determines whether the box type has been selected by the user for the box specified by the specification request. For example, the control unit 21 determines that the user presses the input key 12a, subsequently presses a portion displaying an image indicating a rectangle designated as a standard box, and further presses the save key 12e. When the box is detected by the touch panel 15, it is determined that a selection request for setting the box as a standard box has been received (step S6). Further, when the cancel key 12f is pressed by the user and detected by the touch panel 15, the control unit 21 determines that the designation request in step S5 has been canceled.

  If it is determined that the request to select a standard box has been received (YES in step S6), control unit 21 determines whether an instruction to specify the size of the standard box has been input (step S7). For example, after receiving a selection request for a standard box, the control unit 21 detects that a portion displaying an image indicating a rectangle designated as a standard box has been pressed by the user, An instruction to specify the size of the standard box (that is, the range of the input area) is received.

  If the control unit 21 determines that the instruction to specify the size of the standard box has not been input (NO in step S7), for example, the control unit 21 sets the standard box within a predetermined time after the save key 12e is pressed. If the touch panel 15 does not detect that the user has pressed the portion displaying the image indicating the designated rectangle, the box information creating unit 25 creates box information (step S9).

  That is, the box information creating unit 25 determines the size and position of the image indicating the rectangle specified in the box in the specification request in step S5 in the document image G1, the identification information assigned to the image indicating the rectangle, The type of the box selected by the selection request is associated with the box type and is created as box information of the box.

  For example, as illustrated in FIG. 9, when an image indicating each of four rectangles to which the identification information of (18), (27), (29), and (30) is respectively assigned is selected as a standard box The box information creation unit 25 determines the size and position of the image indicating each of these four rectangles in the document image G1, the identification information assigned to the image indicating the corresponding rectangle, and the information indicating that the image is a standard box. , Box information is created for each of the four boxes. Then, the control unit 21 stores the box information in the storage unit 19 as a template. The size and the position of the image indicating the rectangle in the original image G1 are defined such that an arbitrary point (for example, the uppermost and leftmost point) in the coordinates of the rectangular original image G1 is (0, 0). It is specified by the xy coordinates. As a result, for example, as shown in FIG. 10, the storage unit 19 stores, as box information, identification information allocated to an image indicating a rectangle designated as a box, a box type, and a document of the image indicating a rectangle. The positions of four points of the image indicating the rectangle as the size and position in the image G1 are stored.

  On the other hand, when the control unit 21 determines that the instruction to specify the size of the standard box has been received (YES in step S7), the display control unit 22 causes the display unit 12 to display the display screen illustrated in FIG. . For example, when an image indicating a rectangle to which the identification information of (18) is allocated is selected as a standard box and the control unit 21 receives a change in the size, the display control is performed as illustrated in FIG. The unit 22 causes the display unit 12 to display a height input key 12g and a width input key 12h for inputting the changed height and width, respectively. Then, the user operates the touch panel 15 or numeric keys (not shown) on the operation unit 14 to input desired height and width values. Thus, the input height and width are received by the control unit 21 as the changed height and width. As shown in FIG. 11, the display control unit 22 displays the received height and width in the area of the height input key 12g and the width input key 12h, respectively. Further, when the execution key 12i is pressed by the user and the touch is detected by the touch panel 15, the display control unit 22 causes the display unit 12 to display the display screen shown in FIG.

  In addition to the above description, after the desired height and width values of the standard box are input, the control unit 21 presses the save key 12e by the user, and the touch panel 15 detects the press. Sometimes, a configuration may be adopted in which the height and width input as the changed height and width in the standard box are accepted. In addition to the user inputting desired height and width values using the numeric keys or the like, the user changes the size of the image by dragging an image indicating a rectangle selected as a standard box on the touch panel 15. Thus, the control unit 21 may be configured to receive a change in the size of the standard box.

  Then, when the save key 12 e is pressed by the user and detected by the touch panel 15, the box information creating unit 25 replaces the received values of the changed height and width with the identification information of (18). As the size of the image indicating the allocated rectangle, the storage unit 19 stores the identification information of (18) in the box information of the box corresponding to the image indicating the allocated rectangle.

  When determining that the selection request for the standard box has not been received (NO in step S6), the control unit 21 determines whether the selection request for the connection box has been received (step S10). For example, the control unit 21 informs the user that the input key 12a has been pressed by the user, the portion that displays the image indicating the rectangle designated as the connection box has been pressed by the user, and that the connection key 12c has been pressed by the user. When it is detected by step 15, it is determined that a selection request to make the box a connected box has been received.

  If the control unit 21 determines that the selection request for the connection box has been received (YES in step S10), the control unit 21 determines whether an instruction to specify the size of the connection box has been input (step S7). For example, after receiving the selection request for the connection box, the control unit 21 detects that the touch panel 15 has pressed the portion displaying the image indicating the rectangle designated as the connection box, and An instruction to specify the size of the connection box (that is, the range of the input area) is received.

  When the control unit 21 determines that the instruction to specify the size of the connection box has not been received (NO in step S7), for example, after the connection key 12c is pressed, the connection box is set as the connection box within a predetermined time. If the touch panel 15 does not detect that the user has pressed the portion displaying the image indicating the designated rectangle, the box information creating unit 25 creates box information (step S9).

  For example, when images indicating three rectangles to which the identification information items (14), (15), and (16) shown in FIG. 9 are respectively assigned are selected as the connection boxes, the box information creation unit 25 The size and position of each of the three rectangular images in the original image G1 and the identification information allocated to the corresponding rectangular image are represented by one box information indicating one connected box. create. In this box information, images showing three rectangles to which the identification information of (14), (15), and (16) are respectively assigned are subboxes into which character data for input can be input independently of each other. Contains information indicating that there is.

  Further, for example, when images indicating four rectangles to which the identification information (19), (20), (21), and (22) shown in FIG. The information creating unit 25 determines the size and position of the image indicating each of the four rectangles in the document image G1 and the identification information assigned to the image indicating the corresponding rectangle, as one connection box indicating that the box is one connection box. Create two box information. The box information includes information indicating that the image indicating each of the four rectangles to which the identification information of (19), (20), (21), and (22) is respectively assigned is the sub-box. Have been. Then, the box information creating unit 25 stores the box information in the storage unit 19 as a template.

  On the other hand, if the control unit 21 determines that the instruction to specify the size of the connection box has been received (YES in step S7), the display control unit 22 causes the display unit 12 to display the display screen illustrated in FIG. . For example, when an image indicating a rectangle to which the identification information of (14), (15), and (16) is assigned is selected as a connection box and an instruction to specify its size is received, FIG. As an example, the display control unit 22 causes the display unit 12 to display a height input key 12g and a width input key 12h for inputting values indicating the changed height and width, respectively. Then, the user inputs desired height and width values to numeric keys (not shown) on the touch panel 15 or the operation unit 14. Thus, the input height and width are received by the control unit 21 as the changed height and width. As shown in FIG. 11, the display control unit 22 displays the received height and width in the area of the height input key 12g and the width input key 12h, respectively. When the execution key 12i is pressed by the user and detected by the touch panel 15, the display control unit 22 causes the display unit 12 to display the display screen shown in FIG. Then, when the control unit 21 detects that the save key 12e has been pressed, the box information creating unit 25 converts the received values of the changed height and width into (14), (15), and ( As the size of an image indicating one rectangle formed by combining three rectangles to which the identification information of (16) is allocated, the rectangle to which the identification information of (14), (15), and (16) is allocated is It is stored in the storage unit 19 while being included in the box information of the connection box shown.

  In addition to the above description, after the desired height and width values of the connection box are input, the control unit 21 presses the save key 12e by the user, and the touch panel 15 detects the press. Sometimes, a configuration may be adopted in which the height and width input as the changed height and width in the connection box are received. In addition to the user inputting desired height and width values using the numeric keys or the like, the user changes the size of the image by dragging an image indicating a rectangle selected as a connection box on the touch panel 15. Thereby, the control unit 21 may be configured to receive a change in the size of the connection box.

  When the control unit 21 determines that the selection request for a connection box has not been received (NO in step S10), it determines whether a selection request for a check box has been received (step S11). For example, the control unit 21 informs the user that the input key 12a has been pressed by the user, the portion displaying an image indicating a rectangle designated as a check box has been pressed by the user, and the check key 12d has been pressed by the user. When it is detected by step 15, it is determined that a selection request for selecting the box as a check box has been received.

  When the control unit 21 determines that the selection request for the check box has been received (YES in step S11), the control unit 21 determines whether an instruction to specify the size of the check box has been received (step S11). S7). For example, after accepting a selection request for a check box, the control unit 21 determines that the touch panel 15 detects that a part displaying an image indicating a rectangle designated as a check box has been pressed by the user. An instruction to specify the size of the check box (that is, the range of the input area) is received.

  If the control unit 21 determines that the instruction to specify the size of the check box has not been received (NO in step S7), for example, the control unit 21 specifies the check box as a check box within a predetermined time after the check key 12d is pressed. If the touch panel 15 does not detect that the user has pressed the portion that displays the image indicating the rectangle, the box information creating unit 25 creates box information (step S9).

  For example, when images indicating four rectangles to which identification information (5), (6), (7), and (8) shown in FIG. 9 are respectively assigned are selected as check boxes, box information generation is performed. The unit 25 associates the size and position of the image indicating each of these four rectangles in the document image G1, the identification information assigned to the image indicating the corresponding rectangle, and the information indicating that the image is a check box. Box information is created for each of the four boxes. Then, the box information creating unit 25 stores the box information in the storage unit 19 as a template, as described later.

  On the other hand, when the control unit 21 determines that the instruction to specify the size of the check box has been received (YES in step S7), the display control unit 22 causes the display unit 12 to display the display screen illustrated in FIG. . For example, when an image indicating a rectangle to which the identification information of (5) is allocated is selected as a check box and an instruction to specify its size is received, display control is performed as illustrated in FIG. The unit 22 causes the display unit 12 to display a height input key 12g and a width input key 12h for inputting the changed height and width, respectively.

  Then, the user inputs desired height and width values to numeric keys (not shown) on the touch panel 15 or the operation unit 14. Thus, the input height and width are received by the control unit 21 as the changed height and width. As shown in FIG. 11, the display control unit 22 displays the received height and width in the area of the height input key 12g and the width input key 12h, respectively. When the execution key 12i is pressed by the user and detected by the touch panel 15, the display control unit 22 causes the display unit 12 to display the display screen shown in FIG. Then, when the control unit 21 detects that the save key 12e has been pressed, the box information creating unit 25 assigns each of the accepted values of the changed height and width by the identification information of (5). The size is treated as the size of the image indicating the rectangle, and the identification information of (5) is stored in the storage unit 19 in the box information of the check box corresponding to the image indicating the allocated rectangle.

  In addition to the above description, after the desired height and width values of the check box are input, the control unit 21 presses the save key 12e by the user, and the touch panel 15 detects the press. Sometimes, a configuration may be adopted in which the height and width input as the height and width after the change in the check box are accepted. In addition to the user inputting desired height and width values using the numeric keys or the like, the user drags an image indicating a rectangle selected as a check box on the touch panel 15 to change the size of the image. Thereby, the control unit 21 may receive a change in the size of the check box.

  If the control unit 21 determines that the selection request for the check box has not been accepted (NO in step S11), the process returns to step S5.

  When the box information creation unit 25 finishes the creation of the box information, the control unit 21 determines whether the creation of the box information has been completed for all the boxes (step S12). If the box information creation unit 25 determines that the creation of box information has not been completed for all boxes (NO in step S12), the process returns to step S5.

  On the other hand, if the box information creation unit 25 determines that the creation of box information has been completed for all boxes (YES in step S12), the control unit 21 determines that the original image G1 and the box information creation unit 25 The stored box information is stored in the storage unit 19 as a template T of the original image G1 (step S13).

  Further, the display control unit 22 causes the display unit 12 to display the standard box, the connection box, and the check box in the template T using different display methods. For example, when the box information creating unit 25 creates box information of a box, the display control unit 22 causes the display unit 12 to display the box in a different display method for each type of box. For example, as illustrated in FIG. 12, the display control unit 22 is assigned an image indicating a rectangle selected in the standard box, that is, identification information of (18), (27), (29), and (30). The image showing the four rectangles is displayed by being surrounded by a dashed-dotted rectangle. The display control unit 22 also displays an image indicating the rectangle selected in the connection box, that is, an image indicating three rectangles to which the identification information of (14), (15), and (16) is assigned, respectively, and (19) ), (20), (21), and (22) are displayed, enclosing the four-rectangle images to which the respective pieces of identification information are assigned, with a two-dot chain line rectangle. The display control unit 22 also displays an image indicating the rectangle selected in the check box, that is, an image indicating four rectangles to which the identification information of (5), (6), (7), and (8) is respectively assigned. Is displayed in a dotted rectangle. Such display on the different display units 12 is executed each time the box information creating unit 25 creates box information of a box. Note that, other than this description, for example, the display control unit 22 may display the box by surrounding the box with rectangles of different colors from one another for each type of box. Also, the sub-boxes included in the connection box may be displayed on the display unit 12 in a display method different from other boxes.

  Thereafter, the control unit 21 sends the PC 1 the template T of the document image stored in the storage unit 19 via the network 3 and the display unit 82 of the PC 1 displays the document image T The communication unit 16 transmits an image indicating the designated rectangle and an instruction signal for instructing the identification information allocated to the image indicating the rectangle to be displayed as an input screen (step S14). In addition, the control unit 21 instructs, in response to this instruction signal, to display a box in a different display method for each type of box included in the template T on the input screen displayed on the display unit 82 of the PC 1. Instruction signal to be included.

  Subsequently, the PC 1 determines whether or not the receiving unit 73 has received the template T and the instruction signal from the image forming apparatus 2 via the transmitting / receiving unit 83 (Step S15). If the template T and the instruction signal are not received (NO in Step S15), the PC 1 enters a standby state.

  On the other hand, if receiving section 73 receives template T and the instruction signal via transmitting / receiving section 83 (YES in step S15), control section 71 causes input characters to be input to the box included in template T. It is determined whether the creation of data is started (step S16). For example, when the receiving unit 73 receives the template T and the instruction signal, the control unit 71 displays a display for inquiring via the display control unit 72 whether to start creating input character data. 82. If the operation unit 81 does not receive an operation of instructing to start the creation of the input character data from the user (NO in step S16), the control unit 71 puts the PC 1 into a standby state.

  If the operation unit 81 receives an operation of an instruction to start creation of input character data from the user (YES in step S16), the display control unit 72 receives the instruction according to the instruction signal received by the reception unit 73. The template T is displayed on the display section 82 as shown in FIG. 13 (step S17). The user activates an application such as a word processor by operating the operation unit 81, and creates document data (character data for input) using the application (step S18).

  In the input screen, as shown in FIG. 13, in the template T displayed on the display unit 82, in addition to the document image, an image indicating the rectangle designated in the box in step S5 and an image indicating the rectangle The identification information assigned to the image and the selected type of box are displayed. That is, in this input screen, the input area (box) in which the input character data is input is displayed together with the identification information assigned to the image indicating the corresponding rectangle, so that the user can recognize the box while Document data to be input to the box can be easily created.

For example, a user starts an application such as a word processor or spreadsheet software on the PC 1 and creates a data file D having a predetermined format using the application. The user inputs and arranges numbers and “input characters” by operating the operation unit 81 in accordance with the arrangement indicated by the format using the application, and the data having the arrangement illustrated in FIG. Create file D. In the data file D, the numbers indicating the respective identification information are arranged at predetermined positions. Numerical values, characters, and the like as input character data are arranged at positions spaced by a predetermined number of spaces from the arrangement position of each piece of identification information. By arranging the identification information and the input character data in this manner, the image processing unit 27 and the like in the image forming apparatus 2 can read the identification information and the input character data from the data file D. The data file D is stored in the area of “Form Application” 84 a in the storage unit 84.

  For example, as shown in FIG. 14, "777" is input as input character data for a standard box corresponding to an image indicating a rectangle, adjacent to the position where the identification information of (18) is allocated.

  Further, assuming that the identification information of (14), (15), and (16) is identification information as a connection box, the input information for the connection box is placed adjacent to the position where the identification information of (14) is allocated. As input character data, each input character data to be input into each sub box is arranged in a continuous state with a predetermined delimiter character (for example, “,”) interposed therebetween. For example, in the example shown in FIG. 14, the input character data in sub-box units is “07”, “25”, and “2016”, and “07, 25, 2016” is placed adjacent to the identification information of (14). Is arranged.

  If the identification information in (5) is identification information as a check box, "x" is arranged as input character data for a check box adjacent to the position where the identification information in (5) is allocated. Is done.

  Thereafter, in the PC 1, when the data file D is selected from the area of the “Form Application” 84a of the HDD 84 as a target to be transmitted to the image forming apparatus 2 by the operation of the operation unit 81 by the user, the print job generating unit 74 A print job is generated using the selected data file D (step S19).

  For example, when the user operates the operation unit 81 to start the printer driver, the display control unit 72 causes the display unit 82 to display an input screen in which the tab of the job 82a is selected as illustrated in FIG. . When the user operates the operation unit 81 to select the “Form Application” 82b field on the input screen and further selects the data file D from the “Form Application” 84a area of the HDD 84, the printing is performed. The job generating unit 74 converts the data file D into the above-described print data suitable for the image forming apparatus 2 (data converted into a format in a printer language suitable for the image forming apparatus 2), and uses the data for print processing including the print data. Generate a print job.

  At this time, the print job generation unit 74 converts only the input character data portion in the data file D into print data. The print job generating section 74 adds the information indicating the corresponding input character data to the identification information portion, and incorporates the information into the print job as separate data. That is, in this print job, in the data file D shown in FIG. 14, the identification information of (5), (6), ----, (29), and (30) is not converted into print data. Only the input character data is converted into data for printing in the image forming apparatus 2.

  Subsequently, the control unit 71 causes the transmission / reception unit 83 to transmit a print job including the character data for input to be input to the box and the different data to the image forming apparatus 2 via the network 3 (step S20). .

  In the image forming apparatus 2, the control unit 21 determines whether or not the input character data acquisition unit 26 has received a print job from the PC 1 via the communication unit 16 (step S21). The control unit 21 keeps the image forming apparatus 2 in a standby state until the input character data acquisition unit 26 receives the print job (NO in step S21).

  On the other hand, when the input character data acquisition unit 26 receives the print job from the PC 1 via the communication unit 16 (YES in step S21), the control unit 21 determines whether the input character data included in the print job is The different data (including the identification information) is stored in the storage unit 19 as an input data file (step S22). As shown in FIG. 16, the input data file is stored in the input data file area 19b in the storage section 19, and the document image G read by the image reading section 17 and the box information creating section 25 are stored in the template area 19a. A template T including the created box information is stored.

  In response to the user's operation on the operation receiving unit, the display control unit 22 causes the display unit 12 to display each list of the template T and the input data file stored in the storage unit 19 (Step S23). For example, the display control unit 22 causes the display unit 12 to display the display screen illustrated in FIG.

  Thereafter, the control unit 21 determines whether or not one template and one input data file are selected according to a user's operation instruction to the operation unit 14 (Step S24). If one template and one input data file are not selected (NO in step S24), image forming apparatus 2 enters a standby state.

  On the other hand, when the control unit 21 detects that one template and one input data file have been selected (YES in step S24), the control unit 21 uses the selected template and the input data file. The image processing section 27 is caused to perform the combined processing (step S25).

  For example, when step S24 is performed, the display control unit 22 causes the display unit 12 to display a display screen illustrated in FIG. On this display screen, the user presses the “Payment Form” field from the display field 12j showing a list of templates, and when this press is detected by the touch panel 15, the control unit 21 displays the “Payment Form” as a template. And accept the selection. Further, when the user presses the “Payment Form Info” field from the display field 12 k showing the list of input data files on the touch panel 15, and when this press is detected by the touch panel 15, the control unit 21 transmits the “Payment Form Info” Is selected as an input data file.

Furthermore, when the synthesis key 121 is pressed by the user and this pressing is detected by the touch panel 15, the control unit 21 transmits the selected “Payment Form” template and “Payment Form Info” input data file. Is performed by the image processing unit 27.

  In the synthesizing process, as shown in FIG. 18, the image processing unit 27 stores the template T of the “Payment Form” and the input data file I of the “Payment Form Info” to be synthesized in the template area of the storage unit 19, respectively. 19a (FIG. 16) and the input data file area 19b (FIG. 16). Then, the image processing unit 27 includes the “Payment Form Info” input data file in the area of the image indicating the rectangle specified by the box indicated by the identification information in the document image indicated by the template T of “Payment Form Info”. Then, input character data associated with the same identification information as the identification information is arranged, and the two images are combined to create a combined result image. The created composite result image is stored in the image memory 13 or the storage unit 19.

For example, the image processing unit 27 determines whether or not the image area indicating the rectangle designated by the box (standard box) indicated by the identification information (27) in the template T of “Payment Form” shown in FIG. Then, "Taro Yamada" as input character data associated with the same identification information (27) is arranged, and these two images are combined. The image processing unit 27 determines that the box indicated by the identification information of (27) is a standard box based on the box information included in the template T of “Payment Form”. The image processing unit 27 determines that the input character data associated with the identification information of (27) is “Taro Yamada” and determines the input character data corresponding to the identification information included in the separate data. It is determined based on the information shown.

  In addition, the image processing unit 27 sets, in an image area indicating three rectangles specified in boxes (assumed to be connection boxes) indicated by the identification information of (14), (15), and (16), “07, 25, 2016” as input character data associated with the identification information (14) having the sameness is read from the input data file I of the Payment Form Info, and is associated with the identification information (14). "07" is arranged in the box associated with the identification information of (15), "25" is arranged in the box associated with the identification information of (15), and "2016" is arranged in the box associated with the identification information of (16). Then, an image showing a rectangle as each box and an image of input character data are synthesized. The image processing unit 27 determines that the box indicated by the identification information in (14), (15), and (16) is a connected box based on the box information included in the template T of “Payment Form”. I do. In this case, the image processing unit 27 sets the input character data arranged adjacent to the identification information with the smallest number among the continuous identification information as the input character data used for the synthesis, and In “07, 25, 2016” as character data, “07”, “25”, and “2016” delimited by “,” are arranged in the order in which they are arranged, and the youngest number among the sub-boxes forming the connection box is used. Are arranged in order from the sub-box corresponding to the identification number of.

  Further, the image processing unit 27 arranges “×” as input character data in the area of the image indicating the rectangle specified in the box (assumed to be a check box) indicated by the identification information of (5). Then, these two images are synthesized. The image processing unit 27 determines that the box indicated by the identification information in (5) is a check box based on the box information included in the template T of “Payment Form”. The image processing unit 27 indicates that the input character data associated with the identification information of (5) is “x”, indicating the input character data corresponding to the identification information included in the separate data. Judge based on information.

  Subsequently, the display control unit 22 causes the display unit 12 to display the synthesis result image F created by the image processing unit 27, as shown in FIG. 19 (Step S26).

  Thereafter, the control unit 21 determines whether the printing of the synthesis result image F is requested (step S27). For example, in the display screen shown in FIG. 19, when the control unit 21 detects that the print key 12n is pressed by the user, the control unit 21 determines that the printing of the synthesis result image F is requested. Then, the image forming unit 18 is caused to perform a printing process of the synthesis result image F (step S28).

  On the other hand, when the control unit 21 detects that the save key 12e has been pressed by the user, the control unit 21 determines that printing of the synthesis result image F is not currently requested, and It is stored in the storage unit 19 (step S29).

  As described above, in the present embodiment, when creating the template T, the rectangle extracting unit 23 extracts an image representing a rectangle from the document image obtained by reading by the image reading unit 17, and outputs the document image of the image representing the rectangle. , And the identification information allocating unit 24 sequentially allocates the identification information to the extracted image indicating the rectangle. The display control unit 22 causes the display unit 12 to display the document image, the image indicating the extracted rectangle, and the identification information allocated to the image indicating the rectangle in association with each other. Further, the box information creating unit 25 includes an image indicating the rectangle specified in the box in the specification request, a size and a position of the image indicating the rectangle in the document image, and identification information assigned to the image indicating the rectangle. Is created as box information of the box. When the box information creation unit 25 creates the box information, the control unit 21 stores the document image and the box information in the storage unit 19 as a template including the box information.

  In the present embodiment, the image processing unit 27 includes the same identification information as the identification information included in the input data file in the area of the image indicating the rectangle specified by the box indicated by the identification information in the document image indicated by the template T. In order to arrange the input character data associated with, and combine these two images to create a combined result image, it is possible to easily perform printing in which desired characters and the like are arranged at desired positions in the document image by the user. be able to. Further, the user can easily change the arrangement position of the input character data in the document image and the contents of the input character data by creating the template T and creating the data file D described above.

  That is, in the present embodiment, when the user changes the position of the box for inputting the input character data in the read original, the control unit 21 transmits the original image included in the original image template from the storage unit 19. Is read and processed by the rectangle extracting unit 23 and the identification information allocating unit 24 for the original image, so that the box after the change is recognized. Is created, the position of the box for inputting the character data for input can be easily changed without performing a new reading operation of the document.

  Therefore, in the present embodiment, unlike the related art, it is possible to easily combine the input character data with an image for which input of the input character data is required.

  In the above description, the case where the PC (information processing device) 1 is provided with the print job generation unit 74 that operates according to the printer driver is described. May be one that acquires the input character data created by the PC1, for example, the input character data acquiring unit 26 acquires the document data created by the PC1 as the input character data, and acquires the acquired input character data. The character data may be converted into print data for print processing by a printer driver provided in the image forming apparatus 2. In this case, the image forming apparatus 2 includes the print job generating unit 74.

  Further, in the above embodiment, the configuration and processing described in the above embodiment with reference to FIGS. 1 to 19 are merely an embodiment of the present invention, and are not intended to limit the present invention to the configuration and processing.

2 Image forming device (image processing device)
12 display unit 14 operation unit (operation reception unit)
15 Touch panel (operation reception unit)
17 image reading unit 18 image forming unit 19 storage unit 21 control unit 22 display control unit 23 rectangle extraction unit 24 identification information allocation unit 25 box information creation unit 27 image processing unit

Claims (4)

A display unit,
An image reading unit that reads an image of a document,
A rectangle extracting unit that extracts an image indicating a rectangle from a document image obtained by reading by the image reading unit, and detects a size and a position of the image indicating the rectangle in the document image,
An identification information allocating unit that sequentially allocates identification information to an image indicating a rectangle extracted by the rectangle extracting unit;
A display control unit that causes the display unit to display an image indicating a rectangle extracted by the rectangle extraction unit in the document image,
An operation receiving unit for receiving operation instructions from a user;
When the operation receiving unit receives a specification request to specify an image indicating a rectangle displayed on the display unit from the user as a box which is an input area in which input character data is input, The image indicating the rectangle specified in the box, the size and position of the image indicating the rectangle in the document image, and the identification information assigned to the image indicating the rectangle are associated with each other, and the box information of the box is set. A box information creation unit created as
A storage unit,
When the box information creating unit creates the box information, the control unit causes the storage unit to store the document image and a template including the box information ,
The box information creation unit is a standard box in which at least one character is input as the input character data as the type of the box specified by the specification request and the specification request from the user, and the input character data are The operation receiving unit issues a connection box in which a plurality of input boxes are connected as one box, and a selection request to select one of a check box in which a predetermined check mark is input as the input character data. If received, the image indicating the rectangle specified in the box in the specification request, the size and position of the image indicating the rectangle in the document image, and the identification information assigned to the image indicating the rectangle. By associating the type of the box selected by the selection request with the box type Image processing apparatus for creating as broadcast. 2. The image processing apparatus according to claim 1 , wherein the display control unit displays the boxes on the display unit using different display methods for each type of the box when the box information creating unit creates the box information. . The display control unit, after the operation receiving unit receives the specification request for specifying a box, performs a selection operation from the user on the operation receiving unit, and displays a display for receiving an instruction to change the size of the box. Let the display unit perform
The control unit, when the operation receiving unit receives a value indicating the size of the box after the change, changes the received size of the box after the change to the size of the image indicating the rectangle specified in the box. wherein as the magnitude of the original image, the image processing apparatus according to claim 1 or claim 2 is stored in the storage unit included in the box information. An image processing apparatus according to any one of claims 1 to 3 ,
An image forming apparatus, comprising: an image forming unit that forms a document image obtained by reading by the image reading unit on a recording medium.