JP6558331B2 - Image processing device - Google Patents

Description

  The present invention relates to an image processing apparatus.

  When an image processing apparatus such as a scanner or a copying machine has a function of executing an OCR (Optical Character Recognition) process for reading an image formed on a document and converting a character string image included in the read image into character string data There is.

  Further, the image processing device specifies additional information such as a phonetic symbol or a translated word corresponding to a word included in the character string data obtained by the OCR processing on the input image, and adds the additional information to the input image. It is known to execute a printing process on an added image (see, for example, Patent Document 1).

JP 2006-349836 A

  By the way, for example, known individual information such as name, department or telephone number may have to be entered in a predetermined entry field on a standard form such as an application form or a questionnaire form. In this case, it is troublesome to enter the individual information on the standard paper.

  An object of the present invention is to provide an image processing apparatus that can save the trouble of entering known individual information such as name, department or telephone number on a standard form.

  An image processing apparatus according to an aspect of the present invention includes a registration information acquisition unit, a keyword detection unit, a minimum region size specification unit, an effective free region determination unit, and an image composition unit. The registration information acquisition unit acquires registration information including a keyword and an insertion character string corresponding to the keyword from a nonvolatile storage unit. The keyword detection unit detects a keyword image corresponding to the keyword from a primary image represented by input image data. The minimum area size specifying unit specifies a minimum area size that is a size in which an image representing the inserted character string can be accommodated with a character having a predetermined minimum size. The effective empty area determination unit determines whether or not there is an effective empty area that is a non-image area equal to or larger than the minimum area size at a preset relative position based on the position of the keyword image in the primary image. judge. When the determination result that the effective empty area exists is obtained, the image composition unit outputs an image representing a secondary image in which an image representing the insertion character string is synthesized with the effective empty area in the primary image. Generate image data.

  According to the present invention, it is possible to provide an image processing apparatus that can save the trouble of entering known individual information such as name, department, or telephone number on a standard form.

FIG. 1 is a block diagram of an image processing apparatus according to the embodiment. FIG. 2 is a diagram illustrating an example of a configuration of registration data stored in the image processing apparatus according to the embodiment. FIG. 3 is a diagram illustrating an example of a standard sheet supplied as a document to the image processing apparatus according to the embodiment. FIG. 4 is a flowchart illustrating an example of a procedure of preparation processing in the image processing apparatus according to the embodiment. FIG. 5 is a flowchart illustrating an example of a procedure of character string image composition processing in the image processing apparatus according to the embodiment. FIG. 6 is a diagram illustrating an example of a keyword image in a part of the primary image and an effective empty area larger than the reference area size. FIG. 7 is a diagram illustrating an example of a keyword image and a reference size insertion image in a part of the secondary image. FIG. 8 is a diagram illustrating an example of a keyword image and a valid empty area smaller than the reference area size in a part of the primary image. FIG. 9 is a diagram illustrating an example of a keyword image in a part of the secondary image output by the image processing apparatus according to the embodiment and an insertion image smaller than the reference size. FIG. 10 is a diagram illustrating an example of a secondary image formed on a sheet. FIG. 11 is a flowchart illustrating an example of a procedure of additional image generation processing in the image processing apparatus according to the embodiment. FIG. 12 is a diagram illustrating an example of an additional image output by the image processing apparatus according to the embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In addition, the following embodiment is an example which actualized this invention, Comprising: It does not have the character which limits the technical scope of this invention.

[Configuration of Image Processing Device 10]
The image processing apparatus 10 can execute a process of reading the primary image Gx0 formed on the document 900, combining another image with the read primary image Gx0, and outputting the combined secondary image Gy0.

  The output process of the secondary image Gy0 is, for example, a printing process for forming the secondary image Gy0 on the sheet 901, or a process for transmitting the secondary image data Dy0 representing the secondary image Gy0 to the external device through the communication line 100. is there. The secondary image data Dy0 is an example of output image data.

  For example, it is conceivable that the image processing apparatus 10 is a copying machine, a facsimile machine, or a multifunction machine. In FIG. 1, the document 900 and the sheet 901 are indicated by virtual lines. The sheet 901 is a sheet-like image forming medium such as paper or film.

  The communication line 100 is, for example, a LAN (Local Area Network). In addition to the communication line 100 being a LAN and the Internet, the communication line 100 may be a public telephone line.

  As shown in FIG. 1, the image processing apparatus 10 includes a main control unit 1, an image reading unit 2, a reading control unit 3, an image forming unit 4, a printing control unit 5, a communication unit 6, an image processing unit 7, and an operation display. Part 8 and the like. The main control unit 1, the reading control unit 3, the printing control unit 5, the communication unit 6, and the image processing unit 7 can exchange data with each other through the bus 9.

  The image reading unit 2 includes an optical system (not shown) that scans the document 900 with light, an image sensor (not shown) that detects the amount of reflected light from the document 900 for each pixel, and outputs primary image data Dx0. . The image reading unit 2 reads an image of the original 900 and executes processing for generating primary image data Dx0 representing the read image. Hereinafter, this process is referred to as an image reading process. The primary image data Dx0 is an example of input image data.

  The reading control unit 3 controls the image reading unit 2 and acquires primary image data Dx0 from the image reading unit 2. Further, the reading control unit 3 transfers the primary image data Dx0 to the image processing unit 7 or the communication unit 6.

  The image forming unit 4 forms an image on the sheet 901 by a well-known electrophotographic or inkjet image forming process.

  The print control unit 5 acquires image data for printing from the image processing unit 7 and causes the image forming unit 4 to execute processing for forming an image based on the image data for printing on the sheet 901. The secondary image data Dy0 representing the secondary image Gy0 described above is an example of the printing image data.

  The communication unit 6 transmits / receives data to / from an external device through the communication line 100. All data transmission / reception between the image processing apparatus 10 and the external apparatus is performed through the communication unit 6. Furthermore, the communication unit 6 exchanges data with each element device such as the main control unit 1, the reading control unit 3, and the print control unit 5 through the bus 9.

  The image processing unit 7 executes various types of image processing on the primary image data Dx0 and print job data obtained through the communication unit 6. As will be described later, the image processing unit 7 has a function of executing character recognition processing for converting a character string image included in the primary image Gx0 into character string data. That is, the image processing apparatus 10 has a function of executing OCR processing.

  The reading control unit 3, the printing control unit 5, and the image processing unit 7 are configured by, for example, a DSP (Digital Signal Processor) or an ASIC (Application Specific Integrated Circuit).

  The operation display unit 8 is a user interface and includes an operation unit 8A and a display unit 8B. The operation unit 8A is a device that inputs information in accordance with a user operation, and includes, for example, a touch panel and operation buttons. The display unit 8B is a device that displays information, and includes, for example, a liquid crystal display panel and a notification lamp.

  The main control unit 1 controls the image processing apparatus 10 in an integrated manner. For example, the main control unit 1 displays an operation menu or the like on the operation display unit 8. Further, the main control unit 1 outputs a control command to another control unit in accordance with input information input through an operation on the operation unit 8A and detection results of various sensors.

  As shown in FIG. 2, the main control unit 1 includes an MPU (Micro Processor Unit) 1A, a RAM (Random Access Memory) 1B, a secondary storage unit 1C, and the like.

  The MPU (1A) is a processor that executes various operations and data processing. The RAM 12 is a volatile main storage unit that temporarily stores programs Pr1 to Pr5 to be executed by the MPU (1A).

  The secondary storage unit 1C is a computer-readable non-volatile storage unit. The secondary storage unit 1C stores programs Pr1 to Pr5 for causing the MPU (1A) to execute various processes, data referred to by the MPU (1A), and data written by the MPU (1A).

  In the present embodiment, registration data D0 including information related to the user of the image processing apparatus 10 is stored in advance in the secondary storage unit 1C. For example, as shown in FIG. 2, the registration data D0 includes a plurality of item data D1 and a plurality of personal data D2 respectively associated with the plurality of item data D1.

  In the example shown in FIG. 2, the plurality of item data D1 includes a user ID (D1a) representing user identification data, a user name D1b, a department D1c to which the user belongs, and the like. The personal data D2 is individual data of the user corresponding to the plurality of item data D1.

  The registration data D0 also includes registration authentication information (not shown) such as a password. The MPU (1A) of the main control unit 1 executes user authentication processing for collating input authentication information input through the operation display unit 8 with the registration authentication information stored in the secondary storage unit 1C in advance. The MPU (1A) executes the user authentication process by executing the authentication program Pr1.

  The MPU (1A) allows the use of the image processing apparatus 10 only to users who have succeeded in the user authentication process.

  By the way, there are cases where known individual information such as name, department or telephone number has to be entered in a predetermined entry field on a standard form 900x such as an application form or a questionnaire form (see FIG. 3).

  The standard form 900x shown in FIG. 3 includes a user ID (D1a), a name D1b, and an entry field F0 in which the contents of the personal data D2 corresponding to the department D1c are to be described. It is troublesome to enter the contents of the personal data D2 in the entry field F0 of the standard form 900x.

  The personal data D2 corresponding to the user ID (D1a), name D1b, department D1c, etc. in the registration data D0 is an example of the individual information.

  The image processing apparatus 10 executes the character string image composition processing described later, thereby obtaining the contents of the personal data D2 corresponding to the item data D1 such as the user ID (D1a), the name D1b, and the department D1c included in the registration data D0. It is possible to save the trouble of filling in the standard form 900x.

  In the character string image composition processing, the content of the item data D1 is used as a keyword, and an image representing the insertion character string corresponding to the keyword is synthesized in the entry field F0 next to the image representing the keyword in the primary image Gx0. This is a process of outputting the subsequent secondary image Gy0. In the present embodiment, the insertion character string corresponding to the keyword is a character string represented by the personal data D2 corresponding to the item data D1.

  In the following description, an image of a character string corresponding to the keyword in the primary image Gx0 is referred to as a keyword image G1 (see FIGS. 3 and 6 to 10). In the present embodiment, the keyword image G1 is a character string image represented by the item data D1.

  The primary image Gx0 shown in FIG. 3 includes a first keyword image G1a corresponding to the user ID (D1a), a second keyword image G1b corresponding to the name D1b, and a third keyword image G1c corresponding to the department D1c. .

  An image representing the insertion character string is referred to as an insertion image G2 (see FIGS. 7, 9, and 10). In the present embodiment, the insertion image G2 is a character string image represented by the personal data D2.

  In order to execute the character string image composition process, the image processing unit 7 includes a registration information acquisition unit 7A, a keyword detection unit 7B, a region size identification unit 7C, a neighborhood non-character determination unit 7D, an effective free region determination unit 7E, and an image. A synthesis unit 7F is included. Further, the MPU (1A) of the main control unit 1 executes a preparation process before the character string image composition process is executed.

[Preparation process]
Hereinafter, an example of the preparation process will be described with reference to the flowchart shown in FIG. In the following description, S101 to S104 represent identification codes of steps executed in the preparation process.

<Step S101>
In the preparation process, the MPU (1A) acquires the input authentication information through an input operation on the operation unit 8A, and executes the user authentication process. When the user authentication process is successful, the MPU (1A) shifts the process to the next step S102.

  Although not shown in FIG. 4, when the user authentication process fails, the MPU (1A) displays a predetermined error message on the display unit 8B, and then repeats the process of step S101. The process of step S101 is realized by the MPU (1A) that executes the authentication program Pr1.

<Step S102>
When the user authentication process is successful, the MPU (1A) executes a relative position selection process for selecting a relative position based on the position of the keyword image G1 in the primary image Gx0 in accordance with a selection operation on the operation unit 8A.

  The relative position is, for example, a right position or a lower position of the keyword image G1 in the primary image Gx0. In the relative position selection process, the MPU (1A) determines whether or not there is an effective empty area A0 to be described later from a plurality of predetermined candidate positions including at least a right position and a lower position with respect to the keyword image G1. The relative position used in the above is selected.

  For example, the plurality of candidate positions may include a right position, a lower position, and a left position with respect to the keyword image G1. It is also conceivable that the MPU (1A) individually selects the relative position for each of the plurality of item data D1. In this case, the MPU (1A) selects the relative position for each keyword.

  The process of step S102 is realized by the MPU (1A) that executes the relative position selection program Pr2. The MPU (1A) that executes the process of step S102 is an example of a relative position selection unit.

  When the standard paper 900x as shown in FIG. 3 is used as the original 900, the right position of the keyword image G1 is selected as the relative position in step S102.

<Step S103>
If the user authentication process is successful, the MPU (1A) also executes a first operation mode selection process. In the first operation mode selection process, the MPU (1A) selects one of the once mode and the repeat mode as the first operation mode in accordance with the mode designation operation on the operation unit 8A.

  As will be described later, the one-time mode is an operation mode in which the insertion image G2 is synthesized only in the valid entry field F0 detected first for each keyword in the primary image Gx0. On the other hand, the repetition mode is an operation mode in which the insertion image G2 is combined with all valid entry fields F0 detected for each keyword in the primary image Gx0.

  The process of step S103 is realized by the MPU (1A) that executes the first operation mode selection program Pr3. The MPU (1A) that executes the process of step S103 is an example of an operation mode selection unit.

<Step S104>
When the user authentication process is successful, the MPU (1A) may execute the second operation mode setting process. In the second operation mode setting process, the MPU (1A) can set, as an operation mode, an original writing mode in which the original 900 (standard paper 900x) is used as the image forming sheet 901 in accordance with the setting operation on the operation unit 8A. is there.

  The initial value of the second operation mode is the normal mode. When the second operation mode is the normal mode, the character string image composition process is executed. When the second operation mode is the original document addition mode, the additional image generation process shown in FIG. 11 is executed instead of the character string image synthesis process.

  When the setting operation is not performed on the operation unit 8A, the process of step S104 is skipped, and the normal mode is automatically set as the second operation mode. When the process of step S104 is skipped, or when the process of step S104 ends, the preparation process ends.

  The process of step S104 is realized by the MPU (1A) that executes the second operation mode setting program Pr4. The MPU (1A) that executes the process of step S104 is an example of a document appending mode setting unit.

[String image composition processing]
Next, an example of the procedure of the character string image composition processing will be described with reference to the flowchart shown in FIG. In the following description, S201, S202,... Represent process identification codes executed in the character string image composition process.

  When a predetermined start operation is performed on the operation unit 8A in a state where the normal mode is set as the second operation mode, the MPU (1A) of the main control unit 1 performs the character string image. Start the synthesis process. The user sets the document 900 (standard sheet 900x) on which the primary image Gx0 is formed on the document table or the document transport device of the image processing apparatus 10, and then performs the start operation on the operation unit 8A.

<Step S201>
First, the reading control unit 3 causes the image reading unit 2 to execute the image reading process. As a result, the image reading unit 2 reads the primary image Gx0 formed on the document 900 and generates primary image data Dx0 representing the primary image Gx0. The primary image data Dx0 is transferred to the image processing unit 7.

<Step S202>
Next, the registration information acquisition unit 7A of the image processing unit 7 acquires registration data D0 corresponding to the user who has succeeded in the user authentication processing from the secondary storage unit 1C. Hereinafter, the image processing unit 7 uses the plurality of item data D1 and personal data D2 included in the registration data D0 acquired in step S202 as the keyword and the inserted character string corresponding to the keyword.

<Step S203>
Next, the keyword detection unit 7B selects one of the plurality of keywords obtained in step S202. The keyword detection unit 7B selects one of the plurality of keywords in order each time the process of step S203 is executed. The selected keyword is used in the following processing.

<Step S204>
Next, the keyword detection unit 7B detects the keyword image G1 corresponding to the keyword selected in step S203 from the primary image Gx0 represented by the primary image data Dx0.

  In step S204, the keyword detection unit 7B converts a character string image included in the primary image data Dx0 into character string data by executing a known character recognition process. Further, the keyword detecting unit 7B searches the character string data for a character string that matches the keyword. Then, the keyword detection unit 7B detects the character string image corresponding to the character string that matches the keyword as the keyword image G1 (see FIG. 3).

  In the character recognition process, the keyword detection unit 7B specifies the line direction of the character string in the primary image Gx0, and performs character recognition in the primary image Gx0 according to the specified line direction and a preset language type. Identify the origin and direction.

  If the keyword image G1 cannot be detected from the primary image Gx0, the keyword detection unit 7B shifts the process to step S212 described later. Further, when the keyword detection unit 7B detects the keyword image G1 from the primary image Gx0, the keyword detection unit 7B shifts the processing to the next step S205.

<Step S205>
In step S205, the region size specifying unit 7C executes processing for specifying the minimum region size and the reference region size.

  The minimum area size is a size in which an insertion image G2 representing the insertion character string can be accommodated with characters of a predetermined minimum size. For example, when the minimum size is equivalent to the character size of 9 points and the number of characters in the inserted character string is 10, the area size specifying unit 7C is necessary to arrange the characters of 9 points in size for 10 characters. Is specified as the minimum area size.

  The predetermined minimum size information includes character size information and character spacing information. When specifying the minimum area size, the area size specifying unit 7C calculates the ratio between the size of the character itself and the character interval in the information on the minimum character size, and calculates the ratio between the size of the character image and the character interval in the insertion image G2. Adopt as a ratio.

  On the other hand, in the process of specifying the reference area size, the area size specifying unit 7C first specifies the reference character size that is the size of the character image included in the keyword image G1 detected in step S204. For example, the region size specifying unit 7C specifies the size of the largest character image included in the keyword image G1 or the average size of the character images included in the keyword image G1 as the reference character size.

  Further, the region size specifying unit 7C specifies a combination of the size of the character image itself included in the keyword image G1 and the character interval that is the interval between two adjacent character images as the reference character size.

  Next, the region size specifying unit 7C specifies a size in which the inserted image G2 representing the inserted character string within the characters of the reference character size can be accommodated as the reference region size. For example, when the standard character size is equivalent to the character size of 13 points and the number of characters in the inserted character string is 10, the area size specifying unit 7C arranges the characters of 13 points in size for 10 characters. A necessary size is specified as the reference area size.

  When specifying the reference region size, the region size specifying unit 7C determines the ratio between the size of the character image itself and the character spacing in the standard character size, and the ratio between the size of the character image and the character spacing in the insertion image G2. Adopt as.

  The area size specifying unit 7C that executes the process of specifying the minimum area size in step S205 is an example of the minimum area size specifying unit. Similarly, the region size specifying unit 7C that executes the process of specifying the reference region size in step S205 is an example of a reference region size specifying unit.

<Step S206>
Next, the vicinity non-character determination unit 7D determines whether or not the non-character image G3 exists in the vicinity of the keyword image G1 at the relative position with respect to the position of the keyword image G1 in the primary image Gx0.

  In the example illustrated in FIGS. 3 and 6, the nearby non-character determining unit 7 </ b> D determines that the image of the symbol “:” present near the right side of the keyword image G <b> 1 is the non-character image G <b> 3. In this case, the relative position is a position on the right side of the keyword image G1.

  The neighborhood non-character determining unit 7D sets a neighborhood range of the keyword image G1, which is a detection range of the non-character image G3, based on the reference character size specified in step S205, for example. In this case, the neighborhood non-character determining unit 7D sets a range corresponding to the reference character size or a range corresponding to the character size obtained by multiplying the reference character size by a predetermined coefficient as the neighborhood range. It is possible.

<Step S207>
Next, the effective empty area determination unit 7E determines whether or not the effective empty area A0 exists at the relative position based on the position of the keyword image G1 in the primary image Gx0 (see FIG. 6). The effective empty area A0 is a non-image area that is equal to or larger than the minimum area size specified in step S205.

  In FIG. 6, a first free area A1 representing the range of the minimum area size and a second free area A2 representing the range of the reference area size are indicated by virtual lines.

  If it is determined in step S206 that the non-character image G3 is present in the vicinity of the keyword image G1, the valid empty area determination unit 7E uses the position of the non-character image G3 in the vicinity of the keyword image G1 as a reference. It is determined whether or not an effective free area A0 exists at the relative position.

  In the example shown in FIG. 6, the valid free space determination unit 7E has a valid free space A0 at the right position with reference to the position of the “:” image in the vicinity of the right side of the keyword image G1. It is determined whether or not.

  In step S207, the effective empty area determination unit 7E determines whether the effective empty area A0 is an area equal to or larger than the reference area size. That is, when it is determined that the valid free area A0 exists, the valid free area determination unit 7E determines whether the valid free area A0 includes the second free area A2.

  An effective empty area A0 shown in FIG. 6 is an area including the second empty area A2 or more, that is, an area larger than the reference area size. On the other hand, the effective empty area A0 shown in FIG. 8 is an area smaller than the reference area size, that is, an area smaller than the second empty area A2.

  If the valid free area determination unit 7E determines that there is no valid free area A0 corresponding to the keyword image G1, the process proceeds to step S113 described later. On the other hand, when the effective empty area determination unit 7E determines that the effective empty area A0 corresponding to the keyword image G1 is an area equal to or larger than the reference area size, the process proceeds to step S209 described later. On the other hand, when the valid free area determination unit 7E determines that the valid free area A0 corresponding to the keyword image G1 is an area smaller than the reference area size, the process proceeds to the next step S208.

<Step S208>
When the determination result that the effective empty area A0 is an area smaller than the reference area size is obtained (see FIG. 8), the MPU (1A) specifies the insertion character string according to the size setting operation on the operation unit 8A. Set the size.

  However, the MPU (1A) sets the designated size within a range in which the insertion image G2 representing the insertion character string having the designated size is within the effective empty area A0. Thereafter, the MPU (1A) shifts the process from step S208 to step S210 described later.

  For example, the MPU (1A) executes a process of setting the specified size while displaying a preview image including the inserted image G2 combined with the keyword image G1 and the effective empty area A0 on the display unit 8B. In this case, the MPU (1A) causes the display unit 8B to display the preview image including the insertion image G2 representing the insertion character string having the designated size set according to the size setting operation on the operation unit 8A.

  The process of step S208 is realized by the MPU (1A) that executes the size designation program Pr5. The MPU (1A) that executes the process of step S208 is an example of a size designation unit.

<Step S209>
When the determination result that the effective empty area A0 is an area larger than the reference area size is obtained (see FIG. 6), the MPU (1A) sets the reference character size specified in step S205 as the specified size. Set. Thereafter, the MPU (1A) shifts the process from step S209 to the next step S210.

  The process of step S209 is also realized by the MPU (1A) that executes the size designation program Pr5.

<Step S210>
In step S210, the image composition unit 7F generates secondary image data Dy0 representing the secondary image Gy0 in which the insertion image G2 representing the insertion character string having the specified size is synthesized in the effective empty area A0 in the primary image Gx0. (See FIGS. 7, 9, and 10).

  If it is determined in step S207 that the effective empty area A0 is an area equal to or larger than the reference area size, the designated size is the reference character size. Therefore, when the determination result that the effective empty area A0 is an area larger than the reference area size is obtained, the secondary image data Dy0 is stored in the effective empty area A0 in the primary image Gx0 with characters of the reference character size. This is image data representing a secondary image Gy0 synthesized with an insertion image G2 representing the insertion character string (see FIG. 9).

  On the other hand, when the determination result that the effective empty area A0 is an area smaller than the reference area size is obtained, the secondary image data Dy0 is stored in the effective empty area A0 in the primary image Gx0 in the step S208. This is image data representing a secondary image Gy0 obtained by synthesizing an insertion image G2 representing the insertion character string with characters of a specified size (see FIG. 9).

<Step S211>
Next, the image composition unit 7F selects a processing transfer destination according to whether the first operation mode is the repeat mode or the one-time mode.

  That is, when the first operation mode is the repeat mode, the image composition unit 7F shifts the process to step S212, and when the first operation mode is the one-time mode, shifts the process to step S213. .

<Step S212>
In step S212, the keyword detection unit 7B selects a process transfer destination depending on whether or not the processes in steps S205 to S210 have been executed for all keyword images G1 that can be detected from the primary image Gx0.

  That is, when the processes of steps S205 to S210 are executed for all the keyword images G1 that can be detected from the primary image Gx0, the keyword detection unit 7B shifts the process to step S213. Otherwise, the keyword detection unit 7B Then, the process proceeds to step S204.

  Therefore, when the repeat mode is selected, the processes in steps S205 to S210 are executed for all keyword images G1 that can be detected from the primary image Gx0. In other words, when the repetition mode is selected, the image composition unit 7F represents the insertion character string in the effective empty area A0 corresponding to all the keyword images G1 that the keyword detection unit 7B has detected from the primary image Gx0. The insertion image G2 is synthesized (210).

<Step S213>
In step S213, the keyword detection unit 7B selects a process transfer destination depending on whether or not all the keywords have been selected in the process of step S203. Here, all the item data D1 obtained in step S202 are all the keywords that can be selected.

  That is, when all the keywords are selected, the keyword detection unit 7B shifts the process to step S214. Otherwise, the keyword detection unit 7B shifts the process to step S203.

<Step S214>
In step S214, the print control unit 5 causes the image forming unit 4 to execute a printing process for forming the secondary image Gy0 on the sheet 901 based on the secondary image data Dy0 generated by the image composition unit 7F. Thereafter, the print control unit 5 ends the character string image composition process.

  FIG. 10 is an example of a sheet 901 on which a secondary image Gy0 generated when the first operation mode is the one-time mode is formed. The secondary image Gy0 shown in FIG. 10 includes a first insertion image G2a representing personal data D2 corresponding to the user ID (D1a), a second insertion image G2b representing personal data D2 corresponding to the name D1b, and a department D1c. And a third insertion image G2c representing personal data D2 corresponding to.

  If the image processing apparatus 10 is employed, it is possible to save the trouble of entering known individual information such as a name or department on the standard form 900x.

  In the image processing apparatus 10, if the size of the effective empty area A0 is sufficiently large, the image composition unit 7F uses the characters of the same size as the character image in the keyword image G1 in the effective empty area A0 in the primary image Gx0. Secondary image data Dy0 representing the secondary image Gy0 synthesized with the insertion image G2 representing the insertion character string is generated (see FIGS. 7 and 10).

  Therefore, the character size is unified between the keyword image G1 and the insertion image G2, and a secondary image Gy0 that is easy to see without feeling uncomfortable is obtained.

  On the other hand, when the size of the effective empty area A0 is small, the image composition unit 7F synthesizes the insertion image G2 representing the insertion character string with the character of the specified size set by the user in the effective empty area A0 in the primary image Gx0. Secondary image data Dy0 representing the generated secondary image Gy0 is generated (see FIG. 9). Thereby, it can respond to various fixed form paper 900x.

  Further, the image processing apparatus 10 can select the relative position used for determining the presence / absence of the effective empty area A0 from a plurality of candidate positions (S102 in FIG. 4). Accordingly, it is possible to deal with various standard forms 900x having different positional relationships between the keyword image G1 and the entry field F0.

  In addition, when the non-character image G3 exists in the vicinity of the keyword image G1, the effective empty area determination unit 7E determines whether or not the effective empty area A0 exists at the relative position based on the position of the non-character image G3. Determine. Thus, even when a symbol, ruled line, or noise image such as a colon “:” or a hyphen “−” exists between the keyword image G1 and the entry field F0, the inserted image G2 is a non-character image in the primary image Gx0. It is synthesized at an appropriate position that does not overlap with G3.

  Further, when the repetition mode is selected as the first operation mode, the image composition unit 7F inserts an image into the effective empty area A0 corresponding to all the keyword images G1 that the keyword detection unit 7B has detected from the primary image Gx0. Synthesize G2.

  On the other hand, when the one-time mode is selected as the first operation mode, the image composition unit 7F corresponds to the keyword image G1 first detected by the keyword detection unit 7B from the primary image Gx0 for each selected keyword. The inserted image G2 is synthesized only in the effective empty area A0.

  Since the image processing apparatus 10 can switch processing according to the first operation mode, it can be applied to various applications.

[Additional image generation processing]
Next, an example of the procedure of the additional image generation process that is executed when the document additional recording mode is set as the second operation mode in the preparation process will be described.

  In the following description, S301, S302,... Represent process identification codes executed in the additional image generation process.

  In steps S301 to S314 shown in FIG. 11, the remaining steps S301 to S309 and S311 to S313 except for steps S310 and S314 are the same as steps S201 to S209 and S211 to S213 shown in FIG. That is, the procedure of the additional image generation process shown in FIG. 11 is a procedure in which steps S210 and S214 are replaced with steps S310 and S314 based on the procedure of the character string image composition process shown in FIG. is there.

  Hereinafter, differences from the character string image composition processing in the additional image generation processing will be described. The image processing unit 7 further includes an additional image generation unit 7G in order to execute the additional image generation process.

<Step S310>
The process of step S310 is executed when the MPU (1A) shifts the process from step S308 to step S310, or when the MPU (1A) shifts the process from step S309 to step S310.

  In step S310, the additional image generation unit 7G generates additional image data Dz0 representing the additional image Gz0 including only the insertion image G2 representing the insertion character string at the same position as the position of the effective empty area A0 in the primary image Gx0 ( (See FIG. 1).

  As illustrated in FIG. 12, the additional image Gz0 is not an image obtained by combining the insertion image G2 with the primary image Gx0, but is a new image including only the insertion image G2. However, the position of the insertion image G2 in the additional image Gz0 corresponds to the position of the entry field F0 in the primary image Gx0 (see FIG. 3).

  Note that the process of step S310 is executed when the document additional recording mode is set as the second operation mode and a determination result that an effective empty area A0 exists in the primary image Gx0 is obtained.

  When all the keywords are selected by the process of step S303, the keyword detection unit 7B shifts the process from step S313 to step S314.

  Further, the MPU (1A) displays a message that prompts the user to set the original 900 (standard paper 900x) as the sheet 901 in the sheet supply unit of the image processing apparatus 10 before the process proceeds from step S313 to step S314. 8B is displayed.

  Further, after an operation for confirming that the document 900 (standard sheet 900x) is set in the sheet supply unit is performed on the operation unit 8A, the MPU (1A) allows the process to proceed to step S314.

<Step S314>
In step S314, the print control unit 5 causes the image forming unit 4 to execute a printing process for forming the additional image Gz0 on the sheet 901 based on the additional image data Dz0 generated by the additional image generating unit 7G. Thereafter, the print control unit 5 ends the additional image generation process.

  The output sheet obtained by executing the additional image generation process is the standard paper 900x in which the insertion image G2 is additionally written in the entry field F0.

  The additional image generation process is effective when it is desired to add the additional image Gz0 to the standard paper 900x itself.

[Application example]
In the character string image synthesizing process of the image processing apparatus 10 shown above, instead of executing the printing process for forming the secondary image Gy0 on the sheet 901, the secondary image data Dy0 is transmitted to the other apparatus through the communication unit 6. It is also conceivable that the process of transmitting to is executed.

  In the image processing apparatus 10, it is also conceivable that the image processing unit 7 obtains the primary image data Dx0 from the external device through the communication unit 6 instead of obtaining the primary image data Dx0 through the image reading unit 2.

  The image processing apparatus according to the present invention can be freely combined with the above-described embodiments and application examples, or can be appropriately modified within the scope of the invention described in each claim. Alternatively, it may be configured by omitting a part.

  In the image processing apparatus 10, it is also conceivable that the registration data D0 is stored in a secondary storage unit such as a hard disk drive of an external device. In this case, the registration information acquisition unit 7A acquires registration data D0 from the secondary storage unit of the external device through the communication unit 6. The secondary storage unit of the external device is an example of a computer-readable non-volatile storage unit.

1: Main control unit 1A: MPU
1C: Secondary storage unit 2: Image reading unit 3: Reading control unit 4: Image forming unit 5: Print control unit 6: Communication unit 7: Image processing unit 7A: Registration information acquisition unit 7B: Keyword detection unit 7C: Area size Specific part (minimum area size specific part, standard area size specific part)
7D: Neighboring non-character determining unit 7E: Effective empty region determining unit 7F: Image composition unit 7G: Additional image generating unit 8: Operation display unit 8A: Operation unit 8B: Display unit 9: Bus 10: Image processing device 12: RAM
100: Communication line 900: Document 900x: Standard paper 901: Sheet A0: Effective empty area A1: First empty area A2: Second empty area D0: Registration data (registration information)
D1: Item data (keyword)
D1b: Name D1c: Department D2: Personal data (inserted character string)
Dx0: primary image data Dy0: secondary image data Dz0: additional image data F0: entry field G1: keyword image G1a: first keyword image G1b: second keyword image G1c: third keyword image G2: insertion image G2a: first Inserted image G2b: Second inserted image G2c: Third inserted image G3: Non-character image Gx0: Primary image Gy0: Secondary image Gz0: Additional image Pr1: Authentication program Pr2: Relative position selection program Pr3: First operation mode selection program Pr4: second operation mode setting program Pr5: size designation program

Claims (8)

A registration information acquisition unit for acquiring registration information including a keyword and an insertion character string corresponding to the keyword from a non-volatile storage unit;
A keyword detection unit for detecting a keyword image corresponding to the keyword from a primary image represented by input image data;
A minimum area size specifying unit that specifies a minimum area size that is a size in which an image representing the insertion character string can be accommodated with a predetermined minimum size character;
An effective empty area determination unit that determines whether an effective empty area that is a non-image area equal to or larger than the minimum area size exists at a preset relative position with respect to the position of the keyword image in the primary image; ,
An image that generates output image data representing a secondary image in which an image representing the insertion character string is combined with the effective space in the primary image when a determination result that the effective space is present is obtained And an image processing apparatus. A reference area size specifying unit that specifies a reference character size that is a size of a character image included in the keyword image and specifies a reference area size that is a size in which an image representing the insertion character string is accommodated by characters of the reference character size In addition,
The effective free space determination unit determines whether or not the effective free space is an area larger than the reference area size,
When the determination result that the effective empty area is an area equal to or larger than the reference area size is obtained, the image composition unit inserts the reference character size character into the effective empty area in the primary image. The image processing apparatus according to claim 1, wherein the output image data representing the secondary image combined with an image representing a character string is generated. A size specification that sets the specified size of the inserted character string in accordance with a size setting operation for an operation unit that receives a user operation when a determination result is obtained that the effective empty area is an area smaller than the reference area size Further comprising
When the designated size is set, the image composition unit outputs the output image representing the secondary image in which the image representing the insertion character string of the designated size is synthesized with the effective empty area in the primary image. The image processing apparatus according to claim 2, which generates data.   According to a selection operation on an operation unit that accepts a user operation, it is used to determine whether or not there is an effective empty area from among a plurality of predetermined candidate positions including at least a right position and a lower position with respect to the keyword image. The image processing apparatus according to claim 1, further comprising a relative position selection unit that selects the relative position. A proximity non-character determining unit that determines whether or not a non-character image exists in the vicinity of the keyword image at the relative position based on the position of the keyword image;
When the determination result that the non-character image exists in the vicinity of the keyword image is obtained, the effective empty area determination unit determines the relative position based on the position of the non-character image in the vicinity of the keyword image. 5. The image processing apparatus according to claim 1, wherein the image processing apparatus determines whether or not the effective free area exists. According to a mode designating operation for an operation unit that accepts a user operation, the apparatus further includes a mode selection unit that can select one of a once mode and a repeat mode as an operation mode.
When the one-time mode is selected, the image synthesis unit synthesizes an image representing the insertion character string only in the effective empty area corresponding to the keyword image first detected from the primary image by the keyword detection unit. When the repetition mode is selected, the image composition unit displays an image representing the inserted character string in the effective empty area corresponding to all the keyword images detected by the keyword detection unit from the primary image. The image processing apparatus according to claim 1, wherein the image processing apparatus performs synthesis. An image reading unit that reads the primary image formed on a document and generates the input image data representing the primary image;
The image processing apparatus according to claim 1, further comprising: an image forming unit that forms the secondary image based on the output image data generated by the image combining unit on a sheet. A document appending mode setting unit capable of setting, as an operation mode, a document appending mode in which the document is used as the sheet for image formation in accordance with a setting operation on an operation unit that receives a user operation;
When the document appending mode is set and the determination result that the effective empty area exists is obtained, only the image representing the inserted character string is displayed at the same position as the position of the effective empty area in the primary image. An additional image generation unit that generates additional image data representing the additional image to be included,
The image forming unit forms the additional image based on the additional image data generated by the additional image generating unit on the original supplied as the sheet when the original writing mode is set. 8. The image processing apparatus according to 7.

Images