JP6323075B2 - Image processing device - Google Patents

Description

  The present specification discloses an image processing apparatus that performs image processing on original image data to generate processed image data representing a processed image.

  Patent Document 5 discloses a BEP device that is an image formation support device. The BEP device executes centering processing for moving the character area in the image data to the center of the page, calculates the enlargement ratio of the character area based on the margin around the moved character area, and enlarges the character area. Then, the BEP device lays out the character region after enlargement so that the upper end of the character region before enlargement matches the upper end of the character region after enlargement, and lays out the non-character region at the same position as the original. As a result, the character area is enlarged while the layout is substantially maintained.

JP 2012-108750 A JP 2012-230623 A JP 2011-242987 A JP 2010-183484 A JP-A-2005-223824 JP-A-5-94511 JP 2000-137801 A Japanese Patent Laid-Open No. 11-25283

“Automatic line breaks according to screen size! Displaying document files in an easy-to-read format on smartphones Layout reconstruction technology“ GT-Layout ”Online storage“ Dropbox ”service newly developed”, [online], May 2012 30th, Fuji Film Co., Ltd. [Search January 24, 2014], Internet <http://www.fujifilm.co.jp/corporate/news/articleffnr_0647.html>

  The present specification provides a technique capable of appropriately generating processed image data representing a processed image in which a specific object is enlarged and expressed using a method different from the above method.

  The image processing apparatus disclosed in this specification includes an acquisition unit and an image processing execution unit. The acquisition unit acquires original image data representing an original image including a plurality of objects including a specific object. The image processing execution unit executes image processing on the original image data, and generates processed image data representing a processed image including a plurality of objects. In the processed image, the specific object is expressed in an enlarged manner as compared with the original image. The image processing execution unit includes an object region determination unit, a space region determination unit, and a target region determination unit. The object area determination unit determines an object area including the object for each of the plurality of objects in the original image. The space area determination unit determines a space area including the specific object area determined for the specific object in the original image. The space area does not overlap with other object areas determined for other objects of the plurality of objects. The target area determination unit determines a target area in the processed image based on the specific object area and the space area in the original image. The target area is an area in which a specific object expressed in an enlarged manner is to be placed.

  In one aspect of the technology disclosed in this specification, the target area determination unit is orthogonal to the length of two margins along the first direction between the specific object area and the space area, and the first direction. Based on the lengths of the two margins along the second direction, the position of the target area in the processed image is determined. According to this configuration, since the image processing apparatus can appropriately determine the position of the target area, the process in which the specific object is expressed in an enlarged manner while substantially maintaining the positional relationship between the plurality of objects in the original image. Processed image data representing a completed image can be appropriately generated.

  In another aspect of the technology disclosed in the present specification, the target area determination unit is orthogonal to the length of two margins along the first direction between the specific object area and the space area, and the first direction. The aspect ratio of the target area in the processed image is determined based on the lengths of the two margins along the second direction. According to this configuration, the image processing apparatus can appropriately determine the aspect ratio of the target area, and thus can appropriately generate processed image data representing the processed image in which the specific object is enlarged and expressed.

  A control method, a computer program, and a computer-readable recording medium storing the computer program for realizing the image processing apparatus are also novel and useful.

1 shows a configuration of a communication system. 3 shows a flowchart of processing of an image processing server. The flowchart of a character string analysis process is shown. The flowchart of a joint process is shown. The flowchart of a target area | region determination process is shown. The flowchart of a blank area | region determination process is shown. The flowchart of an area expansion process is shown. An explanatory view for explaining processing for determining a target area while maintaining an aspect ratio is shown. An explanatory view for explaining processing for deciding a target area ignoring an aspect ratio is shown. The flowchart of a rearrangement process is shown. The flowchart of a line number determination process is shown. Explanatory drawing for demonstrating the case A where each character is rearranged and expanded is shown. Explanatory drawing for demonstrating the case B where each character is rearranged and expanded is shown. An explanatory view for explaining processing of a 2nd example for ignoring an aspect ratio and determining a target field is shown.

(First embodiment)
(Configuration of communication system 2)
As shown in FIG. 1, the communication system 2 includes a multi-function device 10 and an image processing server 50. The multi-function device 10 and the image processing server 50 can communicate with each other via the Internet 4. The multi-function device 10 is a peripheral device that can execute a multi-function including a print function, a scan function, a copy function, a FAX function, and the like (that is, a peripheral device such as a PC (abbreviation of personal computer) not shown). The image processing server 50 is a server provided on the Internet 4 by the vendor of the multi-function device 10.

(Outline of each process executed by the multi-function device 10)
Copy functions that can be executed by the multi-function device 10 are classified into a monochrome copy function and a color copy function. In the present embodiment, the description will be made focusing on the color copy function. The color copy function is classified into a normal color copy function and a character enlargement color copy function. Regardless of which color copy function execution instruction is given by the user, the multi-function device 10 first performs color scanning on a sheet representing an image to be scanned (hereinafter referred to as a “scanning sheet”) to obtain a scanned image. A data SID is generated. The scanned image data SID is RGB bitmap data having multiple gradations (for example, 256 gradations).

  The scan image SI represented by the scan image data SID (that is, the image represented on the scan target sheet) has a white background and includes two text objects OB1 and OB2 and one photo object OB3. The text object OB1 includes a three-line character string composed of a plurality of black characters “A to M”. The text object OB2 includes a two-line character string composed of a plurality of black characters “N to W”. The character color may be a color different from black (for example, red). The photo object OB3 does not include characters and includes a photo composed of a plurality of colors.

  In each figure of this embodiment, for convenience, each character string constituting each text object OB1, OB2 is represented by alphabets “A to W” arranged in a regular order. The character string constitutes a sentence. In each character string (that is, one line of character string), the sentence advances from the left side in the horizontal direction in the scan image SI toward the right side. In the three-line character string “A to M” and the two-line character string “N to W”, sentences progress from the upper side to the lower side in the vertical direction in the scan image SI. In any of the following images (for example, a processed image PI described later), a direction in which a plurality of characters constituting one line of character string are arranged and a direction orthogonal to the direction are respectively referred to as “lateral direction”, This is called “vertical direction”. Since sentences progress from the left side to the right side, the left end in the horizontal direction and the right end in the horizontal direction are referred to as “front end” and “rear end”, respectively.

  When a normal color copy function execution instruction is given from the user, the multi-function device 10 uses the scanned image data SID to print an image on a sheet (hereinafter “print”) according to the copy magnification set by the user. To the target sheet). For example, when the copy magnification is equal, the multi-function device 10 prints an image having the same size as the image expressed on the scan target sheet on the print target sheet. Further, for example, when the copy magnification is a magnification indicating the enlargement of the image, the multi-function device 10 prints an image having a size larger than the image expressed on the scan target sheet on the print target sheet. In this case, for example, the image expressed on the A4 size scan target sheet is enlarged and printed on the A3 size print target sheet. As a result, an image in which all the three objects OB1, OB2, and OB3 are enlarged and printed is printed on the print target sheet.

  On the other hand, the multi-function device 10 transmits the scan image data SID to the image processing server 50 via the Internet 4 when an instruction to execute the character enlargement color copy function is given from the user. Accordingly, the multi-function device 10 receives the processed image data PID from the image processing server 50 via the Internet 4 and prints the processed image PI represented by the processed image data PID on the print target sheet. In particular, the multi-function device 10 prints the processed image PI on a print target sheet having the same size (for example, A4 size) as the scan target sheet.

  In the processed image PI, the text objects OB1 and OB2 are enlarged and expressed without the photographic object OB3 being enlarged compared to the scanned image SI. Therefore, even if the size of each character in the scanned image SI is small, the size of each character is large in the processed image PI, so that the user can easily recognize each character in the processed image PI. . In addition, the number of characters (that is, “6”) of the character string “A to F” in the first line among the three lines of character strings “A to M” in the processed image PI is the number of characters in the three lines in the scanned image SI. It is different from the number of characters (namely, “5”) of the character string “A to E” in the first row of the column “A to M”. In addition, the length of the line between the character strings in the processed image PI (for example, the line space between “A to F” and “G to L”) is the length between the lines of each character string in the scanned image SI (for example, “A to E” ”And“ F to J ”).

(Configuration of the image processing server 50)
The image processing server 50 performs image processing on the scanned image data SID received from the multi-function device 10, generates processed image data PID, and transmits the processed image data PID to the multi-function device 10. To do. The image processing server 50 includes a network interface 52 and a control unit 60. The network interface 52 is connected to the Internet 4. The control unit 60 includes a CPU 62 and a memory 64. The CPU 62 is a processor that executes various processes (that is, the processes in FIG. 2 and the like) according to a program 66 stored in the memory 64.

(Each process executed by the image processing server 50; FIG. 2)
Next, the contents of each process executed by the CPU 62 of the image processing server 50 will be described with reference to FIG. When the CPU 62 receives the scan image data SID from the multi-function device 10 via the Internet 4, the CPU 62 starts the process of FIG.

  In S100, the CPU 62 executes a character string analysis process (see FIG. 3 described later), and determines five belt-like areas LA11 to LA13, LA21, LA22 including five lines of character strings in the scan image SI.

  In S200, the CPU 62 executes a combination process (see FIG. 4 described later), and generates two combined image data representing two combined images CI1 and CI2. The combined image CI1 includes one line of combined character strings “A to M” in which three lines of character strings included in the three belt-shaped areas LA11 to LA13 are linearly connected (ie, connected) along the horizontal direction. . The combined image CI2 includes a combined character string “N to W” in which two character strings included in the two strip regions LA22 and LA23 are linearly combined in the horizontal direction.

  In S300, the CPU 62 executes a target area determination process (see FIG. 5 described later) to determine two target areas TA1 and TA2 in the scan image SI. The two target areas TA1 and TA2 in the scanned image SI coincide with the two target areas TA1 and TA2 in the processed image PI (see the processed image PI in S500). Therefore, the process of S300 is equivalent to the process of determining the two target areas TA1 and TA2 in the processed image PI. The target area TA1 and the target area TA2 in the processed image PI are areas in which the character strings “A to M” and the character strings “N to W” expressed in an enlarged manner are to be arranged, respectively.

  In S400, the CPU 62 executes rearrangement processing (see FIG. 10 described later) to determine two rearrangement areas RA1 and RA2 corresponding to the two target areas TA1 and TA2. Then, the CPU 62 uses the combined image data representing the combined image CI1 to rearrange a plurality of characters “A to M” in the rearrangement region RA1, thereby rearranging the rearranged image data representing the rearranged image RI1. Is generated. The CPU 62 further rearranges a plurality of characters “N to W” in the rearrangement area RA2 by using the combined image data representing the combined image CI2, thereby rearranging the rearranged image data representing the rearranged image RI2. Is generated.

  In S500, the CPU 62 enlarges the two rearranged image data representing the two rearranged images RI1 and RI2, and generates two enlarged image data. Then, the CPU 62 generates processed image data PID representing the processed image PI using the two enlarged image data. In the processed image PI, each character is enlarged and expressed, but the processed image data PID has the same number of pixels as the scan data SID.

  In S <b> 600, the CPU 62 transmits the processed image data PID to the multi-function device 10 via the Internet 4. As a result, the processed image PI represented by the processed image data PID is printed on the target print sheet.

(Character string analysis processing; Fig. 3)
Next, the contents of the character string analysis process executed in S100 of FIG. 2 will be described with reference to FIG. In S110, the CPU 62 executes binarization processing on the scanned image data SID, and outputs binary data BD (only part of which is shown in FIG. 3) having the same number of pixels as the scanned image data SID. Generate. The CPU 62 first determines the background color (white in the present embodiment) of the scan image SI using the scan image data SID. Specifically, the CPU 62 generates a histogram indicating the frequency distribution of pixel values of a plurality of pixels in the scan image data SID. Then, the CPU 62 determines the background color by specifying the pixel value having the highest frequency (hereinafter referred to as “the highest frequency pixel value”) using the histogram. Next, for each of the plurality of pixels in the scan image data SID, the CPU 62, when the pixel value of the pixel matches the highest frequency pixel value, in the binary data BD existing at the position corresponding to the pixel. When “0” is assigned as the pixel value of the pixel and the pixel value of the pixel does not match the highest frequency pixel value, the pixel value of the pixel in the binary data BD existing at the position corresponding to the pixel is “ 1 ”is assigned. As a result, in the binary data BD, each pixel representing each character (eg, “A”, “B”) included in each text object OB1, OB2 indicates a pixel value “1”, and each pixel representing the photographic object OB3. Indicates a pixel value “1”, and other pixels (that is, pixels representing the background) indicate a pixel value “0”. Hereinafter, the pixel indicating the pixel value “1” and the pixel indicating the pixel value “0” in the binary data BD are referred to as “ON pixel” and “OFF pixel”, respectively.

  In S120, the CPU 62 performs a labeling process on the binary data BD generated in S110, and the label data LD having the same number of pixels as the binary data BD (only a part is shown in FIG. 3). Is generated). Specifically, the CPU 62 divides a plurality of ON pixels in the binary data BD into two or more ON pixel groups, and each of the two or more ON pixel groups has a different pixel value (for example, “1”). , “2”, etc.). One ON pixel group is composed of two or more ON pixels adjacent to each other. That is, when one or more ON pixels are included in eight adjacent pixels adjacent to one ON pixel to be labeled, the CPU 62 determines that the target ON pixel , One or more ON pixels among the eight adjacent pixels are divided (ie, grouped) into the same ON pixel group. The CPU 62 determines two or more ON pixel groups by sequentially executing grouping of each ON pixel while changing the ON pixels to be labeled. For example, in the label data LD of FIG. 3, the pixel value “1” is assigned to each ON pixel (that is, one ON pixel group) representing the character “A”, and each ON pixel representing the character “B” ( That is, the pixel value “2” is assigned to the other one ON pixel group).

  In S130, the CPU 62 determines each unit area corresponding to each of the ON pixel groups using the label data LD generated in S120. Each unit area is a rectangular area circumscribing one corresponding ON pixel group. For example, when using the label data LD of FIG. 3, the CPU 62 circumscribes the ON pixel group to which the pixel value “1” is assigned (that is, the unit region corresponding to the character “A”), A unit area circumscribing the ON pixel group to which the pixel value “2” is assigned (that is, a unit area corresponding to the letter “B”) is determined. More specifically, the CPU 62 selects 23 unit areas corresponding to 23 characters “A” to “W” and one unit corresponding to one photo object OB3 from the scanned image SI. (I.e., a total of 24 unit areas are determined). The determination of the unit area is executed by storing the position of each pixel constituting each vertex of the unit area in the memory 64. However, in the description below regarding “determination of region (or position)”, description regarding storing the pixel position in the memory 64 is omitted.

  In S140, the CPU 62 determines an object area in the scan image SI using the unit area determined in S130. Specifically, the CPU 62 divides the 24 unit areas into a plurality of unit area groups, and determines each object area corresponding to each unit area group. One unit region group is composed of one or more unit regions existing in the vicinity. When the distance (that is, the number of pixels) between the two unit areas is less than a predetermined distance, the CPU 62 divides the two unit areas into the same unit area group. The predetermined distance is determined in advance according to the resolution of the scan image data SID. For example, in this embodiment, the scan image data SID has a resolution of 300 dpi, and the predetermined distance corresponding to the resolution of 300 dpi is 10 pixels. In the label data LD of FIG. 3, the distance between the unit region RE1 corresponding to the character “A” and the unit region RE2 corresponding to the character “B” is 3 pixels. Therefore, the CPU 62 divides the unit area RE1 and the unit area RE2 into the same unit area group. Thereby, the CPU 62 can group each character (for example, “A” and “B”) existing in the vicinity, that is, each character constituting the same sentence. More specifically, for the scanned image SI, the CPU 62 includes a unit area group including 13 unit areas corresponding to 13 characters “A” to “M” in the text object OB1, and the text object OB2. A unit region group including ten unit regions corresponding to ten characters “N” to “W” and a unit region group including one unit region corresponding to one photo object OB3 are determined. (In other words, a total of three unit region groups are determined). Then, for each of the three unit area groups, the CPU 62 determines a rectangular area circumscribing the unit area group as an object area. That is, the CPU 62 selects, from the scanned image SI, the object area OA1 including 13 characters “A” to “M” in the text object OB1 and the 10 characters “N” to “W” in the text object OB2. ”And the object area OA3 including the photographic object OB3 (that is, a total of three object areas OA1 to OA3 are determined).

  In S150, the CPU 62 determines the type of the object area for each of the three object areas OA1 to OA3 determined in S140. Specifically, the CPU 62 determines whether each of the object areas OA1 to OA3 is a text object area including characters (hereinafter simply referred to as “text area”). First, the CPU 62 generates a histogram indicating the frequency distribution of the pixel values of a plurality of pixels constituting the partial image data representing the object area OA1 in the scanned image data SID. Then, the CPU 62 uses the histogram to calculate the number of pixel values having a frequency higher than zero (that is, the number of colors used in the object area OA1). When the calculated number is less than a predetermined number (for example, “10”), the CPU 62 determines that the object area OA1 is a text area, and when the calculated number is equal to or greater than the predetermined number. The object area OA1 is determined not to be a text area. The object area OA1 includes black characters “A” to “M” and a white background. Therefore, in the histogram corresponding to the object area OA1, the frequency of only two pixel values including the pixel value indicating black and the pixel value indicating white is usually higher than zero. Therefore, the CPU 62 determines that the object area OA1 is a text area. Similarly, the CPU 62 uses the histogram corresponding to the object area OA2 to determine that the object area OA2 is a text area. On the other hand, for example, in the photographic object OB3, ten or more colors are usually used. Therefore, in the histogram corresponding to the object area OA3, the number of pixel values having a frequency higher than zero is usually greater than or equal to the predetermined number. Therefore, the CPU 62 determines that the object area OA3 is not a text area (that is, determines that it is a photo object area).

  In S160, the CPU 62 executes a band-shaped area determination process on the two text areas OA1 and OA2 determined in S150. However, the CPU 62 does not execute the band-shaped area determination process on the photo object area OA3. Specifically, the CPU 62 first generates a projection histogram corresponding to the text area OA1. The projection histogram is an ON pixel (that is, a pixel indicating “1”) when each pixel representing the text area OA1 is projected in the horizontal direction among a plurality of pixels constituting the binary data BD (see S110). Shows the frequency distribution. In other words, the projection histogram shows the distribution of the frequency of the character constituent pixels when each pixel representing the text area OA1 is projected in the horizontal direction among the plurality of pixels constituting the scan image data SID. The character composing pixel is a pixel (that is, a pixel indicating black) constituting a character (for example, “A”) included in the text area OA1. In the projection histogram, a character string of one line (for example, “A to E”) is represented by a range in which the frequency is higher than zero (hereinafter referred to as “high frequency range”). (For example, the line spacing between “A to E” and “F to J”) is expressed in a range where the frequency is zero. Then, the CPU 62 determines one or more band-like regions corresponding to one or more high-frequency ranges using the projection histogram. The length in the vertical direction (that is, the number of pixels in the vertical direction) of one band-like region is equal to the length in the vertical direction of the high-frequency range corresponding to the band-like region. Further, the length in the horizontal direction (that is, the number of pixels in the horizontal direction) of one band-like area is equal to the length in the horizontal direction of the object area OA1. More specifically, the CPU 62 selects, from the text area OA1, a band-shaped area LA11 including the character string “A to E”, a band-shaped area LA12 including the character string “F to J”, and the character string “K to M”. ”Including the band-like area LA13 (that is, a total of three band-like areas LA11 to LA13 are decided). Similarly, the CPU 62 determines, from the text area OA2, a band-shaped area LA21 (see S100 in FIG. 2) including the character string “N to R” and a band-shaped area LA22 including the character string “S to W”. (I.e., a total of two strip regions are determined). When S160 ends, the process of FIG. 3 ends.

(Combining process; FIG. 4)
Next, the contents of the combining process executed in S200 of FIG. 2 will be described with reference to FIG. In S210, the CPU 62 determines one text area of the two text areas OA1 and OA2 as a processing target. Hereinafter, a case where the text area OA1 is determined as a processing target will be described as an example.

  In S220, the CPU 62 generates combined image data representing the combined image CI1 in which the three lines of character strings “A to M” included in the text area OA1 are combined. Specifically, the CPU 62 acquires three partial image data representing the three strip regions LA11 to LA13 (see S160 in FIG. 3) determined for the text region OA1 from the scanned image data SID. Then, the CPU 62 converts the acquired three partial image data so that the three character strings “A to M” in the three belt-like areas LA11 to LA13 are linearly combined along the horizontal direction. The combined image data representing the combined image CI1 is generated by combining. At this time, the CPU 62 determines a margin of a predetermined length in the horizontal direction between the two character strings to be combined (that is, a margin between “E” and “F”, and “J” and “K”. In order to form a blank space between “), pixels representing the blank space, that is, pixels having the background color of the scanned image SI are supplemented to generate combined image data. That is, the CPU 62 combines the three partial image data via the pixels to be supplemented, and generates combined image data representing the combined image CI1. It should be noted that the CPU 62 removes the margin on the rear end side in the strip area LA13 (that is, the margin on the right side of the character string “K to M”) from the partial image data representing the strip area LA13. Delete the data representing the margin. As a result, combined image data representing the combined image CI1 having no margin on the rear end side of the character string “A to M” is generated.

  In S230, the CPU 62 executes binarization processing on the combined image data generated in S220. The contents of the binarization process are the same as S110 in FIG.

  In S240, the CPU 62 determines a plurality of division candidate positions in the combined image data generated in S220 using the binary data generated in S230. The division candidate positions are division position candidates for dividing the combined image data in the rearrangement process (S400 in FIG. 2, see FIG. 10 described later). First, the CPU 62 generates a projection histogram using the binary data. The projection histogram shows the frequency distribution of ON pixels (that is, character constituent pixels) when the pixels constituting the binary data are projected in the vertical direction. In the projection histogram, one character (for example, “A”) is represented in a range where the frequency is higher than zero, and a margin between two characters (for example, a margin between “A” and “B”). Portion) is represented by a range in which the frequency is zero (hereinafter referred to as “zero frequency range”). And CPU62 determines the right end of each zero frequency range as a division | segmentation candidate position using a projection histogram. Thus, since the blank portion between the two characters is determined as the division candidate position, it is possible to suppress the division between one character (for example, “A”). In the modification, the CPU 62 may determine the left end of each zero frequency range as the division candidate position, or may determine the intermediate position of each zero frequency range as the division candidate position.

  In S250, the CPU 62 determines whether or not the processing of S210 to S240 has been completed for all the text areas OA1 and OA2. If the CPU 62 determines that the process has not ended (NO in S250), the CPU 62 determines an unprocessed text area (for example, OA2) as a processing target in S210. As a result, as described above, the CPU 62 generates combined image data representing the combined image CI2 (see S200 in FIG. 2) (S220), and determines a plurality of division candidate positions of the combined image data (S240). . Then, if the CPU 62 determines that the process has ended (YES in S250), the process of FIG. 4 ends.

(Target area determination processing; FIG. 5)
Next, the content of the target area determination process executed in S300 of FIG. 2 will be described with reference to FIG. In S310, the CPU 62 executes a blank area determination process (see FIG. 6 described later) to determine the blank areas corresponding to the text areas OA1 and OA2. Each margin area is the maximum area where each character in the corresponding text area (for example, OA1) can be enlarged and arranged, has a size larger than the corresponding text area, and includes the corresponding text area .

  In S330, the CPU 62 sets an initial value “1.0” as the enlargement ratio ER and sets an initial value “1” as the number-of-times pointer TP. The enlargement ratio ER is an area enlargement ratio for enlarging the text area in the area enlargement process of S350 described later. The number pointer TP is a pointer that indicates the number of times that an area enlargement process of S350 described later has been executed. Therefore, hereinafter, the term “TP-th region expansion processing” or “(TP-1) -th region expansion processing” may be used.

  In S340, the CPU 62 adds a predetermined fixed value α (for example, “0.05”) to the current value (for example, “1.0”) of the enlargement ratio ER to obtain a new value for the enlargement ratio ER (for example, “1.05”) is calculated.

  In S350, the CPU 62 executes a region enlargement process (see FIG. 7 described later). That is, the CPU 62 enlarges each text area OA1, OA2 according to the current value (for example, “1.05”) of the enlargement ratio ER calculated in S340, and determines each enlarged area.

  In S370, the CPU 62 determines whether or not the enlarged region determined in S350 satisfies a predetermined condition. In the present embodiment, the predetermined condition is as follows. For example, when the size of the margin area is relatively small, if the text area is enlarged according to the enlargement ratio ER, the enlarged area may not fit in the margin area. In this case, the CPU 62 cannot determine the enlargement area appropriately according to the formula of FIG. 9 described later, and therefore determines that the enlargement area does not satisfy the predetermined condition (NO in S370). For example, when a plurality of enlargement areas are determined in S350, two enlargement areas of the plurality of enlargement areas may overlap each other. In this case, the CPU 62 determines that the enlarged area does not satisfy the predetermined condition (NO in S370). On the other hand, if the enlarged area fits in the blank area and the two enlarged areas do not overlap each other, the CPU 62 determines that the enlarged area satisfies a predetermined condition (YES in S370).

  If the CPU 62 determines that the enlargement area does not satisfy the predetermined condition (NO in S370), the CPU 62 determines each enlargement area determined in the (TP-1) -th area enlargement process in S372 as each target area TA1, It is determined as TA2 (see S300 in FIG. 2). If the current value of the count pointer TP is “1”, in S372, the CPU 62 determines the text areas OA1 and OA2 as the target areas as they are. When S372 ends, the process of FIG. 5 ends.

  On the other hand, if the CPU 62 determines that the enlargement area satisfies the predetermined condition (YES in S370), whether or not the current value of the enlargement ratio ER matches a predetermined value (eg, “1.4”) in S380. Determine whether. The predetermined value means the maximum enlargement ratio for determining the target area, in other words, the target enlargement ratio for enlarging the size of each character in the scan image SI. For example, even if the original character is a small size, if the size of the character is increased by 1.4 times, it is usually easy for a human to recognize the enlarged character. In this way, the enlargement ratio that is easy for humans to recognize is set as the predetermined value (for example, “1.4”).

  If the CPU 62 determines that the current value of the enlargement rate ER matches the predetermined value (YES in S380), the CPU 62 determines each enlargement area determined in the TP-th area enlargement process in S382 as each target area (for example, (Refer to TA1 and TA2 in S300 of FIG. 2). When S382 ends, the process of FIG. 5 ends.

  On the other hand, if the CPU 62 determines that the current value of the enlargement ratio ER does not match the predetermined value (NO in S380), in S390, “1” is added to the current value of the number pointer TP, and the number of times A new value of the pointer TP is calculated. And CPU62 performs each process after S340 again.

(Blank area determination processing; FIG. 6)
Next, the contents of the blank area determination process executed in S310 of FIG. 5 will be described with reference to FIG. In S311, the CPU 62 determines one text area of the two text areas OA1 and OA2 as a processing target. Hereinafter, a case where the text area OA1 is determined as a processing target will be described as an example.

  In S312 to S319, the CPU 62 sequentially enlarges the text area OA1 in a plurality of directions to determine a blank area BA1. The direction to be used for the first enlargement among the plurality of directions is the upper left direction (S312). The reason is as follows. As described above, in each of the character strings “A to M” in the text area OA1, the sentence advances from the left side to the right side, and the sentence advances from the upper side to the lower side. In such a situation, if the upper left direction, which is the middle between the left side and the upper side where the sentence starts, is used for the first enlargement, the final enlargement result is compared to the case where the other direction is used for the first enlargement. The obtained blank area (the blank area BA1 in S319 described later) can be increased. However, in the modification, the direction to be used for the first enlargement among the plurality of directions may not be the upper left direction, and may be any one of S313 to S319.

  The area OA1 'is obtained by the upper left enlargement in S312. The upper end of the area OA1 'coincides with the upper end of the scan image SI. For this reason, since the area OA1 'cannot be enlarged in the upper right direction, S313 is not executed. Further, the left end of the area OA1 'coincides with the left end of the scan image SI. For this reason, since the area OA1 'cannot be enlarged to the lower left, S314 is not executed. Next, in S <b> 315, the CPU 62 enlarges the region OA <b> 1 ′ downward and determines the region OA <b> 1 ″. The right end of the area OA1 ″ coincides with the left end of the text area OA2. Thus, the CPU 62 sequentially enlarges the text area OA1 in a plurality of directions so as not to overlap with other object areas (for example, OA2 and OA3). In addition, any direction of S312 to S315 is an orientation that forms an angle of 45 degrees with respect to a straight line extending along the horizontal direction and an angle of 45 degrees with respect to a straight line that extends along the vertical direction. In addition, since the region OA1 ″ cannot be enlarged leftward, upward, and rightward, S316 to S318 are not executed. Finally, in S319, the CPU 62 enlarges the area OA1 ″ downward to determine a blank area BA1.

  In S320, the CPU 62 determines whether or not the processing of S311 to S319 has been completed for all the text areas OA1 and OA2. If the CPU 62 determines that the process has not ended (NO in S320), the CPU 62 determines an unprocessed text area (for example, OA2) as a processing target in S311. As a result, as described above, the CPU 62 determines a blank area (refer to BA2 in FIG. 7 described later) corresponding to the text area OA2. Then, when the CPU 62 determines that the process has been completed (YES in S320), the process of FIG. 6 is terminated.

  The margin area BA1 corresponding to the text area OA1 is larger than the text area OA1 on each of the right and left sides in the horizontal direction and larger than the text area OA1 on each of the upper side and the upper side in the vertical direction. Accordingly, between the text area OA1 and the margin area BA1, there are two margins along the horizontal direction and two margins along the vertical direction. The same applies to the blank area BA2 (see FIG. 7 described later) corresponding to the text area OA2. Further, the blank areas BA1 and BA2 do not overlap with other object areas (for example, the blank area BA1 does not overlap with the object areas OA2 and OA3). However, the two blank areas BA1 and BA2 may overlap each other.

(Area enlargement processing; FIG. 7)
Next, the contents of the area expansion process executed in S350 of FIG. 5 will be described with reference to FIG. In S352, the CPU 62 determines one text area of the two text areas OA1 and OA2 as a processing target. In the following, the code OPx and the code OPy are used as the horizontal length (that is, the number of pixels in the horizontal direction) and the length in the vertical direction (that is, the number of pixels in the vertical direction), respectively. Further, as the horizontal length (that is, the number of pixels in the horizontal direction) and the vertical length (that is, the number of pixels in the vertical direction) of the margin area corresponding to the text area to be processed, the codes BPx and BPy are respectively set. Use. Hereinafter, a case where the text area OA1 is determined as a processing target will be described as an example.

  In S354, the CPU 62 multiplies the horizontal length OPx of the text area OA1 by the square root (hereinafter referred to as “root ER”) of the current value of the enlargement ratio ER (see S340 in FIG. 5). The horizontal length (that is, the number of pixels in the horizontal direction) CPx of the candidate enlarged region that is a candidate for the enlarged region to be determined is calculated. Further, the CPU 62 multiplies the vertical length OPy of the text area OA1 by the root ER to calculate the vertical length (that is, the number of pixels in the vertical direction) CPy of the candidate enlargement area. Since the horizontal and vertical lengths OPx and OPy of the text area OA1 are multiplied by the same value (that is, the root ER), the horizontal and vertical lengths CPx and CPy of the candidate expansion area are calculated. The aspect ratio of the area is equal to the aspect ratio of the text area OA1.

  In S356, the CPU 62 determines that the horizontal length CPx of the candidate enlargement area is equal to or less than the horizontal length BPx of the blank area BA1, and the vertical length CPy of the candidate enlargement area is the vertical direction of the blank area BA1. It is determined whether or not the length is BPy or less. In other words, the CPU 62 determines whether or not the candidate enlargement area fits in the blank area BA1.

  When the length CPx is equal to or shorter than the length BPx and the length CPy is equal to or shorter than the length BPy, the CPU 62 determines that the candidate enlargement area falls within the blank area BA1 (YES in S356). The process proceeds to S358. In S <b> 358, the CPU 62 enlarges the text area OA <b> 1 according to the enlargement ratio ER while determining the enlargement area while maintaining the aspect ratio of the text area OA <b> 1. As a result, an enlarged area (hereinafter referred to as “simple enlarged area”) having an aspect ratio equal to the aspect ratio of the text area OA1 is determined. More specifically, the length in the horizontal direction and the length in the vertical direction of the simple enlargement area respectively match the length in the horizontal direction CPx and the length in the vertical direction CPy calculated in S354. . Then, the simple enlargement area can be determined as the target area (see S372 and S382 in FIG. 5). When a target area having an aspect ratio equal to the aspect ratio of the text area OA1 is determined, the CPU 62 can easily execute the rearrangement process (see FIG. 10) of S400 in FIG. . When S358 ends, the process proceeds to S362.

  On the other hand, if the length CPx is greater than the length BPx, or if the length CPy is greater than the length BPy, the CPU 62 determines that the candidate enlargement area does not fit within the blank area BA1 (NO in S356). ), Go to S360. In S360, the CPU 62 enlarges the text area OA1 without maintaining the aspect ratio of the text area OA1 (that is, ignores it), and determines an enlarged area. As a result, an enlargement area (hereinafter referred to as a “deformation enlargement area”) having an aspect ratio different from the aspect ratio of the text area OA1 is usually determined. More specifically, the horizontal length and the vertical length of the deformation enlarged region are different from the horizontal length CPx and the vertical length CPy of the candidate enlarged region, respectively. And a deformation | transformation expansion area | region can be determined as a target area | region. Thus, according to the present embodiment, the CPU 62 can appropriately determine the deformation enlargement area even when the simple enlargement area having the aspect ratio that matches the aspect ratio of the text area OA1 cannot be determined. When S360 ends, the process proceeds to S362.

  In S362, the CPU 62 determines whether or not the processes in S352 to S360 have been completed for all the text areas OA1 and OA2. If the CPU 62 determines that the processing has not ended (NO in S362), the CPU 62 determines an unprocessed text area (for example, OA2) as a processing target in S352. As a result, the CPU 62 determines an enlarged area corresponding to the text area OA2. Then, if the CPU 62 determines that the process is completed (YES in S362), the process of FIG.

(Enlarge while maintaining aspect ratio; Fig. 8)
Next, the contents of the process of S358 in FIG. 7 will be described with reference to FIG. Each rectangle in FIG. 8 shows a text area OA1, a blank area BA1, and an enlarged area CA. Between the text area OA1 and the margin area BA1, there are two horizontal margins (lengths Px1, Px2) and two vertical margins (lengths Py1, Py2). Then, in the process of S358 in FIG. 7, the CPU 62 determines the position of the enlarged area (that is, the simple enlarged area) CA by calculating the four target lengths dx1, dx2, dy1, and dy2. Specifically, the CPU 62 calculates the four target lengths dx1, dx2, dy1, and dy2 using the formulas (1) to (6) in FIG.

  Expression (1) is obtained by subtracting the horizontal length OPx of the text area OA1 from the horizontal length CPx of the enlarged area CA (calculated in S354 of FIG. 7), and the enlarged area CA and the text area OA1. It shows that the difference length Dx in the horizontal direction between is calculated. Equation (2) is obtained by subtracting the vertical length of the text area OA1 from the vertical length of the enlarged area CA (calculated in S354 of FIG. 7) to obtain a distance between the enlarged area CA and the text area OA1. It shows that the length Dy in the vertical direction is calculated. Formula (3) indicates that the differential length Dx in the horizontal direction is the sum of the two target lengths dx1 and dx2 in the horizontal direction. Equation (4) indicates that the difference length Dy in the vertical direction is the sum of the two target lengths dy1 and dy2 in the vertical direction. Formula (5) indicates that the ratio between the two target lengths dx1 and dx2 in the horizontal direction matches the ratio between the two margin lengths Px1 and Px2 in the horizontal direction. Formula (6) indicates that the ratio of the two target lengths dy1 and dy2 in the vertical direction matches the ratio of the two margin lengths Py1 and Py2 in the vertical direction. Since each value of Dx, Px1, and Px2 is known, two target lengths dx1, dx2 in the horizontal direction can be calculated by using each value and Equation (5). Further, since each value of Dy, Py1, and Py2 is known, two target lengths dy1 and dy2 in the vertical direction can be calculated by using each value and Equation (6).

  According to the mathematical expressions (1) to (6) in FIG. 8, the following simple enlarged area CA is obtained. In Formula (5), the target lengths dx1 and dx2 in the horizontal direction are determined according to the ratio of the lengths Px1 and Px2 of the two margins in the horizontal direction. In Formula (6), the two vertical lengths are determined. The target lengths dy1 and dy2 in the horizontal direction are determined according to the ratio of the margin lengths Py1 and Py2. Therefore, simple enlargement having an aspect ratio equal to the aspect ratio of the text area OA1 based on the lengths Px1 and Px2 of the two margins in the horizontal direction and the lengths Py1 and Py2 of the two margins in the vertical direction. The position of the region is determined. Then, the simple enlargement area can be determined as the target area (see S372 and S382 in FIG. 5).

(Ignoring aspect ratio and expanding; Fig. 9)
Next, the contents of the process of S360 in FIG. 7 will be described with reference to FIG. Each rectangle in FIG. 9 is the same as each rectangle in FIG. The CPU 62 calculates the four target lengths dx1, dx2, dy1, dy2 by using the mathematical expressions (1) to (8) in FIG. Determine position, aspect ratio, and size.

  Equation (1) indicates that a value obtained by multiplying the area SO of the text area OA1 by the current value of the enlargement ratio ER matches the area SC of the enlargement area CA. Equation (2) indicates that the area SO of the text area OA1 is obtained by multiplying the horizontal length OPx and the vertical length OPy of the text area OA1. Formula (3) indicates that the area SC of the enlarged area CA is such that the horizontal length OPx of the text area OA1 and the two target lengths dx1 and dx2 are combined with the vertical length OPy of the text area OA1. It is obtained by multiplying the sum of two object lengths dy1 and dy2. Formula (4) represents a formula obtained by substituting the area SO of Formula (2) and the area SC of Formula (3) into Formula (1). Equation (5) is obtained by multiplying each of the four object lengths dx1, dx2, dy1, and dy2 by each of the four margin lengths Px1, Px2, Py1, and Py2 and the coefficient K. It shows that. Formula (6) represents a formula obtained by substituting each target length dx1, dx2, dy1, dy2 of Formula (5) into Formula (4). Formula (7) shows a formula obtained by expanding Formula (6). Formula (8) shows a formula for calculating the coefficient K using the coefficients a, b, and c of Formula (7). Then, if the coefficient K is substituted into Equation (5), four target lengths dx1, dx2, dy1, dy2 can be calculated.

  According to the mathematical expressions (1) to (8) in FIG. 9, the following deformation enlarged area CA is obtained. According to Equation (5), the relationship “dx1 + dx2 = K × (Px1 + Px2)” and the relationship “dy1 + dy2 = K × (Py1 + Py2)” are obtained. Accordingly, when the sum of the lengths of the two margins in the horizontal direction (ie, Px1 + Px2) is larger than the sum of the lengths of the two margins in the vertical direction (ie, Py1 + Py2), the difference length in the horizontal direction (ie, Py1 + Py2). dx1 + dx2) is greater than the longitudinal difference length (ie, dy1 + dy2), and the sum of the two horizontal margin lengths (ie, Px1 + Px2) is the sum of the two vertical margin lengths (ie, When the difference is smaller than Py1 + Py2), the difference length in the horizontal direction (ie, dx1 + dx2) is smaller than the difference length in the vertical direction (ie, dy1 + dy2). As described above, the deformation enlargement area different from the aspect ratio of the text area OA1 based on the two margin lengths Px1 and Px2 in the horizontal direction and the two margin lengths Py1 and Py2 in the vertical direction. The aspect ratio, the size of the deformation enlargement region (that is, the length in the horizontal direction and the length in the vertical direction), and the position of the deformation enlargement region are determined. And a deformation | transformation expansion area | region can be determined as a target area | region (refer S372, S382 of FIG. 5).

(Relocation processing; FIG. 10)
Next, the content of the rearrangement process executed in S400 of FIG. 2 will be described with reference to FIG. In S410, the CPU 62 determines one text area (for example, OA1) out of the two text areas OA1 and OA2 as a processing target. Hereinafter, the text area determined as the processing target in S410 is referred to as “target text area”. The combined image data representing the combined image (for example, CI1 in FIG. 2) in which the character strings included in the target text area are combined is referred to as “target combined image data”.

  In S412, the CPU 62 determines whether or not the aspect ratio of the target text area matches the aspect ratio of the target area determined for the target text area (hereinafter referred to as “target target area”).

  When the simple enlargement area obtained in S358 of FIG. 7 (that is, the method of FIG. 8) is determined as the target area for the target text area, the CPU 62 determines the aspect ratio of the target text area and the aspect ratio of the target target area. Are determined to match (YES in S412), and in S414, the acquisition process is executed. Specifically, the CPU 62 acquires partial image data representing the target text area from the scanned image data SID. When S414 ends, the process proceeds to S490. As described above, when the aspect ratio of the target text area matches the aspect ratio of the target target area, the CPU 62 does not need to execute the processes of S420 to S480, and thus the rearrangement process is easy (that is, Can be executed quickly).

  On the other hand, for the target text area, when the deformation enlargement area obtained in S360 of FIG. 7 (that is, the method of FIG. 9) is determined as the target area, the CPU 62 determines the aspect ratio of the target text area and the target target area. It is determined that the aspect ratio does not match (NO in S412), and each process of S420 to S480 is executed to generate rearranged image data representing the rearranged image (for example, refer to RI1 of S400 in FIG. 2). .

  In S420, the CPU 62 sets the initial value as the horizontal length W (that is, the number of pixels W in the horizontal direction) of the candidate rearrangement region that is a candidate for the rearrangement region to be determined (see RA1 and RA2 in FIG. 2). OPx (that is, the horizontal length of the target text area) is set, and the initial value OPy (that is, the vertical length of the target text area) is set as the vertical length H (that is, the number of pixels H in the vertical direction) of the candidate rearrangement area. Set the direction length.

  In S430, the CPU 62 determines that the ratio W / H of the horizontal length W to the vertical length H of the candidate rearrangement area is the ratio of the horizontal length TW to the vertical length TH of the target target area. It is determined whether it is less than TW / TH.

  When the CPU 62 determines that the ratio W / H is less than the ratio TW / TH (YES in S430), in S432, the fixed length predetermined to the current length W in the horizontal direction of the candidate rearrangement region is determined. The value β (for example, one pixel) is added to determine a new lateral length W of the candidate rearrangement region. When S432 ends, the process proceeds to S440.

  On the other hand, if the CPU 62 determines that the ratio W / H is greater than or equal to the ratio TW / TH (NO in S430), the CPU 62 determines in advance from the current length W in the horizontal direction of the candidate rearrangement region in S434. A fixed length β (for example, one pixel) is subtracted to determine a new horizontal length W of the candidate rearrangement region. When S434 ends, the process proceeds to S440. In the present embodiment, the same fixed value β is used in S432 and S434. However, in a modified example, the fixed value in S432 and the fixed value in S434 may be different values.

  In S440, the CPU 62 determines the length m between rows along the vertical direction (that is, the number m of pixels between rows) according to the resolution of the scan image data SID. For example, when the resolution of the scanned image data SID is 300 dpi, the CPU 62 determines one pixel as the length m between the rows, and when the resolution of the scanned image data SID is 600 dpi, the length m between the rows. 2 pixels are determined. That is, the CPU 62 determines a larger line length m as the resolution of the scanned image data SID increases. According to this configuration, the CPU 62 can determine the length m between lines having an appropriate size according to the resolution of the scanned image data SID. In the modified example, the same value may be adopted as the length m between lines regardless of the resolution of the scanned image data SID.

  In S450, the CPU 62 executes a row number determination process based on the target combined image data and the new horizontal length W of the candidate rearrangement region determined in S432 or S434 (FIG. 11 described later). reference). In the line number determination process, the CPU 62 determines the number of lines in the case where a plurality of characters (for example, “A to M”) included in the target combined image (for example, CI1 in FIG. 2) are rearranged in the candidate rearrangement region. To do.

(Line number determination processing; FIG. 11)
As shown in FIG. 11, in S451, the CPU 62 determines whether or not the horizontal length IW of the target combined image (for example, CI1 in FIG. 11) is equal to or smaller than the horizontal length W of the candidate rearrangement region. Determine whether. If the CPU 62 determines that the length IW is less than or equal to the length W (YES in S451), the CPU 62 determines “1” as the number of rows in S452. This is because all the characters “A to M” are included in the candidate rearrangement region in a state where all the characters “A to M” included in the target combined image CI1 are linearly arranged in the horizontal direction. When S452 ends, the process of FIG. 11 ends.

  On the other hand, if the CPU 62 determines that the length IW is greater than the length W (NO in S451), the CPU 62 divides and arranges the plurality of characters “A to M” included in the target combined image CI1. There is a need to. For this purpose, the CPU 62 executes S453 and 454 to determine a plurality of division candidate positions determined in S240 of FIG. 4 (see, for example, a plurality of arrows attached to the target combined image CI1 in FIG. 11). One or more division candidate positions are selected from the inside.

  In S453, the CPU 62 selects one division candidate position from among a plurality of division candidate positions so that the selection length SW becomes the maximum length not more than the horizontal length W of the candidate rearrangement area. To do. In a state where one division candidate position has not yet been selected, the selection length SW is the horizontal length between the leading end (that is, the left end) of the target combined image CI1 and the division candidate position to be selected. It is. In a state where one or more division candidate positions have already been selected, the selection length SW is present at the most recently selected division candidate position and the rear end side (that is, the right side) of the division candidate position. This is the length in the horizontal direction between the division candidate position to be newly selected. In the example of FIG. 11, the division candidate position between the character “F” and the character “G” is selected.

  In S454, the CPU 62 determines whether or not the remaining length RW is less than or equal to the horizontal length W of the candidate rearrangement region. The remaining length RW is a length in the horizontal direction between the most recently selected division candidate position and the rear end (that is, the right end) of the target combined image. If the CPU 62 determines that the remaining length RW is greater than the length W (NO in S454), the CPU 62 returns to S453 and selects from among a plurality of division candidate positions. A division candidate position that is present on the rear end side from the most recently selected division candidate position is newly determined.

  On the other hand, if the CPU 62 determines that the remaining length RW is less than or equal to the length W (YES in S454), it is obtained by adding “1” to the number of selected division candidate positions in S455. Determine the number as the number of rows. When S455 ends, the process of FIG. 11 ends.

(Continuation of rearrangement processing; FIG. 10)
In S460 of FIG. 10, the CPU 62 determines a new length H in the vertical direction of the candidate rearrangement region according to the mathematical expression in S460. In the mathematical expression in S460, “m” is the length between lines determined in S440, “n” is the number of lines determined in S450, and “h” is the length in the vertical direction of the target combined image data. (Refer to h of the combined image CI1 in FIG. 11).

  In S470, the CPU 62 determines whether or not the aspect ratio W / H of the candidate rearrangement area approximates the aspect ratio TW / TH of the target target area. Specifically, the CPU 62 determines whether or not the aspect ratio W / H of the candidate rearrangement area is included within a predetermined range set based on the aspect ratio TW / TH of the target target area. The predetermined range includes a value obtained by subtracting the value γ from the aspect ratio TW / TH of the target target area, a value obtained by adding the value γ to the aspect ratio TW / TH of the target target area, The range between. Note that the value γ may be a predetermined fixed value, or may be a value obtained by multiplying TW / TH by a predetermined coefficient (for example, 0.05).

  If the CPU 62 determines that the aspect ratio W / H of the candidate rearrangement area does not approximate the aspect ratio TW / TH of the target target area (NO in S470), the CPU 62 executes each process of S430 to S460 again. Thereby, the CPU 62 determines a new length W in the horizontal direction and a new length H in the vertical direction of the candidate rearrangement region, and executes the determination in S470 again.

  On the other hand, if the CPU 62 determines that the aspect ratio W / H of the candidate rearrangement area is close to the aspect ratio TW / TH of the target target area (YES in S470), first, in S480, the horizontal length W And a candidate rearrangement region having a length H in the vertical direction is determined as a rearrangement region (for example, RA1 in FIG. 2). Then, when one or more division candidate positions have been selected in S453 of FIG. 11, the CPU 62 divides the target combined image data at the one or more division candidate positions, and two or more division images. Two or more pieces of divided image data representing are generated. Next, the CPU 62 arranges the two or more divided image data in the rearrangement region so that the two or more divided images are arranged in the vertical direction. At this time, the CPU 62 arranges the two pieces of divided image data so that the line spacing determined in S440 is formed between the two divided images adjacent in the vertical direction. As a result, for example, as shown in S400 of FIG. 2, rearranged image data representing a rearranged image RI1 in which a plurality of characters “A” to “M” are rearranged in the rearranged region RA1 is generated. Is done. The size of the plurality of characters “A” to “M” in the rearranged image RI1 is equal to the size of the plurality of characters “A” to “M” in the scan image SI.

  In S490, the CPU 62 determines whether or not the processing of S410 to S480 has been completed for all the text areas OA1 and OA2. If the CPU 62 determines that the process has not ended (NO in S490), in S410, the CPU 62 determines an unprocessed text area (for example, OA2) as a processing target, and executes each process after S412 again. . As a result, for example, as shown in S400 of FIG. 2, rearranged image data representing a rearranged image RI2 in which a plurality of characters “N” to “W” are rearranged in the rearranged region RA2 is generated. Is done. Then, if the CPU 62 determines that the process is complete (YES in S490), the process of FIG. 10 is terminated.

(Case A; FIG. 12)
Next, with reference to FIG. 12, a specific case A will be described with respect to the rearrangement process in S400 (see FIG. 10) and the enlargement process in S500 in FIG. As shown in (A1), as the initial value of the horizontal length W and the initial value of the vertical length H of the candidate rearrangement area, the horizontal length OPx and the vertical length of the target text area OA1, respectively. The direction length OPy is set (S420 in FIG. 10). In this case, W / H is less than TW / TH. That is, the target target area TA1 has a horizontally long shape as compared with the target text area OA1. In this case, if the candidate rearrangement area has a horizontally long shape, the aspect ratio of the candidate rearrangement area approaches the aspect ratio of the target target area TA1. Therefore, as shown in (A2), the fixed value β is added to the current length W in the horizontal direction of the candidate rearrangement region to determine a new length W in the horizontal direction of the candidate rearrangement region. (S432). In this case, three lines including the character string “A to E”, the character string “F to J”, and the character string “K to M” are determined as the number of lines (S450). Then, a new vertical length H of the candidate rearrangement region is determined (S460).

  In the state of (A2), since the aspect ratio W / H of the candidate rearrangement area does not approximate the aspect ratio TW / TH of the target target area TA1 (NO in S470), as shown in (A3), the candidate rearrangement The fixed value β is added again to the current length W in the horizontal direction of the area, and the new horizontal length W of the candidate rearrangement area is determined again (S432). In this case, three lines including the character string “A to F”, the character string “G to L”, and the character string “M” are determined as the number of lines (S450). That is, the maximum number of characters that can form one line of character string in the candidate rearrangement area increases due to the increase in the horizontal length W of the candidate rearrangement area. Then, a new vertical length H of the candidate rearrangement region is determined (S460).

  In the state of (A3), the aspect ratio W / H of the candidate rearrangement area is close to the aspect ratio TW / TH of the target target area TA1 (YES in S470). Therefore, as shown in (A4), the candidate rearrangement region (A3) is determined as the rearrangement region RA1 (S480). In this case, the aspect ratio W / H of the rearrangement area RA1 is usually closer to the aspect ratio TW / TH of the target target area TA1 than the aspect ratio of the target text area OA. Next, the target combined image data representing the target combined image CI1 is divided, and three divided image data representing the three divided images DI1 to DI3 are generated (S480). Then, the three divided image data are arranged so that three divided images DI1 to DI3 are arranged in the vertical direction and a line space having a length m is formed between two adjacent divided images. Arranged in the rearrangement area RA1. As a result, rearranged image data representing the rearranged image RI1 is generated (S480).

  Next, the rearranged image data is enlarged, and enlarged image data representing the enlarged image is generated (S500 in FIG. 2). Specifically, the rearranged image RI1 is enlarged in the direction in which the diagonal line of the rearranged image RI1 extends, and as a result, enlarged image data representing the enlarged image is generated. For example, when the aspect ratio W / H of the rearrangement area RA1 is equal to the aspect ratio TW / TH of the target target area TA1, all four sides of the enlarged image are in the four sides of the target target area TA1. Match. In other words, in this case, the size of the enlarged image matches the size of the target area TA1. However, for example, when the aspect ratio W / H of the rearrangement area RA1 is not equal to the aspect ratio TW / TH of the target target area TA1, any of the enlarged images is gradually increased in the process of gradually expanding the rearrangement image RI1. The enlargement of the rearranged image RI1 is completed when the corresponding side matches any side of the target target area TA1. That is, in this case, the size of the enlarged image is smaller than the size of the target area TA1.

  Subsequently, as shown in (A5), the enlarged image data obtained by enlarging the rearranged image data representing the rearranged image RI1 is overwritten in the target area TA1 of the scanned image data SID (S500 in FIG. 2). . Similarly, enlarged image data representing an enlarged image obtained by enlarging the rearranged image data representing the rearranged image RI2 in FIG. 2 is overwritten in the target area TA2 of the scanned image data SID. As a result, processed image data PID representing the processed image PI is completed.

  As described above, in this embodiment, in S440 of FIG. 10, a relatively small line length m (for example, 1 pixel, 2 pixels, etc.) is determined, and the line length m is determined by the rearranged image RI1. Adopted. Therefore, the length m between the lines in the rearranged image RI1 is usually smaller than the length between the lines in the scan image SI. As a result, the ratio of the length between lines to the vertical length of a plurality of characters in the processed image PI obtained by enlarging the rearranged image RI1 (for example, the vertical length of the character “A”) is This is smaller than the ratio of the length between lines to the length in the vertical direction of a plurality of characters in the scanned image SI. As described above, in this embodiment, the length between lines in the processed image PI can be relatively reduced, and accordingly, each character can be appropriately enlarged in the processed image PI.

  If it is determined in S412 of FIG. 10 that the aspect ratio of the target text area is equal to the aspect ratio of the target target area, partial image data representing the target text area is acquired in S414. In this case, in S500 of FIG. 2, the partial image data is enlarged, and enlarged image data representing an enlarged image that matches the size of the target target area is generated. Then, the enlarged image data is overwritten on the target target area (for example, TA1) of the scanned image data SID.

(Case B; FIG. 13)
Subsequently, Case B will be described with reference to FIG. As shown in (B1), in this case, the ratio W / H is larger than the ratio TW / TH. That is, the target target area TA1 has a vertically long shape as compared with the target text area OA1. In this case, if the candidate rearrangement area has a vertically long shape, the aspect ratio of the candidate rearrangement area approaches the aspect ratio of the target target area TA1. Accordingly, as shown in (B2), the fixed value β is subtracted from the current length W in the horizontal direction of the candidate rearrangement region to determine a new length W in the horizontal direction of the candidate rearrangement region. (S434). In this case, the number of lines is determined as four lines including the character string “A to D”, the character string “E to H”, the character string “I to L”, and the character string “M” (S450). In other words, in this case, the maximum number of characters that can form one line of character string in the candidate rearrangement area is reduced due to the reduction in the horizontal length W of the candidate rearrangement area. Then, a new vertical length H of the candidate rearrangement region is determined (S460).

  In the state of (B2), the aspect ratio W / H of the candidate rearrangement area approximates the aspect ratio TW / TH of the target target area TA1 (YES in S470). Accordingly, as shown in (B3), the candidate rearrangement region in (B2) is determined as the rearrangement region RA1 (S480). Next, the target combined image data representing the target combined image CI1 is divided to generate four divided image data representing the four divided images DI4 to DI7 (S480). Then, as in the case A of FIG. 12, rearranged image data representing the rearranged image RI1 is generated (S480), and enlarged image data obtained by enlarging the rearranged image data is generated as shown in (B4). Then, the enlarged image data is overwritten in the target area TA1 of the scanned image data SID (S500 in FIG. 2). As a result, processed image data PID representing the processed image PI is completed.

(Effects of the first embodiment)
According to the present embodiment, as shown in FIGS. 8 and 9, the image processing server 50 includes two margin lengths Px1 and Px2 in the horizontal direction between the text area OA1 and the margin area BA1. The position of the target area TA1 (see S300 in FIG. 2) can be determined based on the two margin lengths Py1 and Py2. Also, as shown in FIG. 9, the image processing server 50 is based on the two margin lengths Px1 and Px2 in the horizontal direction and the two margin lengths Py1 and Py2 in the vertical direction. The aspect ratio and size of the target area TA1 having an aspect ratio different from the aspect ratio of the text area OA1 can be determined. Therefore, the image processing server 50 sets the target areas TA1 and TA2 in the processed image PI (S300 in FIG. 2) so that the positional relationship between the plurality of objects OB1 to OB3 in the scan image SI is substantially maintained. Reference) can be appropriately determined. Further, as shown in FIG. 5, the image processing server 50 can determine each target area TA1, TA2 so that two or more target areas TA1, TA2 do not overlap (S370, S372 in FIG. 5). , S380, S382). Accordingly, the image processing server 50 performs processing representing the processed image PI in which the text objects OB1 and OB2 are enlarged and expressed while substantially maintaining the positional relationship between the plurality of objects OB1 to OB3 in the scan image SI. The completed image data PID can be appropriately generated.

  Further, according to the present embodiment, as illustrated in FIGS. 10 to 13, after determining the target area TA1, the image processing server 50 determines the rearrangement area RA1 based on the aspect ratio of the target area TA1. . Therefore, the image processing server 50 can determine the rearrangement region RA1 having an aspect ratio that approximates the aspect ratio of the target region TA1. For this reason, the image processing server 50 can appropriately determine the rearrangement region RA1 in a state where the target region TA1 in which a plurality of characters in the scan image SI are to be rearranged is determined. As a result, a plurality of characters can be rearranged in the rearrangement area RA1, and rearrangement image data representing the rearrangement image RI1 (see FIGS. 12 and 13) can be appropriately generated. Since the aspect ratio of the rearrangement area RA1 approximates the aspect ratio of the target area TA1, the image processing server 50 can appropriately expand the rearrangement image RI1 to a size that approximates the size of the target area TA1. As a result, the image processing server 50 can appropriately generate processed image data PID representing the processed image PI in which a plurality of characters are enlarged and expressed in the target area TA1.

(Correspondence)
The image processing server 50 is an example of an “image processing apparatus”. Scanned image SI, text objects OB1 and OB2, and photographic object OB3 are examples of “original image”, “two or more specific objects”, and “other objects”, respectively. The object areas OA1 and OA2 and the margin areas BA1 and BA2 are examples of “two or more specific object areas” and “two or more space areas”, respectively.

  The horizontal direction and the vertical direction are examples of the “first direction” and the “second direction”, respectively. The left side and the right side in the horizontal direction are examples of the “first side in the first direction” and the “second side in the first direction”, respectively. The upper side and the lower side in the vertical direction are examples of the “first side in the second direction” and the “second side in the second direction”, respectively. 6 is an example of the “direction to be used for the first enlargement”.

  8 and 9, the lengths Px1 and Px2 of the two margins in the horizontal direction and the lengths Py1 and Py2 of the two margins in the vertical direction are “the two margins along the first direction, respectively. This is an example of “length” and “length of two margins along the second direction”. The difference length in the horizontal direction (ie, dx1 + dx2 (see FIG. 9)) and the difference length in the vertical direction (ie, dy1 + dy2) are examples of “first difference length” and “second difference length”, respectively. is there. The roots ER, CPx, and CPy of S354 in FIG. 7 are examples of “target value”, “first candidate length”, and “second candidate length”, respectively. In S356 of FIG. 7, the case of satisfying CPx ≦ BPx and CPy ≦ BPy is an example of “when a specific condition is satisfied”. A predetermined value (eg, 1.4) in S380 in FIG. 5 is an example of “target magnification”.

(Second embodiment; FIG. 14)
In the present embodiment, the content of the process of S360 in FIG. 7 is different from that of the first embodiment. The CPU 62 of the image processing server 50 determines the enlargement area CA (that is, the subsequent target area TA1 and the like) using the technique shown in FIG. 14 instead of the technique shown in FIG. Each rectangle in FIG. 14 is the same as each rectangle in FIG. The CPU 62 calculates the four target lengths dx1, dx2, dy1, dy2 by using the formulas (1) to (6) in FIG. Determine the size.

  Formula (1) represents a formula for calculating each target length dx1, dx2, dy1, dy2. Here, Ex is a magnification (hereinafter referred to as “horizontal enlargement ratio Ex”) of the lateral length of the enlarged area CA (that is, OPx + dx1 + dx2) with respect to the lateral length OPx of the text area OA1. Ey is a magnification (hereinafter, referred to as “vertical enlargement ratio Ey”) of the vertical length of the enlarged area CA (that is, OPy + dy1 + dy2) with respect to the vertical length OPy of the text area OA1. Expression (2) is obtained by multiplying the enlargement ratio ER (see S340 in FIG. 5) of the area of the enlargement area CA with respect to the text area OA1 by the horizontal enlargement ratio Ex and the vertical enlargement ratio Ey. Indicates. In the formula (3), the ratio of the horizontal expansion ratio Ex to the vertical expansion ratio Ey is the sum of the two horizontal lengths Px1 and Px2 and the two vertical lengths. It is equal to the ratio with the sum of Py1 and Py2. Formula (4) represents a formula obtained by substituting Ey of Formula (2) into Formula (3). Formula (5) shows a formula obtained by expanding Formula (4). Equation (6) shows the horizontal enlargement factor Ex and the vertical enlargement factor Ey calculated based on Equation (5). Then, by substituting the horizontal magnification rate Ex and the vertical magnification rate Ey obtained by Equation (6) into Equation (1), four target lengths dx1, dx2, dy1, dy2 can be calculated. it can.

  According to the mathematical expressions (1) to (6) in FIG. 14, the following deformation enlarged area CA is obtained. When the sum of the two horizontal margin lengths Px1 and Px2 is larger than the sum of the two vertical margin lengths Py1 and Py2 as shown in Equation (3), the horizontal direction The aspect ratio of the deformation enlargement area CA is determined such that the enlargement ratio Ex is larger than the vertical enlargement ratio Ey. Further, when the sum of the two horizontal margin lengths Px1 and Px2 is smaller than the sum of the two vertical margin lengths Py1 and Py2, the horizontal enlargement ratio Ex is The aspect ratio of the deformation enlargement area CA is determined so as to be smaller than the enlargement ratio Ey. As described above, the deformation enlargement area different from the aspect ratio of the text area OA1 based on the two margin lengths Px1 and Px2 in the horizontal direction and the two margin lengths Py1 and Py2 in the vertical direction. The aspect ratio, the size of the deformation enlargement region (that is, the length in the horizontal direction and the length in the vertical direction), and the position of the deformation enlargement region are determined. And a deformation | transformation expansion area | region can be determined as a target area | region (refer S372, S382 of FIG. 5).

  Also according to this embodiment, the image processing server 50 includes two horizontal margin lengths Px1 and Px2 between the text area (for example, OA1) and the margin area (for example, BA1) and two vertical areas. Based on the margin lengths Py1 and Py2, the target area (for example, TA1) can be appropriately determined.

  Specific examples of the present invention have been described in detail above, but these are merely examples and do not limit the scope of the claims. The technology described in the claims includes various modifications and changes of the specific examples illustrated above. The modifications of the above embodiment are listed below.

(Modification 1) In the above embodiment, the image processing server 50 performs image processing on the scanned image data SID (that is, each processing of S100 to S500 in FIG. 2) to generate processed image data PID. Then, the processed image data PID is transmitted to the multi-function device 10 (S600). Alternatively, the multi-function device 10 may perform image processing on the scanned image data SID to generate processed image data PID (that is, the image processing server 50 may not exist). In the present modification, the multi-function device 10 is an example of an “image processing apparatus”.

(Modification 2) The target of image processing executed by the image processing server 50 may not be scanned image data SID, but may be data generated by document creation software, table editing software, drawing creation software, or the like. Good. That is, the “original image data” is not limited to data obtained by scanning the scan target sheet, and may be other types of data.

(Modification 3) In the above embodiment, the image processing server 50 generates processed image data PID representing the processed image PI in which the text objects OB1 and OB2 including characters are enlarged and expressed. Instead, the image processing server 50 may generate processed image data representing a processed image in which the photographic object OB3 is enlarged and expressed. Further, the image processing server 50 may generate processed image data representing a processed image in which an object (for example, an object including a graph, a graphic, etc.) different from the text object and the photograph object is expressed in an enlarged manner. . That is, the “specific object” is not limited to the text object, but may be another type of object.

(Modification 4) The processed image data PID may not be data used for printing on the multi-function device 10, and may be data used for display on a display, for example. Generally speaking, the processed image PI represented by the processed image data PID may be an image for output (printing, display, etc.).

(Modification 5) In the above embodiment, the scanned image SI is a character string in which the sentence advances from the left side in the horizontal direction to the right side and the sentence advances in the vertical direction from the upper side to the lower side (that is, horizontally written characters). Column). Instead, the scanned image SI includes a character string (that is, a vertically written character string) in which the sentence advances from the upper side to the lower side in the vertical direction and the sentence advances from the right side in the horizontal direction to the left side. May be. In this case, the image processing server 50 normally cannot determine the band-like region based on the horizontal projection histogram in S160 of FIG. For this purpose, the image processing server 50 further generates a vertical projection histogram to determine a band-like region. Thereafter, the image processing server 50 may perform the same processing as in the above-described embodiment by using the vertical direction instead of the horizontal direction and using the horizontal direction instead of the vertical direction. In the present modification, the vertical direction and the horizontal direction are examples of “first direction” and “second direction”, respectively. The upper side and the lower side in the vertical direction are examples of the “first side in the first direction” and the “second side in the first direction”, respectively. The right side and the left side in the horizontal direction are examples of the “first side in the second direction” and the “second side in the second direction”, respectively. In the blank area determination process of FIG. 6, the upper right direction, which is the middle between the upper side and the right side where the sentence is started, is used for the first enlargement.

(Modification 6) In the above embodiment, for example, as shown in FIG. 12, the image processing server 50 uses the combined character string “A” to “M” in three lines in the scanned image SI. Combined image data representing the combined image CI1 including “A to M” is generated, and the combined image data is divided to generate rearranged image data representing the rearranged image RI1. Alternatively, the image processing server 50 may generate rearranged image data without generating combined image data. For example, the image processing server 50 acquires partial image data representing the character for each character in the scanned image SI, rearranges the partial image data in the rearrangement area RA1, and rearranges the partial image data. Rearranged image data representing the image RI1 may be generated.

(Modification 7) In the above embodiment, the CPU 62 of the image processing server 50 executes the program 66 (that is, software), thereby realizing the processes shown in FIGS. Instead, at least one of the processes in FIGS. 2 to 14 may be realized by hardware such as a logic circuit.

  The technical elements described in this specification or the drawings exhibit technical usefulness alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing. In addition, the technology illustrated in the present specification or the drawings achieves a plurality of objects at the same time, and has technical utility by achieving one of the objects.

  2: Communication system, 4: Internet, 10: Multi-function device, 50: Image processing server, 52: Network interface, 60: Control unit, 62: CPU, 64: Memory, 66: Program, SI: Scanned image, PI: Processed image, OB1, OB2: Text object, OB3: Photo object, OA1, OA2: Text object area (text area), OA3: Photo object area, LA11 to LA13, LA21, LA22: Strip area, BA1, BA2: Margin Area, CA: enlarged area, TA1, TA2: target area, RA1, RA2: rearranged area, SID: scanned image data, CI1, CI2: combined image, DI1 to DI7: fragmented image, RI1, RI2: rearranged image, PID: Processed image data

Claims (20)

An image processing apparatus,
An acquisition unit for acquiring original image data representing an original image including a plurality of objects including a specific object;
An image processing execution unit that performs image processing on the original image data to generate processed image data representing a processed image including the plurality of objects, wherein the processed image includes the original image The image processing execution unit, wherein the specific object is expressed in an enlarged manner,
The image processing execution unit
In the original image, for each of the plurality of objects, an object area determination unit that determines an object area including the object,
A space area determination unit that determines a space area including a specific object area determined for the specific object in the original image, wherein the space area is determined for another object of the plurality of objects. The space area determination unit not overlapping with other object areas;
A target area determination unit that determines a target area in the processed image based on the specific object area and the space area in the original image, wherein the target area is expressed in an enlarged manner The target area determination unit, which is an area in which an object is to be placed,
The target area determination unit includes two margin lengths along a first direction between the specific object area and the space area, and two margins along a second direction orthogonal to the first direction. An image processing apparatus that determines a position of the target area in the processed image based on the length of the image.   The target area determination unit may further determine an aspect of the target area based on the lengths of the two margins along the first direction and the lengths of the two margins along the second direction. The image processing apparatus according to claim 1, wherein the ratio is determined.   The target area determination unit may further include, based on the lengths of the two margins along the first direction and the lengths of the two margins along the second direction, the target area. The image processing apparatus according to claim 2, wherein a size of the target area having an aspect ratio is determined.   The image processing apparatus according to claim 2, wherein the aspect ratio of the target area is different from the aspect ratio of the specific object area. The target area determination unit
When the sum of the lengths of the two margins along the first direction is larger than the sum of the lengths of the two margins along the second direction, the first margin along the first direction Determining the aspect ratio of the target region so that a difference length of 1 is greater than a second difference length along the second direction;
When the sum of the lengths of the two margins along the first direction is smaller than the sum of the lengths of the two margins along the second direction, the first difference length is Determining the aspect ratio of the target area to be smaller than the second difference length;
The first difference length is a difference between a length along the first direction of the target area and a length along the first direction of the specific object area,
5. The method according to claim 2, wherein the second difference length is a difference between a length of the target area along the second direction and a length of the specific object area along the second direction. 6. An image processing apparatus according to claim 1. The target area determination unit
When the sum of the lengths of the two margins along the first direction is greater than the sum of the lengths of the two margins along the second direction, the first magnification is the second Determining the aspect ratio of the target area to be larger than the magnification,
When the sum of the lengths of the two margins along the first direction is smaller than the sum of the lengths of the two margins along the second direction, the first magnification is Determining the aspect ratio of the target area to be smaller than a magnification of 2;
The first magnification is a magnification of a length along the first direction of the target region with respect to a length along the first direction of the specific object region,
5. The second magnification according to claim 2, wherein the second magnification is a magnification of a length along the second direction of the target region with respect to a length along the second direction of the specific object region. An image processing apparatus according to 1.   The target area determination unit may further determine the specific object area based on the lengths of the two margins along the first direction and the lengths of the two margins along the second direction. The image processing apparatus according to claim 1, wherein a position of the target area having an aspect ratio equal to an aspect ratio is determined. The target area determination unit further includes:
The first candidate length obtained by multiplying the length of the specific object region along the first direction by a target value greater than 1 is equal to or less than the length of the space region along the first direction. And the second candidate length obtained by multiplying the length of the specific object region along the second direction by the target value is the length of the space region along the second direction. When a specific condition is satisfied, the first candidate length is determined as a length along the first direction of the target area, and along the second direction of the target area Determining the position of the target area having an aspect ratio equal to the aspect ratio of the specific object area by determining the second candidate length as a length;
When the specific condition is not satisfied, the specific object region is based on the lengths of the two margins along the first direction and the lengths of the two margins along the second direction. The image processing apparatus according to claim 1, wherein a position of the target area having an aspect ratio different from the aspect ratio is determined. An image processing apparatus,
An acquisition unit for acquiring original image data representing an original image including a plurality of objects including a specific object;
An image processing execution unit that performs image processing on the original image data to generate processed image data representing a processed image including the plurality of objects, wherein the processed image includes the original image The image processing execution unit, wherein the specific object is expressed in an enlarged manner,
The image processing execution unit
In the original image, for each of the plurality of objects, an object area determination unit that determines an object area including the object,
A space area determination unit that determines a space area including a specific object area determined for the specific object in the original image, wherein the space area is determined for another object of the plurality of objects. The space area determination unit not overlapping with other object areas;
A target area determination unit that determines a target area in the processed image based on the specific object area and the space area in the original image, wherein the target area is expressed in an enlarged manner The target area determination unit, which is an area in which an object is to be placed,
The target area determination unit includes two margin lengths along a first direction between the specific object area and the space area, and two margins along a second direction orthogonal to the first direction. And an aspect ratio of the target area in the processed image based on the length of the image processing apparatus.   The target area determination unit may further include, based on the lengths of the two margins along the first direction and the lengths of the two margins along the second direction, the target area. The image processing apparatus according to claim 9, wherein a size of the target area having an aspect ratio is determined.   The image processing apparatus according to claim 9, wherein the aspect ratio of the target area is different from the aspect ratio of the specific object area. The target area determination unit
When the first enlargement area obtained by enlarging the specific object area with the target magnification satisfies a predetermined condition, the first enlargement area is determined as the target area;
When the first enlargement area does not satisfy the predetermined condition, a second enlargement area obtained by enlarging the specific object area at a magnification smaller than the target magnification is determined as the target area. Item 12. The image processing apparatus according to any one of Items 1 to 11. The space area determination unit determines two or more space areas corresponding to two or more specific object areas determined for two or more specific objects of the plurality of objects,
The target area determination unit determines two or more target areas corresponding to the two or more specific object areas based on the two or more specific object areas and the two or more space areas;
The target area determination unit includes the two or more specific objects when the two or more first enlarged areas obtained by enlarging each of the two or more specific object areas with a target magnification overlap each other. The two or more second enlarged regions obtained by enlarging each of the regions at a magnification smaller than the target magnification are determined as the two or more target regions. The image processing apparatus described.   The image processing device according to any one of claims 1 to 13, wherein the specific object includes a text object including a character string of M lines (the M is an integer of 1 or more) composed of a plurality of characters. . In each of the M rows of character strings, the sentence advances from the first side to the second side in the first direction,
When the M is an integer of 2 or more, in the character string of the M lines, the sentence advances from the first side to the second side in the second direction,
The space area determination unit sequentially expands the specific object area in a plurality of directions to determine the space area,
Of the plurality of directions, the direction to be used for the first enlargement is a direction from the second side toward the first side along the first direction and a second direction along the second direction. The image processing apparatus according to claim 14, wherein the image processing apparatus has a direction between a direction from the side toward the first side. The target area determination unit may further determine the specific object area based on the lengths of the two margins along the first direction and the lengths of the two margins along the second direction. Determine the aspect ratio of the target area different from the aspect ratio;
The specific object includes a text object including a character string of M lines (M is an integer of 1 or more) composed of a plurality of characters,
The image processing execution unit further includes:
A rearranged image data generation unit that generates rearranged image data representing a rearranged image including a character string of N rows (N is an integer of 1 or more) composed of the plurality of characters, the M rows The number of characters included in the first line of the character string and the number of characters included in the first line of the N character strings, the rearranged image data generation unit,
The image processing execution unit generates the processed image data representing the processed image including the specific object including the character string of the N rows using the rearranged image data. And the image processing apparatus according to any one of 9 to 11. The original image data is data generated by scanning a sheet of a specific size on which the original image is represented,
The image processing apparatus according to claim 1, wherein the processed image data is data used to print the processed image on the sheet having the specific size. The plurality of objects included in the original image include the specific object and another object different from the specific object.
The image processing execution unit represents the processed image representing the processed image in which the specific object is expressed in an enlarged manner and the other object is expressed without being enlarged as compared with the original image. The image processing apparatus according to claim 1, which generates data. A computer program for an image processing apparatus,
In the computer mounted on the image processing apparatus, the following steps, that is,
An acquisition step of acquiring original image data representing an original image including a plurality of objects including a specific object;
An image processing execution step of performing image processing on the original image data to generate processed image data representing a processed image including the plurality of objects, wherein the processed image includes the original image The image processing execution step in which the specific object is expressed in an enlarged manner,
The image processing execution step includes
In the original image, for each of the plurality of objects, an object area determination step for determining an object area including the object;
A space region determining step for determining a space region including a specific object region determined for the specific object in the original image, wherein the space region is determined for another object of the plurality of objects; The space area determination step not overlapping with other object areas;
A target area determining step for determining a target area in the processed image based on the specific object area and the space area in the original image, wherein the target area is expressed in an enlarged manner; The target area determining step, which is an area in which an object is to be placed,
In the target area determination step, the lengths of the two margins along the first direction between the specific object area and the space area, and the two margins along the second direction orthogonal to the first direction. A computer program for determining a position of the target area in the processed image based on the length of the image. A computer program for an image processing apparatus,
In the computer mounted on the image processing apparatus, the following steps, that is,
An acquisition step of acquiring original image data representing an original image including a plurality of objects including a specific object;
An image processing execution step of performing image processing on the original image data to generate processed image data representing a processed image including the plurality of objects, wherein the processed image includes the original image The image processing execution step in which the specific object is expressed in an enlarged manner,
The image processing execution step includes
In the original image, for each of the plurality of objects, an object area determination step for determining an object area including the object;
A space region determining step for determining a space region including a specific object region determined for the specific object in the original image, wherein the space region is determined for another object of the plurality of objects; The space area determination step not overlapping with other object areas;
A target area determining step for determining a target area in the processed image based on the specific object area and the space area in the original image, wherein the target area is expressed in an enlarged manner; The target area determining step, which is an area in which an object is to be placed,
In the target area determination step, the lengths of the two margins along the first direction between the specific object area and the space area, and the two margins along the second direction orthogonal to the first direction. A computer program for determining an aspect ratio of the target area in the processed image based on the length of the image.

Images