JP6264955B2 - Image processing device - Google Patents

Description

  The present specification discloses an image processing apparatus that generates image data representing character strings of two or more lines by dividing image data representing character strings of one line.

  Patent Document 3 discloses a distribution processing server that distributes a document image to a mobile phone. The distribution processing server divides the character string image when the width of the character string for one line included in the document image exceeds the width of the displayable area of the mobile phone, and is arranged along the vertical direction on the mobile phone A plurality of partial images to be generated are generated. Then, the distribution processing server distributes the plurality of partial images to the mobile phone. Thereby, in a mobile phone, each character string is displayed not by horizontal scrolling but by vertical scrolling. Patent Document 1 discloses a mobile phone that rearranges a plurality of characters by using a position coordinate list indicating the positions of the plurality of characters included in the document image.

JP 2012-108750 A JP 2012-230623 A JP 2011-242987 A JP 2010-183484 A JP-A-2005-223824 JP-A-5-94511 JP 2000-137801 A Japanese Patent Laid-Open No. 11-25283 JP 2012-216038 A

"Line breaks automatically according to screen size! Displaying document files easily on smartphones Layout reconstruction technology" GT-Layout "Online storage" Dropbox "service newly developed", [online], May 2012 30th, Fuji Film Co., Ltd. [Search January 24, 2014], Internet <http://www.fujifilm.co.jp/corporate/news/articleffnr_0647.html>

  The above Patent Document 3 does not disclose a specific method for dividing the character string image. In Patent Document 1, data indicating the position of each character (that is, a position coordinate list) is used when a plurality of characters are rearranged. In this specification, when image data representing a character string of one line is divided to generate image data representing a character string of two or more lines, it is not necessary to use data indicating the position of each character. Provide technology.

  The image processing apparatus disclosed in the present specification includes a target character string image data acquisition unit, a dividing unit, and a specific character string image data generation unit. The target character string image data acquisition unit acquires target character string image data representing a single line of target character string composed of a plurality of characters arranged in the first direction. The dividing unit divides the target character string image data, and first partial character string image data representing a first partial character string that is a part of the target character string and a part of the target character string And second partial character string image data representing the second partial character string. At least one of the first partial character string and the second partial character string is composed of two or more characters that are a part of a plurality of characters. The specific character string image data generation unit uses the first partial character string image data and the second partial character string image data to form a first specific character lined up in a second direction orthogonal to the first direction. Specific character string image data representing the string and the second specific character string is generated. The first specific character string includes a first partial character string, and the second specific character string includes a second partial character string. The plurality of pixels constituting the target character string image data include a character constituent pixel constituting a character included in the target character string and a background pixel constituting a background of the character included in the target character string. The dividing unit includes a histogram generating unit and a dividing position determining unit. The histogram generation unit generates a projection histogram using the target character string image data. The projection histogram is a histogram showing the frequency distribution of the character constituting pixels when the pixels constituting the target character string image data are projected along the second direction. The dividing position determination unit determines the dividing position of the target character string image data based on the projection histogram and the specific length. The specific length is the upper limit length along the first direction of a plurality of lines of character strings to be represented by the specific character string image data. The dividing unit divides the target character string image data at the dividing position to generate first partial character string image data and second partial character string image data.

  According to the above configuration, the image processing apparatus uses the projection histogram to determine the division position of the target character string image data representing the target character string of one line composed of a plurality of characters, and the target character string image The data is divided to generate first and second partial character string image data representing first and second partial character strings, at least one of which is composed of two or more characters. Then, the image processing device generates specific character string image data using the first and second partial character string image data. Therefore, when the image processing apparatus should generate the specific character string image data representing the specific character string of two or more lines by dividing the target character string image data representing the target character string of one line, There is no need to use location data.

  A control method, a computer program, and a computer-readable recording medium storing the computer program for realizing the image processing apparatus are also novel and useful.

1 shows a configuration of a communication system. 3 shows a flowchart of processing of an image processing server. The flowchart of a character string analysis process is shown. The flowchart of a strip | belt-shaped area | region determination process is shown. The flowchart of a joint process is shown. A specific example of the combining process is shown. The flowchart of a division | segmentation candidate position determination process is shown. The specific example of a division | segmentation candidate position determination process is shown. The flowchart of a rearrangement process is shown. The flowchart of a line number determination process is shown. Specific examples of the rearrangement process and the enlargement process will be described.

(Configuration of communication system 2)
As shown in FIG. 1, the communication system 2 includes a multi-function device 10 and an image processing server 50. The multi-function device 10 and the image processing server 50 can communicate with each other via the Internet 4. The multi-function device 10 is a peripheral device that can execute a multi-function including a print function, a scan function, a copy function, a FAX function, etc. (that is, a peripheral device such as a PC (abbreviation of personal computer) not shown). The image processing server 50 is a server provided on the Internet 4 by the vendor of the multi-function device 10.

(Outline of each process executed by the multi-function device 10)
Copy functions that can be executed by the multi-function device 10 are classified into a monochrome copy function and a color copy function. In the present embodiment, the description will be made focusing on the color copy function. The color copy function is classified into a normal color copy function and a character enlargement color copy function. Regardless of which color copy function execution instruction is given by the user, the multi-function device 10 first performs color scanning on a sheet representing an image to be scanned (hereinafter referred to as a “scanning sheet”) to obtain a scanned image. A data SID is generated. The scanned image data SID is RGB bitmap data having multiple gradations (for example, 256 gradations).

  A scan image SI represented by the scan image data SID (that is, an image represented on the scan target sheet) has a white background and includes a text object TOB and a photo object POB. The text object TOB includes a four-line character string composed of a plurality of black characters “A to Q”. The character color may be a color different from black (for example, red). The photo object POB does not include characters, but includes a photo composed of a plurality of colors.

  In each drawing of the present embodiment, for convenience, each character string constituting the text object TOB is represented by alphabets “A to Q” arranged in a regular order. Constitutes a sentence. In each character string (that is, one line of character string), the sentence advances from the left side in the horizontal direction in the scan image SI toward the right side. In the four-line character strings “A to Q”, sentences progress from the upper side to the lower side in the vertical direction in the scan image SI. In any of the following images (for example, a processed image PI described later), a direction in which a plurality of characters constituting one line of character string are arranged and a direction orthogonal to the direction are respectively referred to as “lateral direction”, This is called “vertical direction”. Since sentences progress from the left side to the right side, the left end in the horizontal direction and the right end in the horizontal direction are referred to as “front end” and “rear end”, respectively.

  In addition, an indent margin area is formed on the leading end side (that is, on the left side) of the character string “A to E” in the first line of the four character strings “A to Q” constituting the text object TOB. Yes. Also, a line break is made at the third character string “LM” of the four character strings “A to Q”, and an indent margin is provided at the leading end of the last character string “N to Q”. A region is formed. That is, one paragraph is composed of the first three character strings “A to M” of the four character strings “A to Q”, and the last character string “N to Q” is the other. This is a single paragraph.

  When a normal color copy function execution instruction is given from the user, the multi-function device 10 uses the scanned image data SID to print an image on a sheet (hereinafter “print”) according to the copy magnification set by the user. To the target sheet). For example, when the copy magnification is equal, the multi-function device 10 prints an image having the same size as the image expressed on the scan target sheet on the print target sheet. Further, for example, when the copy magnification is a magnification indicating the enlargement of the image, the multi-function device 10 prints an image having a size larger than the image expressed on the scan target sheet on the print target sheet. In this case, for example, the image expressed on the A4 size scan target sheet is enlarged and printed on the A3 size print target sheet. As a result, an image in which all of the two objects TOB and POB are enlarged and printed is printed on the print target sheet.

  On the other hand, the multi-function device 10 transmits the scan image data SID to the image processing server 50 via the Internet 4 when an instruction to execute the character enlargement color copy function is given from the user. Accordingly, the multi-function device 10 receives the processed image data PID from the image processing server 50 via the Internet 4 and prints the processed image PI represented by the processed image data PID on the print target sheet. In particular, the multi-function device 10 prints the processed image PI on a print target sheet having the same size (for example, A4 size) as the scan target sheet.

  In the processed image PI, the photographic object POB is not enlarged but the text object TOB is enlarged as compared with the scanned image SI. Therefore, even if the size of each character in the scanned image SI is small, the size of each character is large in the processed image PI, so that the user can easily recognize each character in the processed image PI. . In addition, the number of characters (that is, “6”) of the character string “A to F” in the first line among the character strings “A to Q” in the processed image PI is the character string “A to Q” in the scanned image SI. It is different from the number of characters (namely, “5”) in the character string “A to E” in the first line of “Q”. The number of character strings in the processed image PI (that is, three lines) is different from the number of character strings in the scanned image SI (that is, four lines). However, the relationship between the two paragraphs in the processed image PI is the same as the relationship between the two paragraphs in the scanned image SI. That is, an indented blank area is formed on the leading end side (that is, on the left side) of the character string “A to F” in the first line of the three character strings “A to Q” in the processed image PI. In addition, a line break is made at the character string “G to M” on the second line, and an indent margin area is formed on the leading end side of the character string “N to Q” on the last line. That is, one paragraph is composed of the first two character strings “A to M” of the three character strings “A to Q”, and the last character string “N to Q” is the other. This is a single paragraph.

(Configuration of the image processing server 50)
The image processing server 50 performs image processing on the scanned image data SID received from the multi-function device 10, generates processed image data PID, and transmits the processed image data PID to the multi-function device 10. To do. The image processing server 50 includes a network interface 52 and a control unit 60. The network interface 52 is connected to the Internet 4. The control unit 60 includes a CPU 62 and a memory 64. The CPU 62 is a processor that executes various processes (that is, the processes in FIG. 2 and the like) according to a program 66 stored in the memory 64.

(Each process executed by the image processing server 50; FIG. 2)
Next, the contents of each process executed by the CPU 62 of the image processing server 50 will be described with reference to FIG. When the CPU 62 receives the scan image data SID from the multi-function device 10 via the Internet 4, the CPU 62 starts the process of FIG.

  In S100, the CPU 62 executes a character string analysis process (see FIG. 3 to be described later), and determines a text object area TOA including four lines of character strings “A to Q” in the scanned image SI. Then, the CPU 62 determines four belt-like areas LA11 to LA14 including four lines of character strings “A to Q” in the text object area TOA.

  In S200, the CPU 62 executes a combination process (see FIG. 5 described later), and generates two combined image data representing the two combined images CI1 and CI2. The combined image CI1 includes one line of character strings “A to M” in which three lines of character strings included in the three belt-like areas LA11 to LA13 are linearly connected (that is, connected) along the horizontal direction. Further, the combined image CI2 includes one line of character strings “N to Q” included in one band-shaped area LA14. The combined image CI2 does not include a character string obtained by combining a plurality of lines of character strings, but is referred to as a “combined image” for convenience. The combined image CI1 includes character strings “A to M” constituting one paragraph, and the combined image CI2 includes character strings “N to Q” constituting another single paragraph. That is, one combined image data representing one combined image is generated for each paragraph included in the text object area TOA.

  In S300, the CPU 62 executes a target area determination process to determine a target area TA in the scan image SI. Specifically, the CPU 62 first determines a space area having an upper left vertex that matches the upper left vertex of the text object area TOA. The space area has a size larger than the size (ie, area) of the text object area TOA and does not overlap with other object areas (for example, an object area including the photo object POB). Then, the CPU 62 determines a target area TA having an aspect ratio equal to the aspect ratio of the space area in the space area. Here, the size (ie, area) of the target area TA is a maximum of α times (where α is a value greater than 1, for example, 1.4 times) the size (ie, area) of the text object area TOA. Is the size of The position of the target area TA is set so that the upper left vertex of the target area TA matches the upper left vertex of the text object area TOA. The aspect ratio of the target area TA is usually different from the aspect ratio of the text object area TOA. The target area TA in the scanned image SI matches the target area TA in the processed image PI (see the processed image PI in S500). Therefore, the process of S300 is equivalent to the process of determining the target area TA in the processed image PI. The target area TA in the processed image PI is an area in which the character strings “A to Q” expressed in an enlarged manner are to be arranged.

  In S400, the CPU 62 executes rearrangement processing (see FIG. 9 described later) to determine the rearrangement area RA. Then, the CPU 62 rearranges the plurality of characters “A to Q” in the rearrangement area RA by using the two combined image data representing the two combined images CI1 and CI2. Rearranged image data representing the image RI is generated.

  In S500, the CPU 62 enlarges the rearranged image data representing the rearranged image RI to generate enlarged image data. Then, the CPU 62 generates processed image data PID representing the processed image PI using the enlarged image data. In the processed image PI, each character is expressed in an enlarged manner, but the processed image data PID has the same number of pixels as the scanned image data SID.

  In S <b> 600, the CPU 62 transmits the processed image data PID to the multi-function device 10 via the Internet 4. As a result, the processed image PI represented by the processed image data PID is printed on the target print sheet.

(Character string analysis processing; Fig. 3)
Next, the contents of the character string analysis process executed in S100 of FIG. 2 will be described with reference to FIG. In S110, the CPU 62 executes binarization processing on the scanned image data SID, and outputs binary data BD (only part of which is shown in FIG. 3) having the same number of pixels as the scanned image data SID. Generate. The CPU 62 first determines the background color (white in the present embodiment) of the scan image SI using the scan image data SID. Specifically, the CPU 62 generates a histogram indicating the frequency distribution of pixel values of a plurality of pixels in the scan image data SID. Then, the CPU 62 determines the background color by specifying the pixel value having the highest frequency (hereinafter referred to as “the highest frequency pixel value”) using the histogram. Next, for each of the plurality of pixels in the scan image data SID, the CPU 62, when the pixel value of the pixel matches the highest frequency pixel value, in the binary data BD existing at the position corresponding to the pixel. When “0” is assigned as the pixel value of the pixel and the pixel value of the pixel does not match the highest frequency pixel value, the pixel value of the pixel in the binary data BD existing at the position corresponding to the pixel is “ 1 ”is assigned. As a result, in the binary data BD, each pixel representing each character (for example, “A”, “B”) included in the text object TOB indicates the pixel value “1”, and each pixel representing the photographic object POB is the pixel value. “1” is indicated, and other pixels (that is, pixels representing the background) indicate the pixel value “0”. Hereinafter, the pixel indicating the pixel value “1” and the pixel indicating the pixel value “0” in the binary data BD are referred to as “ON pixel” and “OFF pixel”, respectively.

  In S120, the CPU 62 performs a labeling process on the binary data BD generated in S110, and the label data LD having the same number of pixels as the binary data BD (only a part is shown in FIG. 3). Is generated). Specifically, the CPU 62 divides a plurality of ON pixels in the binary data BD into two or more ON pixel groups, and each of the two or more ON pixel groups has a different pixel value (for example, “1”). , “2”, etc.). One ON pixel group is composed of two or more ON pixels adjacent to each other. That is, when one or more ON pixels are included in eight adjacent pixels adjacent to one ON pixel to be labeled, the CPU 62 determines that the target ON pixel , One or more ON pixels among the eight adjacent pixels are divided (ie, grouped) into the same ON pixel group. The CPU 62 determines two or more ON pixel groups by sequentially executing grouping of each ON pixel while changing the ON pixels to be labeled. For example, in the label data LD of FIG. 3, the pixel value “1” is assigned to each ON pixel (that is, one ON pixel group) representing the character “A”, and each ON pixel representing the character “B” ( That is, the pixel value “2” is assigned to the other one ON pixel group).

  In S130, the CPU 62 determines each unit area corresponding to each of the ON pixel groups using the label data LD generated in S120. Each unit area is a rectangular area circumscribing one corresponding ON pixel group. For example, when using the label data LD of FIG. 3, the CPU 62 circumscribes the ON pixel group to which the pixel value “1” is assigned (that is, the unit region corresponding to the character “A”), A unit area circumscribing the ON pixel group to which the pixel value “2” is assigned (that is, a unit area corresponding to the letter “B”) is determined. More specifically, the CPU 62 selects 17 unit areas corresponding to 17 characters “A” to “Q” and one unit corresponding to one photo object POB from the scanned image SI. (I.e., a total of 18 unit areas are determined). The determination of the unit area is executed by storing the position of each pixel constituting each vertex of the unit area in the memory 64. However, in the description below regarding “determination of region (or position)”, description regarding storing the pixel position in the memory 64 is omitted.

  In S140, the CPU 62 determines an object area in the scan image SI using the unit area determined in S130. Specifically, the CPU 62 divides the 18 unit areas into a plurality of unit area groups, and determines each object area corresponding to each unit area group. One unit region group is composed of one or more unit regions existing in the vicinity. When the distance (that is, the number of pixels) between the two unit areas is less than a predetermined distance, the CPU 62 divides the two unit areas into the same unit area group. The predetermined distance is determined in advance according to the resolution of the scan image data SID. For example, in this embodiment, the scan image data SID has a resolution of 300 dpi, and the predetermined distance corresponding to the resolution of 300 dpi is 10 pixels. In the label data LD of FIG. 3, the distance between the unit region RE1 corresponding to the character “A” and the unit region RE2 corresponding to the character “B” is 3 pixels. Therefore, the CPU 62 divides the unit area RE1 and the unit area RE2 into the same unit area group. Thereby, the CPU 62 can group each character (for example, “A” and “B”) existing in the vicinity. More specifically, for the scanned image SI, the CPU 62 includes a unit region group including 17 unit regions corresponding to 17 characters “A” to “Q” in the text object TOB, and one photographic object. A unit region group including one unit region corresponding to POB is determined (that is, two unit region groups are determined in total). Then, for each of the two unit area groups, the CPU 62 determines a rectangular area circumscribing the unit area group as an object area. That is, the CPU 62 determines, from the scanned image SI, an object area TOA including 17 characters “A” to “Q” in the text object TOB and an object area POA including the photographic object POB (ie, the object area POA). , Two object areas TOA and POA are determined in total).

  In S150, the CPU 62 determines the type of the object area for each of the two object areas TOA and POA determined in S140. Specifically, the CPU 62 determines whether or not each object area TOA, POA is a text object area including characters (hereinafter simply referred to as “text area”). First, the CPU 62 generates a histogram indicating the frequency distribution of the pixel values of a plurality of pixels constituting the partial image data representing the object area TOA in the scan image data SID. Then, the CPU 62 uses the histogram to calculate the number of pixel values whose frequency is higher than zero (that is, the number of colors used in the object area TOA). When the calculated number is less than a predetermined number (for example, “10”), the CPU 62 determines that the object area TOA is a text area, and when the calculated number is equal to or greater than the predetermined number. The object area TOA is determined not to be a text area. The object area TOA includes black characters “A” to “Q” and a white background. Therefore, in the histogram corresponding to the object region TOA, the frequency of only two pixel values including the pixel value indicating black and the pixel value indicating white is usually higher than zero. For this reason, the CPU 62 determines that the object area TOA is a text area. On the other hand, for example, in the photo object POB, ten or more colors are usually used. Therefore, in the histogram corresponding to the object area POA, the number of pixel values having a frequency higher than zero is usually greater than or equal to the predetermined number. Therefore, the CPU 62 determines that the object area POA is not a text area (that is, determines that it is a photo object area).

  In S160, the CPU 62 executes a band-shaped area determination process (see FIG. 4 described later) for the text area TOA determined in S150. However, the CPU 62 does not execute the band-shaped area determination process for the photo object area POA. When S160 ends, the process of FIG. 3 ends.

(Strip-like region determination process; FIG. 4)
Next, with reference to FIG. 4, the content of the band-shaped area determination process executed in S160 of FIG. 3 will be described. In the following, the contents of the process of FIG. 4 will be described using the text area TOA in the scanned image SI as an example. When a plurality of text objects are included in the scanned image SI, the process of FIG. 4 is executed for each text object (that is, for each text area).

  In S162, the CPU 62 generates a projection histogram corresponding to the text area TOA. The projection histogram is an ON pixel (that is, a pixel indicating “1”) in a case where each pixel representing the text area TOA is projected in the horizontal direction among a plurality of pixels constituting the binary data BD (see S110). Shows the frequency distribution. In other words, the projection histogram shows the frequency distribution of the character constituent pixels when the pixels representing the text area TOA are projected in the horizontal direction among the plurality of pixels constituting the scan image data SID. The character composing pixel is a pixel (that is, a pixel indicating black) constituting a character (for example, “A”) included in the text area TOA. In the projection histogram, a character string of one line (for example, “A to E”) is represented by a range in which the frequency is higher than zero (hereinafter referred to as “high frequency range”). The line spacing (for example, the line spacing between “A to E” and “F to K”) is represented in a range where the frequency is zero.

  In S164, the CPU 62 determines one or more band-like regions corresponding to one or more high-frequency ranges using the projection histogram generated in S162. The length in the vertical direction (that is, the number of pixels in the vertical direction) of one band-like region is equal to the length in the vertical direction of the high-frequency range corresponding to the band-like region. Further, the length in the horizontal direction of one band-like region (that is, the number of pixels in the horizontal direction) is equal to the length in the horizontal direction of the object region TOA. More specifically, the CPU 62 selects, from the text area TOA, a band-shaped area LA11 including the character string “A to E”, a band-shaped area LA12 including the character string “F to K”, and the character string “LM”. A band-like area LA13 including the band-shaped area LA14 including the character string “N to Q” is determined (that is, a total of four band-shaped areas LA11 to LA14 are determined).

  Subsequently, the CPU 62 executes the processes of S166 to S174 to determine each reference position corresponding to each of the belt-like areas LA11 to LA14. The reference position is a position serving as a reference for combining the character strings included in the belt-like regions in the combining process in S200 of FIG. 2 (see FIG. 5 described later).

  In S166, the CPU 62 determines one band-shaped area (hereinafter referred to as “target band-shaped area”) among the four band-shaped areas LA11 to LA14 determined in S164 as a processing target. Hereinafter, a case where the band-shaped area LA11 is determined as the target band-shaped area will be described as an example.

  In S168, the CPU 62 sets an evaluation range for three pixels in the vertical direction from the entire vertical range AR of the target strip area LA11. In S168 for the first time regarding the target band-shaped area LA11, the CPU 62 sets the first evaluation range so that the uppermost pixel of the three pixels exists at an intermediate position of the entire vertical range AR of the target band-shaped area LA11. Set. In S168 after the second time regarding the target band-shaped region LA11, the CPU 62 sets the current evaluation range so that the previous evaluation range is shifted downward by one pixel. In the modified example, the evaluation range may not be a range corresponding to three pixels in the vertical direction, may be a range corresponding to one pixel or two pixels in the vertical direction, or more than four pixels in the vertical direction. It may be a range.

  In S170, the CPU 62 calculates the total lower side length for the current evaluation range. The total lower side length is the length of one or more unit regions among the five unit regions (determined in S130 of FIG. 3) corresponding to the five characters “A” to “E” in the target strip-shaped region LA11. When the lower sides XA to XE are present in the current evaluation range, it is the sum of the lengths of the lower sides of the one or more unit regions. In the example of FIG. 4, since the lower side of one unit area does not exist in the first and second evaluation ranges, the CPU 62 determines “0” as the total lower side length. In the evaluation range for the pth time, all of the five lower sides XA to XE exist, so the CPU 62 has a value of “1” or more as the total lower side length (that is, the length of the five lower sides XA to XE). Sum).

  In S172, the CPU 62 determines whether or not the processes of S168 and S170 have been completed for all the evaluation ranges of the target strip area LA11. Specifically, the CPU 62 determines that all the evaluation ranges when the lower end of the entire vertical range AR of the target strip-shaped region LA11 matches the lower end of the previous evaluation range (for example, the p-th evaluation range). (YES in S172), the process proceeds to S174. On the other hand, if the CPU 62 determines that the processing has not been completed for all the evaluation ranges (NO in S172), the CPU 62 returns to S168 and newly sets an evaluation range.

  In S174, the CPU 62 determines the reference position of the target strip area LA11 based on the plurality of total lower side lengths calculated for the plurality of evaluation ranges. Specifically, the CPU 62 first has one evaluation range (for example, the p-th evaluation) in which the maximum total lower side length is calculated from the plurality of total lower side lengths. Range). In addition, when there are two or more evaluation ranges in which the maximum total lower side length is calculated among the plurality of evaluation ranges, the CPU 62 sets the first among the two or more evaluation ranges. Selected evaluation range. Then, the CPU 62 determines the intermediate position in the vertical direction of the selected evaluation range as the reference position. That is, in the example of FIG. 4, the position in the vicinity of the five lower sides XA to XE in the vertical direction of the target strip area LA11, that is, the position in the vicinity of the lowermost end of the target strip area LA11 is determined as the reference position. .

  In S176, the CPU 62 determines whether or not the processes of S166 to S174 have been completed for all the strip-shaped areas LA11 to LA14. If the CPU 62 determines that the process has not ended (NO in S176), the CPU 62 determines an unprocessed belt-like area (for example, LA12) as a process target in S166, and executes each process after S168 again. . As a result, four reference positions corresponding to the four belt-like regions LA11 to LA14 are determined. Then, if the CPU 62 determines that the process is complete (YES in S176), the process of FIG. 4 is terminated.

  As described above, in this embodiment, in order to determine the reference position, attention is paid to the length of the lower side of the unit area of each character. Therefore, the total lower side length is not normally maximized in the relatively upper range of the entire vertical range AR in the target band-shaped region LA11. Accordingly, in S168, the first evaluation range is set at the middle position of the entire vertical range AR of the target band-shaped region LA1, and then the evaluation range is moved downward. As a result, the number of evaluation ranges set in S168 can be reduced, and as a result, the reference position can be quickly determined.

  In another example shown in FIG. 4, the target band-shaped area determined as the processing target in S166 includes six characters “d” to “i” that are lowercase alphabets. For each character other than the character “i”, one unit region is determined, but for the character “i”, two unit regions are determined. The lower side Xg of the character “g” exists below the lower sides Xd to Xf, Xh, and Xi2 of the other five characters. In this example, one or more total lower side lengths are calculated for each of the evaluation range including the lower side Xi1, the evaluation range including the lower sides Xd to Xf, Xh, and Xi2, and the evaluation range including the lower side Xg. Since the total lower side length calculated for the evaluation range including the lower sides Xd to Xf, Xh, and Xi2 is maximized, the intermediate position of the evaluation range is determined as the reference position. As described above, in this embodiment, the reference position is determined based on the evaluation range having the maximum total lower side length, and two or more lines of character strings are combined based on the reference position (in S200 of FIG. 2). (See the combined image CI1). For this reason, it is possible to suppress the user from unnaturally feeling the arrangement of a plurality of characters constituting the character string in the processed image PI (see S500 in FIG. 2).

(Combining process; FIG. 5)
Next, the contents of the combining process executed in S200 of FIG. 2 will be described with reference to FIG. In S210, the CPU 62 determines one text area (hereinafter referred to as “target text area”) among one or more text areas in the scanned image SI as a processing target. Hereinafter, a case where the text area TOA is determined as the target text area will be described as an example.

  In S212, the CPU 62 processes one band-like area (hereinafter referred to as “target band-like area”) among the four band-like areas LA11 to LA14 (see S164 in FIG. 4) determined for the target text area TOA. Decide as a target.

  In S214, the CPU 62 generates a projection histogram corresponding to the target band-like region (for example, LA11). The projection histogram indicates an ON pixel (that is, “1”) when each pixel representing the target band-like region is projected in the vertical direction among a plurality of pixels constituting the binary data BD (see S110 in FIG. 3). (Pixel) frequency distribution. In other words, the projection histogram shows the distribution of the frequency of the character constituting pixels when each pixel representing the target band-like region is projected in the vertical direction among the plurality of pixels constituting the scan image data SID. In the projection histogram, one character (for example, “A”) is represented in a range where the frequency is higher than zero, and a blank area between two characters (for example, “A” and “B”) Expressed in the range where the frequency is zero. Further, in the projection histogram, when a margin exists between the leading end (that is, the left end) of the target band-like region and the first character (for example, “A”), the margin region (hereinafter, “leading margin region”). Is expressed in the range where the frequency is zero. Similarly, when there is a blank space between the rear end (that is, the right end) of the target band-shaped region and the last character (for example, “E”), the blank region (hereinafter referred to as “rear end blank region”). ) Is represented in the range where the frequency is zero.

  In S216, the CPU 62 uses the projection histogram generated in S214 to specify the horizontal length of the leading edge margin region in the target band-shaped region, and the horizontal length of the leading margin region is larger than the threshold value th1. Judge whether it is large or not. Thereby, the CPU 62 can determine whether or not a relatively large blank area (that is, an indent) exists on the leading end side of the target band-shaped area with respect to the character string in the target band-shaped area. That is, the CPU 62 can determine whether or not the character string in the target band-like region is a character string that forms the head of the paragraph. The threshold th1 is determined according to the length in the vertical direction of the target band-like region. Specifically, the CPU 62 determines a value equal to the vertical length of the target strip area as the threshold th1. However, in the modified example, the threshold th1 may be a value different from the vertical length of the target strip-shaped region (for example, 0.5 times the vertical length of the target strip-shaped region) or may be determined in advance. It may be a fixed value.

  If the CPU 62 determines that the horizontal length of the leading edge margin area is larger than the threshold th1 (YES in S216), that is, determines that the character string in the target band-shaped area is the character string constituting the head of the paragraph. If so, the process of S218 is executed without determining that the character string and the character string of the previous line are to be combined. In S218, the CPU 62 determines a new band-shaped area in which the leading edge blank area in the target band-shaped area is maintained and the trailing edge blank area in the target band-shaped area is deleted. If the target band-shaped area does not include the trailing edge blank area, in S218, the CPU 62 determines the target band-shaped area as a new band-shaped area as it is. In this way, the CPU 62 acquires partial image data representing a determined new band-like area. Since the character string represented by the partial image data includes an indented blank area on the leading end side of the character string, the character string usually constitutes the first character string of the paragraph. Therefore, hereinafter, the partial image data and the character string are referred to as “first partial image data” and “first character string”, respectively.

  On the other hand, when the CPU 62 determines that the horizontal length of the leading edge margin area is equal to or smaller than the threshold th1 (NO in S216), that is, the character string in the target band-like area is not a character string constituting the head of the paragraph. When determining, the character string and the character string of the previous line are determined as a combination target, and the process of S220 is executed. In S220, the CPU 62 first determines a new band area in which the front end margin area and the rear end margin area in the target band area are deleted. If the target band area does not include the front end margin area and the rear end margin area, in S220, the CPU 62 determines the target band area as a new band area as it is. In this way, the CPU 62 acquires partial image data representing a determined new band-like area. The character string represented by the partial image data usually does not constitute the first character string of the paragraph. Therefore, hereinafter, the partial image data and the character string are referred to as “non-leading partial image data” and “non-leading character string”, respectively.

  In S220, the CPU 62 further controls the previous line so that the character string of the previous line of the non-first character string (for example, the first character string determined in S218) exists on the left side and the non-first character string exists on the right side. A character string and a non-leading character string are joined in a straight line along the horizontal direction. More specifically, the CPU 62 has the reference position determined for the preceding character string (see S174 in FIG. 4) and the reference position determined for the non-leading character string at the same vertical position. As described above, the partial image data (for example, the leading character string image data) representing the preceding character string and the non-leading character string image data representing the non-leading character string are combined. At this time, the CPU 62 displays a pixel representing the blank area so that a blank area having a predetermined fixed length in the horizontal direction is formed between the character string in the previous line and the non-leading character string. That is, the pixels having the background color of the scanned image SI are supplemented. That is, the CPU 62 combines the partial image data via the pixels to be replenished. The fixed length is a length (for example, a length equal to or greater than h / 4 in S242 in FIG. 7) in which a blank area having the fixed length can be determined as a division candidate position to be described later. If the image represented by the combined image data does not have a rectangular shape, the CPU 62 supplements the pixels having the background color of the scanned image SI to generate image data representing the rectangular image. When S220 ends, the process proceeds to S222.

  In S222, the CPU 62 determines whether or not the processing in S212 to S220 has been completed for all the band-like regions (for example, LA11 to LA14) included in the target text region. If the CPU 62 determines that the process has not ended (NO in S222), the CPU 62 determines an unprocessed belt-like area (eg, LA12) as a process target in S212, and executes each process subsequent to S214 again. . If the CPU 62 determines that the process has been completed (YES in S222), the CPU 62 proceeds to S224.

  In S224, the CPU 62 determines whether or not the processing in S210 to S222 has been completed for all text regions in the scan image SI. If the CPU 62 determines that the processing has not ended (NO in S224), the CPU 62 determines an unprocessed text area as a processing target in S210. If the CPU 62 determines that the process has been completed (YES in S224), the CPU 62 executes the division candidate position determination process (see FIG. 7 described later) in S230, and then ends the process in FIG.

(Concrete processing example; FIG. 6)
Next, a specific example of the combining process in FIG. 5 will be described with reference to FIG. In (1-1) of (Example 1), it is determined that the leading edge blank area FB11 of the strip-shaped area LA11 is larger than the threshold th1 (YES in S216). Since the band-shaped area LA11 does not include the rear margin area, the band-shaped area LA11 is determined as a new band-shaped area as it is, and the head partial image data representing the band-shaped area LA11 is acquired (S218).

  In (1-2), it is determined that the leading edge blank area FB12 of the strip-shaped area LA12 is equal to or less than the threshold th1 (NO in S216). Since the band-shaped area LA12 does not include the front end margin area and the rear end blank area, the band-shaped area LA12 is determined as a new band-shaped area as it is, and the non-leading partial image data representing the band-shaped area LA12 is acquired (S220).

  In (1-3), the two reference positions of the two strip-like areas LA11 and LA12 are located at the same position in the vertical direction via pixels representing a margin area having a fixed length (1- The first partial image data of 1) and the non-first partial image data of (1-2) are combined (S220). As a result, the middle representing the intermediate image MI1 including the character string “A to K” of one line in which the character string “A to E” and the character string “F to K” are linearly coupled along the horizontal direction. Image data is generated.

  In (1-4), it is determined that the leading edge blank area FB13 of the band-shaped area LA13 is equal to or less than the threshold th1 (NO in S216). Since the band-shaped area LA13 includes the rear end blank area RB13, a new band-shaped area from which the rear end blank area RB13 has been deleted is determined, and non-leading partial image data representing the new band-shaped area is acquired (S220).

  In (1-5), the three reference positions of the three strip-shaped areas LA11 to LA13 are located at the same position in the vertical direction through pixels representing a margin area having a fixed length (1- The intermediate image data representing the intermediate image MI1 in 3) and the non-leading partial image data in (1-4) are combined (S220). As a result, the combined image data representing the combined image CI1 including the character string “A to M” in one line in which the character string “A to K” and the character string “LM” are linearly combined in the horizontal direction. Is generated.

  In the above (1-3) and (1-5), when the non-leading partial image data is combined, a blank area having the same fixed length is inserted. Therefore, in the combined image CI1, the character “E” And the length of the margin between the characters “F” and the length of the margin between the characters “K” and “L” are the same. As a result, the lengths of the margins between the characters constituting the character string “A to M” in the combined image CI1 can be substantially equal.

  In (1-6), it is determined that the leading edge blank area FB14 of the strip-shaped area LA14 is larger than the threshold th1 (YES in S216). Since the band-shaped area LA14 includes the rear end blank area RB14, a new band-shaped area from which the rear end blank area RB14 has been deleted is determined, and the head partial image data representing the new band-shaped area is acquired (S218). Since the band-shaped area LA14 is the last processing target (YES in S222 in FIG. 5), the top partial image data acquired here becomes combined image data representing the combined image CI2. That is, in (Example 1), two combined image data representing two combined images CI1 and CI2 corresponding to two paragraphs are generated.

  Subsequently, (Example 2) will be described. (2-1) to (2-5) are substantially the same as the above (1-1) to (1-5). That is, in (2-1), it is determined that the leading edge blank area FB21 is larger than the threshold value th1, and the head partial image data representing the strip-shaped area LA21 is acquired (S218). In (2-2), it is determined that the leading edge blank area FB22 is equal to or less than the threshold th1, and non-leading partial image data representing the belt-shaped area LA12 is acquired (S220). In (2-3), the head partial image data in (2-1) and the non-head partial image data in (2-2) are combined (S220). As a result, intermediate image data representing intermediate image MI2 including one line of character string “d to v” is generated. In (2-4), it is determined that the leading edge blank area FB23 is larger than the threshold th1, and a new belt-like area in which the trailing edge blank area FR23 of the belt-like area LA23 is erased is determined, and the non-printing area representing the new belt-like area First partial image data is acquired (S220). In (2-5), the intermediate image data of (2-3) and the non-display of (2-4) are set so that the three reference positions of the three strip regions LA21 to LA23 are present at the same position in the vertical direction. The head partial image data is combined (S220). As a result, an intermediate image MI3 including one line of character strings “d to vW to Z” in which the character strings “d to v” and the character strings “W to Z” are linearly coupled along the horizontal direction is obtained. Representing intermediate image data is generated.

  The intermediate image MI3 of (2-5) does not have a rectangular shape. Therefore, in (2-6), pixels representing a blank area in the intermediate image data representing the intermediate image MI3, that is, the scan image SI, are formed so that a combined image CI3 having a rectangular shape circumscribing the intermediate image MI3 is formed. Pixels having a background color are supplemented (S220). Thus, combined image data representing the combined image CI3 having a rectangular shape is generated.

(Division candidate position determination processing; FIG. 7)
Next, the contents of the division candidate position determination process executed in S230 of FIG. 5 will be described with reference to FIG. In S232, the CPU 62 selects one combined image data (hereinafter referred to as “target combination”) of one or more combined image data representing one or more combined images (for example, CI1) generated in S210 to S224 in FIG. (Referred to as “image data”) as a processing target. In the example of FIG. 7, the target combined image CI <b> 1 represented by the target combined image data includes an English sentence “I side 'I have a dream ′.”.

  In S234, the CPU 62 executes binarization processing on the target combined image data. The contents of the binarization process are the same as S110 in FIG.

  In S236, the CPU 62 uses the binary data generated in S234 to generate a projection histogram corresponding to the target combined image data. The projection histogram shows the frequency distribution of ON pixels (that is, character constituent pixels) when the pixels constituting the binary data are projected in the vertical direction. In the projection histogram, one character or symbol (for example, “I”, “′”, “.”) Is represented in a range where the frequency is higher than zero, and a blank portion between two characters or symbols ( For example, in “I Said”, a blank portion between “I” and “s”, a blank portion between “s” and “a”, and the like) are expressed in a range where the frequency is zero.

  In S238, the CPU 62 sets a threshold value for distinguishing between a region in which the character component pixel exists and a region in which the character component pixel does not exist in the target combined image CI1. Specifically, the CPU 62 sets zero as a threshold value in principle. However, if there is one or more continuous ranges in the projection histogram generated in S236, the CPU 62 selects one or more continuous ranges and selects each of the selected one or more continuous ranges. , A minimum value of the frequency within the continuous range (that is, a value greater than zero) is determined as a threshold value. That is, the CPU 62 determines a value larger than zero as the threshold value for the continuous range, and determines zero as a threshold value for a range other than the continuous range. For example, when there is no continuous range as in the target combined image CI1 in FIG. 7, the CPU 62 determines zero as the threshold value for all ranges. The continuous range is, for example, a range that represents a decorative line when a decorative line such as a strikethrough or underline is included in the sentence. Since the decoration line is represented by ON pixels, the range corresponding to the decoration line in the projection histogram has a frequency higher than zero and is relatively long in the horizontal direction. For this reason, in this embodiment, the CPU 62 selects a range having a frequency that is higher than zero and has a lateral length equal to or greater than a predetermined length as a continuous range. The predetermined length is determined in advance according to the resolution of the scanned image data SID. For example, when the resolution of the scan image data SID is 300 dpi, the predetermined length is 50 pixels, and when the resolution is 600 dpi, the predetermined length is 100 pixels. The predetermined length may be any value as long as the presence of the decoration line can be specified. For example, the predetermined length is a value larger than the horizontal length of one character. The threshold value determined here is used in S240 and S244 described later.

  In S240, the CPU 62 determines one intermediate blank area as a processing target using the projection histogram generated in S236 and the threshold value determined in S238. The intermediate margin area is an area corresponding to a margin portion between two characters or symbols. Specifically, the middle blank area is an area between two areas having a frequency higher than the threshold determined in S238 and having a frequency equal to or lower than the threshold. For example, in the target combined image CI1 in FIG. 7, the frequency of zero is determined as the threshold for all ranges. In this case, for example, a region BA1 (that is, a region BA1 having a frequency of zero) sandwiched between two regions having a frequency higher than zero (that is, an “I” region and an “s” region) is an intermediate blank region. is there. In S240 for the first time, the CPU 62 determines one intermediate blank area (area BA1 in the target combined image CI1 in FIG. 7) existing on the most distal side (that is, the left side) as a processing target. Then, in the second and subsequent S240s, the CPU 62 selects one intermediate blank area (for example, “for example,“ at the forefront side) among one or more intermediate blank areas existing on the right side of the previous intermediate blank area to be processed. The area between “s” and “a” in “said”) is determined as the current processing target.

  In S242, the CPU 62 determines whether the horizontal length of the intermediate blank area to be processed is less than h / 4. Here, “h” is the length in the vertical direction of the target combined image CI1 (that is, the number of pixels in the vertical direction).

  When determining that the horizontal length of the intermediate blank area to be processed is equal to or greater than h / 4 (NO in S242), in other words, the CPU 62 determines that the intermediate blank area is relatively large. In S246, the right end of the intermediate blank area is determined as the division candidate position. Thus, since the blank area is determined as the division candidate position, it is possible to suppress division in the middle of one character (for example, “A”). The reason why the right end of the middle blank area is determined as the division candidate position is as follows. For example, a situation is assumed in which the character string is divided at the right end of each of the two middle blank areas included in one line of character string, and the third line of character strings arranged in the vertical direction is rearranged. . In this case, since a blank space is not formed on the left side of the character strings on the second and third lines, the leading ends (that is, the left ends) of the character strings on the second and third lines can be aligned. As described above, since the leading ends of the character strings in the second and subsequent lines can be aligned, the appearance of the rearranged character strings in a plurality of lines can be made beautiful. In a modified example, in S246, the CPU 62 may determine a position other than the right end of the intermediate blank area (for example, the left end, the intermediate position, etc.) as the division candidate position. When S246 ends, the process proceeds to S248.

  On the other hand, when the CPU 62 determines that the horizontal length of the intermediate blank area to be processed is less than h / 4 (YES in S242), in other words, determines that the intermediate blank area is relatively small. In this case, in S244, it is determined whether or not the lateral length of at least one of the left adjacent area and the right adjacent area is less than h / 2. The left side (or right side) adjacent region is a region adjacent to the intermediate margin region on the left side (or right side) of the intermediate blank region to be processed, and has a frequency higher than the threshold value determined in S238. For example, in the intermediate blank area BA1, the area corresponding to “I” and the area corresponding to “a” in “I Said” are the left adjacent area and the right adjacent area, respectively.

  When the CPU 62 determines that the lateral lengths of both the left adjacent area and the right adjacent area are equal to or greater than h / 2 (NO in S244), for example, the CPU 62 compares the left adjacent area with the right adjacent area. If there is a large character (for example, uppercase alphabetic characters, kanji characters, Japanese kana characters, etc.), the right end of the middle blank area is determined as the division candidate position in S246. On the other hand, when the CPU 62 determines that the horizontal length of at least one of the left adjacent area and the right adjacent area is less than h / 2 (YES in S244), for example, the left adjacent area and the right adjacent area If there is a relatively small character (for example, lowercase alphabet) or a symbol (for example, comma, period, quotation mark, etc.) in at least one of them, the process proceeds to S248 without executing S246. That is, the CPU 62 does not determine the intermediate blank area to be processed this time as the division candidate position.

  In S248, the CPU 62 determines whether or not the processing of S240 to S246 has been completed for all intermediate blank areas included in the target combined image CI1. If the CPU 62 determines that the process has not ended (NO in S248), the CPU 62 determines an unprocessed intermediate blank area as a process target in S240, and executes each process after S242 again. If the CPU 62 determines that the process has been completed (YES in S248), the CPU 62 proceeds to S250.

  In S250, the CPU 62 determines whether or not the processing of S232 to S248 has been completed for all the combined image data generated in S210 to S224 of FIG. If the CPU 62 determines that the process has not ended (NO in S250), it determines unprocessed combined image data as a processing target in S232. Then, if the CPU 62 determines that the process is complete (YES in S250), the process of FIG. 7 is terminated.

(Specific example of dividing position determination processing; FIG. 8)
Next, a specific example of the dividing position determination process in FIG. 7 will be described with reference to FIG. The target combined image in case A is the same as the target combined image CI1 in FIG. Therefore, there is no continuous range (that is, a decoration line) in the target combined image, and the frequency of zero is determined as the threshold value for all ranges (S238). In this case, an area BA1 between “I” and “s” in “I Said” is determined as the first intermediate blank area to be processed (S240). The intermediate margin area BA1 corresponds to a margin (so-called space) between the word “I” and the word “said”, and usually has a horizontal length of h / 4 or more (NO in S242). Therefore, the middle blank area BA1 is determined as the division candidate position (S246). Even if the character string is divided at the space between the two English words “I” and “said”, it is unlikely that the user will find it difficult to read the divided character strings. The margin area BA1 is determined as the division candidate position.

  Next, an area BA2 between “s” and “a” in “I Said” is determined as the second intermediate blank area to be processed (S240). The middle margin area BA2 corresponds to a margin between two letters (that is, “s” and “a”) constituting one English word “said”, and is generally a horizontal length of less than h / 4. (YES in S242). Further, the left side adjacent area and the right side adjacent area of the middle blank area BA2 correspond to “s” and “a” of “said”, respectively, and generally have a lateral length of less than h / 2 ( YES in S244). Therefore, the intermediate blank area BA2 is not determined as the division candidate position. When a character string is divided by a blank space between two characters (for example, “s” and “a”) constituting one English word (for example, “said”), the user can select each character string after the division. Since there is a high possibility that it will be difficult to read, in the present embodiment, the intermediate blank area BA2 is not determined as the division candidate position.

  Similarly to the above, for each of the third and subsequent intermediate margin regions, whether or not the intermediate margin region is a division candidate position is determined. For example, in “... Said side“ I... ”, The intermediate margin area BA3 corresponding to the margin between“ d ”and“ ′ ”has a horizontal length of h / 4 or more (S242). NO), it is determined as a division candidate position (S246). Further, for example, the intermediate margin area BA4 corresponding to the margin between “′” and “I” has a lateral length of less than h / 4 (YES in S242). Then, both the left adjacent area “′” and the right adjacent area “I” of the middle blank area BA4 have a lateral length of less than h / 2 (YES in S244). For this reason, the middle blank area BA4 is not determined as a division candidate position. As a result, five division candidate positions are determined for the sentence “I side‘ I have a dream ’.”.

  In case A, an example is assumed in which a margin between two English words is determined as a division candidate position. However, for example, even when a space for one character is inserted between Japanese sentences, the space is usually determined as NO in S242 and determined as a division candidate position (S246). . Even in a language different from English and Japanese, when a relatively large margin exists, the margin is usually determined as a division candidate position.

  In case B, the target combined image includes the same sentence as in case A, but “’ I have a dream ”. In this case, in the projection histogram generated in S236, the range corresponding to the strikethrough has a predetermined length that is higher than zero and has a predetermined length (for example, 50 pixels) or more. The range is selected as a continuous range. Then, for the continuous range (ie, “'I have a dream'.”), The minimum value of the frequency within the continuous range (ie, a value greater than zero) is determined as a threshold, and a range other than the continuous range (ie, “I side ") is determined as a threshold value (S238).

  In a range other than the continuous range (ie, “I Said”), as in case A, each intermediate margin area is determined using the threshold value zero, and the intermediate margin area BA1 is determined as a division candidate position (NO in S242). ). Further, the threshold value is zero in the left range in the area BA5 (that is, the range without the strikethrough), and the threshold value is zero in the right range in the area BA5 (that is, the range with the strikethrough). It is a positive value. Since it is determined that the left range in the area BA5 is less than or equal to the threshold (that is, zero) and the right range in the area BA5 is determined to be less than or equal to the threshold (that is, the positive value), the area BA5 Is determined as an intermediate margin area (S240). In addition, since the areas BA6 and BA7 within the continuous range are also determined to be equal to or less than the threshold value (that is, the positive value), the areas BA6 and BA7 are determined as intermediate blank areas (S240). Then, the intermediate margin areas BA5 and BA7 are determined as the division candidate positions (NO in S242, S246), and the intermediate margin area BA6 is not determined as the division candidate position (YES in S242 and YES in S244). As described above, in this embodiment, a threshold value greater than zero is determined for the continuous range corresponding to the strikethrough line, and therefore, considering the strikethrough line, the intermediate blank area BA5 and the like and the adjacent area (for example, “I”). Area) to be determined appropriately. As a result, like the case A, the five division candidate positions can be appropriately determined.

  Case B assumes a situation in which a strikethrough is attached, but a similar projection histogram can be obtained even when an underline is attached instead of a strikethrough. For this reason, even in the case of being underlined, the five division candidate positions can be appropriately determined as in the case B.

  The target combined image of case C includes a Japanese character string. The intermediate margin area BA8 corresponds to a margin between the parenthesis C1 and the hiragana C2 (ie, “A”), and generally has a lateral length of less than h / 4 (YES in S242). Also, the right adjacent area (ie Hiragana C2) usually has a lateral length of h / 2 or more, while the left adjacent area (ie bracket C1) usually has a lateral length of less than h / 2. (YES in S244). Therefore, the middle blank area BA8 is not determined as the division candidate position. If the character string is divided at the blank space between the parenthesis and the character, the user is likely to find it difficult to read each character string after the division. Therefore, in this embodiment, the middle blank area BA8 is determined as the division candidate position. Not.

  The middle margin area BA9 corresponds to a margin between a left line and a right line constituting one hiragana C3 (ie, “I”), and generally has a lateral length of less than h / 4 ( YES in S242). Further, the left adjacent area (ie, the left line constituting Hiragana C3) and the right adjacent area (ie, the right line constituting Hiragana C3) usually have a lateral length of less than h / 2 (S244). YES) Therefore, the middle blank area BA9 is not determined as the division candidate position. If one hiragana C3 is divided, the user cannot recognize one hiragana C3. Therefore, in the present embodiment, the intermediate blank area BA9 is not determined as the division candidate position. Not only hiragana “I”, but also hiragana C8 to C10 (ie, “ke”, “ni”, “ha”), katakana C11 (ie, “ha”), and kanji C12 (ie, “egg”), 1 Although margins can be formed between individual characters, the margins are usually not determined as division candidate positions (YES in S244).

  The intermediate margin area BA10 corresponds to a margin between the hiragana C4 (ie, “U”) and the hiragana C5 (ie, “e”), and generally has a lateral length of less than h / 4 (YES in S242). . The left adjacent area (ie Hiragana C4) and the right adjacent area (ie Hiragana C5) usually have a lateral length of h / 2 or more (NO in S244). Therefore, the intermediate blank area BA10 is determined as the division candidate position (S246). Even if the character string is divided at the margin between two Japanese characters, it is unlikely that the user will find it difficult to read each divided character string. In this embodiment, the intermediate margin area BA10 is divided. It is determined as a candidate position.

  The intermediate margin area BA11 corresponds to a margin between the hiragana C6 (ie, “o”) and the punctuation point C7 (ie, “.”), And generally has a lateral length of less than h / 4 (YES in S242). . The left adjacent area (ie hiragana C6) typically has a lateral length of h / 2 or more, while the right adjacent area (ie phrase C7) typically has a lateral length of less than h / 2. (YES in S244). Therefore, the intermediate blank area BA11 is not determined as the division candidate position. If the character string is divided at the margin between the character and the punctuation point, the user is likely to find it difficult to read each character string after the division. In this embodiment, the intermediate margin area BA11 is determined as the division candidate position. Not. Similarly, the margin between the character and the punctuation mark (that is, “,”) is not usually determined as the division candidate position (YES in S244).

(Relocation processing; FIG. 9)
Next, the contents of the rearrangement process executed in S400 of FIG. 2 will be described with reference to FIG. In S410, the CPU 62 determines one text area (for example, TOA) out of one or more text areas in the scanned image SI as a processing target. Hereinafter, the text area determined as the processing target in S410 is referred to as “target text area”. A target area determined for the target text area (for example, TA in S300 in FIG. 2) is referred to as a “target target area”. In addition, a combined image (for example, CI1 and CI2 in S200 of FIG. 2) in which the character strings included in the target text area are combined, and combined image data representing the combined image are referred to as “target combined image”, “ This is called “target combined image data”.

  In S420, the CPU 62 determines the initial value of the horizontal length W (that is, the number of pixels W in the horizontal direction) of the candidate rearrangement region that is a candidate for the rearrangement region to be determined (see RA in S400 in FIG. 2). As the initial value of the vertical length H (that is, the number of vertical pixels H), the horizontal length OPx and the vertical length OPy of the target text area are set, respectively.

  In S430, the CPU 62 determines that the ratio W / H of the horizontal length W to the vertical length H of the candidate rearrangement area is the ratio of the horizontal length TW to the vertical length TH of the target target area. It is determined whether it is less than TW / TH.

  When the CPU 62 determines that the ratio W / H is less than the ratio TW / TH (YES in S430), in S432, the fixed length predetermined to the current length W in the horizontal direction of the candidate rearrangement region is determined. The value β (for example, one pixel) is added to determine a new lateral length W of the candidate rearrangement region. When S432 ends, the process proceeds to S440.

  On the other hand, if the CPU 62 determines that the ratio W / H is greater than or equal to the ratio TW / TH (NO in S430), the CPU 62 determines in advance from the current length W in the horizontal direction of the candidate rearrangement region in S434. A fixed length β (for example, one pixel) is subtracted to determine a new horizontal length W of the candidate rearrangement region. When S434 ends, the process proceeds to S440. In the present embodiment, the same fixed value β is used in S432 and S434. However, in a modified example, the fixed value in S432 and the fixed value in S434 may be different values.

  In S440, the CPU 62 determines the length m between rows along the vertical direction (that is, the number m of pixels between rows) according to the resolution of the scan image data SID. For example, when the resolution of the scanned image data SID is 300 dpi, the CPU 62 determines one pixel as the length m between the rows, and when the resolution of the scanned image data SID is 600 dpi, the length m between the rows. 2 pixels are determined. That is, the CPU 62 determines a larger line length m as the resolution of the scanned image data SID increases. According to this configuration, the CPU 62 can determine the length m between lines having an appropriate size according to the resolution of the scanned image data SID. In the modified example, the same value may be adopted as the length m between lines regardless of the resolution of the scanned image data SID.

  In S450, the CPU 62 executes a row number determination process based on the target combined image data and the new horizontal length W of the candidate rearrangement region determined in S432 or S434 (FIG. 10 described later). reference). In the line number determination process, the CPU 62 determines the number of lines in the case where a plurality of characters (for example, “A to M”) included in the target combined image (for example, CI1 in FIG. 2) are rearranged in the candidate rearrangement region. To do.

(Line number determination processing; FIG. 10)
With reference to FIG. 10, the contents of the line number determination process executed in S450 of FIG. 9 will be described. When there are two or more target combined images, the CPU 62 executes the number-of-rows determination process for each target combined image, and the number of two or more lines corresponding to the two or more target combined images. To decide.

  In S451, the CPU 62 determines whether or not the horizontal length IW of one target combined image (for example, CI1) is equal to or smaller than the horizontal length W of the candidate rearrangement region. If the CPU 62 determines that the length IW is less than or equal to the length W (YES in S451), the CPU 62 determines “1” as the number of rows in S452. This is because all the characters (for example, “A to M”) included in the target combined image (for example, CI1) are arranged in a straight line along the horizontal direction, and all the characters fit in the candidate rearrangement region. . When S452 ends, the process of FIG. 10 ends.

  On the other hand, when the CPU 62 determines that the length IW is larger than the length W (NO in S451), it is necessary to divide and arrange a plurality of characters included in the target combined image into a plurality of lines. For this purpose, the CPU 62 executes S453 and 454, and selects from among a plurality of division candidate positions determined in FIG. 7 (for example, refer to a plurality of arrows attached to the target combined image CI1 in FIG. 10). One or more division candidate positions are selected.

  In S453, the CPU 62 selects one division candidate position from among a plurality of division candidate positions so that the selection length SW becomes the maximum length not more than the horizontal length W of the candidate rearrangement area. To do. In a state where one division candidate position has not yet been selected, the selection length SW is a horizontal length between the leading end (that is, the left end) of the target combined image and the division candidate position to be selected. is there. In a state where one or more division candidate positions have already been selected, the selection length SW is present at the most recently selected division candidate position and the rear end side (that is, the right side) of the division candidate position. This is the length in the horizontal direction between the division candidate position to be newly selected. In the example of FIG. 10, a division candidate position between the character “F” and the character “G” included in the target combined image CI1 is selected.

  In S454, the CPU 62 determines whether or not the remaining length RW is less than or equal to the horizontal length W of the candidate rearrangement region. The remaining length RW is a length in the horizontal direction between the most recently selected division candidate position and the rear end (that is, the right end) of the target combined image. If the CPU 62 determines that the remaining length RW is greater than the length W (NO in S454), the CPU 62 returns to S453, and from among the plurality of division candidate positions that are selected most recently. A division candidate position existing on the rear end side is newly determined.

  On the other hand, if the CPU 62 determines that the remaining length RW is less than or equal to the length W (YES in S454), it is obtained by adding “1” to the number of selected division candidate positions in S455. Determine the number as the number of rows. When S455 ends, the process of FIG. 10 ends.

  In the example of FIG. 10, the CPU 62 selects only one division candidate position for the target combined image CI1. As a result, the CPU 62 determines “2” as the number of rows corresponding to the target combined image CI1. Further, the CPU 62 determines that the horizontal length IW of the target combined image CI2 is equal to or smaller than the horizontal length W of the candidate rearrangement region (YES in S451), and as a result, corresponds to the target combined image CI2. “1” is determined as the number of rows to be executed.

(Continuation of rearrangement processing; FIG. 9)
In S460 of FIG. 9, the CPU 62 determines a new length H in the vertical direction of the candidate rearrangement region according to the formula in S460. In the formula in S460, “NH” is the height of the rearranged character string obtained from one target combined image, and “N” is the number of target combined images. “M” is the length between lines determined in S440, “n” is the number of lines determined in S450, and “h” is the vertical length of the target combined image (FIG. 10). H1 of the combined image CI1 and h2 of the combined image CI2).

  In S470, the CPU 62 determines whether or not the aspect ratio W / H of the candidate rearrangement area approximates the aspect ratio TW / TH of the target target area. Specifically, the CPU 62 determines whether or not the aspect ratio W / H of the candidate rearrangement area is included within a predetermined range set based on the aspect ratio TW / TH of the target target area. The predetermined range includes a value obtained by subtracting the value γ from the aspect ratio TW / TH of the target target area, a value obtained by adding the value γ to the aspect ratio TW / TH of the target target area, The range between. Note that the value γ may be a predetermined fixed value, or may be a value obtained by multiplying TW / TH by a predetermined coefficient (for example, 0.05).

  If the CPU 62 determines that the aspect ratio W / H of the candidate rearrangement area does not approximate the aspect ratio TW / TH of the target target area (NO in S470), the CPU 62 executes each process of S430 to S460 again. Thereby, the CPU 62 determines a new length W in the horizontal direction and a new length H in the vertical direction of the candidate rearrangement region, and executes the determination in S470 again.

  On the other hand, if the CPU 62 determines that the aspect ratio W / H of the candidate rearrangement area is close to the aspect ratio TW / TH of the target target area (YES in S470), first, in S480, the horizontal length W And a candidate rearrangement area having a vertical length H are determined as rearrangement areas (for example, RA in FIG. 2). Then, when one or more division candidate positions have been selected in S453 of FIG. 10, the CPU 62 divides the target combined image data at the one or more division candidate positions, and two or more division images. Two or more pieces of divided image data representing are generated. Next, the CPU 62 arranges the two or more divided image data in the rearrangement region so that the two or more divided images are arranged in the vertical direction. At this time, the CPU 62 arranges the two pieces of divided image data so that the line spacing determined in S440 is formed between the two divided images adjacent in the vertical direction. As a result, for example, as shown in S400 of FIG. 2, rearranged image data representing a rearranged image RI in which a plurality of characters “A” to “Q” are rearranged in the rearrangement region RA is generated. Is done. The size of the plurality of characters “A” to “Q” in the rearranged image RI is equal to the size of the plurality of characters “A” to “Q” in the scan image SI.

  In S490, the CPU 62 determines whether or not the processing of S410 to S480 has been completed for all text areas. If the CPU 62 determines that the process has not ended (NO in S490), the CPU 62 determines an unprocessed text area as a process target in S410, and executes each process after S412 again. Then, if the CPU 62 determines that the process has been completed (YES in S490), the process of FIG. 9 is terminated.

(Specific case; Fig. 11)
Next, a specific case will be described with reference to FIG. 11 for the rearrangement process in S400 (see FIG. 9) in FIG. 2 and the enlargement process in S500. As shown in (1), as the initial value of the horizontal length W and the initial value of the vertical length H of the candidate rearrangement area, the horizontal length OPx and the vertical length of the target text area TOA, respectively. The direction length OPy is set (S420 in FIG. 9). In this case, W / H is less than TW / TH. That is, the target target area TA has a horizontally long shape as compared with the target text area TOA. In this case, if the candidate rearrangement area has a horizontally long shape, the aspect ratio of the candidate rearrangement area approaches the aspect ratio of the target target area TA. Accordingly, as shown in (2), the fixed value β is added to the current length W in the horizontal direction of the candidate rearrangement region to determine a new length W in the horizontal direction of the candidate rearrangement region. (S432).

  Next, three lines including the character string “A to E”, the character string “F to K”, and the character string “LM” are determined as the number of lines corresponding to the combined image CI1, and the number of lines corresponding to the combined image CI2 is determined. As described above, one line including the character string “N to Q” is determined (S450). Next, the length NH1 (= 3 rows × h1 + (3 rows−−) in the vertical direction of the three rows of rearranged character strings (ie, “A to E”, “F to K”, and “LM”) obtained from the combined image CI1. 1) × m) is calculated, and the vertical length NH2 (= 1 line × h2 + (1 line−1) ×× 1 line of rearranged character strings (ie, “N to Q”) obtained from the combined image CI2 m) is calculated (S460). Then, a new vertical length H (= NH1 + NH2 + (2-1) × m) of the candidate rearrangement region is determined (S460).

  In the state of (2), since the aspect ratio W / H of the candidate rearrangement area does not approximate the aspect ratio TW / TH of the target target area TA (NO in S470), as shown in (3), the candidate rearrangement The fixed value β is added again to the current length W in the horizontal direction of the area, and the new horizontal length W of the candidate rearrangement area is determined again (S432).

  Next, two lines including the character string “A to F” and the character string “G to M” are determined as the number of lines corresponding to the combined image CI1 (S450). That is, the maximum number of characters that can form one line of character string in the candidate rearrangement area increases due to the increase in the horizontal length W of the candidate rearrangement area. Further, one line including the character string “N to Q” is determined as the number of lines corresponding to the combined image CI2 (S450). Next, the length NH1 (= 2 lines × h1 + (2 lines−1) × m) in the vertical direction of the two lines of rearranged character strings (that is, “A to F” and “G to M”) obtained from the combined image CI1. ) Is calculated, and the vertical length NH2 (= 1 line × h2 + (1 line−1) × m) of the rearranged character string (that is, “N to Q”) obtained from the combined image CI2 is calculated. (S460). Then, a new vertical length H (= NH1 + NH2 + (2-1) × m) of the candidate rearrangement region is determined (S460).

  In the state (3), the aspect ratio W / H of the candidate rearrangement area approximates the aspect ratio TW / TH of the target target area TA (YES in S470). Therefore, as shown in (4), the candidate rearrangement region in (3) is determined as the rearrangement region RA (S480). Next, the combined image data representing the combined image CI1 is divided to generate two divided image data representing the two divided images DI1 and DI2 (S480). Then, the two divided images DI1, DI2 and the combined image CI2 are arranged in the vertical direction, and the two divided images are formed so as to form a space of length m between two adjacent images. Two pieces of divided image data representing the images DI1 and DI2 and target combined image data representing the combined image CI2 are arranged in the rearrangement region RA. As a result, rearranged image data representing the rearranged image RI is generated (S480).

  Next, the rearranged image data is enlarged, and enlarged image data representing the enlarged image is generated (S500 in FIG. 2). Specifically, the rearranged image RI is enlarged in the direction in which the diagonal line of the rearranged image RI extends, and as a result, enlarged image data representing the enlarged image is generated. For example, when the aspect ratio W / H of the rearrangement area RA is equal to the aspect ratio TW / TH of the target target area TA, all four sides of the enlarged image are in the four sides of the target target area TA. Match. In other words, in this case, the size of the enlarged image matches the size of the target area TA. However, if, for example, the aspect ratio W / H of the rearrangement area RA is not equal to the aspect ratio TW / TH of the target target area TA, any of the enlarged images in the process of gradually expanding the rearrangement image RI. The enlargement of the rearranged image RI is completed at the stage when these sides coincide with any side of the target target area TA. That is, in this case, the size of the enlarged image is smaller than the size of the target area TA.

  Subsequently, as shown in (5), the enlarged image data obtained by enlarging the rearranged image data representing the rearranged image RI is overwritten in the target area TA of the scanned image data SID (S500 in FIG. 2). . As a result, processed image data PID representing the processed image PI is completed.

(Effect of Example)
According to this embodiment, the image processing server 50 includes three partial images representing three lines of character strings (that is, “A to E”, “F to K”, and “LM”) obtained from the scanned image data SID. The data is combined to generate combined image data representing a combined image CI1 including a character string in which the three rows of character strings are linearly combined in the horizontal direction (S200 in FIG. 2). At this time, the image processing server 50 generates combined image data by using each unit area corresponding to each character in the scanned image SI (S130 in FIG. 3 and S170 in FIG. 4). Is generated, then, when a plurality of characters in the scan image SI are to be rearranged in the rearrangement area RA, the combined image data has only to be divided (S480 in FIG. 9, FIG. 11), It is not necessary to use data indicating the position of each character in the image SI. In particular, when dividing the combined image data, the image processing server 50 divides the combined image data into divided image data representing a divided image including two or more characters (for example, CI1 in FIG. 11). In other words, the image processing server 50 does not have to execute processing for each character in the scanned image SI. As a result, since the image processing server 50 can execute the processing quickly, the processed image data PID can be quickly provided to the user of the multi-function device 10.

  In this embodiment, the image processing server 50 generates combined image data representing the combined image CI1, and then uses the projection histogram generated in S236 of FIG. The position (i.e. the subsequent split position) can be determined appropriately. That is, the image processing server 50 can appropriately determine the division position of the combined image data in accordance with various cases shown in FIG. Therefore, the image processing server 50 can appropriately generate rearranged image data representing the rearranged image RI by dividing the combined image data at an appropriate position. As a result, the image processing server 50 can provide the user with an appropriate processed image PI using the rearranged image data.

(Correspondence)
The image processing server 50 is an example of an “image processing apparatus”. The scan image SI is an example of an “original image”. In the example of FIG. 11, the first three character strings “A to M” in the scan image SI are examples of “M character strings”. The combined image data representing the combined image CI1, the divided image data representing the divided image DI1, the divided image data representing the divided image DI2, and the rearranged image data representing the rearranged image RI are “target character string image data”, “ It is an example of “first partial character string image data”, “second partial character string image data”, and “specific character string image data”. The character strings “A to F” in the divided image DI1 are examples of “first partial character string” and “first specific character string”. The character strings “GM” in the divided image DI2 are examples of the “second partial character string” and the “second specific character string”. Therefore, in the present embodiment, the “first (or second) partial character string” matches the “first (or second) specific character string”. The horizontal direction, the left side, the right side, and the vertical direction are examples of the “first direction”, the “first side in the first direction”, the “second side in the first direction”, and the “second direction”, respectively. .

  W used in S453 in FIG. 10 is an example of “specific length”. In FIG. 7, the continuous range determined in S238, the threshold determined in S238, h / 4 used in S242, and h / 2 used in S244 are “specific range” and “first threshold, respectively. ”,“ Second threshold ”, and“ third threshold ”. For example, in case A of FIG. 8, the area corresponding to “I” and the intermediate margin area BA1 are examples of “first range” and “second range”, respectively. Further, for example, in case C, the area corresponding to the parenthesis C1, the middle blank area BA8, and the area corresponding to the hiragana C2 are “first range”, “second range”, and “third range”, respectively. It is an example.

  Specific examples of the present invention have been described in detail above, but these are merely examples and do not limit the scope of the claims. The technology described in the claims includes various modifications and changes of the specific examples illustrated above. The modifications of the above embodiment are listed below.

(Modification 1) In the above embodiment, as shown in FIG. 11, the first three lines of character strings “A to E”, “F to K”, and “LM” in the scanned image SI are combined ( After that, the character string “A to M” in one line is divided (see two divided images DI1 and DI2). Instead, the CPU 62 does not have to combine the first three character strings “A to E”, “F to K”, and “LM” in the scan image SI, and generates the rearranged image RI. When necessary, the following processing may be executed. That is, the CPU 62 divides the partial image data representing the character string “F to K” in the second row in the scan image SI, and the first divided image data representing the character string “F” and the character string “G”. Second divided image data representing “˜K”. Next, the CPU 62 combines the partial image data representing the character string “A to E” on the first line in the scan image SI and the first divided image data representing the character string “F” to obtain a character string. First combined image data representing “A to F” is generated. Next, the CPU 62 combines the second segmented image data representing the character string “G to K” and the partial image data representing the character string “LM” on the third line in the scan image SI to obtain a character string. Second combined image data representing “G to M” is generated. Then, the CPU 62 arranges the first combined image data and the second combined image data in the rearrangement area RA, and generates rearranged image data representing the rearranged image RI. In this modification, the character string “F to K” on the second line in the scanned image SI and the partial image data representing the character string “F to K” are respectively “target character string” and “target character string image”. It is an example of “data”. The divided character string “F”, the first divided image data, the divided character strings “G to K”, and the second divided image data are respectively “first partial character string”, “first It is an example of “partial character string image data”, “second partial character string”, and “second partial character string image data”. In addition, the character string “A to F” on the first line and the character string “G to M” on the second line in the rearranged image RI are respectively “first specific character string” and “second specific character”. It is an example of a column. That is, in the present modification, the “first (or second) partial character string” does not match the “first (or second) specific character string”.

(Modification 2) In the above embodiment, enlarged image data obtained by enlarging the rearranged image data is generated, and the enlarged image data is overwritten in a part of the area in the scan image data SID. Thereby, processed image data PID is generated (see FIG. 11). Instead, the CPU 62 may generate the processed image data PID by overwriting the rearranged image data as it is in a partial area in the scanned image data SID. That is, in the processed image PI, each character having the same size as the size of each character “A to Q” in the scanned image SI may be expressed. In this modification, the processed image data PID is an example of “specific character string image data”.

(Modification 3) In the above embodiment, the image processing server 50 performs image processing on the scanned image data SID (that is, each processing of S100 to S500 in FIG. 2) to generate processed image data PID. Then, the processed image data PID is transmitted to the multi-function device 10 (S600). Alternatively, the multi-function device 10 may perform image processing on the scanned image data SID to generate processed image data PID (that is, the image processing server 50 may not exist). In the present modification, the multi-function device 10 is an example of an “image processing apparatus”.

(Modification 4) The target of image processing executed by the image processing server 50 may not be the scanned image data SID, but may be data generated by document creation software, table editing software, drawing creation software, or the like. Good. That is, the “original image data” is not limited to data obtained by scanning the scan target sheet, and may be other types of data.

(Modification 5) In the above embodiment, the scanned image SI is a character string in which the sentence advances from the left side in the horizontal direction to the right side and the sentence advances in the vertical direction from the upper side to the lower side (that is, horizontally written characters). Column). Instead, the scanned image SI includes a character string (that is, a vertically written character string) in which the sentence advances from the upper side to the lower side in the vertical direction and the sentence advances from the right side in the horizontal direction to the left side. May be. In this case, the image processing server 50 cannot normally determine the band-like region based on the horizontal projection histogram in S162 and S164 of FIG. Therefore, the image processing server 50 generates a projection histogram in the vertical direction and determines the band-like region. Thereafter, the image processing server 50 may perform the same processing as in the above-described embodiment by using the vertical direction instead of the horizontal direction and using the horizontal direction instead of the vertical direction. In the present modification, the vertical direction and the horizontal direction are examples of “first direction” and “second direction”, respectively. The upper side and the lower side in the vertical direction are examples of the “first side in the first direction” and the “second side in the first direction”, respectively.

(Modification 6) In the above-described embodiment, the CPU 62 of the image processing server 50 executes the program 66 (that is, software), thereby realizing the processes shown in FIGS. Instead, at least one of the processes in FIGS. 2 to 11 may be realized by hardware such as a logic circuit.

  The technical elements described in this specification or the drawings exhibit technical usefulness alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing. In addition, the technology illustrated in the present specification or the drawings achieves a plurality of objects at the same time, and has technical utility by achieving one of the objects.

  2: Communication system, 4: Internet, 10: Multi-function device, 50: Image processing server, 52: Network interface, 60: Control unit, 62: CPU, 64: Memory, 66: Program, SI: Scanned image, PI: Processed image, TOB: Text object, POB: Photo object, TOA: Text object area (text area), POA: Photo object area, LA11 to LA14: Strip area, TA: Target area, RA: Relocation area, CI1, CI2: combined image, DI1, DI2: fragmented image, RI: rearranged image

Claims (8)

An image processing apparatus,
A target character string image data acquisition unit for acquiring target character string image data representing a target character string of one line composed of a plurality of characters arranged along the first direction;
The target character string image data is divided into first partial character string image data representing a first partial character string that is a part of the target character string, and a part of the target character string. A second partial character string image data representing a second partial character string, wherein at least one of the first partial character string and the second partial character string is , The dividing portion constituted by two or more characters that are part of the plurality of characters;
Using the first partial character string image data and the second partial character string image data, a first specific character string and a second specific string arranged along a second direction orthogonal to the first direction A specific character string image data generating unit that generates specific character string image data representing a character string, wherein the first specific character string includes the first partial character string, and the second specific character string is The specific character string image data generation unit including the second partial character string,
The plurality of pixels constituting the target character string image data include a character constituent pixel constituting a character included in the target character string, and a background pixel constituting a background of the character included in the target character string. Including
The dividing portion is
A histogram generation unit that generates a projection histogram using the target character string image data, wherein the projection histogram projects each pixel constituting the target character string image data along the second direction. A histogram showing a frequency distribution of the character constituting pixels in
A division position determination unit that determines a division position of the target character string image data based on the projection histogram and a specific length, wherein the specific length is represented by the specific character string image data. The division position determination unit, which is an upper limit length along the first direction of a power string of power lines,
The divided portion is divided the target character string image data in the dividing position, and generates a first partial character string image data and the second partial character string image data,
The segmentation position determination unit determines a plurality of candidate positions that are candidates for the segmentation position of the target character string image data using the projection histogram, and the first direction of the first specific character string is determined in the first direction. The dividing position is determined from among the plurality of candidate positions so that the length along the line becomes a maximum length not more than the specific length,
In the target character string, a sentence advances from the first side to the second side in the first direction,
The dividing position determining unit is
In the projection histogram, (A) the frequency of the character constituent pixels in the first range along the first direction is greater than a first threshold, and (B) the second range along the first direction. The frequency of the character constituent pixels in the second range that is located on the second side in the first direction with respect to the first range and is adjacent to the first range is the first threshold value. And (C) a third range along the first direction, located on the second side in the first direction with respect to the second range, and the second range. The length of the second range along the first direction in a specific case indicating that the frequency of the character constituent pixels in the third range adjacent to the second range is greater than the first threshold, Determined according to the number of pixels along the second direction of the target character string image data. Second determining whether it is below a threshold that is,
In the specific case, at least one of the length along the first direction of the first range and the length along the first direction of the third range is the target character string image data. Whether it is less than a third threshold value determined according to the number of pixels along the second direction of
When it is determined that the length of the second range along the first direction is greater than or equal to the second threshold, the predetermined position in the second range is determined as one candidate position. And
The length of the second range along the first direction is determined to be less than the second threshold, and the length of the first range along the first direction and the third range are determined. A predetermined position in the second range is determined as one candidate position when it is determined that both the length along the first direction of the range is greater than or equal to the third threshold,
The length of the second range along the first direction is determined to be less than the second threshold, and the length of the first range along the first direction and the third range are determined. If it is determined that at least one of the lengths of the range along the first direction is less than the third threshold value, the predetermined position in the second range is set as one candidate position. Image processing device not determined as . The image processing apparatus according to claim 1 , wherein the third threshold is larger than the second threshold. An image processing apparatus,
A target character string image data acquisition unit for acquiring target character string image data representing a target character string of one line composed of a plurality of characters arranged along the first direction;
The target character string image data is divided into first partial character string image data representing a first partial character string that is a part of the target character string, and a part of the target character string. A second partial character string image data representing a second partial character string, wherein at least one of the first partial character string and the second partial character string is , The dividing portion constituted by two or more characters that are part of the plurality of characters;
Using the first partial character string image data and the second partial character string image data, a first specific character string and a second specific string arranged along a second direction orthogonal to the first direction A specific character string image data generating unit that generates specific character string image data representing a character string, wherein the first specific character string includes the first partial character string, and the second specific character string is The specific character string image data generation unit including the second partial character string,
The plurality of pixels constituting the target character string image data include a character constituent pixel constituting a character included in the target character string, and a background pixel constituting a background of the character included in the target character string. Including
The dividing portion is
A histogram generation unit that generates a projection histogram using the target character string image data, wherein the projection histogram projects each pixel constituting the target character string image data along the second direction. A histogram showing a frequency distribution of the character constituting pixels in
A division position determination unit that determines a division position of the target character string image data based on the projection histogram and a specific length, wherein the specific length is represented by the specific character string image data. The division position determination unit, which is an upper limit length along the first direction of a power string of power lines,
The divided portion is divided the target character string image data in the dividing position, and generates a first partial character string image data and the second partial character string image data,
The segmentation position determination unit determines a plurality of candidate positions that are candidates for the segmentation position of the target character string image data using the projection histogram, and the first direction of the first specific character string is determined in the first direction. The dividing position is determined from among the plurality of candidate positions so that the length along the line becomes a maximum length not more than the specific length,
In the target character string, a sentence advances from the first side to the second side in the first direction,
The dividing position determining unit is
A specific range along the first direction from the projection histogram, indicating that the frequency of the character constituent pixels is higher than zero, and a length equal to or greater than a predetermined length along the first direction Selecting the specific range having
Of the frequency distribution of the character constituting pixels in the specific range, a minimum value of the frequency of the character constituting pixels is determined as a first threshold to be used in the specific range,
In the projection histogram, (A) the frequency of the character constituent pixels in the first range along the first direction is larger than the first threshold; and (B) the first direction along the first direction. And the frequency of the character constituent pixels in the second range that is located on the second side in the first direction relative to the first range and is adjacent to the first range is the second range. An image processing apparatus that determines a predetermined position along the first direction within the second range as one candidate position in a specific case indicating that the threshold value is 1 or less . An image processing apparatus,
A target character string image data acquisition unit for acquiring target character string image data representing a target character string of one line composed of a plurality of characters arranged along the first direction;
The target character string image data is divided into first partial character string image data representing a first partial character string that is a part of the target character string, and a part of the target character string. A second partial character string image data representing a second partial character string, wherein at least one of the first partial character string and the second partial character string is , The dividing portion constituted by two or more characters that are part of the plurality of characters;
Using the first partial character string image data and the second partial character string image data, a first specific character string and a second specific string arranged along a second direction orthogonal to the first direction A specific character string image data generating unit that generates specific character string image data representing a character string, wherein the first specific character string includes the first partial character string, and the second specific character string is look including the second substring, the specific character string image data is generated so as to be aligned in a state where the tip of the first tip and the second specific character string of a specific character string are aligned , The specific character string image data generation unit,
The plurality of pixels constituting the target character string image data include a character constituent pixel constituting a character included in the target character string, and a background pixel constituting a background of the character included in the target character string. Including
The dividing portion is
A histogram generation unit that generates a projection histogram using the target character string image data, wherein the projection histogram projects each pixel constituting the target character string image data along the second direction. A histogram showing a frequency distribution of the character constituting pixels in
A division position determination unit that determines a division position of the target character string image data based on the projection histogram and a specific length, wherein the specific length is represented by the specific character string image data. The division position determination unit, which is an upper limit length along the first direction of a power string of power lines,
The divided portion is divided the target character string image data in the dividing position, and generates a first partial character string image data and the second partial character string image data,
The segmentation position determination unit determines a plurality of candidate positions that are candidates for the segmentation position of the target character string image data using the projection histogram, and the first direction of the first specific character string is determined in the first direction. The dividing position is determined from among the plurality of candidate positions so that the length along the line becomes a maximum length not more than the specific length,
In the target character string, a sentence advances from the first side to the second side in the first direction,
The division position determination unit is configured such that the projection histogram has (A) a frequency of the character constituent pixels in a first range along the first direction is greater than a first threshold value, and (B) the first direction. Of the character constituent pixels in the second range that is located on the second side in the first direction with respect to the first range and that is adjacent to the first range. The frequency is equal to or less than the first threshold; and (C) a third range along the first direction, which is located on the second side in the first direction with respect to the second range. And in a specific case indicating that the frequency of the character constituent pixels in the third range adjacent to the second range is greater than the first threshold, the second in the second range. An image processing apparatus that determines a side edge as one candidate position . The image processing apparatus further includes:
An original image data acquisition unit that acquires original image data representing an original character string of M rows (where M is an integer of 2 or more), wherein each of the original character strings of the M rows is arranged along the first direction. The original image data acquisition unit, which is composed of a plurality of characters, and in which the original character strings of the M rows are arranged along the second direction,
The target character string image data acquisition unit combines the M original character string image data representing the M lines of original character strings obtained from the original image data to generate the target character string image data. Obtaining the target character string image data;
The image according to any one of claims 1 to 4 , wherein the target character string image data represents the target character string in which the original character strings of the M rows are linearly coupled along the first direction. Processing equipment. A computer program for an image processing apparatus,
In the computer mounted on the image processing apparatus, the following steps, that is,
A target character string image data acquisition step of acquiring target character string image data representing a target character string of one line composed of a plurality of characters arranged along the first direction;
The target character string image data is divided into first partial character string image data representing a first partial character string that is a part of the target character string, and a part of the target character string. A second partial character string image data representing a second partial character string, wherein at least one of the first partial character string and the second partial character string is , The dividing step constituted by two or more characters that are part of the plurality of characters;
Using the first partial character string image data and the second partial character string image data, a first specific character string and a second specific string arranged along a second direction orthogonal to the first direction A specific character string image data generating step for generating specific character string image data representing a character string, wherein the first specific character string includes the first partial character string, and the second specific character string is including the second substring, the a specific character string image data generation step, is executed,
The plurality of pixels constituting the target character string image data include a character constituent pixel constituting a character included in the target character string, and a background pixel constituting a background of the character included in the target character string. Including
The dividing step includes
A histogram generation step of generating a projection histogram using the target character string image data, wherein the projection histogram projects each pixel constituting the target character string image data along the second direction. The histogram generation step, which is a histogram showing a frequency distribution of the character constituting pixels in
A division position determining step for determining a division position of the target character string image data based on the projection histogram and a specific length, wherein the specific length is represented by the specific character string image data. The dividing position determining step, which is an upper limit length along the first direction of a plurality of lines of power strings,
Wherein in the cutting step, by dividing the target character string image data in the dividing position, and it generates a first partial character string image data and the second partial character string image data,
The segmentation position determination unit determines a plurality of candidate positions that are candidates for the segmentation position of the target character string image data using the projection histogram, and the first direction of the first specific character string is determined in the first direction. The dividing position is determined from among the plurality of candidate positions so that the length along the line becomes a maximum length not more than the specific length,
In the target character string, a sentence advances from the first side to the second side in the first direction,
In the dividing position determining step,
In the projection histogram, (A) the frequency of the character constituent pixels in the first range along the first direction is greater than a first threshold, and (B) the second range along the first direction. The frequency of the character constituent pixels in the second range that is located on the second side in the first direction with respect to the first range and is adjacent to the first range is the first threshold value. And (C) a third range along the first direction, located on the second side in the first direction with respect to the second range, and the second range. The length of the second range along the first direction in a specific case indicating that the frequency of the character constituent pixels in the third range adjacent to the second range is greater than the first threshold, Determined according to the number of pixels along the second direction of the target character string image data. Second determining whether it is below a threshold that is,
In the specific case, at least one of the length along the first direction of the first range and the length along the first direction of the third range is the target character string image data. Whether it is less than a third threshold value determined according to the number of pixels along the second direction of
When it is determined that the length of the second range along the first direction is greater than or equal to the second threshold, the predetermined position in the second range is determined as one candidate position. And
The length of the second range along the first direction is determined to be less than the second threshold, and the length of the first range along the first direction and the third range are determined. A predetermined position in the second range is determined as one candidate position when it is determined that both the length along the first direction of the range is greater than or equal to the third threshold,
The length of the second range along the first direction is determined to be less than the second threshold, and the length of the first range along the first direction and the third range are determined. If it is determined that at least one of the lengths of the range along the first direction is less than the third threshold value, the predetermined position in the second range is set as one candidate position. Not determined as a computer program. A computer program for an image processing apparatus,
In the computer mounted on the image processing apparatus, the following steps, that is,
A target character string image data acquisition step of acquiring target character string image data representing a target character string of one line composed of a plurality of characters arranged along the first direction;
The target character string image data is divided into first partial character string image data representing a first partial character string that is a part of the target character string, and a part of the target character string. A second partial character string image data representing a second partial character string, wherein at least one of the first partial character string and the second partial character string is , The dividing step constituted by two or more characters that are part of the plurality of characters;
Using the first partial character string image data and the second partial character string image data, a first specific character string and a second specific string arranged along a second direction orthogonal to the first direction A specific character string image data generating step for generating specific character string image data representing a character string, wherein the first specific character string includes the first partial character string, and the second specific character string is including the second substring, the a specific character string image data generation step, is executed,
The plurality of pixels constituting the target character string image data include a character constituent pixel constituting a character included in the target character string, and a background pixel constituting a background of the character included in the target character string. Including
The dividing step includes
A histogram generation step of generating a projection histogram using the target character string image data, wherein the projection histogram projects each pixel constituting the target character string image data along the second direction. The histogram generation step, which is a histogram showing a frequency distribution of the character constituting pixels in
A division position determining step for determining a division position of the target character string image data based on the projection histogram and a specific length, wherein the specific length is represented by the specific character string image data. The dividing position determining step, which is an upper limit length along the first direction of a plurality of lines of power strings,
Wherein in the cutting step, by dividing the target character string image data in the dividing position, and it generates a first partial character string image data and the second partial character string image data,
In the division position determination step, a plurality of candidate positions that are candidates for the division position of the target character string image data are determined using the projection histogram, and the first direction of the first specific character string is determined. The dividing position is determined from among the plurality of candidate positions so that the length along the line becomes a maximum length not more than the specific length,
In the target character string, a sentence advances from the first side to the second side in the first direction,
In the dividing position determining step,
A specific range along the first direction from the projection histogram, indicating that the frequency of the character constituent pixels is higher than zero, and a length equal to or greater than a predetermined length along the first direction Selecting the specific range having
Of the frequency distribution of the character constituting pixels in the specific range, a minimum value of the frequency of the character constituting pixels is determined as a first threshold to be used in the specific range,
In the projection histogram, (A) the frequency of the character constituent pixels in the first range along the first direction is larger than the first threshold; and (B) the first direction along the first direction. And the frequency of the character constituent pixels in the second range that is located on the second side in the first direction relative to the first range and is adjacent to the first range is the second range. A computer program for determining, as a candidate position, a predetermined position along the first direction within the second range in a specific case indicating that the threshold value is 1 or less . A computer program for an image processing apparatus,
In the computer mounted on the image processing apparatus, the following steps, that is,
A target character string image data acquisition step of acquiring target character string image data representing a target character string of one line composed of a plurality of characters arranged along the first direction;
The target character string image data is divided into first partial character string image data representing a first partial character string that is a part of the target character string, and a part of the target character string. A second partial character string image data representing a second partial character string, wherein at least one of the first partial character string and the second partial character string is , The dividing step constituted by two or more characters that are part of the plurality of characters;
Using the first partial character string image data and the second partial character string image data, a first specific character string and a second specific string arranged along a second direction orthogonal to the first direction A specific character string image data generating step for generating specific character string image data representing a character string, wherein the first specific character string includes the first partial character string, and the second specific character string is look including the second substring, the specific character string image data is generated so as to be aligned in a state where the tip of the first tip and the second specific character string of a specific character string are aligned , Executing the specific character string image data generation step,
The plurality of pixels constituting the target character string image data include a character constituent pixel constituting a character included in the target character string, and a background pixel constituting a background of the character included in the target character string. Including
The dividing step includes
A histogram generation step of generating a projection histogram using the target character string image data, wherein the projection histogram projects each pixel constituting the target character string image data along the second direction. The histogram generation step, which is a histogram showing a frequency distribution of the character constituting pixels in
A division position determining step for determining a division position of the target character string image data based on the projection histogram and a specific length, wherein the specific length is represented by the specific character string image data. The dividing position determining step, which is an upper limit length along the first direction of a plurality of lines of power strings,
Wherein in the cutting step, by dividing the target character string image data in the dividing position, and it generates a first partial character string image data and the second partial character string image data,
In the division position determination step, a plurality of candidate positions that are candidates for the division position of the target character string image data are determined using the projection histogram, and the first direction of the first specific character string is determined. The dividing position is determined from among the plurality of candidate positions so that the length along the line becomes a maximum length not more than the specific length,
In the target character string, a sentence advances from the first side to the second side in the first direction,
In the dividing position determination step, the projection histogram includes: (A) the frequency of the character constituent pixels in the first range along the first direction is greater than a first threshold; and (B) the first direction. Of the character constituent pixels in the second range that is located on the second side in the first direction with respect to the first range and that is adjacent to the first range. The frequency is equal to or less than the first threshold; and (C) a third range along the first direction, which is located on the second side in the first direction with respect to the second range. And in a specific case indicating that the frequency of the character constituent pixels in the third range adjacent to the second range is greater than the first threshold, the second in the second range. determining the end of the side as one candidate position, the computer Program.

Images