JP2020005061A - Image processing apparatus and program - Google Patents

Abstract

To prevent a situation in which by enlarging an image, part of the image is lost or the image is divided and becomes difficult to see, and make it possible to return the enlarged image to the original image by using a display medium on which the enlarged image is displayed.SOLUTION: An image processing apparatus comprises: a protrusion determination unit 22 that determines whether an enlarged image of an original image protrudes from a virtual display area; an image changing unit 23 that, when the enlarged image protrudes from the virtual display area, partially changes the original image so that the enlarged image falls within the virtual display area; an information image addition unit 24 that adds, to the original image, a restoration information image representing restoration information required for returning the original image changed by the image changing unit to a state before the change; and an image enlargement unit 25 that enlarges the original image partially changed and added with the restoration information image to create an enlarged image.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image processing apparatus and a program capable of performing enlargement and partial change of an image.

  2. Description of the Related Art An image forming apparatus such as a multifunction peripheral has a function of printing an image read by an image scanner, an image received from outside via a communication line, an image stored in an internal storage device, and the like on a sheet. Some image forming apparatuses having such a function have an enlarged printing function of enlarging an image and printing it on paper. An image forming apparatus having an enlarged printing function displays an image on a preview screen before printing the image on paper. The user looks at the preview screen and specifies the magnification of the image. The image forming apparatus enlarges an image to a designated enlargement ratio and prints the image on paper (for example, see Patent Document 1 or 2 below).

JP-A-2006-53810 JP 2012-123028 A

  In the image forming apparatus having the above-described enlarged printing function, when an image is enlarged and printed on a sheet, a part of the enlarged image may protrude from the sheet. According to the conventional image forming apparatus, a portion of the enlarged image that protrudes from the paper is not printed on the paper, or only the protruding part is printed on another paper.

  If a portion of the enlarged image that protrudes from the sheet is not printed on the sheet, a user who receives the printed sheet cannot see the protruding portion, which is inconvenient.

  Further, when only the portion of the enlarged image that protrudes from the sheet is printed on another sheet, the image is divided into a plurality of sheets, so that the user who receives the printed sheet becomes difficult to view the image, which is inconvenient. . For example, if an image containing several lines of text is enlarged and the right end of each line of the text protrudes from the paper, and only the right end of each line is printed on another paper, The text is divided and laid out on separate sheets, and the text becomes very difficult to read.

  In order to prevent such inconvenience, when performing an image enlargement process in the image forming apparatus, the enlarged image is printed such that a portion of the enlarged image that protrudes from one sheet is printed on the one sheet. It is conceivable to perform image processing for changing a part of. For example, it is conceivable to perform image processing for moving a portion of the enlarged image that protrudes from one sheet to a blank portion of the one sheet. However, if the enlarged image is simply printed on paper with a part of the enlarged image changed, the original image of the enlarged image printed on the paper, that is, the image before the enlargement and partial change is performed, is performed using the paper. And cannot be restored. Therefore, the user who receives the sheet on which the enlarged image is printed cannot know the original state of the image printed on the sheet, which is inconvenient.

  The present invention has been made in consideration of, for example, the above-described problems, and an object of the present invention is to prevent a part of an image from being lost or an image from being divided and becoming difficult to see by enlarging the image. It is an object of the present invention to provide an image processing apparatus and a program capable of returning an enlarged image to an original image using a display medium on which the enlarged image is displayed.

  In order to solve the above-mentioned problem, an image processing apparatus according to the present invention provides an enlarged image of the original image by enlarging the size of the original image relative to the size of a display area of a display medium of the original image. An image enlarging unit that generates a, an extended judging unit that determines whether the enlarged image protrudes from the display area, and a result of the judging unit that determines whether the enlarged image protrudes from the display area. An image changing unit that partially changes the original image or the enlarged image so that the enlarged image fits in the display area; and the original image or the enlarged image changed by the image changing unit is in a state before the change. An information image adding unit for adding a restoration information image representing restoration information required for returning to the enlarged image.

  In the image processing device of the present invention, the restoration information is information indicating a state before the change of the original image or the enlarged image changed by the image changing unit, and the original image or the enlarged image is changed by the image changing unit. May be included, or information indicating a method of returning the original image or the enlarged image changed by the image changing unit to a state before the change.

  In the image processing apparatus of the present invention, the information image adding unit may be configured to arrange the restored information image so as to overlap a portion of the enlarged image changed by the image changing unit.

  In the above-described image processing apparatus of the present invention, the image changing unit may be configured to move a character such that the length of one line of a character string in the original image or the enlarged image is shortened.

  In the image processing apparatus of the present invention, the image changing unit may move the character so that the number of lines of the character string in the original image or the enlarged image is reduced.

  In the image processing apparatus of the present invention, the image changing unit moves a character in the original image to a blank portion in the original image or moves a character in the enlarged image to a blank portion in the enlarged image. It is good also as composition which makes it do.

  In the image processing device of the present invention, the information image adding unit adds a configuration information image representing configuration information indicating a configuration of the original image or the enlarged image to the original image or the enlarged image, and Is information indicating an enlargement ratio of the enlarged image with respect to the original image, information indicating the number of lines of a character string in the original image or the enlarged image before the change is performed by the image changing unit, Information indicating the number of characters per line of the character string in the original image or the enlarged image before the change is performed, information indicating the direction of the character string in the original image or the enlarged image, or the original image or the It may be configured to include information indicating the start position of the entire character string in the enlarged image.

  In order to solve the above problem, a program according to the present invention generates an enlarged image of the original image by enlarging the size of the original image relative to the size of a display area of a display medium of the original image. An image enlargement unit that performs the operation, an overflow determination unit that determines whether the enlarged image extends out of the display area, and a result of the determination performed by the overflow determination unit that determines that the enlarged image extends outside the display area. An image changing unit for partially changing the original image or the enlarged image so that the original image or the enlarged image is included in the display area; and returning the original image or the enlarged image changed by the image changing unit to a state before the change. And an information image adding section for adding a restoration information image indicating restoration information required for the enlarged image to the enlarged image.

  According to the present invention, by enlarging an image, it is possible to prevent a part of the image from being lost or to prevent the image from being divided and becoming difficult to see, and to use a display medium on which the enlarged image is displayed. Thus, the enlarged image can be returned to the original image.

FIG. 1 is a block diagram illustrating a configuration of an image forming apparatus according to an embodiment of the present invention. 5 is a flowchart illustrating an image enlargement process performed by the image forming apparatus according to the embodiment of the present invention. FIG. 4 is an explanatory diagram showing an original image. FIG. 11 is an explanatory diagram illustrating a state where a configuration information image is added to an original image. FIG. 4 is an explanatory diagram showing a state where a virtual display area is set in an original image. FIG. 11 is an explanatory diagram illustrating a state in which characters protruding rightward from a virtual display area in an original image have been moved into the virtual display area; FIG. 9 is an explanatory diagram illustrating a state in which a line protruding downward from a virtual display area in an original image is moved into the virtual display area. It is explanatory drawing which shows an enlarged image.

(Image forming device)
FIG. 1 shows an image forming apparatus 1 having an image processing unit 18 which is an embodiment of the image processing apparatus of the present invention. In the present embodiment, the image forming apparatus 1 is a multifunction peripheral, and has a copy function, a facsimile function, a data storage function, a printing function, and the like. As shown in FIG. 1, the image forming apparatus 1 includes a document reading unit 11, a communication unit 12, a storage unit 13, a printing unit 14, an operation unit 15, a display unit 16, a control unit 17, and an image processing unit 18. ing.

  The document reading unit 11 is a device that reads a document, and includes, for example, an image scanner. The document reading unit 11 generates image data of an image obtained by copying a document. Specifically, the document reading unit 11 irradiates light on the surface of the document, converts the reflected light into an electric signal by an image sensor, and generates image data.

  The communication unit 12 includes a communication circuit for performing communication via a communication line and a computer network, for example. The communication unit 12 can receive image data transmitted from an external facsimile via a communication line. The communication unit 12 can transmit image data of a document read by the document reading unit 11 to an external facsimile via a communication line. The communication unit 12 can receive image data and the like transmitted from a terminal device such as an external personal computer via a computer network.

  The storage unit 13 includes, for example, a semiconductor memory and a hard disk drive, and stores data or a program. Specifically, the storage unit 13 is used as a storage medium for storing image data. Further, the storage unit 13 is used as a work area for temporarily storing an original image for a processing operation in an image enlargement process described later.

  The printing unit 14 is, for example, a printing mechanism that prints an image on paper by an electrophotographic method. The printing unit 14 includes a photosensitive drum, a charging device, an exposure device, a developing device, a transfer roller, a fixing device, a paper transport mechanism, and the like. The printing unit 14 may be a printing mechanism of another system such as an inkjet system.

  The operation unit 15 and the display unit 16 are devices that function as a user interface. The operation unit 15 includes buttons and the like that allow a user to operate the image forming apparatus 1. The operation unit 15 includes a button for setting an enlargement ratio of an image. The display unit 16 includes a display that allows a user to check the state and operation of the image forming apparatus 1. As will be described later, the display unit 16 displays a preview screen of the original image.

  The control unit 17 and the image processing unit 18 are configured by an arithmetic processing device or the like. The control unit 17 and the image processing unit 18 are realized by executing a program stored in the storage unit 13 by an arithmetic processing device. The control unit 17 controls reading of a document by the document reading unit 11, facsimile transmission and reception by the communication unit 12, printing of an image on paper by the printing unit 14, and the like. The image processing unit 18 corresponds to an embodiment of the image processing apparatus according to the present invention, and performs image enlargement processing, image restoration processing, and the like, which will be described later. The image processing unit 18 includes an image analyzing unit 21, an overflow judging unit 22, an image changing unit 23, an information image adding unit 24, an image enlarging unit 25, and an image restoring unit 26.

(Image enlargement processing)
The image processing unit 18 performs an image enlargement process. The image enlargement process is a process of generating an enlarged image of the original image by relatively enlarging the size of the original image with respect to the size of the display area of the display medium of the original image. In the image enlargement processing, the following processing is performed before the original image is actually enlarged.
(1) A process of analyzing the original image and recognizing the configuration of the original image and the position of each character arranged in the original image. (2) A configuration information image representing the configuration information indicating the configuration of the original image or the enlarged image. Processing to be added to the original image (3) It is determined whether the enlarged image protrudes from the display area, and when the enlarged image protrudes from the display area, the original image is partially changed so that the enlarged image fits in the display area. (4) Process of adding a restoration information image representing restoration information required to return the original image changed by the image changing unit to the state before the change to the original image After performing the above processing, expanding the original image By doing so, the image is partially changed so as to fit within the display area of the display medium, and an enlarged image to which the configuration information image and the restoration information image are added is generated. The user can print the enlarged image on paper.

  In the image enlargement process, the “original image” is, for example, an image of a document read by the document reading unit 11, an image stored in the storage unit 13 as image data, an image transmitted from an external facsimile, or the like. The “display medium” is, for example, paper. The “display area” is an area of the entire area on the front surface of the paper, excluding margins on the upper, lower, left, and right edges. For example, a portion from each edge of the sheet to a position about 5 mm away from the inside of the sheet can be set as a margin.

  In the image enlargement processing, the configuration of the original image includes, for example, the direction of the character string arranged in the original image, the start position of the entire character string in the original image, the maximum number of lines of the character string in the original image, This is the maximum number of characters per line of the character string in the original image. When the original image is a normal horizontally written document, the direction of the character string arranged in the original image is rightward, and the start position of the entire character string in the original image is the upper left corner. When the original image is a normal vertically written document, the direction of the character string arranged in the original image is downward, and the start position of the entire character string in the original image is the upper right end. The maximum number of lines of the character string in the original image and the maximum number of characters per line of the character string mean the maximum number of lines of the character string and the maximum number of characters per line of the character string that can be arranged in the display area of the sheet. . These can be calculated based on the intervals between the characters arranged in the original image. The “configuration information” includes, in addition to the information indicating the configuration of the original image, information indicating an enlargement ratio of the enlarged image with respect to the original image.

  In the image enlargement process, the process of partially changing the original image so that the enlarged image fits in the display area includes moving characters so that the length of one line of the character string in the original image becomes shorter. And a process of moving characters so as to reduce the number of lines of the character string in the original image.

  In the image enlargement process, the “restoration information” is, for example, information indicating a position of a moved character before movement.

  In the image enlargement processing, the “configuration information image” is an image obtained by encoding the configuration information into, for example, a two-dimensional code, and the “restoration information image” is obtained by encoding the recovery information into, for example, a two-dimensional code. It is an image. Further, although it is difficult for the human eyes to recognize the existence of each of the configuration information image and the restored information image, it is an image that can be read by the document reading unit and the contents can be reliably recognized by the image processing unit. For example, it is a copy-forgery-inhibited pattern, pattern, pattern, or mark of a color close to the color of the paper. Note that the configuration information image and the restoration information image may be formed using a steganography technique. As will be described later, the configuration information image and the restoration information image are each arranged on the background of the character string of the original image so as to overlap the character string. However, when a human looks at the enlarged image obtained by enlarging the original image, A human can clearly recognize a character string in the enlarged image, and the recognition of the character string by human eyes is not unclear or unclear by the constituent information image or the restored information image. On the other hand, when performing an image restoration process described later, the image processing unit 18 separates each of the configuration information image and the restored information image in the enlarged image read by the document reading unit 11 from a character string in the enlarged image. Can be clearly recognized.

  In the image enlargement process, each component of the image processing unit 18 performs the following process. That is, the image analysis unit 21 performs a process of recognizing the configuration of the original image and the position of each character arranged in the original image. The protruding determination unit 22 performs a process of determining whether the enlarged image protrudes from the display area. The image changing unit 23 performs a process of partially changing the original image so that the enlarged image fits within the display area when the enlarged image extends out of the display area as a result of the determination by the outside judging unit 22. The information image adding unit 24 performs a process of adding the configuration information image and the restored information image to the original image. The image enlargement unit 25 performs a process of generating an enlarged image of the original image by relatively enlarging the size of the original image with respect to the size of the display area of the display medium of the original image.

(Image restoration processing)
Further, the image processing unit 18 performs an image restoration process. The image restoration process is a process of returning the enlarged image to the original image based on the configuration information image and the restored information image added to the enlarged image. Specifically, the enlarged image is reduced to the original size, and the character string moved in the image enlargement processing is returned to the original position. The image restoration process is performed by the image restoration unit 26. The user can read the sheet on which the enlarged image is printed by the document reading unit 11, execute the image restoration process, return the enlarged image to the original image, and print the original image on the sheet.

(Specific example of image enlargement processing)
FIG. 2 shows the flow of processing of document reading, enlargement ratio setting, image enlargement, and printing. Steps S4 to S13 in FIG. 2 correspond to the image enlargement processing.

  In FIG. 2, for example, after a user places a document on a document placing unit (document glass) of the image forming apparatus 1, the user operates the operation unit 15 to issue an instruction to start copying of the document. To enter. In response, the document reading unit 11 reads the document and generates image data of an image obtained by copying the document (step S1). In this processing, an image obtained by copying this document corresponds to the original image. The image data of the original image is stored in the work area of the storage unit 13.

  Subsequently, the control unit 17 of the image forming apparatus 1 displays a preview screen of the original image on the display unit 16 (Step S2). The user can check the size of the original image by looking at the preview screen. After confirming the size of the original image, the user operates the operation unit 15 and inputs a desired enlargement factor for enlarging the original image to the image forming apparatus 1 (step S3).

  Subsequently, the image analysis unit 21 recognizes the configuration of the original image and the position of each character in the original image (Step S4). FIG. 3 shows an original image stored in the work area in this specific example. The configuration of the original image shown in FIG. 3 is as follows. That is, the original image is a normal horizontal writing document, and the direction of the character string arranged in the original image is rightward. The overall start position of the character string in the original image is the upper left corner. The maximum number of lines of the character string in the original image is 23 lines, and the maximum number of characters per line of the character string in the original image is 33 characters.

  Subsequently, the information image adding unit 24 generates configuration information by adding information indicating the magnification input by the user in step S3 to the information indicating the configuration of the original image, and generates the configuration information indicating the configuration information. An image is generated, and this configuration information image is added to the original image stored in the work area (step 5). The information image adding unit 24 arranges the configuration information image at the start position of the entire character string in the original image. Specifically, the information image adding unit 24 arranges the configuration information image on a part or all of the background of the character string arranged at the start position so as to overlap with part or all of the character string. FIG. 4 shows the state of the original image in this specific example at the time when the process of step S5 is completed. As shown in FIG. 4, the constituent image information 41 is arranged on a background of a part of “aaa” arranged at the upper left end of the original image so as to overlap with a part of “aaa”. Note that the term “character string” generally means a sequence of two or more characters. In the present embodiment, this meaning is extended to a case where only one character exists in a specific area. , One character is referred to as a “character string”.

  Subsequently, when the protruding determination unit 22 generates an enlarged image by enlarging the original image according to the enlargement ratio input by the user based on the start position (upper left end) of the entire character string in the original image, It is determined whether or not there is a character string protruding from the display area 31 to the right in the image (step S6). The protrusion judging unit 22 makes this judgment, for example, as follows. First, the virtual display area 32 is formed by reducing the display area 31 of the original image based on the start position of the entire character string in the original image at the ratio of the reciprocal of the magnification input by the user. Next, the character string in the original image is examined line by line from the top to the bottom of the original image, and it is determined whether or not there is a character string protruding from the virtual display area 32 to the right side. If there is a line, the line in which the protruding character string is located (hereinafter, this is referred to as “right-side protruding line”) is specified. FIG. 5 shows a state in which the virtual display area 32 is superimposed on the original image in this specific example immediately after the processing of step S5 is completed.

  When the right-extending line is specified (step S6: YES), the image changing unit 23 makes the following change to the original image stored in the work area. That is, a character string that extends to the right from the virtual display area 32 is extracted in the right-extending line, and the character string disposed below the right-extending line is shifted downward by one line in the original image. A blank line is generated immediately below the protruding line, and the extracted character string is moved to this blank line (step S7). At this time, the extracted character string is arranged such that the first character in the character string is located at the head of the blank line.

  Subsequently, the information image adding unit 24 generates restoration information, generates a restoration information image representing the restoration information, and adds the restoration information image to the original image stored in the work area (Step S8). The restoration information here is information indicating the position before the movement of the first character in the character string moved in step S7. The information image adding unit 24 arranges the restored information image on the original image stored in the work area on the background of the character string moved in step S7 so as to overlap the character string.

  If the original image includes a plurality of right-extending rows, the extra judging unit 22, the image changing unit 23, and the information image adding unit 24 repeat the processes of steps S6, S7, and S8 from the top to the bottom of the original image. .

  In addition, in the original image, there is a character string that protrudes below the virtual display area 32, and there is a character string that is located to the right of the protruding character string below the position corresponding to the right end of the virtual display area 32. In this case, the overflow judging unit 22, the image changing unit 23, and the information image adding unit 24 also specify a line having such a character string as a right-extending line, and perform the processing in steps S7 and S8 for that line. I do.

  In this specific example, as shown in FIG. 5, in the original image immediately after the processing of step S5 is completed, the character string “eeeeee” on the right side of the fifth line and “hhhhhhhh” on the right side of the eighth line are included. Protrudes from the virtual display area 32 to the right. “Qqq” on the right side of the seventeenth row is located on the right side of the position corresponding to the right end of the virtual display area 32. Therefore, in the original image, the fifth line, the eighth line, and the seventeenth line are right-extending lines.

  FIG. 6 shows the state of the original image in this specific example immediately after the processing of steps S7 and S8 has been performed on all right-extending rows in the original image shown in FIG. By performing the process in step S7 on all right-extending rows in the original image shown in FIG. 5, the character string "eeee" that extends to the right from the virtual display area 32 as shown in FIG. The character string “hhhhhhhh” that has been moved to the sixth line in the display area 32 and protruded to the right from the virtual display area 32 is moved to the tenth line in the virtual display area 32. Further, the character string “qqq” located on the right side of the position corresponding to the right end of the virtual display area 32 is moved to the left side of the position corresponding to the right end of the virtual display area 32.

  Also, in the original image shown in FIG. 6, a restoration information image 42 is arranged in the background of the character string "eeeee" on the sixth line. The restoration information represented by the restoration information image 42 indicates the position of the character string “eeeee” before the movement. As shown in FIG. 5, this character string "eeeeee" was arranged from the 24th character on the fifth line of the original image before the movement. Therefore, the restoration information represented by the restoration information image is “5, 24”. In FIG. 6, the restoration information represented by the restoration information image 43 arranged on the background of the character string “hhhhhhhh” on the tenth line indicates the position of the character string “hhhhhhhh” before the movement, and is represented by “8”. , 24 ". Also, in FIG. 6, the restoration information represented by the restoration information image 44 arranged on the background of the character string “qqq” on the 20th line indicates the position of the character string “qqq” before the movement, which is “17”. , 24 ".

  In the case where the right protruding line is not specified in the original image in step S6 in FIG. 2, or when the processes of steps S7 and S8 are completed for all the right protruding lines specified in the original image (step S6: NO) ), The process proceeds to step S9. Then, in step S9, the protruding determination unit 22 determines whether or not the original image stored in the work area includes a character string protruding below the virtual display area 32.

If there is a character string that protrudes below the virtual display area 32 (step S9: YES), the image changing unit 23 determines whether there is a part in the original image stored in the work area where lines can be packed. It is determined whether or not it is (step S10). Specifically, the image changing unit 23 checks the character string in the original image stored in the work area from the top to the bottom of the original image, and determines the following conditions (A) and (B). It is determined whether there are two consecutive upper and lower rows to be filled.
(A) In the original image stored in the work area, except for the line in which the character string moved in step S7 is arranged, a line having a space that can be arranged by adding a character string to the right part (hereinafter referred to as “ Is called “character addition possible line”.) (B) In the original image stored in the work area, the character string (including a space between characters) arranged on the line next to the character addition possible line The sum of the length and a predetermined set interval length is equal to or less than the length of the blank space of the character addable line. The set interval length is, for example, 5 characters.

  When there are two vertically continuous rows that satisfy the above conditions (A) and (B) (step S10: YES), the image changing unit 23 sets the following for the original image stored in the work area. Make such changes. That is, all the character strings arranged on the lower line (the line next to the character-addable line) of the two vertically continuous lines are changed to the upper line (the two vertically continuous lines). After moving to the blank space of the line in which characters can be added, the character string disposed below the lower line of the two vertically continuous lines is moved up by one line to pack the lines (step S11). ). To move all the strings placed on the line following the line where characters can be added to the blank space of the line where characters can be added, add the characters at the end of the string already placed on the line where characters can be added, and A space with a set interval length (a space of 5 characters) is inserted between the first character of the character string to be moved to the space of the possible line. By inserting a blank in this manner, it is possible to prevent the meaning of the text written in the original image from being obscure due to the movement of the character string in step S11.

  Subsequently, the information image adding unit 24 generates restoration information, generates a restoration information image representing the restoration information, and adds the restoration information image to the original image stored in the work area (step S12). The restoration information here is information indicating the position before the movement of the first character in the character string moved in step S11. The information image adding unit 24 arranges the restored information image in the original image stored in the work area on the background of the character string moved in step S11 so as to overlap the character string.

  The overflow judging unit 22, the image changing unit 23, and the information image adding unit 24 determine whether the original image stored in the work area has no character string that extends below the virtual display area 32, or has a space in which lines can be packed. Steps S9, S10 and S11 are repeated until there is no more.

  In the original image in this specific example shown in FIG. 6, a character string below the 16th line is a character string protruding below the virtual display area 32. In the original image, the first and second rows satisfy the above conditions (A) and (B). That is, the first line is a line in which a character can be added because it has a space 50 in which a character string can be added and arranged on the right side. The length of the space 50 on the first line is 19 characters. Further, the length of the character string arranged on the line following the first line, that is, the second line is three characters. The total length of the length of the character string arranged on the second line and the set interval length (5 characters) is 8 characters, and is equal to or less than the length of the blank space 50 of the first line. Similarly, in the original image shown in FIG. 6, the seventh and eighth rows, and the fourteenth and fifteenth rows also satisfy the above conditions (A) and (B).

  In the original image shown in FIG. 6, the sixth and seventh lines seem to satisfy the conditions (A) and (B) at a glance, but the sixth line contains the character string moved in step S7. Therefore, the above condition (A) is not satisfied. By preventing the character string from being moved in step S11 on the line in which the character string moved in step S7 is arranged, it is possible to prevent the meaning of the text written in the original image from becoming difficult to understand. can do.

  By performing the process of step S11 on the original image shown in FIG. 6, the character string "bbb" arranged on the second line in the original image shown in FIG. Go to In addition, a space of 5 characters is provided between the last character of the character string “aaaa” originally arranged on the first line of the original image and the first character of the character string “bbb” moved to the first line. 51 is inserted. Further, the character string “ccc” arranged on the third line in the original image shown in FIG. 6 also moves to the first line as shown in FIG. In the first line of the original image shown in FIG. 7, a space 52 of five characters is inserted between the last character of the character string “bbb” and the first character of the character string “ccc”. Further, the character strings arranged in the fourth to seventh rows in the original image shown in FIG. 6 move to the second to fifth rows as shown in FIG. Also, the character string “ggggg” arranged on the eighth line in the original image shown in FIG. 6 moves to the fifth line as shown in FIG. In the fifth line of the original image shown in FIG. 7, a space 53 of five characters is inserted between the last character of the character string “ffffff” and the first character of the character string “ggggg”. Also, the character strings arranged in the ninth to fourteenth lines in the original image shown in FIG. 6 move to the sixth to eleventh lines as shown in FIG. Further, the character string “mmmm” arranged on the 15th line in the original image shown in FIG. 6 moves to the 11th line as shown in FIG. In the eleventh line of the original image shown in FIG. 7, a space 54 is inserted between the last character of the character string "llll" and the first character of the character string "mmmmm". In addition, the character strings arranged in the 16th to 20th lines in the original image shown in FIG. 6 move to the 12th to 16th lines as shown in FIG. As a result of the movement of these character strings, the character strings protruding downward from the virtual display area 32 in the original image of FIG. 6 are now contained in the virtual display area 32 as shown in FIG.

  In the original image shown in FIG. 7, a restoration information image 45 is arranged in the background of the character string “bbb” on the first line. The restoration information represented by the restoration information image 45 indicates the position of the character string “bbb” before the movement. As shown in FIG. 5, this character string "bbb" was arranged from the first character of the second line of the original image before the movement. Therefore, the restoration information represented by the restoration information image is “2, 1”. Also, in FIG. 7, the restoration information represented by the restoration information image 46 arranged in the background of the character string “ccc” on the first line indicates the position of the character string “ccc” before the movement, which is “3”. , 1 ". Also, in FIG. 7, the restoration information represented by the restoration information image 47 arranged in the background of the character string “gggggg” on the fifth line indicates the position of the character string “gggggg” before the movement, which is “7 , 1 ". Also, in FIG. 7, the restoration information represented by the restoration information image 48 arranged on the background of the character string “mmmmm” on the 11th line indicates the position of the character string “mmmmm” before the movement, which is “13”. , 1 ".

  In step S9 in FIG. 2, if there is no character string extending below the virtual display area 32 in the original image stored in the work area, or if there is no blank space for filling the line, or store in the work area. The processing of steps S9 to S12 is performed on the original image thus obtained. If the original image has no character string extending below the virtual display area 32 or has no blank space for filling the line, ( (Step S9: NO), the process proceeds to step S13. Then, in step S13, the image enlargement unit 25 enlarges the original image currently stored in the work area in accordance with the enlargement ratio input by the user based on the overall start position of the character string in the original image. Thereby, an enlarged image is generated (step S13). FIG. 8 shows an enlarged image in this specific example. The control unit 17 of the image forming apparatus 1 causes the printing unit 14 to print the enlarged image on a sheet (Step S14 in FIG. 2).

  In the image enlargement process, the character string in the original image stored in the work area may not fit in the virtual display area 32 immediately before step S13. In that case, in the original image, the first page is formed by the lines that fall within the virtual display area 32, and the second page is formed by the lines that extend below the virtual display area 32. In this case, an enlarged image is generated for each page, and these enlarged images are printed on, for example, two sheets of paper.

(Specific example of image restoration processing)
An example of the image restoration processing by the image restoration unit 26 will be described. First, an enlarged image printed on a sheet is read by the document reading unit 11 and stored in a work area of the storage unit 13. Subsequently, the configuration information image is read from the enlarged image stored in the work area, and the configuration information image is decoded to obtain the configuration information. Subsequently, based on the acquired configuration information, the enlargement ratio of the enlarged image to the original image is recognized, the reciprocal of the enlargement ratio is set as the reduction ratio, the enlarged image is reduced at this reduction ratio, and the size of the enlarged image is reduced. Make it equal to the size of the original image. Hereinafter, the image reduced in this manner is referred to as an “intermediate image”.

  Subsequently, based on the acquired configuration information, the start position of the entire character string in the intermediate image and the direction of the character string in the intermediate image are recognized. Here, it is assumed that the start position of the entire character string in the intermediate image is the upper left corner, and that the direction of the character string in the intermediate image is rightward. In this case, the position of each character and each restored information image is recognized line by line from top to bottom of the intermediate image.

  When the character string overlapping the restoration information image is recognized, the restoration information image is read, the restoration information image is decoded to obtain the decoding information, and the character string overlapping the restoration information image is obtained based on the obtained decoding information. Recognize the position before the movement.

  If the position before the movement of the character string is below the current position, the character string and the restoration information image arranged below the character string are shifted downward by one line to form a blank line. The character string is returned to the position before the movement (the head of the formed blank line).

  Further, when two character strings overlapping with the restoration information image are recognized in one line of the intermediate image, based on the decoded information obtained by decoding the restoration information image corresponding to each of the character strings, Recognize the position of the character string before the movement. Then, the character strings arranged below these character strings and the restoration information image are shifted downward by two lines to form two blank lines, and the two character strings are moved to the position before the movement (the two blank lines formed). (Beginning of line).

  Further, a character string overlapping with the restoration information image is recognized, and a position before movement of the character string overlapping with the restoration information image is recognized based on decoding information obtained from the restoration information image. If the position before the movement is above the current position, move the character string to the end of the character string on the line before the character string, and place the character string positioned below the character string Also, the restoration information image is shifted upward by one line.

  As described above, when the enlarged image protrudes from the display area, the image processing unit 18 in the image forming apparatus 1 partially changes the original image so that the enlarged image falls within the display area. Thereby, by enlarging the image, it is possible to prevent a part of the image from being lost or the image from being divided and becoming difficult to see. In the image enlarging process of the image processing unit 18, the enlarged image may be divided into two sheets. Even in such a case, each line of the horizontally written document is not divided right and left in the middle thereof. Since the horizontally written sentence is vertically divided at the boundary between the lines, the sentence written in the image is not difficult to read.

  After adding the restoration information image to the original image, the image processing unit 18 in the image forming apparatus 1 enlarges the original image to generate an enlarged image, and prints the enlarged image on a sheet. Therefore, the enlarged image and the restored information image are printed on the sheet. Therefore, the user can return the enlarged image to the original image by causing the image forming apparatus 1 to read the sheet on which the enlarged image and the restoration information image are printed and execute the image restoration processing.

  The restoration information is information indicating the position of the character string moved by the image changing unit 23 before the movement. Thus, in the image restoration processing, the enlarged image can be easily and accurately returned to the original image based on the restoration information.

  Further, the image processing unit 18 in the image forming apparatus 1 generates an enlarged image by adding the configuration information image in addition to the restored information image, generates an enlarged image by enlarging the original image, and prints the enlarged image on paper. Therefore, the configuration information image is printed on the sheet in addition to the enlarged image and the restored information image. Therefore, in the image restoration process, the configuration of the original image of the enlarged image can be recognized based on the configuration information, and the enlarged image can be easily and accurately returned to the original image.

  Further, the image processing unit 18 in the image forming apparatus 1 arranges the restored information image so as to overlap the character string moved in the original image. Thus, in the image restoration process, the moved character string can be easily recognized based on the position of the restoration information image in the enlarged image or the original image.

  Further, the image processing unit 18 in the image forming apparatus 1 moves the characters in the image enlarging process so that the length of the character string in the original image is shortened. Specifically, a portion of the original image that protrudes rightward from the virtual display area 32 in the right protruding row is moved into the virtual display area 32. Thus, it is possible to prevent the character string in the enlarged image from protruding from the display area to the right.

  Further, the image processing unit 18 in the image forming apparatus 1 moves the characters in the image enlarging process so that the number of lines of the character string of the original image is reduced. Specifically, in the virtual display area, the character string in the original image is moved to a blank portion in the original image to narrow the lines. Thus, the number of lines of the character string in the enlarged image can be reduced, and the frequency at which the enlarged image is divided into a plurality of sheets and printed can be reduced.

  The image processing unit 18 of the image forming apparatus 1 uses the original image of the vertically written document, that is, the original image in which the start position of the entire character string is the upper right end of the original image and the direction of the character string is downward. When the image enlargement process is performed on the image, the following process is generally performed. That is, after arranging the configuration information image so as to overlap with the character string arranged at the upper right end of the original image, the character string protruding below the virtual display area in the character string in the original image is placed on the next line (left side). Line), and the restoration information image is arranged so as to overlap the moved character string. Thereafter, the character string in the original image is moved to a blank portion in the original image, the character string in the original image is packed from right to left, and the restored information image is arranged so as to overlap the moved character string.

  Further, in the above embodiment, the restoration information is information indicating the state before the change of the original image (specifically, information indicating the position before the movement of the character string), but the present invention is not limited to this. The restoration information may be information indicating the changed content of the original image. As the information indicating the changed content of the original image, for example, a code indicating that the character string has been moved to the head one line below, a code indicating that the character string has been moved to the blank part on one line, and the like are considered. Can be Alternatively, the restoration information may be information indicating a method of returning the original image to the state before the change. As information indicating the method of returning the original image to the state before the change, a code indicating that the character string is returned to the end of the character string on one line, a code indicating that the character string is returned to the head of one line below, and the like are included. Conceivable.

  Further, a part of the configuration information described in the above embodiment may be omitted, or another information may be added to the configuration information described in the above embodiment. Further, in the above-described embodiment, the case where the configuration information image is arranged so as to overlap the character string arranged at the start position of the entire character string of the original image has been described as an example. Etc. may be arranged at other positions.

  Further, in the above embodiment, the case where the restored information image is arranged so as to overlap with the moved character string has been described as an example, but for example, the restored information image is moved, for example, immediately below the moved character string. It may be arranged at another position having a certain positional relationship with the character string.

  Further, in the above embodiment, the case where the character string in the original image is moved before enlarging the original image has been described as an example. However, the present invention is not limited to this. The character string inside may be moved.

  In the above embodiment, the character strings in the original image are uniformly enlarged. However, some character strings in the original image are not enlarged, or the enlargement ratio of some character strings in the original image is changed. By making the character string smaller than the enlargement ratio of the character string, the character string that protrudes from the display area in the enlarged image may be included in the display area.

  Further, in the above embodiment, the case where the original image is enlarged without changing the size of the display area has been described as an example, but the present invention is not limited to this. The present invention can be applied to a case where the display area is reduced without changing the size of the original image.

  Further, the present invention is not limited to a multifunction peripheral, and can be applied to a copier, a facsimile, and the like.

  In addition, the present invention can be appropriately modified within a scope that does not contradict the gist or idea of the invention that can be read from the claims and the entire specification, and an image processing apparatus and a program with such a modification are also included in the present invention. Included in technical thought.

REFERENCE SIGNS LIST 1 image forming apparatus 18 image processing unit 21 image analysis unit 22 overflow judging unit 23 image changing unit 24 information image adding unit 25 image enlargement unit 26 image restoration unit 31 display area 32 virtual display area 41 constituent image information 42 to 48 restored image information

Claims (8)

An image enlarging unit that generates an enlarged image of the original image by enlarging the size of the original image relative to the size of the display area of the display medium of the original image,
A protruding determination unit that determines whether the enlarged image protrudes from the display area,
As a result of the determination of the protruding determination unit, when the enlarged image protrudes from the display area, an image changing unit that partially changes the original image or the enlarged image so that the enlarged image falls within the display area. ,
An information image adding unit that adds a restoration information image representing restoration information required to return the original image or the enlarged image changed by the image changing unit to a state before the change to the original image or the enlarged image. An image processing apparatus characterized in that:   The restoration information is information indicating a state before the change of the original image or the enlarged image changed by the image changing unit, information indicating a change content of the original image or the enlarged image by the image changing unit, or The image processing apparatus according to claim 1, further comprising information indicating a method of returning the original image or the enlarged image changed by the image changing unit to a state before the change.   The information image adding unit arranges the restored information image such that the restored information image overlaps a portion changed by the image changing unit in the original image, or overlaps a portion changed by the image changing unit in the enlarged image. The image processing apparatus according to claim 1, wherein:   4. The image processing apparatus according to claim 1, wherein the image changing unit moves the character so that the length of one line of the character string in the original image or the enlarged image is shortened. 5. apparatus.   The image processing apparatus according to claim 1, wherein the image changing unit moves the character such that the number of lines of the character string in the original image or the enlarged image is reduced.   2. The image changing unit according to claim 1, wherein the character in the original image is moved to a blank portion in the original image, or the character in the enlarged image is moved to a blank portion in the enlarged image. 6. The image processing apparatus according to any one of claims 1 to 5. The information image adding unit adds a configuration information image representing configuration information indicating a configuration of the original image or the enlarged image to the original image or the enlarged image,
The configuration information image is information indicating an enlargement ratio of the enlarged image with respect to the original image, information indicating the number of lines of a character string in the original image or the enlarged image before the image is changed by the image changing unit, Information indicating the number of characters per line of the character string in the original image or the enlarged image before the change by the image changing unit, information indicating the direction of the character string in the original image or the enlarged image, or 7. The image processing apparatus according to claim 1, further comprising information indicating a start position of the entire character string in the original image or the enlarged image. An image enlarging unit that generates an enlarged image of the original image by enlarging the size of the original image relative to the size of the display area of the display medium of the original image,
A protruding determination unit that determines whether the enlarged image protrudes from the display area,
As a result of the determination by the protruding determination unit, when the enlarged image protrudes from the display area, an image change unit that partially changes the original image or the enlarged image so that the enlarged image falls within the display area. ,
An information image adding unit that adds a restoration information image indicating restoration information required to return the original image or the enlarged image changed by the image changing unit to a state before the change to the enlarged image. A program that causes a computer to function as an image processing device.

Images