JP6051652B2 - Image processing apparatus, image processing program, and image processing method - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing program, and an image processing method.

  In Patent Document 1, in a table output device that prints a table based on table data on a sheet, if the table is larger than the print area of the sheet and protrudes from the print area, if there is room for printing on the sheet, A technique is disclosed that automatically wraps when printing progresses to a place where it occurs, continuously prints the contents after the protrusion, and prints the contents after the protrusion on another sheet if there is no room for the above. According to the front output device of Patent Document 1, it is possible to suppress paper waste by performing return printing according to the situation.

JP-A-9-69089

  However, in the table output device of Patent Document 1, the paper orientation when printing a table is determined according to the printing conditions set by the user. For this reason, if the paper orientation is changed, the table may be folded and printed even though the paper to be printed can be printed on one sheet without being folded. For example, if the paper orientation is changed, even if there is room (margin) that can be printed without the table protruding from the printing area, it is determined that the table will protrude from the printing area with respect to the paper orientation according to the printing conditions. In some cases, return printing is performed. In such a case, unnecessary folding is performed, which is not preferable as a printing layout.

  If the paper orientation is changed, the table to be printed can be printed on one sheet, but the table may be divided and printed on different sheets. For example, if the paper orientation is changed, even if there is enough margin for wrapping printing, if it is determined that there is no room in the paper orientation according to the printing conditions, the content after the overhang is printed on another paper. End up. In such a case, the table is divided and printed on different sheets, which is not preferable as a printing layout. In such a case, the paper is wasted.

  As described above, when a table based on the table data is printed by the table output device of Patent Document 1, the table is not always printed with a suitable layout having good visibility, so that user convenience is poor. Also, depending on printing conditions, paper can be wasted. Note that such a problem is not limited to printing a table based on the table data. For example, when printing image data based on a long image received by facsimile, the image to be printed does not fit in the print area of the paper. A similar problem can occur if not.

  The present invention has been made in view of the above-described circumstances, and an image processing apparatus, an image processing program, and an image processing capable of printing an image to be printed with a suitable layout without wastefully using paper. It aims to provide a method.

In order to achieve this object, an image processing apparatus according to the present invention includes an image acquisition unit that acquires image data, a paper orientation, and a specific region of an image based on the image data acquired by the image acquisition unit in the longitudinal direction. Aspect ratio acquisition means for acquiring an aspect ratio of a print area in each layout for each of a plurality of types of layouts according to the arrangement of the divided image divided into a plurality of parts by folding back at a predetermined position, and the aspect ratio Of the aspect ratios acquired by the acquisition means, the layout selection means for selecting one layout corresponding to the aspect ratio closest to the aspect ratio of the specific area, and the image according to the layout selected by the layout selection means From the image based on the image data acquired by the acquisition means, the divided image Division means for generating image data, image generation means for generating, as layout image data, image data in which the divided images generated by the division means are arranged in accordance with the layout selected by the layout selection means, and the image generation A plurality of print control means for transmitting layout image data generated by the means or print data based on the layout image data to a printing unit, and image data acquired by the image acquisition means arranged in a matrix In the case of image data generated based on tabular data composed of square cells, non-important composed of blank cells located on the edge side of the image from the image based on the image data Extracting means for extracting an important area excluding the area as the specific area .

  The present invention can be configured in various modes such as a control device that controls an image processing device, an image processing system, an image processing method, and a recording medium that records an image processing program.

According to the image processing apparatus of the first aspect, a layout having a print area having a shape closest to the specific area of the image based on the image data acquired by the image acquisition means is selected from a plurality of types of layouts. Then, according to a layout having a print area having a shape closest to the specific area, generation of a divided image from the image based on the image data acquired by the image acquisition unit, and image data (layout image data) in which the divided image is arranged Therefore, when an image based on the image data acquired by the image acquisition means is printed in the print area of the selected layout, the margin can be made as small as possible, and the print result in which page breaks are wasted It can prevent being output. Therefore, when printing a table or a long image that does not fit on a single sheet as it is, printing can be performed with a suitable layout with good visibility without wasteful use of the sheet. In addition, the “specific area” in claim 1 may be an entire area of the image based on the image data acquired by the image acquisition means or a partial area. In addition, when the image data acquired by the image acquisition unit is image data generated based on tabular data composed of a plurality of cells arranged in a matrix, the image data is acquired from the image based on the image data. The important area excluding the non-important area composed of the blank cells located on the end side of the image is extracted as the specific area by the extraction unit. As a result, a layout having a print area having a shape closest to the important area is selected from the plurality of types of layouts. Therefore, the important area can be arranged as large as possible for printing, so that visibility can be improved.

  According to the image processing apparatus of claim 2, in addition to the effect of claim 1, the following effect is obtained. The aspect ratio acquired by the aspect ratio acquisition means is one or more layouts that are equally divided into a plurality of dividing lines along the longitudinal direction of the sheet for each of the vertical and horizontal directions of one or more types of paper, and The aspect ratio of the print area in each of one or more layouts equally divided into a plurality of lines along the transverse direction of the paper. Therefore, it is possible to select a layout that can print an image to be printed with optimum visibility regardless of the paper orientation set by the user.

  According to the image processing apparatus of claim 3, in addition to the effect of claim 2, the following effect is obtained. The print area of each layout is a rectangular area formed by arranging the divided areas of the paper divided by the dividing lines so that the sides perpendicular to the dividing lines are in contact with each other, so the aspect ratio of the printed area in each layout And the aspect ratio of the specific area of the image based on the image data acquired by the image acquisition means can be easily compared.

  According to the image processing apparatus of the fourth aspect, in addition to the effect produced by any one of the first to third aspects, the following effect is obtained. The aspect ratio of the print area corresponding to each layout is acquired by calculating based on the lengths of the long side and the short side of the paper indicated by the paper size information acquired by the paper size acquisition unit. Therefore, an optimal layout for printing can be selected for various sizes of paper.

According to the image processing apparatus of the fifth aspect , in addition to the effect produced by any one of the first to fourth aspects , the following effect is produced. Of the cells in the non-blank state included in the image based on the image data acquired by the image acquisition means, the cell is formed from a cell at a predetermined position and a cell positioned farthest from the cell at the predetermined position. A rectangular area is extracted as an important area. Therefore, even if there is a blank cell sandwiched between non-blank cells, the blank cell is treated as an important area, and the non-blank cell is divided by the blank cell. Can be prevented from being determined as separate important areas.

According to the image processing apparatus of the sixth aspect , in addition to the effect produced by any one of the first to fifth aspects , the following effect is produced. If there is a blank area other than the area where the divided image is arranged in the print area in the selected layout, layout image data in which at least a part of the non-important area is arranged in the blank area is generated. Therefore, it is possible to use a non-important area (blank cell) in which at least a part is arranged in the blank area in the printing result while arranging the important area as large as possible.

According to the image processing device of the seventh aspect , in addition to the effect produced by any one of the first to sixth aspects, the following effect is produced. Since the specific area in the image based on the image data acquired by the image acquisition means is enlarged or reduced to the maximum size that can fit in the print area in the selected layout, the print result with excellent visibility of the contents of the specific area Can be obtained.

According to the image processing apparatus of claim 8 , in addition to the effect of claim 7 , the following effect is obtained. The ratio of the longitudinal length in the print area of the selected layout to the length in the longitudinal direction of the specific area, and the short direction in the print area of the selected layout to the length in the short direction of the specific area. The specific area is enlarged or reduced by using a small ratio among the length ratios as an enlargement ratio. Therefore, the specific area can be enlarged or reduced so as to have the maximum size that can be accommodated in the print area in the selected layout, and a print result with excellent visibility of the contents of the specific area can be obtained.

According to the image processing program of the ninth aspect, the same effect as that of the image processing apparatus according to the first aspect is obtained. According to the image processing method of claim 1 0 wherein the same advantages as the image processing apparatus according to claim 1.

It is a block diagram which shows the structure of the portable terminal carrying a printing control application. It is a schematic diagram which shows an example of the content of a layout candidate table. It is a schematic diagram which shows an example of the layout in the case of performing return printing. It is a figure which illustrates typically the outline of 1st Embodiment in this invention. It is a flowchart which shows a return printing process. It is a flowchart which shows the optimal layout selection process. It is a figure which illustrates the outline of 2nd Embodiment in this invention typically. It is a flowchart which shows the return printing process of 2nd Embodiment.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. First, a first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a block diagram showing a configuration of a mobile terminal 10 equipped with a print control application (hereinafter referred to as “print control application”) 14b which is an image processing program of the present invention. The print control application 14b according to the present embodiment is configured as a program that prints an image to be printed in a suitable layout without wasteful use of printing paper and with good visibility.

  The mobile terminal 10 is a mobile terminal such as a smartphone or a mobile phone. The mobile terminal 10 includes a CPU 11, a ROM 12, a RAM 13, a flash memory 14, a wireless LAN transmission / reception unit 15, operation keys 16, a touch panel 17, an LCD 18, a memory card interface (memory card I / F) 19, a voice input / output unit 21, a telephone. A network communication unit 22 is provided. These units are connected to each other via a bus line 23.

  The CPU 11 controls each unit connected to the bus line 23 according to a fixed value, a program, or the like stored in the ROM 12 or the like. The ROM 12 is a non-rewritable nonvolatile memory. The RAM 13 is a rewritable volatile memory. The RAM 13 stores a layout candidate table 13a. The layout candidate table 13a is a table in which the size of the print area of each layout is stored for each of a plurality of layouts that can be used when printing an image to be printed on a print sheet. It is generated every time the printing process (see FIG. 5) is executed. Details of the layout candidate table 13a will be described later with reference to FIG.

  The flash memory 14 is a rewritable nonvolatile memory. The flash memory 14 stores an operating system 14a (hereinafter referred to as OS 14a), a print control application 14b, and a print setting 14c. Hereinafter, the CPU 11 that executes a program such as an application or an operating system may be simply described by a program name. For example, the description “application” may mean “CPU 11 that executes the application”. The OS 14a is basic software for realizing the standard functions of the mobile terminal 10, and is an Android (registered trademark) OS in this embodiment.

  The print control application 14b is an application provided by a vendor of a device such as a printer or a multifunction device having a printing function, and is installed in the mobile terminal 10 by the user, and enables the use of the device from the mobile terminal 10. For example, printing by the printer 30 can be performed directly from the mobile terminal 10 without going through a personal computer or the like. When printing a table based on tabular data, that is, a table in which a plurality of grids are arranged in a matrix, the print control application 14b according to the present embodiment appropriately wraps the table to print paper. It enables printing with a layout with good visibility without wasteful use. Each process shown in the flowcharts of FIGS. 5 and 6 to be described later is executed by the print control application 14b. The print settings 14c are various settings at the time of printing, and include settings such as the size of printing paper (recording paper) used for printing, such as A4 and letter, the margin size at the time of printing, and borderless printing. . The print setting 14c can be changed based on a predetermined operation by the user.

  The operation key 16 is a mechanical key for inputting an instruction or the like to the mobile terminal 10, and is provided on the housing of the mobile terminal 10, for example. The touch panel 17 is provided over the LCD 18 and inputs setting information and instructions to the mobile terminal 10. The LCD 18 displays various screens. The memory card I / F 19 is an interface to which a rewritable nonvolatile memory card 20 is attached, and controls writing or reading of data with respect to the memory card 20. The voice input / output unit 21 is a voice input / output device including a microphone, a speaker, and the like. The telephone network communication unit 22 is a circuit for performing a call via a mobile phone network (not shown).

  The wireless LAN transmission / reception unit 15 is configured to be able to communicate between the mobile terminal 10 and the printer 30 via an access point (AP) 50 serving as a relay device by a wireless LAN compliant with the IEEE 802.11b / g standard. Registered trademark). In addition, the wireless LAN transmission / reception unit 15 connects the mobile terminal 10 and the server 100 on the Internet 800 through the AP 50 so as to communicate with each other.

  The AP 50 is a relay device that relays communication between Wi-Fi (registered trademark) terminals. The AP 50 has a broadband router function and can be connected to the Internet 800. The printer 30 is a printing device that performs printing on printing paper based on print data received from the mobile terminal 10 or the like.

  The server 100 provides a service for converting tabular data uploaded from the mobile terminal 10 into image data of a predetermined format and returning it to the mobile terminal 10. The server 100 may be configured from a single server, or may be configured as a system including a plurality of servers provided according to functions. Examples of tabular data to be converted in the server 100 include data created by Excel (registered trademark) which is spreadsheet software (hereinafter referred to as “Excel data”). Examples of the image data obtained by conversion in the server 100 include image data in various formats such as JPEG, PNG, GIF, and BMP. In the present embodiment, it is assumed that the server 100 converts tabular data into JPEG image data.

  FIG. 2 is a schematic diagram showing an example of the contents of the layout candidate table 13a. The layout candidate table 13a stores the horizontal length X (mm) and the vertical length Y (mm) of the print area in the layout indicated by the candidate number i for the layout candidate number i. The layout specified by the candidate number i is defined according to the orientation of the printing paper at the time of printing, the number of dividing lines that divide the printing paper, and the orientation of the dividing lines. In the present embodiment, as shown in FIG. 2, depending on the combination when the orientation of the printing paper is vertical or horizontal, the number of dividing lines is 0 or 1, and the direction of the dividing lines is vertical or horizontal. Six different layouts can be used. A different candidate number i is associated with each of these six types of layouts. In the example shown in FIG. 2, one of candidate numbers i from 1 to 6 is associated with each of the six types of layouts. In the present embodiment, the layout candidate table 13a is generated every time the return printing process (see FIG. 5) is executed. Specifically, the horizontal length X and the vertical length Y of the print area in each layout are calculated based on the size of the print paper stored as the print setting 14c, and are associated with the candidate number i for each layout. Stored. Note that the values of X and Y stored in the layout candidate table 13a shown in FIG. 2 are values calculated to perform borderless printing with the printing paper size set to A4 size.

  FIG. 3 is a schematic diagram illustrating an example of a layout when performing return printing. FIG. 3 illustrates a layout according to the contents of the layout candidate table 13a shown in FIG. That is, each layout at the time of borderless printing is illustrated. As described above, the layout candidate table 13a has a candidate number i for specifying each of the six types of layouts defined according to the combination of the orientation of the printing paper, the number of dividing lines, and the direction of the dividing lines. The size of the print area of each layout, more specifically, the horizontal length X and the vertical length Y of the print area are stored.

  FIG. 3A is a schematic diagram showing a layout for each candidate number i. The layout of candidate number 1 (i = 1) is a layout in which the orientation of the printing paper P is vertical and the dividing line is 0, that is, a layout in which an image is printed without being folded on the printing paper P in the vertical orientation. It is. The layout of candidate number 2 (i = 2) is a layout in which the orientation of the print sheet P is landscape and the dividing line is 0, that is, a layout in which an image is printed without being folded on the landscape print sheet P. .

  The layout of candidate number 3 (i = 3) is a layout in which the vertically oriented printing paper P is divided into two regions Q1 and Q2 by one longitudinally dividing line L. The layout of candidate number 4 (i = 4) is a layout in which a horizontally oriented print paper P is divided into two regions Q1 and Q2 by one vertically oriented dividing line L. The layout of candidate number 5 (i = 5) is a layout in which a vertical print paper P is divided into two regions Q1 and Q2 by one horizontal division line L. The layout of candidate number 6 (i = 6) is a layout in which a landscape print sheet P is divided into two regions Q1 and Q2 by one landscape dividing line L.

  FIG. 3B is a schematic diagram showing the print area i in the layout of the candidate number i. As described above, the layout with the candidate number 1 is a layout in which an image is printed on the vertically oriented printing paper P without being folded. Therefore, the print area 1 (i = 1) in the layout of the candidate number 1 corresponds to the vertical print paper P itself. That is, when the set size of the printing paper is A4 size, the horizontal length X of the printing area 1 is 210 mm, and the vertical length Y is 297 mm. Further, the print area 2 (i = 2) in the layout of candidate number 2 corresponds to the horizontally oriented print paper P itself. That is, when the set size of the printing paper is A4 size, the horizontal length X of the printing area 1 is 297 mm, and the vertical length Y is 210 mm.

  When the layout of the candidate number i is a layout divided by dividing lines, the printing area i is a rectangle formed by arranging the areas obtained by dividing by the dividing lines with the sides orthogonal to the dividing lines in contact with each other. It is considered as an area. Therefore, as shown in FIG. 3B, each of the print areas 3 to 6 (i = 3 to 6) corresponding to the layouts with the candidate numbers 3 to 6 is divided into the dividing lines of the areas Q1 and Q2. This is a rectangular region in which sides orthogonal to each other are arranged in contact with each other. Specifically, the print areas 3 and 4 corresponding to the candidate numbers 3 and 4 which are layouts divided by the vertical dividing lines L are rectangular areas in which the areas Q1 and Q2 are arranged in the vertical direction. On the other hand, the print areas 5 and 6 corresponding to the candidate numbers 5 and 6 which are layouts divided by the horizontal dividing lines L are rectangular areas in which the areas Q1 and Q2 are arranged in the horizontal direction.

  When the size of the set printing paper is A4 size and borderless printing is performed, the size of the printing area 3 (i = 3) is 105 mm (= 210 mm / 2) in the horizontal length X, The vertical length Y is 594 mm (= 297 mm × 2). As for the size of the print area 4 (i = 4), the horizontal length X is 148.5 mm (= 297 mm / 2), and the vertical length Y is 420 mm (= 210 mm × 2). As for the size of the printing area 5 (i = 5), the horizontal length X is 420 mm (= 210 mm × 2), and the vertical length Y is 148.5 mm (= 297 mm / 2). As for the size of the print region 6 (i = 6), the horizontal length X is 594 mm (= 297 mm × 2), and the vertical length Y is 105 mm (= 210 mm / 2).

  FIG. 4 is a diagram schematically illustrating the outline of the present embodiment. When a print instruction for Excel data using the print control application 14b is input, the mobile terminal 10 of the present embodiment uploads the Excel data to be directed to the server 100, and the server 100 converts the Excel data from the Excel data. Download image data in JPEG format. FIG. 4A is a schematic diagram illustrating an example of a print target image (hereinafter referred to as “target image”) I based on image data downloaded from the server 100 by the mobile terminal 10. In the example shown in FIG. 4A, it is assumed that the horizontal length Xa in the target image I is 12 and the vertical length Ya is 2.

  The mobile terminal 10 that has received the target image I compares the aspect ratio of the print area i with the aspect ratio of the target image I for each candidate number i, and the aspect ratio that most closely approximates the size of the target image I. Is selected (selected) as the optimum layout. In this embodiment, the aspect ratio used for comparison is the ratio of the vertical length to the horizontal length (vertical / horizontal).

  FIG. 4B shows a comparison result between the aspect ratio of the target image I and the aspect ratio of each print area i for each candidate number i (i = 1 to 6) stored in the layout candidate table 13a shown in FIG. It is a table | surface which shows. In the present embodiment, for each candidate number i, the ratio of (vertical / horizontal of target image) to (vertical / horizontal of print area i) and (vertical / horizontal of print area i) to (vertical / horizontal of target image). ) And a value equal to or less than 1 is adopted as an approximation rate for the size of the target image I. Then, the layout for the candidate number i with the closest approximation rate is selected as the optimum layout. According to the table shown in FIG. 4B, the optimal layout is the layout of candidate number 6 with an approximation rate of 0.94, that is, a layout in which landscape printing paper is divided into two by one landscape dividing line. Selected as.

  When the optimum layout is selected, the target image I is enlarged or reduced so as to fit in the print area in the optimum layout. Specifically, the ratio (X / Xa) of the horizontal length X of the print area of the optimal layout to the horizontal length Xa of the target image and the vertical length of the print area of the optimal layout with respect to the vertical length Ya of the target image. The ratio of the length Y (Y / Ya) is compared, and the smaller value is determined as the enlargement ratio. Then, the target image I is enlarged or reduced at the determined enlargement rate. When the enlargement ratio is greater than 1, the target image I is enlarged, and when the enlargement ratio is less than 1, the target image I is reduced.

  FIG. 4C is a schematic diagram showing a print result when the target image I is printed on the layout of candidate number 6 selected as the optimum layout. As shown in FIG. 3A, the layout of candidate number 6 is a layout in which the landscape printing paper P is divided into two regions Q1 and Q2 by one landscape dividing line. The target image I is divided into areas Q1 and Q2 and printed. When the approximation ratio with respect to the size of the target image I is less than 1, a blank area R where the target image I is not printed is formed in each of the areas Q1 and Q2. When the approximation ratio with respect to the size of the target image I is 1, the target image I just fits in the region Q1 and the region Q2, so the blank region R is not formed. In addition, when the value smaller than the smaller one of the X / Xa value and the Y / Ya value is used as the enlargement ratio, the margin formed on the printing paper P is not only the lower margin R but also the left-right direction. Also formed. As described above, since the optimal layout is the layout of the print area i having the aspect ratio that most closely approximates the size of the target image I, the size of the blank area R formed in the print result is larger than that of other layouts. Is the smallest. That is, according to the mobile terminal 10 of the present embodiment, the target image I can be printed on the printing paper P with the least waste. In addition, the layout in which the target image I is unnecessarily folded and printed or is not divided and printed on different printing papers is selected as the optimal layout, so that the target image I has a suitable layout with good visibility. Can print.

  FIG. 5 is a flowchart showing the return printing process executed by the CPU 11 in accordance with the print control application 14b. The return printing process is started when the CPU 11 receives an instruction to print the selected Excel data. First, in step S501 (hereinafter, step is omitted), the CPU 11 acquires a target image. Specifically, in S501, the CPU 11 causes the wireless LAN transmission / reception unit 15 to upload the instruction target Excel data to the server 100, and the image data converted from the Excel data is transmitted to the wireless LAN transmission / reception unit 15 as a target image. The target image is acquired by receiving. The Excel data that is the basis of the target image may be stored in any of the RAM 13, the flash memory 14, or the memory card 20.

  Next, the CPU 11 acquires the paper size from the print setting 14c, and generates the layout candidate table 13a (S502). By the process of S502, for example, a layout table 13a as shown in FIG. 2 is generated. Next, the CPU 11 executes an optimum layout selection process using the layout table 13a (S503). The optimum layout selection process (S503) is a process for selecting an optimum layout for the target image, and details thereof will be described later with reference to FIG. After execution of the optimal layout selection process (S503), the ratio of the vertical length of the selected optimal layout to the vertical length of the target image (the vertical of the optimal layout / the vertical of the target image) is When the ratio of the horizontal length of the selected optimal layout to the length (the horizontal of the optimal layout / the horizontal of the target image) is smaller (S504: Yes), the CPU 11 (the vertical of the optimal layout / the vertical of the target image) Is set as an enlargement ratio (S505), and the process proceeds to S506. On the other hand, when (optimum layout length / target image height) is equal to or greater than (optimum layout width / target image width) (S504: No), the CPU 11 determines (optimum layout width / target image width). The value is set as an enlargement ratio (S511), and the process proceeds to S506.

  In step S506, the CPU 11 enlarges or reduces the target image according to the enlargement ratio determined in step S505 or S511. In S506, if the enlargement ratio is greater than 1, the target image is enlarged, and if the enlargement ratio is less than 1, the target image is reduced. According to the processing of S504, S505, and S511 described above, the smaller one of the (optimum layout portrait / target image portrait) value and (optimum layout landscape / target image width) value is enlarged. Since it is adopted as a rate, the target image is enlarged or reduced to the maximum size that can fit in the print area in the selected optimal layout.

  Next, the CPU 11 generates a divided image by dividing the target image enlarged or reduced in S506 according to the optimum layout (S507). Specifically, a divided image is generated by equally dividing the target image that has been enlarged or reduced into (number of dividing lines with respect to the optimal layout + 1). When the optimal layout is the layout of candidate number 1 or 2, and the number of dividing lines is zero, the enlarged or reduced target image itself is a divided image.

  Next, the CPU 11 generates layout image data in which the generated divided images are arranged according to the optimal layout (S508). By the processing of S508, for example, image data corresponding to the print result shown in FIG. 4C is generated as layout image data. Next, the CPU 11 generates print data based on the layout image data (S509), transmits the print data from the wireless LAN transmission / reception unit 15 to the printer 30 (S510), and ends this processing. As a result of the processing in S509, an image based on the layout image data is printed on the printing paper. That is, the target image is printed with the selected optimum layout.

  FIG. 6 is a flowchart showing the optimum layout selection process (S503) described above. First, the CPU 11 initializes the value of the optimum approximation rate to zero (S601), and initializes the value of the variable i indicating the candidate number to 1 (S602). Next, the CPU 11 determines whether or not the current value of the variable i is larger than the number of layout candidates (S603). For example, when the layout table shown in FIG. 2 is adopted as the layout table 13a, the number of layout candidates is 6. In this case, the CPU 11 determines whether the variable i is larger than 6 in S603. .

  In S603, when the CPU 11 determines that the value of the variable i is equal to or less than the number of layout candidates (S603: No), the CPU 11 determines the ratio of the vertical length to the horizontal length of the target image (vertical / horizontal of the target image). ) Is smaller than the ratio of the vertical length to the horizontal length of the print area i in the layout of the candidate number i indicated by the current variable i (vertical / horizontal of the print area i) (S604). . In S604, when (vertical / horizontal of the target image) is smaller than (vertical / horizontal of the printing area i) (S604: Yes), the CPU 11 sets the approximation rate to “(vertical / horizontal of the target image) / (printing area). i vertical / horizontal) "(S605), and the process proceeds to S606. On the other hand, when (vertical / horizontal of the target image) is equal to or larger than (vertical / horizontal of the printing area i) (S604: No), the CPU 11 sets the approximation rate to "(vertical / horizontal of the printing area i) / (target Image Vertical / Horizontal) ”(S610), and the process proceeds to S606. According to the processing of S604, S605, and S610 described above, the value of the aspect ratio of the target image (vertical / horizontal of the target image) and the aspect ratio of the print area i (vertical / horizontal of the print area i) A ratio having a larger value among the values as a denominator is set as an approximate value. That is, the approximate value set in S605 or S610 is a value of 1 or less.

  When the set approximation rate is larger than the current optimum approximation rate in S606 (S606: Yes), the CPU 11 sets the approximation rate set in S605 or S610 as the optimum approximation rate (S607), and the current variable i is The layout with the candidate number i shown is the optimum layout (S608), and the process proceeds to S609. On the other hand, when the set approximation rate is equal to or less than the current optimum approximation rate (S606: No), the CPU 11 shifts the process to S609.

  The CPU 11 adds 1 to the variable i (S609), and the process proceeds to S603. In S603, when the CPU 11 determines that the value of the variable i is larger than the number of layout candidates (S603: Yes), the processing for all candidate numbers is completed. In this case, the CPU 11 ends this processing. According to the processing of S606, S607, and S608 described above, the maximum approximation rate is the closest value to 1 among the approximation rates set between the value of the variable i and the current value. Therefore, according to the optimal layout selection process (S503), the layout in which the aspect ratio of the print area is the closest to the aspect ratio of the target image is selected as the optimal layout among all the available layouts.

  According to the first embodiment, a layout having an aspect ratio that is the closest to the aspect ratio of the target image among a plurality of types of layouts, that is, a layout having a shape that is closest to the shape of the target image, is selected as the optimal layout. The Therefore, since the margin generated when the target image is printed can be made as small as possible, it is possible to prevent a print result that has been pagelessly turned or a print result that has been turned back unnecessarily. Therefore, when printing an image such as a table that does not fit on a single printing sheet as it is, printing can be performed with a suitable layout without wastefully using the sheet. In particular, the smaller one of the value of (vertical layout vertical / vertical image vertical) and (optimal layout horizontal / horizontal image) is determined as the enlargement ratio. It is possible to print at the maximum size that fits in the print area in the selected optimal layout. Therefore, it is possible to obtain a printing result in which the target image is printed with the best visibility.

  In addition, since the layout candidate table 13a is generated based on the paper size acquired from the print setting 14c, it is possible to select an optimal layout for printing for various sizes of printing paper. In the layout candidate table 13a, for example, as shown in FIG. 2, one or more equally divided into a plurality of dividing lines along the longitudinal direction of the printing paper with respect to the vertical and horizontal orientations of the printing paper of each size. Information that can calculate the layout and the aspect ratio of the print area in each of one or more layouts equally divided by a dividing line along the short direction of the printing paper, specifically, the width of each print area And the vertical length are stored. Therefore, it is possible to select a layout that can print an image to be printed with optimum visibility regardless of the paper orientation set by the user.

  Next, a second embodiment of the present invention will be described with reference to FIGS. In the first embodiment, the entire area of the target image is printed on the printing paper regardless of the content of the target image based on the image data converted from the Excel data. In the second embodiment, the target image It is configured so that important areas can be printed at maximum size. Note that in the second embodiment, the same portions as those in the first embodiment described above are denoted by the same reference numerals, and description thereof is omitted.

  FIG. 7 is a diagram schematically illustrating the outline of the second embodiment. FIG. 7A is a schematic diagram illustrating an example of the target image I2 based on the image data converted from the Excel data downloaded from the server 100 by the mobile terminal 10. The image data corresponding to the target image I2 is an example of “image data generated based on tabular data composed of a plurality of cells arranged in a matrix”. In the example shown in FIG. 7A, the target image I2 is a table in which each cell in the bottom row B1 and the rightmost column B2 is blank among a plurality of cells (cells) arranged in a matrix. It is an image. In the present embodiment, among the cells that are not blank, the rectangular region formed by the cell located in the upper left corner and the cell farthest from the cell is an important region, and the other regions are non-important regions. And The cell farthest from the cell located at the upper left is a straight line from a predetermined vertex in the cell located at the upper left to the predetermined vertex in each cell among cells that are not blank. The grid with the longest distance. That is, in the table indicated by the target image, blank cells (blank cells) positioned on the end side are treated as non-important regions.

  FIG. 7B is a schematic diagram showing the important area A in the target image I2 of FIG. As shown in FIG. 7B, the important area A is a rectangle formed by a cell C1 located at the upper left among the cells not in the blank state and a cell C2 farthest from the cell C1. It is an area. The horizontal length of the important area A is Xa2, and the vertical length is Ya2. The optimum layout is selected based on the aspect ratio of the important area A and the aspect ratio of the print area in each layout, and the enlargement ratio at the time of printing is based on the ratio of the size of the important area A to the size of the print area of the optimum layout. Is calculated. That is, in the present embodiment, the enlargement ratio is calculated so that the important area can be printed on the printing paper with the maximum size.

  FIG. 7C is a schematic diagram illustrating a printing result when the target image I2 is printed with respect to the optimum layout selected based on the important area A. In this example, it is assumed that the layout of candidate number 6 is selected. Similar to the first embodiment described above (see FIG. 4C), the target image I2 is divided into regions Q1 and Q2 on the horizontally oriented print paper P and printed. However, in the present embodiment, unlike the first embodiment, the target image I2 is enlarged or reduced at an enlargement rate calculated based on the size of the important area A. The ruled line in the lower row B1 is printed, and no margin area is formed.

  FIG. 8 is a flowchart showing the return printing process of the second embodiment. The return printing process of the second embodiment is also a process executed by the CPU 11 in accordance with the print control application 14b, similar to the first embodiment described above, and is started when the CPU 11 receives a print instruction for the selected Excel data. The First, the CPU 11 acquires a target image as in the first embodiment described above (S501). Next, the CPU 11 extracts an important area from the acquired target image (S801). In step S <b> 801, the CPU 11 detects a non-blank cell in the target image by image analysis, and forms the cell located in the upper left corner of the non-blank cell and the cell farthest from the cell. The rectangular area to be extracted is extracted as an important area.

  Next, as in the first embodiment described above, the CPU 11 generates a layout candidate table 13a (S502) and executes an optimum layout selection process (S503). However, in this embodiment, “vertical / horizontal of the important area” is used instead of “vertical / horizontal of the target image” in S604, S605, and S610 of the optimum layout selection process (see FIG. 6) of the first embodiment. To do.

  After execution of the optimal layout selection process (S503), the ratio of the vertical length of the selected optimal layout to the vertical length of the important area (the vertical of the optimal layout / the vertical of the important area) is If the ratio is smaller than the ratio of the horizontal length of the selected optimal layout to the length (horizontal of the optimal layout / horizontal of the important area) (S802: Yes), the CPU 11 (vertical of the optimal layout / vertical of the important area) Is set as the enlargement ratio (S803), and the process proceeds to S506. On the other hand, when (the optimum layout length / important area length) is equal to or greater than (optimum layout width / important area width) (S802: No), the CPU 11 determines (optimum layout width / important area width). The value is set as an enlargement ratio (S804), and the process proceeds to S506. Therefore, according to the processing of S802, S803, and S804, the smaller one of the value of (vertical layout vertical / important region vertical) and (optimal layout horizontal / important region horizontal) is enlarged. Since it is adopted as a rate, the important area is enlarged or reduced to the maximum size that fits in the print area in the selected optimum layout.

  Next, as in the first embodiment described above, the CPU 11 enlarges or reduces the target image according to the determined enlargement ratio (S506), and generates a divided image from the enlarged or reduced target image (S507). ). According to S507, since the divided image is generated from the target image, the divided image includes at least a part of the lowest row B1 that is the non-important region. Next, as in the first embodiment described above, the CPU 11 generates layout image data (S508), generates print data (S509), and transmits the generated print data to the printer 30 (S510). This process ends. In the present embodiment, for example, image data corresponding to an image corresponding to the print result illustrated in FIG. 7C is generated as layout image data by the processing of S508. That is, since the divided image generated in S507 includes at least a part of the lowermost row B1, the ruled line of the lowermost row B1, which is an unimportant area, is printed in the print result.

  According to the second embodiment, when the target image is an image of image data generated based on tabular data, the target image is composed of blank cells (cells) on the end side of the target image. The important areas excluding the non-important areas are extracted, and the optimum layout is selected based on the aspect ratio (vertical / horizontal) of the important areas. Therefore, the layout with the aspect ratio that most closely approximates the aspect ratio of the important area among the multiple types of layouts, that is, the layout with the shape that most closely approximates the shape of the important area, is selected as the optimum layout. It is possible to print with a suitable layout without useless page breaks or useless wrapping. In particular, since the smaller one of the value of (vertical layout vertical / important area vertical) and (optimal layout width / important area horizontal) is determined as the enlargement ratio, the important area is It is possible to print at the maximum size that fits in the print area in the selected optimal layout. Therefore, the non-blank area in the table, that is, the important area where the user needs to read the contents can be read by the user with the best visibility.

  In addition, a rectangular area formed by the square located in the upper left corner and the square farthest from the square is extracted as an important area among squares that are not blank. Even if there is a blank cell that is sandwiched, it is possible to prevent the non-blank cell from being divided by the blank cell and being determined as separate important areas. In addition, since the divided image generated in S507 provides a print result in which the ruled line of the bottom row B1, which is a non-important area, is printed, it becomes a blank area other than the important area while arranging the important area as large as possible. A non-important area (blank cell) can be arranged in the power area. The user can use this blank cell as, for example, a cell for handwriting in the print result.

In the embodiment, the mobile terminal 10 is an example of an image processing device. The print control application 14b is an example of an image processing program. The printer 30 is an example of a printing unit. The CPU 11 is an example of a computer. The printing paper P is an example of paper. The dividing line L is an example of a dividing line. Regions Q1 and Q2 are examples of divided regions. The important area A is an example of the important area. The bottom row B1 and the rightmost column B2 are examples of non-important regions. CPU11 which performs the process of S501 is an example of an image acquisition means and an image acquisition step. The CPU 11 that executes the process of S502 is an example of an aspect ratio acquisition unit, a paper size acquisition unit, and an aspect ratio acquisition step. CPU11 which performs the process of S604-S608, S610 is an example of a layout selection means and a layout selection step. CPU11 which performs the process of S507 is an example of a division | segmentation means and a division | segmentation step. The CPU 11 that executes the process of S508 is an example of an image generation unit and an image generation step. The CPU 11 that executes the process of S510 is an example of a print control unit and a print control step. CPU11 which performs the process of S801 is an example of an extraction means and an extraction step . The CPU 11 that executes the processes of S504, S505, S511 or S802, S803, and S804 is an example of a size changing unit.

  Although the present invention has been described based on the embodiments, the present invention is not limited to the above-described embodiments, and various improvements and modifications can be easily made without departing from the spirit of the present invention. Can be inferred.

  For example, in each of the above-described embodiments, an image converted from tabular data such as Excel data is exemplified as the target image. However, various images that do not fit on one print sheet, for example, one image received by facsimile. The present invention may be applied to a long image that does not fit on the print paper as a target image.

  In the above-described embodiment, it is exemplified that one target image is folded and printed on one print sheet. However, the present invention is similarly applied to a case where one target image is printed on two or more print sheets. it can. For example, when the user designates the number of prints, all the areas divided by the dividing lines with the same layout are formed side by side in the direction along the dividing lines for each of the printing sheets of the designated number or less. The approximate ratio may be calculated from the rectangular area as a print area and the aspect ratio of the print area and the aspect ratio of the target image or important area. Alternatively, a configuration may be adopted in which the number of printed sheets and the layout are searched so that the approximation ratio with the aspect ratio of the target image or important region is closest to 1, and the corresponding number of printed sheets and layout are adopted. At this time, if there are a plurality of layouts having the same approximation rate with an approximation rate closest to 1, if, for example, a layout with the calculated enlargement rate closest to 1 is selected, the target image is selected. If it is larger than the print area, the target image can be printed with the maximum size. Alternatively, if a layout with the calculated enlargement ratio farthest from 1 is selected from a plurality of layouts having the same approximation ratio at an approximation ratio closest to 1, if the target image is smaller than the print area, the target image Can be printed in the maximum size.

  In each of the above embodiments, the usable layouts are combinations in which the orientation of the printing paper is vertical or horizontal, the number of dividing lines is 0 or 1, and the direction of the dividing lines is vertical or horizontal. Although six types of layouts corresponding to the above are illustrated, it is naturally possible to increase the types of layouts by setting the number of dividing lines to two or more. That is, a layout in which the printing paper is divided into two or more in the vertical or horizontal direction may be adopted.

  In each of the embodiments described above, the layout candidate table 13a is generated every time the return printing process (FIGS. 5 and 8) is executed. However, the layout candidates are preliminarily set for all sizes of usable printing paper. A table similar to the table 13a may be prepared in advance, and a table corresponding to the size of the printing paper set as the print setting 14c may be read when the return printing process is executed.

  In each of the above embodiments, the mobile terminal 10 having the call function is illustrated as the mobile terminal 10 on which the print control application 14b is mounted. However, various devices such as a tablet and a digital camera that do not have the call function are also included in the present invention. The present invention can also be applied to an apparatus that can be an example of the terminal 10 and that does not have the touch panel 17 and inputs an operation from a mechanical key. In each of the above embodiments, the OS 14a is described as an Android (registered trademark) OS. However, the present invention can also be applied to a mobile terminal equipped with another OS.

  In each of the above embodiments, the mobile terminal 10 does not have a printing function, generates layout image data from the target image acquired from the server 100, and transmits the print data based on the layout image data to the printer 30. However, a device corresponding to the print control application 14b is installed in a device such as a multifunction machine or a printer having a printing unit that implements a printing function, and the device having the printing unit performs the above-described return printing process (see FIG. 5, FIG. 8) and an optimum layout selection process (FIG. 6) may be executed. In such a case, an apparatus having a printing unit generates layout image data from a target image acquired from the server 100 or a memory card, and transmits print data based on the layout image data to the printing unit for printing. In each of the above embodiments, the mobile terminal 10 is configured to transmit print data based on the layout image data to the printer 30. However, the mobile terminal 10 transmits the layout image data to the printer 30 and performs printing based on the layout image data. 30 may be executed.

  Alternatively, when the server 100 is loaded with a program corresponding to the print control application 14b and the server 100 receives Excel data from the mobile terminal 10, the above-described return printing process (FIGS. 5 and 8) according to the program. Alternatively, the optimum layout selection process (FIG. 6) may be executed. In such a case, the server 100 acquires the target image by converting the Excel data received from the mobile terminal 10 into image data, generates layout image data from the target image, and generates the layout image data or the layout image. Print data based on the data is transmitted to the printer 30 to print the corresponding image. In such a case, the server 100 includes a plurality of servers, and a conversion server that converts Excel data into an image (target image) is different from a server that generates layout image data from the target image converted by the conversion server. It is preferable to configure as a server.

  In each of the above embodiments, the layout at the time of borderless printing has been described as an example. However, when a margin is set, the area excluding the margin is set as a print area, the aspect ratio of the print area, the target image, What is necessary is just to compare the aspect ratio of an important area | region.

  In each of the above embodiments, the “vertical / horizontal” of each area is adopted as the aspect ratio of the print area, the target image, and the important area, but “horizontal / vertical” of each area is adopted as the aspect ratio. It may be a configuration. In each of the above embodiments, the ratio of (vertical / horizontal of the target image) to (vertical / horizontal of the printing area i) and the ratio of (vertical / horizontal of the printing area i) to (vertical / horizontal of the target image). The value of 1 or less is used as the approximation rate for the size of the target image I, but a value greater than 1 may be used as the approximation rate. Also in such a case, the layout for the candidate number i having the closest approximation rate is selected as the optimum layout.

  In the second embodiment, in S506, the target image is enlarged or reduced according to the enlargement ratio. However, the enlargement or reduction target may be set as an important region. In such a case, it is possible to obtain a print result of only the important area not including the non-important area.

  In the second embodiment, in step S <b> 801, the CPU 11 determines a rectangular area formed by a cell located in the upper left corner of a cell that is not blank in the target image and a cell farthest from the cell. Although it is configured to extract as the important region, the target image may be displayed on the LCD 18 and the user may designate the important region using the touch panel 17 or the like. In such a case, the user can set a desired area as an important area. In addition, when the target image is subjected to image analysis, and there is a predetermined item such as a “remarks column” that is relatively less important than the other items among the items that have been character-recognized, A configuration may be adopted in which the important area is extracted from the target image with the corresponding square as the non-important area.

  In the above embodiment, the target image indicating the table is folded without considering the position of the ruled line in the table. However, the layout image data may be generated so as to be folded at the ruled line position. For example, in S507 of the return printing process (FIGS. 5 and 8), the CPU 11 may generate a divided image divided at the position of the ruled line instead of equally dividing (number of dividing lines with respect to the optimal layout + 1). . However, the width of the divided image is preferably approximated to the equally divided width as much as possible. In such a case, for each divided image, a maximum enlargement ratio that fits in each region in the optimum layout is calculated, and each divided image is enlarged or reduced according to the calculated enlargement ratio to generate layout image data. What is necessary is just to comprise.

  In the above-described embodiment, the target image indicating the table is simply folded, but an item string or item row may be added for each folding. In such a case, for example, in the return printing process (FIGS. 5 and 8), the CPU 11 attaches an image of an item string or item row to each divided image generated in S507, and generates layout data in S508. The CPU 11 may be configured to enlarge or reduce each divided image including the image of the item row and the item row so as to fit in each area of the layout.

10 Mobile terminal 14b Print control application

Claims (10)

Image acquisition means for acquiring image data;
A plurality of types according to the orientation of the paper and the arrangement of the divided image divided into a plurality of parts by folding back a specific area of the image based on the image data acquired by the image acquisition means at a predetermined position in the longitudinal direction. For each layout, aspect ratio acquisition means for acquiring the aspect ratio of the print area in each layout;
Layout selecting means for selecting one layout corresponding to an aspect ratio that most closely approximates the aspect ratio of the specific area among the aspect ratios acquired by the aspect ratio acquiring means;
Division means for generating the divided image from an image based on the image data acquired by the image acquisition means according to the layout selected by the layout selection means;
Image generation means for generating, as layout image data, image data in which the divided images generated by the dividing means are arranged in accordance with the layout selected by the layout selecting means;
Print control means for transmitting layout image data generated by the image generation means or print data based on the layout image data to a printing unit;
When the image data acquired by the image acquisition means is image data generated based on tabular data composed of a plurality of cells arranged in a matrix, from the image based on the image data, Extraction means for extracting an important region excluding a non-important region composed of blank cells located on the edge side of the image as the specific region;
An image processing apparatus comprising:   The aspect ratio acquisition means includes one or more layouts that are equally divided into a plurality of dividing lines along the longitudinal direction of the paper in the vertical and horizontal directions of one or more types of paper, and the short side of the paper The image processing apparatus according to claim 1, wherein an aspect ratio of a print area in each of one or more layouts equally divided into a plurality of division lines along a direction is acquired.   3. The print area according to claim 2, wherein the print area is a rectangular area formed by arranging the divided areas of the paper divided by the dividing lines so that the sides perpendicular to the dividing lines are in contact with each other. Image processing device. Paper size acquisition means for acquiring paper size information,
The aspect ratio acquisition unit calculates the aspect ratio of the print area corresponding to each layout based on the lengths of the long side and the short side of the paper indicated by the paper size information acquired by the paper size acquisition unit. The image processing apparatus according to claim 1, wherein the image processing apparatus acquires the image processing apparatus. The extraction unit includes a cell at a predetermined position and a cell located farthest from the cell at the predetermined position among non-blank cells included in the image based on the image data acquired by the image acquisition unit. The image processing apparatus according to claim 1, wherein a rectangular area formed from eyes is the important area. When there is a margin area other than the area in which the divided image is arranged in the print area in the selected layout, the image generation unit is configured to arrange at least a part of the non-important area in the margin area. 6. The image processing apparatus according to claim 1 , wherein the image processing apparatus generates layout image data. A size changing means for enlarging or reducing the specific area in the image based on the image data acquired by the image acquiring means so as to be the maximum size that fits in the print area in the layout selected by the layout selecting means,
The said image generation means produces | generates the image data which has arrange | positioned the said divided image expanded or reduced by the said size change means as layout image data, It is any one of Claim 1 to 6 characterized by the above-mentioned. Image processing device. The size changing means is the ratio of the length in the print area of the selected layout to the length in the longitudinal direction of the specific area and the length in the short direction of the specific area. The image processing apparatus according to claim 7 , wherein the specific area is enlarged or reduced by using a small ratio as an enlargement ratio among the ratios of the lengths in the short direction in the print area of the selected layout. An image processing program executable by a computer of an image processing apparatus,
Image acquisition means for acquiring image data;
A plurality of types according to the orientation of the paper and the arrangement of the divided image divided into a plurality of parts by folding back a specific area of the image based on the image data acquired by the image acquisition means at a predetermined position in the longitudinal direction. For each layout, an aspect ratio acquisition unit that acquires an aspect ratio of a print area in each layout, and an aspect ratio that is closest to the aspect ratio of the specific region among the aspect ratios acquired by the aspect ratio acquisition unit 1 Layout selection means for selecting the layout of
Division means for generating the divided image from an image based on the image data acquired by the image acquisition means according to the layout selected by the layout selection means;
Image generation means for generating, as layout image data, image data in which the divided images generated by the dividing means are arranged in accordance with the layout selected by the layout selecting means;
Print control means for transmitting layout image data generated by the image generation means or print data based on the layout image data to a printing unit ;
When the image data acquired by the image acquisition means is image data generated based on tabular data composed of a plurality of cells arranged in a matrix, from the image based on the image data, important areas excluding the non-critical region consists grid blank state located at the end side of the image, and an extraction means for extracting, as the specific area,
An image processing program for causing the computer to function. An image processing method performed by an image processing apparatus,
An image acquisition step for acquiring image data;
A plurality of types according to the orientation of the paper and the arrangement of the divided image divided into a plurality of parts by folding back a specific area of the image based on the image data acquired in the image acquisition step with respect to the longitudinal direction. For each layout, an aspect ratio acquisition step for acquiring the aspect ratio of the print area in each layout;
A layout selection step of selecting one layout corresponding to an aspect ratio that is most approximate to the aspect ratio of the specific region among the aspect ratios acquired by the aspect ratio acquisition step;
A division step of generating the divided image from an image based on the image data acquired by the image acquisition step according to the layout selected by the layout selection step;
In accordance with the layout selected in the layout selection step, an image generation step for generating image data in which the divided images generated in the division step are arranged as layout image data;
A print control step of transmitting layout image data generated by the image generation step or print data based on the layout image data to a printing unit;
When the image data acquired by the image acquisition step is image data generated based on tabular data composed of a plurality of cells arranged in a matrix, from the image based on the image data, An extraction step of extracting, as the specific region, an important region excluding a non-important region composed of blank cells located on the edge side of the image;
An image processing method comprising:

Images