JP5665428B2 - Image processing apparatus and image processing method - Google Patents

Description

  The present invention relates to an image processing apparatus and an image processing method suitable for printing a plurality of images on one sheet of paper.

  Conventionally, a plurality of images may be printed on one sheet by an image processing apparatus. However, in such printing, in many cases, each image is adjusted to the same size and arranged at a predetermined position. That is, the size and position of each image are determined by equal allocation. In this case, when a plurality of images printed on the single sheet are observed as one printed matter, the printed matter may be said to be poorly changed.

  In addition, Japanese Patent Application Laid-Open No. 2004-151867 describes a technique for arranging a plurality of images at positions where the center is an integer multiple of the golden ratio so that the images do not overlap, and the plurality of images are irregularly formed by superimposing a plurality of types of templates. Japanese Patent Application Laid-Open No. H10-228707 describes a technique that makes it appear as if it is arranged in the above.

JP-A-2005-79817 JP 2008-289075 A

  However, in the technique described in Patent Document 1, many blank portions are likely to be generated between images, and many wasted portions are generated on the paper. Also, with the technique described in Patent Document 2, a part of an image that does not fit the template size is forcibly deleted.

  An object of the present invention is to provide an image processing apparatus, an image processing method, and the like that can generate one image rich in change from a plurality of images.

An image processing apparatus according to the present invention is an image processing apparatus that automatically lays out a plurality of images, and divides the plurality of images into two or more blocks, and for each block, frames of images included in the blocks are divided. A rectangle composed of a plurality of blocks is generated by combining a rectangle generating unit that generates a rectangle for placement and two of the rectangles generated by the rectangle generating unit to generate a new rectangle. Determining means for generating a rectangle in which a plurality of image frames are arranged and determining the arrangement of the plurality of image frames; and a specific image is a large image having a frame size higher than the plurality of image frames. And control means for controlling the determining means so as to be arranged on the top.

  According to the present invention, it is possible to generate one image in which a plurality of images are arranged without including useless margins.

It is a figure which shows the example of the image output by the printing apparatus. FIG. 2 is a diagram illustrating an outline of an internal configuration of a printing apparatus. 6 is a flowchart illustrating an outline of a printing method. It is a flowchart which shows the outline | summary of 1st Embodiment. It is a figure which shows the specific example of the reference | standard size of a flame | frame. It is a figure which shows the method of adjusting the size and position of a frame group. It is a figure which shows the method of arranging two frames in the vertical direction and producing | generating a frame group. It is a flowchart which shows the method of producing | generating a frame group from N frames. It is a figure which shows the example of the division | segmentation method into the group of N frames. It is a figure which shows the example of the creation method of the rectangle of the block number k. It is a figure which shows the production | generation method of a frame group in case the total frame number N is 11. FIG. It is a flowchart which shows the outline | summary of 2nd Embodiment. It is a figure which shows the content of a cross check. It is a flowchart which shows the detail of a process of step S1202. It is a flowchart which shows the outline | summary of 3rd Embodiment.

  Hereinafter, embodiments of the present invention will be specifically described with reference to the accompanying drawings. First, matters common to the embodiments will be described. FIG. 1 is a diagram illustrating an example of an image output by a printing apparatus (image processing apparatus) according to the embodiment. In this example, a rectangular paper layout area (printable area) 202 designated by the user, for example, is set inside the paper 201. Also, for example, a plurality of images (here, 11 images) designated by the user are arranged irregularly (randomly) without gaps, and the outer edges of these image groups 203 are also rectangular. Note that the magnification of each image is appropriately adjusted from that at the time specified by the user. That is, the size of each image is appropriately adjusted from that specified by the user, while the aspect ratio of each image is the same as that when specified by the user, excluding calculation errors due to scale or enlargement. Is consistent with the one. One set of two parallel sides constituting the outer edge of the image group 203 overlaps one set of two parallel sides constituting the paper layout area 202.

  In the embodiment of the present invention, an image group 203 having a layout as shown in FIG. 1 is generated on a single sheet from a plurality of images.

  Next, the outline of the internal configuration of the printing apparatus according to each embodiment will be described. FIG. 2 is a diagram illustrating an outline of the internal configuration of the printing apparatus.

  In the printing apparatus 100, a CPU 101, a built-in storage device 102, a memory 103, a display control unit 104, an operation unit 105, an image input unit 106, an image processing unit 107, and a printing unit 108 are connected to each other via an internal bus 111. Yes. Therefore, the CPU 101, built-in storage device 102, memory 103, display control unit 104, operation unit 105, image input unit 106, image processing unit 107, and printing unit 108 exchange data with each other via the internal bus 111. Can do.

  The built-in storage device 102 stores data such as image data and various programs for the CPU 101 to operate. For example, a RAM is used as the memory 103. The operation unit 105 receives a user operation, generates a control signal corresponding to the operation, and supplies the control signal to the CPU 101. As the operation unit 105, for example, a character information input device such as a keyboard, a pointing device such as a mouse and a touch panel, an operation button, or the like is used as an input device that receives a user operation. The touch panel is an input device that outputs coordinate information according to a position touched with respect to an input unit configured in a planar manner, for example. For example, the CPU 101 receives a control signal generated by the operation unit 105 in response to a user operation, reads a program stored in the internal storage device 102 based on the control signal, and according to the program, each unit of the printing apparatus 100 To control. At this time, the memory 103 is appropriately used as a work memory of the CPU 101. In this way, the user can cause the printing apparatus 100 to perform an operation corresponding to the operation on the operation unit 105.

  The display control unit 104 outputs a display signal for displaying an image on the display 110. For example, a display control signal generated by the CPU 101 according to a program is supplied to the display control unit 104. The display control unit 104 generates a display signal based on the display control signal and outputs the display signal to the display 110. For example, the display control unit 104 causes the display 110 to display a GUI screen configuring a GUI (Graphical User Interface) based on a display control signal generated by the CPU 101. When a touch panel is used as the operation unit 105, the operation unit 105 and the display 110 can be configured integrally. For example, the touch panel is configured such that the light transmittance does not hinder the display of the display 110 and is attached to the upper layer of the display surface of the display 110. Then, the input coordinates on the touch panel are associated with the display coordinates on the display 110. Thereby, it is possible to configure a GUI as if the user can directly operate the screen displayed on the display 110.

  As the image input unit 106, for example, a drive device that exchanges data with the external storage medium 122, a communication interface, or the like is used. The drive device is configured such that an external storage medium 122 such as a CD, a DVD, a memory card, or the like can be mounted, for example, reading data from the mounted external storage medium 122 and external storage medium based on the control of the CPU 101 Data is written to 122. The communication interface performs communication with a network 120 such as a LAN or the Internet or communication with an external communication device 121 such as a mobile phone or a digital camera based on the control of the CPU 101.

  The image processing unit 107 converts the image data acquired from the internal storage device 102 and the image input unit 106 into a format that can be processed by the resizing process such as predetermined image interpolation, enlargement or reduction, color conversion process, and printing unit 108. Perform conversion processing.

  The printing unit 108 prints the image data converted into a format that can be processed by the image processing unit 107 on a sheet.

  Note that the operation unit 105 may be provided in a computer or the like that can communicate with the printing apparatus 100. Further, the image data may be stored in the computer.

  Printing using the printing apparatus 100 configured as described above can be performed, for example, according to the flowchart shown in FIG. FIG. 3 is a flowchart illustrating an outline of a printing method using the printing apparatus 100.

  First, in step S1001, the user selects a paper size. This selection is performed by, for example, operating the operation unit 105 or mounting a sheet on the printing apparatus 100. Next, in step S1002, the user selects a paper layout. Here, in order to execute the embodiment of the present invention, a paper layout to be left to the printing apparatus 100 is selected. The CPU 101 sets a printable area (paper layout area) based on this selection. For example, the user may select a paper layout named “automatic layout” or a paper layout named similar to this. Thereafter, in step S1003, the user selects a plurality (N: N is a natural number) of images desired to be printed from the images stored in the internal storage device 102 or the image input unit 106. This selection is performed by operating the operation unit 105, for example. At this time, the user may also perform trimming setting for designating a range in which printing is desired for each image, or may perform rotation setting for designating the upward direction of printing. In step S <b> 1004, the user instructs the printing apparatus 100 to execute printing by operating the operation unit 105.

  Next, in step S1005, the printing apparatus 100 starts a printing process. Thereafter, in step S1006, the CPU 101 calculates a frame layout for a plurality of images selected by the user. Here, the frame arrangement means the position and size of each image in the sheet. Details of the contents of this frame arrangement will be described later. Data relating to the frame arrangement calculated in step S1006 is stored in the memory 103 successively. Subsequently, in step S1007, the CPU 101 reads out a plurality of images selected by the user from the internal storage device 102, calculates them in step S1006, and stores data relating to the frame arrangement stored in the memory 103 in the image processing unit 107. The image processing unit 107 generates print data. In step S1008, the CPU 101 causes the printing unit 108 to print the print data generated in step S1007 on a sheet.

(First embodiment)
Next, an overview of the process (calculation of frame placement) in step S1006 in the first embodiment will be described. FIG. 4 is a flowchart showing an overview of the process of step S1006 in the first embodiment.

  In step S1006, first, in step S2001, the CPU 101 retrieves a plurality of images selected by the user from the built-in storage device 102 or the image input unit 106, and acquires a frame standard size for each image. Here, the frame standard size is an initial value of the frame width and height, and is the width and height when the head direction of the image corresponding to each frame is aligned.

  Here, a specific example of the frame standard size will be described with reference to FIG. FIG. 5A shows an example in which the rotation information is 0 degree and the trimming setting by the user is not made in step S1003. FIG. 5B shows an example in which the rotation information is 90 degrees and the trimming setting by the user is not made in step S1003. FIG. 5C shows an example in which the rotation information is 0 degree and trimming is set by the user in step S1003. As the rotation information, for example, the latest information among the rotation information attached to the image or the rotation information designated by the user in step S1003 is used.

  After step S2001, the CPU 101 changes the order of frames irregularly in step S2002. That is, the order of frames is shuffled. Thereby, even if the user selects and prints the same image with the same setting, a different printed matter can be obtained each time.

  Next, in step S2003, the CPU 101 appropriately scales these frames with respect to a plurality (N) of images selected by the user at the same aspect ratio, thereby generating a frame group consisting of N frames and having a rectangular outer edge. Generate. At this time, a frame group is generated so that no gap is generated between adjacent frames. Details of this processing will be described later.

  Thereafter, in step S2004, the CPU 101 refers to the paper layout selected in step S1002, and adjusts the size and position of the frame group and the N frames constituting the frame group. FIG. 6 is a diagram illustrating a method of adjusting the size and position of the frame group. Here, the upper left vertex of the printable area (paper layout area 302) is the origin, the right direction is the x direction, and the lower direction is the y direction. Further, it is assumed that the top left vertex of the frame group is located at the origin before the size and position adjustment.

  As shown in FIG. 6A, ““ width of frame group 301 ”÷“ height of frame group 301 ”≦“ width of paper layout area 302 ”÷“ height of paper layout area 302 ”is satisfied. First, the CPU 101 multiplies (resizes) the width and height of the frame group 301 by ““ the height of the paper layout area 302 ”÷“ the height of the frame group 301 ”. As a result, the height of the frame group 301 matches the height of the paper layout area 302. Next, the CPU 101 moves the frame group 301 in the x direction “(“ width of paper layout area 302 ”−“ width of frame group 301 after resizing ”) / 2”. As a result, the frame group 301 is arranged at the center of the paper layout area 302.

  On the other hand, as shown in FIG. 6B, ““ width of frame group 301 ”÷“ height of frame group 301 ”>“ width of paper layout area 302 ”÷“ height of paper layout area 302 ”holds. In this case, first, the CPU 101 multiplies (resizes) the width and height of the frame group 301 by ““ width of the paper layout area 302 ”÷“ width of the frame group 301 ”. As a result, the width of the frame group 301 matches the width of the paper layout area 302. Next, the CPU 101 moves the frame group 301 in the y direction “(“ height of the paper layout area 302 ”−“ height of the frame group 301 after resizing ”) / 2”. As a result, the frame group 301 is arranged at the center of the paper layout area 302. That is, the frame group 301 fits in the paper layout region 302 and one set of two parallel sides constituting the paper layout region 302 has two sets of parallel two sides constituting the frame group 301. The size and position of the frame group 301 are adjusted so that one set of them overlaps.

  FIG. 6 shows a method for adjusting the size and position of the frame group. The CPU 101 accompanies the adjustment of the frame group, and the N images constituting the frame group also have the same size and position. Make adjustments.

  As a result of such processing, the CPU 101 as the image generation means does not generate a gap other than the left and right margin portions or the upper and lower margin portions in the paper layout area (printable area) 302, and the N pieces selected by the user. The image is arranged in one rectangle. Although it is possible not to generate a gap completely, a line or a margin with a fixed width may be added to clarify the separation of the image. In either case, one image in which N images are arranged can be generated without generating a useless blank area.

  Next, the process of step S2003 (frame group generation) will be described. In this description, a method for generating a frame group from two frames will be described first, and then a method for generating a frame group from three or more frames will be described.

  FIG. 7A is a diagram showing a method of generating a frame group by arranging two frames in the vertical direction, and FIG. 7B is a method of generating a frame group by arranging two frames in the horizontal direction. FIG.

  When two frames are arranged in the vertical direction to generate a frame group, as shown in FIG. 7A, the CPU 101 first has a reference rectangle having the same shape as one of the two frames, and the other. An additional rectangle having the same shape as one of the outer shapes is set. Next, the CPU 101 multiplies (resizes) the width and height of the additional rectangle by ““ width of reference rectangle ”÷“ width of additional rectangle ””. As a result, the width of the reference rectangle matches the width of the additional rectangle after resizing. Thereafter, the CPU 101 sets the coordinates of the additional rectangle. At this time, if the coordinates of the additional rectangle are set as (the X coordinate of the reference rectangle, the Y coordinate of the reference rectangle + the height of the reference rectangle), the additional rectangle is arranged below the reference rectangle. On the other hand, when the coordinates of the additional rectangle are set as (the X coordinate of the reference rectangle, the Y coordinate of the reference rectangle−the height of the additional rectangle after resizing), the additional rectangle is arranged on the reference rectangle. A frame group having a rectangular outer edge shape is generated by resizing the additional rectangle and setting the coordinates as described above. Further, the width of this frame group matches the width of the reference rectangle, and the height matches the sum of the height of the reference rectangle and the height of the additional rectangle after resizing. Even when two frames are arranged in the horizontal direction to generate a frame group, as shown in FIG. 7B, the CPU 101 first has a reference rectangle having the same shape as one of the two frames, and Set an additional rectangle with the same shape as the other. Next, the CPU 101 multiplies (resizes) the width and height of the additional rectangle by ““ the height of the reference rectangle ”÷“ the height of the additional rectangle ””. As a result, the height of the reference rectangle matches the height of the additional rectangle after resizing. Thereafter, the CPU 101 sets the coordinates of the additional rectangle. At this time, if the coordinates of the additional rectangle are set as (reference rectangle X coordinate + reference rectangle width, reference rectangle Y coordinate), the additional rectangle is arranged to the right of the reference rectangle. On the other hand, when the coordinates of the additional rectangle are set as (the X coordinate of the reference rectangle−the width of the resized additional rectangle, the Y coordinate of the reference rectangle), the additional rectangle is arranged on the left of the reference rectangle. A frame group having a rectangular outer edge shape is generated by resizing the additional rectangle and setting the coordinates as described above. In addition, the width of the frame group matches the sum of the width of the reference rectangle and the width of the additional rectangle after resizing, and the height matches the height of the reference rectangle.

  In this way, it is possible to generate a rectangular frame group by combining the reference rectangle and the additional rectangle while maintaining the aspect ratio of the reference rectangle and the additional rectangle, except for the calculation error associated with the reduction or enlargement. In the present invention, it is assumed that not only the aspect ratio is completely the same, but also the aspect ratio is maintained even if the aspect ratio is slightly different due to a calculation error or the like.

  Although details will be described later, both or one of the reference rectangle and the additional rectangle may be a frame group configured through the above-described processing in advance. Also in this case, the frame group obtained by the above-described processing is rectangular without generating a gap between the frames.

  When generating a frame group from three or more frames, the following processing is performed. FIG. 8 is a flowchart showing a method for generating a frame group from N frames.

  In this process (step S2003), first, in step S3001, the CPU 101 arranges the first frame as the first reference rectangle. At this time, the origin of the reference rectangle is (0, 0), the width of the reference rectangle = the width of the reference size of the first frame, and the height of the reference rectangle = the height of the reference size of the first frame.

  Next, in step S3002, the CPU 101 initializes a counter value c of the number of used frames and a block number k of a block to be arranged next as a dividing unit. The block here is a block obtained by dividing N frames into a plurality of groups of one or two or more, and is divided into numbers as shown in FIG. 9, for example. In the table shown in FIG. 9, for example, when the total number of frames (N) is 11, 11 frames are composed of one frame, 2 frames, 3 frames. The block is divided into four blocks of five frames. A reference rectangle or an additional rectangle is created from the frames arranged in each block, and these frames are combined to generate a frame group including N frames. Note that the value of block 1 is always 1, which is frame 1 placed first.

  After step S3002, the CPU 101 compares the counter c of the number of used frames with N in step S3003. If c = N, the process ends. This is because all the frames have been arranged. On the other hand, if c ≠ N, the process proceeds to step S3004. This is for arranging frames that have not yet been arranged.

  In step S3004, the CPU 101 switches processing for determining the vertical and horizontal combination directions of the next block according to the value of the block number k of the next block to be arranged. If the block number k is 1, the process proceeds to step S3005. If the block number k is the last one, the process proceeds to step S3006. If the block number k is any other value, the process proceeds to step S3007.

  In step S3005, the CPU 101 determines that the horizontal combination is performed when the vertical combination is performed when the previous process (layout calculation) is performed, and the horizontal process is performed when the previous process (layout calculation) is performed. If it has been coupled, it is determined to perform longitudinal coupling.

  In step S3006, the CPU 101 compares the aspect ratio (height / width) of the reference rectangle with the aspect ratio of the paper layout area. Then, when the aspect ratio of the reference rectangle is larger than the aspect ratio of the paper layout area, it is determined that vertical combination is performed. When the aspect ratio of the reference rectangle is equal to or less than the aspect ratio of the paper layout area, horizontal combination is performed. decide.

In step S3007, the CPU 101 determines to perform horizontal coupling if the previous block coupling is vertical coupling, and determines to perform vertical coupling if the previous block coupling is horizontal coupling.
In this way, the CPU 101 determines the vertical and horizontal coupling directions.

  After steps S3005 to S3007, the CPU 101 randomly determines the coupling direction in step S3008. That is, in the case of vertical coupling, the upper or lower coupling direction is determined randomly, and in the case of horizontal coupling, the right or lower coupling direction is determined randomly. This determination can be made using, for example, a random number.

  Next, in step S3009, the CPU 101 obtains the number of frames n used with the block number k. The value of the frame number n may be acquired from, for example, the table shown in FIG. 9 or may be obtained by calculation.

  Thereafter, in step S3010, the CPU 101 combines all n frames as a rectangle generation unit to create a rectangle that becomes an additional rectangle. Creation of the rectangle of block number k can be defined as shown in FIG. 10, for example. That is, the calculation of the arrangement of each rectangular frame by two frames can be performed based on the example shown in FIG. 7, as shown in FIG. Further, the calculation of the arrangement of each rectangular frame by the three frames is performed as shown in FIG. 10B, after the calculation of FIG. 7A or FIG. It can be calculated by combining one frame to the rectangle made by. Similarly, the calculation of the arrangement of four frames can be calculated by (3 frames + 1 frame) or (2 frames + 2 frames) as shown in FIG. Furthermore, the calculation of the arrangement of 5 frames can be calculated by (3 frames + 2 frames) as shown in FIG. 10 (d), and the calculation of the arrangement of 6 frames can be calculated as +3 frames). In this way, a rectangle can be created using all frames. That is, a rectangle is generated for each block.

  When the number of frames includes a plurality of patterns, the CPU 101 randomly selects one arrangement pattern from the plurality of arrangement patterns. This selection can be performed using a random number, for example.

  After step S3010, in step S3011, the CPU 101 joins the created rectangle as an additional rectangle to the reference rectangle. This coupling is performed by the method shown in FIG.

  Next, in step S3012, the CPU 101 sets the rectangle obtained by the combination in step S3011 as a new reference rectangle, updates the number of used frames c and the block number k to be combined next, and returns to the determination in step S3003.

  By performing the above processing for all the frames, the CPU 101 adds the rectangle of the other block to the rectangle of the basic block as the determining means, and is the same as the large rectangle in which N frames are joined without a gap. Generate a shape frame group.

  Here, specifically, a case where the total frame number N is 11 will be described as an example, and the frame group generation method according to the flowchart shown in FIG. 8 will be further described. FIG. 11 is a diagram illustrating a frame group generation method when the total frame number N is 11. As shown in FIG. 9, when the total number of frames is 11, these are divided into four blocks of one frame, two frames, three frames, and five frames.

  First, in step A, CPU 101 arranges frame 1 with coordinates (0, 0), width = reference width of frame 1, and height = reference height of frame 1, and sets it as a reference rectangle.

  Next, in step B, the CPU 101 determines the coupling direction of the blocks 2. The vertical / horizontal coupling direction of block 2 is opposite to the vertical / horizontal coupling direction at the time of the previous layout calculation, and assuming that the previous time was horizontal coupling, the vertical coupling is performed this time. Here, it is assumed that the upper bond or the lower bond is a lower bond due to a random result.

  Thereafter, the CPU 101 creates a rectangle of block 2 in step C. Since the connection direction of the blocks 2 is vertical connection, as shown in FIG. The rectangle of the block 2 is obtained by performing the calculation of FIG. 7B with the frame 2 as the reference rectangle and the frame 3 as the additional rectangle. As a result, the width and height of the rectangle of the block 2 and the arrangement of the frames 2 and 3 are calculated.

  Subsequently, in step D, the CPU 101 sets the block 2 as an additional rectangle, and performs a lower combination with the reference rectangle including the frame 1 (step S3011). At this time, the calculation shown in FIG. As a result, a rectangle composed of frame 1, frame 2, and frame 3 is created and used as a new reference rectangle.

  Next, in step E, the CPU 101 determines the coupling direction of the blocks 3. Since the connecting direction of the blocks 2 is the vertical direction, the connecting direction of the blocks 3 is the horizontal direction. Here, it is assumed that the left or right coupling direction is right by random.

  Thereafter, in step F, the CPU 101 creates a rectangle from the three frames of the frame 4, the frame 5, and the frame 6 in the block 3. Here, it is assumed that the pattern 3-2 is randomly selected from the three-frame connection pattern shown in FIG. 10B as the three-frame connection pattern. In the pattern 3-2, the frame 4 is first combined as a reference rectangle and the frame 5 is an additional rectangle. Then, the rectangle obtained by the lower combination is further combined as a reference rectangle and the frame 6 as an additional rectangle. In this way, the rectangle of block 3 is created.

  Subsequently, in step G, the CPU 101 right-joins the reference rectangle created in step D with the rectangle of the block 3 created in step F as an additional rectangle, and sets the resulting rectangle as a new reference rectangle.

  Next, since the next block is the last block in step H, the CPU 101 determines the aspect ratio (height / width) of the rectangle created in step G and the aspect ratio (height / width) of the paper layout area. The vertical and horizontal coupling directions are determined by comparison. In FIG. 11, the paper layout area is indicated by a dotted line. However, since the aspect ratio of the paper layout area is larger than the aspect ratio of the reference rectangle, the last block 4 is horizontally coupled. Here, it is assumed that the left or right coupling direction is randomly left coupling.

  Thereafter, in step I, the CPU 101 creates a rectangle from the five frames of the frame 7, the frame 8, the frame 9, the frame 10, and the frame 11. Since the block 4 is a horizontal connection, the pattern 5-2 shown in FIG. 10E is selected. In the pattern 5-2, first, the frame 8 is laterally coupled as a reference rectangle and the frame 9 is an additional rectangle. Then, the rectangles obtained by the horizontal connection are vertically combined with the additional rectangle and the frame 7 as the reference rectangle. Further, a rectangle is created by horizontal coupling with the frame 10 as a reference rectangle and the frame 11 as an additional rectangle, and the rectangle obtained by the horizontal coupling is vertically coupled to the rectangles of the frames 7, 8, and 9 as additional rectangles. Thus, a rectangle consisting of 5 frames is completed.

Subsequently, in step J, the CPU 101 left-joins the rectangle created in step G as a reference rectangle and the rectangle created in step I as an additional rectangle. Thus, the creation of a rectangular frame group consisting of 11 frames is completed. It should be noted that information regarding the block division and the frame arrangement / size for each m block and the frame arrangement / size at the time of combining blocks are sequentially stored in the memory 103.
In step S2003, such processing is performed.

  According to the first embodiment, even when a plurality of images selected by the user are the same, the layout and size of each image are different each time processing is performed. Therefore, when a plurality of images are observed as one printed matter, there is a change, and a pleasant printed matter can be obtained. Further, in this printed matter, no blank portion is generated other than the upper and lower or left and right margin portions, and generation of useless areas can be suppressed. Further, when there is no intention of the user, it is not necessary to delete a part of the image before processing, and the entire image to be printed by the user can be printed.

  In this way, a layout in which a plurality of images are arranged so as to be rectangular adjacent to each other while the aspect ratio of each image is substantially retained is calculated by the CPU 101 or the like as a calculation unit. The Further, the calculated layout is stored in the memory 103 or the like which is a storage unit. In addition, the layout rectangle stored in the storage unit and the plurality of further images are kept adjacent to each other while maintaining the aspect ratio of the layout rectangle stored in the storage unit by the CPU 101 as the second calculation unit. A layout is calculated when arranged in a rectangular shape. Then, the layout calculated by the second calculation means is stored in the storage means by the CPU 101 as the storage control means. In addition, a plurality of images are laid out based on the layout stored in the storage unit by the CPU 101 as the image processing unit.

(Second Embodiment)
Next, processing in the second embodiment will be described. In the first embodiment, the arrangement of frames is determined irregularly, and thus may not necessarily match the user's preference. On the other hand, it takes too much time to cover all cases in order to obtain the most desirable arrangement desired by the user. Therefore, in the second embodiment, after placing the frames, some checks are performed to generalize cases that are undesirable for the user, and the evaluation is performed by quantifying the results. FIG. 12 is a flowchart illustrating an overview of the process of step S1006 in the second embodiment. In the second embodiment, the image selected in the preprocessing undergoes layout evaluation, and the arrangement of the frame group having the layout with the highest evaluation is determined.

  First, the CPU 101 performs the process of step S2001 in the same manner as in the first embodiment.

Next, in step S1201, the CPU 101 sets the number of trials to 1 in order to count the number of times layout (frame group creation) has been performed.
Thereafter, the CPU 101 performs the processes of steps S2002 to S2004 in the same manner as in the first embodiment.

  Subsequently, in step S1202, the CPU 101 evaluates the layout of the rectangular frame group created in step S2003. Details of this processing will be described later.

  Next, in step S1203, the CPU 101 determines whether the evaluation result in step S1202 is OK or NG. If it is OK, the process ends. On the other hand, if it is NG, it proceeds to step S1204 as re-determining the frame arrangement. In step S1204, the CPU 101 determines whether the number of trials has reached the maximum number of trials. If the maximum number of trials has been reached, the process proceeds to step S1205; otherwise, the process proceeds to step S1206.

  In step S1205, the CPU 101 does not create a new layout any more, restores the layout with the highest evaluation from the layout evaluation performed in step S1202 from the backup, and ends the process. On the other hand, in step S1206, the CPU 101 increases the number of trials.

  After step S1206, when generating the next layout in step S1207, the CPU 101 sets the arrangement at the first block number in the vertical and horizontal directions opposite to the current layout generation in step S3004. Then, the process returns to step S2002, and the frame order is shuffled.

  As a result of such processing, each time a layout is generated, the frame order shuffle and the direction of block arrangement are switched, the variation in frame arrangement increases, and various layouts are generated.

  Next, the process of step S1202 (check for layout evaluation) will be described. In this embodiment, a cross check, an image size difference check, a minimum image check, and a margin check are performed and evaluated. The contents of each check will be explained individually.

<Cross check>
The cross check is a check in which an error occurs when the point where the frames are connected is close to a cross. That is, the corners of four images are concentrated at one point. For example, as shown in FIG. 13, an error occurs when the lower right point of the frame 1401 and the upper left point of the frame 1403 are included within a predetermined distance. That is, a circle 1402 having a predetermined radius around the lower right point of the frame 1401 is set, and an error occurs when the upper left point of the frame 1403 is included in the circle 1402. When there are many states close to a cross like this, images are regularly arranged as a result, resulting in a layout lacking in interest as a whole. The error score is 10.

<Image size difference check>
The image size difference check is a check that makes an error when the maximum frame area and the minimum frame area of the frames to be arranged are compared and the difference is 20 times or more. That is, the check is based on the difference between the size of the maximum size frame and the minimum size frame. When the image difference is too large, the layout gives a stunning impression as a whole. The error score is 20 when the difference is 20 times or more and less than 40 times, and 40 when the difference is 40 times or more.

<Minimum image size check>
The minimum image size check is an error check when the area of the minimum frame to be arranged is 10,000 or less. This is because it is avoided that the frame becomes so small that the image cannot be discriminated, and there is a lot of hardware that has restrictions on the reduction of the image, and it is difficult to scale the image to a too small image. The error score is 40.

<Margin Check>
The margin check is a check in which an area (ratio) occupied by the frame layout image in the output sheet is calculated, and when it is 80% or less, an error is determined. This is because an image is printed on the entire output sheet as much as possible. However, since the occupation rate is included in the score calculation described later, it is assumed that there is no error in this check alone.

FIG. 14 is a flowchart showing details of the processing in step S1202.
In step S1202, first, the CPU 101 performs a cross check, an image size difference check, a minimum image check, and a margin check on each frame included in the rectangular frame group in steps S1301 to S1304.

  Next, in step S1305, the CPU 101 determines whether an error has occurred in each check in steps S1301 to S1304. If no error (NG) has occurred, the layout evaluation of the frame group is set to OK in step S1306, and the process in step S1202 ends. On the other hand, if an error has occurred, a score is calculated in step S1307. Here, the score is expressed as “score = image occupancy rate−total error score of each check”. The minimum score is obtained when the image occupancy is 0 and the error score of each check is maximum, and this value is -90.

  After step S1307, in step S1308, the CPU 101 compares the score calculated in step S1307 with the backed up score. If the score calculated in step S1307 is higher than the backup score, the process proceeds to step S1310. Otherwise, the process proceeds to step S1309 without performing anything. The reason why the process proceeds to step S1309 without performing anything is that the evaluation of the layout of the frame group that was backed up is higher than the evaluation of the layout of the frame group that was created this time.

  In step S1310, the CPU 101 creates a backup of the layout created this time. Specifically, the CPU 101 stores the arrangement information of each frame included in the frame group in the memory 103.

  Next, in step S1311, the CPU 101 updates the backup score to the current score. As a result of this operation, the layout of the frame group having the highest evaluation is always stored as a backup in the case of NG in the check.

  In step S1309 after step S1308 or step S1311, the CPU 101 sets the layout evaluation to NG and ends the process of step S1202. Note that if the initial value of the backup score is set to −90, a score lower than that cannot be obtained. Therefore, if NG occurs even once, the backup score and layout are generated.

  According to such a second embodiment, when an error occurs in each check, the frame is arranged by changing the condition up to a predetermined number of times, and the layout with the highest score is adopted. You can print with a layout close to your liking.

  In addition, since an upper limit is set for the number of repetitions (step S1204), it is possible to reduce the time to wait for the user compared to the case where all patterns are covered.

  Each check described above may be disabled or the error score may be changed according to the number of selected images and the size of the printing paper. For example, since the cross check becomes less noticeable as the number of images increases, it may be disabled when there are more than eight selected images. In addition, when the paper size is increased, there is no problem even if the image size difference is slightly increased. Therefore, the error score may be reduced by 10 for a print layout of 2L or more. If such a setting is performed, it becomes possible to perform finer and more accurate control for each check.

(Third embodiment)
Next, processing in the third embodiment will be described. In the third embodiment, it is possible to obtain printing in which the main image in FIG. 1 is arranged in a large frame. Since the basic operation is the same as in the second embodiment, description of the same processing is omitted.

  Hereinafter, the third embodiment will be described with reference to FIG. In the third embodiment, the process of FIG. 15 is executed between S2003 and S2004 of FIG. 12 so that the main image is arranged in a large frame.

  First, in S1501, in order to determine whether or not the frame corresponding to the main image is largely arranged in the rectangle generated in S2003, it is determined whether or not the main image is arranged in the largest frame. If the frame corresponding to the main image is the largest, the process proceeds to S2004 as it is. Otherwise, the process proceeds to S1502, and it is determined whether the aspect ratio of the largest frame (or the aspect ratio of the image corresponding to the frame) is the same as the aspect ratio of the main image (or the aspect ratio of the main image). To do. If they are the same, the process proceeds to S1503, and the image arranged in the largest frame is replaced with the main image. That is, the main image is arranged in the largest frame, and the image arranged in the largest frame is arranged in the frame where the main image is arranged. Since the aspect ratio is the same, no margin is generated or the image is not cut even if the aspect ratio is changed. If it is determined in step S1603 that they are not the same, the process returns to step S2002, the frame order is shuffled, and the rectangle generation process is performed again.

  By performing the processing of FIG. 15, the main image can be arranged in the largest frame.

  Further, in FIG. 15, it is determined whether the frame is arranged in the largest frame. However, in the case where the frame is arranged in the first to third largest frames, the process may directly proceed to S2004. However, even in this case, if the aspect ratio of the largest frame and the aspect ratio of the main image are the same, it may be replaced.

  The main image may be configured so that the user can select it in advance with the operation unit 105, or may be automatically determined from favorite information or importance information to which an image is added.

  In the present embodiment, the process as shown in FIG. 15 is performed between S2003 and S2004, but may be performed during the process of S2003. For example, the processing shown in FIG. 15 may be performed after the blocks are combined. By performing the process at the time of block combination, if the process is to be redone, the redo is determined quickly, so that unnecessary processing is not required.

  As described above, according to the third embodiment, a layout in which a plurality of images designated by the user are arranged without gaps other than the top and bottom or left and right margins with respect to the paper layout, and a specific main image is arranged larger. Is created.

  Although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. included. Each processing of the present invention can also be realized by executing software (program) acquired via a network or various computer-readable storage media by a processing device (CPU, processor) such as a personal computer.

100 Image processing apparatus 101 CPU
102 Internal Storage Device 103 Memory 104 Display Control Unit 105 Operation Unit 106 Image Input Unit 107 Image Processing Unit 108 Printing Unit 110 Display 111 Internal Bus

Claims (6)

An image processing apparatus for automatically laying out a plurality of images,
Rectangle generating means for dividing the plurality of images into two or more blocks and generating a rectangle for arranging the frames of the images included in the blocks for each block;
By combining two of the rectangles generated by the rectangle generation unit to generate a new rectangle, a rectangle composed of the plurality of blocks, and the frames of the plurality of images are arranged. Determining means for generating a rectangle and determining the arrangement of the frames of the plurality of images;
An image processing apparatus comprising: a control unit that controls the determination unit so that a specific image is arranged in a large frame having a higher frame size among the frames of the plurality of images . Wherein, in the arrangement of frames of the plurality of images determined by the determination unit, when the specific image is not located in the large frame, the particular aspect ratio which corresponds to the largest frame The image processing apparatus according to claim 1, wherein when the aspect ratios corresponding to the images are the same, the arrangement of the images is changed so that the main image is arranged in the largest frame.   When the aspect ratio corresponding to the largest frame and the aspect ratio corresponding to the specific image are not the same, the control unit determines the arrangement of the frames of the plurality of images again by the rectangle generation unit and the determination unit. The image processing apparatus according to claim 2, wherein:   4. An image generating means for generating an image in which the plurality of images are arranged in one rectangle based on the frame arrangement of the plurality of images determined by the determining means. The image processing apparatus according to any one of the above. An image processing method for automatically laying out a plurality of images selected by a user by an image processing apparatus,
A rectangle generation step of dividing the plurality of images into a plurality of blocks each having one or more, and generating a rectangle for arranging the frames of the images included in the blocks for each of the blocks;
By combining two of the rectangles generated for each block to generate a new rectangle, all the frames of the plurality of images, which are rectangles composed of the plurality of blocks, are arranged. A determination step of generating a rectangle and determining an arrangement of the frames of the plurality of images;
Based on the arrangement of the frames of the plurality of images determined in the determination step, and an image generation step of generating an image of arranging the plurality of images in a single rectangular,
The determination includes determining the arrangement of the frames of the plurality of images so that the specific image is arranged in a large frame having a higher frame size among the frames of the plurality of images. Method. Calculating means for calculating a layout in a case where a plurality of images are arranged so as to be rectangular by adjoining the plurality of images while substantially maintaining the aspect ratio of each image;
Storage means for storing the layout calculated by the calculation means;
A layout in which the layout rectangle stored in the storage unit and a plurality of further images are arranged so that the rectangle of the layout and the plurality of images are adjacently formed into a rectangle while substantially maintaining the respective aspect ratios. A second calculating means for calculating
Storage control means for storing in the storage means the layout calculated by the second calculation means;
Image processing means for laying out a plurality of images based on the layout stored in the storage means;
An image processing apparatus, comprising: a changing unit that changes a layout so that a specific image becomes the largest with respect to the layout calculated by the second calculating unit.

Images