JP2009232375A - Image processing method and program therefor, and image processing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To place much bigger faces or much more faces, within such a range that the faces are not hidden, inside an image placement enabled area when creating placement image data obtained by placing a plurality of images inside the image placement enabled area wherein images can be placed. <P>SOLUTION: For each image, a full-face inclusive area including all the face area is created and its aspect ratio is calculated (S100-S120). On the basis of a predetermined condition including the calculated aspect ratio of the full-face inclusive area for each image, a placement order to place images in a medium corresponding area S is set (S140). In accordance with the set placement order, an image size is adjusted for each image while maintaining the aspect ratio of the full-face inclusive area and the image is temporarily placed in the medium corresponding area. At the same time, the temporarily placed images are trimmed for a portion other than the medium corresponding area S and in a direction where the full-face inclusive area placed before is located, to place the images in order (S170-S210). <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing method, a program thereof, and an image processing apparatus.

Conventionally, as this kind of image processing method, as long as the face area of the image already arranged in the base image and the image to be arranged do not overlap, the center of gravity of the face area of the already arranged image and the image to be arranged are arranged. There has been proposed a technique in which a target image is arranged in a base image so that a distance from the center of gravity of a face region is minimized (see, for example, Patent Document 1).
Japanese Patent Laid-Open No. 2007-21878

  In the image processing method described above, a plurality of target images can be arranged in the base image in order so that the faces of the people do not overlap, but depending on the plurality of target images, the background occupies most of the person's face. It may become smaller. In such an image processing method, when placing the target image in order on the base image, in addition to placing the face of the person so that it is not hidden, place a larger face or more face with fewer background parts It may be desired to do so.

  The image processing method, the program thereof, and the image processing apparatus according to the present invention, when creating layout image data in which a plurality of images are arranged in an image arrangement possible area where images can be arranged, The main purpose is to enable the placement of more faces in the image placement possible area.

  The image processing method, the program thereof, and the image processing apparatus of the present invention employ the following means in order to achieve the above-described main object.

The image processing method of the present invention includes:
An image processing method for creating arrangement image data in which a plurality of images are arranged in an image arrangement possible area where images can be arranged by computer software,
(A) detecting one or more face regions for each of the plurality of images;
(B) For each of the plurality of images, create an entire face inclusion region including all the detected face regions;
(C) For each of the plurality of images, calculate the aspect ratio of the created entire face inclusion region,
(D) Based on a predetermined condition including an aspect ratio of the entire face inclusion area of each of the calculated plurality of images, an arrangement order that is an order of arranging the plurality of images in the image arrangement possible area is set.
(E) Based on the set arrangement order, for each of the plurality of images, maintaining the aspect ratio of the calculated all face inclusion area, trimming of a part other than the image arrangement possible area, and the all face inclusion Trimming to prevent hiding the pre-arranged all-face inclusion area, which is the entire face-containing area of the image arranged outside the area first, and sequentially arranging in the image arrangement possible area Create layout image data,
This is the gist.

  In the image processing method of the present invention, for each of a plurality of images, the aspect ratio of the entire face inclusion area created by detecting one or more face areas and creating an all face inclusion area including all the detected face areas is determined. Calculate. Then, based on a predetermined condition including the aspect ratio of the entire face inclusion area of each of the plurality of calculated images, an arrangement order that is an order in which the plurality of images are arranged in an image arrangement possible area is set. Based on the set arrangement order, for each of a plurality of images, the aspect ratio of the calculated entire face inclusion area is maintained, the portion other than the image arrangement possible area is trimmed, and the outside of the whole face inclusion area is arranged first. The arrangement image data is created by arranging in order in the image arrangement possible area together with trimming to prevent the pre-arrangement all face inclusion area which is the whole face inclusion area of the image being displayed. Thereby, a plurality of images can be arranged in the image arrangement possible region so that the face is not cut or hidden. In addition, by such trimming, the background portion can be reduced, and a larger face or a larger number of faces can be arranged in the image arrangement possible area.

  In such an image processing method of the present invention, the step (e) is a step in which each of the plurality of images is trimmed at a boundary on the near side of the pre-arranged all face including area as viewed from the all face including area. It can also be. By so doing, it is possible to avoid placing the images across the pre-placed all face inclusion area when placing each image.

  Further, in the image processing method of the present invention, the step (e) is a step in which each of the plurality of images is not trimmed in a direction in which there is no pre-arranged all-face inclusion area when viewed from the all-face inclusion area. It can also be. By doing this, the background in the direction in which there is no pre-arranged all face inclusion area remains, so that the margin in the image arrangement possible area (the place where no image is arranged) can be filled more.

  Further, in the image processing method according to the present invention, the step (e) is a step of adjusting the size of the image with holding the aspect ratio of the calculated total face inclusion area for each of the plurality of images. It can also be. In this way, it is possible to arrange the image in the image arrangement possible area by adjusting the size of the entire face inclusion area (face size). In this aspect of the image processing method of the present invention, before the step (e), the image arrangement possible region is divided by a plurality of lines in a predetermined direction and a plurality of lines in an orthogonal direction orthogonal to the predetermined direction. Step (f) for creating a unit region, wherein step (b) is a step for creating the rectangular all-face inclusion region, and step (e) is for each of the plurality of images. It is a step of adjusting the size of the image so that two parallel sides of the boundary line surrounding the entire face inclusion region coincide with two lines in the predetermined direction and / or the orthogonal direction. You can also. In this way, the size of the entire face inclusion area can be adjusted more easily. In this case, in the step (e), for each of the plurality of images, two parallel sides of the boundary lines surrounding the entire face inclusion region coincide with two lines in the predetermined direction and / or the orthogonal direction. It is also possible to adjust the size of the image so that the size of the image is maximized within the range. In this way, a larger face can be arranged in the image arrangement possible area.

  Alternatively, in the image processing method of the present invention, in the step (d), as the predetermined condition, in addition to the aspect ratio of each total face inclusion area of the calculated plurality of images, each all face inclusion area It is also possible to set the arrangement order based on at least one of the number of face areas included in the face area and the size of the face area included in each of all face inclusion areas. In this way, the arrangement order can be set more appropriately.

  In addition, in the image processing method of the present invention, the image arrangement possible area may be a donut-shaped area.

  The program of the present invention is for causing one or more computers to implement each step of the image processing method of the present invention of any of the above-described aspects. This program may be recorded on a computer-readable recording medium (for example, hard disk, ROM, FD, CD, DVD, etc.), or from a computer via a transmission medium (communication network such as the Internet or LAN). It may be distributed to another computer or may be exchanged in any other form. If this program is executed by a single computer, or if each computer is caused to share and execute each step, each step of the image processing method of the present invention according to any one of the above-described aspects is executed. The same effects as those of the image processing method can be obtained.

The image processing apparatus of the present invention
An image processing apparatus for creating arrangement image data in which a plurality of images are arranged in an image arrangement possible area where images can be arranged,
Face area detecting means for detecting one or more face areas for each of the plurality of images;
For each of the plurality of images, an all-face inclusion area creating unit that creates an all-face inclusion area including all the detected face areas;
For each of the plurality of images, an aspect ratio calculating means for calculating an aspect ratio of the created entire face inclusion area;
Arrangement order setting means for setting an arrangement order that is an order in which the plurality of images are arranged in the image arrangementable area based on a predetermined condition including an aspect ratio of the entire face inclusion area of each of the plurality of calculated images. When,
Based on the set arrangement order, for each of the plurality of images, maintaining the aspect ratio of the calculated all face inclusion area, trimming of a part other than the image arrangement possible area, and outside the all face inclusion area In addition, the arrangement image data is arranged in order in the image arrangement possible area together with trimming so as not to hide the whole face inclusion area which is the whole face inclusion area of the image arranged in advance. A layout image data creating means for creating
It is a summary to provide.

  In the image processing apparatus of the present invention, for each of a plurality of images, the aspect ratio of the whole face inclusion area created by detecting one or more face areas and creating the whole face inclusion area including all the detected face areas is determined. Calculate. Then, based on a predetermined condition including the aspect ratio of the entire face inclusion area of each of the plurality of calculated images, an arrangement order that is an order in which the plurality of images are arranged in an image arrangement possible area is set. Based on the set arrangement order, for each of a plurality of images, the aspect ratio of the calculated entire face inclusion area is maintained, the portion other than the image arrangement possible area is trimmed, and the outside of the whole face inclusion area is arranged first. The arrangement image data is created by arranging in order in the image arrangement possible area together with trimming to prevent the pre-arrangement all face inclusion area which is the whole face inclusion area of the image being displayed. Thereby, a plurality of images can be arranged in the image arrangement possible region so that the face is not cut or hidden. In addition, by such trimming, the background portion can be reduced, and a larger face or a larger number of faces can be arranged in the image arrangement possible area.

  Next, the best mode for carrying out the present invention will be described with reference to the drawings. FIG. 1 is a configuration diagram showing an outline of a configuration of a printer 20 as an embodiment embodying the present invention. The printer 20 includes a controller 21 that controls the entire apparatus, a reader / writer 25 that can mount and remove a memory card 12 that is a portable storage medium in and from a slot 25a, and a donut-shaped disk that is defined by the standard. A printing mechanism 26 for printing on a printing medium such as a label surface, an interface (I / F) 28 capable of inputting / outputting information between connected external devices, and information can be displayed to the user. And an operation panel 30 capable of inputting instructions. The controller 21, reader / writer 25, printing mechanism 26, I / F 28, and operation panel 30 are electrically connected by a bus 29. The controller 21 is configured as a microprocessor centered on the CPU 22, and includes a flash ROM 23 capable of storing and erasing information and storing various processing programs, and a RAM 24 temporarily storing data. Although not shown, the printing mechanism 26 is an ink jet mechanism that applies a pressure to each color ink and discharges the pressurized ink onto a printing medium to execute a printing process. The mechanism for applying pressure to the ink may be due to deformation of the piezoelectric element or due to generation of bubbles due to the heat of the heater. The operation panel 30 is a device for a user to input various instructions to the printer 20, and includes a display unit 32 configured by a color liquid crystal panel on which characters and images corresponding to the various instructions are displayed, An operation unit 34 for performing an operation is provided. The operation unit 34 is provided with a cursor key 34a that is pressed when the user moves a cursor or the like for selecting a process or a character, a determination key 34b that is pressed when determining a process selection, or the like. The memory card 12 is a nonvolatile memory in which data can be written and erased, and stores a plurality of image files photographed by a photographing device such as a digital camera.

  Next, the operation of the printer 20 configured as described above, particularly the operation when printing a plurality of images stored in the memory card 12 on a print medium such as a label surface of a donut-shaped disk (such as a CD) will be described. FIG. 2 is a flowchart illustrating an example of a print processing routine executed by the CPU 22. This routine is stored in the flash ROM 23. Printing on a label surface such as a CD is selected by the user's operation of the cursor key 34a and the enter key 34b, and printing is performed among a plurality of images stored in the memory card 12. This is executed when a plurality of images to be printed on the medium are selected and the grid interval Lg used when arranging the plurality of images in the medium equivalent area S corresponding to the area of the print medium is set. Details of the grid interval Lg will be described later.

  When the print processing routine is executed, the CPU 22 first detects a human face region for each of the plurality of images selected by the user (step S100). In this embodiment, in the embodiment, a pixel within a predetermined skin color range is extracted as a skin color pixel from the image, and a predetermined feature (for example, the skin color pixel has a shape corresponding to a face) based on the extracted skin color pixel. The area of the skin color pixel having a predetermined area) is calculated, and an area having a lower luminance value than the skin color pixel area is extracted as an eye area at the center or slightly above the calculated skin color pixel area. In the lower area of both eyes, an area having a luminance value lower than that of the flesh color pixel collection area is extracted as a mouth area, and when the eye or mouth area is extracted, this skin color pixel area is extracted with a rectangular border. It is assumed that it is detected as a face area by surrounding it. FIG. 3 is an explanatory diagram illustrating an example of a display screen 40 displayed on the display unit 32 when a face area is detected for each image. In FIG. jpg-008. jpg indicates a file name, and an area surrounded by a dotted line indicates a face area. Hereinafter, a case where these eight images (file names 001.jpg to 008.jpg (hereinafter, the extension is omitted)) will be described. Note that the position and shape of the face area of each image detected in this process are stored in a predetermined area of the RAM 24.

  When the face area of each image is detected in this way, a rectangular all face inclusion area including all face areas is created for each image (step S110). In this embodiment, in this embodiment, for each image, when there is one face area, the face area is set as an all face inclusion area, and when there are two or more face areas, the area is the smallest in a range including all the face areas. A rectangular all face inclusion region is set. FIG. 4 is an explanatory diagram illustrating an example of the display screen 42 displayed on the display unit 32 when the entire face inclusion region is created for each image. It should be noted that the position and shape of the entire face inclusion area of each image created by this processing are stored in a predetermined area of the RAM 24.

  Subsequently, for each image, the aspect ratio is calculated by dividing the long side of the created rectangular all face inclusion area by the short side of the area (step S120), and the face orientation (up, down, left, and right) of each image If necessary, the image is rotated by a predetermined angle (for example, 90 degrees) (step S130). Here, the calculation of the aspect ratio is performed up to the first decimal place in the embodiment. It should be noted that the aspect ratio of the entire face inclusion area of each image calculated in the process of step S120 and the rotation information set in the process of step 130 are stored in a predetermined area of the RAM 24.

  Next, an arrangement order is set, which is the order in which the images are arranged in the medium equivalent area S according to the condition including the aspect ratio of the entire face inclusion area of each image (step S140). In this embodiment, in this embodiment, the arrangement order is set in descending order of the aspect ratio of all face inclusion areas, and there are many face areas for images having the same aspect ratio (up to the first decimal place) of all face inclusion areas. Set the arrangement order in order, and for images with the same aspect ratio and the number of face areas of all face inclusion areas, set the arrangement order in descending order of the number of faces (hereinafter referred to as different faces) that are different from the top of the arrangement order. The arrangement order of images having the same aspect ratio, the number of face regions, and the number of different faces is set in descending order of the size of the largest face region. In this case, the arrangement order for the eight images in FIG. 4 is the order of the file names 004, 001, 002, 007, 006, 008, 005, 003. Note that the set arrangement order is stored in a predetermined area of the RAM 24.

  Then, the medium equivalent area S is divided into a plurality of unit areas using a grid in a predetermined direction and a grid in an orthogonal direction orthogonal to the predetermined direction using the grid interval Lg set by the user (step S150). For each divided unit area, it is determined whether or not all face inclusion areas of each image may be arranged (step S160). In this determination processing, when the area of each unit region of the medium equivalent region S is equal to or larger than a predetermined ratio (for example, 0.75, 0.8, 1.0, etc.) with respect to the area (Lg × Lg). It is determined that the entire face part can be arranged, and when the area is less than a predetermined ratio with respect to the area (Lg × Lg), the whole face part can be arranged. Here, when the area of the unit area is less than a predetermined ratio with respect to the area (Lg × Lg), the face included in the image arranged in the medium-equivalent area S is determined not to be an all-face-part-placeable area. This is to avoid cutting. An example of the all-face-part-placeable area in the medium-equivalent area S is shown in FIG. In the figure, the solid line indicates the medium-equivalent area S, the alternate long and short dash line indicates the grid, and the hatched area indicates the area where the entire face portion can be arranged. It should be noted that the set all-face-part-placeable area is stored in a predetermined area of the RAM 24.

  Next, an image to be arranged is selected from a plurality of images based on the arrangement order (step S170), and the size of the selected image is adjusted while maintaining the aspect ratio of the entire face inclusion area (image). Temporarily arrange in the medium equivalent area S (step S180). Here, in the embodiment, for the size of the image, in the selected image, the shorter two sides of the boundary line surrounding the entire face inclusion region while maintaining the aspect ratio of the entire face inclusion region (hereinafter, two sides on the short side side) Is adjusted so that the size (image size) of the entire face inclusion area is maximized in a range that coincides with two grids parallel to the two short sides (hereinafter referred to as short side parallel grids). It was. Thereby, the size of the image can be adjusted more easily, and the size of the face can be increased as much as possible. In addition, the temporary arrangement of the image is such that the entire face inclusion area of the image whose size has been adjusted does not overlap the pre-arrangement all face inclusion area which is the whole face inclusion area of the image that has been arranged first, and the entire face inclusion area does not overlap. The short side two sides and the short side parallel grid are arranged so as to coincide with each other as long as the face part can be arranged. At this time, two long sides of the boundary line surrounding the entire face inclusion region (hereinafter referred to as the long side 2 sides) and two grids parallel to the long side 2 sides (hereinafter referred to as the long side parallel grid). ) Is not centered using a long parallel grid. FIG. 6 shows a state when the first image (file name 004) is arranged in the arrangementable area in this way. In FIG. 6, “Im1” indicates the first image. In the following description, the first to eighth images are referred to as Im1 to Im8.

  Of the temporarily arranged image, a part other than the medium-equivalent area S and an entire face inclusion area (hereinafter referred to as a pre-arranged all face inclusion area) of the image arranged first when viewed from the entire face inclusion area are included. Trimming in a certain direction is performed to arrange the image and update the arrangement image data (step S190). Here, for trimming according to the pre-arranged all-face inclusion area, trimming is performed at the boundary on the near side of the pre-arranged all-face inclusion area in the direction where the pre-arrangement all-face inclusion area is seen from the all-face inclusion area. Trimming is not performed in a direction where there is no pre-arranged all face inclusion area as seen from the face inclusion area. The former is to prevent the pre-arranged all-face inclusion area from being hidden and to prevent the image to be arranged from being arranged across the pre-arranged all-face inclusion area, and the latter is the background when the image is arranged. This is because the margin in the medium equivalent area S (the part where no image is arranged) is filled as much as possible. By the processing in step S190, in FIG. 6, the inner portion of the inner periphery and the outer portion of the outer periphery of the donut-shaped medium-corresponding region S are trimmed for the first image Im1. At this time, the margin in the medium equivalent area S can be made smaller by not trimming the part in the medium equivalent area S. FIG. 7 shows a state where the third image Im3 (file name 002) is trimmed and arranged in the medium equivalent area S. FIG. 7 shows that the second image Im2 (file name 001) is trimmed in a portion other than the medium equivalent region S and arranged in the medium equivalent region S, and the third image Im3 is a portion other than the medium equivalent region S. And the trimming is performed in the vertical direction as viewed from the entire face inclusion area and arranged in the medium equivalent area S so as not to hide the entire face inclusion area. By arranging the images in this way, the images can be arranged in the medium equivalent area S so that the face is not cut or hidden. In addition, since each image is arranged in the medium equivalent region S while trimming the portion other than the entire face inclusion region S, the background portion can be reduced, and the medium equivalent region S of a larger face or more faces can be reduced. Can be allowed to be arranged. Note that the arrangement image data updated every time an image is arranged in the medium equivalent area S is stored in a predetermined area of the RAM 24.

  Next, the entire face inclusion area of the currently arranged image is removed from the current all face part arrangeable area to reset the all face part arrangeable area (step S200), and whether there is another image to be arranged or not. If it is determined (step S210) and there are other images, the process returns to step S170, and the processes of steps S170 to S210 are repeatedly executed to sequentially arrange the images. When there is no other image to be arranged, that is, when arrangement of all the images is completed (step S210), print processing is executed using arrangement image data in which a plurality of images are arranged in the medium equivalent area S ( Step S220), this routine is finished. FIG. 8 shows a state where the eight images of FIG. 4 are arranged in the medium equivalent area S. In the printing process, the CPU 22 expands the arrangement image data into a bitmap image in the print buffer of the RAM 24, and prints the expanded expansion data on a print medium (such as a label surface of a donut-shaped disk (CD or the like)). The printing mechanism 26 is controlled. For example, the CPU 22 drives the drive motor to rotate the supply roller and the like to convey the print medium to the printable area on the platen, drives the carriage motor to move the carriage in the carriage movement direction, and ink as a colorant. Is discharged to the print medium based on the development data.

  Here, the correspondence between the components of the present embodiment and the components of the present invention will be clarified. The process in step S100 of the print processing routine executed in the present embodiment corresponds to the process in step (a) of the present invention, the process in step S110 corresponds to the process in step (b), and the process in step S120 is performed in step ( The process of step S140 corresponds to the process of step (d), and the processes of steps S170 to S210 correspond to the process of step (e). Further, the process of step S150 corresponds to the process of step (f). Further, the controller 21 corresponds to a face area detection unit, an all-face inclusion area creation unit, an aspect ratio calculation unit, an arrangement order setting unit, and an arrangement image data creation unit.

  According to the printer 20 of the present embodiment described in detail above, for each image, the entire face inclusion region including all the face regions is created, the aspect ratio is calculated, and the aspect ratio of the calculated all face inclusion region of each image is calculated. An arrangement order for arranging the images in the medium-equivalent area S is set based on a predetermined condition including, and the image size is adjusted while maintaining the aspect ratio of the entire face inclusion area for each image according to the set arrangement order. The image is temporarily arranged in the medium equivalent area S and the images are arranged in order by trimming the part of the temporarily arranged image other than the medium equivalent area S and the direction including the pre-arranged all face inclusion area, so that the face is cut or hidden. A plurality of images can be arranged in the medium-equivalent area S so as not to occur, and the background portion can be reduced so that a larger face and more faces can be arranged in the medium-equivalent area S. it can

  Further, according to the printer 20 of the present embodiment, when each image is arranged in the medium equivalent area S, the trimming is performed at the boundary on the near side of the pre-arranged all face including area in a certain direction. Therefore, it is possible to prevent the pre-arranged all face inclusion area from being hidden and to prevent the image to be arranged from being arranged across the pre-arranged all face inclusion area. In addition, when each image is arranged in the medium equivalent area S, since the trimming is not performed in the direction where there is no pre-arranged all face inclusion area when viewed from the entire face inclusion area S, the background can be left, and the medium equivalent area S can be left. The inner margin can be filled more.

  It should be noted that the present invention is not limited to the above-described embodiment, and it goes without saying that the present invention can be implemented in various modes as long as it belongs to the technical scope of the present invention.

  In this embodiment, the aspect ratio is calculated by dividing the long side of the entire face inclusion region by the short side of the region. However, the horizontal length of the entire face inclusion region is the vertical length. The aspect ratio may be calculated by dividing or by dividing the vertical length of the entire face inclusion area by the horizontal length.

  In the present embodiment, the arrangement order of each image in the medium-corresponding region S is set using the aspect ratio of the entire face inclusion region, the number of face regions, the number of different faces, and the size of the maximum face region. However, as long as the arrangement order of the images in the medium-equivalent area S is set using the aspect ratio of the entire face inclusion area, the number of face areas, the number of different faces, and the size of the maximum face area The arrangement order of each image in the medium-equivalent area S may be set without using at least one, or the other image (for example, the average of the face area of each image) is used to correspond to the medium of each image. The arrangement order in the region S may be set. The aspect ratio of the entire face inclusion area is not limited to the one that calculates to the first decimal number, and may be calculated to an integer range or the nth decimal place (n is an integer of 2 or more).

  In this embodiment, when placing each image in the medium-equivalent area S, the two sides on the short side of the boundary line surrounding the entire face inclusion area match the short side parallel grid while maintaining the aspect ratio of the entire face inclusion area. The size of the image is adjusted so that the size of the entire face inclusion region (image size) is maximized in the range (short side matching range), but the aspect ratio of the entire face inclusion region is maintained. For example, a range in which the two long sides of the boundary line surrounding the entire face inclusion region coincide with the long side parallel grid while maintaining the aspect ratio of the entire face inclusion region (long side matching) Range), the size of the image may be adjusted so that the size of the entire face inclusion region becomes the maximum, or the short side coincidence range and the long side coincidence range, but in these ranges, the size of the entire face inclusion region is The aspect ratio of the whole face inclusion area so that it is not the maximum size May be used to adjust the size of the image while retaining may be used to adjust the size of the image while maintaining the aspect ratio of the entire face inclusion area regardless of the short sides coincides range and long sides match range. Further, as long as the aspect ratio is maintained, the image size may not be adjusted (changed).

  In the present embodiment, the medium equivalent area S is divided into a plurality of unit areas by the grid, and each image is arranged in the medium equivalent area S in consideration of the unit areas. However, the medium equivalent area S is divided into a plurality of units. The medium-equivalent area S may be arranged in each image without being divided into areas. In this case, when each image is arranged, the image is provisionally arranged in the medium equivalent area S so that the entire face inclusion area does not overlap the pre-arranged all face inclusion area, and the part other than the medium equivalent area of the temporarily arranged image The image may be arranged in the medium-corresponding area S by performing the above trimming and the trimming for preventing the pre-arranged all face inclusion area from being hidden.

  In the present embodiment, when each image is arranged in the medium-equivalent area S, trimming is performed at the boundary on the near side of the pre-arranged all face including area in a certain direction. Trimming may be performed so as to exclude only the entire face area, or trimming may be performed at the boundary of the entire face inclusion area of the image to be arranged. In addition, when each image is arranged in the medium-equivalent area S, the trimming is not performed in the direction where there is no pre-arranged all face inclusion area when viewed from the all face direction eye area. Trimming may be performed at the boundary of the face inclusion area.

  In the present embodiment, the operation when arranging and printing a plurality of images in the doughnut-shaped medium-equivalent area S has been described. However, the medium-equivalent area S is not limited to the donut shape, and is, for example, a rectangle or a circle. It may be a thing.

  In the present embodiment, it is sufficient to create layout image data in which a plurality of images are arranged in an image layoutable area where images can be arranged. For example, a display unit is used instead of or in addition to the printing process by the printing mechanism 26. It may be displayed on the memory card 32 or stored in the memory card 12.

  In the present embodiment, the face area of a person is detected, but the face area of an animal may be detected.

  In the present embodiment, the printing mechanism 26 is an inkjet mechanism that performs printing by discharging ink onto a printing medium. However, an electrophotographic color laser printer, a thermal transfer color printer, a dot impact, or the like. It may be a color printer of the type, or may be a monochrome printer of these.

  In the above-described embodiment, the printer 20 has been described as the image processing apparatus of the present invention. However, any image processing apparatus may be used as long as it can generate layout image data in which a plurality of images are arranged in an image arrangementable area where images can be arranged. It may be in the form of a method, or may be in the form of a program that executes an image processing method.

FIG. 2 is a configuration diagram showing an outline of the configuration of a printer 20. 6 is a flowchart illustrating an example of a print processing routine. Explanatory drawing which shows an example of the display screen 40 displayed on the display part 32. FIG. FIG. 4 is an explanatory diagram illustrating an example of a display screen 42 displayed on the display unit 32. FIG. 4 is an explanatory diagram illustrating an example of a region where all face parts can be arranged in a medium-equivalent region S. Explanatory drawing which shows a mode when the 1st image is arrange | positioned in the arrangement | positioning possible area | region. Explanatory drawing which shows a mode when the 3rd image is arrange | positioned to the medium equivalent area | region S. FIG. Explanatory drawing which shows a mode when eight images are arrange | positioned in the medium equivalent area | region S. FIG.

Explanation of symbols

  12 memory card, 20 printer, 21 controller, 22 CPU, 23 flash ROM, 24 RAM, 25 reader / writer, 25a slot, 26 printing mechanism, 28 interface (I / F), 29 bus, 30 operation panel, 32 display unit, 34 Operation unit, 34a Cursor key, 34b Enter key, 40, 42 Display screen.

Claims (10)

An image processing method for creating arrangement image data in which a plurality of images are arranged in an image arrangement possible area where images can be arranged by computer software,
(A) detecting one or more face regions for each of the plurality of images;
(B) For each of the plurality of images, create an entire face inclusion region including all the detected face regions;
(C) For each of the plurality of images, calculate the aspect ratio of the created entire face inclusion region,
(D) Based on a predetermined condition including an aspect ratio of the entire face inclusion area of each of the calculated plurality of images, an arrangement order that is an order of arranging the plurality of images in the image arrangement possible area is set.
(E) Based on the set arrangement order, for each of the plurality of images, maintaining the aspect ratio of the calculated all face inclusion area, trimming of a part other than the image arrangement possible area, and the all face inclusion Trimming to prevent hiding the pre-arranged all-face inclusion area, which is the entire face-containing area of the image arranged outside the area first, and sequentially arranging in the image arrangement possible area Create layout image data,
Image processing method.   2. The image processing method according to claim 1, wherein the step (e) is a step of trimming each of the plurality of images at a boundary on the near side of the pre-arranged all face including area as viewed from the all face including area. .   3. The image processing according to claim 1, wherein the step (e) is a step in which trimming is not performed for each of the plurality of images in a direction in which the pre-placed full face inclusion area does not exist when viewed from the full face inclusion area. Method.   The step (e) is a step of adjusting the size of the image for each of the plurality of images while maintaining the aspect ratio of the calculated total face inclusion region. An image processing method according to one claim. The image processing method according to claim 4,
Before the step (e), a step (f) of creating a unit area by dividing the image arrangement possible area by a plurality of lines in a predetermined direction and a plurality of lines in an orthogonal direction orthogonal to the predetermined direction With
The step (b) is a step of creating the rectangular all face inclusion region,
In the step (e), for each of the plurality of images, the two parallel sides of the boundary lines surrounding the entire face inclusion region are matched with the two lines in the predetermined direction and / or the orthogonal direction. A step of adjusting the size of the image,
Image processing method.   In the step (e), for each of the plurality of images, a range in which two parallel sides of the boundary lines surrounding the entire face inclusion region coincide with two lines in the predetermined direction and / or the orthogonal direction. 6. The image processing method according to claim 5, which is a step of adjusting the size of the image so that the size of the image is maximized.   In the step (d), as the predetermined condition, in addition to the aspect ratio of the total face inclusion area of each of the plurality of calculated images, the number of face areas included in each of the total face inclusion areas, The image processing method according to claim 1, wherein the arrangement order is a step of setting the arrangement order based on at least one of the sizes of face areas included in the entire face inclusion area.   The image processing method according to claim 1, wherein the image layoutable area is a donut-shaped area.   A program for causing one or more computers to realize each step of the image processing method according to any one of claims 1 to 8. An image processing apparatus for creating arrangement image data in which a plurality of images are arranged in an image arrangement possible area where images can be arranged,
Face area detecting means for detecting one or more face areas for each of the plurality of images;
For each of the plurality of images, an all-face inclusion area creating unit that creates an all-face inclusion area including all the detected face areas;
For each of the plurality of images, an aspect ratio calculating means for calculating an aspect ratio of the created entire face inclusion area;
Arrangement order setting means for setting an arrangement order that is an order in which the plurality of images are arranged in the image arrangementable area based on a predetermined condition including an aspect ratio of the entire face inclusion area of each of the plurality of calculated images. When,
Based on the set arrangement order, for each of the plurality of images, maintaining the aspect ratio of the calculated all face inclusion area, trimming of a part other than the image arrangement possible area, and outside the all face inclusion area And the arrangement image data arranged in order in the image arrangement possible area together with trimming so as not to hide the pre-arrangement all face inclusion area which is the whole face inclusion area of the image arranged in advance. A layout image data creating means for creating
An image processing apparatus comprising:

Images