JP2008203960A - Image processor, its control method, program, and printer - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce user's operations so as to rearrange decorative images related to a face area. <P>SOLUTION: A control method of an image processor detects a face area in a picture image by face recognition processing (Step S130); and arranges decorative images related to a face at prescribed relative positions with the detected face area as a reference (Step S190). Thereby, by fixing relative positions at which the decorative images related to the face at appropriate positions, since the decorative images related to the face may be arranged at appropriate positions in the face area, the user's operations so as to rearrange the decorative images may be reduced as compared with arranging the decorative images at fixed positions set so that the decorative images are irrelevant to the face area. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image processing apparatus, a control method therefor, a program, and a printing apparatus.

Conventionally, a method of synthesizing a decoration image with image data is known. For example, in the copying apparatus described in Patent Document 1, a decoration image held in a storage medium is synthesized at a position specified by a user in image data of a document, and a new image image is created and printed. In this way, it is possible to easily synthesize an image on a copy document without connecting to other equipment.
JP-A-9-139832

  By the way, when a person's face is included in the image data, it is conceivable to synthesize a decoration image related to the person's face such as a balloon or a tear mark.

  However, the copying apparatus described in Patent Document 1 has a problem in that when a decorative image is combined with image data, the user has to specify the position to be combined each time, which is troublesome for the user.

  The present invention has been made in view of such a problem, and an object of the present invention is to provide an image processing apparatus, a control method thereof, and a control program thereof that can reduce a user's operation of rearranging a decorative image related to a face. One of them. Another object is to provide a printing apparatus provided with such an image processing apparatus.

  The present invention adopts the following means in order to achieve at least one of the above objects.

The image processing apparatus of the present invention
Image display means capable of displaying various images;
Face decoration image storage means for storing a face decoration image which is a decoration image related to the face;
Relative position information storage means for storing relative position information defining a relative position of the face decoration image with respect to the face area;
Face area detecting means for detecting a face area of a predetermined photographic image;
When the face area of the predetermined photographic image is detected by the face area detection means and the predetermined face decoration image is read from the face decoration image storage means, the relative position information of the predetermined face decoration image is obtained as the relative position. Reading from the information storage means, based on the relative position information and the absolute position of the face area of the predetermined photographic image, to determine the display position of the predetermined face decoration image in the predetermined photographic image, Control means for controlling the image display means so that the predetermined face decoration image is displayed;
It is equipped with.

  In this image processing apparatus, when the face area of the predetermined photographic image is detected by the face area detection unit and the predetermined face decoration image is read from the face decoration image storage unit, the relative position information of the predetermined face decoration image is relative. Read from the position information storage means, determine the display position of the predetermined face decoration image in the predetermined photo image based on the relative position information and the absolute position of the face area of the predetermined photo image, and determine the predetermined face decoration at the display position Display an image. Thus, no matter where the face area exists in the photographic image, the position of the face decoration image with respect to the face area is determined based on the predetermined relative position information. If the relative position is set to an appropriate position and this relative position is stored as relative position information in the relative position information storage means, the face decoration image is arranged at an appropriate position with respect to the face area. Therefore, the user's operation of rearranging the face decoration image can be reduced as compared with the case where the face decoration image is arranged at a fixed position determined independently of the face area.

  The image processing apparatus of the present invention comprises a face inclination angle calculating means for calculating an inclination angle of the face area of the predetermined photographic image detected by the face area detecting means with respect to a predetermined direction of the photographic image, and the control means When the face area of the predetermined photographic image is detected by the face area detection means and the predetermined face decoration image is read from the face decoration image storage means, the relative position information of the predetermined face decoration image is obtained as the relative position information. Read from the position information storage means, rotate the predetermined face decoration image based on the inclination angle of the face area of the predetermined photographic image, and to the relative position information and the absolute position of the face area of the predetermined photographic image And determining the display position of the predetermined face decoration image in the predetermined photographic image based on the image table so that the predetermined face decoration image is displayed at the display position. It may be controlled means. By doing so, the user's operation of rotating the face decoration image again according to the inclination angle of the face area of the photographic image can be reduced. Here, the “inclination angle with respect to a predetermined direction” is an inclination angle determined with respect to some reference direction, and may be, for example, an inclination angle with respect to the vertical direction or an inclination angle with respect to the horizontal direction. . Note that the method of rotating the face decoration image may be, for example, a method of rotating the face decoration angle by the same angle as the face inclination angle calculated by the face inclination angle calculation means. It may be a method of rotating by an angle obtained by adding the value of.

  The image processing apparatus of the present invention comprises a face area area calculating means for calculating the size of the face area of the predetermined photographic image, and the control means detects the face area of the predetermined photographic image by the face area detecting means. When the detected face decoration image is read from the face decoration image storage means, the relative position information of the predetermined face decoration image is read from the relative position information storage means, and the face area of the predetermined photographic image is read. A size for displaying the predetermined face decoration image is determined based on the size, and the predetermined image image in the predetermined photographic image is determined based on the relative position information and the absolute position of the face area of the predetermined photographic image. The display position of the face decoration image may be determined, and the image display unit may be controlled so that the predetermined face decoration image is displayed at the display position. In this way, the user's operation of changing the size of the face decoration image according to the size of the face area of the photographic image can be reduced. The method for displaying the predetermined face decoration image based on the size of the face area of the predetermined photo may be, for example, a method of displaying the face decoration image large when the face area is large. When it is small, a method of displaying a face decoration image small may be used.

  The image processing apparatus of the present invention comprises a face area number counting means for counting the number of the face areas detected by the face area detecting means, and the control means is configured to detect the predetermined photographic image by the face area detecting means. After a face area is detected and a predetermined face decoration image is read from the face decoration image storage means, when the number of face areas is counted by two or more by the face area number counting means, the predetermined face decoration image The relative position information is read from the relative position information storage means, and based on the relative position information and the absolute position of the face area determined according to a predetermined rule from two or more face areas of the predetermined photographic image. A display position of the predetermined face decoration image in a predetermined photographic image is determined, and the image display means is configured to display the predetermined face decoration image at the display position. Gosuru may be one. In this way, even when there are a plurality of face areas in the photographic image, one of the face areas is selected, and a face decoration image is attached to the face area. If the face area that the user wishes to attach matches, the user's operation of rearranging the face decoration image can be reduced. Here, the “predetermined rule” is a rule that can select one of the detected face areas, for example, a rule that selects the detected face area with the widest face area. Alternatively, the rule may be to select the detected face area closest to the center position of the photographic image.

  The image processing apparatus of the present invention comprises face area number determination means for determining whether or not the number of the face areas detected by the face area detection means is greater than or equal to a predetermined upper limit value, and the control means comprises: After the face area of the predetermined photographic image is detected by the face area detection means and the predetermined face decoration image is read from the face decoration image storage means, the number of the face areas is previously determined by the face area number determination means. When it is determined that the predetermined upper limit value is exceeded, the display position of the predetermined face decoration image is determined to be a predetermined fixed position, and the image display means is configured to display the predetermined face decoration image at the display position. It may be one that controls. When a number of face areas equal to or greater than a predetermined upper limit value are detected in a photographic image, the probability of matching one face area with the face area intended by the user is reduced, and the effect of the present invention is reduced. This is because it cannot be obtained sufficiently. Here, the “predetermined fixed position” is a predetermined fixed position, and may be, for example, the center of the photographic image or near one of the four corners of the photographic image. Here, the “upper limit value” may be an arbitrary value determined in advance, for example, a value of 3, for example, and there are too many face areas, and one face area is designated as a face decoration image. Even if the face area to be followed automatically is selected, the face area may be a value that reduces the probability that the automatically selected face area matches the face area that the user actually wants to add a face decoration image to.

  A printing apparatus according to the present invention includes any one of the above-described image processing apparatuses and a print execution unit capable of executing printing on a print medium. Since the printing apparatus equipped with the image processing apparatus of the present invention is equipped with the image processing apparatus of the present invention, it can reduce the user's operation of rearranging the face decoration image. A printing apparatus can achieve the same effect.

The control method of the image processing apparatus of the present invention includes:
Image display means capable of displaying various images, face decoration image storage means for storing a face decoration image that is a face decoration image, and relative position for storing relative position information that defines the relative position of the face decoration image with respect to the face area A control method for controlling an image processing apparatus provided with information storage means by computer software,
(A) detecting a face area of a predetermined photographic image;
(B) A predetermined face decoration image to be decorated on the face area detected in the step (a) is read from the face decoration image storage means, and relative position information of the predetermined face decoration image is read from the relative position information storage means, Based on the relative position information and the absolute position of the face area of the predetermined photographic image, a display position of the predetermined face decoration image in the predetermined photographic image is determined, and the predetermined face decoration image is set at the display position. Controlling the image display means so that is displayed;
Is included.

  According to the control method of the image processing apparatus of the present invention, when a face area of a predetermined photographic image is detected by the face area detection unit and a predetermined face decoration image is read from the face decoration image storage unit, the predetermined face decoration image is stored. The relative position information is read from the relative position information storage means, the display position of the predetermined face decoration image in the predetermined photo image is determined based on the relative position information and the absolute position of the face area of the predetermined photo image, and the display position A predetermined face decoration image is displayed on the screen. Thus, no matter where the face area exists in the photographic image, the position of the face decoration image with respect to the face area is determined based on the predetermined relative position information. If the relative position is set to an appropriate position and this relative position is stored as relative position information in the relative position information storage means, the face decoration image is arranged at an appropriate position with respect to the face area. Therefore, the user's operation of rearranging the face decoration image can be reduced as compared with the case where the face decoration image is arranged at a fixed position determined independently of the face area.

  In the control method of the image processing apparatus of the present invention, the control method of the image processing apparatus may include various configurations included in any of the above-described image processing apparatuses, or any of the above-described image processing apparatuses. Steps for realizing the functions may be added.

  The control program of the present invention is a program for causing one or more computers to execute the steps of the control method of the image processing apparatus. This program may be recorded on a computer-readable recording medium (for example, hard disk, ROM, FD, CD, DVD, etc.), or from a computer via a transmission medium (communication network such as the Internet or LAN). It may be distributed to another computer, or may be exchanged in any other form. If this program is executed by a single computer or each step is shared and executed by a plurality of computers, the same effect as the control method described above can be obtained.

  Next, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a perspective view of a photo printer 10 according to an embodiment of the present invention, and FIG. 2 is a block diagram showing an outline of the configuration of the photo printer 10.

  As shown in FIG. 1, the photo printer 10 of this embodiment includes a front door 14 that can open and close the front surface of the printer main body 12, an operation panel 20 provided on the upper surface of the printer main body 12, and an upper surface of the printer main body 12. A cover 30 that is attached to one side of the back so as to be freely opened and closed and covers the operation panel 20 in a closed state, a printing mechanism 40 (see FIG. 2) built in the printer main body 12, and a controller 50 that controls the entire photo printer 10 ( 2). In this embodiment, the printing medium is described as “recording paper”, but it is not intended to specify the material, but includes other materials such as a film other than paper.

  The front door 14 is a lid for opening and closing the front surface of the printer main body 12. As shown in FIG. 1, when the front door 14 is in an open state, the front door 14 is discharged to receive the recording paper S discharged from the front surface of the printer main body 12. In addition to functioning as a tray, various memory card slots 18 provided on the front surface of the printer main body 12 can be used by the user.

  The operation panel 20 includes a display 22 that displays characters, graphics, symbols, and the like, and a button group 24 arranged around the display 22. As shown in FIG. 2, the button group 24 switches the power button 24a for turning on / off the power, the display size of an image or the like displayed on the display 22 to 6-split display, 15-split display, full-screen display, or the like. A display switch button 24b for displaying, a menu button 24c for calling a main menu screen on which a plurality of options relating to the printing function are arranged, and a cancel for canceling the operation or interrupting printing on the recording paper S. A button 24d, a print button 24e for instructing execution of printing on the recording paper S, a save button 24f for saving an edited image or the like in the memory card M inserted in the memory card slot 18, and a plurality of items displayed on the display 22 Up, down, left, and right operated when selecting a desired option or moving the cursor Tan 24g, and it is configured by a the up, down, right and left buttons OK button for being disposed in the center to indicate that it has determined choices selected by the up, down, left, and right buttons 24g of 24g 24h. As shown in FIG. 1, a paper feed port 48 of the printing mechanism 40 is provided in the back of the operation panel 20, and the paper feed port 48 has left and right guide widths that match the width of the recording paper S. A pair of paper guides 49a and 49b that are slid in the direction are provided.

  As shown in FIG. 1, the cover 30 is a resin plate formed in a size that can cover the upper surface of the printer body 12, and includes a window 34 that is the same size as the display 22, and opens and closes the cover support shaft 32. It is attached as possible. Further, when the cover 30 is in the open state, it can be used as a paper feed tray for supplying the recording paper S to the printing mechanism 40. On the other hand, even if the cover 30 is in the closed state, the cover 30 is provided with the window 34, so that the user can check the display content of the display 22 through the window 34.

  The printing mechanism 40 is disposed inside the printer main body 12 and, as shown in FIG. 2, is driven by a carriage belt 41 laid in a loop shape in the left-right direction, and reciprocates left and right along a guide 42. An ink cartridge 44 that supplies ink of each color such as cyan, magenta, yellow, and black to the carriage 43, and pressure is applied to each ink supplied from each ink cartridge 44 to eject the ink from the nozzle toward the recording paper S. The printing head 45 includes a transport roller 46 that feeds the recording paper S supplied from a paper feed port 48 formed on the operation panel 20 to the open front door 14 that is a paper discharge tray. The ink cartridge 44 is attached below the printing mechanism 40 and is a so-called off-carriage type in which the ink cartridge 44 is not mounted on the carriage 43. Here, the print head 45 employs a method in which a voltage is applied to the piezoelectric element to deform the piezoelectric element and pressurize the ink. However, a voltage is applied to a heating resistor (for example, a heater) to heat the ink. A method of pressurizing the ink with the generated bubbles may be employed.

  As shown in FIG. 2, the controller 50 is configured as a microprocessor centered on the CPU 51, and includes a ROM 52 that stores various processing programs, various data, various tables, a RAM 53 that temporarily stores data, An interface 55 (I) that can communicate with the flash memory 54 that is electrically rewritable and retains data even when the power is turned off, and the memory card M, the printing mechanism 40, and the operation panel 20 inserted in the memory card slot 18. / F), and these are connected via the bus 57 so that signals can be exchanged with each other. The ROM 52 stores a decorative image arrangement processing routine, a face recognition processing routine, a face selection processing routine, and the like, which will be described later. The flash memory 54 stores a face decoration image and decoration image information, which will be described later. The controller 50 inputs an image file of the memory card M inserted into the memory card slot 18, and inputs a command signal from the button group 24 of the operation panel 20, a detection signal from each part of the printing mechanism 40, and the like. Further, the controller 50 saves an edited image or the like in the memory card M, and outputs a control signal to each part of the printing mechanism 40 and a control signal to the display 22 of the operation panel.

  Next, the operation of the thus configured photo printer 10 of the present embodiment, particularly the operation of the face decoration image arrangement processing will be described. FIG. 3 is a flowchart illustrating an example of a decorative image arrangement processing routine executed by the CPU 51 of the controller 50. This decoration image arrangement processing routine is stored in the ROM 52 and is repeatedly executed when a photographic image is read by the CPU 51.

  When the decorative image arrangement processing routine of FIG. 3 is started, the CPU 51 first displays a decorative image selection screen (see FIG. 4) that prompts the user to select a decorative image on the display 22 (step S100). Thereby, the user can select a decoration image to be arranged in the photographic image. As shown in FIG. 4, on the decoration image selection screen, a frame mark 81 that surrounds the edge of the photographic image, a banner mark 82 attached to the upper side of the photographic image, a dream mark 83 attached to the outside of the face, A balloon mark 84 attached, a tear mark 85 attached below the eyes, an anger mark 86 attached obliquely above the eyes, a flash mark 87 attached above the head, a glasses mark 88 attached above the eyes, etc. Is displayed as selectable. When the user selects a decoration image to be arranged on the photographic image with the up / down / left / right buttons 24g and presses the OK button 24h, the CPU 51 receives the decoration image information corresponding to the decoration image selected by the user from the flash memory 54 (see FIG. 5). ) Is read (step S110). Here, the decoration image information is a face following flag indicating whether or not the decoration image is a decoration image related to the face (face decoration image), relative coordinates of the face decoration image based on the center coordinates of the face area ( X_S_OFFSET, Y_S_OFFSET), offset size indicating the relative area of the face decoration image relative to the face area, offset rotation angle indicating the relative angle of the face decoration image relative to the vertical direction of the face area, face decoration Information including image width and face decoration image height. When the face following flag is zero, it indicates a decoration image other than the face decoration image (for example, the frame mark 81 or the banner mark 82). When the value is 1, the face decoration image (for example, the balloon mark 84 or the tear mark) is displayed. 85).

  Next, the CPU 51 determines whether or not the face following flag read in step S110 is zero (step S120). When the face following flag is zero, the decoration image selected this time is not a face decoration image, and is thus determined in advance. The decorative image is arranged at the fixed position (in this embodiment, the center position of the photographic image) (step S210), and this routine ends. On the other hand, when the face following flag is 1, the decoration image selected this time is a face decoration image, so an attempt is made to detect a face area using a face recognition processing routine described later (step S130). As a result, only after the decoration image is a face decoration image, the processing from step S130 is performed.

  Here, the face recognition processing routine will be described in detail. FIG. 6 is a flowchart showing an example of a face recognition processing routine. When the face recognition processing routine of FIG. 6 is executed, the CPU 51 tries to detect a face area in the photographic image (step S300). Here, since the method for detecting the face area is a known technique, the detailed detection method is omitted here. For example, pixels having a color close to the color designated as the skin color are extracted from the photograph image as a set of skin color pixels. There is a way to do it. In this method, for example, a skin color range on the color space is defined in advance in a color space for distinguishing the skin color from other colors, and it is determined whether or not the color of each pixel is in the predetermined range. Is done. At this time, the image data is converted into a color space of hue, saturation and luminance, the average luminance of the color image is calculated, and an appropriate range is set in advance for the skin color pixel value for each predetermined range of the calculated average luminance. Thus, the skin color pixel value region within the range may be extracted as a set of skin color pixels. In this way, by dividing the average luminance of the image into a plurality of ranges and setting a range of skin color pixel values for each range, an appropriate range of skin color pixels can be selected depending on whether the entire image is bright or dark. Can be set. As a result, skin color pixels can be detected more accurately. Thereby, a set of skin color pixels can be extracted. At this time, it is possible to extract only the image areas that are gathered in a state where a certain number (for example, 10 pixels, or 1% or more of the total number of pixels) or more skin color pixels are in contact with each other. After extracting the set of skin color pixels, the CPU 51 extracts eyes and mouth from the set of skin color pixels. Here, since the method for extracting the positions of the eyes and mouth is a known technique, the detailed extraction method is omitted here. For example, the luminance value from the detected area of the flesh-colored pixels is larger than that of the flesh-colored pixels. A region having a low luminance value is extracted as a mouth region within the range below the extracted eyes and having a luminance value lower than that of the flesh color pixel collection region. At this time, the image may be extracted by various processes such as a process using a neural network or a process using a shape in an image. The position coordinates in the photographic image are such that the upper left corner of the photographic image is the origin (0, 0), the right direction is the positive X coordinate direction, and the downward direction is the positive Y coordinate direction (see FIG. 7).

  Subsequently, the CPU 51 determines whether or not the face area has been detected as a result of the detection of the face area (step S310). If the face area cannot be detected, it indicates that the face area has failed to be detected. Therefore, the face detection flag is set to zero (step S360), and this routine ends. Note that when the face area could not be detected, for example, when a set of skin color pixels could not be extracted, or after extracting a set of skin color pixels, eyes or mouth could not be extracted. On the other hand, when the CPU 51 can detect the face area in step S310, the CPU 51 sets the face detection flag to a value 1 to indicate that the face area has been successfully detected (step S320). As shown in FIG. A rectangle that touches the face area of the photograph image from the outside is created (step S330), and the coordinates, center coordinates, and area of the four corners of the rectangle are obtained and stored in a predetermined area of the RAM 53 (step S340). Here, for the rectangular coordinates, the vertical direction of the face area is determined from the eyes and mouth positions detected by the face recognition processing routine, and the upper left coordinates of the rectangle corresponding to the upper left position of the face area are defined as (X_F_LT, Y_F_LT). . Similarly, the coordinates of the four corners of the rectangle are determined with the upper right coordinates of the rectangle as (X_F_RT, Y_F_RT), the lower left coordinates of the rectangle as (X_F_LB, Y_F_LB), and the lower right coordinates of the rectangle as (X_F_RB, Y_F_RB). The center coordinates of the rectangle are (X_C, Y_C). In the present embodiment, the rectangular area is regarded as the area of the face region.

  Subsequently, the CPU 51 determines whether or not the processes of step S330 and step S340 have been executed for all the face areas (step S350). Steps S330 and S340 are executed for the face area. On the other hand, when the processes of step S330 and step S340 have been executed for all the face areas, this routine ends. When a plurality of persons are shown in the photographic image, a plurality of face areas are detected when an attempt is made to detect a face area in step S300. Therefore, the processes in steps S330 and S340 are performed for all detected face areas. It is determined whether or not it has been executed. When there are a plurality of face areas, the CPU 51 associates the coordinates, center coordinates, and area of the four corners of the rectangle with each face area and stores them in the RAM 53.

  Returning to the flow of FIG. 3, after completing the face recognition processing routine, the CPU 51 determines whether the face detection flag is zero or value 1 (step S140), and when the face detection flag is zero, that is, the face If the area detection fails, the face decoration image is arranged at a predetermined fixed position (in this embodiment, the center position of the photographic image) (step S210), and this routine is terminated. On the other hand, when the face detection flag is 1, that is, when the face area is successfully detected, the face selection processing routine is subsequently executed (step S150). If the face area detection fails, the face decoration image is placed at a predetermined fixed position, and the user performs an operation of moving the face decoration image to an appropriate position.

  Here, the face selection processing routine will be described in detail. FIG. 8 is a flowchart showing an example of the face selection processing routine. When the face selection processing routine of FIG. 8 is executed, the CPU 51 determines whether or not a plurality of face areas have been detected in the face recognition processing routine (step S130) (step S400), and one face recognition processing routine executes one face recognition processing routine. If it is determined that only the face area has been detected, the face area is set as the face area to be followed (step S410), and the follow target flag is set to indicate that there is a face area that should be followed by the face decoration image. 1 is set (step S420), and this routine is terminated. Here, the face area to be tracked refers to a face area that causes the face decoration image to follow in order to attach the current face decoration image. On the other hand, when it is determined in the face recognition processing routine that a plurality of face areas have been detected, it is determined whether or not the number of face areas is equal to or greater than the upper limit value (step S430). Here, even if the number of face areas is too large and one face area is automatically selected as a face area that should follow the face decoration image, the upper limit value is determined by the user as the automatically selected face area. The value is set such that the probability that the face area to which the face decoration image is to be attached matches is low. In this embodiment, this upper limit value is set to 3. If the number of face areas is less than the upper limit value, the area of each face area is read (step S440), and the face area having the largest area among the read areas is set as the face area to be tracked (step S440). (S450), the tracking target flag is set to 1 (step S420), and this routine is terminated. On the other hand, when the number of face areas is greater than or equal to the upper limit value, even if the face area to be followed is set, the probability that the face decoration image and the face area that the user wants to match is low. Without setting the face area, the tracking target flag is set to zero (step S460), and this routine ends.

  Returning to the flow of FIG. 3, after the face selection processing routine (step S150), the CPU 51 determines whether there is a tracking target face area based on the tracking target flag (step S160). When there is no follow-up target face area, that is, when the follow-up target flag is zero, a face decoration image is placed at the above-mentioned fixed position (step S210), and this routine ends. Note that when the face decoration image is arranged at a predetermined fixed position, the user performs an operation of moving the face decoration image to an appropriate position. On the other hand, when there is a follow target face area, that is, when the follow target flag is 1, the inclination angle of the face decoration image that follows the face area is calculated (step S170). Specifically, first, the value of the upper left coordinate of the rectangle (X_F_RT, Y_F_RT) and the value of the lower right coordinate of the rectangle (X_F_LB, Y_F_LB) are compared, and as shown in Table 1 below, the value of each coordinate is The face area inclination angle is determined to an angle corresponding to the conditional expression. FIG. 9 shows the relationship between the face area tilt angle and the upper left and upper right coordinates of the rectangle. Subsequently, the CPU 51 reads the offset rotation angle of the face decoration image to be followed from the RAM 53 and adds the offset rotation angle to the inclination angle of the face area to calculate the inclination angle of the face decoration image. Thereby, when the face area is inclined with respect to a predetermined direction of the photographic image, the face decoration image can be rotated according to the inclination angle. It should be noted that the face region tilt angle, the offset rotation angle, and the face decoration image tilt angle are positive in the clockwise direction.

  Next, the CPU 51 reads the area value and offset size value of the face area from the RAM 53, and multiplies the read area value by the offset size value to calculate the size of the face decoration image (step S180). .

  Next, the CPU 51 arranges the face decoration image based on the decoration image information (see FIG. 5) and the inclination angle / area of the face decoration image (step S190). Specifically, first, the upper left coordinates (X_OFFSET, Y_OFFSET) of the face decoration image when the area of the face region is a predetermined default value are obtained. These coordinates (X_OFFSET, Y_OFFSET) are determined to be offset coordinates (X_S_OFFSET, Y_S_OFFSET) included in the decorative image information when the area of the face region is the default value and the face region tilt angle is 0 °. . When the face area is the default value and the face area tilt angles are 90 °, 180 °, and 270 °, the coordinates (X_OFFSET, Y_OFFSET) are as shown in Table 2 and FIG. 9, respectively. That is, the coordinates obtained by rotating the offset coordinates (X_S_OFFSET, Y_S_OFFSET) by the face region tilt angle are obtained. After determining the coordinates (X_OFFSET, Y_OFFSET) in this way, the distance between the center coordinates (X_F_C, Y_F_C) of the face area and the previously obtained coordinates (X_OFFSET, Y_OFFSET) is set to the area of the current face area with respect to the default value. Scales based on the ratio. Then, coordinates that are separated from the center coordinates (X_F_C, Y_F_C) of the face region by the distance after expansion / contraction in the direction of the coordinates (X_OFFSET, Y_OFFSET) are the upper left coordinates (X_S, Y_S) of the current face decoration image (FIG. 7). reference). In addition, for the face decoration image when the area of the face area is the default value and the face area tilt angle is 0 °, the tilt angle is set to the tilt angle calculated in step S170 and the size thereof is set in step S180. The image is enlarged or reduced so that the face decoration image calculated in step 1 is obtained. After that, the face decoration image is arranged so that the upper left corner coincides with the upper left coordinates (X_S, Y_S). Here, FIG. 10 shows an arrangement position of each face decoration image when the area of the face region is a default value. FIG. 10 also illustrates the offset coordinates, offset size, and offset rotation angle of each face decoration image.

  Next, the CPU 51 determines whether or not the arrangement position of the arranged face decoration image is an appropriate position (step S200). When it is determined that the arrangement position of the decoration image is an appropriate position, this routine is terminated. To do. Specifically, when the entire area of the arranged face decoration image is arranged inside the photographic image area, it is determined that the arrangement position of the decoration image is an appropriate position. On the other hand, when the CPU 51 determines that the layout position of the face decoration image is not the corresponding position, the face decoration image is disposed at a predetermined fixed position (step S210), and this routine ends. Thus, no matter where the face area exists in the photographic image, the position of the face decoration image with respect to the face area is determined based on the predetermined face decoration image information. Is stored in the flash memory 54 as decoration image information, and the face decoration image is arranged at an appropriate position with respect to the face area.

  After the face decoration image is automatically arranged by the decoration image arrangement processing routine, the user moves the automatically arranged face decoration image to an arbitrary position using the up / down / left / right buttons 24g, and presses the OK button 24h. Press to determine the position of the face decoration image. Since the face decoration image is arranged at an appropriate position with respect to the face area, a user who rearranges the face decoration image compared to the case where the face decoration image is arranged at a fixed position that is determined independently of the face area. Can reduce the operation.

  Here, the correspondence between the components of the present embodiment and the components of the present invention will be clarified. The display 22 of the present embodiment corresponds to image display means, the flash memory 54 corresponds to face decoration image storage means and relative position information storage means, the controller 50 includes control means, face area detection means, face inclination angle detection means, It corresponds to a face area area calculation unit and a face area number count unit, and the printing mechanism 40 corresponds to a print execution unit. The decorative image information corresponds to the relative position information. In this embodiment, an example of the control method of the image processing apparatus of the present invention is also clarified by describing the operation of the photo printer 10.

  According to the photo printer 10 of the present embodiment described in detail above, when a face area of a predetermined photographic image is detected and a predetermined face decoration image is read from the flash memory 54, the decoration image information of the predetermined face decoration image Is read from the ROM 52, the display position of the face decoration image in the photographic image is determined based on the decoration image information and the coordinate position of the face area of the photographic image, and the face decoration image is displayed at the display position. For this reason, if the relative position of the face decoration image with respect to the face area is set to an appropriate position in advance, the face decoration image is arranged at an appropriate position with respect to the face area. Therefore, the user's operation of rearranging the face decoration image can be reduced as compared with the case where the face decoration image is arranged at a fixed position determined independently of the face area.

  In addition, the inclination angle of the face area of the predetermined photographic image is calculated, and the position of displaying the face decoration image is determined by rotating the predetermined face decoration image based on the calculated inclination angle of the face area. The user's operation of rotating the face decoration image again to the inclination angle of the face area can be reduced.

  Further, since the size of the face area of the predetermined photographic image is calculated, and the size of displaying the predetermined face decoration image is determined based on the calculated size of the face area, the size of the face area of the photographic image is determined. Accordingly, the user's operation of changing the size of the face decoration image again can be reduced.

  Furthermore, the number of face areas of a predetermined photographic image is counted, and when the number of face areas counted is 2 or more, a face decoration image is displayed based on the face area having the largest area among the plurality of face areas. To determine the position, even if there are multiple face areas in the photo image, if the selected face area matches the face area that the user wanted to attach the face decoration image to, the face decoration image The user's operation of rearranging can be reduced.

  In addition, when the number of face areas of a predetermined photographic image is equal to or greater than a predetermined upper limit, even if one face area is automatically selected, there is a probability that the face area matches the face area intended by the user. Since it is low, the face decoration image is displayed at a predetermined fixed position.

  It should be noted that the present invention is not limited to the above-described embodiment, and it goes without saying that the present invention can be implemented in various modes as long as it belongs to the technical scope of the present invention.

  For example, in the above-described embodiment, the photo printer 10 is the off-carriage type printing mechanism 40 in which the ink cartridge 44 is mounted below the printing mechanism 40, but the on-carriage type printing mechanism in which the ink cartridge 44 is mounted on the carriage 43. It is good. Although the inkjet printing mechanism is used, the present invention may be applied to a printer such as an electrophotographic method or a dot impact method, or the present invention may be applied to a multi-function machine having a function of a scanner in addition to the printer. May be.

  In the above-described embodiment, the face recognition process is always performed when it is determined in step S120 that the face following flag is 1, but this is not necessarily required. For example, before the end of the face recognition processing routine, rectangular coordinates and the like are stored in the RAM 53 in a format corresponding to the file name of the current photographic image, and the face recognition processing is performed before the face recognition processing (step S130). In addition to adding a step of determining whether or not rectangular coordinates or the like are stored in the RAM 53 in a format corresponding to the photographic image, and when determining that the rectangular coordinates or the like are stored in the RAM 53, face recognition processing (step Instead of performing S130), rectangular coordinates or the like corresponding to the photographic image may be read from the RAM 53. In this way, when the photographic image that has been subjected to the face recognition process is read again, the face recognition process does not have to be performed again, so that the processing time can be shortened.

  In the above-described embodiment, the inclination angle of the face area is determined every 90 ° according to the position of the upper left coordinate of the rectangle in step S170. However, the face area is detected based on the positional relationship between the eyes and mouth detected by the face area detection process. The vertical direction may be detected, and the angle formed by the straight line connecting the left and right eyes with respect to the upper and lower lines of the photographic image in the clockwise direction may be calculated as the tilt angle of the face area. An angle formed by a line segment connecting the upper left coordinates of the rectangle and the upper right coordinates of the rectangle in the clockwise direction may be calculated as the inclination angle of the face area. In this way, since the tilt angle of the face area can be calculated at a finer angle than when calculated every 90 °, the face decoration image can be rotated at a finer angle.

  In the above-described embodiment, when all the areas of the face decoration image arranged in step S200 are arranged in the photographic image area, it is determined that the arrangement position of the decoration image is an appropriate position. The size range is determined in advance for each face decoration image, and when the size of the face decoration image is arranged within the predetermined range, it is determined that the arrangement position of the decoration image is an appropriate position It is good. For example, when the face decoration image is the dream mark 83 or the balloon mark 84, characters cannot be written if the face decoration image is displayed in a small size, and on the contrary, unnecessary handwriting fields increase. In such a case, since it is necessary for the user to manipulate the size of the face decoration image again, the effect of the present invention cannot be sufficiently obtained.

  In the embodiment described above, the face decoration image and the decoration image information are stored in the flash memory 54, but may be stored in a portable removable disk such as a memory stick or a CD-ROM. In this way, the user can arrange various face decoration images on the photographic image.

  In the embodiment described above, the face decoration image is arranged on the photographic image. However, an image composition means for combining and storing the photographic image and the face decoration image may be provided. In this way, the user can store the processed photographic image.

1 is a perspective view of a photo printer 10. FIG. 1 is a block diagram showing an outline of the configuration of a photo printer. The flowchart which shows an example of a decoration image arrangement | positioning processing routine. Explanatory drawing which shows an example of a decoration image selection screen. Explanatory drawing of a face decoration image and decoration image information. The flowchart which shows an example of a face recognition process routine. Explanatory drawing explaining the position coordinate in a photograph image. The flowchart which shows an example of a face selection process routine. Explanatory drawing showing the relationship between a face area inclination angle, and the upper left coordinate and upper right coordinate of a rectangle. Explanatory drawing explaining an example of the arrangement position of a face decoration image.

Explanation of symbols

  10 Photo Printer, 12 Printer Body, 14 Front Door, 18 Memory Card Slot, 20 Operation Panel, 22 Display, 24 Button Group, 24a Power Button, 24b Display Switch Button, 24c Menu Button, 24d Cancel Button, 24e Print Button, 24f Save button, 24g Up / down / left / right button, 24h OK button, 30 cover, 32 cover support shaft, 34 window, 40 printing mechanism, 41 carriage belt, 42 guide, 43 carriage, 44 ink cartridge, 45 print head, 46 transport roller, 48 Paper feed port, 49 Paper guide, 50 Controller, 51 CPU, 52 ROM, 53 RAM, 54 Flash memory, 55 I / F, 57 Bus, 81 Frame mark, 82 Banner mark, 83 Yumema Click, 84 balloon mark, 85 tears mark, 86 anger mark, 87 flash mark, 88 glasses mark, S recording paper, M memory card.

Claims (8)

Image display means capable of displaying various images;
Face decoration image storage means for storing a face decoration image which is a decoration image related to the face;
Relative position information storage means for storing relative position information defining the relative position of the face decoration image with respect to the face area;
Face area detecting means for detecting a face area of a predetermined photographic image;
When the face area of the predetermined photographic image is detected by the face area detecting means and the predetermined face decoration image is read from the face decoration image storage means, the relative position information of the predetermined face decoration image is obtained as the relative position. Read from the information storage means, based on the relative position information and the absolute position of the face area of the predetermined photographic image, determine the display position of the predetermined face decoration image in the predetermined photographic image, Control means for controlling the image display means so that the predetermined face decoration image is displayed;
An image processing apparatus. The image processing apparatus according to claim 1,
A face inclination angle calculating means for calculating an inclination angle of the face area of the predetermined photographic image detected by the face area detecting means with respect to a predetermined direction of the photographic image;
With
The control means detects the relative position of the predetermined face decoration image when the face area of the predetermined photographic image is detected by the face area detection means and the predetermined face decoration image is read from the face decoration image storage means. Information is read from the relative position information storage means, the predetermined face decoration image is rotated based on the inclination angle of the face area of the predetermined photo image, and the relative position information and the face area of the predetermined photo image are Determining the display position of the predetermined face decoration image in the predetermined photographic image based on the absolute position, and controlling the image display means so that the predetermined face decoration image is displayed at the display position;
Image processing device. The image processing apparatus according to claim 1, wherein:
A face area calculation means for calculating the size of the face area of the predetermined photographic image;
With
The control means detects the relative position of the predetermined face decoration image when the face area of the predetermined photographic image is detected by the face area detection means and the predetermined face decoration image is read from the face decoration image storage means. Information is read from the relative position information storage means, the size for displaying the predetermined face decoration image is determined based on the size of the face area of the predetermined photo image, and the relative position information and the predetermined photo are determined. The display position of the predetermined face decoration image in the predetermined photographic image is determined based on the absolute position of the face area of the image, and the image display means is configured to display the predetermined face decoration image at the display position. Control,
Image processing device. The image processing apparatus according to any one of claims 1 to 3,
Face area number counting means for counting the number of face areas detected by the face area detecting means;
With
The control means detects the face area of the predetermined photographic image by the face area detection means and reads the predetermined face decoration image from the face decoration image storage means, and then counts the face by the face area number counting means. When the number of areas is counted two or more, the relative position information of the predetermined face decoration image is read from the relative position information storage means, and the relative position information and the two or more face areas of the predetermined photographic image are read out. The display position of the predetermined face decoration image in the predetermined photographic image is determined based on the absolute position of the face area determined according to a predetermined rule, and the predetermined face decoration image is displayed at the display position. Controlling the image display means;
Image processing device. The image processing apparatus according to any one of claims 1 to 4,
Face area number determining means for determining whether or not the number of the face areas detected by the face area detecting means is equal to or greater than a predetermined upper limit;
With
The control means detects the face area of the predetermined photographic image by the face area detection means and reads the predetermined face decoration image from the face decoration image storage means, and then determines the face area by the face area number determination means. When it is determined that the number of areas is equal to or greater than a predetermined upper limit value, the display position of the predetermined face decoration image is determined as a predetermined fixed position, and the predetermined face decoration image is displayed at the display position. Controlling the image display means,
Image processing device. An image processing apparatus according to claim 1;
Print execution means capable of executing printing on a print medium;
Printing device with Image display means capable of displaying various images, face decoration image storage means for storing a face decoration image that is a face decoration image, and relative position for storing relative position information that defines the relative position of the face decoration image with respect to the face area A control method for controlling an image processing apparatus provided with information storage means by computer software,
(A) detecting a face area of a predetermined photographic image;
(B) A predetermined face decoration image to be decorated on the face area detected in the step (a) is read from the face decoration image storage means, and relative position information of the predetermined face decoration image is read from the relative position information storage means, Based on the relative position information and the absolute position of the face area of the predetermined photographic image, a display position of the predetermined face decoration image in the predetermined photographic image is determined, and the predetermined face decoration image is set at the display position. Controlling the image display means so that is displayed;
A method for controlling an image processing apparatus.   A control program for causing one or more computers to realize each step of the control method of the image processing apparatus according to claim 7.

Images