JP5556330B2 - Image processing apparatus, image processing method, and program thereof - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program thereof.

  Conventionally, as an image processing apparatus, image data captured by a digital camera and attached with a code for identifying a subject or the like is received via a network, and the image quality is optimized and a landscape corresponding to a travel destination corresponding to the code It has been proposed that a template and a travel agency advertisement template are combined with image data and edited to form an album, which is then sent to a printing place close to the place where the trip is dissolved to provide a photo album to travelers ( For example, see Patent Document 1).

JP 2005-267287 A

  By the way, in the apparatus of Patent Document 1, an album is created using a landscape template corresponding to a travel destination, but there is a case where the user wants to create an album by selecting a template frame that matches a photographic image to be printed. . Providing a variety of such template frames can provide a service that matches the user's preference. On the other hand, when there are a wide variety of template frames, it is necessary to select a frame suitable for a photographic image from an enormous number of template frames, and it may take time for the user to select.

  The present invention has been made in view of such problems, and it is a main object of the present invention to provide an image processing apparatus, an image processing method, and a program thereof that can make selection of a user from various template frames easier. And

  The present invention adopts the following means in order to achieve the main object described above.

The image processing apparatus of the present invention
Storage means for storing a plurality of template frames for arranging images;
Display means for displaying an image;
Image data acquisition means for acquiring the selected image data;
Analyzing the image of the acquired image data, the shooting date and time, the number of selected images, the number of people included in the selected image as the analysis result, and the person area included in the selected image as the analysis result Priority order setting means for setting the order of the plurality of template frames so as to be suitable for the selected image based on at least one or more of the sizes;
Display control means for causing the display means to display the template frames in a selectable manner in the order of the set order.

  In this image processing apparatus, the selected image data is acquired, the image of the acquired image data is analyzed, the shooting date and time, the number of selected images, the number of persons included in the selected image, and the selected image are included in the selected image. Based on at least one piece of information about the size of the person area to be displayed, set the order of multiple template frames to arrange the images to suit the selected image, and select the template frames in the order of the set order Display in a possible manner. Here, for example, the shooting date and time is considered to reflect the situation in which a plurality of image data is shot, such as the same day or several days. In addition, for example, it is considered that the situation of the person included in the image also reflects the situation of the person being photographed, such as whether it is a group photo, a person is photographed together with the landscape, or a person is photographed up. In this way, the order of a plurality of template frames is set according to the photographed situation and displayed in a selectable manner. Therefore, the user can easily select from various template frames. Here, the image data acquisition means may acquire the image data selected by the user.

  In the image processing apparatus according to the present invention, the template frame includes a design frame for designing and arranging two or more photos, a photo frame for modifying a photo, a trip frame with a travel modification, and an event frame with a modification for an event. And the priority order setting means determines the order of the groups based on at least one of the shooting date and time, the number of people included in the image, and the size of the person area. And the order of the template frames may be set according to the selected number of images. In this way, the template frames are grouped into the same genus, the order is set, and then the order of the templates is set in accordance with the number of images, so that the user can make selection more easily. At this time, when setting the order of the template frames in accordance with the number of selected images, the template frame in which images of the selected number of images cannot be arranged may not be displayed on the display means.

In the image processing apparatus according to the present invention, the template frame includes a design frame for designing and arranging two or more photos, a photo frame for modifying a photo, a trip frame with a travel modification, and an event frame with a modification for an event. Are associated with at least one type of group, and the priority order setting means sets the order of the plurality of template frames based on at least one of the following conditions (1) to (6): It is good. In this way, since a more suitable group is preferentially displayed according to the shooting state of the selected image, the user can be more easily selected. Here, the “predetermined number of people” may be, for example, the number of people based on the scale of the event, for example, four people, five people, or two people.
(1) When there is no image including a person in the selected image, the design frame group is set to a higher-order template frame.
(2) When the shooting date and time of the selected image are not related, the group of the design frames is set as a higher-order template frame.
(3) When the shooting date and time of the selected image is either within one day or consecutive days, and the plurality of images includes an image including a large number of people greater than or equal to a predetermined number, the event frame group is selected. Set to a higher-order template frame.
(4) When the shooting date and time of the selected image is either within one day or consecutive days, and the plurality of images includes an image whose person area is smaller than a predetermined value, the event frame and the trip One of the frame groups is set as a higher-order template frame.
(5) When the shooting date and time of the selected image is within one day, and the plurality of images are images including a small number of people less than a predetermined number of people and the person area is an image larger than a predetermined value, the photo Set a group of frames to a higher-order template frame.
(6) When the shooting date and time of the selected image is a consecutive day and the plurality of images are images including a small number of people less than a predetermined number of people and the person area is an image larger than a predetermined value, the trip frame and One of the groups of photo frames is set as a higher-order template frame.

  In the image processing apparatus according to the present invention, the template frame includes a design frame for designing and arranging two or more photos, a photo frame for modifying a photo, a trip frame with a travel modification, and an event frame with a modification for an event. Are associated with at least one type of group, the storage means stores group priority information including the priority order of the plurality of groups, and the priority order setting means includes the group priority order information. The order of the plurality of template frames may be set according to the priority order of the groups included in the group. In this way, template frames can be grouped and user selection can be made easier using group priority information. In this aspect, the image processing apparatus updates the group priority information by increasing the frequency of use of the group associated with the selected template frame after the user selects the template frame displayed on the display means. Use frequency update means may be provided. By so doing, it is possible to present more preferentially the user's preference while reflecting the user's usage status. At this time, a group with high usage frequency may have a higher priority. In the image processing apparatus of the present invention, the storage unit stores frame information in which template frames and groups are associated with each other, and corresponds to the highest rank group among the template frames displayed on the display unit. When the user selects a template frame that is not attached, the frame information is updated by increasing the frequency of use of the highest-order group for the selected template frame, and then the template frame is associated with the template frame. Group registration updating means may be provided for updating the frame information by associating the unregistered group with the template frame when the frequency of use of the unregistered group that is not present exceeds a predetermined frequency. In this way, a new group is associated with the template frame in accordance with the usage status of the user, so that a more suitable one according to the user's preference can be presented more preferentially.

  In the image processing apparatus of the present invention, the storage unit stores frame priority information including a priority of the template frame, and the priority order setting unit stores the template frame included in the frame priority information. The order of the plurality of template frames may be set according to the priority. In this way, user selection can be made easier using the frame priority information. The image processing apparatus adopting this aspect includes a frame use frequency update unit that updates the frame priority information by increasing the use frequency of the selected template frame after the user selects the template frame displayed on the display unit, It is good also as a thing provided. By so doing, it is possible to present more preferentially the user's preference while reflecting the user's usage status. At this time, template frames that are frequently used may have higher priority.

  In the image processing apparatus according to the present invention, the template frame includes a design frame for designing and arranging two or more photos, a photo frame for modifying a photo, a trip frame with a travel modification, and an event frame with a modification for an event. Are associated with at least one type of group, and the storage unit associates information regarding the shooting date and time of the selected image with information about a person included in the selected image and a plurality of the groups. The priority order setting means selects the shooting date and time, the number of selected images, the number of persons included in the selected image that is the analysis result, and the analysis result that is selected. Using the image group correspondence information with the size of the person area included in the selected image as a setting condition When the user selects a template frame that is not associated with the highest-order group among the template frames displayed on the display means, the setting condition for setting the highest-order group is set. The group associated with the selected template frame is stored in association with each other, and when the setting condition and the associated group are stored at a predetermined frequency or more, the association is performed according to the setting condition. Image group correspondence information updating means for updating the image group correspondence information may be provided so that a certain group is set as the highest rank group. In this image processing apparatus, using the image group correspondence information, the group associated with the shooting date / time and the information related to the person included in the image is preferentially set, but the user is associated with the highest ranking group. If a template frame that has not been selected is selected at a predetermined frequency or more, the image group correspondence information is updated by associating the setting condition for setting the highest-order group with the group associated with the selected template frame. . For example, even if the association between the setting condition determined by the selected image and the group is dissociated from the actual situation, the image group correspondence information is updated to reflect the user usage status, and the setting condition Since the association between the group and the group is brought closer to the actual situation, the one more suitable for the user's preference can be presented with higher priority.

The image processing method of the present invention includes:
An image processing method using storage means for storing a plurality of template frames for arranging images and display means for displaying images,
(A) obtaining the selected image data;
(B) Performs analysis on the image of the acquired image data, and includes the shooting date and time, the number of selected images, the number of persons included in the selected image that is the analysis result, and the selected image that is the analysis result Setting the order of the plurality of template frames to be suitable for the selected image based on at least one or more information of the size of the person area;
And (c) displaying the template frame in a selectable manner in the order of the set order.

  In this image processing method, as in the above-described image processing apparatus, since the order of a plurality of template frames is set according to the photographed situation and displayed in a selectable manner, the user can select more from various template frames. Can be easily. In this image processing method, various aspects of the above-described image processing apparatus may be adopted, and steps for realizing each function of the above-described image processing apparatus may be added.

  The program of the present invention is for causing one or more computers to realize each step of the above-described image processing method. This program may be recorded on a computer-readable recording medium (for example, hard disk, ROM, FD, CD, DVD, etc.) or from a computer via a transmission medium (communication network such as the Internet or LAN). It may be distributed to another computer, or may be exchanged in any other form. If this program is executed by one computer or if each computer is executed by sharing each step, each step of the above-described image processing method is executed, so that the same effect as this method can be obtained. Can do.

1 is a configuration diagram showing an outline of the configuration of a minilab system 10. FIG. Explanatory drawing of the group priority information 31 and the image / group correspondence information 32. FIG. Explanatory drawing showing an example of the template frame for every group. Explanatory drawing of the frame information 33. FIG. The block diagram which shows an example of a function structure of reception PC20. The flowchart showing an example of a frame display processing routine. Explanatory drawing showing an example of the frame selection screen. The flowchart showing an example of a priority update process routine. Explanatory drawing when the frame of the group of the 1st priority is selected. Explanatory drawing when the frame of groups other than the 1st priority is selected.

  Next, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a configuration diagram showing an outline of a configuration of a minilab system 10 according to an embodiment of the present invention. FIG. 2 is an explanatory diagram of the group priority information 31 and the image / group correspondence information 32. FIG. 3 is an explanatory diagram illustrating an example of a template frame for each group. FIG. 4 is an explanatory diagram of the frame information 33. FIG. 5 is a block diagram illustrating an example of a functional configuration of the reception PC 20. As shown in FIG. 1, the minilab system 10 of the present embodiment includes a receiving personal computer (PC) 20 that processes data and displays the screen, a control PC 52 that receives data from the receiving PC 20 and gives a print command to the printer 60, And a printer 60 that executes print processing. In this minilab system 10, a reception PC 20 and a control PC 52 are connected via a LAN 12 as a network line, and a control PC 52 and a printer 60 are connected via a USB as a local line. In addition to the reception PC 20, a plurality of reception PCs (not shown) such as a reception PC 50 are connected to the LAN 12. Since the reception PC 50 has the same configuration as the reception PC 20, the description thereof is omitted.

  The receiving PC 20 is a personal computer configured as an image processing apparatus that arranges one or more images on a template frame to create a arranged image and receives a print request for the created arranged image. The receiving PC 20 includes a CPU 22 that executes various controls, a ROM 23 that stores various control programs, a RAM 24 that temporarily stores data, an HDD 25 that is a large-capacity memory that stores various application programs and various data files, and a memory card 14. A memory card reader 30 that controls data input / output, and a network interface (I / F) 28 that can transmit / receive signals to / from an external device (for example, the control PC 52) connected to the LAN 12. The reception PC 20 includes an input device 26 such as a keyboard and a mouse for a user to input various commands, a display 27 for displaying various information on a screen, and the like. The user PC 20 has a function of executing an operation corresponding to the input operation when the user inputs the cursor or the like displayed on the display 27 via the input device 26. The CPU 22, ROM 23, RAM 24, HDD 25, input device 26, display 27, and memory card reader 30 are electrically connected via a bus 29 so that various control signals and data can be exchanged. The receiving PC 20 instructs the printer 60 to perform a printing process or displays information about the printer 60 according to the installed program.

  The HDD 25 includes group priority information 31, image / group correspondence information 32, and frame information 33 as information used in the template frame selection process, a frame display program 37 for executing the template frame selection process, and a priority. A rank update program 38 and the like are stored. In the group priority information 31, as shown in FIG. 2, the priority, the group of the template frame, and the number of selections of the group selected by the user are associated with each other. In the minilab system 10, the template frame belongs to at least one group. As shown in FIG. 3, this group includes, for example, a design frame in which two or more photographs are designed and arranged, a photo frame that modifies photographs, a trip frame that is modified for travel, and an event that is modified for events. Frames are specified. The group priority information 31 is set so that a group with a higher selection count has a higher priority. The design frame is, for example, one in which a plurality of images are arranged with different sizes and different inclinations, and is used for an album or the like. A photo frame is, for example, an illustration arranged according to the shooting situation (season, place, time, etc.), and is used when modifying one image. The trip frame is an arrangement of illustrations relating to travel, and is used for a multi-image album or the like for travel over several days. The event frame includes illustrations related to events (such as athletic meet and graduation ceremony), and is used for albums of a plurality of images at events held on one day or several days.

  As shown in FIG. 2, the image / group correspondence information 32 associates information related to the shooting date and time of the selected image, information related to a person included in the selected image, and a group. The information regarding the shooting date / time includes, for example, whether all the selected images were taken on the same day, taken on consecutive days for several days, or not related to the shooting date. The information regarding the person includes one or more images in which a large number of persons of a predetermined number or more (for example, four or more, five or more, etc.) are not included in all the selected images, and less than a predetermined number ( (For example, less than 4 people, less than 5 people, etc.) The proportion of the person area in the photograph is a large range larger than a predetermined value, or the proportion of the person area in the photograph is smaller than the predetermined value Information such as whether or not is included. The image / group correspondence information 32 is set such that a predetermined group is guided as the first priority when information on the shooting date and time and information about a person included in the image (also referred to as setting conditions) are given. Depending on the setting conditions, there may be a plurality of groups associated with each other. In this case, the first priority is determined according to the group priority of the group priority information 31. The “predetermined value” of the person area is determined empirically in accordance with the relationship between the size of the person area in the photograph and the type of photograph, for example, whether it is a person photograph or a commemorative photograph. It may be a thing.

  The frame information 33 is a database related to template frames, and stores information (affiliation) that associates a predetermined template frame with at least one group as shown in FIG. In FIG. 4, for the convenience of explanation, the affiliation group associated with the initial state is indicated by “◎”. As will be described in detail later, the “affiliation group” of the frame information 33 is configured to be additionally registered based on the use of the user, and the additionally registered membership group is indicated by “◯” (described later). (See FIG. 10). The frame information 33 includes frame priority information 34 for storing the number of the template frame, the group to which the user belongs and the number of past selections in the group as the usage frequency, the thumbnail 35 of the template frame, the frame data 36 of the template frame, and the like. Is stored. The frame priority information 34 is used when setting the order of a plurality of template frames belonging to the same group using the stored number of selections (usage frequency). In the frame priority information 34, a template frame having a higher number of selections is set to have a higher priority.

  As shown in FIG. 5, the reception PC 20 includes an image data acquisition unit 40, a priority order setting unit 41, a selection screen creation unit 42, and a display control unit 43 as functional configurations. The reception PC 20 includes an instruction acquisition unit 44, a group usage frequency update unit 45, a frame usage frequency update unit 46, a group registration update unit 47, an arranged image creation unit 48, and a print processing unit 49. ing. The image data acquisition unit 40 performs processing for acquiring one or more image data selected by the user from the memory card 14 or the like. The priority order setting unit 41 analyzes the person included in the image of the image data acquired from the image data acquisition unit 40. The priority order setting unit 41 uses the group priority order information 31, the image / group correspondence information 32, the frame information 33, and the like based on the shooting date and time, the number of selected images, information on the person as the analysis result, and the like. A process for setting the order of a plurality of template frames is performed. The information about the person includes, for example, the number of people included in the image and the size of the person area included in the image in the photograph. The selection screen creation unit 42 performs a process of creating a frame selection screen in which template frames are arranged so as to be selectable in the order of the set order. The display control unit 43 performs processing to display and output the created frame selection screen on the display 27. The instruction acquisition unit 44 performs a process of inputting, from the input device 26, a template frame selection instruction, an instruction to print a placed image created using the selected template frame, and the like. The group usage frequency update unit 45 performs a process of updating the group priority information by increasing the usage frequency of the group associated with the template frame based on the template frame selection instruction. The frame usage frequency update unit 46 performs a process of updating the frame priority information 34 by increasing the usage frequency of the template frame based on a template frame selection instruction. When the template frame is selected by the user when the priority of unregistered groups that are not associated with each other is high and the use frequency increases, the group registration update unit 47 associates the unregistered group with this template frame and sets the frame information 33. Process to update. The arranged image creating unit 48 performs a process of arranging the selected image in the template frame selected based on the image creating instruction from the user and creating the arranged image. The print processing unit 49 converts the created arranged image into print data based on a print instruction from the user and outputs the print data to the control PC 52.

  The control PC 52 is a personal computer configured as a print server device having a function of receiving print commands and print data from the reception PC 20 and transmitting print data to the printer 60. The control PC 52 includes a CPU that executes various controls, a ROM that stores various control programs, a RAM that temporarily stores data, an HDD and an I / F that are large-capacity memories that store various application programs and various data files. I have.

  The printer 60 includes a CPU 62 that executes various controls, a ROM 63 that stores various control programs, a RAM 64 that temporarily stores data, a printing mechanism 65 that ejects ink onto recording paper, and an external device (for example, a control PC 52). And an I / F 68 capable of transmitting / receiving signals to / from. Although not shown, the printing mechanism 65 is an ink jet mechanism that applies a pressure to each color ink and discharges the pressurized ink onto a recording sheet to execute a printing process. The mechanism for applying pressure to the ink may be due to deformation of the piezoelectric element or due to the generation of bubbles due to the heat of the heater. Alternatively, the printing mechanism 65 may be any of a dot impact method, an electrophotographic method, a thermal transfer method, and the like.

  Next, an operation of the minilab system 10 of the present embodiment configured as described above, first, an operation of displaying a template frame in a selectable manner will be described. FIG. 6 is a flowchart showing an example of a frame display processing routine stored in the HDD 25 and executed by the CPU 22. First, the user executes an application program (not shown), selects one or more of the image data stored in the memory card 14, and clicks a template selection button (not shown) displayed on the screen. Then, the CPU 22 executes a frame display processing routine shown in FIG. Here, it is assumed that the CPU 22 executes the frame display processing routine using any of the functional blocks described above.

  When this routine is executed, the CPU 22 first reads the group priority from the group priority information 31 using the priority setting unit 41 and prepares the template frame priority as a preparation for setting the template frame order. Read from the priority information 34 (step S100). Next, the CPU 22 acquires image data selected by the user using the image data acquisition unit 40 (step S110), and executes image data analysis processing using the priority order setting unit 41 (step S120). In this image data analysis processing, processing is performed to analyze the shooting date and time of all the selected image data, the number of people included in the image, the proportion and size of the person area in the image, and the like. The shooting date and time can be analyzed by reading out the shooting date and time information stored in each image data. There are various methods for analyzing a person, but it can be executed by detecting a face area, for example. As an example of the detection of the face area, pixels within a predetermined skin color range in the image are extracted as skin color pixels, and predetermined features (for example, skin color pixels correspond to faces) based on the extracted skin color pixels. A region of skin color pixels having a predetermined area in shape) is calculated, and a region having a lower luminance value than the skin color pixel region is extracted as an eye region at the center or slightly above the calculated skin color pixel region. In the area under the eyes extracted together, the area having a lower luminance value than the skin color pixel collection area is extracted as the mouth area, and the face area is detected when the eye or mouth area is extracted. It was. The number of faces is obtained from the number of face areas, and the size of the face area is used as a person area. As the size of the face area increases, the size of the person area including the face area also increases, and therefore the size of the face area and the size of the person area are correlated. Here, considering the ease of processing, the size of the face area is treated as the size of the person area. The relationship between the face area and the body area existing under the face area is empirically obtained, and given the size of the face area, the size of the person area composed of the face area and the body area is The person area may be derived from the face area and the arrangement position in the image.

  Next, the CPU 22 executes processing for setting the priority order of the group using the priority order setting unit 41, the group priority order information 31, and the image / group correspondence information 32 (steps S130 to S250). In the group priority setting process, the CPU 22 first checks information on the shooting date and time (step S130), and if there is no relevance to the shooting date and time of all the selected images, images taken at various times are made into albums. In step S140, the design frame group is set to the first priority (highest priority). On the other hand, when the shooting date / time of all the selected images is the same day, the CPU 22 determines whether there is an image including a person in all the selected images (step S150), and there is no image including the person. In some cases, it is determined that the landscape image is an album, and the group of design frames is set to the first priority in step S140. On the other hand, when there is an image including a person, the CPU 22 determines whether there is an image including a large number of people (step S160), and when there is an image including a large number of people, an album of events performed during the day is performed. The event frame group is set to the first priority order (step S170). Here, “multiple people” means a number of people larger than a predetermined number of people set as assumed as a personal event, such as a group photo, for example, 4 or more people, 5 people It is good also as above, or it is good also as two or more people. In the case of “not a large number of people”, it may be a “small number” of less than a predetermined number of people, corresponding to a large number of people, less than 4 people, less than 5 people, or 1 person. It is good.

  On the other hand, when there is no image including a large number of people in step S160, the CPU 22 determines whether there is an image in which the person area is a small range among all the selected images (step S180), and the person area is small. When there is no range image, it is determined that the person region is a large range, that is, a group of images in which a person is photographed relatively up, and the group of photo frames is set to the first priority (step S190). Here, the “small person area” may be set empirically within a range in which it can be determined whether or not a person and a surrounding photographing target (landscape, object, etc.) are photographed as subjects. . Alternatively, it may be set empirically within a range where it can be determined that the person is not photographed up. By the way, when there is an image in which the person area is a small range in step S180, the CPU 22 determines that the person and the surrounding area are to be photographed and that the event is one of an event or a trip performed on the 1st. Any group of frames and trip frames is set to the first priority (step S200). Here, when setting any group of event frames and trip frames to the first priority, the higher priority of the group priority information 31 is set as the first priority, and the priority of the group priority information 31 is set. The lower one was set as the second priority.

  In step S130, when the shooting date and time of all the selected images are several consecutive days, the CPU 22 determines whether or not there is an image including a person in all the selected images (step S210). If there is no image including, it is determined that the landscape image is to be an album, and the group of design frames is set to the first priority in step S140. On the other hand, when there is an image including a person in all the selected images, the CPU 22 determines whether there is an image including a large number of people (step S220). In step S170, the event frame group is set to the first priority order. On the other hand, when there is no image including a large number of people in step S220, the CPU 22 determines whether there is an image in which the person area is a small range among all the selected images (step S230), and the person area is small. When there is an image that is a range, it is determined that the person and the surrounding area are to be photographed, and that the event or trip is performed over several days, and in step S200, any group of event frames and trip frames is determined. Is set to the first priority. On the other hand, when there is no image in which the person area is a small range in step S230, it is determined that the person is an object to be photographed and is either a trip or a snapshot performed over several days. One of the groups is set to the first priority, and the other group is set to the second priority (step S240). Here, when setting either the trip frame or the photo frame to the first priority, the higher priority of the group priority information 31 is set as the first priority, and the priority of the group priority information 31 is set. The lower one was set as the second priority. In this way, a group of template frames suitable for the selected image is set with the highest priority using the shooting date and time and the information of the person included in the image as the setting conditions.

  When the first priority group is set in steps S140, S170, S190, S200, and S240, the CPU 22 sets the second and subsequent priorities based on the priority of the group priority information 31 (step S250). Here, the order of the groups after the first priority is set in order from the group with the highest priority in the group priority information 31. When the second priority is already set, the group order after the third priority is set.

  Subsequently, the CPU 22 uses the frame priority information 34 stored in the frame information 33 to set the order of the template frames in each group according to the frequency of use of the template frames (step S260), and the selected image. The order of the template frames of each group is set according to the number (step S270). Here, first, the rank within each group is determined so that the higher the frequency of use of the template frame, the higher the rank. Next, the number with the same number of selected images and the number of images that can be placed in the template frame is the highest ranking, and the number of images that can be placed and the number of images that can be placed in the template frame is the next highest. It was assumed that the ranking within each group was determined so that it would be ranked higher. At this time, the number of selected images may be higher than the number of images that can be arranged in the template frame, that is, the template frame having no empty space may be set higher. In this way, a rough order is determined using groups according to the setting conditions, and a detailed order within each group is determined according to the frequency of use of the template frame and the number of images to be arranged. Template frames that are assumed to be frames are set in a higher order.

  Then, the CPU 22 uses the selection screen creation section 42 to create a frame selection screen by arranging the template frames in the set order, and uses the display control section 43 to display and output the created frame selection screen (step S280), this routine is finished. FIG. 7 is an explanatory diagram illustrating an example of the frame selection screen 70 displayed on the display 27. The frame selection screen 70 is pressed when advancing to the next page, a frame display field 72 in which template frames are arranged so as to be selectable by the cursor 71, a selection value input unit 74 for inputting a selection value of the template frame. A forward button 76 and a return button 78 that is pressed when returning to the previous page are arranged. In the frame selection screen 70, when the forward button 76 or the return button 78 is pressed, the screen changes so that the page is turned. In the frame display field 72, the thumbnails of the template frames are displayed in the frame display field 72 so that the left page has a higher order than the right page, and the order is lower in the order of upper left, upper right, lower left, and lower right on each page. Has been. As described above, since the template frames are arranged in order according to the shooting date and time, the information of the person, the frequency of use, and the number of selected images, the frames that match the user's preference are arranged higher. The user can select a template frame by further reducing the number of times the page of the frame selection screen 70 is turned.

  Thereafter, when a template frame is selected on the frame selection screen 70, the CPU 22 uses the arranged image creation unit 48 to arrange the selected image in the selected template frame and creates a arranged image. It should be noted that the arrangement order and the arrangement position of the images on the template frame may be appropriately changed based on the input by the user operating the input device 26. Based on the user confirmation and the input of the print instruction via the instruction acquisition unit 44, the CPU 22 uses the print processing unit 49 to convert the created arranged image into print data and output it to the control PC 52. . The printer 60 that has received the print data via the control PC 52 performs print processing for this print data. In the printing process, the CPU 72 of the printer 60 drives the drive motor to rotate the conveyance roller and the like to convey the recording paper, and based on the print data, the printing mechanism 65 so as to eject ink from the print head onto the recording paper. To control. In this way, the print processing of the arranged image in which one or more images are arranged in the template frame is executed.

  Next, an operation for updating the group priority information 31 and the frame priority information 34 will be described. FIG. 8 is a flowchart showing an example of a priority update processing routine stored in the HDD 25 and executed by the CPU 22. This routine is executed after the frame selection screen is displayed and the template frame is selected.

  When this routine is executed, the CPU 22 determines whether or not a template frame belonging to the first priority group has been selected (step S300). When a frame belonging to the first priority group is selected, the CPU 22 uses the frame usage frequency update unit 46 to set the number of times of selection of the group set to the first priority in the selected template frame to the value “1”. Increment and update the frame priority information 34 (step S310). That is, the frame priority information 34 is updated by increasing the frequency of use of the selected template frame. Next, the CPU 22 uses the group usage frequency update unit 45 to update the group priority information 31 by incrementing the selection count of the selected group by the value “1” (step S320), and ends this routine. That is, the group priority information 31 is updated by increasing the frequency of use of the selected group. As described above, when a template frame belonging to the first priority group is selected, the use frequency of the template frame and the use frequency of the group belonging to the template frame are increased and updated. For this reason, when the user uses the next time, the group and the template frame having a higher usage frequency are displayed in a higher order.

  On the other hand, when a template frame belonging to the first priority group is not selected in step S300, that is, when a template frame not belonging to the first priority group is selected, the CPU 22 uses the frame usage frequency update unit. 46, the frame priority information 34 is updated by incrementing the number of times of selection of a group (also referred to as an unregistered group) set to the first priority in the selected template frame by a value “1” (step S330). ). For example, in the frame priority information 34 of FIG. 4, when the first priority is an event frame, No. When C1 is selected, this No. The number of times of selecting the group of the event frame of C1 is incremented.

  Next, the CPU 22 determines whether or not the incremented number of group selections has reached a predetermined group addition threshold (step S340). This “group addition threshold value” can be determined empirically to a value sufficient to add a new group, for example, the selected template frame should belong to an unregistered group. Here, it is assumed that the group addition threshold is set to 50 selections. When the incremented group selection count does not reach the predetermined group addition threshold, the CPU 22 updates the group priority information 31 by incrementing the selection count of the selected group by a value “1” in step S320, This routine ends. For example, when the first priority is an event frame, No. When C1 is selected, the number of trip frame groups selected in the group priority information 31 is incremented. On the other hand, when the incremented group selection count reaches a predetermined group addition threshold value in step S340, the CPU 22 additionally registers an unregistered group in the group to which the selected template frame belongs (step S350). That is, the selected template frame has a plurality of belonging groups. Then, the CPU 22 increments the number of selections of the additionally registered group in the group priority information 31 by a value “1” (step S360), and ends this routine. For example, when the first priority is an event frame, No. C1 is selected. When an event frame group is additionally registered in C1, the number of event frame groups selected in the group priority information 31 is incremented. In this way, by updating the use frequency of the group and the template frame and further adding the group that should belong to the group to the template, it is possible to learn the user's usage state and select the template frame more easily. It is.

  Here, the operation of updating the group priority information 31 and the frame priority information 34 will be described using a specific example. FIG. 9 is an explanatory diagram when a template frame of a group with the first priority is selected, and FIG. 10 is an explanatory diagram when a template frame of a group other than the first priority is selected. Here, a group of event frames is set in the first priority order based on setting conditions such as the shooting date and time of the selected image and the information of the person included in the image, and the nth priority order (n is an integer of 2 or more) )), A trip frame is set, and in FIG. When the template frame of D1 is selected, in FIG. A case where the C1 template frame is selected will be described. In the following, description will be made using the step numbers of the above-described priority update processing routine.

  As shown in the first row of FIG. 9, the CPU 22 sets the order of the template frames based on the setting conditions, and displays a frame selection screen 70 on which the template frames are arranged in the set order on the display. At this time, the template frame D1 belonging to the group of event frames having the first priority order is selected by the user on the frame selection screen 70 (second row in FIG. 9). Then, as shown in the third row of FIG. 9, the number of times of selecting the template frame of D1 in the frame priority information 34 is incremented by “1” (S310), and the event of the first priority in the group priority information 31 is also performed. The frame selection count is incremented by “1” (S320). After that, when the event frame group is set to the first priority in the same manner, for example, the frequency of use of the template frame of D1 is increased, and when the frequency of use is higher than that of the higher-order template frame, The display order increases (fourth row in FIG. 9).

  Further, after the number of uses is increased by the user and the number of times of use is increased, as shown in the first row of FIG. 10, the order of the template frames is set based on the setting condition, and the template frames are arranged in the set order. The selection screen 70 is displayed on the display. At this time, the C1 template frame that does not belong to the first priority event frame group is selected by the user on the frame selection screen 70 (second row in FIG. 10). Then, as shown in the third row of FIG. 10, the number of selections of the event frame group which is an unregistered group of the C1 template frame in the frame priority information 34 is incremented by “1” (S330). At this time, if an unregistered group addition condition (for example, the number of selections is equal to or greater than a predetermined group addition threshold (for example, 50 selections)), the unregistered group of the C1 template frame in the frame priority information 34 A certain event frame is additionally registered in the group to which it belongs (S350), and the number of times of selection of the added group is incremented by “1” (S360). Thereafter, when the group of event frames is set to the first priority in the same manner, for example, the group is added to the template frame of C1, and is displayed with the priority of the additional group, and the display order is increased. (4th stage in FIG. 10).

  Here, the correspondence between the components of the present embodiment and the components of the present invention will be clarified. The HDD 25 of this embodiment corresponds to the storage unit of the present invention, the display 27 corresponds to the display unit, the CPU 22 and the image data acquisition unit 40 correspond to the image data acquisition unit, and the CPU 22 and the priority order setting unit 41 have the priority order. The CPU 22, the selection screen creation unit 42, and the display control unit 43 correspond to the display control unit, the CPU 22 and the group usage frequency update unit 45 correspond to the group usage frequency update unit, and the CPU 22 and the frame usage frequency. The update unit 46 corresponds to a frame use frequency update unit, and the CPU 22 and the group registration update unit 47 correspond to a group registration update unit. In the present embodiment, an example of the image processing method of the present invention is also clarified by describing the operation of the reception PC 20.

  According to the receiving PC 20 of the present embodiment described in detail above, the image data selected by the user is acquired, the image of the acquired image data is analyzed, the shooting date and time, the number of selected images, and the selected image are displayed. Based on the information of the number of people included and the size (setting condition) of the person area included in the selected image, the order of a plurality of template frames for arranging the images to suit the selected image is set and set The template frames are displayed in a selectable manner in the order of the rankings. Here, for example, the shooting date and time reflects the situation where a plurality of image data was shot, such as the same day or several days, and is a group photo, whether a person is shot with a landscape, The state of the person included in the image, such as whether the image was taken, also reflects the situation where the image was taken. In this way, since the order of a plurality of template frames is set in accordance with the photographed situation and displayed in a selectable manner, the user can easily select from various template frames.

  In addition, template frames are grouped into the same genus, the group order is set based on the setting conditions, and then the template order is set according to the number of images, making it easier for users to select. Can be. Further, the order of a plurality of template frames is set based on the group priority order information 31 in which the setting condition and the group priority order are associated with each other, and a more suitable group is preferentially set according to the shooting situation of the selected image. In order to display, what is more suitable for a user preference can be preferentially presented. In addition, the group priority information 31 can be used to make the user's selection easier. Furthermore, since the group priority information 31 is updated according to the user's selection of the template frame, it is possible to present more preferentially what is more suitable for the user's preference while reflecting the user's usage status. Then, after the user selects a template frame that is not associated with the highest-ranking group (for an unregistered group), the unregistered group is associated with this template frame when the usage frequency of the unregistered group exceeds a predetermined frequency. Therefore, by associating a new group with the template frame in accordance with the usage status of the user, it is possible to preferentially present what is more suitable for the user's preference. In addition, since the order of a plurality of template frames is set according to the priority of the template frame using the frame priority information 34, it is possible to preferentially present the one more suitable for the user's preference. Furthermore, since the frame priority information 34 is updated in accordance with the user's selection of the template frame, it is possible to present more preferentially what is more suitable for the user's preference while reflecting the user's usage status.

  It should be noted that the present invention is not limited to the above-described embodiment, and it goes without saying that the present invention can be implemented in various modes as long as it belongs to the technical scope of the present invention.

  For example, in the above-described embodiment, the order of the template frames is set based on the shooting date and time, the number of selected images, the number of people included in the selected image, and the size of the person area included in the selected image. The order of the template frames is set based on at least one of the shooting date and time, the number of selected images, the number of people included in the selected image, and the size of the person area included in the selected image. It is good also as what to do. That is, one or more of the four conditions may be omitted. Alternatively, a new condition other than the above-described condition may be replaced with any one of the above conditions, or may be further added.

  In the above-described embodiment, template frames are associated with one or more groups of design, photo, trip, and event, and the priority order is set for each group, and the order of template frames is set. Is not particularly limited to this, one or more of these may be omitted, and a new group other than those described above may be replaced with any one of the above groups, or may be further added Good. Alternatively, the order of template frames may be set without using a group. At this time, for example, the frame priority information 34 may be configured to increase the priority of a predetermined template when a predetermined condition is satisfied.

  In the above-described embodiment, when there is no image including a person in the selected image and there is no relevance to the shooting date and time, the group of design frames is set to the first priority, and the shooting date and time is within one day or among consecutive days. When there is an image that includes any of a large number of people, the group of event frames is set to the first priority, and an image whose shooting date is within one day or consecutive days and whose person region is a small region is set. In some cases, either the event or trip frame group is set to the first priority, and when the shooting date and time is within one day, the image includes a small number of people and the person area is a large range image, the photo frame group is set to the first priority. When the priority is set to 1 and the shooting date / time is consecutive, the image includes a small number of people and the person area is large, the trip and photo frame One of-loop and shall be set to the first priority, but not particularly limited thereto. For example, any one or more of the above conditions may be omitted, a group to be set may be changed or added, a new condition other than the above may be replaced with the above condition, or a new one may be added Also good.

  In the above-described embodiment, the group priority is set using the group priority information 31. However, the present invention is not particularly limited to this, and the group priority is set without using the group priority information 31. It is good. At this time, for each setting condition such as the shooting date and time, the number of selected images, the number of people included in the selected image, and the size of the person area included in the selected image, Priorities may be stored in association with each other, and group priorities may be set based on this information. In addition, the group usage frequency is the number of group selections, but the present invention is not particularly limited thereto. For example, a ratio of a predetermined group usage frequency to the total group usage frequency may be used as the usage frequency.

  In the above-described embodiment, the first priority group is set using the image / group correspondence information 32. However, the present invention is not limited to this. For example, the priority order of the lowest group from the highest order may be stored in association with the image / group correspondence information 32, and the priority order of the group may be set based on this information. Alternatively, the image / group correspondence information 32 may be omitted, and when a setting condition is given, a template frame having information conforming to the setting condition may be searched to set the order of the template frames.

  In the above-described embodiment, the order of the template frames is set using the frame priority information 34. However, the present invention is not particularly limited to this. Further, the frequency of use of the template frame is the number of times of selecting the template frame. However, the present invention is not particularly limited to this.

  In the above-described embodiment, the group priority order information 31 is updated according to the user's selection of the template frame, but this may be omitted. This also makes it easier for the user to select from various template frames. Further, the frame priority information 34 is updated according to the user's selection of the template frame, but this may be omitted. This also makes it easier for the user to select from various template frames. Also, when a template frame belonging to a group that is not in the first priority order is selected and exceeds a predetermined frequency, the first priority group is associated with the template frame, that is, a new group is additionally registered. However, the present invention is not limited to this, and for example, the belonging group may be changed to a new group. Or it is good also as what does not perform registration update of a new affiliation group. This also makes it easier for the user to select from various template frames. Alternatively, when a predetermined deletion condition is satisfied, the correspondence with the new group once added may be deleted. At this time, even if the same condition is satisfied, the group that was supported from the beginning is not deleted, only the new group that has been added may be deleted, the last one group is not deleted, and the others are deleted. You may do it.

  In the above-described embodiment, when the order of the template frames is set according to the number of selected images, the template frame having no vacancy is set higher. However, the selected number of images are arranged. Template frames that cannot be displayed may not be displayed.

  In the embodiment described above, when a template frame belonging to a group that is not the first priority is selected, that is, when it is presented as the most suitable group for the selected image, but differs from the user's preference, When it becomes a predetermined frequency or more, this group that is not associated with the template frame is additionally registered and the frame priority information 34 is updated to make it more suitable for the user's preference. Not. For example, if the group is presented as the most suitable group for the selected image but is different from the user's preference, the association between the setting condition and the group is changed and the image / group correspondence information 32 is updated. Also good. Specifically, when the user selects a template frame that is not associated with the highest-order group among the template frames displayed on the frame selection screen 70, the setting condition for setting the highest-order group and the selected template are selected. The group associated with the frame is associated and stored in the image / group correspondence information 32. When the group associated with the setting condition is stored at a predetermined frequency or more, the association is performed according to the setting condition. The image / group correspondence information 32 is updated so that the current group is set as the highest-ranking group. Here, the predetermined frequency may be the number of times the new correspondence is stored (for example, 50 times). In this way, the image / group correspondence information 32 is used to preferentially set the group associated with the shooting date and time and the information about the person included in the image, but the user is associated with the highest ranking group. If a template frame that has not been selected is selected more than a predetermined frequency, the setting condition for setting the highest rank group and the group associated with the selected template frame are associated with each other and the image / group correspondence information 32 is obtained. It will be updated. In this way, for example, even when the association between the setting condition determined by the selected image and the group is dissociated from the actual situation, the image / group correspondence information 32 is reflected to reflect the usage situation of the user. Updating and associating the setting condition with the group closer to the actual situation, it is possible to preferentially present what is more suitable for the user's preference.

  In the above-described embodiment, the reception PC 20, the control PC 52, and the printer 60 are the minilab system 10 connected to the LAN 12. However, if the order of the template frames is set based on the selected image, For example, the reception PC 20 and the control PC 52 may be integrated, the control PC 52 and the printer 60 may be integrated, or the reception PC 20, the control PC 52 and the printer 60 may be integrated. . The print data need not be created by the receiving PC 20, but may be created by the control PC 52 or the printer 60, or may be created in cooperation with each other. In the above-described embodiment, the image processing apparatus using the reception PC 20 has been described. However, an image processing method or a program for executing the image processing method may be used.

  The present invention is applicable to the printing industry.

10 minilab system, 12 LAN, 14 memory card, 20 acceptance PC, 22 CPU, 23 ROM, 24 RAM, 25 HDD, 26 input device, 27 display, 28 network interface (I / F), 29 bus, 30 memory card reader 31 group priority information, 32 image / group correspondence information, 33 frame information, 34 frame priority information, 35 thumbnail, 36 frame data, 37 frame display program, 38 priority update program, 40 image data acquisition unit, 41 priority Rank setting unit, 42 selection screen creation unit, 43 display control unit, 44 instruction acquisition unit, 45 group usage frequency update unit, 46 frame usage frequency update unit, 47 group registration update unit, 48 arranged image creation unit, 49 printing process Part, 50 reception PC, 52 control PC, 60 printer, 62 CPU, 63 ROM, 64 RAM, 65 printing mechanism, 68 network interface (I / F), 70 frame selection screen, 71 cursor, 72 frame display field, 74 selection Value input section, 76 forward button, 78 back button.

Claims (11)

Storage means for storing a plurality of template frames for arranging images;
Display means for displaying an image;
Image data acquisition means for acquiring the selected image data;
Analyzing the image of the acquired image data, the shooting date and time, the number of selected images, the number of people included in the selected image as the analysis result, and the person area included in the selected image as the analysis result Priority order setting means for setting the order of the plurality of template frames so as to be suitable for the selected image based on at least one or more of the sizes;
Display control means for causing the display means to display the template frames in a selectable manner in the order of the set order,
The template frame is a group of at least one of a design frame in which two or more photos are designed and arranged, a photo frame that modifies a photo, a trip frame that is modified for travel, and an event frame that is modified for an event. Associated with,
The priority order setting means sets the order of the group based on at least one of the shooting date and time, the number of people included in the image, and the size of the person area, and the template is set according to the selected number of images. An image processing apparatus that sets the order of frames. The template frame is a group of at least one of a design frame in which two or more photos are designed and arranged, a photo frame that modifies a photo, a trip frame that is modified for travel, and an event frame that is modified for an event. Associated with,
The image processing apparatus according to claim 1 , wherein the priority order setting unit sets the order of the plurality of template frames based on at least one of the following conditions (1) to (6).
(1) When there is no image including a person in the selected image, the design frame group is set to a higher-order template frame.
(2) When the shooting date and time of the selected image are not related, the group of the design frames is set as a higher-order template frame.
(3) When the shooting date and time of the selected image is either within one day or consecutive days, and the image includes an image including a large number of people greater than or equal to a predetermined number, the event frame group is ranked higher Set to the template frame of rank.
(4) When the shooting date and time of the selected image is within one day or consecutive days, and the image includes an image in which the person area is smaller than a predetermined value, the event frame and the trip frame Set one of the groups to the higher-order template frame.
(5) When the shooting date and time of the selected image is within one day, and the image is an image including a small number of people less than a predetermined number of people and the person area is an image larger than a predetermined value, Set the group to a higher-order template frame.
(6) When the shooting date and time of the selected image is a consecutive day and the image is an image including a small number of people less than a predetermined number of people and the person area is larger than a predetermined value, the trip frame and the photo One of the frame groups is set as a higher-order template frame. Storage means for storing a plurality of template frames for arranging images;
Display means for displaying an image;
Image data acquisition means for acquiring the selected image data;
Analyzing the image of the acquired image data, the shooting date and time, the number of selected images, the number of people included in the selected image as the analysis result, and the person area included in the selected image as the analysis result Priority order setting means for setting the order of the plurality of template frames so as to be suitable for the selected image based on at least one or more of the sizes;
Display control means for causing the display means to display the template frames in a selectable manner in the order of the set order,
The template frame is a group of at least one of a design frame in which two or more photos are designed and arranged, a photo frame that modifies a photo, a trip frame that is modified for travel, and an event frame that is modified for an event. Associated with,
The storage means stores group priority information including a plurality of group priorities,
The image processing apparatus, wherein the priority order setting means sets the order of the plurality of template frames according to the priority order of the group included in the group priority order information. The image processing apparatus according to claim 3 ,
A group usage frequency updating unit that updates the group priority information by increasing the frequency of use of the group associated with the selected template frame after the user selects the template frame displayed on the display unit; Image processing device. The image processing apparatus according to claim 3 or 4 ,
The storage means stores frame information in which template frames and groups are associated with each other,
When the user selects a template frame that is not associated with the highest-order group among the template frames displayed on the display means, the use frequency of the highest-order group is increased with respect to the selected template frame. The frame information is updated, and then the frame information is updated by associating the unregistered group with the template frame when the frequency of use of the unregistered group not associated with the template frame exceeds a predetermined frequency. An image processing apparatus comprising registration update means. The storage means stores frame priority information including the priority of the template frame,
Said priority setting means sets a priority of said plurality of template frames according to the priority of the template frames included in the frame priority information, the image processing according to any one of claims 1 to 5 apparatus. The image processing apparatus according to claim 6 ,
An image processing apparatus comprising: a frame use frequency update unit that updates the frame priority information by increasing a use frequency of the selected template frame after a user selects a template frame displayed on the display unit. The image processing apparatus according to any one of claims 1 to 7 ,
The template frame is a group of at least one of a design frame in which two or more photos are designed and arranged, a photo frame that modifies a photo, a trip frame that is modified for travel, and an event frame that is modified for an event. Associated with,
The storage means stores image group correspondence information in which information on the shooting date and time of the selected image, information on a person included in the selected image, and a plurality of the groups are associated with each other.
The priority order setting means sets the shooting date and time, the number of selected images, the number of persons included in the selected image that is the analysis result, and the size of the person area included in the selected image that is the analysis result Set the priority of the group using the image group correspondence information as
When the user selects a template frame that is not associated with the highest-order group among the template frames displayed on the display means, the setting condition for setting the highest-order group is associated with the selected template frame. Are stored in association with each other, and when the setting condition and the associated group are stored more than a predetermined frequency, the group associated with the setting condition becomes the highest-ranking group. An image processing apparatus comprising: image group correspondence information updating means for updating image group correspondence information to be set. An image processing method using storage means for storing a plurality of template frames for arranging images and display means for displaying images,
(A) obtaining the selected image data;
(B) Performs analysis on the image of the acquired image data, and includes the shooting date and time, the number of selected images, the number of persons included in the selected image that is the analysis result, and the selected image that is the analysis result Setting the order of the plurality of template frames to be suitable for the selected image based on at least one or more information of the size of the person area;
(C) displaying the template frame in a selectable manner in the order of the set order on the display means,
The template frame is a group of at least one of a design frame in which two or more photos are designed and arranged, a photo frame that modifies a photo, a trip frame that is modified for travel, and an event frame that is modified for an event. Associated with,
In the step (b), the order of the group is set based on at least one of the shooting date and time, the number of people included in the image, and the size of the person area, and the template is set according to the selected number of images. An image processing method for setting the frame order. An image processing method using storage means for storing a plurality of template frames for arranging images and display means for displaying images,
(A) obtaining the selected image data;
(B) Performs analysis on the image of the acquired image data, and includes the shooting date and time, the number of selected images, the number of persons included in the selected image that is the analysis result, and the selected image that is the analysis result Setting the order of the plurality of template frames to be suitable for the selected image based on at least one or more information of the size of the person area;
(C) displaying the template frame in a selectable manner in the order of the set order on the display means,
The template frame is a group of at least one of a design frame in which two or more photos are designed and arranged, a photo frame that modifies a photo, a trip frame that is modified for travel, and an event frame that is modified for an event. Associated with,
The storage means stores group priority information including a plurality of group priorities,
In the step (b), the order of the plurality of template frames is set in accordance with the priority order of the group included in the group priority order information. A program for causing each step of the image processing method according to claim 9 or 10 to be realized by one or more computers.

Images