JP2012221005A - Image processing apparatus, photo book producing method and program for image processing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing apparatus, a photo book producing method and a program for an image processing apparatus which can reduce man-hours by a user when producing a photo book.SOLUTION: Layout information for multiple pieces of first image data and attribute information relating to photographic parameters for each piece of the first image data in a first photo book are acquired, and attribute information relating to photographic parameters for multiple pieces of second image data is also acquired. Based on the attribute information for each piece of the first image data and the attribute information for each piece of the second image data, each piece of the first image data is associated with respective pieces of the second image data. According to the acquired layout information, associated pieces of the second image data are laid out so as to generate photo book data for producing a second photo book.

Description

  The present invention relates to an image processing apparatus for creating a photobook, a photobook creation method in the image processing apparatus, and a program.

  With the spread of digital cameras and the development of computer technology and network technology, photo books are created on personal computers and are often submitted as digital data. Photobooks are often created using a dedicated editor or the like, and it is required to reduce the number of man-hours to create. Especially in events such as tour trips and weddings planned by traders, schedules, event contents, and photo shooting positions are determined, and images to be taken and photo books to be created are also patterned by each trader. In Patent Document 1, for example, when an album is created at a wedding event, composition information representing the composition of an image to be inserted is recorded in the image insertion area of the template on the album editing screen. The composition information includes, for example, the type of subject included in the image to be inserted, the position of the subject in the image, the color of the subject, and the like. In Patent Document 1, the composition information of the image insertion area is referred to, the inserted image is processed, and the image is inserted into the image insertion area.

JP 2005-182767 A

  However, in Patent Document 1, it is necessary to select a shooting scene and edit the configuration of the entire photobook every time a photobook is created.

  An object of the present invention is to solve such conventional problems. An object of the present invention is to provide an image processing apparatus, a photobook creation method in the image processing apparatus, and a program that reduce the man-hours of the user in creating a photobook.

In order to solve the above problems, an image processing apparatus according to the present invention acquires layout information of a plurality of first image data in a first photobook and attribute information regarding shooting parameters of each of the first image data. A first acquisition means;
Second acquisition means for acquiring attribute information relating to imaging parameters of a plurality of second image data;
Based on the attribute information of each first image data acquired by the first acquisition means and the attribute information of each second image data acquired by the second acquisition means, each of the first image data Association means for associating the second image data with the second image data;
According to the layout information acquired by the first acquisition means, photobook data for generating a second photobook by laying out the second image data associated by the association means is generated. And generating means.

  ADVANTAGE OF THE INVENTION According to this invention, a user's man-hour can be reduced in preparation of a photobook.

The figure which shows the structure of an image processing apparatus. The figure which shows a network structure. The figure which shows the functional block of an application program. The figure which shows the image of a sightseeing spot and its photography spot. The figure for demonstrating creation of a photo book. The figure which shows an example of the editor which sets an image frame and an image. The figure which shows the photobook created before and the photobook created automatically. The figure which shows the correspondence of two images based on positional information. The figure for demonstrating the imaging | photography timing on a schedule. The figure for demonstrating creation of a photo book. The figure for demonstrating the procedure of the photobook creation in a present Example. The figure for demonstrating the matching based on progress of time. The figure for demonstrating the matching based on progress of time in case there exist multiple images. The figure which shows an example which is not matched based on progress of time. The figure which shows the matching based on time passage when the image is grouped. The flowchart which shows the procedure of the photobook creation in a present Example. The flowchart which shows the procedure of the determination process of matching based on progress of time. The figure which shows an example of the screen which sets the conditions of matching of an image. The figure for demonstrating allocation of the imaging | photography time accompanying a schedule change.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the following embodiments do not limit the present invention according to the claims, and all combinations of features described in the present embodiments are not necessarily essential to the solution means of the present invention. . The same constituent elements are denoted by the same reference numerals, and the description thereof is omitted.

  FIG. 1 is a diagram illustrating a configuration of an image processing apparatus according to an embodiment of the present invention. In FIG. 1, the computer includes a CPU 102, a memory 103, a storage unit 104, a display control unit 105, an input / output (hereinafter abbreviated as I / O) interface 106, and a communication interface 107. Each component is connected to the system bus 101. The CPU 102 is a central processing unit that controls each component via the system bus 101 and performs data calculation and processing. The memory 103 stores data and programs, and a random access memory (RAM), a read only memory (ROM), or the like is used. The storage unit 104 writes / reads stored data. As the storage unit 104, a hard disk drive 111, a floppy (registered trademark) disk drive 112, a CD-ROM drive 113 used as a nonvolatile data source, and the like are used. Although not shown in the drawing, a magnetic tape drive, DVD-ROM, USB memory, or the like may be used as the storage unit 104.

  The program shown as the present embodiment is read from the storage unit 104, stored in the memory 103, and executed by the CPU 102. In this embodiment, the program is read from the storage unit 104. However, the program may be read from the ROM or read from the outside via the communication interface 107. The display control unit 105 controls display output to the display unit 114. A display method of the display unit 114 includes CRT, liquid crystal, and the like. Input devices such as a keyboard 115 and a pointing device 116 are connected to the I / O interface 106. The operator issues an operation command to the system by operating the keyboard 115. The pointing device 116 moves the cursor on the display unit 114 to perform selection and operation of menus and objects. The communication interface 107 communicates with an external device via the network 117. The connection destination network includes a public line such as LAN, WAN, and the Internet. The communication interface 107 also communicates with an output device such as the printer 118.

  FIG. 2 is a diagram illustrating a network configuration in the present embodiment. A client personal computer (hereinafter referred to as a client PC) 202 and a server computer 203 (hereinafter referred to as a server) are connected to the network 201. Examples of the network 201 include a LAN, a WAN, and the Internet. The client PC 202 communicates with the server 203 via the network 201. An application program that implements the operation of the present embodiment may operate on the server 203 or the client PC 202. In the case of a configuration that operates on the server 203, an editor screen for editing photobook data is displayed on the client PC 202. The editor is displayed by a Web browser or by installing a client application.

  FIG. 3 is a diagram illustrating functional blocks of an application program that implements the operation of the present embodiment. The operation flow of this embodiment will be described. The image information of the previously created photobook is compared with the newly captured image information, and images corresponding to the same shooting scene are associated with each other. Then, a photo book is created in which the newly photographed image is arranged in the same layout as the associated image on the previously created photo book.

  The photobook data analysis unit 301 analyzes the configuration of a previously created photobook. The image attribute information acquisition unit 302 acquires image frame and image attribute information analyzed by the photobook data analysis unit 301. The attribute information comparison unit 303 compares the attribute information of the image acquired by the image attribute information acquisition unit 302 with the attribute information of the newly captured image, and associates images of the same shooting scene. The image arrangement unit 304 arranges a new image associated by the attribute information comparison unit 303 based on the layout information of the associated image on the previously created photobook. In this case, the image frame layout information acquired by the image attribute information acquisition unit 302 is reflected. The photo book data creation unit 305 creates new photo book data based on the contents of the photo book data analysis unit 301. Then, after the image is arranged by the image arrangement unit 304, unnecessary image frames and pages are deleted, the photobook style is applied, and the photobook data is created.

  An example of creating a photo book based on position information will be described with reference to FIGS. FIG. 4 is an image diagram showing a shooting spot of a sightseeing spot. FIG. 4 shows a sightseeing spot such as a park as an example, and 401, 402, 403, and 404 represent buildings, gardens, fountains, and objects. The camera icons indicated by reference numeral 411 each indicate a shooting spot. The numbers appended to the camera icons correspond to the image numbers shown in FIG.

  FIG. 5 is a diagram illustrating an example of the created photobook data. FIG. 5A shows a state at the start of creation, and FIG. 5B shows a state in which creation has been completed. From the state where nothing is set as shown in FIG. 5A, image placement is performed in consideration of image trimming and layout. Also, pages are added according to the number of images and layout, and finally photobook data as shown in FIG. 5B is created. Reference numeral 501 denotes an arranged image, and the numbers correspond to the shooting spot numbers in FIG. Reference numeral 502 denotes an image layout using a spread page. An example of using a spread page is a group photo on a tour trip or an image of an event to be highlighted. In 506, the image orientation is set as a portrait. The image layout is determined in consideration of the characteristics of each tourist spot. For example, the images 7 to 10 are a collection of images at the same place, and are grouped in one spread page. In this way, the arrangement of images is not determined only by the shooting scene for each image, but can be determined in consideration of the characteristics of each tourist spot and the balance with other captured images. It is a feature.

  FIG. 6 is a diagram for explaining an editor for editing or creating photobook data, and shows an example in which an image frame and an image are set. Reference numeral 601 denotes a photobook data page, reference numeral 602 denotes an image frame, and dotted line 603 denotes the position and size of the image with respect to the image frame 602. An image frame 602 represents a display image after the image 603 is trimmed, and is an area that is actually displayed in a photo book. The image frame holds information such as the size of the frame, the arrangement position with respect to the page, and the position from the image indicating the trimming position on the image. Although FIG. 6 shows an example in which position information is expressed in units of pixels, it may be displayed in a ratio in consideration of a difference in image resolution depending on the photographing apparatus. The photobook data created here will serve as a template for creating a photobook later. Therefore, instead of arranging the trimmed image on the page, it has information on both the image 603 and the image frame 602 so that the trimming position can be readjusted when another image is arranged. . The operator can readjust the trimming position by moving the image frame 602 and the image 603 on the editor.

  FIG. 7 is a diagram showing an example of photobook data automatically created based on previous photobook data. FIG. 7A is a diagram showing an example of photobook data (first photobook data) created before, and here, the same diagram as the photobook data of FIG. 5B is shown. FIG. 7B shows an example of photobook data (second photobook data) automatically created based on the photobook data shown in FIG. 7A using a newly taken image.

  The content of tour tours planned by traders is determined in advance, and the images to be taken are often taken in the same way and at the same position. The number of the image inserted in FIG. 7B is associated with the number of the photographing spot in FIG. 4 and also associated with each image of FIG. 7A previously photographed. . Both the image 701 and the image 711 in FIG. 7 are taken at the photographing spot 411 in FIG. In the present embodiment, the image 701 (first image data) and the image 711 (second image data) are automatically associated with each other by comparing attribute information relating to image capturing parameters. The attribute information related to the shooting parameter is, for example, a shooting time, which will be described later.

  FIG. 8 is a diagram illustrating the attribute information of the image 701 and the image 711 and the correspondence relationship based on the attribute information. The image 701 and the image 711 each have position information attribute information such as latitude, longitude, altitude, and direction. In this embodiment, it is determined whether or not both images have been shot at the same shooting spot based on whether or not the position information matches. However, since some errors appear in the position information in practice, the determination including the errors is performed. The image 711 is arranged on new photobook data in accordance with the page position, composition, and layout information of the associated image 701. At this time, the image frame shown in FIG. 6 is also created. Similar to the image 711, the other images in FIG. 7 are also associated and arranged on new photobook data. As a result, the photobook data shown in FIG. 7B is automatically generated.

  Next, an example of creating a photo book based on the passage of time will be described with reference to FIGS. The position information described in FIGS. 4 to 8 cannot be acquired if the photographing apparatus is not compatible or GPS (Global Positioning System) information cannot be received. Perform the association.

  FIG. 9 is a diagram for explaining the shooting timing on the schedule. 901 in FIG. 9 represents a schedule item, which indicates that there are schedules S1 to S6. A camera icon indicated by 911 indicates a predetermined shooting time according to the schedule. Numbers 1 to 6 appended to each camera icon correspond to the numbers 1 to 6 of the image shown in FIG. The time axis advances from the left to the right, and the time added below each camera icon indicates the shooting time.

  FIG. 10 is a diagram illustrating an example of the created photobook data. Similar to FIG. 5, FIG. 10A shows a state at the start of creation, and FIG. 10B shows a state where creation is completed. Reference numeral 1001 denotes an arranged image, and the numbers correspond to the numbers of the respective photographing timings shown in FIG. The image layout is determined in consideration of the characteristics of each event. The arrangement of images is not determined only by the shooting scene of each image, but is characterized in that it is determined in consideration of the characteristics of each event and the balance with a plurality of other images taken.

  FIG. 11 is a diagram for explaining an example of a photobook automatically created based on a previous photobook and image association based on the passage of time. The photo book data 1100 is an example of previously created photo book data, and here, the same diagram as the photo book data of FIG. 10B is shown. Reference numeral 1130 denotes an example of photobook data automatically created based on 1100 photobook data using a newly taken image. For example, an event such as a wedding has a predetermined schedule, and images to be taken are often taken in the same manner at the same timing. The image numbers inserted in the photobook data 1130 correspond to the shooting timing numbers shown in FIG. 9, respectively, and are also associated with the images of the photobook data 1100 previously shot.

  The image association shown in FIG. 11 will be described with reference to the flowchart of FIG. The flowchart shown in FIG. 16 is executed by the CPU 102, for example. The CPU 102 first acquires the shooting times of the images laid out in the previous photobook data 1100, and rearranges them with the passage of time (S1601: one example of first acquisition). 1111 to 1116 in FIG. 11 conceptually represent images rearranged in S1601. Next, the CPU 102 acquires newly captured images (an example of image data acquisition), acquires their shooting times (an example of second acquisition), and rearranges them with the passage of time (S1602). 1111 to 1126 in FIG. 11 conceptually represent images rearranged in S1602. Next, the first date and time of rearrangement is set as the start date and time (S1603). This provides a starting point for calculating the elapsed time. For example, June 10th 10:00 of the image 1111 and June 20th 14:00 of the image 1121 are set as starting points, and the images of the starting points are associated with each other. Then, images that have passed the same time from the starting point are associated with each other. For example, the image 1112 and the image 1122 are images at the time when 20 minutes have elapsed, and are associated with each other. The associating process is a process after S1604 in FIG. 16 and loops for the images included in the previous photobook data (S1604), and for each image included in the previous photobook data, a newly captured image is obtained. A corresponding image is acquired from the inside (S1605).

  In actuality, since the elapsed times rarely coincide completely, the association is performed in consideration of the time difference. FIG. 12 is a diagram illustrating the association in consideration of the time tolerance. The left and right lines shown in FIG. 12 represent the allowable range of time difference. Although the images 1201 and 1202 have a difference of two minutes in the elapsed time, but are within the allowable range, the elapsed times are considered to match. Images 1113 and 1123 and images 1114 and 1124 in FIG. 11 are associated with each other within an allowable time difference range. In addition, when there are a plurality of images within the allowable range, the ones with close elapsed time are associated with priority. FIG. 13 shows that there are two images 1302 and 1303 that can be associated with the image 1301. In that case, since the elapsed time of the image 1303 is closer, the image 1301 is associated with the image 1303. However, not only the determination method that the elapsed time is near, but also the one with the earlier time may be selected. In addition, when there is no image within the allowable range of time difference, no association is performed. In FIG. 14, an image 1401 is shown as an image having the closest elapsed time, but is not within the allowable range, and thus is not associated with each other. In this case, in the flowchart of FIG. 16, the CPU 102 determines that no image is acquired (S1606), and sets that there is no corresponding image (S1609). Although not shown in this flowchart, the association may be performed again by changing the allowable range for an image that has not been associated. Thereby, the image which cannot be matched can be reduced more.

  Images 1115 and 1125 in FIG. 11 indicate that association is performed as a group. Group setting is performed in the photobook data 1100. The group is set when the date and time are approaching and there are a plurality of images in the same shooting scene. When group setting is performed, an allowable range of time difference can be set for each group, and association between the groups is performed. An image 1501 in FIG. 15 is a diagram showing a plurality of images set as a group. Mutual association is performed for the number of images set in the group within the allowable range of time difference as a group.

  After the association is performed as described above, the CPU 102 acquires the image configuration and layout information of the previous photobook data (S1607) for the image acquired in association (S1606). Thereafter, an image is set based on the image configuration and layout information (S1608). In S1608, for example, the image 1121 shown in FIG. 11 is set and laid out as an image 1131 based on the image configuration of the previous photobook data and the layout information of the image 1101. The other images 1122 to 1126 are similarly laid out, and photobook data 1130 is created (an example of photobook creation).

  FIG. 17 is a flowchart showing the procedure of the process in S1605 of FIG. When acquiring an image to be associated, the CPU 102 first acquires the elapsed time of the image information of the previous photobook (S1701), and whether or not the newly captured image is associated with an image that has not yet been associated. Are determined (S1702). Specifically, the CPU 102 acquires the elapsed time of the captured image (S1703), calculates the difference from the elapsed time of the image acquired in S1701 (S1705), and if the difference is within the allowable range (S1705). S1705), it is regarded as an associated image (S1706).

  As described above, in this embodiment, when the same photobook data is created with a different image from the previously created photobook data, the photobook data can be created automatically, and the man-hours of the operator Can be reduced. Note that after the photobook data is automatically created, it can be adjusted and updated by an editor shown in FIG. If there are more shooting scenes than in the previous photo book, they can be added manually. On the other hand, if there are fewer shooting scenes, the image frames and pages can be deleted automatically or manually.

  FIG. 18 is an example of a setting screen for conditions for associating images. Check boxes 1811, 1821, and 1831 represent conditions related to position information, and check box 1841 represents conditions related to the passage of time. A check box 1851 represents a condition regarding scene information set by the photographing apparatus. In addition to this figure, it may be configured such that conditions based on attribute information of various images such as the vertical and horizontal orientations of the image can be set. A plurality of conditions can be specified, and both a condition regarding position information and a condition regarding the passage of time can be specified. In this case, after associating with the passage of time, processing for confirming the association based on the position information is performed before S1706 in FIG.

  The order of event schedules may be changed for convenience. FIG. 19 is a diagram illustrating a case where the schedule order is changed. FIG. 19B shows that the schedule 1905 in FIG. 19A has been moved forward. When the schedule 1905 is changed to the schedule 1925, the shooting times 1913, 1914, and 1915 are newly assigned to the images as shooting times 1933, 1934, and 1935, respectively, based on the length of the schedule 1925 and the travel time. In FIG. 19 (a), for example, what was planned to be taken at S12: 00 at S5 was changed after S2, so the shooting time is newly assigned as 10:30. Then, after S3, new shooting times are sequentially assigned in consideration of the difference from the shooting time with S4.

  In the case of performing association based on elapsed time, appropriate association is not performed if the predetermined schedule order is changed. However, if the length and movement time of each schedule to be changed are specified, the shooting time of each image set in the previously created photobook data can be automatically adjusted. As a result, even after the schedule is changed, the association process as shown in FIGS. 16 and 17 becomes possible. Referring to FIG. 11, by specifying the length of the schedule to be changed and the moving time, the shooting times of the images 1111 to 1116 are automatically adjusted, and the correspondence with newly taken images 1121 to 1126 Make sure that the attachment is done properly. Further, when adjustment is performed, the positions of the image 603 and the image frame 602 of the photobook data 1100 can be moved in conjunction with each other. As a result, even when the order of the event schedule is changed, photobook data can be automatically created.

  In the above description, the image attribute information and the layout information held by the photobook data are separated. However, the image attribute information may be collectively held on the photobook data side. In addition, a configuration may be provided in which previously created photobook data is acquired as a template and reused as a photobook template.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

Claims (6)

First acquisition means for acquiring layout information of a plurality of first image data in the first photo book and attribute information relating to shooting parameters of each of the first image data;
Second acquisition means for acquiring attribute information relating to imaging parameters of a plurality of second image data;
Based on the attribute information of each first image data acquired by the first acquisition means and the attribute information of each second image data acquired by the second acquisition means, each of the first image data Association means for associating the second image data with the second image data;
According to the layout information acquired by the first acquisition means, photobook data for generating a second photobook by laying out the second image data associated by the association means is generated. An image processing apparatus comprising: generating means for performing   The image processing apparatus according to claim 1, wherein the attribute information is a shooting time of image data.   The associating means includes a first image data and a second image in which a difference between a shooting time of each of the first image data and a shooting time of each of the second image data is within a predetermined allowable range. The image processing apparatus according to claim 2, wherein data is associated with the image processing apparatus. Changing means for changing the order of the plurality of first image data based on the shooting time of each of the first image data;
An assigning unit that assigns a photographing time to each of the first image data according to the changed order;
The image processing apparatus according to claim 3, wherein the association unit associates the first image data to which the photographing time is assigned by the assignment unit with the second image data. A photobook creation method executed in an image processing apparatus,
First acquisition means for acquiring a plurality of pieces of first image data layout information in the first photobook and attribute information relating to shooting parameters of each of the first image data. Process,
A second acquisition step in which a second acquisition unit of the image processing apparatus acquires attribute information relating to imaging parameters of a plurality of second image data;
The association unit of the image processing apparatus includes the attribute information of each of the first image data acquired in the first acquisition step and the second image data acquired by the second acquisition unit. An association step of associating the first image data with the second image data based on the attribute information;
The generation unit of the image processing device lays out the second image data associated in the association step according to the layout information acquired in the first acquisition step, and generates a second photobook. And a generation step of generating photobook data for generation.   The program which makes a computer perform each process of the photobook production method of Claim 5.

Images