WO2015093385A1

WO2015093385A1 - Album generation device, album generation method, album generation program and recording medium that stores program

Info

Publication number: WO2015093385A1
Application number: PCT/JP2014/082823
Authority: WO
Inventors: 栄輝山岸
Original assignee: 富士フイルム株式会社
Priority date: 2013-12-18
Filing date: 2014-12-11
Publication date: 2015-06-25
Also published as: JP2015118522A

Abstract

Provided are an album generation device that can reduce load, an album generation method, a control program therefor and a recording medium that stores the program. An image file sent from a PC (21) is received at an album generation server (1) (step 51). If album generation pre-processing has not been done on the subject image of the received image file (if step 52 is NO), pre-processing is performed (step 53). If pre-processing has been done (if step 52 is YES), the pre-processing step is skipped. For the pre-processed subject image, the subject image to be pasted into an album is determined, and a layout is determined (steps 54, 55). An album is generated in accordance with the layout (step 56). The load on the album generation server (1) can be lightened by causing pre-processing to be carried out at times when access to the album generation server (1) is not concentrated.

Description

Album generating apparatus, album generating method, album generating program, and recording medium storing the program

The present invention relates to an album generating apparatus, an album generating method, an album generating program, and a recording medium storing the program.

アルバム In order to show parents the growth of children at home, the album generation time for electronic albums is often concentrated before the homecoming time. In the case of creating an album by uploading image data to the server, access to the server will be concentrated before returning home. For this reason, the provision information update cycle is changed from the load information of the server, and even when the load on the server is concentrated, the real-time property is apparently maintained (Patent Document 1). In addition, there are those that increase the service price during the time when access to the server is concentrated (Patent Document 2), and those that use a mirror server (Patent Document 3).

JP 2000-115166 JP JP 2005-332133 A JP 2004-304698 A

The one described in Patent Document 1 does not reduce the load if it does not provide information to the user. Moreover, in the thing of patent document 2, the number of album orders at the time of access concentration decreases. Furthermore, in the thing of patent document 3, since a mirror server is required, it will cost.

An object of the present invention is to reduce the load on the server at the time when access to the server is concentrated.

The album generating apparatus according to the first aspect of the present invention determines whether or not pre-processing other than the pasting process is performed on the subject image in the album generating process including the pasting process of pasting the subject image on the mount image representing the mount of the album. Pre-processing determining means, pre-processing determining means for performing pre-processing of the subject image when the pre-processing determining means determines that pre-processing has not been performed on the subject image, and pre-processing by the pre-processing determining means The image processing apparatus includes a pasting processing unit that pastes the subject image determined to have been performed and the subject image pre-processed by the pre-processing unit to the mount image.

The first invention also provides an album generation method. That is, the pre-processing determining means determines whether pre-processing other than the pasting process is not performed on the subject image in the album generating process including the pasting process of pasting the subject image on the mount image representing the album mount. The pre-processing means performs pre-processing of the subject image in response to the pre-processing determining means determining that the pre-processing is not performed on the subject image, and the pasting processing means performs pre-processing by the pre-processing determining means. The subject image determined to have been performed and the subject image pre-processed by the pre-processing means are pasted on the mount image.

The first invention also provides a program for controlling the computer of the album generating apparatus and a recording medium storing the program.

The pre-processing means performs pre-processing on a subject image that is determined not to be pre-processed in response to, for example, a pre-processing execution command being given.

The pasting processing unit pastes according to the result of the pre-processing among the subject image determined to be pre-processed by the pre-processing determining unit and the subject image pre-processed by the pre-processing unit. You may further provide the selection means to select a to-be-photographed image. In this case, the subject image selected by the selection means will be pasted on the mount image.

The apparatus may further include a load status detection unit that detects the load status of the album generation apparatus. In this case, the pre-processing means will perform pre-processing according to the fact that the load status detected by the load status detection means indicates a load equal to or less than a threshold value.

Also, pre-processing may be performed at a time, date, or time when the load status of the album generating apparatus is considered to be a load below a threshold value.

Subject image data receiving means for receiving subject image data representing the subject image may be provided. In this case, the pre-processing means will perform pre-processing in response to the subject image data received by the subject image data receiving means.

The pre-processing is subject recognition processing for recognizing the subject content represented by the subject image, for example. In this case, it may further comprise layout determining means for determining a layout for pasting the subject image on the mount image based on the result of the subject recognition processing for the subject image subjected to the subject recognition processing. In this case, the pasting processing unit will paste the subject image on the mount image with the layout determined by the layout determining unit, for example.

The subject recognition process will include at least one of a face detection process, a person detection process, a process for recognizing a specific person, or a process for recognizing an imaging scene, for example. The recognition of imaging scenes is specifically known for processing such as indoor / outdoor recognition, night view / evening view / daytime / under tungsten light / under fluorescent light, and scenery / nature / underwater recognition. Yes. Further, an image capturing scene of an image may be recognized using image tag information such as GPS (global positioning system) information, imaging date and time information, and imaging mode information such as macro imaging.

The pre-processing determining means determines, for example, whether or not the pre-processing is performed on the subject image based on information stored in the same file as the file storing the subject image data.

The pre-processing determining unit may determine whether or not pre-processing is performed on the subject image based on information associated with the file that stores the subject image data.

The information and the file can be associated based on a combination of the file name of the file and the hash value of the subject image, or a combination of the file name of the file and the imaging date and time of the subject image.

Also, the information and the file can be associated based on the combination of the file name of the file and the user identification data.

The above-described means may be implemented in a manner shared by a plurality of servers and businesses. For example, the first server may include pre-processing determination means and the pre-processing means, and the second server may include sticking processing means.

The first server may further include first receiving means for receiving subject image data. In this case, the pre-processing determining unit will determine whether or not pre-processing is being performed on the subject image represented by the subject image data received by the first receiving unit. The first server preferably has pre-processed subject image data processed by the pre-processing unit, pre-processed subject image data determined to be pre-processed by the pre-processing determination unit, and data indicating a pre-processing result. Is further provided to the second server. The second server further includes second receiving means for receiving the pre-processed subject image data and data indicating the pre-processing result transmitted from the transmitting means of the first server, and the pasting process of the second server The means will paste the subject image represented by the pre-processed subject image data on the mount image based on the data indicating the pre-processing result received by the second receiving means.

Alternatively, the first server may include pre-processing determination means, the second server may include pre-processing means, and the third server may include sticking processing means.

The first server may further include first transmission means for transmitting data indicating the preprocessing determination result in the preprocessing determination means to the second server. In addition, the second server may include first receiving means for receiving data indicating the preprocessing determination result transmitted from the first transmitting means of the first server. In this case, the pre-processing unit of the second server responds to the determination that the subject image is not pre-processed based on the data indicating the pre-processing determination result received by the first receiving unit. , Pre-processing of the subject image will be performed. The second server further includes second transmission means for transmitting data indicating the pre-processing result in the pre-processing means and subject image data that has been pre-processed to the third server. Further, the third server preferably further includes second receiving means for receiving data indicating the pre-processing result transmitted from the transmitting means of the second server and pre-processed subject image data. The sticking processing means of the third server is configured to mount the subject image represented by the preprocessed data received by the second receiving means of the third server based on the preprocessing result indicated by the data indicating the preprocessing result. It will be pasted on the image.

The first server may include transmission means for transmitting the subject image data and the determination result in the pre-processing determination means to the second server. In this case, the pre-processing unit provided in the second server will perform the pre-processing on the subject image determined that the pre-processing is not performed based on the determination result in the pre-processing unit.

The first server transmits the subject image data determined by the preprocessing determination means that the preprocessing is not performed to the second server, and the subject image data determined that the preprocessing is performed You may make it further provide the transmission means which transmits a pre-processing result to a 3rd server.

Storage means for storing subject image data preprocessed by the preprocessing means and data indicating the preprocessing result, subject image data determined to be preprocessed by the preprocessing determination means, and a read command In response to this, the image processing apparatus may further include a reading control unit that supplies the subject image data stored in the storage unit and data indicating the pre-processing result to the pasting processing unit.

Storage means for storing subject image data preprocessed by the preprocessing means and data indicating the preprocessing result, subject image data determined to be preprocessed by the preprocessing determination means, and storage means An album generation command determination means for determining whether or not an album generation command using the subject image data stored in is provided. In this case, the layout determination unit pastes the subject image on the mount image based on the pre-processing result stored in the storage unit in response to the determination that the album generation command is given by the album generation command determination unit. The layout will be determined.

A receiving server for receiving subject image data may be further provided. In this case, the preprocessing determination means will determine whether or not preprocessing has been performed on the subject image represented by the subject image data received at the receiving server.

The album generating apparatus according to the second invention determines that pre-processing other than the pasting process is not performed on the subject image in the album generating process including the pasting process of pasting the subject image on the mount image representing the mount of the album. The subject image data that has been subjected to preprocessing and the subject image data that has been determined to be preprocessed, and the subject image data that has been received by the receiver, The image processing apparatus includes a pasting processing unit that pastes the subject image on the mount image.

The second invention also provides an album generation method. That is, in this method, it is determined that the preprocessing except for the pasting process is not performed on the subject image in the album generating process including the pasting process in which the receiving unit pastes the subject image on the mount image representing the mount of the album. The subject image data that has been subjected to the pre-processing and the subject image data that has been determined to have been subjected to the pre-processing are received, and the pasting processing means uses the subject image data received by the receiving means. The represented subject image is pasted on the mount image.

The second invention also provides a program for generating an album and a recording medium storing the program.

The receiving means is performed when it is determined that pre-processing other than the pasting process is not performed on the subject image in the album process including the pasting process of pasting the subject image on the mount image representing the mount of the album. , A set of subject image data that has been pre-processed and a pre-processing result, and a set of subject image data that has been determined to be pre-processed and a pre-processing result may be received. In this case, it is preferable that the image processing apparatus further includes a selection unit that selects a subject image to be pasted on the mount image based on the pre-processing result received by the reception unit, based on the subject image data received by the reception unit. The pasting processing unit will paste the subject image selected by the selection unit onto the mount image.

According to a third aspect of the present invention, the album generating apparatus determines whether or not the pre-processing excluding the pasting process is performed on the subject image data in the album generating process including the pasting process of pasting the subject image on the mount image representing the album mount. Preprocessing determining means for determining, preprocessing means for performing preprocessing on subject image data determined not to be preprocessed by the preprocessing determining means, and subject image data for which preprocessing has been performed in the preprocessing means, The pre-processing result is transmitted to the album creation processing apparatus that performs the pasting process, and the subject image data determined to be pre-processed by the pre-processing determination unit and the pre-processing result are transmitted to the album creation processing apparatus. It is characterized by having a transmission means.

The third invention also provides an album generation method. That is, in this method, in the album generation process including the pasting process in which the preprocessing determining unit pastes the subject image on the mount image representing the album mount, the preprocessing excluding the pasting process is performed on the subject image data. The pre-processing means performs pre-processing on the subject image data determined not to be pre-processed by the pre-processing determination means, and the transmission means performs subject processing on which the pre-processing means has been pre-processed. The image data and the pre-processing result are transmitted to the album creating processing apparatus that performs the pasting process, and the subject image data and the pre-processing result determined to be pre-processed by the pre-processing determining unit are generated in the album creating process To be sent to the device.

The third invention also provides a program for generating an album and a recording medium storing the program.

An album generating apparatus according to a fourth aspect of the invention determines whether pre-processing other than the pasting process is performed on a subject image among album generating processes including a pasting process of pasting a subject image on a mount image representing an album mount. The pre-processing determining means, and the subject image data determined not to be pre-processed by the pre-processing determining means are transmitted to the pre-processing device that performs the pre-processing, and the pre-processing determining means performs the pre-processing. The image forming apparatus includes a transmission unit that transmits the subject image data determined to be and the pre-processing result thereof to an album creation processing apparatus that performs the pasting process.

The fourth invention also provides an album generation method. That is, the pre-processing determining means determines whether pre-processing excluding the pasting processing is performed on the subject image among the album generation processing including pasting processing for pasting the subject image on the mount image representing the album mount, The transmission unit transmits the subject image data determined to be not pre-processed by the pre-processing determination unit to a pre-processing device that performs pre-processing, and the pre-processing determination unit performs pre-processing. The determined subject image data and its pre-processing result are transmitted to an album creation processing apparatus that performs pasting processing.

The fourth invention also provides a program for generating an album and a recording medium storing the program.

According to the first invention, it is determined whether or not the pre-processing other than the pasting process is performed in the album generating process. If it is determined that pre-processing has not been performed, pre-processing of the subject image is performed. The subject image determined to be pre-processed and the subject image that has been pre-processed are pasted onto the mount image to generate an album. Since it is possible to adjust the time when the pre-processing is performed on the subject image that has not been subjected to the pre-processing, the pre-processing can be performed when the access to the album generating apparatus is low. Also in the second aspect, by receiving the subject image data that has been pre-processed, the subject image represented by such subject image data can be pasted on the mount image. Also in the third aspect of the invention, since it is possible to adjust the time when the pre-processing is performed on the subject image that has not been pre-processed, the pre-processing can be performed when the access to the album generating apparatus is low. . In the fourth aspect of the invention, the subject image that has not been pre-processed is transmitted to the pre-processing device that performs the pre-processing so that the pre-processing is performed when access to the album generating device is low. Will be able to. The pre-processing is performed before the process of pasting the subject image on the mount image. However, the subject image data is received, and the subject image represented by the received subject image data is pasted on the mount image. If pre-processing may be performed in response to the reception of the subject image data (immediately after reception), the pre-processing may be performed at a time when the load on the album generation apparatus (server) that performs the pre-processing is low. It may be done. Also, a history of the time when the subject image is pasted on the mount image is created, and the time when the request for pasting the subject image onto the mount image (album generation request time) is predicted from the history, and the time of the predicted time Pre-processing may be performed before.

An overview of the album generation system is shown. It is a block diagram which shows the electric constitution of an album production | generation server. It is an example of a to-be-photographed image. It is an example of a to-be-photographed image. The file structure of an image file is shown. It is an example of a management information table. It is a flowchart which shows the process sequence of an album production | generation system. It is a flowchart which shows the process sequence of an album production | generation server. It is a flowchart which shows the process sequence of an album production | generation server. 2 shows a configuration example of an album generation server. 2 shows a configuration example of an album generation server. 2 shows a configuration example of an album generation server. 2 shows a configuration example of an album generation server.

FIG. 1 shows an embodiment of the present invention and shows an outline of an album generation system.

The album generation system includes an album generation server (album generation apparatus) 1, a personal computer 21, and a smartphone 22. The album generation server 1, the personal computer 21 and the smartphone 22 can communicate with each other via a network such as the Internet.

The user transmits the image file to the album generation server 1 by using the personal computer 21 and the smartphone 22 (not to mention the personal computer 21 and the smartphone 22). When the image file is received by the album generation server 1, an album (either an electronic album or a paper album) is generated in the album generation server 1. Alternatively, the user may upload an image file in advance to an image file server or the like, and transmit the image file stored in the image file server to the album generation server 1.

FIG. 2 is a block diagram showing an electrical configuration of the album generation server 1.

The overall operation of the album generation server 1 is controlled by the CPU 2.

A memory card reader 4 is connected to the album generation server 1. The memory card reader 4 reads data stored in the memory card 3 and writes data to the memory card 3. Done. A CD (compact disc) drive 8 is also connected to the album generation server 1, and reading of data recorded on the CD 7 and writing of data onto the CD 7 are performed by the CD drive 8.

The album generation server 1 also includes a printer 5 for generating a paper album and a clock 6 for timing. The album generation server 1 also includes a memory 10 for storing data and the like, a hard disk 12, and a hard disk drive 11 for accessing the hard disk 12. Further, the album generation server 1 also includes a communication device 13 for connecting to the network.

The CD 7 storing a program to be described later is read by the CD drive 8, and the read program is installed in the album generation server 1, whereby the album generation server 1 operates as described below. However, instead of reading the program from the recording medium such as the CD 7, the program transmitted via the network may be received and the received program may be installed in the album generation server 1.

FIG. 3 is an example of a subject image affixed to the album.

The subject image 30 includes a plurality of persons. The user transmits an image file representing such a large number of subject images 30 to the album generation server 1 using the personal computer 21 or the like. The subject image 30 may be captured by the user or may not be captured by the user. Needless to say, an album may be generated using a subject image including only one person or a subject image not including a person.

FIG. 4 is an example of a subject image 30 that has undergone face detection processing.

When face detection processing is performed on the subject image 30 by the CPU 2,

face image portions

31, 32, and 33 are detected.

The album generation process includes various pre-processes in addition to the process of pasting the subject image on the mount image representing the mount that constitutes the album. Examples of pre-processing include processing to detect a face from a subject image, processing to detect a person from the subject image, processing to recognize who a person is in the subject image, There are processes to recognize, but what is pre-processed depends on the type of album generation process.

The pre-processing may be performed by the user using the personal computer 21 or other devices, or may not be performed by the user. When an image file representing a subject image that has not been subjected to pre-processing necessary for album generation is transmitted to the album generation server 1, such pre-processing is performed in the album generation server 1.

FIG. 6 shows an example of the file structure (data structure) of an image file.

The image file includes a header recording area and a data recording area.

The subject image data representing the subject image is stored in the data recording area. In the header recording area, management information (information) of data recorded in the data recording area is stored. The header recording area stores an image file name, a user ID (user identification data), an imaging date and time, a hash value of subject image data recorded in the data recording area, and the like, and a feature amount of the subject image. The feature amount of the subject image is detected by pre-processing, and includes the face position obtained by the face detection described above, the brightness of the subject image, the camera shake amount of the subject image, and the like. In addition, information on whether or not pre-processing is performed is also stored in the header recording area.

As described above, when preprocessing is performed by the user using the personal computer 21 or the like, an image file in which the feature amount of the subject image is stored in the header recording area is transmitted to the album generation server 1. The Rukoto. When the pre-processing is not performed by the user using the personal computer 21 or the like, an image file in which the feature amount of the subject image is not stored in the header recording area is transmitted to the album generation server 1.

FIG. 6 is an example of the management information table.

The management information table stores management information (information) such as the above-described feature quantity associated with the image file separately from the image file. The management information table is recorded on, for example, the hard disk 12 of the album generation server 1.

The management information table stores, for each user ID, the image file name, the shooting date and time of the subject image represented by the image file, the hash value of the subject image, the feature amount of the subject image, and whether or not pre-processing has been performed. The

If a management information table is generated for each user ID, the user ID is not necessary as information stored in the management information table. In addition, information on imaging date / time, hash value, and whether or not pre-processing has been completed is not necessarily required.

When the image file transmitted from the user's personal computer 21 is transmitted to the album generation server 1, the management information recorded in the header of the image file is read. The read management information is stored in the management information table. If preprocessing has been performed on the subject image represented by the image file, the contents obtained by the preprocessing are described in the feature amount column. In addition, “done” is described as information indicating whether or not pre-processing has been completed. If pre-processing has not been performed on the subject image represented by the image file, the feature amount column is blank, and “not yet” is described as information indicating whether or not pre-processing has been performed.

Further, apart from the image file transmitted from the user, only management information may be transmitted from the user. By transmitting only management information from the personal computer 21 to the album generation server 1, the management information is written in the management information table by the hard disk drive 11 under the control of the CPU 2 of the album generation server 1.

Since the management information table stores not only the image file name but also the user ID, shooting date, hash value, etc., even if the image file name is the same, it corresponds to the image file accurately. You can find the quantity.

FIG. 7 is a flowchart showing the processing procedure of the album generation system.

The user transmits an image file representing a subject image used for the album to the album generation server 1 by using the personal computer 21 (may be another device) (step 41). One image file may be transmitted one by one, or a plurality of image files may be transmitted at once.

The image file transmitted from the personal computer 21 is received by the communication device 13 of the album generation server 1 (step 51). The received image file is temporarily stored in the memory 10 of the album generation server 1.

CPU 2 reads the management information recorded in the header of the image file. If the management information includes information indicating whether or not the pre-processing has been performed, the information indicating whether or not the pre-processing has been performed is read. If the header information does not include information indicating whether or not pre-processing has been completed, the feature amount is read if the feature amount is recorded in the header. If neither the information indicating whether or not the preprocessing has been performed and the feature amount are recorded in the header, whether or not the feature amount corresponding to the received image file or the preprocessing has been performed in the management information table stored in the hard disk 12 Is confirmed to be recorded. If the management information table records the feature amount corresponding to the received image file or information indicating whether or not the pre-processing has been performed, the feature amount or information indicating whether or not the pre-processing has been performed is read.

From the information obtained in this way, the CPU 2 determines whether or not the subject image represented by the received image file has been preprocessed (step 52) (preprocessing determination means). It may be determined whether or not preprocessing has been performed only from data indicating whether or not preprocessing has been completed, and if the preprocessing required for album generation differs depending on the type of album generation, the necessary Whether or not the pre-processing is performed may be determined based on whether or not the feature amount obtained from the pre-processing is detected.

If pre-processing has not been performed (YES in step 52), a pre-processing execution command is generated by CPU 2, and pre-processing is performed in CPU 2 for the subject image represented by the received image file (step 53) (pre-processing means) ). Thus, pre-processing is performed in response to the image file representing the subject image being received by the album generation server 1. If pre-processing is being performed (NO in step 52), pre-processing is skipped.

The above processing is repeated for a plurality of image files. Then, the CPU 2 determines (selects) the subject image to be attached to the album from the plurality of pre-processed subject images with reference to the feature amount (step 54) (selection means). For example, a subject image whose face size detected by face detection is greater than or equal to a predetermined size, a subject image whose detected face position is substantially in the center, a subject image including a specific person, a predetermined range A subject image having a brightness of, a subject image having a camera shake amount equal to or less than a predetermined value, and the like are subject images to be attached to the album. The subject image to be pasted is selected according to the result of the pre-processing.

Subsequently, the album layout for pasting the subject image on the album mount image is determined based on the feature amount (step 55) (layout determining means). For example, the layout is determined so that a predetermined album template includes all the same persons recognized by person recognition. Further, the layout is determined so that a subject image (person image) with a face detected is pasted on the odd page, and a subject image (landscape image) with no face detected on the even page. Further, the layout is determined so that a subject image with a large detected face is affixed large, and a subject image not including a person is affixed small. In addition, the layout may be determined based on the feature amount. However, the layout may be determined without using the feature amount.

When the pre-processing includes at least one of processing for recognizing the subject content, for example, face detection processing, human detection processing, processing for recognizing a specific person, or processing for recognizing an imaging scene, The layout may be determined based on the above process. For example, the subject image layout can be different for each page, such as a different shooting scene, a different person, or a specific person.

When the album layout is determined, the determined subject image is pasted to the mount image of the album by the CPU 2 with the determined layout (step 56) (pasting processing means). A subject image determined to have been pre-processed by pre-processing determination (step 52) and a subject image to which pre-processing (step 53) has been performed are pasted on the album image of the album.

FIG. 8 is a flowchart showing a part of the processing procedure of the album generation server 1. In this figure, the same processes as those shown in FIG.

If the subject image of the image file received in the album generation server 1 is not pre-processed (NO in step 52), the load status of the album generation server 1 is detected (step 57) (load status detection means). The load status is obtained by calculating the operation occupation ratio of the CPU 2. If the operation occupancy is less than or equal to a predetermined threshold, it is determined that the load is less than the threshold (NO in step 58), and album generation is performed without performing pre-processing to reduce the load on the album generation server 1. The server 1 is kept waiting for a certain time (step 59). If the album generation server 1 has a load equal to or lower than the threshold value (YES in step 58), it is considered that the album generation server 1 has the capacity to perform preprocessing, so subject image preprocessing is performed ( Step 53).

FIG. 9 shows still another embodiment, and is a flowchart showing a part of the processing procedure of the album generation server 1.

If the subject image of the received image file has not been pre-processed (NO in step 52), it is determined whether the time, date, or time when the load on the album generation server 1 is considered to be a load below the threshold value (step) 60). For example, the period when the load is considered to be below the threshold is from February to June and from September to November, and the day when the load is considered to be below the threshold is a weekday. The expected time is 2 am to 6 am. At these times, etc., it is considered that the percentage of users accessing the album generation server 1 for album generation is small. If the time, date, or time when the load on the album generation server 1 is considered to be a load below the threshold (YES in step 60), the pre-processing is performed on the subject image that has not been pre-processed (step 53). . If the time, date, or time when the load of the album generation server 1 is considered to be a load equal to or less than the threshold value (NO in step 60), the album generation server 1 performs processing preferentially over pre-processing (step 61). ). For example, an album generation process will be performed for a user who has instructed to generate an album with priority. For those that have been instructed to preferentially generate albums, when the load on the album generation server 1 is greater than or equal to a predetermined threshold, or when it is considered that the load is greater than or equal to a predetermined threshold Even if the pre-processing is not performed, it goes without saying that the pre-processing is performed and the album generation processing is performed.

In the above-described embodiment, the above-described processing is performed by one album generation server 1, but the above-described processing may be performed using a plurality of servers as described below. In addition, users of a plurality of servers do not need to be the same company, and may be implemented by different companies. All servers to be described later have the configuration shown in FIG.

10 to 13 show an example of the configuration of the album generation server 1.

FIG. 10 shows that the album generation server 1 is composed of a first server 71 and a second server 72.

The first server 71 performs the above-described image file reception processing (step 51), pre-processing determination processing (step 52), and pre-processing (step 53). The second server 72 (album creation processing device) performs subject image determination processing (step 54), album layout determination processing (step 55), and album generation processing (step 56).

In this case, the first server 71 is provided with a first receiving device (first receiving means) for receiving subject image data. Then, the first server 71 determines whether or not the subject image represented by the subject image data received by the first receiver is being processed, and determines that the pre-processed subject image data and the pre-processing have been completed. Pre-processed subject image data and pre-processing result data [a set of pre-processed subject image data (pre-processed subject image data) and its pre-processing result and a subject determined to be pre-processed] The first server 71 is also provided with a transmission device that transmits image data (a set of image data (subject image data that has already been subjected to pre-processing) and its pre-processing result] to the second server. The second server 72 further includes a second receiving device (second receiving means) that receives the pre-processed subject image data and the data indicating the pre-processing result transmitted from the first server 71. In this case, the second server 72 pastes the pre-processed subject image on the mount image based on the data indicating the pre-processing result received by the second receiving device.

In FIG. 11, the album generation server 1 is composed of a first server 71, a second server 72, and a third server 73.

The first server 71 performs the above-described image file reception process (step 51) and a determination process (step 52) as to whether or not pre-processing has been completed. In addition, pre-processing (step 53) is performed by the second server 72. Further, the third server 72 performs subject image determination processing (step 54), album layout determination processing (step 55), and album generation processing (step 56).

The first server 71 further includes, for example, a first transmission device (first transmission means) that transmits data indicating the pre-processing determination result to the second server 72. The second server includes a first receiving device (first receiving means) that receives data indicating the preprocessing determination result transmitted from the first transmitting device of the first server 71. The second server 72 performs the pre-processing of the subject image when it is determined that the pre-processing is not performed on the subject image based on the received data indicating the pre-processing determination result. The second server 72 further includes second transmission means for transmitting data indicating the pre-processing result and pre-processed subject image data to the third server 73. The third server further includes a second receiving device (second receiving means) that receives the pre-processing result data transmitted from the second server 72 and the pre-processed subject image data. . The third server 73 pastes the subject image represented by the preprocessed data received by the second receiving device of the third server on the mount image based on the preprocess result indicated by the data indicating the preprocess result. wear.

In the case shown in FIG. 11, the subject image data determined not to have been pre-processed by the first server 71 is transmitted (transmitting means) to the second server 72 (pre-processing device), and the first server 71 The subject image data determined to have been pre-processed and the pre-processing result may be provided to the third server 73 (album creation processing device) without going through the second server 72. Of course, even if such subject image data is given to the second server 72, the subject image data is simply passed through the second server 72 and given to the third server 73. Good.

The first server 71 performs the above-described image file reception process (step 51), and the second server 72 determines whether or not pre-processing has been completed (step 52) and pre-processing (step 53). ) May be performed.

FIG. 12 shows that the album generation server 1 is composed of a first server 71, a second server 72, a third server 73, a fourth server 74, and a storage server 75.

The first server 71 performs the above-described image file reception process (step 51) and a determination process (step 52) as to whether or not pre-processing has been completed. In addition, pre-processing (step 53) is performed by the second server 72. The storage server 75 (stores the data indicating the feature amount obtained by the pre-processing, the image file representing the subject image subjected to the pre-processing, and the image file representing the subject image determined to be pre-processed. Means). A read command is given from the third server 72 to the storage server 75. Then, it is determined by the third server 72 that the data indicating the feature amount obtained by the pre-processing from the storage server 75, the image file representing the subject image that has been subjected to the pre-processing, and the pre-processing are being performed. An image file representing the subject image is read (reading control means). When an album generation command is given from the third server 73 to the fourth server 74 and it is determined in the fourth server 74 that the album generation command has been given (album generation command determination means), in the fourth server 74 , Subject image determination processing (step 54), album layout determination processing (step 55), and album generation processing (step 56) are performed based on the feature amount (pre-processing result).

Pre-processing is performed in advance, and data and image files representing the feature amounts obtained by the pre-processing can be stored in the storage server 75, so that pre-processing and the like can be performed before the album generation command from the user, An album can be generated relatively quickly when an album generation command is received from the user.

When an image file representing a subject image that has not been pre-processed and an image file representing a subject image that has been pre-processed are transmitted to the album generation server 1, pre-processing is being performed. The image file is stored in the storage server 75, and the image file stored in the storage server 75 together with the image file that has been pre-processed in the second server 72 (the pre-processing is performed). By giving the image file) to the fourth server 74 via the third server 73, the memory usage of the fourth server 74 can be reduced. Further, the album generation process can be performed smoothly by executing the process performed by the fourth server 74 when the load on the second server 72 is low.

Furthermore, when the pre-processed image file and the pre-processed image file are provided to the album generation server 1, the pre-processed image file can be stored in the storage server 75. In this case, an image file that has not been pre-processed may be stored in the storage server 75 after the pre-processing is performed to generate an album. When the user gives an album generation command, the image file stored in the storage server 75 is read, and an album is generated in the fourth server 74. Instead of newly providing the storage server 75, the hard disk provided in the second server 2 to the fourth server 74 may have the function of the storage server 75.

Furthermore, a management information table as shown in FIG. 6 may be stored in the storage server 75. In such a case, it is confirmed whether or not the feature amount of the image file input to the album generation server 1 is already stored in the management information table, and if it is stored, it is managed without performing pre-processing. The feature amount stored in the information table can be used.

FIG. 15 shows that the album generation server 1 is composed of a first server 71, a second server 72, a third server 73, a fourth server 74, a storage server 75, and a receiving server 76.

The above-described image file reception process (step 51) is performed by the reception server 76. The first server 71 determines whether or not pre-processing has been completed (step 52). In addition, pre-processing (step 53) is performed by the second server 72. Data indicating the feature amount obtained by the pre-processing and an image file representing the subject image are stored in the storage server 75. The third server 72 reads the data indicating the feature quantity and the image file representing the subject image from the storage server 75, and the fourth server 74 determines the subject image to be pasted to the album (step 54), Layout determination processing (step 55) and album generation processing (step 56) are performed.

Further, in one server (album generating device), if the pre-processing except for the pasting process is not performed on the subject image in the album creating process including the pasting process for pasting the subject image on the mount image representing the mount of the album. A receiving device (receiving means) that receives subject image data that has been subjected to pre-processing and subject image data that has been determined to have undergone pre-processing performed in response to the determination is provided. The subject image represented by the received subject image data may be pasted on the mount image (paste processing means). It goes without saying that such a server can be realized by the configuration of FIG. A program for controlling such an operation may be downloaded to a server, or may be stored in a recording medium such as a memory card, read from the recording medium, and installed on the server.

1 Album generation server (album generation device)
2 CPU (pre-processing judging means, pre-processing means, sticking processing means, layout determining means)
13 Communication device (subject image data receiving means)
71 First server
72 Second server
73 Third server
74 Fourth server
75 Storage server
76 Receiving server

Claims

Pre-processing determination means for determining whether pre-processing other than the pasting processing is not performed on the subject image among album generation processing including pasting processing for pasting the subject image on the mount image representing the mount of the album;
In response to the determination that the pre-processing is not performed on the subject image by the pre-processing determination unit, the pre-processing unit that performs pre-processing of the subject image, and the pre-processing determination unit performs pre-processing. Pasting processing means for pasting the subject image determined to be and the subject image pre-processed by the pre-processing means to the mount image;
An album generation device with
The pre-processing means is
In response to the pre-processing execution command being given, the pre-processing is performed on the subject image that is determined not to be pre-processed.
The album generating apparatus according to claim 1.
The sticking processing means is
The subject image to be pasted is selected according to the result of the pre-processing from the subject image determined to be pre-processed by the pre-processing determining unit and the subject image pre-processed by the pre-processing unit. Further comprising a selection means for
The subject image selected by the selection means is pasted on the mount image.
The album generating apparatus according to claim 1 or 2.
A load status detecting means for detecting the load status of the album generating device;
The pre-processing means is
Pre-processing is performed in response to the load status detected by the load status detection means indicating a load below a threshold value.
The album generating apparatus according to claim 2, further comprising:
The pre-processing means is
Pre-processing is performed at the time, date or time when the load status of the album generator is considered to be below the threshold.
The album generating apparatus according to claim 2, further comprising:
Subject image data receiving means for receiving subject image data representing the subject image;
The pre-processing means is
Pre-processing is performed in response to the subject image data being received by the subject image data receiving means.
The album generating apparatus according to claim 2, further comprising:
The pre-processing is subject recognition processing for recognizing the subject content represented by the subject image.
Layout determining means for determining a layout for pasting the subject image on the mount image based on the result of the subject recognition processing for the subject image subjected to the subject recognition processing;
The sticking processing means is
The subject image is pasted on the mount image with the layout determined by the layout determining means.
The album generating apparatus according to any one of claims 1 to 6.
The subject recognition process
Including at least one of a face detection process, a person detection process, a process for recognizing a specific person, or a process for recognizing an imaging scene.
The album generating apparatus according to claim 7.
The pre-processing determination means is
It is determined whether or not pre-processing is performed on the subject image based on information stored in the same file as the file storing the subject image data.
The album generating apparatus according to any one of claims 1 to 8.
The pre-processing determination means is
A determination is made as to whether or not preprocessing has been performed on the subject image based on information associated separately from the file storing the subject image data.
The album generating apparatus according to any one of claims 1 to 8.
The information and the file are associated on the basis of a combination of the file name of the file and the hash value of the subject image or a combination of the file name of the file and the shooting date and time of the subject image.
The album generating apparatus according to claim 10.
The information and the file are associated with each other based on a combination of the file name of the file and user identification data.
The album generating apparatus according to claim 10.
The first server
Comprising the pre-processing determining means and the pre-processing means,
The second server
Provided with the sticking processing means,
The album generating apparatus according to any one of claims 1 to 12.
The first server is
A first receiving means for receiving subject image data;
The preprocessing determining means determines whether or not preprocessing is being performed on the subject image represented by the subject image data received by the first receiving means;
The first server is
The pre-processed subject image data processed by the pre-processing unit, the pre-processed subject image data determined to be pre-processed by the pre-processing determining unit, and data indicating the pre-processing result are transmitted to the second server. A transmission means for
The second server is
A second receiving means for receiving pre-processed subject image data and data indicating a pre-processing result transmitted from the transmitting means of the first server;
The pasting processing means of the second server is:
Based on the data indicating the pre-processing result received by the second receiving means, the subject image represented by the pre-processed subject image data is pasted on the mount image.
14. The album generation device according to claim 13.
The first server
Comprising the pre-processing determination means,
The second server
Comprising the pre-processing means,
A third server
Provided with the sticking processing means,
The album generating apparatus according to any one of claims 1 to 12.
The first server is
A first transmission means for transmitting data indicating a preprocessing determination result in the preprocessing determination means to the second server;
The second server is
First receiving means for receiving data indicating a preprocessing determination result transmitted from the first transmitting means of the first server;
The pre-processing unit of the second server is responsive to determining that pre-processing is not performed on the subject image based on the data indicating the pre-processing determination result received by the first receiving unit. , Subject image pre-processing,
The second server is
A second transmission unit configured to transmit data indicating a pre-processing result in the pre-processing unit and pre-processed subject image data to the third server;
The third server is
A second receiving means for receiving data indicating the pre-processing result transmitted from the transmitting means of the second server and the pre-processed subject image data;
The pasting processing means of the third server is:
A subject image represented by pre-processed data received by the second receiving means of the third server is pasted on a mount image based on the pre-processing result indicated by the data indicating the pre-processing result;
The album generating apparatus according to claim 15.
The first server is
Transmission means for transmitting subject image data and the determination result in the pre-processing determination means to the second server;
The pre-processing means provided in the second server is
Pre-processing is performed on a subject image determined to have not been pre-processed based on the determination result in the pre-processing means.
The album generating apparatus according to claim 15.
The first server is
The subject image data determined as not being preprocessed by the preprocessing determination means is transmitted to the second server, and the subject image data determined as being preprocessed and the preprocessing result are sent to the second server. A transmission means for transmitting to the server 3;
16. The album generating apparatus according to claim 15, further comprising:
Storage means for storing subject image data preprocessed by the preprocessing means and data indicating a preprocessing result, subject image data determined to be preprocessed by the preprocessing determination means, and A reading control means for supplying subject image data stored in the storage means and data indicating a pre-processing result to the pasting processing means in response to a reading command;
The album generating apparatus according to any one of claims 1 to 18, further comprising:
Storage means for storing subject image data preprocessed by the preprocessing means and data indicating a preprocessing result, subject image data determined to be preprocessed by the preprocessing determination means, and Album generation command determination means for determining whether or not an album generation command using subject image data stored in the storage means has been given;
The layout determining means is
In response to the determination that the album generation command is given by the album generation command determination means, the layout for pasting the subject image on the mount image is determined based on the pre-processing result stored in the storage means. is there,
The album generating apparatus according to claim 7.
A receiving server for receiving subject image data;
The pre-processing determination means is
Determining whether pre-processing has not been performed on the subject image represented by the subject image data received by the receiving server;
The album generating apparatus according to claim 1, 13 or 15.
Pre-processing performed when it is determined that pre-processing other than the pasting processing is not performed on the subject image among album generation processing including pasting processing for pasting the subject image on the mount image representing the mount of the album Receiving means for receiving the subject image data and subject image data determined to be pre-processed, and pasting the subject image represented by the subject image data received by the receiving means on the mount image Sticking processing means,
An album generation device with
The receiving means is
Of the album processing including pasting processing for pasting the subject image on the mount image representing the mount of the album, pre-processing is performed in response to the determination that pre-processing other than the pasting processing has not been performed on the subject image. A set of subject image data and pre-processing results that have been performed and a set of subject image data and pre-processing results that have been determined to be pre-processed;
Selecting means for selecting a subject image to be pasted on the mount image in accordance with the pre-processing result received by the receiving means, the subject image represented by the subject image data received by the receiving means;
The sticking processing means is
A subject image selected by the selection means is pasted on a mount image;
The album generating apparatus according to claim 22.
Pre-processing determining means for determining whether pre-processing other than the pasting process is performed on the subject image data among the album generating processes including the pasting process of pasting the subject image on the mount image representing the mount of the album;
Pre-processing means for performing pre-processing on subject image data determined not to be pre-processed by the pre-processing determining means, and subject image data and pre-processing results pre-processed by the pre-processing means. Transmitting means for transmitting to the album creation processing apparatus the subject image data and the pre-processing result determined to be pre-processed by the pre-processing determining means. ,
An album generation device with
Of the album generation processing including pasting processing for pasting a subject image on a mount image representing an album mount, preprocessing determination means for determining whether preprocessing other than pasting processing is performed on the subject image, and the preprocessing described above The subject image data determined as not being pre-processed by the determining means is transmitted to the pre-processing device that performs pre-processing, and the subject image determined as being pre-processed by the pre-processing determining means A transmission means for transmitting the data and its pre-processing result to the album creation processing apparatus for performing the pasting process;
An album generation device with
The pre-processing determining means determines whether or not pre-processing other than the pasting processing is performed on the subject image among the album generating processing including pasting processing for pasting the subject image on the mount image representing the album mount,
The pre-processing means performs the pre-processing of the subject image in response to the pre-processing determining means determining that the pre-processing is not performed on the subject image;
The pasting processing unit pastes the subject image determined to be pre-processed by the pre-processing determination unit and the subject image pre-processed by the pre-processing unit to the mount image,
Album generation method.
When the receiving means determines that the pre-processing other than the pasting process is not performed on the subject image in the album generating process including the pasting process of pasting the subject image on the mount image representing the mount of the album. The pre-processed subject image data and the subject image data determined to be pre-processed,
The pasting processing means pastes the subject image represented by the subject image data received by the receiving means to the mount image.
The album generation method.
The pre-processing determining means determines whether pre-processing other than the pasting process is performed on the subject image data among the album generating processes including the pasting process of pasting the subject image on the mount image representing the album mount,
Pre-processing means performs pre-processing on the subject image data determined to be not pre-processed by the pre-processing determination means;
The transmission means transmits the subject image data and the preprocessing result that have been preprocessed by the preprocessing means to the album creation processing apparatus that performs the pasting process, and the preprocessing determination means performs the preprocessing. The subject image data determined to be and the pre-processing result are transmitted to the album creation processing device,
Album generation method.
The pre-processing determining means determines whether pre-processing other than the pasting processing is performed on the subject image among the album generating processing including pasting processing for pasting the subject image on the mount image representing the album mount,
The transmission unit transmits the subject image data determined to be not pre-processed by the pre-processing determination unit to a pre-processing device that performs pre-processing, and the pre-processing determination unit performs the pre-processing. The subject image data determined to be and the pre-processing result thereof are transmitted to the album creation processing device that performs the pasting process.
Album generation method.
In the album generation process including the pasting process for pasting the subject image on the mount image representing the mount of the album, it is determined whether the pre-processing other than the pasting process is not performed on the subject image.
In response to the determination that the subject image has not been pre-processed, the subject image is pre-processed,
A computer-readable program for controlling a computer of an album generating apparatus so that a subject image determined to be pre-processed and a pre-processed subject image are pasted on a mount image.
Pre-processing performed when it is determined that pre-processing other than the pasting processing is not performed on the subject image among album generation processing including pasting processing for pasting the subject image on the mount image representing the mount of the album Subject image data and subject image data determined to be pre-processed are received,
A computer-readable program for controlling the computer of the album generating apparatus so that a subject image represented by received subject image data is pasted on a mount image.
Among the album generation processes including the pasting process for pasting the subject image on the mount image representing the album mount, it is determined whether or not the pre-processing excluding the pasting process has already been performed on the subject image data.
Pre-processing is performed on subject image data determined not to be pre-processed,
The album so that the set of the subject image data and the pre-processing result that has been pre-processed and the set of the subject image data and the pre-processing result that has been determined to have been pre-processed are sent to the album creation processing device A computer-readable program for controlling the computer of the generation device.
Among the album generation processes including the pasting process for pasting the subject image on the mount image representing the album mount, it is determined whether or not the pre-processing other than the pasting process is performed on the subject image.
The subject image data determined not to be pre-processed is transmitted to a pre-processing device that performs pre-processing, and the subject image data determined to be pre-processed and the pre-processing result are A computer-readable program for controlling a computer of an album generation apparatus to be transmitted to an album creation processing apparatus that performs a pasting process.
A recording medium storing the program according to any one of claims 30 to 33.