JP2008225586A - Album server and its control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technique for more effectively selecting album data highly likely to attract a user and notifying the user of the data. <P>SOLUTION: An album server has a reception means for receiving, from an external device, registration album data having image data for registration in the album server, and information on the owner of the registration album data; a storage means for storing the registration album data and the information on the owner of the registration album data in association with each other in a storage device; an acquisition means for acquiring feature information showing the features of the registration album data; a search means for searching for similar album data similar to the registration album data among the album data stored in the storage device, by comparing the feature information of the registration album data with the feature information of the album data stored in the storage device; and a means for notifying a user indicated by the owner information associated with the similar album data that the registration album data has been stored in the storage device, if the similar album data is found through a search. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an album server that stores album data having image data, and a control method thereof.

  There is known a sharing system in which multimedia data (document data, image data, etc.) on a server is shared by a plurality of users. In such a sharing system, a large number of multimedia data is usually shared, but individual users are not necessarily interested in all multimedia data. Therefore, it is required to select only multimedia data of interest to the user from a large number of multimedia data and notify the user of the presence.

  In view of this, a system has been proposed in which the importance of multimedia data is calculated based on user preferences and the like, and the addition or update of multimedia data is notified only for multimedia data important to the user (Patent Document 1). reference).

In recent years, an online album system for sharing album data including image data among multimedia data has become widespread. In the online album system, album data uploaded by a user to a server can be downloaded and viewed by other users. Also in the online album system, in order to realize efficient sharing of album data, it is required to notify the presence of album data that is important (that is, high interest) to the user.
JP 2005-346494 A

  As disclosed in Patent Document 1, the method of selecting multimedia data of interest to a user using the user's preferences may have a certain effect for an online album system that shares album data. Not, but there are some inadequacies. This is because even if the photograph (image) matches the user's preference (for example, “skiing as a hobby”), the possibility that the user is interested in photographs related to skis of other people who are irrelevant is not so high. Because.

  The present invention has been made in view of such a situation, and provides a technique for more effectively selecting album data that is likely to be of interest to a user in an online album system and notifying its existence. With the goal.

  In order to solve the above-described problem, according to the first aspect of the present invention, registered album data having image data and owner information of the registered album data are received from an external device for registration in the album server. Receiving means, storage means for associating the registered album data and owner information of the registered album data and storing them in a storage device, acquisition means for acquiring feature information indicating characteristics of the registered album data, and the registration By comparing the feature information of the album data with the feature information of the album data stored in the storage device, among the album data stored in the storage device, similar album data similar to the registered album data is obtained. Search means for searching, and when the similar album data is found by the search, the registered album data There in that the stored in the storage unit, a notification unit that notifies the user indicated by the owner information associated with the similar album data, the album server, characterized in that it comprises a provided.

  According to a second aspect of the present invention, there is provided an album server comprising a storage device that stores album data having image data and owner information of the album data in association with each other, and is stored in the storage device. Receiving means for receiving a transmission request for requesting transmission of one of the album data as browsing album data from an external device, and acquiring characteristic information indicating the characteristics of the album data stored in the storage device And comparing the feature information of the browse album data with the feature information of the album data stored in the storage device other than the browse album data, of the album data stored in the storage device Search means for searching for similar album data similar to the browse album data; and A transmission means for transmitting to the external device at least one of the similar album data and the similar album information indicating the similar album data together with the browse album data when the album data is found. An album server is provided.

  According to a third aspect of the present invention, a receiving step of receiving registered album data having image data and owner information of the registered album data for registering with an album server from an external device, and the registration A storage step of associating album data with owner information of the registered album data and storing it in a storage device; an acquisition step of acquiring feature information indicating features of the registered album data; and feature information of the registered album data A search step for searching similar album data similar to the registered album data among album data stored in the storage device by comparing with feature information of the album data stored in the storage device; If the similar album data is found by the search, the registered album data is stored in the storage device. That is, a notifying step of notifying the user indicated by the owner information associated with the similar album data, characterized in that it comprises a control method of the album server is provided.

  According to a fourth aspect of the present invention, there is provided an album server control method comprising a storage device storing album data having image data in association with owner information of the album data, the storage being stored in the storage device Receiving a request for transmission from an external device for requesting transmission of one of the album data as browse album data, and feature information indicating characteristics of the album data stored in the storage device An album stored in the storage device by comparing the feature information of the browsing album data with the acquisition step of acquiring and the feature information of the album data stored in the storage device other than the browsing album data Among the data, a search step for searching similar album data similar to the browse album data, and the search When the similar album data is found, a transmission step of transmitting at least one of the similar album data and the similar album information indicating the similar album data together with the browsing album data to the external device is included. An album server control method is provided.

  According to the fifth aspect of the present invention, the receiving means for receiving the registered album data having the image data and the owner information of the registered album data for registering the computer with the album server from the external device, Storage means for associating and storing the registered album data and owner information of the registered album data in a storage device; acquisition means for acquiring characteristic information indicating characteristics of the registered album data; and feature information of the registered album data Search means for searching similar album data similar to the registered album data among album data stored in the storage device by comparing with feature information of the album data stored in the storage device, When the similar album data is found by the search, the registered album data is stored in the memory. That is stored in the location notification means for notifying the user indicated by the owner information associated with the similar album data, the program to function as is provided.

  According to a sixth aspect of the present invention, there is provided a computer comprising a storage device storing album data having image data and the owner information of the album data in association with the album data stored in the storage device. Receiving means for receiving a transmission request for requesting transmission of one of them as browsing album data from an external device; acquisition means for acquiring characteristic information indicating characteristics of album data stored in the storage device; By comparing the feature information of the album data with the feature information of the album data stored in the storage device other than the browse album data, the browse album data among the album data stored in the storage device Search means for searching for similar album data similar to Is found, a program for causing the browsing album data and at least one of the similar album data and the similar album information indicating the similar album data to function as transmission means for transmitting to the external device is provided. Is done.

  Other features of the present invention will become more apparent from the accompanying drawings and the following description of the best mode for carrying out the invention.

  With the above configuration, according to the present invention, in the online album system, it is possible to more effectively select album data that is likely to be of interest to the user and notify the existence thereof.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. The individual embodiments described below will help to understand various concepts, such as the superordinate concept, intermediate concept and subordinate concept of the present invention.

  The technical scope of the present invention is determined by the claims, and is not limited by the following individual embodiments. In addition, not all combinations of features described in the embodiments are essential to the present invention.

[First Embodiment]
<Configuration of Online Album System 140>
FIG. 1 is a diagram showing a configuration example of an online album system 140 of the present invention.

  The online album system 140 of the present invention includes an album server 100 and one or more user terminals 120 that are external devices, and the album server 100 and the user terminals 120 are connected to each other via the Internet 110.

  The album server 100 includes a feature information calculation unit 101, a similar album data search unit 102, a communication unit 103, and an album data management unit 104. The album server 100 also includes a built-in or external storage device 130.

  The feature information calculation unit 101, the similar album data search unit 102, the communication unit 103, the album data management unit 104, a program executed by a CPU (not shown) of the album server 100, a dedicated circuit, or a combination of a program and a dedicated circuit. Composed.

  The storage device 130 is a hard disk drive (HDD), for example, and stores album data registered (uploaded) by the user terminal 120. The storage device 130 also includes an image DB 105, an owner DB 106, and a metadata DB 107.

  The feature information calculation unit 101 calculates feature information (details will be described later) indicating the features of the album data.

  The similar album data search unit 102 searches for album data similar to certain album data based on the feature information.

  The communication unit 103 is responsible for communication with the user terminal via the Internet 110.

  The album data management unit 104 manages registration acceptance of album data, user registration of users who use the album server 100, and the like.

  The image DB 105 stores image data included in the album data.

  The owner DB 106 stores owner information of album data (for example, user information such as an ID (user ID) of a user who has registered album data).

  The metadata DB 107 stores metadata of album data (for example, browsing authority information, feature information, owner information, etc. (details will be described later) of album data).

  Each album data has a unique ID (album ID), and each data stored in the image DB 105, the owner DB 106, and the metadata DB 107 is associated with the album ID to constitute one album data.

  The user terminal 120 is, for example, a personal computer (PC), and is used by the user for registering, editing, browsing, and the like of album data.

  In this embodiment, it is assumed that album data management application software (album management software) is installed in the user terminal 120. The user accesses the album server 100 via the album management software and manages album data. However, for example, the online album system 140 may be configured such that a user accesses a website provided by the album server 100 via a web browser installed in the user terminal 120 and manages album data. Good.

<User registration>
Next, user registration processing of a user who uses the album server 100 will be described with reference to FIGS. 2 and 7A.

  In step S701 of FIG. 7A, the user inputs arbitrary user information such as ID 201, password 202, and e-mail address 203 on the user registration screen 200 (FIG. 2) of the album management software, and presses the registration button 204. . Then, user information is transmitted from the user terminal 120 to the album server 100.

  In step S <b> 702, the album data management unit 104 stores user information in the owner DB 106.

  When the storage of the user information in the owner DB 106 is completed, in step S703, the album data management unit 104 notifies the user terminal 120 that the user registration has been completed (user registration completion notification). The user registration completion notification is performed when the album data management unit 104 transmits an e-mail to e-mail address 203, for example.

  With the above process, the user registration process is completed.

<Create album>
Next, the album data registration process will be described with reference to FIG. 3, FIG. 4, and FIG. 7B.

  In step S711, the user of the user terminal 120 sets desired settings for the title 301, the public attribute 302, the similar condition setting 303, and the notification setting 304 on the album new creation screen 300 (FIG. 3) of the album management software. I do.

  In the title 301, the user can input an arbitrary character string and set the title of album data to be registered (newly created). In the example shown in the figure, the title “Athletic meet” is set.

  In the public attribute 302, the public attribute of the album data to be created can be selected from “general public”, “similar public”, and “private” using radio buttons. The public attribute “public release” is a setting for releasing the album data to be registered (registered album data) to all users. The public attribute “similar publication” is a setting that the registered album data is disclosed only to the owner of album data similar to the registered album data (similar album data). The public attribute “private” is a setting that the registered album data is not disclosed to all users.

  In the similar condition setting 303, a condition to be used when searching for similar album data of registered album data is selected from “date and time”, “location”, “comment tag”, and “subject” using check boxes. A plurality of check boxes can be selected. When “date and time” is selected in the similar condition setting 303, information (time information) of the imaging date and time of the image data included in the album data is used as a search condition. When “Place” is selected, information (position information) on the imaging position of the image data included in the album data is used as a search condition. When “comment tag” is selected, the character information in the comment tag of the image data included in the album data is used as a search condition. When “Subject” is selected, subject information indicating the subject included in the image data included in the album data is used as a search condition. The subject included in the image data can be detected using any existing subject recognition process. Although not shown, imaging condition information such as an imaging mode and a focal length at the time of imaging may be used as a search condition.

  In the notification setting 304, it is possible to set whether to notify by e-mail when similar album data of registered album data is registered in the album server 100 (discovered as a result of search). The notification destination by e-mail may be only the owner (user) of registered album data, only the owner of similar album data, or both. Therefore, the new album creation screen 300 may be configured so that the notification destination can be selected in detail.

  After the setting of each item is completed, when the user presses the new creation button 310, an album creation message is transmitted from the user terminal 120 to the album server 100.

  In step S712, the album data management unit 104 generates album data 150. At this time, the album data 150 has no image data.

  In step S713, the album data management unit 104 stores the information (attribute information) set on the new album creation screen 300 in the metadata DB 107 in association with the album ID of the album data 150.

  In step S715, the album data management unit 104 stores the album ID in the owner DB 106 in association with the owner information of the user (user A) who generated the album data 150.

  With the above processing, the generation processing of the album data 150 is completed, and the image data registration screen 400 (FIG. 4) is displayed on the user terminal 120.

  Next, in step S <b> 731, the user A selects image data to be included in the album data 150 on the image data registration screen 400. The image data registration screen 400 displays a list of image data stored in a storage device (not shown) of the user terminal 120 in the local image list area 401. Each image data displayed in the local image list area 401 includes a thumbnail display 402, a check box 403, and a file name display 404. When the user A checks the check box 403 of desired image data, the image data to be included in the album data 150 is selected. When the transfer button 410 is pressed, the image data in which the check box 403 is checked is transmitted to the album server 100.

  In step S732, the album data management unit 104 stores the image data received from the user terminal 120 in the image DB 105. At this time, an image ID is assigned to each image data, and the image ID is associated with the album ID.

  In step S735, the feature information calculation unit 101 calculates and acquires feature information of the album data 150 (details will be described later).

  In step S736, the album data management unit 104 stores the feature information of the album data 150 in the metadata DB 107.

  The feature information may be calculated by the user terminal 120 instead of the feature information calculation unit 101 and transmitted to the album server 100 together with the image data in step S731.

  In step S737, the similar album data search unit 102 searches the storage device 130 for similar album data (details will be described later). When similar album data is found, the album data management unit 104 registers information (album ID and the like) related to similar album data of the album data 150 in the metadata DB 107. Thus, if the metadata DB 107 is accessed, similar album data of the album data 150 can be acquired.

  In the present embodiment, it is assumed that the album data 151 of the user B is found as similar album data.

  In steps S <b> 740 and S <b> 741, the album data management unit 104 notifies the existence of similar album data by transmitting an email to the user A and the user B via the communication unit 103.

  Specifically, there are the following four types of notifications.

  (1) The album data management unit 104 notifies the user (user B) indicated by the owner information associated with the album data 151 that is similar album data that the album data 150 has been registered. As a result, the user B can know that album data (album data 150) similar to the album data that he / she has already registered, that is, album data that is likely to be of interest is newly registered.

  (2) The album data management unit 104 notifies the user A that the registration of the album data 150 has been notified to the user B. Thereby, the user A can know who is notified of the existence of the album data registered by the user A.

  (3) The album data management unit 104 notifies the user A that similar album data (album data 151) has been found. Thereby, the user A can know that album data with high possibility of interest has already been registered.

  (4) The album data management unit 104 notifies the user B that the user A has been notified that similar album data (album data 151) has been found. Thereby, the user B can know who has been notified of the existence of the album data that he / she has already registered.

  All of the four types of notifications described above need not be performed. With only one to three notifications, the present embodiment has the effects described in (1) to (4). However, the notification in (2) is based on the assumption that the notification in (1) has been performed, and the notification in (4) is based on the assumption that the notification in (3) has been performed.

  As a notification method, in addition to e-mail, a message displayed on album management software or a web browser may be used. The notification (1) described above may include a URL for accessing the album data 150, and the notification (3) includes a URL for accessing the album data 151. It may be included.

<Feature information calculation processing>
Details of the feature information calculation process in step S735 of FIG. 7B will be described with reference to FIGS. 10A to 10E.

  As shown in FIG. 10A, the feature information calculation unit 101 calculates time information in step S110. Next, position information is calculated in step S120, character information is calculated in step S130, and subject information is calculated in step S140.

  The time information is calculated by the process shown in FIG. 10B.

  In step S111, the feature information calculation unit 101 acquires one of the image data included in the album data.

  In step S112, the feature information calculation unit 101 plots the imaging time information of the image data at a predetermined distribution time for each unit time. The unit time represents a unit for generating the distribution time in units of 15 minutes, 30 minutes, 1 hour, for example. The imaging time information can be acquired from, for example, Exif information of a JPEG file including image data.

  In step S113, the feature information calculation unit 101 stores the obtained distribution time in the metadata DB 107 in association with the image data.

  In step S114, the feature information calculation unit 101 stores the obtained distribution time in the metadata DB 107 as histogram information of the entire image data included in the album data.

  In step S115, the feature information calculation unit 101 determines whether or not the distribution time has been obtained for all the image data included in the album data, and repeats the processes in steps S111 to S114 until the distribution time is completed.

  Through the above processing, a histogram relating to the imaging time of the image data included in the album data is generated in the metadata DB 107.

  The position information is calculated by the process shown in FIG. 10C.

  In step S121, the feature information calculation unit 101 acquires one of the image data included in the album data.

  In step S122, the feature information calculation unit 101 plots the imaging position information of the image data in a distribution of position information for each predetermined unit area. The unit area represents a unit for generating a position distribution for each region divided in units of 50 m, 100 m, and 500 m in the east and west and the north and south, respectively. Note that the imaging position information can be obtained from, for example, Exif information of a JPEG file including image data.

  In step S123, the feature information calculation unit 101 stores the obtained distribution position in the metadata DB 107 in association with the image data.

  In step S124, the feature information calculation unit 101 stores the obtained distribution position in the metadata DB 107 as histogram information of the entire image data included in the album data.

  In step S125, the feature information calculation unit 101 determines whether or not the calculation of the distribution position for all the image data included in the album data has been completed, and repeats the processing in steps S121 to S124 until the completion.

  Through the above processing, a histogram relating to the imaging position of the image data included in the album data is generated in the metadata DB 107.

  The character information is calculated by the process shown in FIG. 10D.

  In step S131, the feature information calculation unit 101 acquires one of the image data included in the album data.

  In step S132, the feature information calculation unit 101 extracts a sentence, a phrase, a word, and the like from the information of the comment tag given as metadata of the image data based on any existing algorithm. The comment tag can be acquired from, for example, Exif information of a JPEG file including image data.

  In step S133, the feature information calculation unit 101 totals the extracted sentences, phrases, and words, and stores the total results in the metadata DB 107 in association with the image data.

  In step S134, the feature information calculation unit 101 stores the aggregation result in the metadata DB 107 as histogram information of the entire image data included in the album data.

  In step S135, the feature information calculation unit 101 determines whether or not the summation for each sentence, phrase, and word of the character information has been completed for all the image data included in the album data, and in steps S131 to S134 until the completion. Repeat the process.

  Through the above processing, a histogram in which the character information of the image data included in the album data is tabulated for each sentence, phrase, and word is generated in the metadata DB 107.

  The subject information is calculated by the process shown in FIG. 10E.

  In step S141, the feature information calculation unit 101 acquires one of image data included in the album data.

  In step S142, the feature information calculation unit 101 extracts a subject image region from the image data based on an arbitrary existing algorithm.

  In step S143, the feature information calculation unit 101 performs subject recognition processing based on any existing algorithm based on the extracted subject image region data.

  In step S144, the feature information calculation unit 101 counts the number of appearances in the entire album as a distribution for each subject recognized by the subject recognition process, and stores the obtained distribution subject information in association with the image data in the metadata DB 107. To do.

  In step S145, the feature information calculation unit 101 stores the obtained distributed subject information in the metadata DB 107 as histogram information of the entire image data included in the album data.

  In step S146, the feature information calculation unit 101 determines whether or not the distribution subject information has been obtained for all the image data included in the album data, and repeats the processes in steps S141 to S145 until the completion.

  Through the above processing, a histogram related to the distribution subject information of the image data included in the album data is generated in the metadata DB 107.

  In the present embodiment, the feature information is calculated based on the above four pieces of information, but the present invention is not limited to this. In addition to the above information, it is also possible to generate feature information using metadata attached to image data such as subject type, imaging mode, camera type, lens type, focal length, and the like.

  Furthermore, it is also possible to generate feature information as a metadata distribution of each image by combining the above information. For example, information combining date and place may be obtained for each image and the distribution of the information may be used as feature information.

<Similar album data search processing>
Details of the similar album data search process in step S737 in FIG. 7B will be described with reference to FIGS. 11A and 11B.

  The similar album data search unit 102 calculates the degree of similarity between album data by comparing preset items of the feature information of the comparison source album data and the comparison destination album data. If the degree of similarity is equal to or greater than a predetermined threshold, the comparison target album data is determined as similar album data and recorded in the metadata DB 107. Here, the “items set in advance” are, for example, items set in the similar condition setting 303 of the new album creation screen 300 of FIG.

  In step S202, the similar album data search unit 102 acquires one of the album data registered in the storage device 130 as comparison destination album data. At this time, the comparison source album data (for example, album data 150 in FIG. 7B) is excluded from the comparison destination album data.

  In step S203, the similar album data search unit 102 calculates the similarity between the comparison source album data and the comparison destination album data (details will be described later with reference to FIG. 11B).

  In step S204, the similar album data search unit 102 determines whether or not the similarity calculated in step S203 is equal to or greater than a predetermined threshold. If the similarity is greater than or equal to a predetermined threshold, the process proceeds to step S205, and otherwise, the process proceeds to step S206.

  In step S205, the similar album data search unit 102 records the album ID of the comparison destination album data in the metadata DB 107 in association with the album ID of the comparison source album data. Thus, if the metadata DB 107 is accessed, it can be confirmed that the comparison source album data and the comparison destination album data are similar to each other. That is, when viewed from the comparison source album data, the comparison destination album data is similar album data, and when viewed from the comparison destination album data, the comparison source album data is similar album data.

  In step S206, the similar album data search unit 102 determines whether or not the above-described processing has been completed for all album data registered in the storage device 130 except the comparison source album data. The processes of S202 to S205 are repeated.

  In the present embodiment, of the album data registered in the storage device 130, all album data excluding comparison source album data is set as comparison destination album data. In this case, album data with the same owner of comparison source album data may be found as similar album data. However, it is considered that the user may want to search for album data registered by another person that is likely to be interested rather than own album data. Therefore, the album data associated with the owner information indicating the same user as the owner information of the comparison source album data may be excluded from the comparison destination album data (that is, the search target).

  Further, there are cases where the similarity degree is greater than or equal to a predetermined threshold for a plurality of comparison destination albums and a plurality of similar album data is found. In this case, the similar album data search unit 102 may store the album IDs of the similar album data in the metadata DB by ranking in descending order of similarity, or only the album data with the highest similarity is stored in the similar album data. You may judge.

  Next, with reference to FIG. 11B, details of the similarity calculation processing in step S203 will be described.

  In step S221, the similar album data search unit 102 acquires the similar condition setting (see the similar condition setting 303 in FIG. 3) of the comparison source album data from the metadata DB 107.

  In step S222, the similar album data search unit 102 determines whether or not the “date and time” of the similar condition setting 303 is checked, and if it is checked, the process proceeds to step S223. Otherwise, the process proceeds to step S225.

  In step S223, the similar album data search unit 102 obtains a histogram regarding the time information of the comparison source album data and the comparison destination album data from the metadata DB 107 and compares them to calculate the similarity.

  In step S224, the similar album data search unit 102 adds the similarity related to the time information to the similarity of the album data. Note that the initial value of the similarity of album data is, for example, 0.

  Thereafter, similarly in steps S225 to S233, the similarities of “position information”, “text information”, and “subject information” are added to the similarity of album data, and the final similarity is calculated.

  As described above, according to the present embodiment, when new album data is registered in the album server 100, the feature information calculation unit 101 calculates the feature information of the album data. Based on the feature information, the similar album data search unit 102 searches the album data stored in the storage device 130 for similar album data similar to the new album data. When the similar album data is found, the album data management unit 104 notifies the owner of the new album data and / or the owner of the similar album data.

  As described above, even if the photograph (image) matches the user's preference (for example, “skiing as a hobby”), the possibility that the user is interested in a photograph related to skiing of an unrelated person is not so high. it is conceivable that. On the other hand, it is considered that the user is relatively likely to be interested in photos of acquaintances, photos of events he / she participated in, photos of places where he / she was present, and similar dates. In the present embodiment, similar album data is searched based on image data actually included in album data registered by the user, rather than preferences directly associated with the user.

  Therefore, according to the present embodiment, there is provided a technique for effectively selecting album data that is likely to be of interest to the user in the online album system and notifying the user of the existence.

[Second Embodiment]
In the first embodiment, attention is paid to a notification when new album data is registered in the album server 100. In the second embodiment, attention is paid to notifying the user of the presence of similar album data when browsing album data already registered in the album server 100.

  Also in the second embodiment, since the online album system 140 of FIG. 1 is used, a duplicate description is omitted.

<Album data browsing process>
The album data browsing process will be described with reference to FIGS. 5 and 7C.

  In step S751, the user A transmits an album data (eg, album data 150) browsing request (transmission request) to the album server 100 via the album management software.

  In step S752, the album data management unit 104 acquires a list indicating image data included in the album data 150.

  In step S754, the album data management unit 104 acquires the image data included in the album data 150 from the image DB 105 based on the list acquired in step S752.

  In steps S755 to 757, the album data management unit 104 acquires the album ID of similar album data (album data 151 in the example of FIG. 7C) of the album data 150.

  In step S758, the album data management unit 104 acquires the public attribute of the similar album data (see the public attribute 302 in FIG. 3).

  If the release attribute of the similar album data is “public release” or “similar release”, in step S759, the album data management unit 104 acquires a list of image data included in the similar album data.

  In step S761, the album data management unit 104 acquires image data included in similar album data from the image DB 105 based on the list acquired in step S759. At this time, if the notification setting 304 of similar album data is set to “notify by email”, the album data management unit 104 indicates that the album data 151 that is similar album data has been disclosed to the user A. (Step S762).

  In step S <b> 763, the album data management unit 104 transmits the album data 150 and 151 to the user terminal 120 of the user A via the communication unit 103. Then, the album management software of the user terminal 120 displays the album browsing screen 600 of FIG.

  The album browsing screen 600 includes album selection tabs 601 to 604. The number of album selection tabs may change according to the number of album data registered by user A. In the example of FIG. 5, the album selection tab 601 is selected. In other words, there are four albums “Athletic meet”, “Admission ceremony”, “Hawaii trip”, and “Soccer game” registered by user A, and the “Athletic meet” album is selected. . When another album selection tab is selected, the process of FIG. 7C is performed again for the corresponding album.

  Reference numeral 610 denotes a thumbnail display of a list of images registered in the athletic meet album. User A can enlarge the desired image by clicking on the thumbnail image.

  Reference numeral 620 denotes a public information display area for displaying public information of the selected album (athletic event album).

  Reference numeral 621 represents a public attribute set in the selected album data.

  Reference numeral 622 represents the release status of the selected album data.

  The content displayed in the public information display area 620 is appropriately switched depending on the public attribute of the selected album data and the public status, as illustrated in FIG.

  In FIG. 6, a public information display area 620a shows a display example when the public attribute is set to private. In the public information display area 620a, the public attribute 621 is “private”, and it is explained that the public status 622 is private.

  The public information display areas 620b and 620c show display examples when the public attribute is set to similar public. In the public information display area 620b, the public attribute 621 is “similar public”, but the similar album data does not exist and is not disclosed to other users. In the public information display area 620c, the public status 622 explains that the album data is disclosed and notified to the user B who has registered similar album data.

  The public information display areas 620d and 620e show display examples when the public attribute is set to general public. In the public information display area 620d, the public attribute 621 is “public” and the public status 622 describes that the public attribute is displayed. In the public information display area 620e, the public status 622 explains that the album data is notified to the user B who has registered similar album data. The difference from the public information display area 620c is that album data is disclosed to the user B who has received the notification.

  Returning to FIG. 5, reference numeral 630 denotes a similar album display area for displaying an album searched as similar album data of the selected album data (athletic meet album).

  The example of FIG. 5 shows a situation where album data 151 of another user is searched as a similar album.

  Reference numeral 640 denotes a display area for displaying a list of images registered in the album data 151 as thumbnails. The user A can browse each image of the album data 151 by clicking on the display area 640. At this time, the similar album browsing screen 900 of FIG. 9 is displayed (details will be described later).

  Reference numeral 650 denotes a similar album search condition setting / display area.

  In this area, a check box for displaying and setting the similar condition setting, which is preset for the selected album, is displayed.

  In the present embodiment, the date 651, the place 652, the comment tag 653, and the subject 654 can be set as the similar condition setting. In the example of FIG. 5, the date 651 and the location 652 are set as similar condition settings.

  Reference numeral 655 denotes a re-search button for re-searching similar album data. The re-search button 655 is effective only when the similar condition setting is changed. When an operation such as clicking is performed, similar album data is re-searched under the changed condition (see FIGS. 11A and 11B).

  Next, the similar album browsing screen 900 will be described.

  FIG. 9 shows a display example when the user A browses the similar album data (athletic meet album) of the user B.

  Reference numeral 901 denotes a tab for selecting similar album data. In the example of FIG. 9, since there is only one similar album data, there is only one tab.

  Reference numeral 910 denotes a thumbnail display of an image list included in similar album data. User A can enlarge the desired image by clicking on the thumbnail image.

  Reference numeral 920 denotes an area for writing a comment on the displayed album (athletic meet album).

  Reference numeral 921 denotes a text box for writing a comment, and reference numeral 922 denotes a write button for transmitting the comment written in the text box 921.

  The text written in the text box 921 is transmitted by e-mail, for example, to the user B who is the owner of similar album data (athletic meet album) by pressing the write button 922.

  930 is for displaying the album (here, album data 150) determined to be similar to the similar album data among the albums of the user A who is currently browsing the similar album browsing screen 900. It is a browsing user similar album display area.

  Reference numeral 940 denotes a display area for displaying an image list of the album data 150. When this area is clicked, the album management software displays the album browsing screen 600 again.

  Reference numeral 950 denotes an album release button for releasing the album data in the display area 940 to the user B who is the owner of similar album data (athletic meet album). When the album release button 950 is clicked, the album data 150 is released to the user B and notified to the user B by electronic mail.

  The album release button 950 is used when the viewing user's album (here, album data 150) displayed in the similar album display area 930 is not disclosed to the owner of the album being viewed (here, user B). Only displayed.

  In the example of FIG. 9, the album data 150 is not disclosed to the user B who is the owner of the similar album data.

  On the other hand, if the album of the viewing user displayed in the similar album display area 930 has already been published to the owner of the album being browsed (here, user B), the album publication is stopped instead of the album publication button 950. A button 951 is displayed (see FIG. 13).

  Accordingly, it is possible to easily change the public setting of the album while browsing the album of another person found as similar album data.

  Next, FIG. 12 shows an example of the album browsing screen displayed on the user terminal 120 of the user B when the URL described in the e-mail received by the user B in step S762 of FIG. 7C is clicked.

  In FIG. 12, album data published by user B (here, album data 151) is displayed.

  In the public information display area 620, it is displayed that the public attribute 621 is similar public, and the album public status 622 indicates that it is publicly similar to the user A.

  Further, in the similar album search condition 650, since all the check boxes are off, it is indicated that there is no similar album in the display area 640.

  As described above, according to the present embodiment, the album data management unit 104 transmits the album data (browsing album data) indicated by the transmission request to the user terminal 120 together with the similar album data of the browsing album data. However, the album data management unit 104 may transmit related information (similar album information) such as the name of similar album data instead of the similar album data itself, or may transmit both.

  Therefore, according to the present embodiment, in the online album system, when the user browses specific album data, other album data that is likely to be of interest to the user is effectively selected and its presence is notified. Technology is provided.

[Third Embodiment]
In the third embodiment, a modified example of the similar album data search process shown in FIGS. 11A and 11B will be described with reference to FIGS. 8A and 8B.

  In the present embodiment, the similar album data search unit 102 compares one image at a time with respect to preset items among the feature information of each of the two album data. Then, the similarity between the albums is obtained by setting the comparison result as the similarity between the albums, and the album data whose similarity is equal to or higher than a predetermined threshold is set as similar album data.

  In FIG. 8A, steps that perform the same processing as in FIG. 11A are denoted by the same reference numerals, and description thereof is omitted.

  In step 304, the similar album data search unit 102 acquires one piece of image data as comparison source image data from the comparison source album data.

  In step S306, the similar album data search unit 102 acquires one piece of image data as comparison destination image data from the comparison destination album data.

  In step S307, the similar album data search unit 102 calculates the similarity between the comparison source image data and the comparison destination image data (details will be described later with reference to FIG. 8B).

  In step S308, the similar album data search unit 102 adds the similarity calculated in step S307 to the album similarity (initial value is, for example, 0) regarding the comparison destination album data.

  Through steps S309 and S310, the processing of steps S304 to S308 is repeated for all image data of comparison source album data and all image data of comparison destination album data.

  Other processes are the same as those in FIG. 11A, and album data having an album similarity equal to or higher than a predetermined threshold is finally found as similar album data.

  Next, the details of the image similarity calculation process in step S307 will be described with reference to FIG. 8B.

  In step S321, the similar album data search unit 102 acquires the similar condition setting (see the similar condition setting 303 in FIG. 3) of the comparison source album data to which the comparison source image data belongs from the metadata DB 107.

  In step S322, the similar album data search unit 102 determines whether or not the “date and time” of the similar condition setting 303 is checked, and if it is checked, the process proceeds to step S323. Otherwise, the process proceeds to step S325.

  In step S323, the similar album data search unit 102 compares the time information of the comparison source image data and the comparison destination image data, and calculates the similarity regarding the time information.

  In step S324, the similar album data search unit 102 adds the similarity related to the time information to the image similarity (initial value is 0, for example).

  Thereafter, similarly in steps S325 to S333, the similarities of “position information”, “text information”, and “subject information” are added to the image similarity, and the final image similarity is calculated.

  As described above, according to the present embodiment, in the present embodiment, similar images are calculated based on the similarity calculated by comparing all the images of album data in a brute force manner instead of the histogram of feature information. Data is retrieved.

[Other Embodiments]
In the processing of each embodiment described above, a recording medium in which a program code of software embodying each function is recorded may be provided to the system or apparatus. The function of the above-described embodiment can be realized by reading and executing the program code stored in the recording medium by the computer (or CPU or MPU) of the system or apparatus. In this case, the program code itself read from the recording medium realizes the functions of the above-described embodiment, and the recording medium on which the program code is recorded constitutes the present invention. As a recording medium for supplying such a program code, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, or the like can be used. Alternatively, a CD-ROM, CD-R, magnetic tape, nonvolatile memory card, ROM, or the like can be used.

  The functions of the above-described embodiments are not only realized by executing the program code read by the computer. In some cases, an OS (operating system) running on the computer performs part or all of the actual processing based on the instruction of the program code, and the functions of the above-described embodiments are realized by the processing. include.

  Further, the program code read from the recording medium may be written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. After that, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instruction of the program code, and the functions of the above-described embodiments are realized by the processing. Is also included.

It is a figure which shows the structural example of the online album system 140 of this invention. It is a figure which shows an example of the user registration screen. 5 is a diagram showing an example of a new album creation screen 300. FIG. 5 is a diagram illustrating an example of an image data registration screen 400. FIG. 5 is a diagram showing an example of an album browsing screen 600. FIG. 6 is a diagram illustrating a display example of a public information display area 620. FIG. It is a sequence diagram which shows an example of the flow of a user registration process. It is a sequence diagram which shows an example of the flow of an album data registration process. It is a sequence diagram which shows an example of the flow of an album data browsing process. It is a flowchart which shows an example of the flow of a similar album data search process based on 3rd Embodiment. It is a flowchart which shows an example of the flow of a similarity calculation process based on 3rd Embodiment. 5 is a diagram illustrating an example of a similar album browsing screen 900. FIG. It is a flowchart which shows an example of the flow of a feature information calculation process. It is a flowchart which shows an example of the flow of a time information calculation process. It is a flowchart which shows an example of the flow of a positional information calculation process. It is a flowchart which shows an example of the flow of a character information calculation process. It is a flowchart which shows an example of the flow of subject information calculation processing. It is a flowchart which shows an example of the flow of a similar album data search process. It is a flowchart which shows an example of the flow of a similarity calculation process. It is a figure which shows the other example of the album browsing screen. FIG. 12 is a diagram showing another example of a similar album browsing screen 900.

Claims (17)

Receiving means for receiving registered album data having image data and owner information of the registered album data for registration in an album server from an external device;
Storage means for storing the registered album data in association with owner information of the registered album data in a storage device;
Acquisition means for acquiring characteristic information indicating characteristics of the registered album data;
Similar album information similar to the registered album data among the album data stored in the storage device by comparing the feature information of the registered album data with the feature information of the album data stored in the storage device A search means for searching for data;
A notification means for notifying a user indicated by owner information associated with the similar album data that the registered album data is stored in the storage device when the similar album data is found by the search;
An album server comprising:   The notification means notifies the user that the owner information associated with the similar album data indicates that the registered album data is stored in the storage device, and the owner associated with the registered album data. The album server according to claim 1, wherein notification is made to a user indicated by the information.   The album server according to claim 1, wherein the notification unit notifies a user indicated by owner information associated with the registered album data that the similar album data has been found.   The notification means is a user indicated by the owner information associated with the similar album data that the user indicated by the owner information associated with the registered album data is notified that the similar album data has been found. The album server according to claim 3, wherein the album server is notified. The acquisition means calculates feature information of the registered album data based on image data included in the registered album data,
The album server according to any one of claims 1 to 4, wherein the storage unit stores characteristic information of the registered album data in the storage device in association with the registered album data.   The search means calculates the similarity between the feature information of the registered album data and the feature information of the album data stored in the storage device, and retrieves album data whose similarity is equal to or greater than a predetermined threshold. 6. The album server according to claim 1, wherein retrieval is performed as the similar album data.   The search means, when there are a plurality of album data whose similarity is equal to or greater than the predetermined threshold, searches for the album data having the highest similarity as the similar album data. The album server described in. The image data includes time information indicating when the image data was captured, position information indicating a position where the image data was captured, imaging condition information indicating an imaging condition of the image data, and a subject included in the image data Including at least one of subject information indicating the image data and character information indicating the description of the image data as metadata,
The album server according to claim 1, wherein the feature information is calculated based on metadata of image data included in the album data.   The search means searches the album data associated with the owner information indicating the same user as the owner information associated with the registered album data from among the album data stored in the storage device. The album server according to claim 1, wherein the album server is excluded. Receiving means for receiving a transmission request for requesting transmission of one of the album data stored in the storage device as browsing album data from an external device;
In response to the transmission request, the search means compares the feature information of the browse album data with the feature information of the album data stored in the storage device other than the browse album data. Is searched for similar album data similar to the browse album data,
When the similar album data is found by a search according to the transmission request, at least one of the similar album data and the similar album information indicating the similar album data is transmitted to the external device together with the browse album data. The album server according to any one of claims 1 to 9, further comprising: a transmission unit that performs the following.   The search means includes album data associated with owner information indicating the same user as owner information associated with album data indicated by the transmission request among album data stored in the storage device, The album server according to claim 10, wherein the album server is excluded from search targets according to a transmission request. An album server comprising a storage device that stores album data having image data and the owner information of the album data in association with each other,
Receiving means for receiving a transmission request for requesting transmission of one of the album data stored in the storage device as browsing album data from an external device;
Acquisition means for acquiring characteristic information indicating characteristics of album data stored in the storage device;
Of the album data stored in the storage device, the browsing information is compared with the feature information of the album data stored in the storage device other than the browsing album data. Search means for searching similar album data similar to album data;
Transmitting means for transmitting to the external device at least one of the similar album data and the similar album information indicating the similar album data together with the browsing album data when the similar album data is found by the search;
An album server comprising: A receiving step of receiving registered album data having image data and owner information of the registered album data for registering with the album server from an external device;
A storage step of associating and storing the registered album data and owner information of the registered album data in a storage device;
An acquisition step of acquiring characteristic information indicating characteristics of the registered album data;
Similar album information similar to the registered album data among the album data stored in the storage device by comparing the feature information of the registered album data with the feature information of the album data stored in the storage device A search process for searching for data;
A notification step of notifying a user indicated by owner information associated with the similar album data that the registered album data is stored in the storage device when the similar album data is found by the search;
An album server control method comprising: A method for controlling an album server comprising a storage device that stores album data having image data in association with owner information of the album data,
A receiving step of receiving a transmission request for requesting transmission of one of the album data stored in the storage device as browsing album data from an external device;
An acquisition step of acquiring characteristic information indicating characteristics of album data stored in the storage device;
Of the album data stored in the storage device, the browsing information is compared with the feature information of the album data stored in the storage device other than the browsing album data. A search process for searching for similar album data similar to the album data;
When the similar album data is found by the search, a transmitting step of transmitting at least one of the similar album data and the similar album information indicating the similar album data together with the browsing album data to the external device;
An album server control method comprising: Computer
Receiving means for receiving registered album data having image data and owner information of the registered album data for registration in an album server from an external device;
Storage means for storing the registered album data in association with owner information of the registered album data in a storage device;
Acquisition means for acquiring characteristic information indicating characteristics of the registered album data;
Similar album information similar to the registered album data among the album data stored in the storage device by comparing the feature information of the registered album data with the feature information of the album data stored in the storage device Search means for searching data,
A notification means for notifying a user indicated by owner information associated with the similar album data that the registered album data is stored in the storage device when the similar album data is found by the search;
Program to function as. A computer comprising a storage device that stores album data having image data in association with owner information of the album data,
Receiving means for receiving a transmission request for requesting transmission of one of album data stored in the storage device as browsing album data from an external device;
Acquisition means for acquiring characteristic information indicating characteristics of album data stored in the storage device;
Of the album data stored in the storage device, the browsing information is compared with the feature information of the album data stored in the storage device other than the browsing album data. Search means for searching similar album data similar to album data,
A transmitting means for transmitting, when the similar album data is found by the search, at least one of the similar album data and the similar album information indicating the similar album data together with the browsing album data;
Program to function as.   The computer-readable recording medium which recorded the program of Claim 15 or 16.

Images