JP4444856B2 - Title assigning device, title assigning method, and program - Google Patents

Description

  The present invention relates to a title assigning device, a title assigning method, and a program. In particular, the present invention relates to a title assigning device, a title assigning method, and a program for the title device that assign a title to a captured image.

Estimate the context of the image data from the date and time attached to the image data acquired by a digital still camera, position information, etc., and pre-registered map information, knowledge of seasonal events, knowledge of the calendar, etc. A technique for titleing image data based on an estimation result has been disclosed (for example, see Patent Document 1).
JP 2002-10178 A

  However, if titles are given to a plurality of image data by the technique of Patent Document 1, the same title may be given to the plurality of image data. Therefore, when the user wants to distinguish and manage images with the same title, complicated operations such as manual re-registration by the user are required.

  Therefore, an object of the present invention is to provide a title assigning apparatus, a title assigning method, and a program that can solve the above-described problems. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.

  The title assigning apparatus according to the first aspect of the present invention includes an image storage unit that stores a plurality of captured images, an imaging time storage unit that stores imaging times at which a plurality of captured images stored by the image storage unit are captured, A period term storage unit that stores a plurality of terms respectively associated with a plurality of periods having different time widths including the period, and a period that includes an imaging time stored in the imaging time storage unit A term term selection unit that selects terms stored in the term storage unit, and a title assignment unit that assigns a title to the captured image stored in the image storage unit using the terms selected by the term term selection unit. When the unit gives the same title to the first captured image and the second captured image, the period term selecting unit stores the term term storage unit in association with the imaging time of the first captured image. Assigned to the first captured image last time The first term relating to a period having a shorter time width than the selected term is selected, and the title assigning unit reassigns the title to the first captured image using the first term selected by the period term selecting unit. .

  When the title assignment unit assigns the same title to the first captured image and the second captured image, the period term selection unit further stores the period term storage unit in association with the imaging time of the second captured image. Among terms, a second term different from the first term related to a period with a shorter time width than the term assigned to the second captured image was selected, and the title giving unit was selected by the term term selection unit The second term may be used to reassign the title to the second captured image.

  The image storage unit stores a captured image group including a plurality of captured images, and the period term selection unit includes an imaging period including imaging times of the plurality of captured images included in the captured image group stored in the image storage unit. The term storage unit selects a term stored in association with the time within the period, and the title assigning unit assigns a title to the captured image group stored in the image storage unit using the term selected by the term term selecting unit. It's okay.

  The title assigning method according to the second aspect of the present invention includes an image storage stage for storing a plurality of captured images, and an imaging time storage stage for storing imaging times at which the plurality of captured images stored in the image storage stage are captured. A period term storage stage for storing a plurality of terms associated with a plurality of periods having different time widths including the period, and a period including an imaging time stored in the imaging time storage stage A term term selection step for selecting a term to be stored in the term term storage step, and a title assignment step for giving a title to the captured image stored in the image storage step using the term selected in the term term selection step When the same title is assigned to the first captured image and the second captured image in the title providing step, the first captured image is selected in the period term selecting step. Among the terms stored in the term term storage stage in association with the image time, a first term related to a period having a shorter time width than the term assigned to the first captured image is selected, and in the title assignment stage, The title is reassigned to the first captured image using the first term selected in the period term selection step.

  According to the third aspect of the present invention, there is provided a program for a title assigning device that assigns a title to a captured image, the title assigning device including an image storage unit that stores a plurality of captured images, and a plurality of image storage units that store the title storage device. An imaging time storage unit that stores an imaging time when the captured image of the image is captured, a period term storage unit that stores a plurality of terms associated with a plurality of periods having different time widths including the period, and an imaging A term term selection unit that selects a term stored in the term term storage unit in association with a period including the imaging time stored in the time storage unit, and an image stored in the image storage unit using the term selected by the term term selection unit When the title assigning unit functions as a title assigning unit that assigns a title to the image, and the title assigning unit assigns the same title to the first captured image and the second captured image, the imaging time of the first captured image is displayed in the period term selecting unit Associate with Of the terms stored in the term term storage unit, the first term related to a period having a shorter time width than the term assigned to the first captured image is selected, and the term term selection unit selects the term terminator. Using the first term, the title is reassigned to the first captured image.

  A title assigning apparatus according to a fourth aspect of the present invention includes an image storage unit that stores a plurality of captured images, an imaging position storage unit that stores imaging positions where the plurality of captured images stored in the image storage unit are captured, A regional term storage unit that stores a plurality of terms associated with a plurality of regions having different sizes including the position, and a regional term storage unit that is associated with the imaging position stored in the imaging position storage unit A regional term selection unit that selects a term stored in the image storage unit, and a title provision unit that assigns a title to the captured image stored in the image storage unit using the term selected by the regional term selection unit. In the case where the same title is assigned to the first captured image and the second captured image, the regional term selection unit selects the first of the terms stored in the regional term storage unit in association with the imaging position of the first captured image. The term given to the captured image Selecting a first term related to the small area, title assigning unit, using the first term regional term selection unit selects and reapplication of the title in the first captured image.

  When the title assignment unit assigns the same title to the first captured image and the second captured image, the regional term selection unit further stores the regional term storage unit in association with the imaging position of the second captured image. Among the terms, a second term different from the first term and related to a region narrower than the term assigned to the second captured image is selected, and the title assigning unit selects the second term selected by the region term selecting unit. Terminology may be used to reassign the title to the second captured image.

  The image storage unit stores a captured image group including a plurality of captured images, and the regional term selection unit includes an imaging region including the imaging positions of the plurality of captured images included in the captured image group stored in the image storage unit. The regional term storage unit selects a term stored in association with the position in the image, and the title assignment unit assigns a title to the captured image group stored in the image storage unit using the term selected by the regional term selection unit. It's okay.

  The title assigning method according to the fifth aspect of the present invention includes an image storage stage for storing a plurality of captured images, and an imaging position storage stage for storing imaging positions at which the plurality of captured images stored in the image storage stage are captured. A regional term storage stage for storing a plurality of terms associated with a plurality of areas of different sizes including the position, and a regional term corresponding to the imaging position stored in the imaging position storage stage A regional term selection step for selecting terms to be stored in the storage step, and a title assignment step for assigning a title to the captured image stored in the image storage step using the terms selected in the regional term selection step, When the same title is assigned to the first captured image and the second captured image in the title providing step, the regional term selecting step is associated with the imaging position of the first captured image. Of the terms stored in the regional term storage stage, the first term related to a region narrower than the term assigned to the first captured image is selected, and the title provision stage is selected in the regional term selection stage. The title is reassigned to the first captured image using the term 1.

  According to a sixth aspect of the present invention, there is provided a program for a title assigning device that assigns a title to a captured image, wherein the title assigning device includes an image storage unit that stores a plurality of captured images, and a plurality of image storage units that store the title storage device. An imaging position storage unit that stores an imaging position where the captured image of the image is captured, an area term storage unit that stores a plurality of terms associated with a plurality of areas having different sizes including the position, and an imaging position storage unit A regional term selection unit that selects a term stored in the regional term storage unit in association with an imaging position stored in the position storage unit, and a title selected in the captured image stored in the image storage unit using the term selected by the regional term selection unit When the same title is assigned to the first captured image and the second captured image, the title assigning unit associates the area term selection unit with the imaging position of the first captured image. Regional terminology The first term related to the region narrower than the term assigned to the first captured image is selected from the terms stored in the first captured image, and the first term selected by the regional term selection unit is used for the title assigning unit. Thus, the title is reassigned to the first captured image.

  Note that the above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  ADVANTAGE OF THE INVENTION According to this invention, the title provision apparatus which provides a different suitable title to a some image can be provided.

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the claimed invention, and all combinations of features described in the embodiments are inventions. It is not always essential to the solution.

  FIG. 1 shows an example of a usage environment of a title assigning apparatus 100 according to an embodiment of the present invention. In FIG. 1, a personal computer that assigns a title to a captured image and displays the title on an output unit 110 such as a liquid crystal display is shown as an example of the title assignment device 100. The title assigning device 100 stores a plurality of images captured using a digital still camera or the like together with an imaging location and an imaging time at which the image was captured. Then, when displaying the image selected by the user 180, the title assigning apparatus 100 records a title related to the image capturing time and the image capturing location together with the image. Then, the title assigning apparatus 100 combines the title with the image and displays it on the output unit 110. For example, when displaying an image captured at Kinkakuji in the spring of 2004, the title assigning apparatus 100 assigns a title such as “in spring 2004, in Kyoto” and displays it on the output unit 110 together with the image. Note that the title assigning apparatus 100 may assign a title to each of a plurality of images, or may assign one title to a plurality of images, such as a title attached to an album including a plurality of images.

  The title assigning apparatus 100 assigns different titles to a plurality of images displayed at once on the screen of the output unit 110. For example, the title assigning apparatus 100 does not assign the same title such as “in spring 2004, in Kyoto” to two images taken at Kinkakuji and Kyoto Station, and for example, restricts the time and place of imaging of each image. For example, the titles “May 2004, at Kinkakuji” and “May 2004, at Kyoto Station” are assigned to each image. In addition, in order to assign different titles to a plurality of albums, the title assigning apparatus 100 assigns the same title to a plurality of albums. Reassign titles using terms that limit the scope of the place.

  Further, the title assigning apparatus 100 identifies the person to be imaged from the face of a person shown in the image. In addition, the title assigning device 100 includes the face of the user 180 imaged by the imaging unit 102 provided in the title assigning device 100 and / or the voice of the user 180 recorded by the recording unit 104 provided in the title assigning device 100. From this, the user 180 who browses the image is identified. Then, the title assigning apparatus 100 assigns a title according to the personal relationship between the user 180 and the person to be imaged to the image. For example, when the title assigning apparatus 100 determines that the grandchild of the user 180 is the imaged person, the title assigning apparatus 100 assigns the title “in spring 2004, grandson and Kyoto” to the image.

  In addition to the personal computer, the title assigning apparatus 100 may be a device that displays an image on a screen, such as an electronic photo stand or an HDTV. In addition, the title assigning apparatus 100 may be a digital still camera, a mobile phone with a camera, a PDA, or the like, and may capture an image and give a title to the image and display it on the screen. The title assigning device 100 may be a device that prints an image, such as a printer, and may print out the image and the title. In addition, the title assigning apparatus 100 may manage a plurality of images based on the assigned title. For example, the title assigning apparatus 100 may manage a plurality of images by storing the plurality of images in a directory having names assigned to the plurality of images.

  According to the title assigning apparatus 100 described above, an appropriate title can be automatically added to the image and provided to the user 180. Therefore, the user 180 can enjoy the image happily without taking the trouble of determining and registering a title suitable for the contents of many images.

  FIG. 2 shows an example of a block configuration of the title assigning apparatus 100. The title assigning apparatus 100 includes an imaging unit 102, a recording unit 104, an output unit 110, a captured image storage unit 210, a face image storage unit 212, an imaged person determination unit 214, a viewer determination unit 216, a voice storage unit 218, and output control. Unit 220, output time acquisition unit 222, period term storage unit 270, period term selection unit 272, imaging period determination unit 274, imaging time storage unit 276, title assignment unit 282, person relationship storage unit 284, reference position storage unit 286, A regional term storage unit 290, a regional term selection unit 292, an imaging region determination unit 294, and an imaging position storage unit 296 are provided.

  The captured image storage unit 210 stores a captured image group including a plurality of captured images. The imaging position storage unit 296 stores imaging positions at which each of the plurality of captured images stored in the captured image storage unit 210 is captured. The imaging time storage unit 276 stores imaging times when each of the plurality of captured images stored in the captured image storage unit 210 is captured. For example, the captured image storage unit 210 stores captured images in association with image IDs that identify a plurality of captured images. In addition, the imaging position storage unit 296 stores the latitude and longitude information received from the GPS satellite at the timing when the captured image is captured in association with the image ID. The imaging time storage unit 276 stores the imaging time when the captured image is captured in association with the image ID.

  The imaging period determination unit 274 determines the imaging period and the imaging timing including the imaging time stored in the imaging time storage unit 276. For example, the imaging period determination unit 274 stores, in the imaging time storage unit 276, the oldest imaging time in time and the newest imaging in time among the imaging times when the captured image group including a plurality of captured images is captured. Determine the time range between times.

  The term term storage unit 270 stores terms related to the period and time in association with the period and time. The term term storage unit 270 stores a plurality of terms associated with a plurality of periods having different time widths including the period and the period in association with the period and the period. For example, the term term storage unit 270 stores terms relating to a plurality of periods having different time widths such as “October”, “Autumn”, and “2004” as terms relating to October of 2004.

  The term term selection unit 272 stores the term stored in the term term storage unit 270 in association with the time within the imaging period including the imaging time of a plurality of captured images included in the captured image group stored in the captured image storage unit 210. Select. Specifically, the period term selection unit 272 selects a term stored in the period term storage unit 270 in association with a period including the imaging time stored in the imaging time storage unit 276. More specifically, the period term selection unit 272 selects a term stored in the period term storage unit 270 in association with the imaging period and the imaging timing determined by the imaging period determination unit 274. For example, the term term selection unit 272 may store the terms stored in the term term storage unit 270 when the imaging term determination unit 274 determines that an image captured in October is stored in the captured image storage unit 210. Select “October” from the list.

  The title assigning unit 282 uses the terms stored in the term term storage unit 270 in association with the imaging period and the period including the imaging time determined by the imaging period determination unit 274, and the imaging stored in the captured image storage unit 210. Give titles to images. Specifically, the title assignment unit 282 assigns a title to the captured image stored in the captured image storage unit 210 using the term selected by the period term selection unit 272.

  The output unit 110 outputs a plurality of images included in the captured image group stored in the captured image storage unit 210 and outputs the title given by the title assigning unit 282. Specifically, the output control unit 220 causes the output unit 110 to output the captured image stored in the captured image storage unit 210, and causes the output unit 110 to output the title provided by the title providing unit 282. The output unit 110 may be a display device that displays an image, such as a liquid crystal display, or may be a printing device that prints and outputs an image. The output unit 110 may output the title to a device different from the device that outputs the image.

  The output time acquisition unit 222 acquires the output time at which output of a plurality of captured images stored in the captured image storage unit 210 is requested. The title assigning unit 282 stores the term term when the difference between the imaging time included in the imaging period and the imaging timing determined by the imaging period determination unit 274 and the output time acquired by the output time acquisition unit 222 is longer. Of the plurality of terms stored in the unit 270, a title is assigned using a term related to a longer time period.

  For example, when the period term selection unit 272 is requested to output the captured image in the winter of 2004, the period term selection unit 272 is requested to select “autumn” stored in the period term storage unit 270 and output it five years later. If it is, “2004” related to a period with a wider time width is selected. For this reason, the term term selection unit 272 can provide the title giving unit 282 with terms that are easy to understand for the user 180.

  The imaging area determination unit 294 determines an imaging area including the imaging position stored in the imaging position storage unit 296. For example, the imaging period determination unit 274 determines an area including a plurality of imaging positions stored in the imaging position storage unit 296 as an imaging position where a captured image group including a plurality of captured images is captured.

  The regional term storage unit 290 stores terms associated with the region including the location in association with the location. The regional term storage unit 290 stores a plurality of terms associated with a plurality of regions each having a different area including the location in association with the location. For example, the regional term storage unit 290 is associated with a plurality of regions having different sizes such as “Kinkakuji”, “Kyoto City”, “Kyoto Prefecture”, and “Japan” in association with the latitude and longitude of the location of the Kinkakuji. Stores terms.

  The regional term selection unit 292 is a term stored in the term term storage unit 270 in association with a position in the imaging region including the imaging positions of a plurality of captured images included in the captured image group stored in the captured image storage unit 210. Select. Specifically, the regional term selection unit 292 selects a term stored in the regional term storage unit 290 in association with the imaging position stored in the imaging position storage unit 296. More specifically, the regional term selection unit 292 selects terms stored in the regional term storage unit 290 in association with the imaging region determined by the imaging region determination unit 294.

  The title assigning unit 282 further uses the terms stored in the regional term storage unit 290 in association with the position in the imaging region determined by the imaging region determination unit 294, and applies a title to the captured image group stored in the captured image storage unit 210. Is granted. Specifically, the title assignment unit 282 assigns a title to the captured image stored in the captured image storage unit 210 using the term selected by the regional term selection unit 292.

  The reference position storage unit 286 stores a preset reference position. When the difference between the imaging position included in the imaging area determined by the imaging area determination unit 294 and the reference position stored in the reference position storage unit 286 is farther, the title assigning unit 282 determines that the area term storage unit 290 Of the plurality of terms to be stored, the title is given using terms related to a wider area. For example, the reference position storage unit 286 stores a position that the user 180 uses as a base of daily life, such as a position of the user 180 who owns the title assignment device 100. Then, the regional term selection unit 292 determines the terms related to a wider region, for example, “Kyoto City”, “Kyoto Prefecture”, “Japan” as the distance between the home position of the user 180 and the imaging position increases. Select terms in the following order. Then, for example, when the user 180 living in a country other than Japan browses an image captured at Kinkakuji, the title assigning unit 282 assigns the title “memory of Japan” to the image. For example, when the user 180 residing in Kyoto views the same image, the title assigning unit 282 is not a title that the user 180 feels uncomfortable, such as “memory of Japan”, but “memory of Kinkakuji” A title that is natural to the user 180 is added to the image.

  The face image storage unit 212 stores a person's face image in association with the person. The person to be imaged determination unit 214 determines the person to be imaged of the captured image stored in the captured image storage unit 210. Specifically, the person to be imaged determination unit 214 stores the captured image storage unit 210 by comparing the captured image stored in the captured image storage unit 210 with the face image stored in the face image storage unit 212. The person to be imaged is determined.

  The imaging unit 102 images a viewer who browses the captured image output by the output unit 110. The browser determination unit 216 determines a viewer who browses the captured image output by the output unit 110. Specifically, the viewer determination unit 216 browses the captured image output by the output unit 110 by comparing the browser image captured by the imaging unit 102 with the face image stored in the face image storage unit 212. To determine who will be viewing.

  The voice storage unit 218 stores a person's voice in association with the person. The recording unit 104 records the voice of a viewer who browses the captured image output from the output unit 110. Then, the viewer determination unit 216 determines the viewer who browses the captured image output by the output unit 110 by comparing the voice recorded by the recording unit 104 with the voice stored by the voice storage unit 218. For example, the voice storage unit 218 stores voiceprint data in association with a person. Then, the viewer determination unit 216 determines the viewer by comparing the voice print recorded by the recording unit 104 with the voice print data stored in the voice storage unit 218.

  The person relationship storage unit 284 stores a mutual relationship between a plurality of persons. The title assigning unit 282 applies a title to the captured image group stored in the captured image storage unit 210 based on the relationship between the imaged person determined by the imaged person determination unit 214 and the viewer determined by the viewer determination unit 216. Is granted. Specifically, the title assigning unit 282 determines the person to be imaged determined by the imaged person determination unit 214 and the viewer determination unit 216 based on the mutual relationship between a plurality of persons stored in the person relationship storage unit 284. Judge the relationship with the viewer. For example, the personal relationship storage unit 284 stores personal relationships such as “Father” and “Brother”. Then, the title assigning unit 282 assigns a title including the personal relationship stored in the personal relationship storage unit 284 to the image.

  Note that the person to be imaged determination unit 214 determines each person to be imaged of the plurality of captured images stored in the captured image storage unit 210. Then, the title assigning unit 282 determines the relationship between the person to be imaged of the most captured images among the plurality of person to be imaged determined by the person to be imaged determination unit 214 and the user who has determined the viewer determination unit 216. Based on this, a title is assigned to the captured image group stored in the captured image storage unit 210. For this reason, the person to be imaged determination unit 214 appropriately determines the person to be imaged intended by the user 180 even if tourists unrelated to the user 180 are reflected in the captured image captured at the sightseeing spot, for example. Can do.

  When the title assigning unit 282 assigns the same title to the first captured image and the second captured image, the period term selecting unit 272 associates the period term storage unit 270 with the imaging time of the first captured image. The first term related to a period with a shorter time width than the term assigned to the first captured image is selected. Then, the term term selection unit 272 further has a time period shorter than the term given to the second captured image last time among terms stored in the term term storage unit 270 in association with the imaging time of the second captured image. A second term different from the first term related to is selected. Then, the title assigning unit 282 reassigns the title to the first captured image using the first term selected by the period term selecting unit 272. Further, the title assigning unit 282 reassigns the title to the second captured image using the second term selected by the period term selecting unit 272.

  The title assigned to the second captured image group such as an existing album created by the user 180 is the same as the title assigned to the first captured image group such as an album newly created by the user 180. In such a case, the term term selection unit 272 newly selects a term related to a term having a shorter time width than the term assigned to the first captured image group. Then, the title assigning unit 282 reassigns the title to the first captured image group using the term newly selected by the period term selecting unit 272. Furthermore, the term term selection unit 272 selects a term different from the term used when re-assigning to the first captured image group related to a period with a shorter time width than the term assigned to the second captured image group. To do. Then, the title assigning unit 282 reassigns the title to the second captured image group using the term selected by the period term selecting unit 272.

  Further, when the title assigning unit 282 gives the same title to the first captured image and the second captured image, the regional term selecting unit 292 associates with the imaging position of the first captured image, the regional term storage unit 290. The first term related to the area narrower than the term assigned to the first captured image is selected. Then, the regional term selection unit 292 further relates to a region narrower than the term assigned to the second captured image last time among the terms stored in the regional term storage unit 290 in association with the imaging position of the second captured image. , Select a second term different from the first term. Then, the title assigning unit 282 reassigns the title to the first captured image using the first term selected by the regional term selecting unit 292. Then, the title assigning unit 282 reassigns the title to the second captured image using the second term selected by the regional term selecting unit 292.

  The title assigned to the second captured image group such as an existing album created by the user 180 is the same as the title assigned to the first captured image group such as an album newly created by the user 180. In this case, the regional term selection unit 292 newly selects a term related to a region narrower than the term assigned to the first captured image group. Then, the title assigning unit 282 reassigns the title to the first captured image group using the term newly selected by the regional term selecting unit 292. Furthermore, the regional term selection unit 292 selects a term different from the term used when re-assigning to the first captured image group, which is related to an area narrower than the term assigned to the second captured image group. Then, the title assigning unit 282 reassigns the title to the second captured image group using the term selected by the regional term selecting unit 292. For this reason, the title assigning unit 282 does not assign the same title as the title assigned to the existing album to the newly created album. Therefore, the user 180 can easily distinguish each album.

  According to the title assigning apparatus 100 described above, it is possible to provide an image with an appropriate title according to the place where the image was taken, the time, and the person to be imaged and / or the viewer. In addition, the user 180 can easily view an image to which an appropriate title is assigned without performing a complicated operation in which the user 180 manually inputs the title or the like to give the image. In addition, since the title assigning unit 282 assigns different titles to a plurality of albums and / or a plurality of images, the user 180 can easily distinguish a plurality of albums and / or a plurality of images.

  FIG. 3 shows an example of data stored in the term term storage unit 270 in a table format. The term term storage unit 270 stores terms related to each of a plurality of periods having different times and time widths. The term term storage unit 270 stores the term term. For example, the term term storage unit 270 stores terms such as “athletic day”, “October 9”, “October”, “autumn”, and “2004” as terms related to October 9, 2004. . For example, the term term selection unit 272 can select the term “October 9” as the title to be added to the image captured on October 9, or can select the term “athletic meet”. it can. In addition, the term term selection unit 272 may select the term “October 9 athletic meet”, for example. The term term selection unit 272 can also select a term such as “October athletic meet” in the images captured on October 9 and October 10, for example. Therefore, the term term storage unit 270 can provide an appropriate term to the title assigning unit 282 according to the time range in which a plurality of images are captured.

  The term term storage unit 270 may store a term indicating a time and period relative to the current time. For example, the term term storage unit 270 stores the term “this year” at the time of 2004 as a term in the time range indicating 2004. And the term term storage part 270 may update the term to store according to progress of time. For example, the term term storage unit 270 updates the term in the time range indicating 2004 to “last year” when 2005 is reached. As a result, the term term storage unit 270 can provide an appropriate term that matches the human sense of time to the title assigning unit 282.

  The term term storage unit 270 may be realized by software that causes the title assigning apparatus 100 to function as term data, or may be realized by recording term data on a recording medium. Further, the term term storage unit 270 may receive an input from the user 180 and store a term input from the user 180. As a result, the term term storage unit 270 can provide a term according to the individual of the user 180 such as “birthday” to the title assigning unit 282.

  FIG. 4 shows an example of data stored in the regional term storage unit 290 in a table format. The regional term storage unit 290 stores terms related to each of a plurality of regions having different sizes in association with latitude and longitude information. For example, the regional term storage unit 290 stores “Kyoto Station”, “Kyoto City”, “Kyoto Prefecture”, and “Japan” in association with the latitude and longitude information of Kyoto Station. At this time, the term term selection unit 272 may select “Kyoto Station” for an image captured at Kyoto Station, for example. The term term selection unit 272 can also give the title “Kyoto City” to images taken at “Kyoto Station” and “Kinkakuji”, for example. That is, the regional term storage unit 290 can provide the appropriate terminology including the imaging region where a plurality of images are captured to the title assigning unit 282.

  The reference position storage unit 286 stores a preset reference position, for example, the latitude and longitude of the user 180's home position. At this time, for example, when the home of the user 180 is in a country other than Japan, the regional term storage unit 290 provides the title granting unit 282 with the term “Japan” as the title term to be given to the image captured at Kinkakuji. be able to. Further, the regional term storage unit 290 can provide the term “Kinkakuji” to the title assigning unit 282 when the user 180 who is home in Kyoto Prefecture views the same image. As a result, for example, when a user 180 in a country other than Japan browses an image captured at Kinkakuji, a title such as “2004, Japanese memories” is given to the image by the title assigning unit 282. When the user 180 who is home in Kyoto browses the same image, the title of the user 180 such as “2004, memories of Kinkakuji” is not the title that the user 180 feels uncomfortable, such as “2004, memories of Japan”. A natural title is given to the image by the title giving unit 282.

  FIG. 5 shows an example of the title given to the captured image. In this example, the captured image storage unit 210 stores images captured at times t501 to t503 in April 2004 and images captured at times t504 to t506 in May 2004. Note that the imaging position storage unit 296 has an imaging position when imaged at Kinkakuji at times t501 to t503, an imaging position when imaged at Kiyomizudera at times t504 and t505, and an imaging position when imaged at Kyoto Station at time t506. The latitude and longitude information is stored.

  When the title assignment device 100 is requested at time t507 in June 2004 to output an image captured at times t501 to t503, the title assignment unit 282 assigns the title “April, at Kinkakuji”. To do. Further, when a request is made at time t507 to output images taken at time t504 and t505, the title “May, at Kiyomizu Temple” is given. When the title assigning apparatus 100 is requested at time t507 to output an image picked up at times t504 to t506, the terminology storage unit 270 displays a regional term including the position, for example, “Kyoto city”. To give the title “May, in Kyoto, Japan”.

  In addition, when the title assigning apparatus 100 is requested at time t508 in 2010 to output an image captured at times t501 to t503, the title assigning apparatus 100 has a time range in which the time width is wider than “May”. For example, “2004” is selected from the term storage unit 270, and the title “2004, at Kinkakuji” is given. Similarly, at time t508, the title assigning unit 282 adds “2004 at Kiyomizu Temple”, “2004, Kyoto City” to the image captured at time t504 to t506 and the image captured at time t504 to t506, respectively. Title. Note that when the country 180 is set as a reference position by the user 180 in the reference position storage unit 286 by the user 180, the title assigning apparatus 100 adds “2004 in Japan in 2004” to images captured at times t504 to t506. "And output. As described above, the title assigning apparatus 100 can assign a title that is easy for the user 180 to recognize the location and period when the image is captured.

  FIG. 6 shows an example of data stored in the face image storage unit 212 in a table format. The face image storage unit 212 stores a face image obtained by imaging a person's face in association with a person ID for identifying the person. Note that the face image storage unit 212 may store a face image registered from a person image captured by the imaging unit 102. In addition, the face image storage unit 212 may extract and store a human face image from an image region selected by the user 180 of the image stored in the captured image storage unit 210. Further, the face image storage unit 212 may store a feature amount extracted from the face image instead of the face image itself. For example, the face image storage unit 212 may include a face contour shape, a shape of a characteristic part of the face such as an eye, a nose, or a mouth, a position of each part in the whole face, or a positional relationship between the parts. Etc. may be stored.

  The viewer determination unit 216 extracts the feature amount of the viewer's face from the image captured by the imaging unit 102, and compares the feature amount with the feature amount of the face image stored in the face image storage unit 212. Thus, the person ID of the viewer may be determined. Similarly, the person to be imaged determination unit 214 extracts the feature amount of the face of the subject in the captured image stored in the captured image storage unit 210 and calculates the feature amount of the face image stored in the face image storage unit 212. The person ID of the person to be imaged may be determined by comparison. Note that the viewer determination unit 216 and the person to be imaged determination unit 214 determine an image region including a human face by extracting an image region having a color close to the color of human skin, and perform edge extraction or the like in the image region. The feature amount of the face may be extracted based on the contour of the subject extracted using.

  Note that the person to be imaged determination unit 214 may determine the person ID of the person to be imaged by comparing an image in a predetermined range including the center of the captured image with the face image. Further, the person to be imaged determination unit 214 may extract the face image of the person to be imaged from a subject in an image area whose spatial frequency is larger than a predetermined value in the captured image. Note that the person to be imaged determination unit 214 may determine the person IDs of a plurality of persons to be imaged in the captured image.

  FIG. 7 shows an example of data stored in the voice storage unit 218 in a table format. The voice storage unit 218 stores voiceprint data obtained from a voice uttered by a person in association with the person ID. The voice storage unit 218 preferably stores voiceprint data extracted from the voice of the person recorded by the recording unit 104. Then, the viewer determination unit 216 extracts the voiceprint data from the voice recorded by the recording unit 104 and compares it with the voiceprint data stored in the voice storage unit 218, thereby determining the person ID of the viewer.

  FIG. 8 shows an example of data stored in the person relationship storage unit 284 in a table format. The person relationship storage unit 284 stores a person ID for identifying a person, a person ID for identifying a person different from the person, and a mutual relationship between these persons. In the example of FIG. 8, the person relationship storage unit 284 stores “brother” as the relationship of the person with the person ID # 602 viewed from the person with the person ID # 601. In addition, the person relationship storage unit 284 stores “Father” as the relationship of the person with the person ID # 701 viewed from the person with the person ID # 601. The person relationship storage unit 284 stores “friend” as the relationship of the person with the person ID # 702 as seen from the person with the person ID # 701.

  Then, the title assigning unit 282 includes the person IDs of the person to be imaged and the viewer determined by the person to be imaged determination unit 214 and the viewer determination unit 216, and the mutual relationship stored in the person relationship storage unit 284. Based on the above, the relationship between the viewer and the person to be imaged is determined. And the title provision part 282 provides the image with the title containing the term which shows a person relationship based on the said relationship. For example, when the viewer is a person identified by # 601 and the person to be imaged is a person identified by # 602, the title assigning unit 282 assigns a title including “brother” to the image. Further, for example, when the viewer is a person identified by # 601 and the person to be imaged is a person identified by # 702, the title assigning unit 282 displays a title including “father's friend” as an image. To grant. When the viewer determined by the viewer determination unit 216 is the same person as the imaged person determined by the imaged person determination unit 214, the title assigning unit 282 displays a title including “I”, for example. You may give to an image. In addition, when the viewer determining unit 216 determines that a plurality of non-imaging persons including the viewer are included in the image, the title assigning unit 282 allows the viewer to take an image such as “with brother”. A title including the fact that it is included as a person may be given to the image.

  Note that the title assigning unit 282 may include a title template that generates a title. For example, the title assignment unit 282 includes a term term that is a term selected by the term term selection unit 272, a regional term that is a term selected by the regional term selection unit 292, and a person-related term determined by the viewer and the person to be imaged. You may have a title template whose title is determined by fitting. For example, the title assigning unit 282 generates the title “At the elder brother of 2004, at Kinkakuji” using the title template “At the term term“ Person related term ”,“ Regional term ”. When the viewer is included in the plurality of subjects to be imaged determined by the image-captured person determination unit 214, the title assigning unit 282 displays ““ period term ”,“ person-related term ”, and“ regional term ”. Using the title template “At”, the title “At my brother and Kinkakuji in 2004” may be generated.

  FIG. 9 shows an example of the flow of processing for assigning a title. The title assigning unit 282 determines the person to be imaged by receiving the person ID of the person included in the captured image output to the output unit 110 from the imaged person determination unit 214 (S902). When the title assigning device 100 assigns a title to a plurality of images, the person-to-be-photographed person determination unit 214 acquires a person ID of a person included in each of the plurality of captured images, and the title assigning unit 282 Of the person IDs received from the image-captured person determination unit 214, the person ID determined from the largest number of images is determined as the person ID of the image-captured person.

  Then, the title assigning unit 282 determines the viewer by receiving the viewer's person ID from the viewer determining unit 216 (S904). Then, the title assigning unit 282 determines the interrelationship of the imaged person viewed from the viewer based on the data stored in the person relationship storage unit 284 (S906). And the title provision part 282 determines the term which shows the mutual relationship of the to-be-photographed person seen from the browsing person (S908).

  In addition, the imaging period determination unit 274 determines an imaging period and an imaging timing when the captured image output to the output unit 110 is captured (S910). Then, the term term selection unit 272 selects terms related to the term and the period from the term term storage unit 270 based on the imaging period and the imaging timing determined in S910 (S912). Further, the imaging region determination unit 294 determines the imaging region where the captured image output to the output unit 110 is captured (S914). Then, the regional term selection unit 292 selects a term related to the imaging region from the regional term storage unit 290 based on the imaging region determined in S914 (S916).

  Then, the title assigning unit 282 determines a title for the image to be output to the output unit 110 using the terms selected in S908, S912, and S916 (S918). Then, the title assigning unit 282 determines whether or not the same title is assigned to a plurality of images and / or a plurality of image groups (S920). At this time, the title assigning unit 282 determines whether or not the same title is assigned to each image and / or image group, for example, when assigning titles to a plurality of images displayed on the output unit 110, respectively. Good. In addition, when the output unit 110 prints out an image and a title on a print medium, the title assigning unit 282 determines whether or not the same title is assigned to a plurality of images output on the print medium. Good.

  In S920, when it is determined that the same title is not assigned to a plurality of images and / or a plurality of image groups, the title assignment unit 282 transmits the title to be assigned to the image to the output control unit 220, and performs output control. The unit 220 causes the output unit 110 to output the image and the title (S922). When it is determined in S920 that the same title is assigned to a plurality of images and / or a plurality of image groups, the term term selection unit 272 differs from the term selected in S912 and has a time width that is longer than the term. A term related to a short period of time is newly selected (S924). At this time, the term term selection unit 272 newly selects a term for each of the images assigned with the same title in S920.

  Then, the regional term selection unit 292 newly selects a term different from the term selected in S916 and related to a region narrower than the term (S926). Note that the term term selection unit 272 newly selects a term for each of a plurality of images and / or a plurality of image groups determined to have the same title in S920. And the title provision part 282 determines a new title in S918 using the term selected in S924 and S926. Therefore, the title assigning apparatus 100 can provide the user 180 with different titles assigned to the plurality of images and / or the plurality of image groups.

  FIG. 10 shows an example of a hardware configuration of the title assigning apparatus 100 according to the present embodiment. The title assignment device 100 includes a CPU peripheral unit including a CPU 1505, a RAM 1520, a graphic controller 1575, and a display device 1580 connected to each other by a host controller 1582, and communication connected to the host controller 1582 by an input / output controller 1584. An input / output unit having an interface 1530, a hard disk drive 1540, and a CD-ROM drive 1560, and a legacy input / output unit having a ROM 1510, a flexible disk drive 1550, and an input / output chip 1570 connected to the input / output controller 1584. .

  The host controller 1582 connects the RAM 1520, the CPU 1505 that accesses the RAM 1520 at a high transfer rate, and the graphic controller 1575. The CPU 1505 operates based on programs stored in the ROM 1510 and the RAM 1520 and controls each unit. The graphic controller 1575 acquires image data generated by the CPU 1505 and the like on a frame buffer provided in the RAM 1520 and displays the image data on the display device 1580. Alternatively, the graphic controller 1575 may include a frame buffer that stores image data generated by the CPU 1505 or the like.

  The input / output controller 1584 connects the host controller 1582 to the hard disk drive 1540, the communication interface 1530, and the CD-ROM drive 1560, which are relatively high-speed input / output devices. The hard disk drive 1540 stores programs and data used by the CPU 1505. The communication interface 1530 is connected to the network communication device 1598 to transmit / receive programs or data. The CD-ROM drive 1560 reads a program or data from the CD-ROM 1595 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520.

  The input / output controller 1584 is connected to the ROM 1510, the flexible disk drive 1550, and the relatively low-speed input / output device of the input / output chip 1570. The ROM 1510 stores a boot program that the title assigning apparatus 100 executes at startup, a program that depends on the hardware of the title assigning apparatus 100, and the like. The flexible disk drive 1550 reads a program or data from the flexible disk 1590 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520. The input / output chip 1570 connects various input / output devices via a flexible disk drive 1550 and, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

  A program executed by the CPU 1505 is stored in a recording medium such as the flexible disk 1590, the CD-ROM 1595, or an IC card and provided by the user. The program stored in the recording medium may be compressed or uncompressed. The program is installed in the hard disk drive 1540 from the recording medium, read into the RAM 1520, and executed by the CPU 1505.

  The program executed by the CPU 1505 includes the title assigning device 100, the imaging unit 102, the recording unit 104, the output unit 110, the captured image storage unit 210, the face image storage unit 212, the imaged person determination unit 214, and the viewer determination unit 216. , Voice storage unit 218, output control unit 220, output time acquisition unit 222, period term storage unit 270, period term selection unit 272, imaging period determination unit 274, imaging time storage unit 276, title assignment unit 282, person relation storage unit 284, a reference position storage unit 286, a regional term storage unit 290, a regional term selection unit 292, an imaging region determination unit 294, and an imaging position storage unit 296.

  The program shown above may be stored in an external storage medium. As the storage medium, in addition to the flexible disk 1590 and the CD-ROM 1595, an optical recording medium such as a DVD or PD, a magneto-optical recording medium such as an MD, a tape medium, a semiconductor memory such as an IC card, or the like can be used. Further, a storage device such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium, and the program may be provided to the title assigning device 100 via the network.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. Various modifications or improvements can be added to the above embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

FIG. 3 is a diagram showing a usage environment of a title assigning apparatus 100. FIG. 2 is a diagram showing a block configuration of a title assigning apparatus 100. It is a figure which shows the data which the term term storage part 270 stores in a table format. It is a figure which shows the data which the regional term storage part 290 stores in a table format. It is a figure which shows a captured image and the title provided. It is a figure which shows the data which the face image storage part 212 stores in a table format. It is a figure which shows the data which the voice storage part 218 stores in a table format. It is a figure which shows the data which the personal relationship storage part 284 stores in a table format. It is a figure which shows the flow of the process which provides a title. 2 is a diagram illustrating a hardware configuration of a title assigning apparatus 100. FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Title assignment apparatus 102 Image pick-up part 104 Recording part 110 Output part 180 User 210 Image storage part 212 Face image storage part 214 Imaged person judgment part 216 Viewer judgment part 218 Voice storage part 220 Output control part 222 Output time acquisition part 270 Period Term storage unit 272 Period term selection unit 274 Imaging period determination unit 276 Imaging time storage unit 282 Title assignment unit 284 Person relation storage unit 286 Reference position storage unit 290 Regional term storage unit 292 Regional term selection unit 294 Imaging region determination unit 296 Imaging position Storage

Claims (10)

An image storage unit for storing a plurality of captured images;
An imaging time storage unit that stores imaging times when a plurality of captured images stored in the image storage unit are captured; and
A term term storage unit that stores a plurality of terms respectively associated with a plurality of periods having different time widths including the period in association with the period,
A term term selection unit for selecting a term stored in the term term storage unit in association with a period including the imaging time stored in the imaging time storage unit;
Using a term selected by the term term selection unit, and a title adding unit that gives a title to the captured image stored in the image storage unit,
When the title adding unit gives the same title to the first captured image and the second captured image,
The term term selection unit relates to a term having a shorter time width than the term previously given to the first captured image among terms stored in the term term storage unit in association with the imaging time of the first captured image. Select the first term to
The title assigning unit reassigns a title to the first captured image using the first term selected by the period term selecting unit. When the title adding unit gives the same title to the first captured image and the second captured image,
The term term selection unit further includes a term having a shorter time width than the term previously given to the second captured image among terms stored in the term term storage unit in association with the imaging time of the second captured image. Selecting a second term related to the first term different from the first term;
2. The title assigning apparatus according to claim 1, wherein the title assigning unit reassigns a title to the second captured image using the second term selected by the period term selecting unit. The image storage unit stores a captured image group including a plurality of captured images,
The period term selection unit selects a term stored in the period term storage unit in association with a time within an imaging period including the imaging times of a plurality of captured images included in the captured image group stored in the image storage unit. And
The title assigning apparatus according to claim 1, wherein the title assigning unit assigns a title to the captured image group stored in the image storage unit using the term selected by the term term selecting unit. An image storage stage for storing a plurality of captured images;
An imaging time storage stage for storing imaging times when a plurality of captured images stored in the image storage stage are captured;
A term term storage stage for storing a plurality of terms respectively associated with a plurality of periods having different time widths including the period in association with the period,
A term term selection step of selecting a term stored in the term term storage step in association with a period including the imaging time stored in the imaging time storage step;
Using a term selected in the term term selection step, and adding a title to the captured image stored in the image storage step,
In the title assignment step, when the same title is assigned to the first captured image and the second captured image,
Among the terms stored in the period term storage step in association with the imaging time of the first captured image in the period term selection stage, in a period having a shorter time width than the term assigned to the first captured image last time Select the relevant first term,
In the title provision step, a title provision method for reassigning a title to the first captured image using the first term selected in the period term selection step. A program for a title assigning device that assigns a title to a captured image, the title assigning device comprising:
An image storage unit for storing a plurality of captured images;
An imaging time storage unit that stores imaging times when a plurality of captured images stored in the image storage unit are captured;
A term term storage unit that stores a plurality of terms respectively associated with a plurality of periods having different time widths including the period in association with the period,
A term term selection unit that selects a term stored in the term term storage unit in association with a period including the imaging time stored in the imaging time storage unit;
Using the term selected by the term term selection unit, the term storage unit functions as a title adding unit that adds a title to the captured image stored therein,
When the title adding unit gives the same title to the first captured image and the second captured image,
Among the terms stored in the period term storage unit in association with the imaging time of the first captured image in the period term selection unit, the term is related to a period having a shorter time width than the term assigned to the first captured image last time Select the first term to
A program that causes the title assigning unit to reassign a title to the first captured image using the first term selected by the period term selecting unit. An image storage unit for storing a plurality of captured images;
An imaging position storage unit that stores imaging positions at which a plurality of captured images stored in the image storage unit are captured;
A regional term storage unit that stores a plurality of terms that are associated with a location and that are associated with a plurality of different regions including the location;
A regional term selection unit that selects a term stored in the regional term storage unit in association with an imaging position stored in the imaging position storage unit;
Using a term selected by the regional term selection unit, and a title adding unit for giving a title to the captured image stored in the image storage unit,
When the title adding unit gives the same title to the first captured image and the second captured image,
The regional term selection unit is a first term related to a region narrower than the term assigned to the first captured image last time among terms stored in the regional term storage unit in association with the imaging position of the first captured image. Select a term for
The title assigning unit reassigns a title to the first captured image using the first term selected by the regional term selecting unit. When the title adding unit gives the same title to the first captured image and the second captured image,
The regional term selection unit further relates to a region narrower than a term assigned to the second captured image last time among terms stored in the regional term storage unit in association with an imaging position of the second captured image. Select a second term different from the first term,
The title assigning apparatus according to claim 6, wherein the title assigning unit reassigns a title to the second captured image using the second term selected by the regional term selecting unit. The image storage unit stores a captured image group including a plurality of captured images,
The regional term selection unit selects terms stored in the regional term storage unit in association with positions in an imaging region including imaging positions of a plurality of captured images included in the captured image group stored in the image storage unit. And
The title assigning apparatus according to claim 6, wherein the title assigning unit assigns a title to the captured image group stored in the image storage unit using the term selected by the regional term selecting unit. An image storage stage for storing a plurality of captured images;
An imaging position storage stage for storing imaging positions at which a plurality of captured images stored in the image storage stage are captured; and
A regional term storage stage that stores a plurality of terms that are associated with a location and that are respectively associated with a plurality of regions of different sizes including the location;
A regional term selection step for selecting terms stored in the regional term storage step in association with the imaging positions stored in the imaging location storage step;
Using a term selected in the regional term selection step, and adding a title to the captured image stored in the image storage step,
In the title assignment step, when the same title is assigned to the first captured image and the second captured image,
In the regional term selection step, among terms stored in the regional term storage step in association with the imaging position of the first captured image, the regional term selection step is related to a region narrower than the term assigned to the first captured image last time. Select one term,
In the title assigning step, the title is reassigned to the first captured image using the first term selected in the regional term selecting step. A program for a title assigning device that assigns a title to a captured image, the title assigning device comprising:
An image storage unit for storing a plurality of captured images;
An imaging position storage unit for storing imaging positions at which a plurality of captured images stored in the image storage unit are captured;
A regional term storage unit that stores a plurality of terms that are associated with a location and that are associated with a plurality of different regions including the location.
A regional term selection unit that selects terms stored in the regional term storage unit in association with imaging positions stored in the imaging position storage unit;
Using the term selected by the regional term selection unit, function as a title adding unit that gives a title to the captured image stored in the image storage unit,
When the title adding unit gives the same title to the first captured image and the second captured image,
Of the terms stored in the regional term storage unit in association with the imaging position of the first captured image in the regional term selection unit, the first related to a region narrower than the term assigned to the first captured image last time. Select a term for
A program that causes the title assigning unit to reassign a title to the first captured image using the first term selected by the regional term selecting unit.

Images