JP2006238221A - Output device, output method, image pickup device, image pickup method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an output device enabling a user to conveniently view desirable images to be photographed in an area where the user visits for image pickup, and an image pickup device. <P>SOLUTION: The device is provided with an image storage for storing a plurality of images picked up with the image pickup device; an image pickup position storage for storing the image pickup positions at which the plurality of images to be stored in the image storage are each picked up; a non-image pickup area detector for detecting non-image pickup areas where images are not picked up with the image pickup device, on the basis of the image pickup positions to be stored in the image pickup storage; an image acquisition part for acquiring images to be associated with the non-image pickup areas detected by the non-image pickup area detector and stored, from an image database for associating the images with each of the plurality of areas and storing the images concerning the areas; and an output part for successively outputting the plurality of images to be stored in the image storage and the images acquired by the image acquisition part. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an output device, an output method, an imaging device, an imaging method, and a program. In particular, the present invention relates to an output device and an output method for outputting an image, an imaging device and an imaging method for capturing an image, and a program for the output device and the imaging device.

Conventionally, there is a technology that allows a user to refer to digital image data using a DVD player or the like by processing digital image data captured by a digital camera as a video stream to create a DVD-Video disc or the like. Published (for example, see Patent Document 1).
JP 2003-259303 A

  For example, the user may not be able to capture a representative image of a tourist spot due to reasons such as lack of time to capture a symbol or the like at a tourist spot visited by the user or a bad weather condition. . In such a case, even if the image captured by the digital camera is referred to by the technique described in Patent Document 1, the user cannot appreciate the representative image of the sightseeing spot that could not be captured. In addition, for a user, a representative of a sightseeing spot that could not be captured without performing complicated operations such as separately acquiring an image of a sightseeing spot that could not be captured or editing the image. It is desirable that a typical image can be easily appreciated together with the captured image.

  Accordingly, an object of the present invention is to provide an output device, an output method, an imaging device, an imaging method, and a program that can solve the above-described problems. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.

  An output device according to a first aspect of the present invention includes an image storage unit that stores a plurality of images captured by an imaging device, and an imaging unit that stores an imaging position where each of the plurality of images stored in the image storage unit is captured. A position storage unit, a non-imaging area detection unit that detects a non-imaging area where an image is not captured by the imaging device based on the imaging position stored in the imaging position storage unit, and a plurality of areas in association with each other An image acquisition unit that acquires an image stored in association with the non-imaging area detected by the non-imaging area detection unit from an image database that stores an image related to the area, a plurality of images stored in the image storage unit, and And an output unit that sequentially outputs the images acquired by the image acquisition unit.

  The imaging position storage unit has an imaging device other than the imaging position where each of the plurality of images stored in the image storage unit is captured and the imaging position where each of the plurality of images stored in the image storage unit is captured. The non-imaging area detection unit may detect the non-imaging area including the existence position where the imaging apparatus existed.

  The imaging position storage unit is an imaging position other than the imaging position at which each of the plurality of images stored in the image storage unit is captured, and the imaging position and time, and the plurality of images stored in the image storage unit. The non-imaging area detection unit stores the location and time at which the device was present, and the non-imaging area detection unit detects that the difference between the imaging times when the two images stored in the image storage unit are captured is longer than a preset time. The non-imaging area including the location where the imaging device was present during the imaging time when each of the two images was captured may be detected.

  The non-imaging area detection unit has an imaging device between the imaging times when the two images stored in the image storage unit are captured when the difference between the imaging times when the two images are captured is larger. A larger number of non-imaging areas each including a plurality of existing positions may be detected.

  The imaging position storage unit is an imaging position other than the imaging position at which each of the plurality of images stored in the image storage unit is captured, and the imaging position and time, and the plurality of images stored in the image storage unit. The non-imaging area detection unit stores the location and time at which the device was present, and the non-imaging area detection unit indicates the distance between the imaging positions at which the two images stored in the image storage unit are respectively captured. When the value obtained by dividing the difference between the captured image times is smaller than a preset value, the non-imaging area including the location where the imaging device was present between the captured times when the two images were captured. May be detected.

  The non-imaging area detection unit has a smaller value obtained by dividing the distance between the imaging positions at which the two images stored in the image storage unit are respectively imaged by the difference between the imaging times at which the two images were respectively captured In addition, a larger number of non-imaging regions each including a plurality of existing positions where the imaging device was present during the imaging time when the two images were respectively captured may be detected.

  The output unit may output the plurality of images stored in the image storage unit and the images acquired by the image acquisition unit in the order of the movement path of the imaging device.

  An output method according to a second aspect of the present invention stores an image storage stage that stores a plurality of images captured by an imaging device, and an imaging position at which each of the plurality of images stored in the image storage stage is captured. An imaging position storage stage, a non-imaging area detection stage that detects a non-imaging area where an image is not captured by the imaging device based on the imaging position stored in the imaging position storage stage, and a plurality of areas are associated with each other An image acquisition stage for acquiring an image stored in association with the non-imaging area detected in the non-imaging area detection stage, and a plurality of images stored in the image storage stage from an image database storing images related to the area And an output stage for sequentially outputting the images acquired in the image acquisition stage.

  According to the third aspect of the present invention, there is provided a program for an output device that outputs an image, and the output device stores an image storage unit that stores a plurality of images captured by the imaging device, and a plurality of images stored in the image storage unit. An imaging position storage unit that stores an imaging position at which each of the images is captured, and a non-imaging area detection that detects a non-imaging area where an image is not captured by the imaging device based on the imaging position stored by the imaging position storage unit An image acquisition unit that acquires an image stored in association with the non-imaging area detected by the non-imaging area detection unit, from an image database that stores images related to the area in association with each of the plurality of areas; The image storage unit functions as an output unit that sequentially outputs a plurality of images stored by the image storage unit and images acquired by the image acquisition unit.

  An imaging device according to a fourth aspect of the present invention includes an imaging unit, an image storage unit that stores a plurality of images captured by the imaging unit, and an imaging position at which each of the plurality of images stored by the image storage unit is captured. Corresponding to each of a plurality of areas, an imaging position storage section to store, a non-imaging area detection section that detects a non-imaging area where the imaging section is not capturing an image based on an imaging position stored in the imaging position storage section An image acquisition unit that acquires an image stored in association with the non-imaging area detected by the non-imaging area detection unit from an image database that stores an image related to the area, and a plurality of images stored in the image storage unit And an output unit that sequentially outputs images and images acquired by the image acquisition unit.

  The imaging position storage unit has an imaging device other than the imaging position where each of the plurality of images stored in the image storage unit is captured and the imaging position where each of the plurality of images stored in the image storage unit is captured. The non-imaging area detection unit may detect the non-imaging area including the existence position where the imaging apparatus existed.

  The image pickup apparatus further includes a position detection unit that detects a position where the image pickup device exists, and the image pickup position storage unit is an image pickup that is a position detected by the position detection unit when each of a plurality of images stored in the image storage unit is picked up. You may store a position and the presence position which is a position which the position detection part detected other than the imaging position where each of the several image which an image storage part stores was imaged.

  The imaging method according to the fifth aspect of the present invention includes an imaging stage for capturing an image, an image storage stage for storing a plurality of images captured in the imaging stage, and a plurality of images stored in the image storage stage. An imaging position storage stage that stores the captured imaging position, and a non-imaging area detection stage that detects a non-imaging area where the imaging unit is not capturing an image based on the imaging position stored in the imaging position storage stage; An image acquisition stage for acquiring an image stored in association with the non-imaging area detected in the non-imaging area detection stage, from an image database that stores images related to the area in association with each of the plurality of areas; A plurality of images stored in the image storage stage, and an output unit that sequentially outputs the images acquired in the image acquisition stage.

  According to a sixth aspect of the present invention, there is provided a program for an imaging device that captures an image, the imaging device including an imaging unit that captures an image, an image storage unit that stores a plurality of images captured by the imaging unit, and an image An imaging position storage unit that stores an imaging position where each of the plurality of images stored in the storage unit is captured, and a non-imaging area where the imaging unit is not capturing an image based on the imaging position stored in the imaging position storage unit An image stored in association with the non-imaging area detected by the non-imaging area detection unit from the non-imaging area detection unit to be detected and an image database that stores images related to the area in association with each of the plurality of areas. It functions as an output unit that sequentially outputs an image acquisition unit to be acquired, a plurality of images stored in the image storage unit, and an image acquired by the image acquisition unit.

  Note that the above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  ADVANTAGE OF THE INVENTION According to this invention, the output device and imaging device which can appreciate the desirable image which should be imaged in the area where the user visited for imaging can be provided.

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the claimed invention, and all combinations of features described in the embodiments are inventions. It is not always essential to the solution.

  FIG. 1 shows an example of an image providing system according to an embodiment of the present invention. The image providing system includes an imaging device 100, an output device 140, and an image database 170. In this example, the imaging device 100 captures a commemorative photo at a sightseeing spot. The image database 170 stores representative images at a plurality of places in a sightseeing spot. The image capturing apparatus 100 stores the position of the image capturing apparatus 100 at the timing of capturing an image, and periodically detects and stores the position of the image capturing apparatus 100 even when the image capturing apparatus 100 is not capturing an image. When the imaging device 100 displays the captured image on the monitor of the imaging device 100, the imaging device 100 acquires a representative image at a position where the imaging device 100 has not captured from the image database 170, and together with the captured image. Record.

  In addition, the imaging apparatus 100 outputs an image captured by the imaging apparatus 100, a position of the imaging apparatus 100 at a timing when the image is captured, and a position where the imaging apparatus 100 has not captured the image via the communication line 150 such as the Internet. Send to. When the output device 140 displays an image received from the imaging device 100, the output device 140 acquires a representative image at a position where the imaging device 100 has not taken an image from the image database 170 and displays it.

  It should be noted that the image database 170 may store representative sounds in the tourist area such as sounds related to the image in addition to the representative images in the tourist area. The imaging device 100 and / or the output device 140 acquires the image and sound from the image database 170 from the image database 170, and the sound is synchronized with the display of the image at the position where the imaging device 100 has not captured the image. May be played. Further, the imaging device 100 and / or the output device 140 may acquire the sound at the location captured by the imaging device 100 from the image database 170 and reproduce the sound in synchronization with displaying the captured image. .

  Note that the imaging apparatus 100 may be, for example, a digital still camera, a camera-equipped mobile phone, or the like. Further, the image capturing apparatus 100 may record image and sound data on a recording medium, and the output apparatus 140 may receive the image and sound data from the recording medium. Further, the imaging apparatus 100 may store image and position information data in a directory provided for each user 180 of the server connected to the communication line 150, for example, a directory associated with the imaging apparatus 100. . The output device 140 may receive image and sound data stored in the server for each user 180. The output device 140 may be a device that displays an image, such as an HDTV, an electronic photo stand, or a computer, or may be a printing device that prints an image, such as a printer.

  According to the image providing system described above, even when the user 180 fails to capture a desired image to be captured, such as an image of a subject representing a visited tourist spot, the user 180 is in the position where he / she has the imaging apparatus 100 and has visited. A desirable image to be captured can be viewed. For this reason, the user 180 can concentrate on sightseeing without being distracted by the imaging of the subject.

  FIG. 2 shows data stored in the image database 170 in a table format. The image database 170 stores a position range indicating an area of the area and an image related to the area in association with the area. The image relating to the region may be representative image data of the region such as an image obtained by imaging a symbol representing the region as a subject. The image database 170 may store a plurality of image data for each region. Moreover, the image database 170 may store the latitude and longitude of coordinates forming a diagonal of a rectangular area including a region on the latitude and longitude coordinates, for example, as the position range. Further, the image database 170 may store the latitude and longitude of the coordinates forming the diagonal of each of a plurality of rectangular areas including at least a part of the area on the latitude and longitude coordinates as the position range.

  Note that the image database 170 may include a position range indicating another region in a position range indicating the position of one region. The image database 170 may store image data for a plurality of seasons for each region. The image database 170 may further store image data in a plurality of time zones for each season of each region. For example, the image database 170 may store images captured in respective time zones of morning, noon, evening, and night in each season of spring, summer, autumn, and winter.

  FIG. 3 shows an example of a block configuration of the imaging apparatus 100. The imaging apparatus 100 includes an imaging unit 302, an image storage unit 310, an output unit 324, an imaging position storage unit 332, a non-imaging area detection unit 334, an image acquisition unit 336, and a position detection unit 338.

  The imaging unit 302 captures an image. Specifically, the imaging unit 302 receives light from the subject with an imaging device such as a CCD and images the subject. Note that the imaging unit 302 may continuously capture the subject at predetermined time intervals. Then, the imaging unit 302 may hold a predetermined number of images obtained by continuously capturing images. Then, the imaging unit 302 may use, as an image captured by the imaging unit 302, an image captured at a timing closest to the time when the imaging is instructed, among the images held by the imaging unit 302.

  The image storage unit 310 stores a plurality of images captured by the imaging unit 302. Specifically, the image storage unit 310 stores a plurality of images captured by the imaging unit 302 in association with image IDs for identifying the images.

  The position detection unit 338 detects a position where the imaging device 100 exists. Specifically, the position detection unit 338 detects the latitude and longitude information of the place where the imaging device 100 is located at the timing when the imaging unit 302 has captured the image by receiving from the GPS satellite. Note that the position detection unit 338 receives the latitude and longitude information of the location where the imaging device 100 is located from a GPS satellite at predetermined time intervals even at times when the imaging device 100 is not capturing images. Detects the position where is present.

  The imaging position storage unit 332 is other than the imaging position at which each of the plurality of images stored in the image storage unit 310 is captured and the imaging position at which each of the plurality of images stored in the image storage unit 310 is captured. The location where the device 100 was present is stored. Specifically, the imaging position storage unit 332 stores the imaging position that is the position detected by the position detection unit 338 when each of the plurality of images stored in the image storage unit 310 is captured, and the image storage unit 310 stores the imaging position. The existence position which is a position detected by the position detection unit 338 other than the imaging position where each of the plurality of images is captured is stored.

  In addition, the imaging position storage unit 332 includes an imaging position and an imaging time at which each of the plurality of images stored in the image storage unit 310 is captured, and an imaging position at which each of the plurality of images stored in the image storage unit 310 is captured. Other than that, the position and time at which the imaging apparatus 100 was present are stored. Specifically, the imaging position storage unit 332 detects an imaging position, an imaging time, an image ID for identifying the image, an existing position, and the existing position detected at the timing when the imaging unit 302 picks up the image. Stores the time when

  The non-imaging area detection unit 334 detects a non-imaging area where the imaging unit 302 is not capturing an image based on the imaging position stored in the imaging position storage unit 332. Specifically, the non-imaging area detection unit 334 detects a non-imaging area including the location where the imaging apparatus 100 was present. For example, the non-imaging area detection unit 334 detects an existing position stored in the imaging position storage unit 332 and not associated with the image ID as a position included in the non-imaging area. In addition, the non-imaging area detection unit 334 includes an imaging position or existing position detected at a time closest to the imaging position or existing position stored in the imaging position storage unit 332 and the time when the imaging position or existing position is detected. May be detected as a position included in a non-imaging area.

  The image acquisition unit 336 stores images stored in association with the non-imaging regions detected by the non-imaging region detection unit 334 from the image database 170 that stores images related to the regions in association with the respective regions. get. Specifically, the image acquisition unit 336 searches the image database 170 and acquires an image associated with an area including a position included in the non-imaging area detected by the non-imaging area detection unit 334. The output unit 324 sequentially outputs a plurality of images stored in the image storage unit 310 and images acquired by the image acquisition unit 336. For example, the output unit 324 outputs the plurality of images stored in the image storage unit 310 and the images acquired by the image acquisition unit 336 in the order of the movement path of the imaging apparatus 100. The output unit 324 may be a display device that displays an image, such as liquid crystal.

  The output unit 324 provides the user 180 with a representative image of the place where the image was missed by outputting a representative image at a position not captured by the image capturing apparatus 100 in addition to the image captured by the image capturing apparatus 100. can do. In addition, since the user 180 can view the images in the order in which the image capturing apparatus 100 is carried and moved, the user 180 can enjoy watching the images without feeling uncomfortable.

  FIG. 4 shows an example of a block configuration of the output device 140. The output device 140 includes an image storage unit 410, an output unit 424, an imaging position storage unit 432, a non-imaging area detection unit 434, and an image acquisition unit 436.

  The image storage unit 410 stores a plurality of images captured by the imaging device 100. For example, the image storage unit 410 receives and stores the image data and the image ID stored in the image storage unit 310 through the communication line 150.

  The imaging position storage unit 432 stores imaging positions at which each of the plurality of images stored in the image storage unit 410 is captured. The imaging position storage unit 432 is other than the imaging position where each of the plurality of images stored in the image storage unit 410 is captured and the imaging position where each of the plurality of images stored in the image storage unit 410 is captured. Thus, the location where the imaging device 100 was present is stored. In addition, the imaging position storage unit 432 is an imaging position and an imaging time at which each of the plurality of images stored in the image storage unit 410 is captured, and an imaging position at which each of the plurality of images stored in the image storage unit 410 is captured. Other than that, the position and time at which the imaging apparatus 100 was present are stored. Specifically, the imaging position storage unit 432 transmits the imaging position and the existing position stored in the imaging position storage unit 332, the imaging time and the existing time, and the image ID stored in the imaging position storage unit 332 through the communication line 150. Receive and store.

  The non-imaging area detection unit 434 detects a non-imaging area where no image is captured by the imaging apparatus 100 based on the imaging position stored in the imaging position storage unit 432. Specifically, the non-imaging area detection unit 434 detects a non-imaging area including the location where the imaging apparatus 100 was present. Specifically, the non-imaging area detection unit 434 detects a position included in the non-imaging area from the existing positions stored in the imaging position storage unit 432. In addition, the non-imaging area detection unit 434 has an imaging position or existing position detected at a time closest to the imaging position or existing position stored in the imaging position storage unit 432 and the time when the imaging position or existing position is detected. May be detected as a position included in a non-imaging area.

  The image acquisition unit 436 stores images stored in association with the non-imaging regions detected by the non-imaging region detection unit 434 from the image database 170 that stores images related to the regions in association with the respective regions. get. Specifically, the image acquisition unit 436 searches and acquires an image associated with an area including a position included in the non-imaging area detected by the non-imaging area detection unit 434 from the image database 170. Note that when the image database 170 stores regional images in association with seasons and times, the image acquisition unit 436 detects the positions included in the non-imaging regions detected by the non-imaging region detection unit 434. An image stored in association with the season and time closest to the existing time at the time of the acquisition may be acquired.

  The output unit 424 sequentially outputs a plurality of images stored in the image storage unit 410 and images acquired by the image acquisition unit 436. For example, the output unit 424 outputs the plurality of images stored in the image storage unit 410 and the images acquired by the image acquisition unit 436 in the order of the movement path of the imaging apparatus 100. The output unit 324 may be a display device that displays an image, such as a liquid crystal display, or may be a printing device that prints and outputs an image.

  The output unit 424 provides the user 180 with a representative image of a place where the image has been missed by outputting a representative image at a position not captured by the imaging device 100 in addition to the image captured by the imaging device 100. can do. In addition, since the user 180 can view the images in the order in which the image capturing apparatus 100 is carried and moved, the user 180 can enjoy watching the images without feeling uncomfortable.

  The non-imaging area detection unit 434 captures images of the two images when the difference between the imaging times when the two images stored in the image storage unit 410 are captured is longer than a preset time. A non-imaging area including the location where the imaging apparatus 100 existed during the time is detected. In addition, the non-imaging area detection unit 434 captures images between the capturing times when the two images stored in the image storage unit 410 are captured when the difference between the capturing times when the two images are captured is larger. A larger number of non-imaging areas each including a plurality of locations where the apparatus 100 was present are detected. For this reason, the imaging apparatus 100 can provide the user 180 with a representative image in a place where the user 180 has not taken an image even though the area has stayed for a long time.

  In addition, the non-imaging area detection unit 434 is a value obtained by dividing the distance between the imaging positions at which the two images stored in the image storage unit 410 are respectively captured by the difference between the imaging times at which the two images are respectively captured. May be smaller than a preset value, a non-imaging area including an existing position where the imaging apparatus 100 existed during the imaging time when the two images were respectively captured may be detected. In addition, the non-imaging area detection unit 434 is a value obtained by dividing the distance between the imaging positions at which the two images stored in the image storage unit 410 are respectively captured by the difference between the imaging times at which the two images are respectively captured. In the case where is smaller, a larger number of non-imaging regions each including a plurality of existing positions where the imaging apparatus 100 existed during the imaging time when the two images were respectively captured may be detected.

  For this reason, the output device 140 relates to a place where the user 180 actually stayed and captured rather than a place on the moving route when the user 180 moved a long distance in a short time using an airplane or the like. More images can be acquired from the image database 170 and provided to the user 180. Therefore, the output device 140 can provide the user 180 with an image of a place that was not captured in an area where the user 180 stayed more interested.

  According to the imaging device 100 or the output device 140 described above, in addition to the image captured by the imaging device 100, the user 180 is provided with a desirable image that should be captured at the place where the user 180 has carried the imaging device 100. Can do. Further, the user 180 can easily appreciate the image.

  FIG. 5 shows an example of data stored in the imaging position storage unit 332 in a table format. The imaging position storage unit 332 stores the position, time, and image ID. As the position, the imaging position storage unit 332 includes the latitude and longitude of the imaging position when the image stored in the image storage unit 310 is captured, and the existing position where the imaging apparatus 100 existed other than the imaging position. Stores latitude and longitude. The imaging position storage unit 332 is other than the imaging time at which the image stored in the image storage unit 310 was captured and the imaging position at which the image stored in the image storage unit 310 was captured, and the imaging device 100 exists. The existing time is stored as time. The imaging position storage unit 332 stores an image ID that identifies the image in association with the imaging position and imaging time at which the image stored in the image storage unit 310 is captured. Note that the imaging position storage unit 332 does not store the image ID in association with the data indicating the location and time.

  The non-imaging area detection unit 334 can determine the existence position where the image ID is not stored as a position including an area where no image is captured by the imaging apparatus 100 by referring to the imaging position storage unit 332. . The imaging position storage unit 432 receives data stored in the imaging position storage unit 332 and stores the same data as the data stored in the imaging position storage unit 332 described with reference to FIG.

  FIG. 6 shows an example of the time relationship between the imaging time and the time at which the presence position is detected. In the example of FIG. 6, the image storage unit 310 stores images captured by the imaging unit 302 at times t608, t614, t616, and t634. The imaging position storage unit 332 then detects the imaging position detected by the position detection unit 338 at the timing of the imaging operation by the imaging unit 302 at times t608, t614, t616, and t634, and times t609 to t613 at a predetermined time interval. , T615, and t617 to t633, the position of the imaging device 100 detected by the position detection unit 338 is stored.

  Then, the non-imaging area detection unit 334 calculates a difference between adjacent imaging times stored in the imaging position storage unit 332 as a difference between imaging times when the images stored in the image storage unit 310 are captured. In the example of FIG. 6, the non-imaging area detection unit 334 determines (t614-t608), (t616-t614), and (t634-t616) as the difference in imaging time when the images stored in the image storage unit 310 are captured. Calculate Then, the non-imaging area detection unit 334 searches the imaging position storage unit 332 for the location where the imaging device 100 existed in the periods t608 to t614 and the periods t616 to t634 where the difference in imaging time is longer than the preset time. Then, a position including a non-imaging area is detected.

  For example, the non-imaging area detection unit 334 detects the existence position stored in association with the times t609 to t613 and the times t617 to t633 stored in the imaging position storage unit 332 as a position including the non-imaging area. To do. In addition, the non-imaging area detection unit 334 detects positions including more non-imaging areas than the periods t608 to t614 from the periods t616 to t634 that are longer time interval differences. For example, the non-imaging area detection unit 334 detects the existing position at time t611 from the positions in the periods t608 to t614 as a position including the non-imaging area, and from the positions in the periods t616 to t634, the times t619, t622, The five existing positions at t625, t628, and t631 are detected as positions including a non-imaging area. At this time, the non-imaging area detection unit 334 may select a position where the time interval at which the position including the non-imaging area is detected is equal to or greater than the predetermined time interval as the position including the non-imaging area. Good.

  Then, the image acquisition unit 336 searches the image database 170 for an area that includes the position including the non-imaging area detected by the non-imaging area detection unit 334, and stores the image stored in association with the area. get. For example, the output unit 324 acquires and outputs the images captured at times t608, t614, t616, and t634 from the image storage unit 310, and images at times t611, t619, t622, t625, t628, and t631. The image acquired by the image acquisition unit 336 is output. Note that the output unit 324 outputs the images in order of oldest time when outputting the images. In the example of FIG. 6, the output unit 324 outputs in the order of times t608, t613, t614, t616, and t618 to t649. For this reason, the output unit 324 can output images in the order of the route along which the user 180 has moved while having the imaging device 100.

  In addition, when detecting a position including a non-imaging area, the non-imaging area detection unit 334 stores the image stored in the image storage unit 310 in the imaging position storage unit 332 in addition to the difference in imaging time when the image was captured. Detection may be performed based on the distance between the imaging positions at the adjacent imaging times. For example, in FIG. 6, the non-imaging area detection unit 334 calculates (t614-t608), (t616-t614), and (t634-t616) as the difference in imaging time when the image stored in the image storage unit 310 was captured. And the distance between the imaging positions is calculated based on the position stored in the imaging position storage unit 332. That is, the non-imaging area detection unit 334 calculates distances between the imaging positions at time t608 and t614, between the imaging positions at time t614 and t616, and between the imaging positions at time t616 and time t634.

  Then, the non-imaging area detection unit 334 calculates a value obtained by dividing the distance between the imaging positions by the difference in imaging time. Then, the non-imaging area detection unit 334 may detect a position including the non-imaging area from the existing positions in a period in which the value is smaller than a predetermined value. Further, the non-imaging area detection unit 334 may detect a large number of existing positions as positions including the non-imaging area when the value is smaller. For this reason, the non-imaging area detection unit 334 prioritizes the position in the sightseeing spot that the user 180 actually visited rather than the position of the place that the user 180 passed when the user 180 moved between the sightseeing spots using an airplane or the like. Therefore, it can be detected as a position in a non-imaging area.

  Note that specific operations and functions of the imaging position storage unit 432, the image acquisition unit 436, and the output unit 424 of the output device 140 are the same as the imaging position storage unit 332 of the imaging device 100 described in FIG. The specific operations and functions of the unit 334, the image acquisition unit 336, and the output unit 324 may be the same.

  As described above, according to the image providing system of this embodiment, when providing an image captured by the imaging apparatus 100 to the user 180, a representative image of a place that has not been captured by the imaging apparatus 100 is also included. It can be acquired from the image database 170 and provided to the user 180. In addition, the image providing system of the present embodiment can provide more images that have not been captured in places where the user 180 is more interested, such as places where the user 180 has actually stayed for a long time.

  FIG. 7 illustrates an example of a hardware configuration of the computer 1500 related to the output device 140 and the imaging device 100. The computer 1500 includes a CPU peripheral unit having a CPU 1505, a RAM 1520, a graphic controller 1575, and a display device 1580 connected to each other by a host controller 1582, and a communication interface 1530 connected to the host controller 1582 by an input / output controller 1584. An input / output unit having a hard disk drive 1540 and a CD-ROM drive 1560, and a legacy input / output unit having a ROM 1510, a flexible disk drive 1550, and an input / output chip 1570 connected to the input / output controller 1584.

  The host controller 1582 connects the RAM 1520, the CPU 1505 that accesses the RAM 1520 at a high transfer rate, and the graphic controller 1575. The CPU 1505 operates based on programs stored in the ROM 1510 and the RAM 1520 and controls each unit. The graphic controller 1575 acquires image data generated by the CPU 1505 and the like on a frame buffer provided in the RAM 1520 and displays the image data on the display device 1580. Alternatively, the graphic controller 1575 may include a frame buffer that stores image data generated by the CPU 1505 or the like.

  The input / output controller 1584 connects the host controller 1582 to the hard disk drive 1540, the communication interface 1530, and the CD-ROM drive 1560, which are relatively high-speed input / output devices. The hard disk drive 1540 stores programs and data used by the CPU 1505 in the computer 1500. The communication interface 1530 communicates with the output device 140 or the imaging device 100 via a network, and provides a program and data to the output device 140 or the imaging device 100. The CD-ROM drive 1560 reads a program or data from the CD-ROM 1595 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520.

  The input / output controller 1584 is connected to the ROM 1510, the flexible disk drive 1550, and the relatively low-speed input / output device of the input / output chip 1570. The ROM 1510 stores a boot program executed when the computer 1500 is started up, a program depending on the hardware of the computer 1500, and the like. The flexible disk drive 1550 reads a program or data from the flexible disk 1590 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520. The input / output chip 1570 connects various input / output devices via a flexible disk drive 1550 and, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

  A program provided to the communication interface 1530 via the RAM 1520 is stored in a recording medium such as the flexible disk 1590, the CD-ROM 1595, or an IC card and provided by the user. The program is read from the recording medium, provided to the communication interface 1530 via the RAM 1520, and transmitted to the output device 140 or the imaging device 100 via the network. The program transmitted to the output device 140 or the imaging device 100 is installed and executed in the output device 140 or the imaging device 100.

  The program installed and executed in the output device 140 causes the output device 140 to function as the output device 140 described with reference to FIGS. The program installed and executed in the imaging apparatus 100 causes the imaging apparatus 100 to function as the imaging apparatus 100 described with reference to FIGS.

  The program shown above may be stored in an external storage medium. As the storage medium, in addition to the flexible disk 1590 and the CD-ROM 1595, an optical recording medium such as a DVD or PD, a magneto-optical recording medium such as an MD, a tape medium, a semiconductor memory such as an IC card, or the like can be used. Further, a storage device such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium, and the program may be provided to the computer 1500 via the network.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. Various modifications or improvements can be added to the above embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

It is a figure which shows an example of an image provision system. It is a figure which shows an example of the data which the image database 170 stores in a table format. 1 is a diagram illustrating an example of a block configuration of an imaging apparatus 100. FIG. 3 is a diagram illustrating an example of a block configuration of an output device 140. FIG. It is a figure which shows an example of the data which the imaging position storage part 332 stores in a table format. It is a figure which shows an example of the time relationship of the imaging time and the time which detected the presence position. FIG. 3 is a diagram illustrating an example of a hardware configuration of a computer 1500 related to the output device 140 and the imaging device 100.

Explanation of symbols

100 imaging device 140 output device 150 communication line 170 image database 180 user 302 imaging unit 310 image storage unit 324 output unit 332 imaging position storage unit 334 non-imaging area detection unit 336 image acquisition unit 338 position detection unit 410 image storage unit 424 output unit 432 Imaging position storage unit 434 Non-imaging area detection unit 436 Image acquisition unit

Claims (14)

An image storage unit for storing a plurality of images captured by the imaging device;
An imaging position storage unit that stores an imaging position at which each of the plurality of images stored in the image storage unit is captured;
A non-imaging area detection unit that detects a non-imaging area where an image is not captured by the imaging device, based on an imaging position stored in the imaging position storage unit;
An image acquisition unit that acquires an image stored in association with a non-imaging area detected by the non-imaging region detection unit, from an image database that stores an image related to the region in association with each of a plurality of regions;
An output device comprising: a plurality of images stored in the image storage unit; and an output unit that sequentially outputs the images acquired by the image acquisition unit. The imaging position storage unit is other than the imaging position where each of the plurality of images stored in the image storage unit is captured and the imaging position where each of the plurality of images stored in the image storage unit is captured, Store the location where the imaging device was located,
The output device according to claim 1, wherein the non-imaging area detection unit detects the non-imaging area including an existing position where the imaging apparatus was present. The imaging position storage unit is other than the imaging position and imaging time at which each of the plurality of images stored in the image storage unit is captured, and the imaging position at which each of the plurality of images stored in the image storage unit is captured. And stores the location and time at which the imaging device was present,
The non-imaging area detection unit, when a difference between imaging times when the two images stored in the image storage unit are respectively captured is longer than a preset time, indicates the imaging time when the two images are respectively captured. The output device according to claim 2, wherein the non-imaging area including the location where the imaging device is located is detected. The non-imaging area detection unit is configured to capture the imaging device between imaging times when the two images stored in the image storage unit are captured when the difference between imaging times when the two images are captured is larger. The output device according to claim 3, wherein a larger number of the non-imaging areas including each of a plurality of existing positions where the image is present is detected. The imaging position storage unit is other than the imaging position and imaging time at which each of the plurality of images stored in the image storage unit is captured, and the imaging position at which each of the plurality of images stored in the image storage unit is captured. And stores the location and time at which the imaging device was present,
The non-imaging area detection unit has a value obtained by dividing the distance between the imaging positions at which the two images stored in the image storage unit are respectively captured by the difference between the imaging times at which the two images are captured in advance. 3. The output device according to claim 2, wherein, when the value is smaller than a set value, the non-imaging area including the location where the imaging device was present during the imaging time when the two images were respectively captured is detected. . The non-imaging area detection unit has a value obtained by dividing the distance between the imaging positions at which the two images stored in the image storage unit are respectively captured by the difference between the imaging times at which the two images are respectively captured. 6. The output according to claim 5, wherein when the number is small, a larger number of the non-imaging areas including each of a plurality of existing positions where the imaging device existed between the imaging times when the two images were respectively captured are detected. apparatus. The output device according to claim 3 or 5, wherein the output unit outputs a plurality of images stored in the image storage unit and images acquired by the image acquisition unit in order of a movement path of the imaging device. An image storage stage for storing a plurality of images captured by the imaging device;
An imaging position storage stage for storing an imaging position at which each of the plurality of images stored in the image storage stage is captured;
A non-imaging area detection stage for detecting a non-imaging area where an image is not captured by the imaging device based on the imaging position stored in the imaging position storage stage;
An image acquisition stage for acquiring an image stored in association with the non-imaging area detected in the non-imaging area detection stage, from an image database storing images related to the area in association with each of the plurality of areas; ,
An output method comprising: a plurality of images stored in the image storage step; and an output step of sequentially outputting the images acquired in the image acquisition step. An output device program for outputting an image, wherein the output device stores a plurality of images captured by an imaging device,
An imaging position storage unit that stores an imaging position at which each of the plurality of images stored in the image storage unit is captured;
A non-imaging area detection unit that detects a non-imaging area where an image is not captured by the imaging device, based on an imaging position stored in the imaging position storage unit;
An image acquisition unit that acquires an image stored in association with a non-imaging area detected by the non-imaging area detection unit, from an image database that stores an image related to the area in association with each of a plurality of areas;
A program that functions as an output unit that sequentially outputs a plurality of images stored in the image storage unit and images acquired by the image acquisition unit. An imaging unit;
An image storage unit for storing a plurality of images captured by the imaging unit;
An imaging position storage unit that stores an imaging position at which each of the plurality of images stored in the image storage unit is captured;
A non-imaging area detection unit that detects a non-imaging area where the imaging unit is not capturing an image based on an imaging position stored in the imaging position storage unit;
An image acquisition unit that acquires an image stored in association with a non-imaging area detected by the non-imaging region detection unit, from an image database that stores an image related to the region in association with each of a plurality of regions;
An imaging apparatus comprising: a plurality of images stored in the image storage unit; and an output unit that sequentially outputs the images acquired by the image acquisition unit. The imaging position storage unit is other than the imaging position where each of the plurality of images stored in the image storage unit is captured and the imaging position where each of the plurality of images stored in the image storage unit is captured, Store the location where the imaging device was located,
The imaging apparatus according to claim 10, wherein the non-imaging area detection unit detects the non-imaging area including an existing position where the imaging apparatus was present. A position detection unit that detects a position where the imaging device is present;
The imaging position storage unit includes an imaging position that is a position detected by the position detection unit when each of a plurality of images stored in the image storage unit is captured, and a plurality of images stored in the image storage unit. The image pickup apparatus according to claim 11, wherein an existence position that is a position detected by the position detection unit other than an image pickup position at which each of them is picked up is stored. An imaging stage for capturing an image;
An image storage stage for storing a plurality of images taken in the imaging stage;
An imaging position storage stage for storing an imaging position at which each of the plurality of images stored in the image storage stage is captured;
A non-imaging area detection stage that detects a non-imaging area where an image is not captured in the imaging stage, based on the imaging position stored in the imaging position storage stage;
An image acquisition stage for acquiring an image stored in association with the non-imaging area detected in the non-imaging area detection stage, from an image database storing images related to the area in association with each of the plurality of areas; ,
An imaging method comprising: a plurality of images stored in the image storage stage; and an output unit that sequentially outputs the images acquired in the image acquisition stage. A program for an imaging device that captures an image, the imaging unit capturing an image of the imaging device,
An image storage unit for storing a plurality of images captured by the imaging unit;
An imaging position storage unit that stores an imaging position at which each of the plurality of images stored in the image storage unit is captured;
A non-imaging area detection unit that detects a non-imaging area where the imaging unit is not capturing an image based on an imaging position stored in the imaging position storage unit;
An image acquisition unit that acquires an image stored in association with a non-imaging area detected by the non-imaging area detection unit, from an image database that stores an image related to the area in association with each of a plurality of areas;
A program that functions as an output unit that sequentially outputs a plurality of images stored in the image storage unit and images acquired by the image acquisition unit.

Images