JP5638993B2 - Image display device and image display method - Google Patents

Description

  The present invention relates to an image display device and an image display method capable of displaying image capturing position information.

  In recent photographing apparatuses such as digital cameras, it is known that photographing position information can be recorded in association with a photographed image when photographing an image. By recording the shooting position information in association with the shot image, for example, the user can search for a desired image using the shooting position information or display the shooting position information on the map image. .

  Here, in the case of positioning using GPS, positioning cannot be performed in an environment where GPS radio waves cannot be received. For example, Patent Document 1 proposes a technique for recording the shooting position information even in a situation where positioning by GPS cannot be performed. In Patent Document 1, when positioning data (capturing position information) is not obtained correctly at the time of shooting, the previous positioning data is associated with a shot image.

JP-A-10-210337

  When the previous shooting position information is used, if the time difference between the timing at the time of shooting and the timing at which the previous positioning data is obtained becomes longer, the error between the actual shooting position and the position becomes larger. If a map is displayed based on such shooting position information with a large error, incorrect information is presented to the user.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide an image reproduction device and an image reproduction method that can correctly present photographing position information to a user even when photographing position information is not obtained. .

In order to achieve the above object, an image display device according to a first aspect of the present invention includes a determination unit that determines whether or not shooting position information is associated with image data obtained by shooting, and the image data. When the photographing position information is not associated with the first image data, the first photographing position information and the first image data estimated for the first image data that is image data with which the photographing position information is not associated are obtained. A position difference from the second shooting position information, which is shooting position information of the second image data obtained at a timing before being acquired, and after the first shooting position information and the first image data are obtained. The position difference with the third shooting position information that is the shooting position information of the third image data obtained at the timing is determined, and the two pieces of the image data having the shorter position difference are obtained. Time A photographing position estimation unit that estimates a region including the shooting position where the first image data is obtained in accordance with the difference, the the image data when the image position information is associated, by the photographing position information Display data is generated so as to display the shooting position shown on the map image, and when the shooting position information is not associated with the image data, the display data is displayed so that the area is displayed on the map image. A display data generation unit to generate and a display control unit to display a map image on the display unit based on the generated display data, and the display control unit is configured to display each image data when there are a plurality of the image data. The image capturing position and the region corresponding to the image data are simultaneously displayed on the map image, and the image corresponding to each image data is simultaneously displayed at a position different from the map image. And characterized in that shown.

In order to achieve the above object, in the image display method according to the second aspect of the present invention, the determination unit determines whether or not shooting position information is associated with image data obtained by shooting, and the determination The image capturing position estimation unit estimates the first image data that is image data not associated with the image capturing position information when the image capturing position information is not associated with the image data. The position difference between the first shooting position information and the second shooting position information which is the shooting position information of the second image data obtained at the timing before the first image data is obtained, and the first shooting. The positional difference between the positional information and the third imaging position information which is the imaging position information of the third image data obtained at the timing after the first image data is obtained is determined, and the shorter positional difference Two with Wherein a region including the shooting position where the first image data is obtained is estimated in accordance with the time difference between the photographing date and time information image data has been obtained, the determination unit, the imaging position information associated with the image data The display data generation unit generates display data to display the shooting position indicated by the shooting position information on a map image, and the determination unit adds the shooting position to the image data. When it is determined that the information is not associated, the display data generation unit displays the display data so as to display the area on the map image when the image position information is not associated with the image data. The display control unit generates a map image on the display unit based on the generated display data, and the display control unit displays each image when there are a plurality of the image data. Causes display on the said imaging position and the area corresponding to the over data simultaneously the on the map image, characterized in that said simultaneously displayed at a position different from the corresponding said map image an image on each image data.

  According to the present invention, it is possible to provide an image playback device and an image playback method that can correctly present shooting position information to a user even when shooting position information is not obtained.

1 is a block diagram illustrating a configuration of a digital camera as an example of an image display device according to an embodiment of the present invention. It is a flowchart which shows the operation | movement in imaging | photography mode. It is a figure which shows an example of the structure of an image file. It is a flowchart which shows the operation | movement at the time of reproduction | regeneration mode. It is a figure which shows an example of a GPS log. It is a figure which shows an example of an interpolation GPS log. It is a figure which shows the 1st example of the map image reproduced in one Embodiment of this invention. It is a figure which shows the 2nd example of the map image reproduced in one Embodiment of this invention. It is a figure which shows the 3rd example of the map image reproduced in one Embodiment of this invention. It is a figure which shows the example of a display of the map image which considered water depth information. It is a figure which shows the example of the GPS log containing altitude information. It is a figure which shows the example of a display of the map image which considered altitude information.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram illustrating a configuration of a digital camera (hereinafter referred to as a camera) as an example of an image display apparatus according to an embodiment of the present invention. A camera 100 illustrated in FIG. 1 has a function of an image display device and also a function of an imaging device. As shown in FIG. 1, the camera 100 includes an imaging unit 101, an SDRAM 102, an image processing unit 103, a display driver (LCD driver) 104, a display unit (LCD) 105, and a display data processing unit 106. , A memory interface (I / F) 107, a recording medium 108, a communication unit 109, a gyro sensor 110, a pressure sensor 111, a microcomputer 112, an operation unit 113, a flash memory 114, and an interface (I / F). F) 115.

  The imaging unit 101 includes a photographic lens, an imaging element, and an imaging signal processing circuit. The photographing lens is an optical system for condensing an image of a subject (not shown) on the photoelectric conversion surface of the image sensor. The photographing lens includes a plurality of lenses such as a focus lens and a zoom lens, and an aperture. The image sensor has a photoelectric conversion surface for receiving an image of a subject condensed by the photographing lens. On the photoelectric conversion surface, pixels including photoelectric conversion elements (for example, photodiodes) for converting the amount of light into the amount of charge are two-dimensionally arranged. Further, for example, a Bayer color filter is arranged on the surface of the photoelectric conversion surface. Such an image sensor converts light collected by the photographing lens into an electric signal (image signal). The imaging signal processing circuit performs various analog signal processing such as CDS processing and AGC processing on the imaging signal input from the imaging device. The CDS process is a process for removing a dark current noise component in an imaging signal. The AGC process is an amplification process for obtaining a desired dynamic range of the imaging signal. The imaging signal processing circuit converts the imaging signal subjected to the analog signal processing into image data as digital data.

The SDRAM 102 is a storage unit that temporarily stores image data obtained by the imaging unit 101, various data processed by the image processing unit 103 and the display data processing unit 106, and the like.
The image processing unit 103 performs various image processing on the image data stored in the SDRAM 102. The image processing includes processing such as white balance (WB) processing, demosaic processing, color conversion processing, gradation conversion processing, edge enhancement processing, and compression / decompression processing.

  The LCD driver 104 drives the LCD 105 according to the control of the microcomputer 112 having a function as a display control unit, and causes the LCD 105 to display various images. The LCD 105 as a display unit is a liquid crystal display provided on the back surface of the camera 100, for example, and displays various images such as an image based on the image data processed in the image processing unit 103.

  The display data processing unit 106 generates display data for displaying shooting position information corresponding to the image data. The display data processing unit 106 includes a position interpolation processing unit 1061, a position information generation unit 1062, and a display data generation unit 1063. A position interpolation processing unit 1061 having a function as a determination unit determines whether or not shooting position information is associated with image data, and interpolates shooting position information when shooting position information is not associated. Necessary information is acquired from the microcomputer 112. A position information generation unit 1062 having a function as a shooting position estimation unit interpolates shooting position information corresponding to image data not associated with shooting position information, according to information received from the position interpolation processing unit 1061. The display data generation unit 1063 generates display data for displaying the shooting position information corresponding to the image data on the map image according to the shooting position information interpolated by the position information generation unit 1062. For this purpose, the display data generation unit 1063 stores map image data associated with position information (longitude / latitude information) and icon data for displaying various icons superimposed on the map image.

The memory I / F 107 is an interface that acts as an intermediary for the microcomputer 112 to perform data communication with the recording medium 108. The recording medium 108 is a recording medium on which an image file obtained by the shooting operation is recorded.
The communication unit 109 is a communication unit for the camera 100 to remotely communicate with various external devices. The communication unit 109 includes a GPS communication unit 1091 and a wireless communication unit 1092. The GPS communication unit 1091 is a GPS receiver that receives radio waves from GPS satellites. The wireless communication unit 1092 is a communication module for wirelessly communicating the camera 100 with an external device such as a wireless LAN module.

  The gyro sensor 110 is a sensor for detecting a change in posture of the camera 100. With this gyro sensor 110, it is possible to detect in which direction the camera 100 has moved. The pressure sensor 111 detects the pressure around the camera 100. The pressure sensor 111 can detect the depth and altitude of the place where the camera 100 is located.

  The microcomputer 112 comprehensively controls various sequences of the camera 100. When any one of the operation units of the operation unit 113 is operated, the microcomputer 112 controls each block shown in FIG. 1 corresponding to the operation. Here, the microcomputer 112 in this embodiment has a function of storing GPS logs. The GPS log is a log that records at least the shooting frame number of the image obtained at that time, the GPS data at the time of shooting, and the shooting date and time at that time each time shooting is performed. .

  The operation unit 113 includes operation members for the user to perform various operations on the camera 100. The operation unit 113 in this embodiment relates to at least an operation unit for setting the operation mode of the camera 100 to the GPS mode, various operation units related to a reproduction mode such as a reproduction button and a reproduction end button, and a photographing mode such as a release button. Includes various operation units. In addition, the operation unit 113 includes an operation unit for turning off the power of the camera 100, an operation unit for switching the operation mode of the camera 100 between the shooting mode and the reproduction mode, and the like.

The flash memory 114 is a memory that stores processing programs and setting data necessary for the microcomputer 112 to execute various processes.
The I / F 115 is an interface that mediates when the camera 100 performs wired communication with various external devices.

  Hereinafter, the operation of the camera 100 shown in FIG. 1 will be described. FIG. 2 is a flowchart showing the operation of the camera 100 in the shooting mode. Here, the camera 100 according to the present embodiment can set the operation mode to the GPS mode. In the GPS mode, shooting position information obtained by positioning by GPS is associated with image data obtained by shooting. In the following description, it is assumed that the operation mode of the camera 100 is set to the GPS mode in advance.

  In FIG. 2, the microcomputer 112 first executes a through image display process (step S101). As the through image display processing, the microcomputer 112 continuously operates the image pickup device of the image pickup unit 101. Then, the microcomputer 112 controls the LCD driver 104 to display an image corresponding to the image data sequentially obtained by the continuous operation of the image sensor on the LCD 105. Through such a through image display process, the user can determine the composition based on the image displayed on the LCD 105.

  After the through image display process, the microcomputer 112 determines whether or not the release button has been pressed (step S102). In step S102, when the release button is pressed, the microcomputer 112 executes a photographing operation. Therefore, the microcomputer 112 determines whether or not the current operation mode is a shooting mode for shooting a still image (step S103).

  In step S103, when the current operation mode is a shooting mode for shooting a still image, the microcomputer 112 executes still image shooting (step S104). In still image shooting, the microcomputer 112 performs a focusing process to adjust the focal position of the shooting lens. Further, in parallel with the focusing process, the microcomputer 112 determines an exposure condition (aperture opening amount, exposure time / sensitivity of the image sensor) at the time of performing the photographing operation in accordance with the subject brightness and the like. Thereafter, the microcomputer 112 causes the imaging device to perform imaging according to the determined exposure condition. Further, the microcomputer 112 acquires shooting date / time information using a built-in clock. Further, in the GPS mode, the microcomputer 112 starts the operation of the GPS communication unit 1091 to receive GPS radio waves from GPS satellites (not shown), and generates GPS data from the received GPS radio waves. The GPS data is represented by, for example, longitude X and latitude Y. After acquiring the GPS data, the microcomputer 112 stores the acquired GPS data as a GPS log in association with the shooting date / time and the shooting frame number. Here, when the GPS communication unit 1091 cannot receive the radio wave from the GPS satellite, the GPS data cannot be generated. In this case, GPS data is not recorded in the GPS log, but the shooting frame number and shooting date / time are recorded.

  In step S103, when the current operation mode is a shooting mode for shooting a moving image, the microcomputer 112 executes moving image shooting (step S105). In moving image shooting, the microcomputer 112 performs focusing processing in the same manner as in still image shooting to adjust the focal position of the shooting lens. Further, in parallel with the focusing process, the microcomputer 112 determines an exposure condition (aperture opening amount, exposure time / sensitivity of the image sensor) at the time of performing the photographing operation in accordance with the subject brightness and the like. Thereafter, the microcomputer 112 causes the imaging device to perform imaging according to the determined exposure condition. In the case of moving image shooting, imaging by the image sensor is repeatedly executed until the end of moving image shooting is instructed by the user. Further, the microcomputer 112 generates or updates the GPS log in the same manner as the still image shooting.

  After executing still image shooting or moving image shooting, the microcomputer 112 causes the image processing unit 103 to perform image processing on image data stored in the SDRAM 102 as a result of still image shooting or moving image shooting. Thereafter, the microcomputer 112 adds attribute data such as shooting information to the image data processed by the image processing unit 103 to generate an image file. The microcomputer 112 records the generated image file on the recording medium 108 (step S106).

  FIG. 3 is a diagram showing an example of the structure of the image file recorded in step S106. As shown in FIG. 3, the image file includes an attribute data recording unit and an image data recording unit. The attribute data recording unit corresponds to, for example, the Exif (Exchangeable image file format) standard. In the attribute data recording unit, various attribute data such as shooting conditions at the time of still image shooting or moving image shooting, shooting position information, and shooting date / time information are recorded in a metadata format. Here, the shooting position information in the present embodiment includes not only the above-described GPS data but also interpolation GPS data described later. In the image data recording unit, still image data obtained by still image shooting or moving image data obtained by moving image shooting is compressed and recorded.

  When the release button is not pressed in step S102 or after recording the image file in step S106, the microcomputer 112 determines whether or not to change the operation mode to the reproduction mode (step S107). For example, it is determined that the operation mode is to be changed when instructed by the user to operate the operation unit 113 to change the operation mode to the reproduction mode. In step S107, when an instruction to change the operation mode is given, the microcomputer 112 executes an operation in a reproduction mode described later.

  If the operation mode change instruction is not issued in step S107, the microcomputer 112 determines whether to turn off the power of the camera 100 (step S108). For example, when the user turns off the power of the camera 100 or when the no-operation state continues for a predetermined time, the power of the camera 100 is turned off. In step S108, when the power of the camera 100 is not turned off, the microcomputer 112 performs the through image display process in step S101 again. In step S108, when turning off the power of the camera 100, the microcomputer 112 performs a power-off process for turning off the power of the camera 100, and ends the process of FIG.

  FIG. 4 is a flowchart showing the operation of the camera 100 in the playback mode. Here, in the playback mode in the present embodiment, not only the selected image file is simply played, but also the map image is displayed according to the shooting position information recorded as the attribute data of the selected image file. it can. Whether or not to display the map image can be set by the operation of the operation unit 113 by the user.

  In FIG. 4, the microcomputer 112 controls the LCD driver 104 to display on the LCD 105 thumbnail images showing a list of image files recorded on the recording medium 108 (step S201). When displaying thumbnails, an index for identifying the file may be attached to each thumbnail image so that the still image file and the moving image file can be identified.

  After the thumbnail display, the microcomputer 112 determines whether any image file displayed as a thumbnail is selected by a user operation (step S202). In step S202, when an image file is selected, the microcomputer 112 displays a map image, that is, whether the operation mode of the camera 100 is set to a map display mode for displaying a map image by a user operation. It is determined whether or not (step S203).

  In step S203, when the map display mode is set, the microcomputer 112 instructs the display data processing unit 106 to generate display data for map display. Upon receiving this instruction, the display data processing unit 106 reads out the attribute data of the image file selected by the user through the position interpolation processing unit 1061 (step S204). Then, the display data processing unit 106 determines whether or not shooting position information is recorded as attribute data by the position interpolation processing unit 1061 (step S205).

  In step S205, when shooting position information is recorded as the read attribute data, the display data processing unit 106 uses the attribute data (GPS data or interpolated GPS data) recorded in the selected image file. Display data for displaying the map. Then, the microcomputer 112 controls the LCD driver 104 to display a map image based on the display data on the LCD 105 (step S206).

  After the reproduction of the map image, the microcomputer 112 determines whether or not the reproduction of the map image is finished (step S207). For example, when it is instructed by the user's operation of the operation unit 113 to end the reproduction of the map image, it is determined that the reproduction ends. The microcomputer 112 stands by while performing the determination of step S207 until it is determined that the reproduction of the map image is finished.

In step S205, when shooting position information is not recorded as the read attribute data, the display data processing unit 106 acquires a GPS log from the microcomputer 112 by the position interpolation processing unit 1061 (step S208).
FIG. 5 is a diagram illustrating an example of a GPS log. The GPS log in the example shown in FIG. 5 is recorded in association with GPS data, still image / moving image identification data, shooting date and time, and water depth for each shooting frame. As shown in FIG. 5, for example, GPS data is not recorded because GPS radio waves cannot be received underwater. In this case, shooting position information as attribute data is not recorded. In the present embodiment, the shooting position information of the shooting frames for which such GPS data could not be obtained is interpolated from the GPS data related to the shooting frames before and after that.

  The position interpolation processing unit 1061 of the display data processing unit 106 captures images at the timing before and after the shooting date and time when the selected image file is obtained from the acquired GPS log, and before and after the loss of GPS data. A difference ΔT in date and time, and a difference ΔX (longitude difference) and ΔY (latitude difference) between photographing positions before and after losing GPS data are calculated. For example, if an image file corresponding to the shooting frame C is selected from the shooting frames shown in FIG. 5, ΔT is the difference between the shooting date / time tF in the shooting frame F and the shooting date / time tB in the shooting frame B (tF−tB). ) = 9 minutes. ΔX is (xF−xB), and ΔY is (yF−yB).

  After calculating ΔT, ΔX, and ΔY, the position interpolation processing unit 1061 determines whether or not the calculated ΔT is within a predetermined time (for example, 5 hours) (step S209). In step S209, when ΔT is within the predetermined time, the position interpolation processing unit 1061 of the display data processing unit 106 causes the position information generation unit 1062 to estimate the imaging region (step S210).

Hereinafter, the concept of estimating the imaging region will be described with reference to FIG. Here, it is assumed that an image file corresponding to the shooting frame C is selected. First, it is assumed that the user moves at a constant linear velocity from the shooting position PB (xB, yB) of the shooting frame B to the shooting position PF (xF, yF) of the shooting frame F. At this time, it can be estimated that the shooting position PC (xC, yC) of the shooting frame C is a position indicated by the following (formula 1) on the straight line connecting the shooting position PB and the shooting position PF.
xC = xB + Δx × (tC−tB) / ΔT
yC = yB + Δy × (tC−tB) / ΔT (Formula 1)
Actually, the movement of the user from the shooting position PB to the shooting position PF is not always a constant velocity linear movement. Therefore, in the present embodiment, the shooting position PC of the shooting frame C is represented by a circular area including the shooting position PB with the position of (Equation 1) as the center. The radius rC of such a circular area can be determined according to the time difference from the shooting position PB to the shooting position PC. That is, the radius rC is determined by the following (Formula 2).
rC = r × (tC−tB) (Formula 2)
Here, r is a coefficient. In (Expression 2), the radius of the circular area is determined according to the time difference from the immediately preceding shooting frame, but the radius of the circular area is determined according to the time difference from the immediately following shooting frame (ie, shooting frame D). May be.

In this way, the circular shooting area estimated from (Equation 1) and (Equation 2) indicates that the shooting frame C is actually used even if the user's movement from the shooting position PB to the shooting position PF is not a uniform linear movement. There is a high possibility that the shooting position is included.
(Equation 1) and (Equation 2) are cases where an image file corresponding to the shooting frame C is selected. It is also possible to obtain the shooting areas of the shooting frame D and the shooting frame E according to the same concept as when the image file corresponding to the shooting frame C is selected. That is, the center position PD (xD, yD) of the shooting area related to the shooting frame D can be calculated by replacing tC in (Equation 1) with tD. Similarly, the center position PE (xE, yE) of the shooting area for the shooting frame E can be calculated by replacing tC in (Equation 1) with tE. In addition, the radius rD of the shooting area related to the shooting frame D can be obtained by multiplying the time difference (tD-tC) from tC, which is the previous shooting date and time, by a coefficient r. Similarly, the radius rE of the shooting area relating to the shooting frame E can be obtained by multiplying the time difference (tE-tD) from tD, which is the previous shooting date and time, by a coefficient r.

  By estimating the shooting area as described above, an interpolation GPS log as shown in FIG. 6 can be generated. After generating the interpolated GPS log, the position information generating unit 1062 records the generated interpolated GPS log in its own memory. In addition, the position information generation unit 1062 obtains the interpolation GPS data (in the above example, (xC, yC)) corresponding to the image file selected by the user from the information recorded in the interpolation GPS log. Is recorded in the attribute data recording unit of the image file selected by (Step S211). By recording these information, the next time the same image file is selected, step S205 is branched to step S206. Therefore, it is not necessary to perform the processing of steps S208 to S211.

  After recording the interpolation GPS log, the display data generation unit 1063 generates display data for displaying a map image using the generated interpolation GPS data. Then, the microcomputer 112 controls the LCD driver 104 to display a map image based on the display data on the LCD 105 (step S212).

  After replaying the map image, the microcomputer 112 determines whether or not to end the replay of the map image (step S213). For example, when it is instructed by the user's operation of the operation unit 113 to end the reproduction of the map image, it is determined that the reproduction ends. The microcomputer 112 stands by while performing the determination of step S213 until it is determined that the reproduction of the map image is finished.

  FIG. 7 shows an example of the map image reproduced in step S212. As shown in FIG. 7, when displaying a map image with a shooting area, a shooting corresponding to the image file selected by the user is displayed on the map image 201 around the shooting area corresponding to the image file selected by the user. An image showing the region is displayed in a superimposed manner. For example, FIG. 7 shows a case where the image file of the shooting frame C is selected. In this case, the display data generation unit 1063 selects map image data representing the map image 201 in the vicinity of the shooting area of the shooting frame C. Then, the display data generation unit 1063 generates display data so that the image RC of the circular area indicating the shooting area of the shooting frame C is displayed on the map image 201. At this time, the display data may be generated so as to display the index image PC indicating the center position of the image RC in the circular area.

  Here, as shown in FIG. 6, if GPS data related to a shooting frame other than the shooting frame C is also recorded as an interpolated GPS log, information related to a shooting position other than the selected shooting frame can be displayed at the same time. . A display example in this case is shown in FIG. In the display example of FIG. 8, for shooting frames A, B, and F in which shooting position information is associated with image data, index images PA, PB, and PF that directly indicate the shooting positions may be displayed in a superimposed manner. In addition, for the shooting frames D and E in which the shooting position information is not associated with the image data, as with the shooting frame C, the circular regions RD and RE indicating the shooting region may be displayed in a superimposed manner.

  In addition, when information on shooting positions corresponding to a plurality of shooting frames is simultaneously displayed on the map image 201 as shown in FIG. 8, a thumbnail image 202 indicating an image file in the recording medium 108 in addition to the map image 201. In addition, an index 202a for identifying a moving image and a still image, a scroll icon 203, and the like may be displayed. Furthermore, the user's movement trajectory 204 may be displayed.

  Here, it returns to description of FIG. 4 again. If ΔT exceeds a predetermined time (for example, 5 hours) in step S209, the display data processing unit 106 notifies the microcomputer 112 accordingly. In response to this, the microcomputer 112 controls the LCD driver 104 to display a warning indicating that the map display is not performed on the LCD 105 (step S214). The case where ΔT is long is because shooting before and after the loss of GPS data is shooting in different moving steps, and it is considered that there is not much meaning even if the shooting area is estimated. In the case of the example of FIG. 5, when an image file corresponding to the shooting frame I is selected, the shooting area is not displayed on the map image. Here, as shown in FIG. 8, in the case of simultaneously displaying information related to the shooting positions corresponding to a plurality of shooting frames, it is not necessary to display the information related to the shooting position of the shooting frame I without warning in step S214. good.

  Further, in step S203, when the operation mode of the camera 100 is not set to the map display mode for displaying the map information, the microcomputer 112 decompresses the image file selected by the user in the image processing unit 103, and An image based on the decompressed image data is displayed on the LCD 105 by controlling the LCD driver 104 (step S215).

  After the reproduction of the selected image file, the microcomputer 112 determines whether or not to end the reproduction of the image (step S216). For example, it is determined that the reproduction is to be terminated when an instruction is given by the operation of the operation unit 113 by the user to end the reproduction of the image. The microcomputer 112 stands by while performing the determination in step S216 until it is determined that the reproduction of the map image is finished.

  If no image file is selected in step S202, or if the end of reproduction is instructed in steps S207, S213, and S216, the microcomputer 112 determines whether or not to change the operation mode to the shooting mode (step S202). S217). For example, it is determined that the operation mode is to be changed when instructed by the user to operate the operation unit 113 to change the operation mode to the shooting mode. In step S217, when an instruction to change the operation mode is given, the microcomputer 112 executes the operation in the photographing mode of FIG.

  If no instruction to change the operation mode is given in step S217, the microcomputer 112 determines whether to turn off the power of the camera 100 (step S218). For example, when the camera is turned off by the user or when the no-operation state is continued for a predetermined time, the camera is turned off. In step S218, when the power of the camera 100 is not turned off, the microcomputer 112 performs the thumbnail display in step S201 again. In step S218, when the power of the camera 100 is turned off, the microcomputer 112 performs a power-off process for turning off the power of the camera 100 and ends the process of FIG.

  As described above, according to the present embodiment, the shooting position information at the timing when the GPS data is lost, the shooting date / time information indicating this timing, the GPS data before and after this timing, and the respective GPS data are It is estimated from the acquired shooting date and time information. That is, in this embodiment, it is possible to present information related to the shooting position at the timing when GPS data is lost to the user in the form of a circular area where shooting is likely to be performed. is there. Thereby, compared with the case where imaging position information is presented by simple linear interpolation, the possibility that incorrect information is presented to the user can be reduced.

  In addition, by displaying a plurality of pieces of shooting position information at the same time as shown in FIG. 8, it is possible to present to the user a moving situation related to a series of shootings without interruption. Further, at this time, by preventing the shooting position information from being displayed for the shooting frames whose shooting dates and times are extremely far apart, the possibility of erroneous information being presented to the user can be reduced.

Here, in the example of FIG. 4, the reproduction of the image file selected by the user and the reproduction of the map image are performed separately. However, the reproduction of the image file selected by the user and the reproduction of the map image are performed separately. It may be performed simultaneously.
Hereinafter, modifications of the above-described embodiment will be described. Depending on the recorded GPS log, there may be a case where the positional difference between the shooting frame E in which GPS data is lost and the subsequent shooting frame F are close. In this case, the actual shooting of the shooting frame E is considered to be close to the shooting position of the shooting frame F. However, in the case of (Expression 2), the radius of the circular area is determined by the time difference from the immediately preceding shooting frame. For this reason, even when the actual shooting position of the shooting frame E is close to the shooting frame F, if the time difference (tE−tD) between the shooting date / time of the shooting frame D and the shooting date / time of the shooting frame E is long, the radius rE. Will also be long. Therefore, when the position difference between the shooting frame E in which the GPS data is lost and the subsequent shooting frame F are close, the radius of the circular area can be calculated by multiplying the time difference (tF-tE) by the coefficient r. desirable. A display example in such a case is shown in FIG.

  Moreover, the display examples of FIGS. 7 to 9 are display examples of a shooting area on a two-dimensional map image. On the other hand, if the water depth information is taken into consideration, it is also possible to display the shooting area on the three-dimensional map image. For example, in the example of FIG. 5, the shooting frame D is underwater shooting at a water depth of 3 m. In this case, the imaging area is 3 m below the circular area estimated by the calculations of (Expression 1) and (Expression 2). If a three-dimensional map image can be displayed, as shown in FIG. 10, a true circular area RD ′ is displayed at a position 3 m below the circular area RD estimated by (Expression 1) and (Expression 2). Is desirable.

  Further, as shown in FIG. 11, if the altitude information at the time of shooting is recorded in the GPS log, as shown in FIG. 12, the shooting area is displayed on the three-dimensional map image in consideration of the altitude. Can also be displayed. Here, the circular area estimated by the calculations of (Expression 1) and (Expression 2) is an area parallel to the flat ground. Therefore, when the estimated circular region is on a mountain slope or the like, it is desirable that the circular region be inclined according to the inclination angle of the mountain.

In addition, the coefficient r in (Equation 2) may be a fixed value, but is preferably changed according to the moving speed of the camera 100. For example, if the output signal of the gyro sensor 110 is integrated once, the moving speed of the camera 100 can be calculated. For this reason, the imaging region can be estimated more accurately by making the value of the coefficient r variable according to the output signal of the gyro sensor 110. Further, it is possible to specify the moving direction of the camera 100 from the output signal of the gyro sensor 110, and by using this, it is possible to perform curve interpolation on the shooting position information at the timing when the GPS data is lost. Such interpolation can be performed not only from the gyro sensor 110 but also from the output of an electronic compass or the like.
The position display by the above (Formula 1) and (Formula 2) is not limited to this, and may be modified within a range satisfying the gist of the present embodiment. For example, the acceleration can be obtained as described above, and the position can be displayed with the radius rC from the gravity center position of the photographing position PB (xB, yB) and the estimated photographing PC (xC, yC) obtained by (Equation 1). . Further, the position may be obtained by a calculation formula that further considers a coefficient related to the moving speed.

  Further, the GPS log described above records GPS data every time shooting is performed. On the other hand, GPS data may be recorded even while shooting is not being performed. In this way, it is possible to estimate the shooting area more accurately by shortening the GPS data acquisition interval. However, in this case, GPS data is repeatedly acquired even in a situation where GPS data such as underwater cannot be acquired. Therefore, for example, when it is determined from the output signal of the pressure sensor 111 that the camera 100 is located in water, it is desirable to interrupt the acquisition of GPS data.

In the example of FIG. 4, interpolation GPS data is generated when shooting position information is not recorded in the selected image file. On the other hand, interpolated GPS data may be generated for all shooting frames that do not have GPS data in the GPS log.
In the above-described embodiment, a digital camera is used as an example of an image display device. However, the technology of this embodiment is applied to various image display devices other than a digital camera having a map image display function. Is possible.

Although the present invention has been described above based on the embodiments, the present invention is not limited to the above-described embodiments, and various modifications and applications are naturally possible within the scope of the gist of the present invention. For example, the configuration shown in FIG. 1 may be configured as a control circuit (ASIC) in which a plurality of blocks are integrated into one chip.
Further, the above-described embodiments include various stages of the invention, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some configuration requirements are deleted from all the configuration requirements shown in the embodiment, the above-described problem can be solved, and this configuration requirement is deleted when the above-described effects can be obtained. The configuration can also be extracted as an invention.

  DESCRIPTION OF SYMBOLS 100 ... Camera, 101 ... Imaging part, 102 ... SDRAM, 103 ... Image processing part, 104 ... Display driver (LCD driver), 105 ... Display part (LCD), 106 ... Display data processing part, 107 ... Memory interface (I / F), 108 ... recording medium, 109 ... communication unit, 110 ... gyro sensor, 111 ... pressure sensor, 112 ... microcomputer, 113 ... operation unit, 114 ... flash memory, 115 ... interface (I / F), 1061 ... position Interpolation processing unit, 1062 ... Position information generation unit, 1063 ... Display data generation unit, 1091 ... GPS communication unit, 1092 ... Wireless communication unit

Claims (7)

A determination unit that determines whether or not shooting position information is associated with image data obtained by shooting;
When the shooting position information is not associated with the image data, the first shooting position information and the first image estimated for the first image data that is image data with which the shooting position information is not associated. A position difference from the second shooting position information, which is shooting position information of the second image data obtained at the timing before the data is obtained, and the first shooting position information and the first image data are obtained. The position difference with the third shooting position information that is the shooting position information of the third image data obtained at a later timing is determined, and the two image data having the shorter position difference are obtained. A shooting position estimation unit that estimates a region including a shooting position from which the first image data is obtained according to a time difference of date and time information;
When the shooting position information is associated with the image data, display data is generated so that the shooting position indicated by the shooting position information is displayed on a map image, and the shooting position information is included in the image data. If not associated, a display data generation unit that generates display data to display the region on a map image;
A display control unit for displaying a map image on a display unit based on the generated display data;
Comprising
When there are a plurality of the image data, the display control unit simultaneously displays the shooting position and the region corresponding to each image data on the map image, and displays the image corresponding to each image data in the map An image display device that displays images at different positions simultaneously with an image. The image display apparatus according to claim 1, wherein the photographing position estimation unit estimates a circular area having a radius that increases as the time difference increases as the area.   The shooting position estimation unit is configured to add a position indicated by position information obtained at a previous timing to the shooting date / time information associated with the image data and the shooting date / time information associated with the image data. The image display device according to claim 1, wherein a circular area having a center on a straight line connecting a position indicated by position information obtained at a later timing is estimated as the area. The imaging position estimating unit, and the photographing date and time information shows the previous timing with respect to the photographing date and time information associated with the image data, after to the shooting date and time information associated with the image data the image display apparatus according to any one of claims 1 to 3 and the photographing date and time information indicating the timing, the time difference is characterized in that it estimates the area if within a predetermined time. The map image is a three-dimensional map image;
The display data generating unit, the three-dimensional claims 1 to any one of the 4 and generates display data to display the area at a position based on the water depth at the time of the shooting of the map image The image display device according to item. The map image is a three-dimensional map image;
The display data generating unit, any one of claims 1 to 5, characterized in that to generate the display data to display the area to highly based position at the time of the photographing of the three-dimensional map image The image display device according to item. The determination unit determines whether or not shooting position information is associated with image data obtained by shooting,
When the determination unit determines that the shooting position information is not associated with the image data, the shooting position estimation unit estimates the first image data that is image data not associated with the shooting position information. The positional difference between the first shooting position information thus obtained and the second shooting position information that is the shooting position information of the second image data obtained at the timing before the first image data is obtained, and the first The position difference between the shooting position information of the third image data and the third shooting position information which is the shooting position information of the third image data obtained at the timing after the first image data is obtained is determined. Estimating a region including the shooting position from which the first image data was obtained according to the time difference between the shooting date and time information from which the two image data having a position difference were obtained ;
When the determination unit determines that the shooting position information is associated with the image data, the display data generation unit displays the shooting position indicated by the shooting position information on the map image. And when the determination unit determines that the shooting position information is not associated with the image data, the display data generation unit does not associate the shooting position information with the image data. Generates display data to display the region on a map image,
The display control unit causes the display unit to display a map image based on the generated display data,
When there are a plurality of the image data, the display control unit simultaneously displays the shooting position and the region corresponding to each image data on the map image, and displays the image corresponding to each image data in the map An image display method, wherein the image is displayed simultaneously at a position different from the image.

Images