JP5843628B2 - Display control apparatus, control method therefor, and program - Google Patents

Description

  The present invention relates to a technique for displaying a marker on a map based on position information.

  In recent years, devices that receive a signal from a GPS (Global Positioning System) satellite and use the received position information and date / time information have become widespread. One of them, a digital camera with a built-in GPS reception function, can add and record position information to captured image data. Some devices equipped with wireless communication means, such as a camera-equipped mobile phone, can obtain position information from information of a radio wave transmission base station or the like, and can record the information in association with the obtained position information and captured image data. In addition, there is a GPS log device that periodically stores received position information and date and time information and generates travel information as log information. If this GPS log device is used, position information can be given to an image from an image photographed by a digital camera not equipped with a GPS receiver or a wireless communication device and a log file generated by the log device. Of course, it is also common to provide position information of an image with an application or the like that can display a map.

  Since the image data generated by these has position information such as latitude and longitude, displaying the position information on a map allows the shooting location to be known, which can be useful for recalling memories related to photographs (Patent Document 1).

JP 2007-323543 A

  As described above, there are various position positioning methods and setting methods for the position information associated with the image data. Therefore, it is not possible to confirm the position measurement method of individual images simply by displaying markers indicating the shooting positions of a plurality of images on a map.

  The present invention has been made in view of the above-described problems, and is a technique that can not only simply display a marker at a position indicated by position information associated with an image file on a map but also check a position measurement method for each marker. Is to provide.

In order to solve this problem, for example, the display control apparatus of the present invention has the following configuration. That is,
Holding means for holding image data associated with position information;
Display control means for controlling display information related to the image data to be displayed at a display position on a map based on position information associated with the image data;
Determining means for determining whether positioning method information indicating a type of a method for determining position information associated with the image data held by the holding means is associated with the image data;
When the determination unit determines that the positioning method information is associated with the image data, the display control unit can identify the type of the method that determined the position information based on the positioning method information. The display information related to the image data is controlled to be displayed on a map.

  According to the present invention, it is possible not only to simply display a marker at a position indicated by position information associated with an image file on a map, but also to easily check a position measurement method for each marker.

1 is a schematic configuration diagram of a system in an embodiment. 1 is a functional block diagram of a system in an embodiment. The figure which shows an example of the display screen in embodiment. The flowchart which shows the processing content of PC in embodiment. The figure which shows the data structure of the image file in embodiment. The flowchart which shows the processing content of PC in embodiment. The figure for demonstrating the image management list | wrist in embodiment. The figure which shows the structure of the GPS log file in embodiment. The figure for demonstrating the log management list in embodiment. The flowchart which shows the processing content of PC in embodiment. The flowchart which shows the processing content of PC in embodiment. The flowchart which shows the processing content of PC in embodiment. The figure which shows an example of the display state of PC in embodiment. The figure which shows an example of the display state of PC in 2nd Embodiment.

  Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. In this embodiment, an example in which the present invention is applied to a general-purpose information processing apparatus (hereinafter referred to as a computer or a PC) such as a personal computer will be described. However, since the present invention can also be applied to a digital camera, a mobile phone, and the like, the present invention is limited thereby. It is not something.

[First Embodiment]
In the first embodiment, the GPS device and the digital camera with a wireless communication device using a wireless LAN are provided with position information indicating the position (imaging position) of the image data obtained when the image is obtained. Are recorded in a storage medium such as a removable semiconductor memory card. In addition, log data representing the travel route is also recorded in the storage medium as a GPS log file. For example, a PC connects to a digital camera via a USB interface, receives the image file or GPS log file, uses an application operating on the PC, and displays a mark indicating a shooting position on a map displayed by the application. Display travel routes.

  FIG. 1 shows that a digital camera 100 and a computer (PC) 200 for realizing the above are connected via a USB cable 10 so as to be communicable. With this connection, the PC 200 acquires an image file or a GPS log file stored in the storage medium of the digital camera 100 and stores it in its storage device (hard disk or the like).

<Configuration of digital camera and PC>
FIG. 2 is a functional block diagram of the digital camera 100 and the computer 200 in FIG. In the block diagram shown in FIG. 2, elements that are not directly required for understanding the configuration of the embodiment are omitted.

  The digital camera 100 includes an imaging unit 101, a GPS receiving unit 102, a central control unit (CPU) 103, a RAM 104, a flash memory 105, a recording medium 106, a display unit 107, an operation unit 108, a USB communication unit 109, and a wireless LAN communication unit. 110.

  The imaging unit 101 includes a lens, a shutter, a diaphragm, an imaging device, and the like, and forms an image of light from the subject on the imaging device with an appropriate amount and timing. The GPS receiving unit 102 receives a signal from a GPS satellite and calculates a current position based on the signal. In addition, UTC (Universal Time Coordinated) received simultaneously with the current position is provided to the central control unit. The central control unit 103 performs various calculations and controls each part of the digital camera 100 in accordance with the input signal and program. Specifically, imaging control, display control, recording control, communication control, and the like are performed. The RAM 104 records temporary data and is used for work of the central control unit 103. The flash memory 105 records a program (firmware) for controlling the digital camera 100 and various setting information. The recording medium 106 records captured image files and the like. Note that the recording medium 106 in this embodiment is a detachable so-called memory card, which can be mounted on a computer or the like and read an image file. That is, the digital camera 100 has access means to the recording medium 106 and can read and write image files on the recording medium 106.

  The display unit 107 performs display of a viewfinder image at the time of shooting, display of a shot image, display of characters for interactive operation, and the like. Note that the display unit 107 does not need to be included in the digital camera 100, and the digital camera 100 only needs to have a display control function for controlling the display of the display unit 107. The operation unit 108 is for accepting a user operation. For example, a button, a lever, a touch panel, or the like can be used as the operation unit 108.

  A USB communication unit 109 is connected to an external device via a USB (Universal Serial Bus) interface, and transmits and receives control commands and image data. For example, PTP (Picture Transfer Protocol) is used as a protocol for establishing a connection and performing data communication. The wireless LAN communication unit 110 is for connecting to the Internet by wireless communication. For example, it can be used to transmit / receive image data on a website or e-mail, or to connect to an external device connected to the Internet via a server on the Internet. The control of the digital camera 100 may be performed by one piece of hardware, or a plurality of pieces of hardware may function as means for executing the process in the digital camera 100 while sharing the process.

  The processing of the central control unit 103 when photographing with the digital camera 100 in the present embodiment is as follows. That is, if the central control unit 103 receives a signal sufficient for the GPS receiving unit 102 to calculate the position information from the GPS satellite, the position information and the GPS date / time at that time, and the GPS satellite A positioning method that is determined by the above signal is added to the image data and recorded on the recording medium 106 as an Exif format file. However, if the GPS reception unit 102 has not received a signal sufficient to calculate the position information, the position information obtained from the wireless radio wave information received by the wireless LAN communication unit is displayed together with the image data in the Exif format. Recording as a file on the recording medium 106. In this case, as the positioning method (measurement method), the content acquired from the wireless LAN information is recorded. If the position information cannot be obtained from the wireless LAN, neither the position information nor UTC is recorded in the image file. Details of the file in this embodiment will be described later.

  The computer (PC) 200 includes a central control unit (CPU) 203, a RAM 204, a recording medium 206, a display unit 207, an operation unit 208, a communication unit 209, and a network interface 210. As is well known, the computer 200 has an operating system (OS) in hardware, and application software exists on the operating system (OS) to perform various processes. The central control unit 203 performs various calculations, data reproduction, and control of each part of the computer in accordance with the input signals and programs. The RAM 204 is used for loading the OS and applications, and for work of the central control unit 203 such as recording temporary data. The recording medium 206 is a hard disk drive (HDD) as an auxiliary storage device, and stores various data, application programs, an OS, and the like. It also functions as a storage location for image files and GPS log files acquired from digital cameras. In the present embodiment, the display unit 207 is a display, and displays an image or a program screen. The operation unit 208 is a keyboard, a mouse, or the like, and is used for inputting from a user to an application or the like. A communication unit 209 connects to an external device and transmits / receives control commands and data. In this embodiment, a USB interface is used for connection with the digital camera 100, but this is included.

<Description of UI of application software running on computer>
Next, application software in this embodiment will be described.

  The application software is loaded from the recording medium 206 to the RAM 204 and executed by the central control unit 203. As a result, the computer 200 functions as an image display device.

  FIG. 3 shows a GUI displayed on the display screen of the display unit 207 when the application software is executed. The application software in this embodiment can display a map on the screen. The central control unit 203 executes the software, refers to the image file or the GPS log file recorded by copying from the digital camera 100 to the recording medium 200 of the computer 200, and the position recorded there. In accordance with the information, a mark indicating the presence of image data and a moving route are displayed on the map.

  In the GUI 300 of the application shown in FIG. 3, reference numeral 301 denotes a folder designation unit 301 for designating image data to be processed by the application. In the folder designation unit 301, a folder configured in the recording medium 206 of the computer 200 can be selected. In this application software, the image file stored in the folder selected here is handled. Reference numeral 302 denotes a thumbnail list display unit, which displays thumbnail images (reduced images) corresponding to image files included in the folder selected by the folder specification unit 301 in a vertical line as a list in a scrollable manner. A map display unit 303 can display a map at an arbitrary position by the user operating the map moving button 304 or the map scale change bar 305. In the application of the present embodiment, it is possible to connect to the Internet via the network interface 210, and the map data to be displayed is acquired using a general Web service. However, a map database may be stored in the recording medium 206, and map image data at a necessary position may be acquired using the map database, and the method for acquiring the map image data is not limited.

  When this application is executed, the central control unit 203 displays a mark indicating the presence of image data in accordance with the position information included in each image data file corresponding to the thumbnail image displayed on the thumbnail list display unit 302. It is displayed as 310. In addition, the central control unit 203 arranges the images in the order of shooting dates and times included in the image data file, and displays the movement route 311 by connecting the positions indicated by the position information with line segments.

<Processing of application software running on the computer>
Processing for realizing the above functions will be described below using a flowchart. The processing shown below is executed by the central control unit 203 of the computer loading a program stored in the recording medium 206 into the RAM 204 and executing it.

  FIG. 4 is a flowchart showing processing when the operator operates the operation unit 208 on the GUI screen and a folder is selected by the folder designation unit 301. As long as a subfolder exists in the designated folder, image files in the subfolder are also processed.

  First, in S5, the central control unit 203 analyzes the GPS log file. The GPS log file is stored in a predetermined folder in the recording medium 206. In the process of S5, the GPS log file recorded in the predetermined folder is sequentially referred to, and the log management list shown in FIG. 900 is created.

  The log management list 900 shown in FIG. 9 summarizes the file path 9001 for each GPS log file, the UTC positioning start date and time 902 extracted from the GPS log file, the UTC positioning end date and time 903, the model name 904, and the serial number 905. There is something. Note that the log management list is managed in a state of being sorted in ascending order by the positioning start date and time 902. The log management list is recorded in the recording medium 206, but may be temporarily managed in the RAM 204. Details of the log management list creation method will be described later.

  Returning to the description of FIG. 4, when the processing in S <b> 5 is completed, the central control unit 203 processes the image data included in the folder designated by the folder designation unit 301 one by one. In S10 of FIG. 4, the central control unit 203 determines whether all the image data has been processed. If an unprocessed image exists, the process proceeds to S20. If the processing for all the image data has been completed, the central control unit 203 moves the process to S40.

  In S20, the central control unit 203 creates an image management list in which information related to the target image is collected. The image information is also subjected to a process for obtaining a UTC conversion time which is a key when searching for a log file corresponding to the image data. Details regarding these will be described later. In S30, the target log file is obtained based on the previously obtained UTC conversion time. Details of this processing will be described later. The log file obtained here is used to draw the movement route when the image being processed is taken. Information about the obtained log file is also recorded in the image management list. When the processing for all the image files is completed, the central control unit 203 shifts the processing from S10 to S35.

  In S35, the central control unit 203 refers to the generated image management list, calculates an average value (latitude average value, longitude average value) of positions (latitude, longitude), and searches an existing map database based on the average value. Then, map image data is acquired. In addition, by referring to the image management list, the maximum and minimum values of latitude and the maximum and minimum values of longitude are obtained, and map image data that fits them is acquired.

  Thereafter, when the process proceeds to S40, the central control unit 203 displays the map image in the map display area 303 based on the image management list, and the image indicated by the image file exists in the map image. A marker indicating is displayed. In the present embodiment, as shown in FIG. 3, a marker 310 is displayed on the map displayed in the map display area 303. The markers 310 are displayed for the number of images that are managed in the image management list and whose position information is recorded. Details of the processing at this time will be described later.

  Thereafter, in step S50, the central control unit 203 draws the travel route 311 on the map displayed in the map display area 303. This process is also performed based on the contents of the image management list.

<Configuration of image data>
FIG. 5 shows the configuration of the image data in the present embodiment, which is generated by the digital camera 100 and is the same as that recorded in the HDD after being transferred to the computer.

  The data structure of the image file of the present embodiment uses Exif-JPEG as the format of the image file, but it is also implemented in a format in which the metadata can be recorded in the image file, such as Exif-TIFF, RAW image, and moving image. Is possible. Exif (Exchangeable image file format) is an image metadata format for digital cameras established by JEIDA (Japan Electronics Industry Promotion Association). FIG. 5 is a conceptual diagram illustrating the data structure of Exif-JPEG500.

  The SOI 501 is a marker indicating the start of Exif-JPEG500. APP1 502 is an application marker corresponding to the header part of Exif-JPEG500. A data block 503 includes a quantization table (DQT), a Huffman table (DHT), a frame start marker (SOF), and a scan start marker (SOS). Compressed Data 504 is compressed data of the main body image. The EOI 505 is a marker indicating the end of the Exif-JPEG 500.

  The APP1 502 is configured as indicated by 506 to 512 in FIG. A data block 506 includes APP1 Length indicating the size of the APP1 502 and Exif Identifier Code indicating the identification code of the APP1 502. The 0th IFD 507 is a data block that records attached information related to the compressed main body image. For example, information on the model name 5071 of the photographed digital camera is included. A part of the 0th IFD 507 includes data blocks of the Exif IFD 508 and the GPS IFD 510. The Exif IFD 508 includes tags related to the Exif version, tags related to the characteristics and structure of image data, tags related to the shooting date and time 5081, tags related to shooting conditions in which shutter speed, lens focal length, and the like are recorded. Further, the Exif IFD 508 includes a MakerNote 509 data block. In MakerNote 509, information unique to the manufacturer that generated the file is recorded. For example, time difference information 5091 used in the present embodiment and information such as a serial number 5092 representing a unique number of the digital camera 100 used for photographing are included.

  The GPS IFD 510 is composed of tags related to GPS information. Among them, position information such as latitude 5101 and longitude 5102 used in the present embodiment and satellite positioning date and time (UTC) 5103 are recorded. UTC (Coordinated Universal Time) is a standard time according to an international agreement that is determined based on the international atomic time recorded by an atomic clock. More specifically, latitude 5101 is recorded in GPS latitude Ide (2.H) and GPS LatitudeRef (1.H) of GPS info IFD, and longitude 5102 is recorded in GPS Longitude (4.H) and GPS LongitudeRef (3.H). The satellite positioning date and time (UTC) 5103 is recorded in GPSDateStamp (1D.H) and GPSTimeStamp (7.H) (5103). Further, the position positioning method 5104 is recorded in the GPS Processing Method (1B.H). Note that the GPS Processing Method is recorded as a character string as defined in Exif, and a plurality of positioning methods can be listed by interposing a space.

  Positioning method information obtained by positioning by the central control unit 103 of the digital camera 100 in the present embodiment can take three types of values.

  The first of the positioning method information is WLAN. This is a positioning method using a wireless LAN. Acquisition of the current position from the wireless LAN is performed as follows. Receives radio waves from one or more wireless LAN access points and estimates the current location from the strength of each radio wave and the location of the access point. The second positioning method information is GPS. This is a method of receiving information from a plurality of satellites and calculating the current position of the own aircraft. The third positioning method information is MANUAL. This generally indicates that the user has manually input location information. When this value is input, the part that depends on the implementation is large. For example, when the latitude / longitude is directly input or when the latitude / longitude is input by specifying a specific part of the map by the user operation It is conceivable to use it. Although not specifically mentioned in the present embodiment, the present invention is applicable to CELLID, which is a positioning method using base station information of a mobile phone, as a fourth positioning method.

  The 1st IFD 511 is a data block that records attached information related to thumbnail images. Thumbnail 512 is thumbnail image data.

  Here, the time difference information 5091 will be described. Normally, a digital camera has a clock function, and when shooting, the date and time at that time is recorded as image attribute information in association with image data. Also in this embodiment, the digital camera 100 has a clock function, and the captured image data includes a shooting date and time 5081 shown in FIG. Furthermore, in the digital camera 100 according to the present embodiment, it is possible to set the time difference from UTC of the date and time set in the camera clock. Like the shooting date and time 5081, the generated image data is set in the camera. The time difference is also recorded. The time difference information 5091 in FIG. 5 corresponds to this. For example, assume that the user is staying in Japan. In this case, the clock setting of the digital camera 100 is set to local time in Japan, and the time difference from UTC is set to 9 hours (540 minutes). As a result, the shooting date and time 5081 of the image data generated by shooting records the local time in Japan at the time of shooting and the time difference information 5091 records a value of 9 hours (540 minutes). Note that the method for setting time difference information by the user in the digital camera 100 is not directly related to the present invention, and thus the description thereof is omitted.

<Image management list>
FIG. 7 shows an image management list created by processing to be described later. The image management list is a list for managing information obtained by analyzing all images designated by the user. It consists of an image file path, latitude, longitude, positioning method, model name and serial number of the digital camera that took the image, time when the shooting time is converted to UTC, and a corresponding log file path. Details of the corresponding log file path in the image management list will be described later.

<Image management list creation process>
Details of the processing of S20 of FIG. 4 will be described using the flowchart shown in FIG. The processing described here is processing for creating an image management list.

  In S601 of FIG. 6, the central control unit 203 of the computer 200 first records the file path of the target image in the image file path item of the image management list. In step S602, the image data file is analyzed to extract latitude, longitude, position measurement method, model name, and serial number, and a value is recorded in a predetermined item of the image management list. Note that each item is left blank when there is no information associated with the image data. As for the positioning method, if a plurality of positioning methods are listed in the GPS Processing Method, they are recorded in the image management list as they are.

  In step S <b> 603, the central control unit 203 analyzes the image data and obtains three values of the shooting date / time, satellite positioning date / time (UTC), and time difference information. This is data necessary for obtaining a time that is a key for searching log data corresponding to an image data file and a UTC conversion time. Although details will be described later, the log file is recorded in a predetermined folder, and the information is managed by the log file management list. In the log file management list, positioning start date and time and positioning end date and time are recorded in UTC as information of each log file. Therefore, in order to find the log file corresponding to the image data, a time corresponding to UTC of the time when the image was taken is required. The above three values are used to obtain this value. However, some image data files do not necessarily include all these three data. For example, even when the digital camera 100 of the present embodiment is used for shooting, in an environment where radio waves from GPS satellites cannot be captured, such as indoors, in addition to position information such as latitude and longitude, satellite supplement date (UTC) is also included. It is not recorded in the image data. In addition, when shooting without setting the time difference information with a digital camera that does not have a GPS function, or in the first place, in the case of a digital camera not equipped with a function for setting time difference information, there is no time difference information. can not get. For this reason, in S604 and subsequent steps, processing is branched according to the acquired data.

  In step S604, the central control unit 203 determines whether the satellite supplement date (UTC) has been acquired. If it has been acquired, the central control unit 203 moves the process to S605. In this case, the central control unit 203 records the satellite supplement date (UTC) acquired from the image data file in “UTC conversion time” of the image management list.

  On the other hand, if the file does not have a satellite positioning date and time (UTC), the central control unit 203 moves the process to S606. In step S <b> 606, the central control unit 203 determines whether a shooting date / time exists in the image data file. If the image data file does not exist, the process proceeds to S610, and the central control unit 203 sets 0 representing an error as the UTC conversion time of the image management list.

  On the other hand, if there is a shooting date and time, the central control unit 203 moves the process to S607. In step S <b> 607, the central control unit 203 divides the processing depending on whether time difference information exists. If the time difference information exists, the central control unit 203 sets a value obtained by subtracting the time difference information from the shooting date and time in the image management list in step S <b> 609. On the other hand, if the time difference information does not exist, the central control unit 203 requests the user to input the time difference information in S608. The central control unit 203 obtains a UTC conversion time in S609 based on the input value and records it in the image management list. Note that inputting the time difference information to the user merely displays a screen for designating the time difference, and thus description thereof is omitted.

  As described above, the UTC conversion time for searching the log file corresponding to the image can be obtained even when the attribute information included in the image file is various.

<Log management list creation process>
Next, a method for creating the log management list 900 shown in FIG. 9 will be described. This process corresponds to the process in step S5 of FIG. 4 executed by the central control unit 203.

  First, the configuration of the GPS log file in the present embodiment will be described.

  FIG. 8 shows a GPS log file in this embodiment. The central control unit 103 of the digital camera 100 with the GPS function is stored in the recording medium 106 at regular time intervals based on the signal received by the GPS receiving unit 102.

  The first line describes the model name and serial number of the GPS log device. In this embodiment, since the digital camera has a function of a GPS log device, a model name 801 and a serial number 802 of the digital camera are described.

  The line starting from the $ mark from the second line is a message conforming to the NMEA-0183 format, which is received by the GPS log device and output as log information. The NMEA-0183 format is a standard for communication between a GPS receiver and a navigation device defined by the National Marine Electronics Association using a serial port. In this embodiment, two types of messages, GPGGA and GPRMC, are recorded. The data fields that follow each message are separated by commas. GPGGA stands for Global Positioning System Fix Data. The data fields are: UTC positioning time 803, latitude and north latitude (N) or south latitude (S) (804), longitude and east longitude (E) or west longitude (W) (805), GPS quality, number of satellites received , HDOP (Horizontal Division of Precision), antenna altitude from mean sea level (m), altitude difference from WGS-84 ellipsoid to mean sea level (m), age of DGPS data (seconds), ID of DGPS reference station, check Sam. GPRMC stands for Recommended Minimum Specific GNSS Data. The data fields are, in order, UTC positioning time, valid (A) or invalid (V) status, latitude and north latitude (N) or south latitude (S), longitude and east longitude (E) or west longitude (W), ground Speed (knot), direction of travel (degree, true north), UTC positioning date 806, geomagnetic declination, mode, and checksum.

  As described above, the log management list 900 shown in FIG. 9 includes the file path 901 for each GPS log file, the UTC positioning start date and time 902 extracted from the GPS log file, the UTC positioning end date and time 903, the model. A name 904 and a serial number 905 are included.

  In order to create this, the central control unit 203 sequentially checks GPS log files included in a predetermined folder, and sets a path including the file name of the GPS log file as the log file path 901. Further, the central control unit 203 sets a value obtained from the positioning time 803 and the positioning date 806 recorded in the first GPGGA / GPRMC of the message of the GPS log file as the positioning start date 902. Further, the central control unit 203 sets a value obtained from the positioning time 803 and the positioning date 806 recorded in the last GPGGA / GPRMC of the message of the GPS log file as the positioning end date 903. Furthermore, the central control unit 203 sets the model name 801 recorded in the header of the GPS log file as the model name 904. And then. The central control unit 203 sets the serial number 802 written in the header as the serial number 905. And these processes are performed about all the GPS log files.

  Next, details of the processing of the central control unit 203 performed in S30 of FIG. 4 will be described using the flowchart shown in FIG. This process refers to the log management list based on the UTC conversion time obtained in S20 of FIG. 4 to search for a GPS log file corresponding to the image file, and sets a corresponding log file path 707 of the image management list 700. It is processing to do.

  FIG. 10 is a flowchart showing a search process for a GPS log file corresponding to a selected image. First, in step S1001, the central control unit 203 acquires the selected image information from the image management list described with reference to FIGS. In step S1002, the central control unit 203 initializes a variable N indicating a number in the log management list described in FIG.

  In S1003, the central control unit 203 increments the value of the variable N, and refers to the log management list Nth log information in S1004. And then. In next step S1005, the central control unit 203 determines whether the model name and the serial number of the acquired image information match the Nth log information. If not, the central control unit 203 determines that the Nth GPS log file is not a corresponding GPS log file, and returns to the process of incrementing the variable N in S1003. On the other hand, if it is determined that they match, the central control unit 203 advances the process to S1006.

  In step S1006, the central control unit 203 determines whether the image-captured shooting time of the image information is before the Nth GPS log file positioning start date and time. If yes, the process proceeds to S1007, and the central control unit 203 determines whether the UTC-converted shooting time matches the Nth GPS log file positioning start date. If they match, in S1008, the central control unit 203 determines the Nth GPS log file as a corresponding file, and proceeds to S1016. If they do not match, the central control unit 203 determines in step S1009 whether the UTC-converted shooting time matches the positioning end date of the nth log before the Nth. The condition of the nth log is the last log in which the model name and the serial number match in S1005. If the central control unit 203 determines that it matches the positioning end date of the nth log, the process proceeds to S1010, determines the nth log as a corresponding file, and proceeds to S1016. In S1009, if the central control unit 203 determines that it does not coincide with the positioning end date of the nth log, that is, if the shooting date converted to UTC does not exist in any log, in S1011 It is determined that there is no corresponding GPS log file.

  If the central control unit 203 determines in S1006 that the UTC-converted shooting time of the image information is not before the Nth GPS log file positioning start date and time, the process proceeds to S1012. In S1012, the central control unit 203 determines whether the UTC-converted shooting time is before the positioning end date and time of the Nth GPS log file. If it is before, that is, if it is determined that the UTC-converted shooting time is between the positioning start date and time and the positioning end date and time of the Nth GPS log file, the central control unit 203 advances the process to S1013. In S1013, the central control unit 203 determines the Nth GPS log file as a corresponding file, and proceeds to S1016. If the central control unit 203 determines in S1012 that the UTC-converted shooting time is not before the positioning end date and time of the Nth GPS log file, the process proceeds to S1014, and the reference of all GPS log files is completed. Determine if you did. If not completed, the process returns to the process of incrementing N in S1003. If it is determined that the process has been completed, the central control unit 203 advances the process to S1015, determines that there is no corresponding GPS log file, and advances the process to S1016. In step S1016, the central control unit 203 records the determined path of the corresponding GPS log file in the image management list described with reference to FIG.

  In the present embodiment, as described with reference to FIG. 6, when the image management list is created, the time axis of the image capturing time is converted to UTC and the corresponding GPS log file is determined. However, the corresponding GPS log file may be determined by converting the time axis on the GPS log file side to local time obtained by adding a time difference from UTC.

  Further, in this embodiment, a GPS log file in which the image shooting date matches the positioning start date of the GPS log file or the positioning end date is determined as the corresponding file based on the determination in S1007 and S1009. Therefore, in the image management list of FIG. 7, there is no GPS log file in which the date of UTC conversion time of the image file path C: ¥ 201000908 ¥ IMG_0007.JPG coincides. For this reason, it is recorded that there is no corresponding GPS log file path. However, even if there is no GPS log file with the same date, the GPS log file with the closest positioning start date or positioning end date may be determined as the corresponding file. In that case, even the GPS log file with the closest positioning start date / time or positioning end date / time may be determined not to be a corresponding file if the threshold value is exceeded.

<Marker display processing>
Next, details of the processing in step S40 in FIG. 4 will be described using the flowcharts shown in FIGS. The process described here is executed by the central control unit 203 of the computer 200. Then, when position information associated with the image data exists in the image file, it is a process of plotting an appropriate marker on the map. In this case, the image management list 700 is referred to, and the process is performed for each element (row) included therein.

  First, in S1101 of FIG. 11, the central control unit 203 checks whether or not the processing for all the elements has been completed, and ends this processing if completed. If not completed, the process proceeds to S1102. The processing in S1102 is processing performed for each element (image file) of the list.

  FIG. 12 is a flowchart showing details of the processing in S1102. The processing contents of the central control unit 203 will be described below with reference to FIG.

  First, in S1201, the central control unit 203 determines whether or not position information is described in the target image file. The determination may be made based on whether both the latitude 702 and longitude 703 corresponding to the element being processed in the image management list 700 are recorded. If it is determined that the position information is not described, it is not necessary to plot the marker, and the process is exited. On the other hand, if it is determined that the position information is described, the central control unit 203 checks the position positioning method in S1202, S1204, and S1206. Specifically, the contents recorded in the position positioning method 708 of the image management list are referred to. Note that the position positioning method 708 may include a plurality of types of position positioning methods, but in this embodiment, only the one recorded at the top is referred to. When the head of the value set in the positioning method 708 is “GPS”, “WLAN”, or “MANUAL”, the process moves to any of S1203, S1205, and S1207, and the difference in positioning method can be identified. Performs marker display processing. If anything other than the above is recorded or nothing is set (blank), the process proceeds to S1208.

  When the processing proceeds to S1203, the central control unit 203 plots a marker indicating that the position measurement method is “GPS” at a position on the map corresponding to the values of latitude 702 and longitude 703 of the image file of interest ( Deploy. Specifically, it is plotted on the map in the format of the GPS marker 320 of FIG.

  When the process proceeds to S1205, the central control unit 203 plots a marker indicating that the position measurement method is “WLAN” at a position on the map corresponding to the values of latitude 702 and longitude 703 of the image file of interest. . Specifically, it is plotted on the map in the form of the wireless marker 321 in FIG.

  When the process proceeds to S1207, the central control unit 203 plots a marker indicating that the position measurement method is “MANUAL” at a position on the map corresponding to the values of latitude 702 and longitude 703 of the image file of interest. . Specifically, it is plotted on the map in the form of the manual marker 322 of FIG.

  When the process proceeds to S1208, the central control unit 203 displays a marker indicating that the positioning method is not any of “GPS”, “WLAN”, and “MANUAL”, or is not recorded (blank), as a target image file. Are plotted at positions on the map corresponding to the values of latitude 702 and longitude 703. Specifically, it plots on the map in the format of the other marker 322 of FIG.

<Display when the mouse is over the marker>
Here, a process when one marker is designated by the operator's instruction input will be described. As an example, a case where a pointing device such as a mouse is operated and a mouse cursor displayed in conjunction with the pointing device is moved to a marker position on the map is taken as an example.

  FIGS. 13A to 13C show that the operation of the operation unit 208 by the operator is detected, the mouse cursor 1300 is moved, and the mouse cursor 1300 is positioned on the marker displayed on the map. The example of the display processing result at the time of determining is shown. FIG. 5A shows an example in which the position positioning method at the time of capturing an image indicated by the image file indicated by the marker is “GPS”. In the figure, when the mouse cursor 1300 is overlaid on the marker, the GPS marker supplementary information 1301 is displayed in a balloon format including character information. For example, in the image management list 700, No. One image file corresponds to this.

  FIG. 13B shows an example in which the positioning method is “MANUAL WLAN”. When the mouse cursor 1300 is placed on a marker, two independent balloons of manual marker supplement information 1302 and wireless marker supplement information 1303 are displayed. Is done. For example, in the image management list 700, No. 7 images correspond to this.

  FIG. 13C shows an example in which the position positioning method is “” (blank), and even if the mouse cursor 1300 is superimposed on the marker, in this case, supplementary information on the marker is not displayed.

  As described above, according to the present embodiment, the marker is displayed on the map image according to the position information described in the image file, and the display form of the marker is the position measurement method described in the corresponding image file. By making it according to the type, it is possible to visually determine at which position the image represented by the image file is captured and in what positioning method the position is obtained.

  Although the travel route 311 is displayed on the screen of FIG. 3, the central control unit 203 draws this travel route display processing based on the GPS log file (see FIG. 8). The model name and serial number are the same, and the same day's location information is connected by a single line. That is, if there are GPS log files with different model names or serial numbers, they are displayed as separate line segments. Since the process of displaying the movement route itself is well known, detailed description thereof is omitted here.

  In addition, if a plurality of markers exist within a preset distance range (distance range depending on the scale of the displayed map), the map is hidden by these markers, and therefore one marker is displayed as a representative. In this case, since a plurality of markers are represented by one representative marker, the pattern has a format representing the representative, and a slightly larger (about 1.5 times) marker is displayed. Then, when the map scale change bar 305 is operated and enlarged, it is separated into individual markers and displayed.

[Second Embodiment]
<Display when the mouse is over the marker>
FIG. 14 shows another example when the marker displayed on the map is designated with the mouse cursor 1300. The example in the figure is an example in which an image in which a plurality of positioning methods are set as the positioning method is designated with a mouse cursor. Specifically, this is a case where the positioning method is “GPS WLAN”. In this embodiment, when a plurality of methods are recorded in the position measurement method, position information such as latitude and longitude in each positioning method is recorded in association with image data. Specifically, the position information measured by the second and subsequent positioning methods is recorded in the MakerNote 509 in the file structure shown in FIG. Note that the position information based on the first positioning method is recorded in the GPS IFD 510 as in the first embodiment. When this file is displayed on the map, it is displayed as one marker in the normal state, like the marker 1400 in FIG. However, if the central control unit 203 determines that the mouse cursor 1300 is positioned on the marker 1400, the auxiliary marker 1402 plotted from the position information based on the second positioning method, the supplementary information 1403, and the relationship are shown. An auxiliary line 1404 is newly displayed.

  Note that the position information based on the second positioning method may be displayed only when the first position information and the second position information are separated by a certain distance or more. Further, the value of the certain distance may be changed according to the scale of the displayed map. Further, the position information recorded in the file is not limited to two, and a plurality of pieces of information may be recorded. In this case, when a marker based on the first position information is designated by the mouse cursor, a plurality of auxiliary markers are displayed.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

  For example, in the present embodiment, as shown in FIG. 3, the pattern of the marker is changed according to the positioning method. However, the present invention is not limited to this, and the color and size of the marker are changed according to the positioning method. You may change it. Furthermore, only a specific positioning method may be displayed, or conversely, a specific positioning method may not be displayed.

In this embodiment, as shown in FIG. 5, the image data and related information are recorded in the Exif format, but the present invention is not limited to this. Even in the case of the Exif format, for example, the same content may be recorded in MakerNote without referring to the GPS ProcessingMethod.
(Other examples)
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

Claims (15)

Holding means for holding image data associated with position information;
Display control means for controlling display information related to the image data to be displayed at a display position on a map based on position information associated with the image data;
Determining means for determining whether positioning method information indicating a type of a method for determining position information associated with the image data held by the holding means is associated with the image data;
When the determination unit determines that the positioning method information is associated with the image data, the display control unit can identify the type of the method that determined the position information based on the positioning method information. A display control apparatus that controls to display display information on the image data on a map. The holding means also holds image data not associated with the position information,
The display control means controls to display display information relating to image data associated with the position information and display information relating to image data not associated with the position information in a distinguishable manner. The display control apparatus according to claim 1. When the display information displayed on the map is instructed by a user operation, the display control unit converts the character information corresponding to the positioning method information associated with the image data corresponding to the display information into the character information. The display control apparatus according to claim 1, wherein the display information is displayed in a balloon format. When a plurality of positioning method information is associated with the image data corresponding to the display information instructed by the user operation, the display control unit is configured to display each positioning associated with the image data corresponding to the display information. 4. The display control apparatus according to claim 3, wherein character information corresponding to the method information is displayed in a balloon form with respect to the display information. The holding means holds a plurality of image data,
When the respective display positions based on the position information associated with the plurality of image data are within a preset distance range, the display control means replaces the plurality of display information with a representative one The display control apparatus according to claim 1, wherein display information is displayed. The display control apparatus according to claim 1, wherein the positioning method information is recorded in a header area of the image data. The image data has a data structure according to the Exif standard,
The display control apparatus according to claim 1, wherein the positioning method information is recorded on an Exif GPS processing method tag. The display control according to claim 7, wherein a plurality of positioning method information is associated with one image data by recording character strings representing a plurality of positioning methods in the GPS processing method tag. apparatus. 9. The display control apparatus according to claim 1, wherein when a plurality of pieces of position information are associated with the image data, positioning method information corresponding to each position information is also associated. . It further has connection means for connecting to an external device,
The display control apparatus according to claim 1, wherein the holding unit holds image data received from the external apparatus. A means for receiving log data from an external device;
11. The display control unit according to claim 1, wherein the display control unit controls display information related to the image data and display information based on position information in the log data to be displayed on a map. The display control device according to item. The display control apparatus according to claim 1, wherein the display information related to the image data includes a marker. The display control apparatus according to claim 1, wherein the display information related to the image data includes a thumbnail of the image data. A holding step for holding image data associated with position information;
A display control step for controlling display information relating to the image data to be displayed at a display position on a map based on position information associated with the image data;
A determination step of determining whether positioning method information indicating a type of a method for determining position information associated with the image data held in the holding step is associated with the image data;
When it is determined that the positioning method information is associated with the image data in the determining step, the display control step can identify the type of the method that determined the position information based on the positioning method information. A control method for a display control device, wherein display information relating to the image data is controlled to be displayed on a map. A computer-readable program for causing a computer to function as each unit of the display control device according to claim 1.

Images