JP2014160128A - Information processing device, reproduction device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To generate a photograph image file which can support a more flexible utility form.SOLUTION: A PC 2 requests a digital camera 1 to transmit photograph image data held by the digital camera 1, and then captures the photograph image data from the digital camera 1. When position information is attached to the acquired photograph image data, the PC 2 searches a map database for a map image corresponding to the position information. Specifically, the PC 2 searches for a map image on a predetermined scale that centers a position indicated by the position information attached to the photograph image, for each of plurality of languages, as the corresponding map image. Then, the PC 2 concatenates all pieces of the map image data retrieved from the map database and the acquired photograph image data as one file, to generate a concatenated file.

Description

  The present invention relates to an information processing apparatus that generates a captured image file, a playback apparatus that reproduces the captured image file, and a control method and program for these apparatuses.

Some captured images captured by a digital camera equipped with a GPS (Global Positioning System) receiver are added with position information acquired from a GPS satellite. The position information acquired from the GPS satellite is recorded as a part of the additional information of the photographed image according to the Exif (Exchange Image File Format) standard.
As one example of use of a photographed image to which this position information is added, a photographed image is displayed on a map image so that the photographed position is indicated on the map image.
For example, in Patent Document 1, a map image is acquired via an external network, and an arrow indicating the shooting position and direction is displayed on the map image in association with the shot image.

JP 2008-277959 A

  However, in the above-mentioned Patent Document 1, it is necessary to prepare a map image separately in addition to the captured image. That is, in an environment where it is difficult to prepare a map image, a captured image cannot be displayed on the map image. For example, it is difficult to refer to a map image with a digital camera that cannot be connected to the Internet. Therefore, it is conceivable to record a map image corresponding to the position information together with the photographed image. However, such a method does not take into account, for example, a change in the scale of the map image or a change in language. That is, there is a problem that it is not possible to flexibly cope with the usage form of the recorded image after recording.

  The present invention has been made in view of the above points, and an object of the present invention is to be able to generate a captured image file that can cope with a more flexible usage pattern.

  An information processing apparatus according to the present invention includes an image acquisition unit that acquires captured image data including position information indicating a shooting position, and a plurality of map image data based on position information included in the captured image data acquired by the image acquisition unit. Map acquisition means for acquiring image data, and generation means for generating a single file by collecting the captured image data acquired by the image acquisition means and a plurality of map image data acquired by the map acquisition means. The plurality of map image data includes map image data of a plurality of languages.

  According to the present invention, it is possible to generate a captured image file that can correspond to a more flexible usage pattern.

It is a figure which shows the picked-up image processing system which concerns on 1st Embodiment. It is a figure which shows the structure of the digital camera which concerns on 1st Embodiment. It is a figure which shows the structure of the personal computer which concerns on 1st Embodiment. 4 is a flowchart illustrating a processing flow when an image is captured by the digital camera according to the first embodiment. It is a flowchart which shows the flow until PC produces | generates a connection file in connection with a map image, acquiring a picked-up image in 1st Embodiment. It is a figure for demonstrating a connection file, (a) is a figure showing the connection file structure produced by making a captured image and a map image link | related, (b) is a figure showing the detailed structure of a picked-up image main body, (c) FIG. 4 is a diagram showing a detailed structure of APP1 (application marker segment). It is a figure showing a map image information list. It is a figure showing the correspondence table of the language number and language name of map image information. It is a figure showing the correspondence table of the file format number of map image information, and a file format kind. It is a figure for demonstrating the language setting in a digital camera, (a) is a figure which shows the back surface of the digital camera in the state where the language setting UI is displayed, (b) is the language number and language name in the language setting of a digital camera FIG. It is a flowchart which shows the flow until a digital camera displays a picked-up image, positional information, and a map image in 1st Embodiment. It is a figure for demonstrating reproduction | regeneration of the connection file with a digital camera, (a) is a figure which shows the display screen when a picked-up image is displayed, (b) is a display screen when displaying a picked-up image and position information (C) is a figure which shows a display screen when a picked-up image, position information, and a map image are displayed.

Preferred embodiments of the present invention will be described below with reference to the accompanying drawings.
<First Embodiment>
FIG. 1 shows a captured image processing system according to the first embodiment. The captured image processing system includes a digital camera 1 that is an example of an imaging apparatus, and a personal computer (hereinafter referred to as “PC”) 2 that is an example of an information processing apparatus that receives captured image data captured by the digital camera 1. Composed. The digital camera 1 and the PC 2 are connected using a communication path 3 such as a USB (Universal Serial Bus).

FIG. 2 shows the configuration of the digital camera 1.
The control device 200 includes a CPU and a ROM, and controls each unit of the digital camera 1 according to an input signal or program.
The subject image passes through the condenser lens 201, and the subject image captured by a CCD (Charge Coupled Device) 202 is converted into an electrical signal as an analog signal. Then, it is converted into a digital signal by the A / D converter 203. Hereinafter, a series of these processes is referred to as an imaging process. The photographing process is started by pressing a shutter button 4 included in the input device 207 described later.
A RAM (Random Access Memory) 204 temporarily stores data such as captured images and various parameters. The flash memory 206 is a storage medium for storing captured image data, a control program, and the like, and may be built in the digital camera 1 or detachable like a memory card.
An LCD (Liquid Crystal Display) 209 displays various GUIs (Graphical User Interfaces) such as captured images and information notified to the user. The VRAM 208 stores captured image data and the like to be displayed on the LCD 209.
The input device 207 is a member that is mainly operated by the user, and accepts user input for instructing the shutter button 4 (see FIG. 1) used at the time of shooting, image feed at the time of playing back a shot image, and the like. As the input device 207, a button, a lever, a wheel, a touch panel, or the like can be used.
The communication device 205 is an interface for connecting the digital camera 1 and the PC 2. The digital camera 1 can transmit captured image data to the PC 2 via the communication device 205.
The GPS receiver 210 receives a signal from a GPS satellite if the GPS reception setting is ON at the time of photographing with the digital camera 1. The control device 200 calculates position information from a signal from a GPS satellite, and adds the calculated position information to the captured image data.

FIG. 3 shows the configuration of the PC 2. The PC 2 includes a CPU 300, a hard disk device (hereinafter referred to as “HDD”) 301, a RAM 302, an input device 303, a VRAM 304, a display device 305, and a communication device 306.
The PC 2 can take captured image data held by the digital camera 1 from the digital camera 1 via the communication device 306.
As the input device 303, a pointing device such as a keyboard or a mouse can be used.
The HDD 301 stores various data such as photographed image data received from the digital camera 1, a map image database associated with the photographed image, a program for controlling the PC 2, and the like. An application (hereinafter referred to as “PC application”) for transferring and displaying a captured image in the present embodiment is also stored in the HDD 301.
Although the input device 303 and the display device 305 are described as components of the PC 2, they may be connected to the PC 2 as external devices and the CPU 300 may control them.

  In the present embodiment, a USB cable is used as the communication path 3 when transferring captured image data from the digital camera 1 to the PC 2, but the communication path 3 is not necessarily limited to wired communication. For example, wireless communication such as a wireless LAN represented by IEEE 802.11b may be used. Alternatively, communication may be performed via the Internet. In this case, communication between the digital camera 1 and the PC 2 is performed, for example, by a method according to the Hypertext Transfer Protocol. By using wireless communication in this way, the degree of freedom of arrangement of both devices is increased, and convenience is further improved. When the flash memory 206 is a removable SD card or the like, a method may be used in which a captured image is stored in the SD card and the captured image is sent to the PC 2 by replacing the SD card with the PC 2.

FIG. 4 is a flowchart showing the flow of processing when the digital camera 1 captures an image. Each process of this flowchart is realized by the control device 200 of the digital camera 1 loading, developing, and executing a program recorded in the flash memory 206 in the RAM 204. Further, the processing of this flowchart is started in response to an imaging instruction input by operating the shutter button 4 of the input device 207 of the digital camera 1, for example.
In step S400, the control device 200 executes shooting processing and generates shot image data.
Next, in step S401, the control device 200 determines whether or not the reception setting of the GPS receiver 210 is ON. If the control device 200 determines that the reception setting of the GPS receiver 210 is ON, the process proceeds to step S402. On the other hand, when the control device 200 determines that the reception setting of the GPS receiver 210 is OFF, the process proceeds to step S404. The process of step S404 will be described later.
In step S402, control device 200 determines whether or not a signal from a GPS satellite can be received. If the control device 200 determines that the signal from the GPS satellite can be received, the process proceeds to step S403. If the control device 200 determines that the signal from the GPS satellite cannot be received, the process proceeds to step S403. The process proceeds to S404.
In step S403, the control device 200 calculates position information from a signal from a GPS satellite, and adds the calculated position information to the captured image data generated in step S400.
In step S404, the control device 200 stores the captured image data to which the position information is added in step S403 in the flash memory 206.

  FIG. 5 is a flowchart showing a flow from when the PC 2 acquires captured image data to create a linked file in association with a map image. The processing of this flowchart is realized by the CPU 300 of the PC 2 executing the PC application read from the HDD 301. Further, the processing of this flowchart is started in response to receiving an instruction to import a captured image held by the digital camera 1 into the PC 2 by the PC application while the digital camera 1 and the PC 2 are connected. .

  In step S <b> 501, the CPU 300 captures captured image data recorded in the digital camera 1 into the HDD 301. Specifically, the CPU 300 requests the digital camera 1 to transmit the captured image held by the digital camera 1 to the PC 2. In response to this, the digital camera 1 transmits the captured image data stored in the flash memory 206 to the PC 2. The PC 2 receives the transmitted captured image data and stores the captured image data in the HDD 301 to capture the captured image from the digital camera 1. The CPU 300 that executes the process of this step is an example of an image acquisition unit.

In step S502, the CPU 300 determines whether or not position information is added to the captured image data acquired in step S501. If the CPU 300 determines that position information is added to the captured image data, the process proceeds to step S503. If the CPU 300 determines that position information is not added to the captured image data, the process proceeds to step S506. move on.
First, the case where it progresses to step S503 is demonstrated.
In step S <b> 503, CPU 300 searches for a map image corresponding to the position information from the map database recorded in HDD 301. Here, for each of a plurality of languages, a map image having a predetermined scale (that is, a predetermined range) centered on the position information added to the captured image data is searched as a corresponding map image. For example, for seven types of map images of Japanese, English, Korean, Italian, French, Chinese, and Arabic, a map image with a scale of 1/10000 is searched centering on position information added to each image. . This scale may be set in advance by the user. Alternatively, it may be hard coded. If it is determined that there is a map image, the process proceeds to step S504. If it is determined that there is no map image, the process proceeds to step S506.

In step S504, the CPU 300 reads the corresponding map image from the map database. The CPU 300 that executes the processing of this step is an example of a map acquisition unit.
In step S505, the CPU 300 combines all the map image data read out in step S504 and the captured image data acquired in step S501 into one file to generate a linked file.
In step S506, the CPU 300 stores the concatenated file generated in step S505 in the HDD 301. If no position information is added in step S502 or no map image is found in step S503, the captured image data acquired in step S501 is stored in the HDD 301 without combining the map image and the captured image data. To do.

Next, the linked file generated by the above procedure will be described. The linked file in this embodiment is a file recorded in a format according to the so-called multi-picture format standard.
FIG. 6A (a) shows the structure of a linked file created by associating captured image data with map image data. FIG. 6A (b) shows the detailed structure of the captured image main body of FIG. 6A (a), and has the same structure as Exif JPEG. FIG. 6A (c) shows the detailed structure of APP1 (application marker segment) of FIG. 6A (b).
FIG. 6B shows a list of map image information. FIG. 6C is a correspondence table between the language numbers 610 and the language names 615 of the map image information of FIG. 6B. 6D is a correspondence table between the file format number 612 and the file format type 616 of the map image information in FIG. 6B.

As shown in FIG. 6A (a), the concatenated file is a file in which the photographed image main body 601 and map image data 602 for a plurality of languages are concatenated. In FIG. 6A (b), SOI 603 indicates the start position of JPEG, and EOI 606 indicates the end position. APP1 604 represents an application marker segment, and is a segment for recording Exif attached information. The compressed data 605 stores compressed image data of the captured image main body 601, so-called thumbnails.
In FIG. 6A (c), 607 represents 0th IFD. In the 0th IFD 607, information about various Exif such as the Exif IFD 608 and the GPS IFD 609 is stored. The Exif IFD 608 is a collection of tags for describing Exif-specific attached information. The GPS IFD 609 is a collection of tags for describing GPS information, and the position information acquired by the GPS receiver 210 is stored here.

  The map image information in FIG. 6B includes a language number 610, a map image data size 611, a file format number 612, map image offset information 613, and latitude / longitude information 614. These pieces of information are stored in the Exif IFD 608 in FIG. 6A (c). The language number 610 in FIG. 6B is the same as the language number 610 in FIG. 6C, and the language associated with each language number is a language name 615. The map image data size 611 represents the data size of each map image in KB (kilobyte) units. The file format number 612 represents the file format number of each map image. The file format number 612 in FIG. 6B is the same as the file format number in FIG. 6D, and the file format associated with each file format number is the file format type 616. The map image offset information 613 indicates the number of KB (kilobytes) where each map image data exists from the end of the EOI 606 in KB (kilobyte) units. Latitude / longitude information 614 represents the upper left and lower right latitude and longitude of each map image.

Next, a procedure for writing back the linked file generated by the above procedure to the digital camera 1 and reproducing the linked file by the digital camera 1 will be described.
Prior to description of linked file playback, language setting in the digital camera 1 will be described first.
FIG. 7A is a diagram illustrating an example of the back surface of the digital camera 1 including the LCD 209 and the input device 207, and shows a state in which a language setting UI is displayed. In this example, a playback button 701, a determination button 702, a display button 703, a wheel button 704, and a menu button 705 are mounted as the input device 207. FIG. 7B is a correspondence table of language numbers and language names in the language setting of the digital camera 1. When the menu button 705 in FIG. 7A is pressed, various camera setting screens are displayed. When “Language setting” is selected with the wheel button 704 from among various camera settings and determined with the determination button 702, a language setting screen 706 is displayed on the LCD 209. When the language used on the language setting screen 706 is selected with the wheel button 704 and the enter button 702 is pressed, the set language is reflected as an internal setting of the camera, and the characters displayed on the UI are expressed in the language set here. Will be. Note that the language number 707 corresponding to the language name 708 of FIG. 7B selected and determined here is stored in the RAM 204 of the digital camera 1. The language name 708 is selected on the language setting UI, but the language number 707 is used in processing such as internal storage.

  Next, a description will be given of the playback of linked files with the digital camera 1 in a state where a predetermined language is set in advance by the above-described language setting procedure. Assume that the linked file saved in the HDD 301 in step S506 of FIG. 5 is saved in the flash memory 206 of the digital camera 1 through the communication path 3 prior to the playback of the linked file. The user can play back the linked file stored in the flash memory 206 by pressing a play button included in the input device 207, for example. As a result, for example, a screen 901 as shown in FIG. 9A is displayed on the LCD 209. In FIG. 9A, the same components as those in FIG. 7A are denoted by the same reference numerals. The processing of the flowchart shown in FIG. 8 is started in response to detection of pressing of the display button 703 in a state where this screen is displayed.

FIG. 8 is a flowchart showing a flow until the digital camera 1 displays a captured image, position information, and a map image. Each process of this flowchart is realized by the control device 200 of the digital camera 1 loading, developing, and executing a program recorded in the flash memory 206 in the RAM 204.
In step S801, the control device 200 determines whether or not position information is added to the captured image data displayed on the captured image display screen 901. If position information has been added, the process proceeds to step S802. When position information is not added, the process of this flowchart is terminated with the display of the captured image display screen 901 of FIG.

  In step S802, the control device 200 additionally displays the position information added in step S801. As a result, for example, a screen as shown in FIG. 9B is displayed. At this time, the captured image on the captured image display screen 901 displayed in FIG. 9A is reduced and displayed in the region of the captured image display area 907 in FIG. 9B. A position information display area 908 is set in the empty space, and position information is displayed in this area.

  When pressing of the display button 703 is detected again, the control device 200 confirms the language number 707 stored in the RAM 204 and identifies the set language in step S803.

In step S804, the control device 200 determines whether or not a map image corresponding to the set language specified in step S803 is in the linked file. If there is a map image corresponding to the set language, the process proceeds to step S805. If there is no map image corresponding to the set language, the process proceeds to step S809.
In step S809, the control apparatus 200 extracts the map image offset 613 corresponding to English from the Exif IFD 608, and proceeds to step S806. In this embodiment, when there is no map image corresponding to the set language, the control device 200 automatically selects a map image corresponding to English as a default setting.
On the other hand, in step S805, the control device 200 extracts the map image offset 613 corresponding to the set language from the Exif IFD 608.

In step S806, the control device 200 identifies the recording location of the map image data in the linked file based on the information of the offset 613 extracted in steps S805 and S809.
In step S807, the control device 200 sets a map image display area 909 and displays a map image, as shown in FIG. 9C.

  In step S808, the control device 200 extracts the latitude / longitude information 614 on the upper right and lower left of the map image specified in step S806 from the Exif IFD 608, and calculates which position of the map image the shooting position is. Based on the calculated position on the map, a shooting position display pin 910 indicating the shooting position of the shot image is displayed on the map as shown in FIG. 9C. Thereby, the user can grasp intuitively which position on the map the photographing position of the photographed image is. In FIG. 9A, FIG. 9B, and FIG. 9C, the screen can be switched by the display button 703.

  In the present embodiment, a plurality of map images based on position information included in the captured image and the captured image are combined to generate a single file. Thus, as long as the multi-picture format is supported, it is possible to intuitively grasp the shooting position without having a map image database or a communication function.

<Other embodiments>
In the above-described embodiment, the example in which the linked file is created by executing the PC application by the PC 2 has been described. This is not limited to PC2. For example, as the PC 2, a digital camera, a mobile phone, or a so-called tablet device may be used.
In the above-described embodiment, an example in which captured image data to which position information is added is generated by a digital camera has been described. For example, the PC 2 may include an imaging unit and a GPS receiver, and the PC 2 may generate captured image data, calculate position information, and add position information to the captured image data.
In addition, the display of the linked file is performed on the digital camera, but the display can be performed not only on the digital camera but also on other devices.
In addition, a plurality of map images are connected at the time of creating the connection file, but the user can select whether to use one or a plurality of map images as necessary.
Moreover, although the information of each map image is stored in APP1 604 in a picked-up image, it is not restricted to APP1. For example, a method is also conceivable in which each map image file format is unified to JPEG, each Exif compressed file is prepared, and each map image information is stored in each APP1.
In addition, the map image database is prepared in the HDD 301, but a method of applying to a system for downloading by referring to an external network is also conceivable.

  In addition to the above-described embodiment, a plurality of scale map images may be collected for each language as a linked file. For example, among Japanese map images, map images of different scales with the shooting position as the center, for example, three map images of 1/100, 1/1000, and 1/10000 of a predetermined range are prepared. Similarly, for map images in other languages, three map images of 1/100, 1/1000, and 1/10000 of a predetermined range centering on the shooting position are prepared, and each map image is collected together with the shot images. Into one concatenated file. In this case, at the time of reproduction, a plurality of scale maps can be switched according to a user instruction. With this configuration, it is possible to handle the map database as if it is mounted, and usability is further improved.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

Claims (16)

Image acquisition means for acquiring captured image data including position information indicating a shooting position;
Map acquisition means for acquiring a plurality of map image data based on position information included in the captured image data acquired by the image acquisition means;
A generation unit that generates a single file by collecting the captured image data acquired by the image acquisition unit and the plurality of map image data acquired by the map acquisition unit;
The information processing apparatus, wherein the plurality of map image data includes map image data of a plurality of languages.   2. The information processing apparatus according to claim 1, wherein the plurality of map image data acquired by the map acquisition unit indicate shooting positions of corresponding captured image data at a plurality of scales for each language. A communication means for communicating with an external device;
The information processing apparatus according to claim 1, wherein the communication unit transmits the file generated by the generation unit to the external device.   The information processing apparatus according to claim 3, wherein the map acquisition unit acquires the map image data by receiving the map image data from an external device via the communication unit.   The information processing apparatus according to claim 3, wherein the communication unit communicates with an external apparatus according to a Hypertext Transfer Protocol.   The said image acquisition means acquires the said picked-up image data by receiving the said picked-up image data from an external device via the said communication means, The any one of Claim 3 thru | or 5 characterized by the above-mentioned. Information processing device. Photographing means for photographing a subject and generating photographed image data;
Determining means for determining position information indicating a photographing position of the photographed image data;
An additional means for adding the position information determined by the determination means to the captured image data generated by the imaging means as an imaging position;
6. The image acquisition unit according to claim 3, wherein the image acquisition unit acquires captured image data including position information indicating the shooting position by adding the position information to the captured image data by the adding unit. The information processing apparatus according to any one of claims. A receiving means for receiving a signal from a GPS satellite;
The information processing apparatus according to claim 7, wherein the determination unit determines position information based on a signal received by the reception unit.   9. The information processing apparatus according to claim 1, wherein the captured image data is data in a format according to an EXIF standard.   The information processing apparatus according to claim 1, wherein the file generated by the generation unit is a file in a format in accordance with a multi-picture format standard. Selecting means for selecting any one of a plurality of languages;
Reproducing means for reproducing a file in which photographed image data obtained by photographing a subject, map image data in a plurality of languages, and position information indicating the photographing position of the photographed image data are combined. ,
The reproduction apparatus controls the display of map image data corresponding to the language selected by the selection means from among the map image data included in the file.   The playback device according to claim 11, further comprising each unit of the information processing device according to claim 1. A method for controlling an information processing apparatus,
An image acquisition step of acquiring captured image data including position information indicating a shooting position;
A map acquisition step of acquiring a plurality of map image data based on position information included in the captured image data acquired in the image acquisition step;
A step of generating a single file by combining the captured image data acquired in the image acquisition step and the plurality of map image data acquired in the map acquisition step;
The method of controlling an information processing apparatus, wherein the plurality of map image data includes map image data of a plurality of languages. A control method of a playback device,
A selection step of selecting any one of a plurality of languages;
A reproduction step of reproducing a file in which photographed image data obtained by photographing a subject, map image data in a plurality of languages, and position information indicating a photographing position of the photographed image data are collected together;
The method for controlling a playback apparatus, wherein the playback step controls to display map image data corresponding to the language selected in the selection step among the map image data included in the file.   A computer-readable program for causing a computer to function as each unit of the information processing apparatus according to any one of claims 1 to 10.   A computer-readable program for causing a computer to function as each unit of the playback device according to claim 11 or 12.

Images