JP6914480B2 - Indicator display device, indicator display method, program, and indicator display system - Google Patents

Description

The present invention relates to a technique for grasping a situation when an image is taken.

Conventionally, by utilizing GPS (Global Positioning System) etc., self-position information at the time of shooting is acquired, and when the shot image is reproduced, a peripheral map including the position information at the time of shooting is displayed on the map. A technique for displaying the fact that the image was taken at the photographing point of the above has been considered (see, for example, Patent Document 1 below).

Japanese Unexamined Patent Publication No. 2006-279266

However, with this technology, although it is possible to show the user the past movement route and the shooting point at the same time on the map, it is not possible to tell the situation at the time of shooting at each shooting point. was there.

The present invention has been made in view of the above problems, and an object of the present invention is to make it easy to understand the situation at the time of shooting at the shooting point.

In order to solve the above-mentioned problems, in the index display device of the present invention, a position information acquisition means for acquiring position information related to image shooting, a shooting information acquisition means for acquiring predetermined information regarding image shooting, and the image shooting It is acquired by the external environment information acquisition means for acquiring information about the external environment of the imaging device, the generation means for generating an index image based on the predetermined information acquired by the shooting information acquisition means, and the position information acquisition means. An index indicating that the predetermined information is acquired at a display position corresponding to the position information, an index image generated by the generation means, and the external environment acquired by the external environment information acquisition means. The position information acquired by the position information acquisition means includes an altitude, and the display means includes an altitude of the position information based on an operation detection from the outside. A first display mode for displaying an index indicating that the predetermined information is acquired at a display position indicated by no information, the index image, and information on the external environment, and the position information include altitude. It is characterized in that it is displayed in any display mode of the second display mode in which an index indicating that the predetermined information is acquired is displayed at the display position indicated by the information.

Further, in the index display method of the present invention, a position information acquisition step for acquiring position information related to image shooting, a shooting information acquisition step for acquiring predetermined information regarding image shooting, and an external image pickup device that has captured the image. An external environment information acquisition step for acquiring information about the environment, a generation step for generating an index image based on the predetermined information acquired in the shooting information acquisition step, and a position information acquired in the position information acquisition step. The index indicating that the predetermined information is acquired at the display position corresponding to the above, the index image generated in the generation step, and the external environment acquired in the external environment information acquisition step. It is seen containing a display step of displaying information, the display unit, wherein the display step, based on the operation detection from the outside, the predetermined information on a display position indicated by the information that does not include a high degree of the positional information The predetermined information is acquired in a first display mode for displaying an index indicating that it is an acquired point, the index image, and information about the external environment, and a display position indicated by information including altitude in the position information. It is characterized in that it is displayed in any of the display modes of the second display mode for displaying the index indicating that the point is the designated point .

Further, in the program of the present invention, the computer is used as a position information acquisition means for acquiring position information regarding image capture, a capture information acquisition means for acquiring predetermined information regarding image capture, and an external environment of an image pickup device that captures the image. An external environment information acquisition means for acquiring information about, a generation means for generating an index image based on the predetermined information acquired by the shooting information acquisition means, and a display position corresponding to the position information acquired by the position information acquisition means. Display that displays an index indicating that the predetermined information is a point where the predetermined information is acquired, an index image generated by the generation means, and information about the external environment acquired by the external environment information acquisition means. The position information acquired by the position information acquisition means includes altitude, and the display means is set to a display position indicated by information not including altitude in the position information based on operation detection from the outside. The index indicating that the predetermined information is the acquired point, the first display mode for displaying the index image and the information about the external environment, and the display position indicated by the information including the altitude in the position information. It is characterized in that it is displayed in any display mode of the second display mode that displays an index indicating that the predetermined information is the acquired point.

Further, in the index display system of the present invention, a display device, a position information recording device that sequentially records position information while the carrier is moving, and acquires information on the external environment, and an imaging device carried by the carrier. In an index display system including The imaging information acquisition means acquired from the device, the external environment information acquisition means for acquiring information on the external environment of the image pickup device that captured the image from the position information recording device, and the predetermined information acquired by the imaging information acquisition means. By a generation means for generating an index image based on the above, an index indicating that the predetermined information is acquired at a display position corresponding to the position information acquired by the position information acquisition means, and the generation means. A display control means for controlling the display of the generated index image and the information about the external environment acquired by the external environment information acquisition means is provided, and the position information acquired by the position information acquisition means is highly advanced. The display control means includes, and an index indicating that the predetermined information is acquired at the display position indicated by the information not including the altitude among the position information based on the operation detection from the outside and the index. A first display mode for displaying an image and information about the external environment, and a second display for displaying an index indicating that the predetermined information is acquired at a display position indicated by information including altitude in the position information. It is characterized in that it displays in any of the display modes of 2.

According to the present invention, it is possible to easily understand the situation at the time of shooting at a shooting point during the past movement.

It is a block diagram which shows the structure of the index display system including the index display device which concerns on 1st Embodiment of this invention. It is a flowchart which shows the operation of a sensor device and a camera device while a user is moving. It is an explanatory diagram showing the relationship between the trigger output condition of the sensor device and the shooting mode of the camera device. It is a flowchart which shows the operation of the index display device when the image processing program is started, and the operation of the corresponding camera device. It is a flowchart following FIG. It is a flowchart which shows the operation of the sensor device corresponding to FIG. It is a conceptual diagram explaining the log table which is stored in the storage part while the image processing program is started. It is a figure which shows the display form of the user's action history and the recorded information such as an image in an index display device. It is a figure which shows the content of the processing processing condition table in 2nd Embodiment. It is a conceptual diagram explaining the log table stored in the storage part in 2nd Embodiment. It is a flowchart which shows the operation of the index display device when the image processing program in 2nd Embodiment is started. It is a part of the flowchart following FIG. It is a figure which shows the display form of the cover data in the index display device in 2nd Embodiment. It is a figure which shows the display form of the user's action history and the record information such as an image in the index display device in 2nd Embodiment.

(First Embodiment)
Hereinafter, the first embodiment of the present invention will be described. FIG. 1 is a block diagram showing a configuration of an index display system including an index display device 100 according to the first embodiment of the present invention. This index display system includes an index display device 100, a camera device 200, and a sensor device 300 that can communicate with each other.

First, the camera device 200 will be described. The camera device 200 is a small digital camera capable of still image shooting, moving image shooting, and voice recording while the user is attached to the body or the like, and is a control unit 201 that controls the operation of the entire device and an imaging unit 203. , Recording unit 204, voice input unit 205, wireless communication unit 206, and input unit 207.

The control unit 201 is composed of a CPU (Central Processing Unit), peripheral circuits, etc., working memory such as RAM (Random Access memory), program memory, etc., and the CPU operates according to a program stored in the program memory. By doing so, each part of the camera device 200 is controlled. The control unit 201 includes a timekeeping means having a calendar function for acquiring the shooting date and time.

The image pickup unit 203 includes an image pickup element such as a CMOS (Complementary Meta10xide Semiconductor) or a CCD (Charge Coupled Device) that images a subject via an imaging optical system (not shown), a drive circuit thereof, and an analog signal output from the image pickup element. Is composed of a signal processing circuit or the like that converts the image data into digital format image data, and supplies this image data to the control unit 201. The photographing optical system of the camera device 200 is composed of one or a plurality of wide-angle lenses capable of photographing the entire sky around 360 °.

The image data supplied to the control unit 201 is subjected to various image processing by the control unit 201, then compressed, and various additional information such as the shooting date and time and thumbnail images are added to the still image file in a predetermined format. It is recorded in the recording unit 204 as a moving image file. The recording unit 204 is composed of, for example, a rewritable non-volatile memory such as a flash memory built in the camera device 200, and various memory cards that can be attached to and detached from the device body.

Here, the camera device 200 has, as a lower mode of the still image shooting mode, a portrait shooting, a landscape shooting, a continuous shooting in which a predetermined number of shots are continuously taken, and an all-sky circumference having a surrounding 360 ° range as a shooting target. There are multiple shooting modes available, including shooting, etc. Further, as the moving image shooting mode, a plurality of kinds of moving image shooting modes including normal movie shooting and shooting only for a short time (for example, 10 seconds) are prepared. Then, when the image data is stored in the recording unit 204 as a still image file or a moving image file, other additional information such as the shooting mode used at the time of shooting and the shooting date and time are added and stored in these files together with the image data. Will be done.

The voice input unit 205 is composed of a microphone built in the main body of the device, an amplifier, and an A / D converter, converts surrounding voice input to the microphone into voice data, and supplies the voice data to the control unit 201. The audio data supplied to the control unit 201 is encoded by the control unit 201, and then added to the moving image data and recorded as a moving image file at the time of moving image shooting.

The camera device 200 is provided with a recording mode for recording only voice as an operation mode. In the recording mode, the voice data encoded by the voice input unit 205 is added with additional information such as the recording date and time, and is independent. It is recorded in the recording unit 204 as an audio file. The coded audio data recording method at the time of moving image shooting may be a method of recording in relation to the moving image file separately from the moving image file.

The wireless communication unit 206 performs wireless communication with the index display device 100 and the sensor device 300. In particular, the wireless communication unit 206 transmits the still image file, the moving image file, and the audio file recorded in the recording unit 204 to the index display device 100 as needed. The wireless communication technology adopted in the wireless communication unit 206 is, for example, a technology compliant with Wi-Fi (registered trademark) to which the international standard IEEE 802.11 series is applied, or Bluetooth (registered trademark) (including Bluetooth Low Energy). be. The wireless communication unit 206 can be changed to a communication means that employs other communication technologies, not limited to wired and wireless, as long as communication between the index display device 100 and the sensor device 300 is possible.

The input unit 207 includes a shooting mode setting switch, a shutter button, and the like, and supplies operation information by the user to the control unit 101.

Next, the sensor device 300 will be described. The sensor device 300 is a so-called data logger that is used in a state of being worn on the body of the user such as the shoulder, arm, and waist of the user, and sequentially acquires various data related to the user's behavior history and records them.

As shown in the figure, the sensor device 300 includes a control unit 301 that controls the operation of the entire device, a position information acquisition unit 302, a motion sensor unit 303, an external environment acquisition unit 304, an action history storage unit 305, and a wireless communication unit 306. It has each part of.

The control unit 301 is composed of a CPU and its peripheral circuits, work memory such as RAM, a program memory, and the like, and controls each part of the sensor device 300 by operating the CPU according to a program stored in the program memory. do.

The position information acquisition unit 302 measures the current position using a known GPS (Global Positioning System), and supplies the measurement result, that is, GPS data consisting of latitude, longitude, and altitude to the control unit 301.

The motion sensor unit 303 is composed of an acceleration sensor that detects acceleration in the three-axis direction, a gyro sensor that detects the angular velocity in the three-axis direction, an amplifier that amplifies the detection signal, and an A / D converter. Axial acceleration information and angular velocity information are supplied to the control unit 301.

The external environment acquisition unit 304 is composed of a temperature sensor, a pressure sensor, and a humidity sensor that detect the ambient temperature, pressure, and humidity of the sensor device 300, and an amplifier and an A / D converter that amplify the detection signals of each sensor. , Each of the detected temperature, pressure, and humidity data (hereinafter referred to as external environment data) is supplied to the control unit 301.

The action history storage unit 305 is composed of a rewritable non-volatile memory such as a flash memory built in the sensor device 300, and stores action history data including GPS data and external environment data supplied to the control unit 301. .. The action history data also includes user step count data counted by the control unit 301 based on the acceleration information and the angular velocity information acquired by the motion sensor unit 303.

The wireless communication unit 306 performs wireless communication with the index display device 100 and the camera device 200. In particular, the wireless communication unit 306 transmits the action history data (GPS data and external environment data) stored in the action history storage unit 305 to the index display device 100. The wireless communication technology adopted in the wireless communication unit 306 also includes, for example, Wi-Fi (registered trademark) or Bluetooth (registered trademark) (including Bluetooth Low Energy) (registered trademark) to which the international standard IEEE 802.11 series is applied. It is a compliant technology. Further, the wireless communication unit 306 can also be changed to a communication means adopting other communication technologies, not limited to wired and wireless, as long as communication between the index display device 100 and the camera device 200 is possible.

Next, the index display device 100 will be described. The index display device 100 displays a still image based on a map on which a user's movement route is superimposed and a still image file acquired from the camera device 200 based on GPS data acquired from the sensor device 300, and is based on a moving image file. It is a device equipped with a function to play and display moving images.

As shown in the figure, the index display device 100 includes a control unit 101 that controls each unit of the device, a first wireless communication unit 102, a second wireless communication unit 103, a storage unit 104, an audio output unit 105, and a display unit. Each part of 106 and input part 107 is provided.

The control unit 101 is composed of a CPU, peripheral circuits, and the like, a work memory such as a RAM, and the like, and controls each part of the index display device 100 by operating the CPU according to a program stored in the storage unit 104. ..

The first wireless communication unit 102 performs wireless communication with the camera device 200 and the sensor device 300. In particular, the first wireless communication unit 102 receives the above-mentioned action history data from the sensor device 300 and the above-mentioned still image file, moving image file, or audio file from the camera device 200, respectively. The wireless communication technology adopted in the first wireless communication unit 102 also conforms to, for example, Wi-Fi (registered trademark) to which the international standard IEEE 802.11 series is applied, or Bluetooth (registered trademark) (including Bluetooth Low Energy). It is a technology that has been used. Further, the first wireless communication unit 102 may be changed to a communication means adopting other communication technologies, not limited to wired and wireless, if communication with the camera device 200 and the sensor device 300 is possible. can.

The second wireless communication unit 103 communicates with an external map server 400 having the map database 401 based on TCP / IP (Transmission Control Protocol / Internet Protocol), and stores the data in the map database 401 via the Internet 500. Receive the map data of the specified area. The connection to the Internet 500 by the second wireless communication unit 103 is performed via, for example, a commercial communication line network (mobile phone line or the like) or a wireless base station such as a public LAN.

The storage unit 104 is composed of a rewritable non-volatile memory such as a flash memory built in the index display device 100, and stores basic programs and various application programs necessary for operation control of the index display device 100. The various application programs include the movement path of the user wearing the camera device 200 and the sensor device 300, an image processing program for processing the still image file and the moving image file recorded in the camera device 200, and exercise. Includes an analysis program.

Further, various data received from the sensor device 300 and the camera device 200 are temporarily stored in the storage unit 104, and various data described later are stored by the control unit 101. In addition, the log table 1041 described later is also stored.

The audio output unit 105 includes a D / A (digital-to-analog conversion) converter, an amplifier, a speaker, etc. that convert the audio data contained in the audio file into an analog audio signal, and reproduces the audio data received from the camera device 200. do.

The display unit 106 includes a liquid crystal panel and a drive circuit thereof, and displays an operation screen used for operating the index display device 100, a peripheral map described later, a still image, a moving image, or the like received from the camera device 200.

The input unit 107 is composed of an operation button for the user to operate the index display device 100 and a touch panel integrally provided on the surface of the liquid crystal panel of the display unit 106, and sends operation information by the user to the control unit 101. Supply.

The index display device 100 can be realized by, for example, a smartphone or a tablet-type portable information device. In that case, the index display device 100 is used to perform voice communication and data communication in addition to the above configuration. Well-known circuits, that is, an audio input circuit that modulates and transmits the input audio, a transmission circuit, a reception circuit that receives and decodes and reproduces the received audio signal, a reproduction circuit, a data transmission / reception circuit, and the like. Become.

In the index display system having the above configuration, for example, while the user is moving during mountain climbing or hiking, the camera device 200 and the sensor device 300 can be attached, operated, and communicated with each other by a predetermined operation. In this state, the camera device 200 and the sensor device 300 operate as described later. Here, the camera device 200 is provided with a predetermined operation mode (hereinafter, interlocking mode) in which interval shooting is performed after a certain period of time and automatic shooting or automatic recording is performed in response to a request from the sensor device 300 during that period. It is assumed that communication with the sensor device 300 is established by setting the mode.

FIG. 2 is a flowchart showing the operation of the camera device 200 based on the processing of the control unit 201 and the operation of the sensor device 300 based on the processing of the control unit 301 when the interlocking mode is set.

First, the operation of the sensor device 300 will be described. The sensor device 300 starts operation by detecting the power-on, and first, various information such as GPS data is acquired by the position information acquisition unit 302, the motion sensor unit 303, and the external environment acquisition unit 304 (step SA1). The various acquired information is recorded as action history data (step SA2). Further, when the power-on is detected, the communication between the sensor device 300 and the camera device 200 may be established as a background process.

Further, when the acceleration information exceeds a predetermined threshold value among the various acquired information and the angular velocity information satisfies a certain condition (step SA3: YES), the sensor device 300 adds the excess acceleration information as a step. And record (step SA4). The step count data generated after the addition is recorded as one record together with other action history data recorded in the process of the immediately preceding step SA2.

On the other hand, the sensor device 300 sequentially determines whether or not the situation at the current processing timing corresponds to a predetermined trigger output condition (shooting control condition) (step SA5). Here, the predetermined trigger output conditions are determined by the number of steps, the acceleration information acquired by the motion sensor unit 303, the angular velocity information, and the GPS data, and are four types shown in FIG. Is.

That is, the current position indicated by GPS data did not change, and the state continued for a certain period of time (“stop for a certain period of time” in the figure), and the number of steps reached the set value (“the number of steps is set” in the figure. (Value "), the value of acceleration changes beyond the range of change over the most recent fixed time, and the amount of change exceeds the threshold at which it can be judged that the user has made a sudden movement (in the figure," sudden movement is Yes "), and the altitude of the current position indicated by GPS data has reached the set value ("altitude is the set value" in the figure).

Here, if the status at the current processing timing does not correspond to the predetermined trigger output condition (step SA5: NO), the sensor device 300 immediately returns to the processing of step SA1 and performs the subsequent processing. repeat.

On the other hand, when the situation at the current processing timing corresponds to a predetermined trigger output condition (step SA5: YES), the sensor device 300 wirelessly requests the camera device 200 to take a picture. Output the signal (step SA6). This predetermined trigger signal is a signal including a trigger ID (any of "01", "02", "03", and "04") indicating a trigger output condition determined to be applicable at that time. After that, the sensor device 300 returns to the process of step SA1 and repeats the subsequent processes.

That is, the sensor device 300 sequentially acquires various information such as GPS data, counts the number of steps, and repeats the process of recording them. In the meantime, a situation corresponding to a predetermined trigger output condition arrives. A trigger signal is output to the camera device 200 each time.

On the other hand, in the camera device 200, after the interlocking mode is set and the operation is started, the operation of measuring the interval time for acquiring the shooting timing required for the interval shooting is repeated (not shown), and the interval Every time the shooting timing of shooting arrives (step SB1: YES), a still image is automatically shot and the still image file is recorded in the recording unit 204 (step SB3). At this time, information indicating the type of recording operation (here, interval shooting) is added to the still image file together with other additional information such as the shooting mode used at the time of shooting and the shooting date and time.

Further, even before the shooting timing arrives (step SB1: NO), the camera device 200 takes a picture and records a still image file or a moving image file when the user detects a shooting instruction (step SB2: YES). (Step SB3). The shooting according to the shooting instruction of the user is a still image shooting or a moving image shooting in an arbitrary shooting mode set in advance by the user. Further, at this time, information indicating the type of recording operation (here, manual shooting) is added to the still image file or the moving image file together with other additional information such as the shooting mode used at the time of shooting and the shooting date and time.

Further, when the camera device 200 receives the trigger signal described above from the sensor device 300 (step SB4: YES), the camera device 200 responds to conditions such as the type of trigger indicated by the trigger ID and a predetermined shooting mode. Perform shooting processing and recording processing (step SB5).

Specifically, as shown in FIG. 3, when the trigger ID is "01", the still image shooting is performed in the all-sky mode, and when the trigger ID is "02", the still image shooting process is performed in the portrait shooting mode. When the trigger ID is "04", the still image shooting process in the landscape shooting mode is performed.

Further, when the trigger ID is "03", the recording operation is performed according to the mode condition at that time. That is, when the brightness at that time is equal to or higher than the threshold value and there is no moving object within the angle of view, a moving image shooting process using a short movie is performed. If the brightness at that time is equal to or higher than the threshold value and there is a moving object within the angle of view, the still image shooting process is performed in the continuous shooting mode. If the brightness at that time is less than the threshold value, the recording process is performed. In the process of step SB5, the brightness at that time is detected from the image obtained by the imaging unit 203, and the presence or absence of a moving object within the angle of view is also determined by the image of a plurality of frames obtained by the imaging unit 203. ..

Then, the camera device 200 records the still image file, the moving image file, and the audio file acquired in the shooting process and the recording process of step SB5 in the recording unit 204 (step SB6). At this time, information indicating the type of recording operation (here, automatic shooting according to the trigger signal) is added to the still image file and the moving image file together with other additional information such as the shooting mode used at the time of shooting and the shooting date and time. Will be done. Further, information indicating the type of the recording operation (here, automatic recording according to the trigger signal) is added to the audio file together with other additional information such as the recording date and time. After that, the camera device 200 returns to the process of step SB1 and repeats the subsequent processes.

Next, the operation of the index display device 100 will be described. In the index display device 100, the user uses an image processing program to display the movement path of the user wearing the camera device 200 and the sensor device 300, an arbitrary captured image recorded on the camera device 200, and the like. You can check.

4 to 6 are flowcharts showing the operation of the index display device 100 when the image processing program is started by the user, and the corresponding operations of the camera device 200 and the sensor device 300. More specifically, it is a figure which showed the process of each control part 101, 201, 301 in an index display device 100, a camera device 200, and a sensor device 300.

As shown in FIG. 4, when the index display device 100 activates the image processing program, it first requests the camera device 200 to transmit information at the time of recording a still image file, a moving image file, and an audio file. A signal is transmitted (step SC101). On the other hand, when the camera device 200 receives the inquiry signal (step SB101: YES), the camera device 200 simultaneously transmits the information at the time of recording the still image file, the moving image file, and the audio file stored in the recording unit 204 to the index display device 100. Transmit (step SB102). The information at the time of recording to be transmitted is the file name, shooting date and time, shooting mode, and recording operation type for still image files and video files, and the file name, recording date and time, and recording operation type (automatic) for audio files. Or manual).

Next, the index display device 100 receives and stores the information at the time of recording from the camera device 200 (step SC102), confirms the type of recording operation for each image and the like, and transmits the information from the sensor device 300 into them. It is confirmed whether or not there is something recorded by receiving the triggered signal (step SC103).

Here, if there is a corresponding image or the like (step SC103: YES), the index display device 100 confirms whether or not the latest action history is stored, and if it is not stored (step SC4: NO), the motion analysis is performed. Start the program (step SC105). The motion analysis program acquires the action history data (GPS data, external environment data, step count data) recorded in the sensor device 300, and based on the acquired action history data, when the sensor device 300 is worn. It is a program that analyzes the movement of the user.

Then, the index display device 100 transmits an inquiry signal requesting transmission of action history data including GPS data to the sensor device 300 by a part of the functions realized by the processing of the control unit 101 according to this motion analysis program. (Step SC106). Here, the action history data requested to be transmitted to the sensor device 300 is the data of one or a plurality of specific records corresponding to the image or the like recorded by the trigger signal, that is, the data recorded at the time of recording the image or the like. .. However, the data of all records may be acquired as the action history data.

At that time, as shown in FIG. 6, when the sensor device 300 receives this inquiry signal (step SA101: YES), the sensor device 300 stores the action history data (data of the requested record) stored in the action history storage unit 305. It is transmitted to the index display device 100 (step SA102).

Then, after receiving the action history data from the sensor device 300 (step SC107), the index display device 100 records the still image file, the moving image file, and the audio file recorded by the trigger signal in the received action history data. The time information (shooting date / time, recording date / time) and the GPS data measured at the same date / time are associated with each other and stored in the log table 1041 of the storage unit 104 (step SC108).

Further, as shown in FIG. 5, the index display device 100 stores the icon image and the composite character in the storage unit 104 in relation to the information at the time of recording the still image file, the moving image file, and the audio file (step SC109). ). Here, the icon image is an image prepared in advance in the image processing program, and is an image corresponding to the shooting mode of the camera device 200 at the time of recording the image or the like. Specifically, the still image file and the moving image file are images prepared for each shooting mode at the time of recording, and the audio file is an image showing the recording operation. Note that these icon images are not prepared in advance, and the shooting mode may be grasped from the profile data of the still image file, the moving image file, or the audio file, and the optimum icon image may be generated. Further, the composite character is a character generated based on the trigger output condition (see FIG. 3) indicated by the trigger ID included in the shooting mode and the action history data in each image or the like recorded by the trigger signal.

FIG. 7 is a diagram showing the stored contents of the log table 1041 in the storage unit 104 by the above processing. In the figure, information such as images (linked still image files, video files, audio file file names), GPS data, icon images (file names), and composite characters that are stored in relation to each other. An example is shown for convenience with the shooting mode used to determine the icon image, the trigger ID used to determine the composite character together with the shooting mode, and the sensor value (including the number of steps) at the time of recording the image or the like. Is. Note that the GPS data in the figure is shown for convenience, and here, it is data indicating each of the specific points "A" to "N".

Here, the contents of the composite characters stored in the storage unit 104 in the process of step SC109 will be described. The data of the record corresponding to the trigger ID "01" includes the GPS data at the point "B" and the sensor value. Since the acceleration is less than the threshold value and there is a high possibility that the user is stopped at the place where the GPS data is received, the composite character "Stop!" Is stored.

Further, in the data of the record corresponding to the trigger ID corresponding to the image or the like "02", since the step count data counted 1000 steps at the GPS data point "C", the composite character "1000 steps!" Is displayed. Be remembered.

Further, in the data of the record whose trigger ID corresponding to the image or the like corresponds to "03", the acceleration data is equal to or higher than the threshold value at the GPS data point "K", so that the user is looking around. Judging as a state, the composite character "View!" Is stored.

Further, in the data of the record whose trigger ID corresponding to the image or the like corresponds to "04", the altitude of 400 m is recorded in the sensor value (altitude data) transmitted from the sensor device 300 at the GPS data point "L". Therefore, the composite character "400M!" Is stored.

Subsequently, the index display device 100 connects to the external map server 400, and maps data in a range including the positioning location corresponding to the plurality of GPS data included in the action history data acquired in the process of step SC107 to the map server 400. Obtained from (step SC110).

Next, the index display device 100 is a map based on map data acquired from the map server 400, and includes recording points (shooting points and recording points) in which each still image file, moving image file, and audio file are recorded. A map of the range is displayed on the display unit 106, the user's action history (movement route) is displayed on the map, and the contents registered in FIG. 7 are indexed and displayed (step SC111).

FIG. 8 shows a case where the still image file, the moving image file, the file name of the audio file, the icon image (file name), and the composite character illustrated in FIG. 7 are displayed on the display unit 106 in association with the GPS data. It is a figure which showed an example.

Specifically, in the process of step SC110, the index display device 100 is based on the GPS data of the action history data acquired in the process of step SC107 on the map displayed on the display unit 106 as shown in FIG. The user's movement path 1001 is drawn, and points A to N (black circles in the figure) in which each still image file, moving image file, and audio file are recorded are displayed on the movement path 1001.

Further, the index display device 100 displays icon images (indexes) corresponding to the shooting modes such as images recorded there in the vicinity of the points A to N as information at the time of recording them. That is, the icon image corresponding to the shooting mode (including interval shooting) is displayed for the captured image (still image file, moving image file), and the icon image corresponding to the recording mode is displayed for the audio (audio file). Further, the index display device 100 displays composite characters (“stop!”, Etc.) together with the icon image in the vicinity of the points B, C, K to N where the image or the like is recorded by the trigger signal.

Then, when the index display device 100 detects that any index (icon image) is instructed (touched) by the user while displaying the contents as shown in FIG. 8 (step SC112). , A transmission instruction signal instructing the transmission of a still image file such as an image, a moving image file, or an audio file corresponding to the instructed index is transmitted to the camera device 200 (step SC115).

At this time, as shown in FIG. 3, when the camera device 200 receives the transmission instruction signal (step SB103: YES), the camera device 200 reads out the still image file, the moving image file, or the audio file instructed to transmit from the recording unit 204. It is transmitted to the index display device 100 (step SB104).

Then, after receiving these files from the camera device 200 (step SC116), the index display device 100 reproduces the still images, moving images, and sounds included in these received files (step SC117).

After that, the index display device 100 confirms whether or not there is an instruction to change the confirmation target by the user and whether or not there is an instruction to end the image processing program (steps SC118 and SC119). During that time, when the user detects a change instruction to be confirmed (step SC118: YES), the index display device 100 returns to the process of step SC103 in FIG. 4, displays a map, an action history, and the like on the display unit 106, and thereafter. Repeat the process of. Although omitted in the figure, if the captured image is displayed when the change instruction of the confirmation target is detected, the display of the captured image ends.

Then, when the user is instructed to end the image processing program (step SC119: YES), the index display device 100 ends all the processing related to the image processing program.

On the other hand, unlike the above-described processing, in the index display device 100, the confirmation result in step SC103 of FIG. 4 is YES, and the trigger transmitted from the sensor device 300 in the information at the time of recording from the camera device 200. If there is nothing recorded by receiving the signal, the following processing is performed.

That is, as shown in FIG. 5, the index display device 100 displays the recorded information for each image or the like as an index (icon image) on the screen of the display unit 106 (step SC113).
That is, the icon images corresponding to the shooting modes of each image and the like are displayed in a list. However, since there is no concept of shooting mode for audio files, only icon images are displayed.

After that, when the index display device 100 detects that any index (icon image) on the screen is instructed (touched) by the user (step SC114: YES), the still image file corresponding to the instructed index is displayed. A transmission instruction signal instructing the transmission of a moving image file or an audio file is transmitted to the camera device 200 (step SC115).

Also at this time, as shown in FIG. 3, when the camera device 200 receives the transmission instruction signal (step SB103: YES), the camera device 200 records the instructed still image file, moving image file, or audio file from the recording unit 204. It is read out and transmitted to the index display device 100 (step SB104).

Then, after receiving the still image file, the moving image file, or the audio file from the camera device 200 (step SC116), the index display device 100 reproduces the still image, the moving image, and the audio contained in these received files (step SC116). Step SC117). Subsequent processing is as described above. That is, when the index display device 100 detects the change instruction of the confirmation target by the user (step SC118: YES), the index display device 100 returns to the process of step SC103 of FIG. 4 and repeats the subsequent processes. Even in that case, if the still image or moving image taken at the time when the change instruction of the confirmation target is detected, the display is terminated.

After that, the index display device 100 indexes the information at the time of each recording and displays the list again on the screen of the display unit 106 (step SC113), and then when the user is instructed to end the image processing program (step SC119). : YES), all processing related to the image processing program is completed.

As described above, in the index display device 100, the map showing the movement route of the user does not simply indicate the shooting point or the recording point, but displays an icon image indicating the shooting mode at the time of shooting in the vicinity of the shooting point. do. Therefore, it is easy for the user to change the shooting mode used at each shooting point on the moving path to the shooting situation such as the shooting opportunity (reason for shooting) and the shooting purpose at each shooting point. Can be understood. In particular, this effect is great when the number of days has passed since the shooting date or when the situation at the time of shooting is confirmed at the shooting point where automatic shooting is performed instead of manual shooting.

Therefore, for example, even when there are many captured images (shooting points) or when the number of days has passed since the shooting date, it is possible to easily know the captured images automatically captured under a specific situation. ..

In addition, when the icon image displayed at each shooting point is instructed, the corresponding shot image (this image) can be displayed, so only the shot image automatically shot under a specific situation can be displayed. You can easily play it back and check the contents.

In addition, for the shooting points where automatic shooting was performed, the user's behavior content (predetermined behavior content) at the time of shooting can also be confirmed by displaying composite characters on the map together with the icon image. .. Therefore, it is possible to more easily understand the situation at the time of shooting at each shooting point.

Further, in the index display device 100, the shooting mode at the time of shooting the shot image is wirelessly acquired from the camera device 200, and the GSP data of the shooting point of each shot image is wirelessly acquired. Therefore, the user of the index display device 100 can easily confirm the situation at the time of shooting at each shooting point during movement.

Further, when another user different from the user of the index display device 100 is using the camera device 200 and the sensor device 300, the user of the index display device 100 can easily confirm the situation at the time of shooting by another person. You can also do it.

In the present embodiment, the index display system mainly composed of the index display device 100, the camera device 200, and the sensor device 300 has been described, but the index display device 100 includes both the camera device 200 and the sensor device 300, or either of them. It may have one of the functions. Further, the camera device 200 and the sensor device 300 may be configured by a single electronic device.

(Second Embodiment)
Next, a second embodiment of the embodiment of the present invention will be described. It should be noted that the same drawings and the same reference numerals will be used for the parts having the same description and operation as those of the first embodiment described above, and the description thereof will be omitted. Further, in the second embodiment, the index display device 100 requests the sensor device 300 to transmit all the action history data in step SC106 of FIG.

In the second embodiment, the index display device 100 includes a processing processing condition table 1042 as shown in FIG. 9 in the storage unit 104. In this processing condition table, it is a condition that the external environment data (altitude, temperature, pressure) included in the action history data and the calorie consumption data calculated based on the user's step count data exceed a predetermined threshold. In addition, it is a table that defines that a still image file, a moving image file, and an audio file whose recording date and time are satisfied when the condition is satisfied are processed with the contents set in the processing contents. In the case of FIG. 9, for example, for a photographed image in which the condition is "cloudy" or "shade" in the AWB (auto white balance) judgment when the temperature is 5 degrees or less, an image of water droplets is combined as a processing condition. By applying soft focus processing, the image emphasizes that the weather conditions are close to fog and mist. Further, for example, for a photographed image taken when the condition "the calorie consumption exceeds a preset predetermined value, an image of a medal or a medal or a predetermined frame is combined as a processing condition.

Further, in step SC108 of FIG. 4, the index display device 100 receives the action history data from the sensor device 300 (step SC107), and then the still image file recorded by the trigger signal in the received action history data. The information (shooting date / time, recording date / time) at the time of recording the moving image file and the audio file is stored in the log table 1043 of the storage unit 104 in association with the GPS data measured at the same date and time as shown in FIG. In the present embodiment, the log table 1043 further receives and acquires all the set data S1 to S14 of other external environment, acceleration, and angular velocity values, and the log table 1043 includes a still image file, a moving image file, and an audio file. Correspond with GPS data and acquisition date and time.

FIG. 11 is a flowchart showing the operation of the index display device when the image processing program in the second embodiment is started, and is an improvement from the flowchart of the first embodiment shown in FIG.
When the control unit 110 of the index display device 100 acquires the map data of the range including the positioning location corresponding to the plurality of GPS data included in the action history data from the map server 400 in the flow from the step SC110 of FIG. 5, these Process data is generated from the GPS data and the action history data of the above (step SC201). Then, a representative image is selected from the acquired still image files and read out to generate cover data (step SC202).

FIG. 13 illustrates the cover data generated at this time. In the figure, the screen is divided into upper and lower parts, and the following information is displayed in the upper display area as data obtained from GPS data, action history data, and the like.
・ Current time "9:34"
-Altitude "500m" of the arrival point calculated from the altitude data included in the GPS data and the altitude (atmospheric pressure) data obtained as external environment data.
・ Elapsed time measured from the starting point "Elapsed: 1 hour 21 minutes"
-Temperature at the destination calculated from the temperature data obtained as external environment data "Temperature: 14 ° C"
-Speed calculated from the elapsed time and the distance traveled by positioning "Speed: 3.6 km / h"
-The number of times that the period during which there was no change in these values for a predetermined time or more from each value of the accelerometer, angular velocity sensor, and GPS data obtained during movement was estimated as the break time "Break: 2 times"
-The number of steps is counted from the acceleration sensor and angular velocity sensor obtained during movement, and the calorie consumption obtained from the counted value "consumption: 256 kcal"

Further, in the lower area, a plurality of still image files recorded in this process or those selected and read from a moving image file are displayed as representative images. It should be noted that various methods for selecting the representative image can be considered. For example, the representative image may be an image including all the participating members, or may be a landscape image of the goal point.

Further, when the display data is generated and displayed, it is determined whether or not the instruction to switch to the process data is detected by an external operation by the user (step SC203). If the switching instruction is not detected (step S203: NO), the detection of this instruction is repeatedly waited, while if the switching instruction is detected (step S203: YES), the map based on the map data acquired from the map server 400 is used. The recorded information (shooting point and recording point) indicating that each still image file, video file, and audio file was recorded is indexed, and the user's action history (movement route) recorded in FIG. 10 is further indexed. Is added and displayed as the top view 1063 (step SC204).

Specifically, in the process of step SC204, the index display device 100 displays GPS data of the action history data acquired in the process of step SC107 on the map displayed in the top view 1063 as shown in FIG. 14 (a). A user's movement path 1001 is drawn based on the above, and points A to E (black circles in the figure) in which each still image file, moving image file, and audio file are recorded are displayed on the movement path 1001.

Further, the index display device 100 displays icon images (indexes) corresponding to the shooting modes such as images recorded there in the vicinity of the points A to E as information at the time of recording them. That is, the icon image corresponding to the shooting mode (including interval shooting) is displayed for the captured image (still image file, moving image file), and the icon image corresponding to the recording mode is displayed for the audio (audio file). Further, the index display device 100 displays a composite character (“stop!”, Etc.) together with the icon image in the vicinity of the points A to C where the image or the like is recorded by the trigger signal. Further, in this movement route 1001, sections 1069 to 1071 whose display colors are different from those of other routes are displayed. In each of the sections 1069 to 1071, the moving speed of the section is calculated based on the measurement time, the moving distance, and the values of the acceleration sensor and the angular velocity sensor of the section, and whether the user has moved or ran by walking. It is a differentiated display of whether other means of transportation (bicycle or car) were used.

Further, in the figure, when the user instructs the index 1064, the control unit 110 controls to play the still image file and the moving image file regulated by the movement path 1001. Further, 1065 with the indications of "bird", "top", and "side" expresses the display mode of the movement path 1001, and by detecting the external operation of the user, "bird (abbreviation of bird view)", Each display mode of "top (abbreviation of top view)" and "side (abbreviation of side view)" is switched. Further, below the top view, the required time 1066, the moving distance 1067, and the height difference 1068 of the moving stroke calculated by appropriately using the GPS data, the acceleration sensor, the angular velocity sensor, and the external environment data are displayed. The required time 1066, the moving distance 1067, and the height difference 1068 are commonly displayed in each of the "bird", "top", and "side" display modes.

The control unit 101 determines whether or not a switch to any other display (in this case, "bird" or "side") in 1065 is instructed by an external operation by the user (step SC205). If the switching instruction is not detected (step SC205: NO), the process proceeds to step SC112 in FIG. On the other hand, when the display switching instruction is detected (step SC205: YES), it is determined whether the switching is the display switching instruction to "bird" or the display switching instruction to "side" (step). SC206).

When the control unit 101 detects the switching instruction to "bird", it indexes the recording information (shooting point or recording point) indicating that each still image file, moving image file, or audio file has been recorded from the top view 1063. Further, the one to which the user's action history (movement path) recorded in FIG. 10 is added is displayed as a bird view 1072 which is a 3D (three-dimensional) display by a bird's-eye view (step SC207). At this time, the index display device 100 sets the user's movement route 1001 on the map displayed in the bird view 1072 as shown in FIG. 14B based on the GPS data of the action history data acquired in the process of step SC107. Is drawn, and points A to G (black circles in the figure) in which each still image file, moving image file, and audio file are recorded are displayed on the movement path 1001. In this display, that is, the icon images corresponding to the shooting modes (including interval shooting) are not displayed for the shot images (still image files, moving image files), but these images may be displayed.

The control unit 101 determines whether or not a switch to any other display in 1065 has been instructed by an external operation by the user (step SC208). If the switching instruction is not detected in step SC208 (step SC208: NO), it is determined whether or not the termination instruction of the application (application software) has been detected (step S209). When the end instruction of the application is detected in step SC209 (step SC209: YES), the process is terminated. On the other hand, when the end instruction of the application is not detected in step SC209 (step SC209: NO), the process returns to the process of step SC206. Further, when the switching instruction is detected in step SC208 (step S208: YES), it is further determined whether the switching instruction display is “side” or “top” (step SC210).

If a switching instruction to "top" is detected here, the process proceeds to step SC204. On the other hand, when a switch to "side" instruction is detected, the recording information (shooting point or recording point) indicating that each still image file, video file, or audio file has been recorded is displayed without displaying the map. The side view 1073 is obtained by indexing the user's behavior history recorded in FIG. 10 and adding process data obtained from measurement data (mainly tilt angle) such as altitude data, acceleration sensor, and angular velocity sensor. (Step SC211).

Specifically, in the processing of step SC211, the index display device 100 simply displays the height of the movement path as shown in FIG. 14 (c), and each still image file, moving image file, and audio are displayed. Display each point A to G (black circle in the figure) where the file was recorded. In this display, that is, the icon images corresponding to the shooting modes (including interval shooting) are not displayed for the shot images (still image files, moving image files), but these images may be displayed.

The control unit 101 determines whether or not a switch to any other display in 1065 has been instructed by an external operation by the user (step SC212). If the switching instruction is not detected in step SC212 (step SC212: NO), it is determined whether or not the termination instruction of the application (application software) has been detected (step S213). When the end instruction of the application is detected in step SC213 (step SC213: YES), the process is terminated. On the other hand, when the end instruction of the application is not detected in step SC213 (step SC213: NO), the process returns to the process of step SC211. Further, when the switching instruction is detected in step SC212 (step S212: YES), it is further determined whether the switching instruction display is "top" or "bird" (step SC214). If a switching instruction to "top" is detected here, the process proceeds to step SC204. On the other hand, when the instruction to switch to "bird" is detected, the process proceeds to step SC207.

Further, as shown in FIG. 12, the index display device 100 receives a still image file, a moving image file, or an audio file from the camera device 200 (step SC116), and then acquires (records / images) these files. The external environment data at the time, the step count data calculated from the acceleration sensor and the angular velocity sensor, and the calorie consumption data obtained from the step count data are acquired, and these acquired data are set in the processing condition table of FIG. It is determined whether or not the corresponding still image file, moving image file, or audio file is subject to processing processing as a result of satisfying the above conditions (step SC120). If it is determined that the target is to be processed (step SC120: YES), the target still image file, moving image file, or audio file is processed (step SC121), and the processed still image or moving image is processed. , Play the audio (step SC122). The outline of this processing is described in the description of FIG. 9, and will be omitted. On the other hand, when it is determined that the processing target is not (step SC120: NO), the still image, the moving image, and the sound included in these received files are reproduced.

As described above, in the index display device 100 of the second embodiment, the movement route can be represented by a plurality of types. Therefore, it becomes easy to understand what kind of terrain has been moved. In addition, by associating the external environment and action history with the processing conditions, the received still image file, moving image file, or audio file can be reproduced and output as a memorial to the achievement of a specific goal.

In the present embodiment, the index display system mainly composed of the index display device 100, the camera device 200, and the sensor device 300 has been described, but the index display device 100 includes both the camera device 200 and the sensor device 300, or either of them. It may have one of the functions. Further, the camera device 200 and the sensor device 300 may be configured by a single electronic device.

The embodiments of the present invention and modifications thereof have been described above, but these can be appropriately changed as long as the effects of the present invention can be obtained, and the modified embodiments are also within the scope of claims. It is included in the scope of the described invention and the invention equivalent to the invention. The inventions described in the claims of the original application of this application are described below.
(Appendix 1)
Location information acquisition means for acquiring location information related to image capture,
Shooting information acquisition means for acquiring predetermined information regarding image shooting,
A generation means for generating an index image based on the predetermined information acquired by the shooting information acquisition means, and a generation means.
An index display device comprising: a display means for displaying an index image generated by the generation means at a position indicated by the position information acquired by the position information acquisition means.
(Appendix 2)
Further provided with a behavior information acquisition means for acquiring information on the behavior of the person carrying the image pickup device that captured the image.
The index display device according to claim 1, wherein the display means further displays information about the behavior acquired by the behavior information acquisition means in association with the predetermined information.
(Appendix 3)
The information regarding the behavior includes a plurality of types of movement modes of the carrying person.
The index display device according to claim 2, wherein the display means displays the plurality of types of movement modes in an identifiable manner as information on the behavior.
(Appendix 4)
Further provided with an external environment information acquisition means for acquiring information on the external environment of the imaging device that captured the image.
The index display device according to any one of claims 1 to 3, wherein the display means further displays information about the external environment acquired by the external environment information acquisition means.
(Appendix 5)
An instruction detecting means for detecting an instruction for the predetermined information displayed by the display means, and
The invention according to any one of claims 1 to 3, further comprising a display control means for controlling the display means to display an image corresponding to the predetermined information for which an instruction has been detected by the instruction detection means. The index display device described.
(Appendix 6)
A first control means for controlling so as to associate an image displayed on the display means with information related to the behavior is further provided.
When displaying an image on the display means, the display control means controls to display the image in a display mode based on the information related to the behavior associated with the first control means. The index display device according to claim 5.
(Appendix 7)
A second control means for controlling so as to associate the image displayed on the display means with the information about the external environment is further provided.
When displaying an image on the display means, the display control means controls to display the image in a display mode based on information about the external environment associated with the second control means. The index display device according to claim 5 or 6.
(Appendix 8)
The index display device according to claim 6 or 7, wherein the display control means controls the image to be displayed so as to perform predetermined processing or synthesize another image.
(Appendix 9)
Further equipped with communication means to communicate with external devices
The index display device according to any one of claims 1 to 8, wherein at least one of the image, the position information, and the predetermined information is received by the communication means.
(Appendix 10)
The index display device according to any one of claims 1 to 9, wherein the predetermined information is a shooting mode used for shooting the image.
(Appendix 11)
The index display device according to any one of claims 1 to 10, wherein the image includes an image taken when a predetermined condition is satisfied.
(Appendix 12)
The location information acquisition step to acquire the location information related to image shooting, and
A shooting information acquisition step for acquiring predetermined information regarding image shooting, and
A generation step of generating an index image based on the predetermined information acquired in the shooting information acquisition step, and a generation step.
An index display method including a display step for displaying an index image generated in the generation step at a position indicated by the position information acquired in the position information acquisition step.
(Appendix 13)
Computer,
Location information acquisition means for acquiring location information related to image capture,
Shooting information acquisition means for acquiring predetermined information regarding image shooting,
A generation means for generating an index image based on the predetermined information acquired by the shooting information acquisition means,
A program characterized in that it functions as a display means for displaying an index image generated by the generation means at a position indicated by the position information acquired by the position information acquisition means.
(Appendix 14)
An index display system including a display device, a position information recording device that sequentially records position information while the carrier is moving, and an imaging device carried by the carrier.
The display device is
A position information acquisition means for acquiring the position information from the position information recording device, and
An imaging information acquisition means for acquiring predetermined information regarding imaging of an image recorded in the imaging device from the imaging device, and
A generation means for generating an index image based on the predetermined information acquired by the shooting information acquisition means, and a generation means.
An index display system including a display control means for controlling the display of an index image generated by the generation means at a position indicated by the position information acquired by the position information acquisition means.

100 Index display device 101 Control unit 102 First wireless communication unit 103 Second wireless communication unit 104 Storage unit 105 Audio output unit 106 Display unit 107 Input unit 200 Camera device 201 Control unit 203 Imaging unit 303 Motion sensor unit 204 Recording unit 205 Voice input unit 206 Wireless communication unit 207 Input unit 300 Sensor device 301 Control unit 302 Position information acquisition unit 304 External environment acquisition unit 305 Action history storage unit 306 Wireless communication unit 400 Map server 401 Map database 500 Internet 1001 Movement route

Claims (12)

Location information acquisition means for acquiring location information related to image capture,
Shooting information acquisition means for acquiring predetermined information regarding image shooting,
An external environment information acquisition means for acquiring information on the external environment of the imaging device that captured the image, and
A generation means for generating an index image based on the predetermined information acquired by the shooting information acquisition means, and a generation means.
An index indicating that the predetermined information is acquired at a display position corresponding to the position information acquired by the position information acquisition means, an index image generated by the generation means, and the external environment information acquisition. A display means for displaying the information about the external environment acquired by the means, and a display means for displaying the information.
Equipped with a,
The position information acquired by the position information acquisition means includes altitude and includes altitude.
Based on the operation detection from the outside, the display means includes an index indicating that the predetermined information is acquired at the display position indicated by the information not including the altitude in the position information, the index image, and the outside. A first display mode for displaying information about the environment and a second display mode for displaying an index indicating that the predetermined information is acquired at the display position indicated by the information including altitude in the position information. An index display device characterized by displaying in any of the display modes of. Further provided with a behavior information acquisition means for acquiring information on the behavior of the person carrying the image pickup device that captured the image.
The index display device according to claim 1, wherein the display means further displays information about the action acquired by the action information acquisition means in the first display mode in association with the predetermined information. .. The information regarding the behavior includes a plurality of types of movement modes of the carrying person.
The index display device according to claim 2, wherein the display means displays the plurality of types of movement modes in an identifiable manner as information on the behavior in the first display mode. Further, a first control means for controlling so as to associate the image captured by the image pickup device with the information related to the behavior is provided.
When displaying the captured image, the display means displays the captured image in a display mode based on the information related to the behavior associated with the first control means. Item 2. The index display device according to item 2 or 3. Further, a second control means for controlling so as to associate the image captured by the image pickup device with the information about the external environment is provided.
When displaying the captured image, the display means displays the captured image in a display mode based on information about the external environment associated with the second control means. The index display device according to claim 4. The index display device according to claim 5, wherein the display means displays an image to be displayed by combining a predetermined process or another image. Further equipped with communication means to communicate with external devices
The index display device according to any one of claims 1 to 6, wherein at least one of the captured image, the position information, and the predetermined information is received by the communication means. .. The index display device according to any one of claims 1 to 7, wherein the predetermined information is a shooting mode used for shooting the image. The index display device according to any one of claims 1 to 8, wherein the captured image includes an image captured when a predetermined condition is satisfied. The location information acquisition step to acquire the location information related to image shooting, and
A shooting information acquisition step for acquiring predetermined information regarding image shooting, and
An external environment information acquisition step for acquiring information on the external environment of the image pickup device that captured the image, and
A generation step of generating an index image based on the predetermined information acquired in the shooting information acquisition step, and a generation step.
An index indicating that the predetermined information is acquired at a display position corresponding to the position information acquired in the position information acquisition step, an index image generated in the generation step, and the external environment. A display step for displaying the information about the external environment acquired in the information acquisition step on the display unit, and
Including
The display step includes an index indicating that the predetermined information is acquired at a display position indicated by information that does not include altitude in the position information based on operation detection from the outside, the index image, and the outside. A first display mode for displaying information about the environment and a second display mode for displaying an index indicating that the predetermined information is acquired at the display position indicated by the information including altitude in the position information. An index display method characterized by displaying in any of the display modes of. Computer,
Location information acquisition means for acquiring location information related to image capture,
Shooting information acquisition means for acquiring predetermined information regarding image shooting,
An external environment information acquisition means for acquiring information on the external environment of the image pickup device that captured the image.
A generation means for generating an index image based on the predetermined information acquired by the shooting information acquisition means,
An index indicating that the predetermined information is acquired at a display position corresponding to the position information acquired by the position information acquisition means, an index image generated by the generation means, and the external environment information acquisition. A display means for displaying the information about the external environment acquired by the means,
To function as
The position information acquired by the position information acquisition means includes altitude and includes altitude.
Based on the operation detection from the outside, the display means includes an index indicating that the predetermined information is acquired at a display position indicated by information not including altitude in the position information, the index image, and the outside. A first display mode for displaying information about the environment and a second display mode for displaying an index indicating that the predetermined information is acquired at the display position indicated by the information including altitude in the position information. A program characterized by displaying in any of the display modes of. An index display system including a display device, a position information recording device that sequentially records position information while the carrier is moving, and acquires information on the external environment, and an imaging device carried by the carrier.
The display device is
A position information acquisition means for acquiring the position information from the position information recording device, and
An imaging information acquisition means for acquiring predetermined information regarding imaging of an image recorded in the imaging device from the imaging device, and
An external environment information acquisition means for acquiring information on the external environment of the image pickup device that captured the image from the position information recording device, and
A generation means for generating an index image based on the predetermined information acquired by the shooting information acquisition means, and a generation means.
An index indicating that the predetermined information is acquired at a display position corresponding to the position information acquired by the position information acquisition means, an index image generated by the generation means, and the external environment information acquisition. The display control means for controlling the display of the information about the external environment acquired by the means, and the display control means.
With
The position information acquired by the position information acquisition means includes altitude and includes altitude.
The display control means includes an index indicating that the predetermined information is acquired at a display position indicated by information that does not include altitude in the position information based on operation detection from the outside, the index image, and the display control means. A first display mode for displaying information about the external environment and a second display for displaying an index indicating that the predetermined information is acquired at the display position indicated by the information including altitude in the position information. An index display system characterized by displaying in any of the display modes.

Images