JP5409852B2 - Virtual landscape display device and virtual landscape display method - Google Patents

Description

The present invention relates to a virtual landscape display device and a virtual landscape display method for supplementing and displaying a landscape image viewed by a subject from a captured image with shooting position information.

In recent years, various services for displaying a map using a three-dimensional (3D) image such as a Google (registered trademark) map have been proposed. Various systems that can display a CG image superimposed on a real image have also been proposed. For example, in Patent Document 1, by combining a real image and a CG image, undulations in a landscape that is reflected in a relayed video can be visually displayed in a golf relay or the like.
JP 2000-128298 A

In personal camera photography, there are cases where a user takes a picture taken by himself / herself in an album or the like and relives the time of photography. Here, in general, it is considered that the memory about the photograph taken by the user himself is likely to remain, and the memory regarding the photograph which has not been photographed is difficult to remain. Therefore, it is considered difficult to have a re-experience about scenery that was not taken at that time.

The present invention has been made in view of the above circumstances, and an object thereof is to provide a virtual landscape display device and a virtual landscape display method capable of recalling a landscape that was not captured at the time of shooting.

In order to achieve the above object, a virtual landscape display device according to a first aspect of the present invention includes a recording unit that records a captured image in which shooting position information and shooting date / time information are associated, a communication unit, and the recording unit. When displaying a non-recorded image in a virtual landscape display device comprising a display unit for displaying a recorded photographed image and an image not recorded in the recording unit at the time of photographing via the communication unit , map the recorded captured image from the communication unit transmits via the communication unit to the external device, the external device is searched by using the photographing position information and the shooting time information of the captured image transmitted over SL And a control unit that displays a virtual landscape image that the subject should have seen at the time of photographing, created based on the image .
In order to achieve the above object, a virtual landscape display device according to a second aspect of the present invention includes a recording unit that records a captured image in which shooting position information and shooting date / time information are associated, a communication unit, and the recording unit. In a virtual landscape display method using a virtual landscape display device comprising a display unit that displays a recorded photographed image and an image that has not been recorded in the recording unit at the time of photographing via the communication unit, the virtual landscape display method is not recorded. When displaying an image, the communication unit transmits the recorded photographed image to an external device via the communication unit, and the external device uses the photographing position information and the photographing time information of the transmitted photographed image. The virtual landscape image that the subject should have seen at the time of shooting is displayed based on the map image retrieved in this manner.

ADVANTAGE OF THE INVENTION According to this invention, the virtual landscape display apparatus and virtual landscape display method which can recall the scenery which was not image | photographed at the time of imaging | photography can be provided.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a diagram showing a configuration of a virtual landscape display system including a virtual landscape display device according to an embodiment of the present invention. A virtual landscape display system shown in FIG. 1 includes a camera 100 and a server 20.
0 is communicably connected via a communication line 300. Here, the communication line 300 is a general-purpose communication line such as an Internet line.

The camera 100 includes a control unit 101, an operation input unit 102, an imaging unit 103, a position detection unit 104, a clock unit 105, a recording unit 106, a display unit 107, and a communication unit 108. .

The control unit 101 controls the overall operation of the camera 100. The control unit 101 controls various processes according to the operation state of the operation input unit 102 by the user. The operation input unit 102 is a power switch for turning on / off the power of the camera 100, a release button for giving an instruction to execute shooting of the camera 100, a zoom button for executing a zoom operation, and an instruction for normal playback of an image. A user's playback button, a memory playback button for giving a memory playback instruction (details will be described later), a cross key for performing various selection operations on the camera 100, an OK button for performing various determination operations on the camera 100, etc. Are configured to include various operation members for operating the camera 100.

The imaging unit 103 captures an image by capturing a subject under the control of the control unit 101. The position detection unit 104 is configured by, for example, GPS, and the position (latitude / longitude) of the camera 100 at the time of shooting.
Is detected. The clock unit 105 detects the shooting date and time.

Here, the position detection unit 104 and the clock unit 105 are not necessarily built in the camera 100. For example, the camera 100 may acquire position information and time information detected by a GPS wristwatch or a dedicated navigation device carried by the user.

The recording unit 106 is, for example, a memory card configured to be detachable from the camera 100, and an image acquired via the imaging unit 103 is detected by the shooting position detected by the position detection unit 104 and the clock unit 105. Recorded in association with the shooting date and time. The display unit 107 is the control unit 1
Various images such as images recorded in the recording unit 106 are displayed under 01.

The communication unit 108 performs various processes related to communication with the server 200 under the control of the control unit 101.

The server 200 includes a control unit 201, an operation input unit 202, an image recording unit 203, an age-specific map database (DB) 204, a photographer image DB 205, a virtual landscape creation unit 206, and a communication unit 207. doing. The server 200 has a huge database so that various local map images can be recorded, and is preferably connected to the Internet so that information on various sites on the Internet can be used. 200 functions may be provided.

The control unit 201 controls various processes in the server 200. When the operation input unit 202 is operated, the control unit 201 also performs processing according to the operation content. Operation input unit 2
02 includes various operation members for operating the server 200. Here, in FIG. 1, the operation input unit 202 is provided in the server 200, but the operation input unit 20
2 may be a PC connected to the server 200 via a network.

The image recording unit 203 records an image transmitted from the camera 100 via the communication line 300. The image recording unit 203 includes a hard disk having a larger recording capacity than the recording unit 106 of the camera 100. Here, the image recording unit 20 in the present embodiment.
3 has a recording area as the position age recording section 203a. Position dating unit 203a
Is a recording area for associating and recording the shooting position of each image recorded in the image recording unit 203 and the shooting date and time (shooting age).

The age-specific map DB 204 is a database that records 2D and 3D map images for each shooting age. Here, the age-specific map DB 204 may be constructed in a recording medium different from the image recording unit 203 or may be constructed in the image recording unit 203.

The photographer image DB 205 is a database in which images of users (photographers) are recorded. The photographer's image recorded in the photographer image DB 205 is an avatar that is a photographed image registered by the photographer himself or a character image as a part of the photographer registered in advance in the server 200. The user can use the operation input unit 202 or the operation input unit 102 of the camera 100 to select whether the image to be synthesized with a virtual landscape image created at the time of replaying memories, which will be described later, to be a real image or an avatar. Is possible.

The virtual landscape creation unit 206 creates a landscape image (virtual landscape image) viewed by the subject in the image that is input at the time of memory playback, and is further input to the virtual landscape image as necessary. The image of the user (photographer) of the image is synthesized. The virtual landscape creation unit 206 includes a direction detection unit 2
061 and an image composition unit 2062. The direction detection unit 2061 is the same direction detection unit 2
061a and an opposite direction detection unit 2061b. The same direction detection unit 2061a detects the shooting direction from the shooting position information of the input image and the landscape shown in the input image. The opposite direction detection unit 2061b detects a direction (180-degree rotation direction) opposite to the photographing direction detected by the same direction detection unit 2061a. The image composition unit 2062 acquires a landscape image existing in the direction detected by the opposite direction detection unit 2061b as a virtual landscape image from the chronological map DB 204, and is input to the acquired landscape image as necessary. Synthesize the image of the photographer. That is, the virtual landscape image acquired by the image composition unit 2062 corresponds to an image of a landscape that is considered to be reflected in the direction in which the subject was looking at the time of shooting the input image, that is, the direction in which the photographer was present. To do.

The communication unit 207 performs various processes related to communication with the camera 100 under the control of the control unit 201.

The outline of the operation of the virtual landscape display system shown in FIG. 1 will be described below. FIG. 2 is a diagram showing an outline of the operation of the virtual landscape display system.

In this embodiment, when shooting is performed, an image is recorded in the recording unit 106 in a state where the shooting position and the shooting date and time are associated with each other.

Then, the operation mode of the camera 100 is set to the memory image reproduction mode by the operation of the operation input unit 102 by the user, and when the image recorded in the recording unit 106 of the camera 100 is selected after that, the selected mode is selected. An image is transmitted to the server 200. In the example of FIG. 2, an example is shown in which an image 401 captured at a position of latitude A and longitude B at 12:20 is selected.

When the image 401 is received by the server 200, the image 40 is retrieved from the chronological map DB 204.
A 2D map image 402 and a 3D map image including one shooting position are acquired. Thereafter, in the same direction detection unit 2061a of the virtual landscape creation unit 206, the shooting direction of the image 401 is specified from the landscape shown in the image 401. After specifying the shooting direction of the image 401, the opposite direction detection unit 20
The direction opposite to the shooting direction (180-degree rotation direction of the shooting direction) is specified by 61b.
This direction is the direction in which the subject is thought to have been looking at the time of shooting the image 401.

When the direction opposite to the shooting direction is specified by the opposite direction detection unit 2061b, the image composition unit 2062 uses the 3D map image in the chronological map DB 204 as a virtual landscape image as an image considered to be viewed by the subject. Created. Furthermore, the created virtual landscape image 4
03, a photographer's image 404 is synthesized as necessary.

By creating a virtual landscape image as described above, it is possible to view other images that can be viewed at the shooting position even if only the image 401 is actually shot.

  Hereinafter, a specific operation of the virtual landscape display system of FIG. 1 will be described.

FIG. 3 is a flowchart showing the operation of the camera 100 in the virtual landscape display system shown in FIG. When the user operates the power switch of the operation input unit 102, the camera 10
The processing of FIG. 3 is started by turning on the power of 0.

After the power is turned on, the control unit 101 operates the imaging unit 103 to perform a through image display in which an image obtained via the imaging unit 103 is displayed on the display unit 107 in real time (step S1).
. After the through image display, the control unit 101 determines whether an image shooting instruction is given by the user operating the release button of the operation input unit 102 (step S2).

If it is determined in step S2 that an image shooting instruction has been issued, the control unit 101 performs shooting of the subject (step S3). That is, the control unit 101 operates the imaging unit 103 to acquire a subject image, and performs various image processing on the acquired subject image. Thereafter, the control unit 101 acquires the shooting date / time information detected by the clock unit 105 when the shooting is performed (step S4), and acquires the shooting position information detected by the position detection unit 104 when the shooting is executed (step S5). . Next, the control unit 101 records the image obtained by shooting, shooting date / time information, and shooting position information in the recording unit 106 in association with each other (step S6).

Further, in the determination in step S2, if no image shooting instruction is given, the control unit 1
01 determines whether a normal image reproduction instruction has been made by the user operating the reproduction button of the operation input unit 102 (step S7). In the determination in step S7, when a normal image reproduction instruction is given, the control unit 101 performs processing related to normal image reproduction (step S8). That is, the control unit 101 causes the display unit 107 to display a thumbnail image of the image recorded in the recording unit 106 and causes the display unit 107 to display an image corresponding to the thumbnail image selected by the user. The image recorded in the image recording unit 203 of the server 200 may be played back by the camera 100. In this case, an image reproduction request is made from the camera 100 to the server 200. In response to this, a thumbnail image of an image recorded in the server 200 is displayed on the display unit 107. When any thumbnail image is selected by the user, an image corresponding to the thumbnail image is transmitted from the server 200 to the camera 100, and the transmitted image is displayed on the display unit 107.

Further, in the determination in step S7, when a normal image reproduction instruction has not been given, the control unit 101 determines whether or not a memory reproduction instruction has been given by the operation of the memory reproduction button of the operation input unit 102 by the user (step S9). ). If it is determined in step S9 that no memory playback instruction has been issued, the control unit 101 determines whether an image transmission instruction has been given by an operation of the operation input unit 102 by the user (step S10). If it is determined in step S10 that no image transmission instruction has been issued, the process returns to step S1, and the control unit 101 performs the through image display again. On the other hand, when an image transmission instruction is given in the determination in step S10, the control unit 101 performs processing related to image transmission (step S11).
. That is, the control unit 101 causes the display unit 107 to display a thumbnail image of the image recorded in the recording unit 106 and displays an image corresponding to the thumbnail image selected by the user on the server 2.
Send to 00.

In the determination of step S9, when a memory playback instruction is given, the control unit 101
Executes a process related to the memory reproduction. First, the control unit 101 causes the display unit 107 to display thumbnail images of images recorded in the recording unit 106 (step S12). Next, the control unit 101 waits for any image in the thumbnail image to be selected by the operation of the operation input unit 102 by the user (step S13).

After the image is selected in step S13, the control unit 101 waits for input of the photographer's image setting (step S14). This setting is a setting such as whether to synthesize a photographer image with a virtual landscape image in a memory reproduction mode described later, and what kind of image to synthesize. The process for setting the photographer image will be described later.

Thereafter, the control unit 101 determines whether a determination instruction has been given by the operation of the operation input unit 102 by the user (step S15). If it is determined in step S15 that no determination instruction has been given, the process returns to step S13, and the control unit 101 waits for selection of an image and change in setting input of a photographer image. On the other hand, when a determination instruction is given in the determination in step S <b> 15, the control unit 101 transmits the image selected by the user to the server 200 and transmits a memory playback request to the server 200. At this time, the setting information of the photographer image set in step S14 is also transmitted to the server 200 (step S16). Thereafter, in the process of the server 200 described later, an image file for replaying memories is generated.

Thereafter, the control unit 101 determines whether an image file for replaying a memory generated in the server 200 has been received (step S17). In step S17, the server 200
Wait until an image file is received from. In the determination in step S17, the server 20
When an image file is received from 0, the control unit 101 notifies the user to that effect.
It is determined whether or not the user has instructed playback of the memory image file (step S18).
). If it is determined in step S18 that a memory image file playback instruction has been issued,
Based on the image file transmitted from the server 200, the control unit 101 performs a memory reproduction process for causing the display unit 107 to display a landscape image that is considered to be viewed by the subject at the time of shooting (step S19). This memory reproduction process will be described later. Also, in the determination in step S18, if no instruction to reproduce the memory image file is given, the control unit 101 skips the process in step S19.

After step S18 or step S19, the control unit 101 performs a user operation input unit 102.
It is determined whether an instruction to record an image file has been given by the operation (step S20). If it is determined in step S20 that an image file recording instruction has been issued, the control unit 101 records the image file in the recording unit 106 (step S21). Further, in the determination of step S20, when the recording instruction of the memory image file is not made, the control unit 101
The process of step S21 is skipped.

FIG. 4 is a flowchart showing the operation of the server 200 in the virtual landscape display system shown in FIG. The control unit 201 determines whether an image from the camera 100 has been received in a state where no memory playback request has been made (step S31). In the determination of step S31,
When the image is received, the control unit 201 records the received image in the image recording unit 203 (
Step S32). Thereafter, the control unit 201 determines whether or not reception of an image from the camera 100 has been completed (step S33). If it is determined in step S33 that image reception has not ended, the process returns to step S31, and the control unit 201 waits for reception of the next image from the camera 100.

If no image is received in the determination in step S31, the control unit 201 determines whether a memory playback request is made from the camera 100 together with the image (step S34).
. If it is determined in step S34 that no memory playback request is made, the control unit 20
1 determines whether a normal image reproduction request has been made from the camera 100 (step S35).
). If it is determined in step S35 that a normal image reproduction request is made, the control unit 2
01 transfers the image selected by the user to the camera 100. As a result, the camera 1
The image reproduction is performed on the 00 display unit 107 (step S36).

Further, in the determination of step S34, when a memory playback request is made, the control unit 20
1 acquires an image sent from the camera 100 (step S37). Next, the control unit 2
In 01, a photographer image is acquired based on the photographer image setting information sent from the camera 100 (step S38). That is, when an image showing a photographer is sent from the camera 100, the image is acquired as a photographer image. In addition, the photographer image DB2 of the server 200
If it is requested to synthesize the image recorded in 05, the image is acquired as a photographer image.

Thereafter, the control unit 201 is based on the shooting date and time information added to the acquired image and the shooting date of the image at the same age as the shooting date and time of the image sent from the camera 100 from the chronological map DB 204. The 2D map image and 3D map image including the position are selected (step S39), and the selected 2D map image and 3D map image are sent to the virtual landscape creation unit 206. Thereafter, the same direction detection unit 2061a of the virtual landscape creation unit 206 detects the shooting direction of the image sent from the camera 100 from the landscape shown in the image sent from the camera 100 (
Step S40). That is, the same direction detection unit 2061a is an image that should be seen when the photographer stands at the shooting position (a landscape image that exists along the 360-degree rotation direction around the shooting position).
Is selected from the 3D map image. Then, matching processing between each image selected from the virtual landscape and the image sent from the camera 100 is performed, and a direction in which a landscape image determined to have the highest degree of coincidence by the matching processing is detected as a shooting direction. For example, position 402 in FIG.
When it is determined that the degree of coincidence with the landscape image existing in a is high, the shooting direction is indicated by an arrow C. After detecting the shooting direction, the opposite direction detection unit 2061b of the virtual landscape creation unit 206
The direction opposite to the shooting direction (180 ° rotation direction with respect to the shooting direction. In the example of FIG. 2, the direction of the arrow D)
Is detected (step S41).

After the detection of the opposite direction is completed, the control unit 201 determines whether or not the setting is made to synthesize the photographer image based on the setting information of the photographer image (step S42). In the determination of step S42, when it is set to synthesize the photographer image, the control unit 201 selects a landscape image corresponding to a 360 ° position around the shooting position as a virtual landscape image, and selects the selected virtual image. Among the landscape images, a virtual landscape image corresponding to the position (position 402b in the example of FIG. 2) corresponding to the opposite direction detected in step S41 is selected, and the selected virtual landscape image is selected as the image composition unit 2.
Send to 062. The image composition unit 2062 composes the photographer image acquired in step S38 with the sent virtual landscape image. After such image synthesis, the control unit 201 sets a virtual landscape image around the shooting position including the synthesized virtual landscape image as one image file (step S43). On the other hand, if it is determined in step S42 that the photographer image is not set to be synthesized, the control unit 201 selects a landscape image corresponding to a 360 ° position around the shooting position as a virtual landscape image, and selects it. Each virtual landscape image and the photographer image acquired in step S38 are set as one image file (step S44). In addition, the memory image file created here includes information in the opposite direction detected in step S41. In this way, the virtual landscape image and the photographer image are recorded in the image file without being combined, so that the camera 100 can also perform the combination.

FIG. 5 is a flowchart showing the photographer image setting process in step S14 of FIG. A user (photographer) can select a desired photographer image from images recorded in the photographer image DB 205 of the server 200. The photographer image settings are
It can also be performed from a PC connected to the server 200 via a network.

When setting the photographer image, the control unit 101 receives the candidate image of the avatar from the server 200 and displays the received thumbnail image of the candidate image as indicated by reference numeral 107a in FIG. And it waits for selection of the avatar candidate by a user (step S51).
At this time, the control unit 101 determines whether an avatar candidate has been selected by the user (step S52), and repeats the processes of steps S51 to S52 until selection is made. Step S
In 51, it is possible to select the avatar outer shape such as the sex and style of the avatar.
That is, the user operates the cross key 102a and the OK button 102b of the operation input unit 102 to move the cursor 107b, and selects one of the thumbnail images displayed on the display unit 107. An avatar can be selected.

When the avatar candidate is selected in the determination of step S52, the control unit 101 receives a candidate image of the avatar corresponding to the selected outline from the server 200, and displays the thumbnail image of the received candidate image as shown in FIG. It is displayed as indicated by reference numeral 107c in (b). And it waits for selection of the avatar candidate by a user (step S53). At this time, the control unit 101 determines whether an avatar candidate has been selected by the user (step S54), and repeats the processing of steps S53 to S54 until selection is made. In step S53, the avatar pose can be selected. That is, the user operates the cross key 102a and the OK button 102b of the operation input unit 102 to move the cursor 107b, and the display unit 10
By selecting one of the thumbnail images displayed in 7, it is possible to select an avatar having a desired pose corresponding to the outline selected in step S 51.

In the determination of step S54, when an avatar candidate is selected, the control unit 101 creates an avatar candidate image based on the selected pose, and confirms the created avatar candidate image to the user. Is displayed on the display unit 107 (step S55). Thereafter, the control unit 101 determines whether an OK operation has been performed by the user (step S56).
). The OK operation is an operation of the OK button 102b by the user. If it is determined in step S56 that an OK operation has not been performed, the process returns to step S53, and the control unit 1
01 again waits for selection of avatar candidates.

In the determination of step S56, when the user performs an OK operation, the control unit 101 communicates with the server 200 and the photographer image DB 205 of the server 200 displays a live-action image indicating the user who is the photographer. It is determined whether an image registered by itself is recorded (step S57). If it is determined in step S57 that no real image is recorded, the control unit 101 ends the process of FIG. On the other hand, when the photographed image is recorded in the determination of step S57, the control unit 101 receives the photographed image from the server 200, and the received thumbnail image of the photographed image is represented by reference numeral 107d in FIG. Display as shown. Then, it waits for the user to select a live-action image (step S58). At this time, the control unit 101 determines whether or not a live-action image that is a candidate for an avatar has been selected by the user (step S59), and repeats the processing of steps S58 to S59 until selection is made.

In the determination of step S59, when a live-action image that is a candidate for an avatar is selected,
The control unit 101 synthesizes the face image in the selected live-action image with the face portion of the avatar candidate created in step S55 (step S60). Thereafter, the control unit 101 ends the process of FIG.

The avatar image synthesized as described above is transmitted to the server 200 at the time of the memory reproduction request in step S16 of FIG. The avatar image is combined with a virtual landscape image as necessary when the memory image file is created. Thereby, even if the user (photographer) does not shoot his / her own image, an image showing the user can be created. By synthesizing such an image with a virtual landscape image, even if the user did not shoot an image of himself / herself, the landscape that the subject was viewing at the time of shooting, including those that were not taken at that time, was captured. You can appreciate the images. Thereby, the user can recall the situation at the time of shooting.

FIG. 7 is a flowchart showing the process during memory playback by the camera 100.
Here, in the present embodiment, the virtual landscape image and the photographer image can be combined even during the memory reproduction.

After the memory image file is received and the user gives an instruction to play back the memory, the control unit 101 determines whether the photographer image is included in the memory image file (whether the photographer image is not synthesized in the server 200). ) Is determined (step S71). Step S7
If the photographer image is included in the memory image file in the determination of 1, the control unit 1
In 01, it is determined whether a photographer's image is instructed to be combined with a virtual landscape image by a user operation (step S72). When it is instructed to synthesize the photographer image in the determination of step S72, the control unit 101 converts the photographer image as shown in FIG.
A virtual landscape image corresponding to the opposite direction of the shooting direction as shown in b) is synthesized (step S7).
3).

After step S71, S72, or S73, the control unit 101 displays the virtual landscape image on the display unit 1.
Reproduction of memories is executed by displaying in 07 (step S74). During memory playback, the control unit 101 determines whether an OK operation has been performed by the user (step S75). In the determination of step S75, when an OK operation is performed, the control unit 101 ends the process of FIG. Thereafter, the memory image file including the virtual landscape image 501a created as shown in FIG. 8D is recorded in the recording unit 106 in accordance with the user operation.

On the other hand, if it is determined in step S75 that no OK operation has been performed, the control unit 10
1 determines whether the user has operated the left and right keys of the cross key 102a (step S76). In the determination in step S76, when the operation of the cross key 102a is performed, the control unit 101 selects another virtual landscape image in the image file according to the operation direction of the cross key 102a, and the selected virtual landscape image is again displayed. Then, the composition position of the photographer image is changed by compositing the photographer image (step S77). The user can select a virtual landscape image along the direction of arrow E in FIG. 8C (360 ° rotation direction around the shooting position) by operating the left and right keys of the cross key 102a. For example, when the right key is pressed in the state of FIG. 8C, the virtual landscape image adjacent to the right of the virtual landscape image 501 is selected, and the photographer image 502 is displayed at the center position of the selected virtual landscape image. Synthesized. When the left key is pressed in the state of FIG. 8C, the virtual landscape image adjacent to the left of the virtual landscape image 501 is selected, and the photographer image 502 is displayed at the center position of the selected virtual landscape image. Synthesized.

After step S76 or S77, the control unit 101 determines whether a zoom operation has been performed by the user (step S78). When the zoom operation is performed in the determination in step S78, the control unit 101 enlarges or reduces the photographer image according to the operation direction of the zoom button, and again synthesizes the enlarged or reduced photographer image with the virtual landscape image. Thus, the display range of the photographer image is changed (step S79). The user can enlarge or reduce the captured image in the direction of arrow F in FIG. 8C by operating the zoom button. For example, when the wide side of the zoom button is pressed, the photographer image is enlarged. Further, when the tele side of the zoom button is pressed, the photographer image is reduced.

As described above, according to the present embodiment, an image of a landscape that has not been photographed by the user at the time of photographing is created from the 3D map image, so that the scenery that the subject should have seen at the time of photographing is photographed. Appreciate and recall memories.

Although the present invention has been described above based on the embodiments, the present invention is not limited to the above-described embodiments, and various modifications and applications are naturally possible within the scope of the gist of the present invention.

For example, in the above-described embodiment, a system including the camera 100 and the server 200 has been described, but a PC, a mobile phone, or the like may be used instead of the camera 100. That is, any device having at least an image display function can be used instead of the camera 100.

In addition to the 3D map image, the virtual landscape image may be created using a satellite photograph or an aerial photograph.

Further, the above-described embodiments include various stages of the invention, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some configuration requirements are deleted from all the configuration requirements shown in the embodiment, the above-described problem can be solved, and this configuration requirement is deleted when the above-described effects can be obtained. The configuration can also be extracted as an invention.

It is a figure which shows the structure of the virtual scenery display system containing the virtual scenery display apparatus which concerns on one Embodiment of this invention. It is a figure shown about the outline | summary of operation | movement of a virtual scenery display system. It is a flowchart which shows the operation | movement of the camera in the virtual landscape display system shown in FIG. It is a flowchart which shows operation | movement of the server in the virtual scenery display system shown in FIG. It is a flowchart shown about the setting process of a photographer image. It is a flowchart which shows the example of a display of the display part in the case of a photographer image setting process. It is a flowchart shown about the process at the time of memory reproduction. It is a figure for demonstrating the image composition process at the time of memory reproduction.

DESCRIPTION OF SYMBOLS 100 ... Camera 101 ... Control part 102 ... Operation input part 103 ... Imaging part 104 ... Position detection part 105 ... Clock part 106 ... Recording part 107 ... Display part 108 ... Communication part 200
DESCRIPTION OF SYMBOLS ... Server 201 ... Control part 202 ... Operation input part 203 ... Image recording part 203a ... Position age recording part 204 ... Map database (DB) classified by age, 205 ... Photographer image DB, 20
6 ... Virtual landscape creation unit, 207 ... Communication unit, 300 ... Communication line

Claims (4)

A recording unit for recording a photographed image in which photographing position information and photographing date and time information are associated;
A communication department;
A captured image recorded in the recording unit, a display unit and an image that has not been recorded in the recording unit at the time of the photographing is displayed via the communication unit,
In a virtual landscape display device comprising:
When displaying an image that is not the recording, the recorded captured image from the communication unit transmits via the communication unit to the external device, and the photographing position information of the photographed image the external device is transmitted over the Symbol A control unit that displays a virtual landscape image that the subject should have seen at the time of shooting, created based on the map image searched using the shooting time information;
A virtual landscape display device comprising: The virtual landscape display device has an operation unit that can be operated left and right,
The virtual landscape image according to claim 1, wherein the virtual landscape image is an image selected by the operation unit along a 360-degree rotation direction centered on a shooting position indicated by the shooting position information. Display device. 3. The virtual landscape display device according to claim 2, wherein the virtual landscape image is an image created by the external device from a 3D map image based on a shooting date and time indicated by the shooting time information . A recording unit that records a photographed image in which photographing position information and photographing date and time information are associated, a communication unit, a photographed image recorded in the recording unit, and an image that has not been recorded in the recording unit at the time of photographing. In a virtual landscape display method by a virtual landscape display device comprising a display unit for displaying via
When displaying the unrecorded image, the recorded image is transmitted from the communication unit to an external device via the communication unit,
Displaying the virtual landscape image that the subject should have seen at the time of shooting, created based on the map image searched by the external device using the shooting position information and shooting time information of the transmitted shot image;
A virtual landscape display method characterized by the above.

Images