JP2009193468A - Virtual scenery display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a virtual scenery display device for reproducing a situation on a shooting date as well as scenery and the like which were not obtained at the time of photography. <P>SOLUTION: When a memory playback request is made in a camera 100, a photographic image is transmitted to a server 200 by the camera 100. On the basis of a shooting date and shooting position of the photographic image, a 2D map image and a 3D map image are selected from a period map DB 204. An image of the scenery which is assumed to be viewed by a subject at the shooting position at the time of shooting is created by a virtual scenery creating part 206. One image file is generated from a series of images created by the virtual scenery creating part 206 and displayed on a display part 107 of the camera 100. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a virtual landscape display device that supplements and displays a landscape image viewed by a subject from a captured image with shooting position information.

In recent years, various services for displaying a map using a three-dimensional (3D) image such as a Google (registered trademark) map have been proposed. Various systems that can display a CG image superimposed on a real image have also been proposed. For example, in Patent Document 1, by combining a real image and a CG image, undulations in a landscape that is reflected in a relayed video can be visually displayed in a golf relay or the like.
JP 2000-128298 A

  In personal camera photography, there are cases where a user takes a picture taken by himself / herself in an album or the like and relives the time of photography. Here, in general, it is considered that the memory about the photograph taken by the user himself is likely to remain, and the memory regarding the photograph which has not been photographed is difficult to remain. Therefore, it is considered difficult to have a re-experience about scenery that was not taken at that time.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a virtual landscape display device that can recall a landscape that was not photographed at the time of photographing.

  In order to achieve the above object, a virtual landscape display device according to a first aspect of the present invention includes an input unit for inputting an image to which shooting position information is added, and map data and an input to the input image. A virtual landscape creation unit that virtually creates and displays an image of a landscape that exists in a direction opposite to the direction in which the subject in the input image is viewed based on the captured shooting position information. It is characterized by that.

  According to the present invention, it is possible to provide a virtual landscape display device that can recall a landscape that was not photographed at the time of photographing.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram showing a configuration of a virtual landscape display system including a virtual landscape display device according to an embodiment of the present invention. The virtual landscape display system shown in FIG. 1 is configured such that a camera 100 and a server 200 are communicably connected via a communication line 300. Here, the communication line 300 is a general-purpose communication line such as an Internet line.

  The camera 100 includes a control unit 101, an operation input unit 102, an imaging unit 103, a position detection unit 104, a clock unit 105, a recording unit 106, a display unit 107, and a communication unit 108. .

  The control unit 101 controls the overall operation of the camera 100. The control unit 101 controls various processes according to the operation state of the operation input unit 102 by the user. The operation input unit 102 is a power switch for turning on / off the power of the camera 100, a release button for giving an instruction to execute shooting of the camera 100, a zoom button for executing a zoom operation, and an instruction for normal playback of an image. A user's playback button, a memory playback button for giving a memory playback instruction (details will be described later), a cross key for performing various selection operations on the camera 100, an OK button for performing various determination operations on the camera 100, etc. Are configured to include various operation members for operating the camera 100.

  The imaging unit 103 captures an image by capturing a subject under the control of the control unit 101. The position detection unit 104 is configured by, for example, a GPS or the like, and detects the position (latitude / longitude) of the camera 100 during shooting. The clock unit 105 detects the shooting date and time.

  Here, the position detection unit 104 and the clock unit 105 are not necessarily built in the camera 100. For example, the camera 100 may acquire position information and time information detected by a GPS wristwatch or a dedicated navigation device carried by the user.

  The recording unit 106 is, for example, a memory card configured to be detachable from the camera 100, and an image acquired via the imaging unit 103 is detected by the shooting position detected by the position detection unit 104 and the clock unit 105. Recorded in association with the shooting date and time. The display unit 107 displays various images such as images recorded in the recording unit 106 under the control unit 101.

  The communication unit 108 performs various processes related to communication with the server 200 under the control of the control unit 101.

  The server 200 includes a control unit 201, an operation input unit 202, an image recording unit 203, an age-specific map database (DB) 204, a photographer image DB 205, a virtual landscape creation unit 206, and a communication unit 207. is doing. The server 200 has a huge database so that various local map images can be recorded, and is preferably connected to the Internet so that information on various sites on the Internet can be used. 200 functions may be provided.

  The control unit 201 controls various processes in the server 200. When the operation input unit 202 is operated, the control unit 201 also performs processing according to the operation content. The operation input unit 202 includes various operation members for operating the server 200. Here, although the operation input unit 202 is provided in the server 200 in FIG. 1, the operation input unit 202 may be a PC connected to the server 200 via a network.

  The image recording unit 203 records an image transmitted from the camera 100 via the communication line 300. The image recording unit 203 includes a hard disk having a larger recording capacity than the recording unit 106 of the camera 100. Here, the image recording unit 203 in the present embodiment has a recording area as the position age recording unit 203a. The position age recording unit 203a is a recording area for recording the shooting position of each image recorded in the image recording unit 203 and the shooting date and time (shooting age) in association with each other.

  The age-specific map DB 204 is a database that records 2D and 3D map images for each shooting age. Here, the age-specific map DB 204 may be constructed in a recording medium different from the image recording unit 203 or may be constructed in the image recording unit 203.

  The photographer image DB 205 is a database in which images of users (photographers) are recorded. The photographer's image recorded in the photographer image DB 205 is an avatar that is a photographed image registered by the photographer himself or a character image as a part of the photographer registered in advance in the server 200. The user can use the operation input unit 202 or the operation input unit 102 of the camera 100 to select whether the image to be synthesized with a virtual landscape image created at the time of replaying memories, which will be described later, is a live-action image or an avatar. Is possible.

  The virtual landscape creation unit 206 creates a landscape image (virtual landscape image) viewed by the subject in the image that is input at the time of memory playback, and is further input to the virtual landscape image as necessary. The image of the user (photographer) of the image is synthesized. The virtual landscape creation unit 206 includes a direction detection unit 2061 and an image composition unit 2062. The direction detection unit 2061 includes a same direction detection unit 2061a and an opposite direction detection unit 2061b. The same direction detection unit 2061a detects the shooting direction from the shooting position information of the input image and the landscape shown in the input image. The opposite direction detection unit 2061b detects a direction (180-degree rotation direction) opposite to the photographing direction detected by the same direction detection unit 2061a. The image composition unit 2062 acquires a landscape image existing in the direction detected by the opposite direction detection unit 2061b as a virtual landscape image from the chronological map DB 204, and is input to the acquired landscape image as necessary. Synthesize the image of the photographer. That is, the virtual landscape image acquired by the image composition unit 2062 corresponds to an image of a landscape that is considered to be reflected in the direction in which the subject was looking at the time of shooting the input image, that is, the direction in which the photographer was present. To do.

  The communication unit 207 performs various processes related to communication with the camera 100 under the control of the control unit 201.

  The outline of the operation of the virtual landscape display system shown in FIG. 1 will be described below. FIG. 2 is a diagram showing an outline of the operation of the virtual landscape display system.

  In this embodiment, when shooting is performed, an image is recorded in the recording unit 106 in a state where the shooting position and the shooting date and time are associated with each other.

  Then, the operation mode of the camera 100 is set to the memory image reproduction mode by the operation of the operation input unit 102 by the user, and when the image recorded in the recording unit 106 of the camera 100 is selected after that, the selected mode is selected. An image is transmitted to the server 200. In the example of FIG. 2, an example is shown in which an image 401 captured at a position of latitude A and longitude B at 12:20 is selected.

  When the image 401 is received by the server 200, the 2D map image 402 and the 3D map image including the shooting position of the image 401 are acquired from the age-specific map DB 204. Thereafter, in the same direction detection unit 2061a of the virtual landscape creation unit 206, the shooting direction of the image 401 is specified from the landscape shown in the image 401. After specifying the shooting direction of the image 401, the opposite direction detection unit 2061b specifies a direction opposite to the shooting direction (180-degree rotation direction of the shooting direction). This direction is the direction in which the subject is thought to have been looking at the time of shooting the image 401.

  When the direction opposite to the shooting direction is specified by the opposite direction detection unit 2061b, the image composition unit 2062 uses the 3D map image in the chronological map DB 204 as a virtual landscape image as an image considered to be viewed by the subject. Created. Further, the photographer's image 404 is combined with the created virtual landscape image 403 as necessary.

  By creating a virtual landscape image as described above, it is possible to view other images that can be viewed at the shooting position even if only the image 401 is actually shot.

Hereinafter, a specific operation of the virtual landscape display system of FIG. 1 will be described.
FIG. 3 is a flowchart showing the operation of the camera 100 in the virtual landscape display system shown in FIG. The process of FIG. 3 is started when the power of the camera 100 is turned on by the operation of the power switch of the operation input unit 102 by the user.

  After the power is turned on, the control unit 101 operates the imaging unit 103 to perform a through image display in which an image obtained via the imaging unit 103 is displayed on the display unit 107 in real time (step S1). After the through image display, the control unit 101 determines whether an image shooting instruction is given by the user operating the release button of the operation input unit 102 (step S2).

  If it is determined in step S2 that an image shooting instruction has been issued, the control unit 101 performs shooting of the subject (step S3). That is, the control unit 101 operates the imaging unit 103 to acquire a subject image, and performs various image processing on the acquired subject image. Thereafter, the control unit 101 acquires the shooting date / time information detected by the clock unit 105 when the shooting is performed (step S4), and acquires the shooting position information detected by the position detection unit 104 when the shooting is executed (step S5). . Next, the control unit 101 records the image obtained by shooting, shooting date / time information, and shooting position information in the recording unit 106 in association with each other (step S6).

  Further, in the determination in step S2, if no image shooting instruction has been issued, the control unit 101 determines whether a normal image reproduction instruction has been made by the user operating the reproduction button of the operation input unit 102 (step S7). . In the determination in step S7, when a normal image reproduction instruction is given, the control unit 101 performs processing related to normal image reproduction (step S8). That is, the control unit 101 causes the display unit 107 to display a thumbnail image of the image recorded in the recording unit 106 and causes the display unit 107 to display an image corresponding to the thumbnail image selected by the user. The image recorded in the image recording unit 203 of the server 200 may be played back by the camera 100. In this case, an image reproduction request is made from the camera 100 to the server 200. In response to this, a thumbnail image of an image recorded in the server 200 is displayed on the display unit 107. When any thumbnail image is selected by the user, an image corresponding to the thumbnail image is transmitted from the server 200 to the camera 100, and the transmitted image is displayed on the display unit 107.

  Further, in the determination in step S7, when a normal image reproduction instruction has not been given, the control unit 101 determines whether or not a memory reproduction instruction has been given by the operation of the memory reproduction button of the operation input unit 102 by the user (step S9). ). If it is determined in step S9 that no memory playback instruction has been issued, the control unit 101 determines whether an image transmission instruction has been given by an operation of the operation input unit 102 by the user (step S10). If it is determined in step S10 that no image transmission instruction has been issued, the process returns to step S1, and the control unit 101 performs the through image display again. On the other hand, when an image transmission instruction is given in the determination in step S10, the control unit 101 performs processing related to image transmission (step S11). That is, the control unit 101 causes the display unit 107 to display a thumbnail image of the image recorded in the recording unit 106 and transmits an image corresponding to the thumbnail image selected by the user to the server 200.

  In the determination of step S9, when a memory playback instruction is given, the control unit 101 executes a process related to memory playback. First, the control unit 101 causes the display unit 107 to display thumbnail images of images recorded in the recording unit 106 (step S12). Next, the control unit 101 waits for any image in the thumbnail image to be selected by the operation of the operation input unit 102 by the user (step S13).

  After the image is selected in step S13, the control unit 101 waits for input of the photographer's image setting (step S14). This setting is a setting such as whether to synthesize a photographer image with a virtual landscape image in a memory reproduction mode described later, and what kind of image to synthesize. The process for setting the photographer image will be described later.

  Thereafter, the control unit 101 determines whether a determination instruction has been given by the operation of the operation input unit 102 by the user (step S15). If it is determined in step S15 that no determination instruction has been given, the process returns to step S13, and the control unit 101 waits for selection of an image and change in setting input of a photographer image. On the other hand, when a determination instruction is given in the determination in step S <b> 15, the control unit 101 transmits the image selected by the user to the server 200 and transmits a memory playback request to the server 200. At this time, the setting information of the photographer image set in step S14 is also transmitted to the server 200 (step S16). Thereafter, in the process of the server 200 described later, an image file for replaying memories is generated.

  Thereafter, the control unit 101 determines whether an image file for replaying a memory generated in the server 200 has been received (step S17). In step S17, the process waits until an image file is received from the server 200. If it is determined in step S17 that an image file has been received from the server 200, the control unit 101 notifies the user to that effect. It is determined whether or not the user has instructed playback of the memory image file (step S18). If it is determined in step S18 that the memory image file is instructed to be reproduced, the control unit 101 displays, on the display unit 107, a landscape image that is considered to be viewed by the subject at the time of shooting based on the image file transmitted from the server 200. The memory reproduction process to be displayed is performed (step S19). This memory reproduction process will be described later. Also, in the determination in step S18, if no instruction to reproduce the memory image file is given, the control unit 101 skips the process in step S19.

  After step S18 or step S19, the control unit 101 determines whether an instruction to record an image file has been given by the user's operation on the operation input unit 102 (step S20). If it is determined in step S20 that an image file recording instruction has been issued, the control unit 101 records the image file in the recording unit 106 (step S21). Also, in the determination in step S20, when no memory image file recording instruction is given, the control unit 101 skips the process in step S21.

  FIG. 4 is a flowchart showing the operation of the server 200 in the virtual landscape display system shown in FIG. The control unit 201 determines whether an image from the camera 100 has been received in a state where no memory playback request has been made (step S31). If it is determined in step S31 that an image has been received, the control unit 201 records the received image in the image recording unit 203 (step S32). Thereafter, the control unit 201 determines whether or not reception of an image from the camera 100 has been completed (step S33). If it is determined in step S33 that image reception has not ended, the process returns to step S31, and the control unit 201 waits for reception of the next image from the camera 100.

  Further, in the determination in step S31, when no image is received, the control unit 201 determines whether a memory playback request is made from the camera 100 together with the image (step S34). If the memory playback request is not made in the determination in step S34, the control unit 201 determines whether a normal image playback request is made from the camera 100 (step S35). In the determination in step S <b> 35, when a normal image reproduction request is made, the control unit 201 transfers the image selected by the user to the camera 100. Thereby, image reproduction is performed on the display unit 107 of the camera 100 (step S36).

  In the determination in step S34, when a memory playback request is made, the control unit 201 acquires an image sent from the camera 100 (step S37). Next, the control unit 201 acquires a photographer image based on the photographer image setting information sent from the camera 100 (step S38). That is, when an image showing a photographer is sent from the camera 100, the image is acquired as a photographer image. Further, when it is requested to synthesize an image recorded in the photographer image DB 205 of the server 200, the image is acquired as a photographer image.

  Thereafter, the control unit 201 is based on the shooting date and time information added to the acquired image and the shooting date of the image at the same age as the shooting date and time of the image sent from the camera 100 from the chronological map DB 204. The 2D map image and 3D map image including the position are selected (step S39), and the selected 2D map image and 3D map image are sent to the virtual landscape creation unit 206. Thereafter, the same direction detection unit 2061a of the virtual landscape creation unit 206 detects the shooting direction of the image sent from the camera 100 from the landscape shown in the image sent from the camera 100 (step S40). That is, the same direction detection unit 2061a selects, from the 3D map image, an image that should be visible when the photographer stands at the shooting position (a landscape image that exists along the 360-degree rotation direction with the shooting position as the center). Then, matching processing between each image selected from the virtual landscape and the image sent from the camera 100 is performed, and a direction in which a landscape image determined to have the highest degree of coincidence by the matching processing is detected as a shooting direction. For example, when it is determined that the degree of coincidence with the landscape image existing at the position 402a in FIG. 2 is high, the shooting direction is indicated by an arrow C. After detection of the shooting direction, the opposite direction detection unit 2061b of the virtual landscape creation unit 206 detects the opposite direction of the shooting direction (rotation direction 180 degrees with respect to the shooting direction; the direction of arrow D in the example of FIG. 2) (step S1). S41).

  After the detection of the opposite direction is completed, the control unit 201 determines whether or not the setting is made to synthesize the photographer image based on the setting information of the photographer image (step S42). In the determination of step S42, when it is set to synthesize the photographer image, the control unit 201 selects a landscape image corresponding to a 360 ° position around the shooting position as a virtual landscape image, and selects the selected virtual image. Among the landscape images, a virtual landscape image corresponding to the position (position 402b in the example of FIG. 2) corresponding to the opposite direction detected in step S41 is selected, and the selected virtual landscape image is sent to the image composition unit 2062. The image composition unit 2062 composes the photographer image acquired in step S38 with the sent virtual landscape image. After such image synthesis, the control unit 201 sets a virtual landscape image around the shooting position including the synthesized virtual landscape image as one image file (step S43). On the other hand, if it is determined in step S42 that the photographer image is not set to be synthesized, the control unit 201 selects a landscape image corresponding to a 360 ° position around the shooting position as a virtual landscape image, and selects it. Each virtual landscape image and the photographer image acquired in step S38 are set as one image file (step S44). In addition, the memory image file created here includes information in the opposite direction detected in step S41. In this way, the virtual landscape image and the photographer image are recorded in the image file without being combined, so that the camera 100 can also perform the combination.

  FIG. 5 is a flowchart showing the photographer image setting process in step S14 of FIG. A user (photographer) can select a desired photographer image from images recorded in the photographer image DB 205 of the server 200. The photographer image can also be set from a PC connected to the server 200 via a network.

  When setting the photographer image, the control unit 101 receives the candidate image of the avatar from the server 200 and displays the received thumbnail image of the candidate image as indicated by reference numeral 107a in FIG. And it waits for selection of the avatar candidate by a user (step S51). At this time, the control unit 101 determines whether an avatar candidate has been selected by the user (step S52), and repeats the processes of steps S51 to S52 until selection is made. In step S51, it is possible to select the outer shape of the avatar such as the sex and style of the avatar. That is, the user operates the cross key 102a and the OK button 102b of the operation input unit 102 to move the cursor 107b, and selects one of the thumbnail images displayed on the display unit 107. An avatar can be selected.

  When the avatar candidate is selected in the determination of step S52, the control unit 101 receives a candidate image of the avatar corresponding to the selected outline from the server 200, and displays the thumbnail image of the received candidate image as shown in FIG. It is displayed as indicated by reference numeral 107c in (b). And it waits for selection of the avatar candidate by a user (step S53). At this time, the control unit 101 determines whether an avatar candidate has been selected by the user (step S54), and repeats the processing of steps S53 to S54 until selection is made. In step S53, the avatar pose can be selected. That is, the user moves the cursor 107b by operating the cross key 102a and the OK button 102b of the operation input unit 102, and selects one of the thumbnail images displayed on the display unit 107, thereby selecting in step S51. It is possible to select an avatar having a desired pose corresponding to the formed outer shape.

  In the determination of step S54, when an avatar candidate is selected, the control unit 101 creates an avatar candidate image based on the selected pose, and confirms the created avatar candidate image to the user. Is displayed on the display unit 107 (step S55). Thereafter, the control unit 101 determines whether an OK operation has been performed by the user (step S56). The OK operation is an operation of the OK button 102b by the user. If it is determined in step S56 that an OK operation has not been performed, the process returns to step S53, and the control unit 101 waits for selection of an avatar candidate again.

  In the determination of step S56, when the user performs an OK operation, the control unit 101 communicates with the server 200 and the photographer image DB 205 of the server 200 displays a live-action image indicating the user who is the photographer. It is determined whether an image registered by itself is recorded (step S57). If it is determined in step S57 that no real image is recorded, the control unit 101 ends the process of FIG. On the other hand, when the photographed image is recorded in the determination of step S57, the control unit 101 receives the photographed image from the server 200, and the received thumbnail image of the photographed image is represented by reference numeral 107d in FIG. Display as shown. Then, it waits for the user to select a live-action image (step S58). At this time, the control unit 101 determines whether or not a live-action image that is a candidate for an avatar has been selected by the user (step S59), and repeats the processing of steps S58 to S59 until selection is made.

  In the determination in step S59, when a live-action image that is a candidate for an avatar is selected, the control unit 101 combines the face image in the selected live-action image with the face portion of the avatar candidate created in step S55. (Step S60). Thereafter, the control unit 101 ends the process of FIG.

  The avatar image synthesized as described above is transmitted to the server 200 at the time of the memory reproduction request in step S16 of FIG. The avatar image is combined with a virtual landscape image as necessary when the memory image file is created. Thereby, even if the user (photographer) does not shoot his / her own image, an image showing the user can be created. By synthesizing such an image with a virtual landscape image, even if the user did not shoot an image of himself / herself, the landscape that the subject was viewing at the time of shooting, including those that were not taken at that time, was captured. You can appreciate the images. Thereby, the user can recall the situation at the time of shooting.

  FIG. 7 is a flowchart showing the process during memory playback by the camera 100. Here, in the present embodiment, the virtual landscape image and the photographer image can be combined even during the memory reproduction.

  After the memory image file is received and the user gives an instruction to play back the memory, the control unit 101 determines whether the photographer image is included in the memory image file (whether the photographer image is not synthesized in the server 200). ) Is determined (step S71). If it is determined in step S71 that the photographer image is included in the memory image file, the control unit 101 determines whether a user operation instructs to synthesize the photographer image with the virtual landscape image (step S71). S72). When it is instructed to synthesize the photographer image in the determination in step S72, the control unit 101 displays the photographer image as shown in FIG. 8A in the shooting direction as shown in FIG. Are combined with a virtual landscape image corresponding to the opposite direction (step S73).

  After step S71, S72, or S73, the control unit 101 displays a virtual landscape image on the display unit 107 to execute memory reproduction (step S74). During memory playback, the control unit 101 determines whether an OK operation has been performed by the user (step S75). In the determination of step S75, when an OK operation is performed, the control unit 101 ends the process of FIG. Thereafter, the memory image file including the virtual landscape image 501a created as shown in FIG. 8D is recorded in the recording unit 106 in accordance with the user operation.

  On the other hand, if it is determined in step S75 that an OK operation has not been performed, the control unit 101 determines whether the left and right keys of the cross key 102a have been operated by the user (step S76). In the determination in step S76, when the operation of the cross key 102a is performed, the control unit 101 selects another virtual landscape image in the image file according to the operation direction of the cross key 102a, and the selected virtual landscape image is again displayed. Then, the composition position of the photographer image is changed by compositing the photographer image (step S77). The user can select a virtual landscape image along the direction of arrow E in FIG. 8C (360 ° rotation direction around the shooting position) by operating the left and right keys of the cross key 102a. For example, when the right key is pressed in the state of FIG. 8C, the virtual landscape image adjacent to the right of the virtual landscape image 501 is selected, and the photographer image 502 is displayed at the center position of the selected virtual landscape image. Synthesized. When the left key is pressed in the state of FIG. 8C, the virtual landscape image adjacent to the left of the virtual landscape image 501 is selected, and the photographer image 502 is displayed at the center position of the selected virtual landscape image. Synthesized.

  After step S76 or S77, the control unit 101 determines whether a zoom operation has been performed by the user (step S78). When the zoom operation is performed in the determination in step S78, the control unit 101 enlarges or reduces the photographer image according to the operation direction of the zoom button, and again synthesizes the enlarged or reduced photographer image with the virtual landscape image. Thus, the display range of the photographer image is changed (step S79). The user can enlarge or reduce the captured image in the direction of arrow F in FIG. 8C by operating the zoom button. For example, when the wide side of the zoom button is pressed, the photographer image is enlarged. Further, when the tele side of the zoom button is pressed, the photographer image is reduced.

  As described above, according to the present embodiment, an image of a landscape that has not been photographed by the user at the time of photographing is created from the 3D map image, so that the scenery that the subject should have seen at the time of photographing is photographed. Appreciate and recall memories.

  Although the present invention has been described above based on the embodiments, the present invention is not limited to the above-described embodiments, and various modifications and applications are naturally possible within the scope of the gist of the present invention.

  For example, in the above-described embodiment, a system including the camera 100 and the server 200 has been described, but a PC, a mobile phone, or the like may be used instead of the camera 100. That is, any device having at least an image display function can be used instead of the camera 100.

  In addition to the 3D map image, the virtual landscape image may be created using a satellite photograph or an aerial photograph.

  Further, the above-described embodiments include various stages of the invention, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some configuration requirements are deleted from all the configuration requirements shown in the embodiment, the above-described problem can be solved, and this configuration requirement is deleted when the above-described effects can be obtained. The configuration can also be extracted as an invention.

It is a figure which shows the structure of the virtual scenery display system containing the virtual scenery display apparatus which concerns on one Embodiment of this invention. It is a figure shown about the outline | summary of operation | movement of a virtual scenery display system. It is a flowchart which shows the operation | movement of the camera in the virtual landscape display system shown in FIG. It is a flowchart which shows operation | movement of the server in the virtual scenery display system shown in FIG. It is a flowchart shown about the setting process of a photographer image. It is a flowchart which shows the example of a display of the display part in the case of a photographer image setting process. It is a flowchart shown about the process at the time of memory reproduction. It is a figure for demonstrating the image composition process at the time of memory reproduction.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 ... Camera 101 ... Control part 102 ... Operation input part 103 ... Imaging part 104 ... Position detection part 105 ... Clock part 106 ... Recording part 107 ... Display part 108 ... Communication part 200 ... Server, DESCRIPTION OF SYMBOLS 201 ... Control part, 202 ... Operation input part, 203 ... Image recording part, 203a ... Position age recording part, 204 ... Map database (DB) according to age, 205 ... Photographer image DB, 206 ... Virtual landscape creation part, 207 ... Communication unit, 300 ... communication line

Claims (3)

An input unit for inputting an image with shooting position information added thereto;
Based on map data and shooting position information added to the input image, a virtual image of a landscape existing in a direction opposite to the direction in which the subject in the input image is viewed is created. A virtual landscape creation section to be displayed;
A virtual landscape display device comprising: The virtual landscape creation unit
A direction detection unit for detecting a direction on the map data;
According to the detected direction, a landscape image corresponding to a direction opposite to the direction in which the subject in the image is viewed is created, and the created landscape image is converted into an image indicating the photographer of the input image. An image composition unit to be composed;
The virtual landscape display device according to claim 1, comprising: The direction detector
Based on the shooting position information and a landscape image in the input image, a same direction detection unit that detects a shooting direction of the input image;
An opposite direction detection unit that detects a direction opposite to the photographing direction detected by the same direction detection unit as a direction opposite to a direction in which the subject in the image is viewed;
The virtual landscape display device according to claim 2, comprising:

Images