JP5862865B2 - Composite image display device and composite image display program - Google Patents

Description

  The present invention is a composite image display device and a composite image display program that superimposes and displays a virtual space image on a live-action image. More specifically, for example, a flooded simulation result is superimposed and displayed on a live-action image obtained by photographing the current situation. The present invention relates to a composite image display device and a composite image display program that visually image a flooding situation.

Japan is known as an earthquake-prone country, and in recent years, major earthquakes such as the Tohoku-Pacific Ocean Earthquake, the Hyogoken-Nanbu Earthquake, and the Niigata-ken Chuetsu Earthquake have occurred. While the damage caused by the Hyogoken-Nanbu Earthquake and the Niigata Chuetsu Earthquake was directly caused by ground motion, the Great East Japan Earthquake suffered immeasurable damage from the tsunami. As a result of this tremendous disaster , the awareness of the tsunami is increasing and awareness of the tsunami is growing.

  In order to plan disaster prevention measures against tsunami, it is necessary to first understand the scale of the tsunami. Inundation simulation is a typical example of a method for estimating what kind of tsunami can occur in which region. Inundation simulations are not limited to cases caused by tsunamis caused by earthquakes, but are also conducted when inundation and inundation occur. As a result, the extent to which the target area is inundated is predicted. can do.

  The result obtained by the inundation simulation is generally expressed as the inundation depth to which level (depth) of the ground surface is submerged. Further, when calculating the inundation depth, a method is often adopted in which a target area is divided into planes (usually grid division) to form a large number of meshes, and one inundation depth is assigned to each mesh.

  Having quantitative data on the inundation depth for each mesh arranged in a plane has the advantage that it is extremely easy to handle when analyzing, but is not suitable for intuitively grasping the inundation status by visual inspection. There is a difficulty that it is. Therefore, for example, when visually grasping the inundation prediction due to a tsunami, a tsunami hazard map is used. This hazard map is created by dividing the inundation depth into a predetermined range in advance, determining a color scheme corresponding to each range, and coloring with a color corresponding to each mesh.

  Although this hazard map is suitable in terms of being able to overlook the entire target area, it is difficult to imagine how much it will be flooded locally. Specifically, it is natural that we cannot understand what happens when the place where we are standing is flooded by a tsunami, and how the surrounding landscape changes.

  On the other hand, graphic technology has also evolved significantly with the rapid progress of information technology in recent years, and it is easy and free on computers by using general-purpose software such as DirectX (registered trademark) and OpenGL (registered trademark). Various images can be drawn. In particular, OpenGL is easy to use because it does not select a platform and is open, and it is often used especially in the game software field. By making full use of such a technique, it is preferable to be able to visually express the predicted inundation situation because it can be intuitively imagined.

  Until now, there has been proposed a technique for imaging a virtual thing (but not a flooded situation) by using a graphic technique. For example, in Patent Document 1, a structure such as a sign is modeled by CG on a digitized moving image taken by a video camera or the like, and the structure modeled based on predetermined rule information is displayed on the image. It proposes to arrange and create a CG image.

JP 08-101924

  The CG proposed in Patent Document 1 is based on video in the first place, so it is not expected to be used for grasping the inundation situation. Furthermore, the local inundation situation, that is, the current standing area is inundated. It is not possible to intuitively grasp the situation.

  The subject of this invention is providing the apparatus and program which can image the inundation situation locally, in other words, the synthetic image display apparatus and synthetic image which can grasp | ascertain the inundation situation of the periphery visually at arbitrary points and in real time To provide a display program.

A composite image display device according to the present invention is a device that superimposes and displays a virtual space image on a real image obtained by imaging a real space, and an image acquisition unit that acquires the real image, and a planar position of the image acquisition unit Position measuring means for measuring the position, attitude measuring means for measuring the attitude of the image acquisition means, storage means for storing a spatial model in which a plurality of meshes obtained by dividing a predetermined area into planes are provided with the inundation depth, and the position measuring means Extracting means for extracting a spatial model of the mesh corresponding to the planar position measured in step, image creating means for creating the virtual space image based on the spatial model extracted by the extracting means, the photographed image and the real image Display means for superimposing and displaying a virtual space image, wherein the image creation means is the imaging height of the image acquisition means and the appearance of the image acquisition means measured by the attitude measurement means If, performs arithmetic processing based on, it is to create the virtual space image to be a perspective view in the display means.

A composite image display device according to the present invention is a device that superimposes and displays a virtual space image on a real image obtained by imaging a real space, and an image acquisition unit that acquires the real image, and a planar position of the image acquisition unit And a position measuring means for measuring the altitude, an attitude measuring means for measuring the attitude of the image acquisition means, a storage means for storing a spatial model in which a plurality of meshes obtained by dividing a predetermined area into planes are given a flood depth, and the position Extraction means for extracting a mesh space model corresponding to the planar position measured by the measurement means, image creation means for creating the virtual space image, and display for superimposing and displaying the photographed image and the virtual space image And the image creating means performs arithmetic processing based on the imaging height of the image acquisition means and the attitude of the image acquisition means measured by the attitude measurement means, and the display It may be intended to create the virtual space image to be a perspective view in stages. In this case, the image creating means includes an elevation of the water surface of the spatial model extracted by the extracting means, an elevation of the image acquiring means measured by the position measuring means, an imaging height of the image acquiring means, And the virtual space image is created based on the inundation model.

  In the composite image display device of the present invention, the virtual space image created by the image creating means may be composed of a flooded surface and a flooded wall surface.

  The composite image display device of the present invention includes a terminal side device and a server side device, and the terminal side device includes the image acquisition unit, the position measurement unit, the posture measurement unit, the display unit, and the image. Creating means and terminal side transmission / reception means, wherein the server side device comprises the storage means, extraction means, and server side transmission / reception means, wherein the terminal side transmission / reception means is the position measurement means. The measured plane position is transmitted, and the server-side transmission / reception unit receives the plane position measured by the position measurement unit, transmits the spatial model extracted by the extraction unit, and further transmits the terminal-side transmission / reception unit. May receive the spatial model extracted by the extraction means.

The composite image display program of the present invention is a program for causing a computer to realize a function of superimposing a virtual space image on a real image obtained by imaging a real space and displaying the virtual space image on the display means. a planar position reading function of reading a planar position of the image acquisition means, based on the plane position of the picture image obtaining means, from the data base over scan constituted giving depth immersion respective predetermined regions in the plane surface division mesh, the A search function for searching for a spatial model corresponding to a planar position, a ground model creation function for creating a ground model that models a ground surface based on the imaging height and orientation of the image acquisition means, and the ground model, Based on the inundation depth of the space model searched by the search function, the virtual space image is created so as to become a perspective view by the display means That the image creation functions, the photographed image, the superimposed a virtual space image, and an image display function of displaying on the display means, the is intended to realize a computer, the ground model, the display means Are formed on the photographed image displayed on the screen.

The composite image display program of the present invention is a composite image display program for causing a computer to realize a function of superimposing a virtual space image on a real image obtained by capturing a real space and displaying the virtual space image on the display means. A plane position reading function for reading the plane position and altitude of the image acquisition means that captured the image, and data configured by giving the altitude of the submerged surface to each mesh obtained by dividing the predetermined area into planes based on the plane position of the image acquisition means A search function for searching a spatial model corresponding to the planar position from the base, and a ground model creation function for creating a ground model that models the ground surface based on the imaging height and orientation of the image acquisition means; The ground model, the altitude of the flooded surface of the spatial model searched by the search function, and the image read by the plane position reading function Based on the altitude of the acquisition means and the imaging height of the image acquisition means, an image creation function for creating the virtual space image so as to become a perspective view on the display means, and the real image, An image display function for superimposing the virtual space image and displaying on the display means is realized by a computer, and the ground model is formed on the live-action image displayed on the display means It can also be.

The composite image display device and the composite image display program of the present invention have the following effects.
(1) Since the predicted inundation situation is superimposed on the actually captured landscape, the situation at the time of the inundation can be easily imaged. Thereby, it can explain in an easy-to-understand manner to those who are not experts, for example, to local residents.
(2) Since it is possible to superimpose and display the actually captured landscape and the inundation situation simply by photographing with an image acquisition means such as a mobile phone, a smartphone, or a digital camera, the operability is excellent.
(3) By measuring with the position measuring means, it is possible to imagine the inundation situation around the current position (imaging position). Therefore, it is possible to recognize a flooding situation predicted at an arbitrary point and in real time.
(4) utilizing etc. commercially available mobile phones and smartphones, it is possible to configure a composite image display device, it is possible to easily create and inexpensively.
(5) If the composite image display device is composed of a terminal-side device and a server-side device, and further has an image creation means on the terminal side and a storage means on the server side, there is no need to transmit / receive image data. Therefore, since the data communication is processed in a short time and the terminal does not need to secure a data storage area more than necessary, the terminal can be reduced in weight and size.

The monitor of the terminal device of the present invention, illustration of displaying a synthesized image image obtained by superimposing the photographed image and the virtual space image. Explanatory drawing for demonstrating the creation method of a ground model. Explanatory drawing which displayed the ground model on the monitor of the terminal side apparatus of this invention. The model figure for demonstrating the flooded wall surface in the flooded state. Explanatory drawing which displayed the photographed image on the monitor of the terminal side apparatus of this invention. Explanatory drawing which shows the flooding depth and the altitude of the flooded surface.

(Embodiment 1)
A composite image display device and a composite image display program according to a first embodiment of the present invention will be described below with reference to the drawings.

(Overview)
The composite image display device of the present invention displays a virtual space image superimposed on a real image, and includes various means for executing this. Specifically, it includes means such as an image acquisition means, a position measurement means, an attitude measurement means, a storage means, an extraction means, an image creation means, and a display means. The composite image display apparatus can be provided with all the above means as one apparatus (that is, as an integrated type), but can also be configured separately into a server side apparatus and a terminal side apparatus. In this case, the server side device is provided with storage means, extraction means, in addition to these server side transmission / reception means, and the terminal side device is provided with image acquisition means, position measurement means, posture measurement means, image creation means, display means, In addition to these, terminal side transmission / reception means is provided. If the composite image display device is divided into a server side device and a terminal side device, it can be used by a plurality of terminal side devices for one server side device.

Moreover, the composite image display program of the present invention is a program to superimpose the virtual space image on the photographed image, plane position reading function, search function, ground model creation function, the image creation functions, image display function It has a function such as.

  Here, the terms “real image” and “virtual space image” will be described. First, the “real image” is an image obtained from a still image or a moving image actually captured by an imaging device such as a camera or a video, and is an image of an actual landscape. Note that images captured by a digital camera are not limited to still images obtained by a shutter operation, but also include images that are always displayed on a monitor (so-called live view images). Of course, not only a digital camera but also an image captured by an analog camera can be used as a real image.

  Next, the “virtual space image” is an image of a space model. The spatial model means a set of spatial information for expressing a feature with a specific position on the earth, a specific shape and size. The spatial information here is information for expressing the position of a feature such as coordinates and latitude / longitude, and two-dimensional coordinates (X, Y) and three-dimensional coordinates (X, Y, Z) are used. It can be illustrated. Furthermore, the term “feature” as used herein means an extent that can be expressed by spatial information, and is not limited to an existing one. That is, a virtual space image is an image created from a space model regardless of whether or not it actually exists, and in this respect, it differs from a real image actually captured by a camera or the like.

Hereinafter, in the present embodiment, the spatial model will be described as an inundation prediction result (specifically, an inundation depth calculated by the inundation simulation) by the inundation simulation. Of course, this inundation simulation is not limited to those caused by the tsunami, may be as water simulation immersion by the internal water-external water flooding, or not limited to the case of a spatial model and inundation prediction result, the embankment plan, such as bridges and buildings structure Various plans such as product plans can also be used as spatial models.

  FIG. 1 is an explanatory diagram in which a composite image 5 obtained by superimposing a real image 3 and a virtual space image 4 is actually displayed on the monitor 2 (display unit) of the terminal-side device 1. Here, the scenery of a residential area is acquired as a live-action image 3 by an image acquisition unit (not shown) of the terminal-side device 1, and a virtual space image composed of a flooded surface 4 a and a flooded wall surface 4 b by an image creation unit (not shown). 4 has been created. In this way, the predicted inundation situation is superimposed and displayed on the actual landscape in front of you.

  Hereinafter, each element will be described in detail.

(Terminal device)
As described above, the terminal-side device 1 includes image acquisition means, position measurement means, posture measurement means, image creation means, display means, and terminal-side transmission / reception means. Image forming means is a means which is mainly carried out by the ground model generating function and the image creation functions of the composite image display program of the present invention, specifically to store these functions and computer to execute (a computer ). As the terminal-side device, for example, a mobile phone or a tablet computer (for example, a smartphone) can be used. In addition to computers, mobile phones and tablet computers include digital cameras (video) as image acquisition means, GPS (Global Positioning System) as position measurement means, geomagnetic sensors (electronic compass) as attitude measurement means, monitors as display means, This is because terminal-side transmission / reception means and the like are installed. Of course, the terminal device may be created by modifying the digital camera (adding insufficient means, etc.), or a dedicated terminal device can be newly created for the present invention.

1. Image acquisition means The image acquisition means (not shown) can acquire an image, and a digital camera can be cited as a typical example. This image acquisition means is mounted on the terminal-side device 1, and as this mounting method, it may be built-in or may be detachable externally. On the monitor, a scene in the direction toward the image acquisition means is always displayed, and is displayed in a so-called live view that is displayed following the movement of the image acquisition means. Of course, it can also be acquired as a still image by operating the shutter. The image acquired by the shutter operation by the image acquisition means is stored in the terminal side device 1. Or the image of the live view state displayed on the monitor 2 can be regularly and automatically cut out and stored in the terminal device 1 each time.

2. Position measurement means The position measurement means (not shown) acquires the position of the image acquisition means. The position here is a plane position or a combination of a plane position and an altitude. The plane position is a two-dimensional coordinate. In (X, Y), the combination of the plane position and the altitude can be expressed by three-dimensional coordinates (X, Y, Z). Of course, latitude and longitude, or latitude, longitude and elevation may be used. The position measurement means is typically GPS, but in addition, a positioning method that uses a wireless LAN access point (such as Place Engine), a positioning method that uses visible light communication that transmits LED blinking as a signal, indoors Positioning method to acquire position information from IMES (Indoor Messaging System), QR code (registered trademark) , visual marker (marker used in ARTToolKit), RFID tag, etc. Known positioning techniques such as the positioning method used can be used. Of course, various positioning methods can be used in combination, such as GPS for outdoor use and a wireless LAN system for indoor use.

3. Posture Measurement Unit The posture measurement unit (not shown) acquires the posture of the image acquisition unit, and the posture here means the direction in which the image acquisition unit is facing and the inclination. More specifically, assuming that the horizontal axis on the horizontal plane is the X axis, the longitudinal axis of the horizontal plane is the Y axis, and the vertical axis is the Z axis, the rotation ω (pitch) around the X axis and the rotation φ (roll) around the Y axis The rotation κ (yaw) around the Z axis is an element that determines the posture. The posture measuring means is typically a geomagnetic sensor (electronic compass) that measures rotation κ around the Z axis, that is, an azimuth, or an acceleration sensor that measures rotation ω around the X axis or rotation φ around the Y axis. Other known techniques such as a gyro sensor can also be used. Since a mobile phone terminal incorporating a so-called 6-axis sensor and incorporating both an electronic compass and an acceleration sensor is also commercially available, it is preferable to use such a terminal.

4). Image creating means The image creating means (not shown) creates a virtual space image 4 by imaging a space model corresponding to the imaging point (current position). This spatial model is stored in the storage unit of the server side device, but when the plane position data of the imaging point measured by the position measurement unit is sent to the server side device, it is extracted based on the plane position data. Since the space model is returned, the terminal device 1 can also acquire the space model.

  In the present embodiment, the space model is a flooding prediction result, and actually the flooding depth is returned from the server side device. A method for creating the virtual space image 4 based on the inundation depth at the imaging point will be described in more detail with reference to FIG.

  FIG. 2 is an explanatory diagram for explaining a method of creating a ground model. FIG. 2 shows a state in which the ground surface G has been submerged, and the difference in height between the submerged surface s and the ground surface G is the submergence depth h. This state is imaged by the image acquisition means placed at the position of the imaging height e. An image of an object (in this case, the ground or a flooded state) imaged by the image acquisition unit is acquired as image information (for example, RGB values) in pixel units on a ccd image sensor (so-called imaging surface) through a focal point o. As can be seen from this figure, the angle of view α differs depending on the focal length f from the focal point o to the ccd image sensor and the ccd size D (that is, the size of the imaging surface), that is, the imaging range is different. It can also be seen that the range to be imaged varies depending on the imaging height e and the posture (pitch ω) of the image acquisition means. In the case of FIG. 2, the imaging range L is displayed on the monitor 2 of the image acquisition means.

Usually, since the focal length f, ccd size D, and angle of view α of the image acquisition means can be obtained in advance as the camera model, if the imaging height e and posture (pitch ω) of the image acquisition means are known, the imaging range L Can be requested. 2 shows a cross-sectional view in the vertical direction, but the same can be said in a plan view. Therefore, if the imaging height e and the posture of the image acquisition means are known, the horizontal direction (the drawing depth in FIG. Direction) imaging range can also be obtained. The Attitude of the image acquisition means can in use of a measure in a posture measuring means for imaging the height e of the image acquisition unit can be easily measured at the time of imaging. As the imaging height e of the image acquisition means, for example, an estimated value such as 1.5 m can be used.

  Further, assuming that the ground surface G is horizontal, the distance from the actual imaging point can be obtained for an arbitrary point on the ground surface displayed on the monitor 2. This is the ground model creation function in the composite image display program. Therefore, as shown in FIG. 3, a ground model 6 in which the ground surface G is modeled can also be created. As shown in this figure, the ground model 6 calculated based on the focal length f, the ccd size D, the angle of view α, the imaging height e of the image acquisition means, and the posture is a perspective view expressing the perspective. In FIG. 3, the ground model is a grid having a plane right angle. However, the present invention is not limited to this, and various modeling such as a concentric mesh can be employed.

If a ground model can be created, it is possible to calculate the shape of the inundation surface s that extends upward from the ground surface G by the inundation depth h on the monitor 2. Since the shape on the monitor 2 calculated here is calculated according to the focal length f, the ccd size D, the angle of view α, the imaging height e of the image acquisition means, and the posture, the perspective is similar to the ground model 6. It becomes the expressed perspective view. In general, for such calculation, general-purpose software using a language such as DirectX (registered trademark) or OpenGL (registered trademark) is used. The virtual space image 4 is a shape formed by the lines and surfaces of the calculated shape. This is an image creation capabilities of the composite image display program. When the virtual space image 4 is composed of a surface, it can be variously devised so that it can be easily recognized by coloring this surface, arranging a pattern, combining the pattern and the color, making the color translucent, etc. .

  Moreover, the virtual space image 4 of the flood prediction result can be composed of the flooded surface s and the flooded wall surface k (FIG. 4) so that the flooded situation can be recognized more easily. FIG. 4 is a model diagram for explaining the flooded wall surface k in the flooded state. As shown in FIG. 4, if it is assumed that only the periphery of the photographer is not flooded, the photographer can see the flooded wall surface k which is a cross section in the flooded state. The flooded wall surface k is provided at a position away from the photographer by a predetermined distance (L1 in FIG. 2). For example, the predetermined distance can be set in a range of 5 m to 10 m.

The virtual space image 4 shown in FIG. 1 is also composed of a flooded surface s and a flooded wall surface k. The flooded surface s is created as a virtual space image 4a of the flooded surface, and the flooded wall surface k is created as a virtual space image 4b of the flooded wall surface. Yes. In this case, a virtual space image 4a flooded surface, the virtual space image 4b flooded wall, if something different each coloring or patterns, it is preferable to easily recognize further inundation situations. Of course, the virtual space image 4a of the submerged surface and the virtual space image 4b of the submerged wall surface can be the same color or pattern, respectively, or the virtual space image 4b of the submerged wall surface can be omitted and the virtual space image of the submerged surface can be omitted. It is also possible to create the virtual space image 4 using only 4a.

(Server side device)
As described above, the server side device (not shown) includes the storage unit, the extraction unit, and the server side transmission / reception unit. The extracting means is a means that is executed mainly by the planar position reading function and the search function in the composite image display program of the present invention, and is specifically constituted by a computer that stores and executes these functions.

1. Storage means The storage means (not shown) is capable of storing a plurality of spatial models. The spatial model in the present embodiment will be described in the case where it is created by dividing a predetermined region having a planar extension into planes. That is, one unit obtained by dividing a predetermined area into planes is a mesh, and each mesh is given a water immersion depth is a spatial model. That is, a spatial model is created for each mesh, and a large number of meshes are obtained by dividing a predetermined region into planes. As a result, a large number of spatial models are stored in the storage means. The space model composed of the mesh and the inundation depth is usually stored in the storage means as a database. In addition, this water immersion depth is obtained as a result of the water immersion simulation as described above.

  The plane position coordinates of the mesh obtained by dividing the predetermined area into planes are set so that the range can be specified. Alternatively, a representative point (for example, a center point) is provided in the mesh, and plane position coordinates are set. Thus, each mesh is associated (linked) with a planar position, ie, each spatial model is associated with a planar position. Thereby, when the plane position of the imaging point is specified, it becomes possible to select a spatial model corresponding to this.

2. Extraction Unit The extraction unit (not shown) extracts a target spatial model from a large number of spatial models stored in the storage unit. The target spatial model is a spatial model corresponding to the planar position of the imaging point, more specifically, a mesh spatial model including the planar position of the imaging point, or closest to the planar position of the imaging point. It is a mesh spatial model with representative points.

  When the plane position of the imaging point transmitted from the terminal side transmission / reception means of the terminal side device 1 is received by the server side transmission / reception means of the server side apparatus, the plane position reading function reads the plane position of the imaging point, and this plane position is a clue. The search function searches the target spatial model. At this time, if the number of space models (mesh) is enormous, all the space models must be queried, so the search time becomes long and the server side device is heavily loaded. In such a case, if you create a tile that collects a predetermined number of meshes and clarify the plane range of this tile, when searching for the plane position as a clue, first search for the corresponding tile, Since it is sufficient to query the mesh contained therein, the search time is shortened and the load on the server side device can be reduced.

(Example of use)
A usage example of the present invention in this embodiment will be described below.

1. Terminal Side Device As shown in FIG. 5, the terminal side device 1 is directed in the target direction, and the target range is displayed on the monitor 2. In this state, the position measurement unit measures the planar position of the image acquisition unit, and the posture measurement unit measures the attitude of the image acquisition unit. The timing (so-called trigger) at which this measurement is performed can be provided with a means (button or touch panel) for instructing measurement, or can be configured to measure automatically and periodically.

  The posture measured by the posture measuring means is stored in the terminal device 1. Note that the imaging height of the image acquisition means can be stored in advance in the terminal-side device 1 as a fixed value (for example, 1.5 m), or is measured locally and input to the terminal-side device 1. You can also. The planar position measured by the position measuring unit is transmitted to the server side device by the terminal side transmitting / receiving unit. This timing can also be provided with a means for instructing transmission (button or touch panel), or can be configured to automatically transmit after measurement.

2. Server side apparatus When the server side transmitting / receiving means receives the planar position (imaging point) of the image acquisition means, the planar position of the imaging point is recognized by the planar position reading function of the composite image display program. Using this plane position as a clue, the search function of the composite image display program searches and extracts a target space model from a database (configured with plane-divided meshes and inundation depths) stored in the storage means. The space model extracted by the extracting unit is transmitted to the terminal side device by the server side transmitting / receiving unit.

3. Terminal side apparatus When the spatial model is received by the terminal side transmission / reception means, the camera specifications such as the focal length f, the ccd size D, and the angle of view α of the image acquisition means stored in advance are read, and the posture and image measured by the posture measurement means The imaging height of the acquisition unit is also read. Based on these information, ground model is created by the ground model generating function of the composite image display program, a virtual space image is generated by the image creation functions. Then, the virtual space image is superimposed and displayed on the real image displayed on the monitor 2 by the image display function.

(Embodiment 2)
A second embodiment of the composite image display device and the composite image display program of the present invention will be described below with reference to the drawings. The present embodiment is for explaining a case where the spatial model is configured by the mesh and the elevation of the flooded surface instead of the spatial model configured by the mesh and the flooded depth in the first embodiment. The description regarding the technical contents common to 1 is omitted.

  FIG. 6 is an explanatory diagram showing the depth of flooding and the elevation of the flooded surface. As shown in this figure, the difference in height between the ground surface and the flooded surface is the flood depth h, and the elevation of the flooded surface is obtained by adding the flood depth h to the altitude z of the ground surface. In the present embodiment, since the space model stored in the storage means does not have the inundation depth, it is necessary to calculate the inundation depth in order to create a virtual space image.

  Therefore, in this embodiment, the altitude z (FIG. 6) of the image acquisition unit is measured by the position measurement unit. The altitude of the ground surface can be obtained by subtracting the imaging height e (FIG. 2) from the measured altitude z of the image acquisition means. Further, the inundation depth is calculated by obtaining the difference between the altitude of the ground surface and the altitude of the inundated surface of the spatial model. A virtual space image is created based on the inundation depth calculated here. This point is different from the first embodiment.

(Example of use)
A usage example of the present invention in this embodiment will be described below.

1. Terminal Side Device As shown in FIG. 5, the terminal side device 1 is directed in the target direction, and the target range is displayed on the monitor 2. In this state, the position measurement unit measures the planar position and altitude of the image acquisition unit, and the posture measurement unit measures the posture of the image acquisition unit. The timing (so-called trigger) at which this measurement is performed can be provided with a means (button or touch panel) for instructing measurement, or can be configured to measure automatically and periodically.

  The posture measured by the posture measuring means is stored in the terminal device 1. Note that the imaging height of the image acquisition means can be stored in advance in the terminal-side device 1 as a fixed value (for example, 1.5 m), or is measured locally and input to the terminal-side device 1. You can also. The planar position measured by the position measuring unit is transmitted to the server side device by the terminal side transmitting / receiving unit. This timing can also be provided with a means for instructing transmission (button or touch panel), or can be configured to automatically transmit after measurement.

2. Server side apparatus When the server side transmitting / receiving means receives the planar position (imaging point) of the image acquisition means, the planar position of the imaging point is recognized by the planar position reading function of the composite image display program. Using this plane position as a clue, the search function of the composite image display program searches and extracts a target spatial model from a database (configured with plane-divided meshes and flooded surface elevations) stored in the storage means. The space model extracted by the extracting unit is transmitted to the terminal side device by the server side transmitting / receiving unit.

3. Terminal side apparatus When the spatial model is received by the terminal side transmission / reception means, the camera specifications such as the focal length f, the ccd size D, and the angle of view α of the image acquisition means stored in advance are read, and the posture and image measured by the posture measurement means The imaging height of the acquisition unit is also read. Based on these pieces of information, a ground model is created by the ground model creation function of the composite image display program. Further, the image creation stage means (image creation function), the submerged surface elevation with the space model, and elevation of the image acquisition means which is measured by the position measuring means, and an imaging height of the image acquisition means, depth immersion by the A virtual space image is created based on the camera specifications and the like. Then, the virtual space image is superimposed and displayed on the real image displayed on the monitor 2 by the image display function.

[Other Embodiments]
The adult image display device of the present invention is not limited to the case where the device is divided into a terminal side device and a server side device, but all means (image acquisition means, position measurement means, posture measurement means, storage means, extraction means, image creation) And a computer that stores and executes a composite image display program can be provided in a single apparatus. In this case, the server side transmission / reception means and the terminal side transmission / reception means can be omitted.

  The image composition system of the present invention can be used not only for inundation prediction due to tsunami but also when displaying the result of inundation prediction due to inundation or inundation. Further, the present invention can be applied to superimposing and displaying various plans such as embankment plans, structure plans such as bridges and buildings, etc. on actually captured images.

DESCRIPTION OF SYMBOLS 1 Terminal side device 2 Monitor (of terminal side device 1) 3 Actual image 4 Virtual space image 4a Virtual space image 4a of the flooded surface Virtual space image 5 of the flooded wall 5 Composite image 6 Ground model α Angle of view D ccd size e Image acquisition means Imaging height f Focal distance G Ground surface h Inundation depth k Inundation wall L Imaging range L1 Predetermined distance from the photographer o Focus s Water surface z Elevation ω (of the ground surface) Pitch φ (of the attitude of the image acquisition means) Roll κ (out of image acquisition means) Yaw (out of image acquisition means)

Claims (6)

A composite image display device that superimposes and displays a virtual space image on a real image obtained by imaging a real space,
Image acquisition means for acquiring the live-action image;
A position measuring means for measuring the planar position of the image acquisition unit,
A posture measuring means for measuring the orientation of said image acquiring means,
Storage means for storing a spatial model in which a water immersion depth is given to a plurality of meshes obtained by dividing a predetermined region into planes ;
Extracting means for extracting a mesh spatial model corresponding to the planar position measured by the position measuring means;
Image creating means for creating the virtual space image based on the space model extracted by the extracting means;
Display means for displaying the live-action image and the virtual space image in a superimposed manner,
Said image forming means includes an imaging height of the image acquisition unit, a posture of the image acquisition means which is measured by the position measuring means, performs arithmetic processing on the basis of the so that the perspective view in the display means A composite image display device characterized by creating a virtual space image. A composite image display device that superimposes and displays a virtual space image on a real image obtained by imaging a real space,
Image acquisition means for acquiring the live-action image;
A position measuring means for measuring the flat position and altitude of the image acquisition unit,
A posture measuring means for measuring the orientation of said image acquiring means,
Storage means for storing a spatial model in which the elevation of the submerged surface is given to a plurality of meshes obtained by dividing a predetermined region into planes ;
Extracting means for extracting a mesh spatial model corresponding to the planar position measured by the position measuring means;
An inundation model is created based on the elevation of the inundation surface of the spatial model extracted by the extraction means, the elevation of the image acquisition means measured by the position measurement means, and the imaging height of the image acquisition means. And image creation means for creating the virtual space image based on the flooded model ;
Display means for displaying the live-action image and the virtual space image in a superimposed manner,
Said image forming means includes an imaging height of the image acquisition unit, a posture of the image acquisition means which is measured by the position measuring means, performs arithmetic processing on the basis of the so that the perspective view in the display means A composite image display device characterized by creating a virtual space image. Wherein the virtual space image generated by the image generating means, submerged surfaces and consists of flooding the wall, it composite image display apparatus according to claim 1 or claim 2, wherein. It consists of a terminal side device and a server side device,
The terminal device includes a said image acquiring means, said position measuring means, the position measuring means, the display means, the image creating device, a terminal side transmitting and receiving means, and
The server side device includes the storage unit, the extraction unit, and a server side transmission / reception unit,
The terminal side transmission / reception means transmits the planar position measured by the position measurement means,
The server-side transmission / reception means receives the plane position measured by the position measurement means, and transmits the spatial model extracted by the extraction means,
Further, the terminal side transmitting and receiving means, the composite image display apparatus according to any one of claims 1 to 3 wherein receiving the extracted spatial model extracting means, characterized in that. A composite image display program for causing a computer to realize a function of superimposing a virtual space image on a real image obtained by capturing a real space and displaying it on a display means,
A plane position reading function for reading the plane position of the image acquisition means for capturing the photographed image;
Based on the plane position of the image acquisition means , a search function for searching a spatial model corresponding to the plane position from a database configured by giving a flood depth to each mesh obtained by dividing the predetermined area into planes;
Based on the imaging height and posture of the image acquisition means, a ground model creation function for creating a ground model that models the ground surface;
It said ground model, the immersion depth of the space model found by the search function, performs arithmetic processing based on an image creation functions to create the virtual space image to be a perspective view in the display means ,
An image display function for superimposing the virtual space image on the real image and displaying the image on the display means is realized by a computer.
The composite image display program, wherein the ground model is formed on the photographed image displayed on the display means. A composite image display program for causing a computer to realize a function of superimposing a virtual space image on a real image obtained by capturing a real space and displaying it on a display means,
A plane position reading function for reading the plane position and altitude of the image acquisition means for capturing the photographed image;
A search function for searching a spatial model corresponding to the planar position from a database configured by giving elevation of the flooded surface to each mesh obtained by dividing the predetermined area into planes based on the planar position of the image acquisition means; ,
Based on the imaging height and posture of the image acquisition means, a ground model creation function for creating a ground model that models the ground surface;
Based on the ground model, the elevation of the flooded surface of the spatial model retrieved by the retrieval function, the elevation of the image acquisition means read by the planar position reading function, and the imaging height of the image acquisition means An image creation function for performing arithmetic processing and creating the virtual space image so as to become a perspective view on the display means;
An image display function for superimposing the virtual space image on the real image and displaying the image on the display means is realized by a computer.
The composite image display program, wherein the ground model is formed on the photographed image displayed on the display means.

Images