JP3898212B2 - Position providing photo providing system and program thereof - Google Patents

Description

  The present invention relates to a site photo with position and orientation transmitted by adding the position, shooting direction, and time information to a site photo of disaster, travel, construction, etc., with a direction at a glance on a map or a digital photo image. The present invention relates to a method for providing a photograph with a position and orientation that can be provided in a format in which the position is known.

  Various natural disasters have occurred in each region, and many people have been sacrificed, and many lessons have been left behind. There are many landslide disasters and landslide damages among these disasters. Contributing to the smooth execution of on-site command and orders, etc., continuously disseminating information to nearby residents in high-risk locations in advance, and the damage status The importance of early grasping is increasing.

  Based on this situation, various attempts have been made such as the use of digital cameras and the introduction of GIS in order to advance the work and save labor in the sabo project.

  For example, Japanese Patent Laid-Open No. 2000-30175 (hereinafter referred to as Patent Document 1) is disclosed as a system that conveys the situation of the site to the disaster prevention center by video and audio.

  In this system, a helmet is equipped with an image acquisition function and a voice communication function, and maintenance personnel wear this helmet, and transmit images and situations of the site to the disaster prevention center by voice. Specifically, a camera and a radio device are attached to the helmet, and a receiver is provided for each area. When the receiver receives the image of the camera from the radio device, the area is specified at the monitoring center.

Japanese Patent Laid-Open No. 2004-289670 (hereinafter referred to as “Patent Document 2”) solves that a viewer to whom an image is distributed does not know the shooting position and shooting direction of the camera. The center provides the viewer with the camera position and orientation by associating the map position with the identification information from the camera. On the center side, the camera position and orientation are developed on a map and provided to the viewer.
JP 2000-30175 A JP 2004-289670 A

  In general, when a disaster occurs, the photograph is taken at the site after the disaster occurs, and the photograph is analyzed at the center or provided to the resident / administrator.

  In the event of a disaster, it is necessary to promptly provide the administrative staff with images at the time of the disaster.

  Even if an image is provided immediately, the person in charge of the administration cannot make an accurate judgment unless the user knows where the image was taken and from which direction.

  In order to solve such a problem, the above patent document has been filed.

  For example, in Patent Document 1, a camera and a wireless device are attached to a helmet, and a receiver is provided for each area. When this receiver receives a camera image from the wireless device, the area is identified by the monitoring center. However, even if the image can be transmitted, the area can be specified, but the location cannot be specified in detail, and the direction in which the image is taken is unknown.

  On the other hand, Patent Document 2 defines a camera position that associates an identification code of a camera with a position on a map and delivers an image to a position on the map when the identification code is transmitted. Therefore, when the camera is moved, since the center stores the camera position as fixed information, the moved camera position cannot be defined on the map of the center.

  On the other hand, in the event of a disaster, an operator carries a camera to get the image of the disaster site and heads for the site, where the most damaged place is, and where it seems to be dangerous I will move and take a picture.

  However, since the camera position is fixed in Patent Document 2, it cannot be applied to such a system for acquiring an image at the time of a disaster.

  In addition, in order to give an accurate instruction to residents after a disaster occurs, it is possible to make an accurate judgment and analysis not only at the disaster site but also when there are images of each point in a wide range. Moreover, it is common to take an image after a disaster while moving.

  However, since the cited document 2 is based on the premise that the camera is fixed, the cited document 1 can specify the shot area, so that a plurality of shooting positions and directions while moving can be seen at a glance on a map or aerial photograph. There was a problem that it could not be provided by.

  Further, in the event of a disaster, past images of other points of the disaster location may be referred to. However, Cited Documents 1 and 2 only display an icon that indicates the current shooting direction at which the disaster occurred, and therefore do not display from which direction there are past images taken at other points. .

  For this reason, even if there are past images at other points, there is a problem that it takes a very long time because it must be searched manually.

    The present invention has been made in order to solve the above-mentioned problems, and a set of photographs, positions, orientations, and time information is provided from the site side, and these photographs (tourism, construction work) are displayed on a map. The purpose is to obtain a system that can be provided to viewers in a format where the position and direction of the site and disaster site can be understood at a glance.

  In the present invention, a photograph image with photographing identification information obtained by capturing an object and adding photographing identification information including at least time information, a photographing direction, and a photographing position to the photograph image is attached to a portable terminal with a digital camera. This is a photo providing system with a position orientation in which an IC card is transmitted to a server of a monitoring center, and the server of the monitoring center provides a map or digital photo image including the shooting position on the screen of the terminal.

The IC card is
It is attachable to the portable terminal, has a position information acquisition function, a shooting direction acquisition function, a communication function, and a time information measurement function, and when the object is shot with the portable terminal, a photographic image is synchronized with the shooting. In addition, the photographic image is combined with shooting identification information that combines the position information of the position information acquisition function, the shooting direction of the shooting direction acquisition function, and the time information of the time information measurement function, and this is combined with the photographic image. Means for transmitting to the server of the monitoring center.

The monitoring center server is:
A first database storing a map to which latitude and longitude are allocated; a second database storing the photograph image with shooting identification information; and a shooting icon in which a mesh group is defined for each time information and in a map coordinate system. A third database in which the figure is stored,
Means for storing the photographic image with shooting identification information in the second database and searching the map including the shooting position of the photographic image with shooting identification information from the first database; In addition, means for defining the shooting position of the photographic image with the shooting identification information in the third database in the coordinate system on the searched map for each time information,
The photographing direction of the photographic image with photographing identification information is read, the photographing direction is defined in the mesh group, and a photographing icon with an arrow according to the direction is generated in the mesh at the defined position to generate the time information. When the position is specified, a means for obtaining the shooting icon diagram for each time, and when the position is specified, an integrated shooting icon diagram is generated by combining the shooting icon diagrams for each time information having the position, and the integrated shooting icon diagram and the specified The present invention includes a means for extracting a map of the first database having a specific position, obtaining an image with a shooting position / direction icon obtained by synthesizing the extracted map, and displaying the image on a screen.

  The program for providing a photograph with position orientation of the present invention reads a photograph image with photographing identification information obtained by adding photographing identification information including at least time information, a photographing direction, and a photographing position to a photograph image, and displays it on a map or a digital photograph image. Is a program for displaying an icon indicating the direction of the photographing identification information.

On the computer,
Means for storing in a first database a map assigned latitude and longitude;
Means for storing the photographic image with photographing identification information in a second database;
Means for storing, in a third database, shooting icon diagrams in which mesh groups are defined for each time information and in a coordinate system of a map;
Means for storing the photograph image with photographing identification information in the second database, and searching the first database for a map including a photographing position of the photograph image with photographing identification information;
Each time the map is searched, means for defining the shooting position of the photographic image with shooting identification information in the third database in the coordinate system on the searched map for each time information ,
The photographing direction of the photographic image with photographing identification information is read, the photographing direction is defined in the mesh group, and a photographing icon with an arrow according to the direction is generated in the mesh at the defined position to generate the time information. Means for obtaining each shooting icon diagram;
When a position is specified, an integrated shooting icon diagram is generated by combining the shooting icon diagrams for each time information having the position, and this integrated shooting icon diagram and the map of the first database having the specified position are generated. Is a program for providing a photograph with a position and orientation for executing a function as a means for obtaining an image with a shooting position / direction icon obtained by synthesizing the extracted map and displaying it on a screen.

  As described above, according to the present invention, the photographic images with the shooting direction provided by the monitoring center server are stored for each time information, and the shooting icon diagram for each time information is generated, and the shooting icons for each time information are generated. An integrated shooting icon diagram is generated by combining the diagrams.

  Then, an image with a shooting position / direction icon obtained by combining this integrated shooting icon diagram and a map (aerial image) is displayed on the screen, and when the shooting icon on this image is selected, linked shooting is performed. Display a photographic image with direction on the shooting icon.

  For this reason, the supervisor can immediately know from which position and in what direction the photograph is taken in the past and present on the map.

  The present embodiment will be described as a system that acquires an image at the time of a disaster and provides it to the center.

<Embodiment 1: Displaying a large number of icons with shooting directions on a map or digital photograph image>
FIG. 1 is a schematic configuration diagram of a photograph providing system with position and orientation according to the first embodiment. In the system of FIG. 1, a person in charge of photography Ai uses, for example, an on-site photograph transmission mobile terminal 1 with a position and orientation, which will be described later, for example, a photographic image Bi and a position Ci of a disaster site (in addition to a construction site, travel, observation, etc.). A photograph image Hi with photographing identification information including a photographing direction θi, date, time (hereinafter referred to as time information Di), photographer name, and the like is provided to the central center by radio or storage medium to the central center (also referred to as a monitoring center) The central center generates an icon indicating the shooting direction and position, stores the icons separately for each time information, and stores all the direction position providing icons Pi on the map or digital aerial image of the shooting position. Display all. As a result, it is possible to grasp at a glance how many photographs have been taken from what position and from what position on the map or digital aerial photograph image displayed on the screen.

  Then, by selecting the direction position providing icon Pi, the photo image Hi with the shooting identification information with the shooting position Ci, the shooting direction θi, and the time information Di associated with the icon is opened on the screen. That is, it can be understood from which position and from what direction and when.

  As shown in FIG. 1, the above-mentioned on-site photo transmitting portable terminal 1 with position and orientation includes a camera-equipped mobile phone 3 to which an IC card (2, 7, 11) having an orientation sensor function, a GPS function, and a storage function can be attached. , A digital camera 6 on which a digital camera IC card 5 having a direction sensor function, a GPS function, a communication function, and a storage function can be mounted, and a PDA IC card 7 having a direction sensor function, a GPS function, a communication function, and a storage function, or digital The camera 9 is a generic name for the helmet 9, which includes the terminal 10, the microphone 13, and the like.

  Further, the terminal 10 of the helmet 14 operates by mounting the terminal IC card 11. This terminal IC card includes a GPS function, a storage function, an orientation sensor function, a communication function, a storage function, a display for displaying an image of a digital camera, and the like.

    Further, as shown in FIG. 1, the on-site photo providing system with position and orientation is connected to a central center server 21 via a communication network 20, and this server 21 includes an editing personal computer 25 and a survey report personal computer. 25, connected to a personal computer 24 for map display and a personal computer 23 for digital photography. These personal computers have a browser function, a database connection function, and the like.

  Then, the server 21 reads the photographic identification information of the photographic image Hi with the photographic identification information from the on-site photo transmission portable terminal 1 via the communication network 20 and provides the directional position indicating the photographic direction of this photographic identification information. An icon Pi (also referred to as a shooting icon) is generated, and a shooting point direction map Ri defined by associating the icon with the photo image Bi is generated separately for each time information.

  Then, all stored shooting point direction maps Ri (R1, R2,...) Are provided (sent out) to the personal computer with images Mi with shooting position / direction icons synthesized with a map of this area or a digital aerial photograph. indicate.

(Central server configuration)
Next, the configuration of the central center server 21 will be described.

  FIG. 2 is a schematic configuration diagram of the server 21 of the system according to the first embodiment. The server 21 includes an image storage unit 31 that stores, in the database 30, a photograph image Hi with photographing identification information from the on-site photo portable terminal 1 with position and orientation, and a map database 32 that stores a map in which latitude and longitude are defined. Yes. Digital aerial photographs are stored in a separate database (not shown).

  As shown in FIG. 3, in the photographic image Hi with photographing identification information, photographing identification information Ki including a position Ci, a photographing direction θi, and time information Di is written in a predetermined area of the photographic image. Further, when the IC card transmits the photograph image Hi with photographing identification information, it is transmitted in a format in which the photographing identification information Ki is also written in the header.

  The above-described map database 32 stores a map of 1/25000, 15000/1, 10000/1, 1/5000, and 1/500.

  Further, as shown in FIG. 2, the server 21 includes an image machine unit 31, an area search unit 33, a region-specific shooting direction map memory generation unit 34, a shooting point direction map creation unit 35, and a link unit 37. A memory 36 in which a mesh for shooting direction maps for each region is generated, a database 38 for storing shooting point direction maps Ri for each region, a combining unit 40, and an integrated shooting icon map Qi for each region are stored. A database 41, a display composition unit 43, a photo reading unit 44, and the like.

  Each time the image storage unit 31 receives a photographic image Hi with photographing identification information, it stores it in the database 30. At this time, header information is also associated and stored.

  For example, when an area (for example, Nagano prefecture, .., group, town, and district) and a scale are specified from the personal computer 25, the area search unit 33 has a shooting position Ci included in the area of this area, and A map of a specified scale (for example, 1/5000) is allocated from the database 32.

  Then, the coordinate system of this area (such as matching the mesh interval) is notified to the area-specific shooting direction diagram memory creation unit 34. For example, when the designated area is the A district, it is determined whether or not the mesh form 36a for the regional shooting direction map for the A district has been created.

  The region-specific shooting direction map memory creation unit 34 determines whether or not a mesh form for the region-specific shooting direction map of the specified area has been generated in the memory 36. A mesh for the shooting direction map for each region is generated in the memory 36 in the coordinate system of the scale of the map obtained.

  When the area and scale are input from the personal computer 25, for example, the shooting point direction map creation unit 35 searches the database 30 for all photo images with shooting identification information having shooting positions in this area. Then, the time information Di (year / month / day, time) of the retrieved photograph image with photographing identification information Hi is read, and the photographing point direction map Ri corresponding to the time information Di is generated in the database 38.

  For example, the database 38 generates shooting point direction map mesh forms (files) 38a, 38b,... For generating shooting point direction maps Ri for each region (A region, B region...). .

  That is, in the mesh form for the shooting point direction map for each region, the shooting point direction map Ri for each time information Di of the mesh interval based on the scale is generated.

    The shooting point direction Ri described above defines, for example, a camera icon (direction position providing icon) shown in FIG. 6, and the shooting direction is indicated by an arrow.

  The arrow indicating the shooting direction assigns the photographic image Hi with shooting identification information stored in the database 30 and reads the shooting position Ci. Then, after finding the mesh position of the shooting point direction map Ri corresponding to the shooting position Ci and defining the shooting icon Pi at this position (direction position definition icon Pi), the arrow icon is rotated based on the shooting direction θi. Define by connecting to the shooting icon.

  The shooting point direction map creation unit 35 reads the shooting position, shooting direction, and time information of the header portion of the photo image with shooting identification information Hi, and the vicinity of the direction position providing icon Pi corresponding to the shooting position and shooting direction. The read shooting direction and time information are written in (the shooting position is written if necessary).

  When the area is specified, the combining unit 40 assigns mesh forms R1, R2,... For shooting point direction maps corresponding to the area, and combines all shooting point direction maps of these mesh forms. The integrated photographing direction point diagram Qi is stored in the database 41.

  Each time the integrated shooting direction point diagram Qi is stored in the database 41, the linking unit 37 reads the position of the icon Pi in this point diagram Qi, and stores the photograph image Hi with shooting identification information having this position information in the database 30. The photographic image Hi with photographing identification information is stored in the database 42, and link information obtained by linking the address (database 42) and the icon Pi is stored in the database 42.

  When an area (also referred to as an area) and a scale are specified, the display synthesis unit 43 reads the specified map from the database 32 and also reads the integrated shooting point direction map Qi corresponding to the specified area from the database 41 and specifies it. An image Mi with a shooting position / direction icon synthesized with the map is generated, converted into a specified image size, and displayed on the display unit.

  When the icon Pi on the screen is designated, the photo reading unit 44 reads the photo image with photo identification information Hi linked to the designated icon from the database 42 and displays it on the screen as shown in FIG. (In FIG. 8, a photographic image Hi with photographing identification information is displayed on the digital aerial photograph).

(Description of system operation)
The operation of the above-mentioned photo providing system with position and orientation will be described with reference to the sequence diagram of FIG.

    For example, a worker operates the on-site photo transmission terminal device 1 with a position and orientation to photograph a disaster site. In synchronization with the shutter signal at this time, the shooting direction θi, position information Ci (XYZ), and current time information Di are written at predetermined positions of the photographic image Bi and stored in the memory of the IC card.

  This IC card is configured, for example, as shown in FIG. FIG. 5 is a schematic configuration diagram of the mobile IC card.

  As shown in FIG. 5, the portable IC car 50 has a U-shape so that the communication card 51 can be mounted, and a position measuring unit 53 with a built-in GPS function is provided on the upper arm unit 52 a side. Is built-in. Further, a polar direction sensor 55 is built in the lower arm portion 52b. Then, the IC card 50 is mounted from, for example, a digital camera mounting opening (not shown). As a result, the surface of the IC card 50 is perpendicular to the optical axis of the digital camera lens.

    The lower arm portion 52b has a polar sensor 55. The polar sensor 55 detects the N pole or the S pole.

  Further, the main unit 59 includes a port unit 60 for inputting a photographic image and instruction information from a portable terminal (for example, a digital camera), a shooting direction calculation unit 61, a hard disk unit 62 (hereinafter referred to as HDD 62), and a communication unit. It has a port unit 63 for transmitting / receiving data to / from the IC card 51, a CPU unit 64, a ROM 65, a timer (not shown), and the like.

  The HDD 62 stores a photographic image Bi from the digital camera. In addition, a photograph image Hi with photographing identification information in which photographing identification information Ki including a photographing direction θi, a photographing position Ci, and time information Di is written on the photograph image Bi is stored.

  The shooting direction calculation unit 61 obtains the surface direction of the IC card with the shooting position / direction based on the polar direction detected by the polar direction sensor 55 (shooting direction). That is, the lens direction of the digital camera is obtained (this is called the shooting direction θi).

  Further, the position measuring unit 53 obtains a position according to the GPS signal, and outputs this as a photographing position Ci.

  The CPU unit 64 takes in a shutter signal from the digital camera. Then, in response to the input of the shutter signal, the photographing direction calculation unit 61, the position measurement unit 53, and the timer are activated and read. Further, the photographic image Bi is stored in the HDD 62 with the input of the shutter signal. Then, the shooting direction θi calculated by the shooting direction calculation unit 61 (e.g., northeast, northwest, southeast / north, south / eight, or 16 directions), the shooting position Ci obtained by the position measurement unit 53, and the timer The current time information Di is input and combined.

  Shooting identification information Ki including the shooting direction θi, the shooting position Ci, and the current time information Di generated by this combination is written at a predetermined position of the photographic image Bi. That is, frame information (xy) at a predetermined position of the photographic image Bi is provided in advance, and shooting identification information Ki is written in this frame information. The photographic image Hi with photographic identification information is a combination of the photographic identification information Ki and the photographic image Bi written in the frame information.

  In other words, the HDD 62 stores a photograph image Hi with photographing identification information obtained by combining the photographing direction θi, the photographing position Ci, the time information Di, and the photograph image Bi of the destination taken by the digital camera. Become.

  When the communication IC card 51 is inserted and a transmission instruction is input, the photograph image Bi and the photographing identification information Ki stored in the HDD 62 are read, and the photographing direction θi, the photographing position Ci, and the time information Di are read in the header. Are added to the communication IC card 51 and transmitted by the wireless Internet protocol. Therefore, it is possible to transmit a photographic image whose photographing direction and photographing position are known to the other party in real time.

  Further, it has a function of receiving an image via the communication IC card 51, storing the image in the HDD, and outputting the image on a screen.

  Although this IC card may be installed in the server at the central center, in this embodiment, the case where the communication IC card 41 is used will be described.

  As shown in FIG. 4, the communication IC card 51 transmits the terminal number and the like to the header of the transmission data of the photographic image Hi with the photographic identification information of the HDD in accordance with the transmission instruction and transmits it to the central center (d1).

  The server 21 receives this information, and the image storage unit 31 sequentially stores it in the hard disk 30 (d2).

  On the other hand, the central center supervisor communicates with the server 21 by operating the personal computer, and inputs the area, scale, image size, password, ID, etc. for receiving the service (d2a).

  For example, when an area (for example, Nagano prefecture, .., group, town, and district) and a scale are specified from the personal computer 25, the area search unit 33 has a shooting position Ci included in the area of this area, and A map of a specified scale (for example, 1/5000) is allocated from the database 32.

  Then, the coordinate system of this area (such as matching the mesh interval) is notified to the area-specific shooting direction diagram memory creation unit 34.

  Next, when the area and scale are input, the shooting point direction map creation unit 35 searches the database 30 for all the photo images with shooting identification information having shooting positions in the area. Then, the time information Di (year / month / day, time) of the retrieved photograph image with photographing identification information Hi is read, and the photographing point direction map Ri corresponding to the time information Di is generated in the database 38.

  That is, in the mesh form for the shooting point direction map for each region, the shooting point direction map Ri for each time information Di of the mesh interval based on the scale is generated.

  The time information Di (year / month / day, time) of the photograph image Hi with photographing identification information stored in the database 30 is read, and the shooting point direction map Ri corresponding to the time information Di (for example, May 10, 2005) is read. It is generated in the database 38.

    That is, a shooting point direction map Ri having an address of May 10, 2005 is generated in the shooting point direction map file of area A (d3).

    In this shooting point direction diagram Ri, a shooting icon Pi whose shooting direction is indicated by an arrow is defined.

  Next, when the area A is designated, the compositing unit 40 assigns the shooting point direction map file 38a (for area A) corresponding to this area, combines all the shooting point direction maps of this file, The integrated shooting direction point diagram Qi is stored in the database 41 (d4).

  At this time, each time the integrated shooting direction point diagram Qi is stored in the database 41, the linking unit 37 reads the position of the icon Pi of the point diagram Qi, and the photo image Hi with shooting identification information having this position information. Is read from the database 30, and this photograph image with photograph identification information Hi is linked to the icon Pi of the database 41 and stored in the database 42.

    The display composition unit 43 reads the area name and scale from the personal computer, reads the integrated shooting point direction map Qi of this area name, reads and synthesizes the area map of the designated scale, and sends this to the personal computer ( d6). At this time, the shooting direction and time information linked to the icons of the integrated shooting point direction diagram Qi are read and displayed as shown in FIG. 6 (however, one icon is shown as an example). FIG. 7 shows an example of an image Mi with a shooting position / direction icon obtained by combining the integrated shooting point direction map Qi with the digital aerial photograph.

That is, as shown in FIG. 6 or FIG. 7, the icon Pi showing the shooting direction is displayed on the designated map and the direction and time information are displayed in the vicinity, as shown in FIG. You can see at a glance how many photos you have taken in which direction from where in the past.
For example, when the supervisor selects a desired icon, the pixel coordinates of this icon are output to the photo reading unit 44 of the server (d8).

  The photo reading unit 44 determines which region the image is from the display synthesis unit 43, reads the photo image with photo identification information Hi corresponding to the position information of the pixel coordinates of the icon from the database 42 (d9), and takes this photo. The photographic image Hi with identification information is output to the personal computer (d10), and the photographic image Hi with photographing identification information is displayed on the sub-screen shown in FIG. Since the position, direction, date, and time are displayed in this image, the monitor can easily know when, where and from which direction the photograph is taken, and this image Hi is a map or photograph of the designated area. Since it is displayed above, the positional relationship of this photograph Hi can also be grasped simultaneously.

<Embodiment 2>
In the second embodiment, the photograph image Bi is displayed on the map or the aerial photograph image in the direction corresponding to the arrow indicated by the icon.

  FIG. 9 shows the configuration of the server according to the second embodiment. The server 70 according to the second embodiment includes a database 30, an image storage unit 31, a map database 32, an area search unit 33, a region-specific shooting direction map memory generation unit 34, and a shooting point direction map creation unit 35. , A linking unit 37, a memory 36, a database 38 storing shooting point direction maps for each region, a combining unit 40, a database 41 storing integrated shooting point direction maps Qi for each region, and display composition In addition to the unit 43, the photo reading unit 44, and the like, a shooting direction frame setting unit 71 is provided to overlay and display the photo Bi on the aerial photograph or map according to the shooting direction, as shown in FIG.

  When the icon Pi on the screen is input, the shooting direction frame setting unit 71 reads the integrated shooting point direction map Qi including the position of the icon Pi, and determines the direction of the icon Pi and the position Pa of the integrated shooting point direction map Qi. Read. That is, as shown in FIG. 12B, the arrow Ji, the position Pa, the vertex Ja of the arrow Pi, and the direction θi of the icon Pi are defined in the photo pasting memory as shown in FIG.

  Then, a rectangular frame Li having a side Pj perpendicular to the arrow Ji from the camera icon position Pa in the photo pasting memory is generated as shown in FIG.

Then, the photograph Bi of the database 42 is read, and the photograph is rotated by the direction θi and embedded in the frame Vi as shown in FIG.

  Then, the data in the frame Vi of the photo pasting memory is synthesized as shown in FIG. As a result, an image according to the shooting direction of FIG. 10 or FIG. 11 is obtained.

  Therefore, since the site photograph displayed on the map or the aerial photograph is displayed at the angle in the photographing direction, the monitor can easily know from which direction the photograph is taken.

    In the above embodiment, a digital aerial photograph or a map has been described as an example. However, as shown in FIG. 13, a photograph from the mobile terminal side may be displayed in the sky map view.

  Further, in FIG. 10, FIG. 11, and FIG. 13, the position information is displayed on the photographic image, but the position information may be deleted and displayed.

<Embodiment 3>
In the third embodiment, a monitor at a central center transmits a photograph of a desired position and direction to the site side via a communication network, and a photograph of a position and direction desired by the monitor is provided. That is, a desired photograph is obtained in real time by bidirectional communication.

  FIG. 14 is a schematic configuration diagram of an on-site photo providing system with position and orientation according to the third embodiment. As shown in FIG. 14, for example, a photograph of a disaster site is taken by the on-site photo transmission terminal 1 with position and orientation, and this photo image Bi is taken at a shooting position Ci (latitude a, longitude b) and shooting direction θi (for example, northwest). Then, the photographic image Hi with photographing identification information in which the time information Di or the like is written is transmitted via the communication network 21.

  Then, when the central center server 80 displays the photograph image Hi with photographing identification information on the personal computer 25 and the photographing position and the direction (4 to 16 directions) are input from the personal computer 25, the new photographing position and When the photographic image Bi corresponding to the direction is stored, the photographing position Cp (latitude g, mild f) and the photographing direction θp (for example, northeast) input to the photographic image Bi are written, and this is monitored. The information is transmitted to the IC card of the on-site photo transmission terminal 1 with position and orientation as photographing request information.

  When there is no photographic image Bi corresponding to the input shooting position Cp and the shooting direction θp, a pseudo image when the shooting direction θp is viewed from the shooting position Cp in a constant field of view is created from the DEM data. This is used as a pseudo image, and the shooting position Cp and the shooting direction θp are written in the pseudo image and transmitted.

  That is, if the photographic image sent from the site is not what the supervisor wants, the supervisor can create and send a past raw photographic image or pseudo image desired by the supervisor. It is possible to obtain the desired photo on the side. Also, on the site side, the location desired by the supervisor is transmitted as a past raw photo or pseudo-image, and transmitted in a form in which the location and direction are known. Can shoot.

  FIG. 15 is a schematic configuration diagram of the server 80 according to the third embodiment. A server 80 shown in FIG. 15 includes an image storage unit 31 that stores a photograph image Hi with photographing identification information from the on-site photograph portable terminal 1 with a position and orientation in a database 30, and a map database 32 that stores a map in which latitude and longitude are defined. And. Digital aerial photographs are stored in a separate database (not shown).

  In addition, a shooting point assignment unit 85, a database 41 that stores integrated shooting point diagrams, a database 86 that stores DEM data, a display synthesis unit 43, a transmission image type determination unit 87, and a shooting direction pseudo image creation Unit 90, pseudo image reading unit 92, transmission determination unit 93, and the like.

  The shooting point assignment unit 85 includes an area search unit 33, a region-specific shooting direction map memory generation unit 34, a shooting point direction map creation unit 35, a link unit 37, and a region-specific shooting direction map mesh. Is a generic term for the memory 36 in which the image is generated, the database 38 in which the shooting point direction map Ri for each region is stored, and the combining unit 40.

  That is, when the area search unit 33 specifies an area and a scale, the shooting point assignment unit 85 has a shooting position Ci included in the area of this area and has a specified scale (for example, 1/5000). A map is allocated from the database 32, and the coordinate system of this area (such as matching mesh intervals) is notified to the area-specific shooting direction map memory creation unit.

  When the shooting point direction map creation unit 35 inputs the area and scale, the database 30 retrieves all the photo images with shooting identification information Hi having the shooting position in this area from the database 30. Then, the time information Di (year / month / day, time) of the retrieved photograph image with photographing identification information Hi is read, and the photographing point direction map Ri corresponding to the time information Di is generated in the database 38.

  When the area A is designated, the compositing unit 40 assigns the shooting point direction map file 38a (for area A) corresponding to this area, combines all the shooting point direction maps of this file, and this integrated shooting direction. The point diagram Qi is stored in the database 41.

  At this time, each time the integrated shooting direction point diagram Qi is stored in the database 41, the linking unit 37 reads the position of the icon Pi of the point diagram Qi, and the photo image Hi with shooting identification information having this position information. Is read from the database 30, and this photograph image with photograph identification information Hi is linked to the icon Pi of the database 41 and stored in the database 42.

  When the supervisor side shooting instruction mode is instructed from the personal computer 25, the photo reading unit 83 determines whether or not the image machine unit 31 has newly received the photo image with shooting identification information Hi. Immediately, the photograph image Hi with photographing identification information is displayed on the screen of the personal computer 25.

  Then, if the shooting position Cp and the shooting direction θp input on the screen are compared with the shooting position Ci of the received photo image Hi with the shooting identification information and the shooting direction θi, if there is a difference, a new supervisor If there is a photographic image Bi (raw photo) that matches the desired information (position may be shifted to about 10 m and the direction may be shifted by about 3 degrees), the photographic image Bi is transmitted. If not, the pseudo image Ji is transmitted. .

  When the shooting direction θp and the shooting position Cp are input from the personal computer 25 (which may be another personal computer), the transmission image type determination unit 87 inputs a photo image Bi that matches the shooting direction θp and the shooting position Cp to the photo reading unit 83. Ask if there exists.

  When the photographic image Bi does not exist, the pseudo image reading unit 92 is caused to read a pseudo image of the shooting direction θp and the shooting position Cp.

  The shooting direction pseudo image creation unit 90 reads the input shooting position Cp and shooting direction θp as the pseudo image is read from the pseudo image reading unit 92, and defines the shooting position Cp on the DEM data. A pseudo image Ji when viewed in the photographing direction θp with a predetermined visual field is created, and this is created in the database 96.

  The pseudo image reading unit 92 reads the pseudo image Ji created in the database 96, adds the shooting direction θp and the shooting position Cp to the image, and displays them on the screen.

  When receiving a transmission permission instruction from the personal computer 25, the transmission determination unit 93 reads a pseudo image or a photographic image displayed on the screen, and attaches this to a mail for transmission.

  For example, it is attached to the PDA terminal n mail address, and the message is newly “photographed in this direction at this photographing position.

  FIG. 16 is a sequence diagram for explaining the operation of the on-site photograph providing system with position and orientation according to the third embodiment. In the present embodiment, for example, it is assumed that a photograph image Hi with photographing identification information in the photographing direction θi at the photographing position Ci from the terminal 1 is displayed on the personal computer. For example, it is assumed that the direction of Mt. Buko is taken in the direction θi shown in FIG.

  When the photographing position or photographing direction in FIG. 17A is not desired, the central center supervisor operates the personal computer 25 to instruct the supervisor-side photographing instruction mode and also the photographing direction θp. The shooting position Cp is transmitted to the server 80 (d20).

  The photograph reading unit 83 of the server 80 reads the photographing direction θp and the photographing position Cp, and determines whether or not a photograph image BI matching these exists in the database 42 (d21). That is, this is a case where a photographic image at this position Cp was taken in this direction θp in the past.

  When it is determined that the corresponding photo image exists, the photo reading unit 83 reads the photo image with photographing identification information Hi from the database 42 (d22), sends it to the personal computer 25, and displays it on the screen (d23). For example, the image of FIG. 17B is displayed. The shooting direction is slightly shifted between FIG. 17B and FIG.

  If the screen image is desired, the monitor inputs the terminal address (IC card address) and the OK instruction and sends them to the server 80 (d24).

  The server 80 reads and transmits the photographic image Hi from the database 42 with the input of these pieces of information (OK, terminal address, etc.) (d25).

  As a result, an image in the direction designated by the supervisor is displayed on the photographer's PDA terminal, and the position and direction are written. Can be sent to the server.

  Moreover, since it transmits with time information from the terminal side, the icon Pi with time information can be displayed on a map as mentioned above.

  Further, when the transmission image type determination unit 87 determines that the corresponding photographic image is not stored in the database 42, the shooting direction pseudo image creation unit 90 is based on the direction θp from the position CP instructed based on the DEM data. A pseudo image (image rendered on a wire frame) is generated (d27), and this pseudo image Ji is sent to the personal computer 25 for display (d28).

  For example, see FIG. 17 (b) and FIG. 17 (a).

  If the screen image is the desired one, the monitor inputs the terminal address (IC card address) and the OK instruction and sends them to the server 80 (d28).

  The server 80 reads and transmits the pseudo image Ji in the database 96 with the input of these pieces of information (OK, terminal address, etc.) (d29).

  As a result, a pseudo image in the direction designated by the supervisor is displayed on the PDA terminal of the photographer, and the position and the direction are written in the pseudo image. You can take an image of the direction and send it to the monitoring server.

  Moreover, since it transmits with time information from the terminal side, the icon Pi with time information can be displayed on a map as mentioned above.

It is a schematic block diagram of the photograph providing system with a position orientation of the first embodiment. It is a schematic block diagram of the server 21 of the system of this Embodiment 1. FIG. It is explanatory drawing of the photograph image Hi with imaging | photography identification information. It is a sequence diagram explaining operation | movement of the photograph provision system with a position / orientation. It is a schematic block diagram of the form IC card used for this Embodiment. It is explanatory drawing which expand | deployed the icon with a shooting direction on the map. It is explanatory drawing which expanded the icon with a photographing direction on the aerial photograph. It is explanatory drawing explaining the subscreen display of the photograph image with imaging | photography identification information of this Embodiment. 6 is a schematic configuration diagram of a server according to Embodiment 2. FIG. 10 is an explanatory diagram illustrating a screen obtained in Embodiment 2. FIG. 10 is an explanatory diagram illustrating a screen obtained in Embodiment 2. FIG. FIG. 11 is an explanatory diagram illustrating generation of a shooting direction frame and embedding of a photograph according to the second embodiment. It is explanatory drawing of the screen which applied this Embodiment to the sky view map. FIG. 10 is a schematic configuration diagram of a photo providing system with a position and orientation according to a third embodiment. FIG. 6 is a schematic configuration diagram of a server according to a third embodiment. FIG. 10 is a sequence diagram for explaining the operation of the photo providing system with position and orientation according to the third embodiment. FIG. 10 is an explanatory diagram for explaining a comparison of screen displays when an imaging direction is instructed from a monitoring side according to a third embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Field photograph transmission portable terminal 20 with position and orientation 20 Communication network 21 Server 31 Image storage part 33 Area search part 34 Area-specific shooting direction map memory generation part 35 Shooting point direction map creation part 37 Linking part 40 Compositing part 44 Photo reading part

Claims (9)

An IC card mounted on a portable terminal with a digital camera captures a photograph image with photographing identification information obtained by capturing an object and adding photographing identification information including at least time information, a photographing direction, and a photographing position to the photograph image. A photo providing system with position and orientation, which is transmitted to a server of a monitoring center, and the server of the monitoring center provides a map or digital photo image including the shooting position on the screen of the terminal,
The IC card is
It is attachable to the portable terminal, has a position information acquisition function, a shooting direction acquisition function, a communication function, and a time information measurement function, and when the object is shot with the portable terminal, a photographic image is synchronized with the shooting. In addition, the photographic image is combined with shooting identification information that combines the position information of the position information acquisition function, the shooting direction of the shooting direction acquisition function, and the time information of the time information measurement function, and this is combined with the photographic image. Means for transmitting to the server of the monitoring center as
The monitoring center server is:
A first database storing a map to which latitude and longitude are allocated; a second database storing the photograph image with shooting identification information; and a shooting icon in which a mesh group is defined for each time information and in a map coordinate system. A third database in which the figure is stored,
Means for storing the photograph image with photographing identification information in the second database, and searching the first database for a map including a photographing position of the photograph image with photographing identification information;
Each time the map is searched, means for defining the shooting position of the photographic image with shooting identification information in the third database in the coordinate system on the searched map for each time information When,
The photographing direction of the photographic image with photographing identification information is read, the photographing direction is defined in the mesh group, and a photographing icon with an arrow according to the direction is generated in the mesh at the defined position to generate the time information. Means for obtaining each shooting icon diagram;
When a position is specified, an integrated shooting icon diagram is generated by combining the shooting icon diagrams for each time information having the position, and this integrated shooting icon diagram and the map of the first database having the specified position are generated. And a means for obtaining an image with a shooting position / direction icon obtained by synthesizing the extracted map and displaying the image on the screen. A fourth database storing the digital aerial image of the map, and when the map is extracted by specifying the position, the digital aerial image of the extracted map is extracted from the fourth database; 2. The system for providing a photograph with position and orientation according to claim 1, further comprising: a unit that synthesizes the integrated photograph icon diagram after superimposing the extracted digital aerial photograph image on the extracted map. When a shooting icon of an image with a shooting position / direction icon on the screen is designated, the second database is searched for the photograph image with shooting identification information having the position information corresponding to the designated position; 3. The system for providing a photograph with position orientation according to claim 1, further comprising means for displaying the retrieved photograph image with photographing identification information on the photographing icon of the image with photographing position / direction icon. The photographic image with the photographic identification information is assigned, the photographing direction is read, the photographic image with the photographic identification information is rotated in the photographing direction, and the image with the photographing position / direction icon corresponding to the positional information of the photographic image is photographed. 4. The system for providing a photograph with position and orientation according to claim 1, further comprising means for displaying the assigned photograph image with photographing identification information on an icon. The server
Connected to a personal computer having a display unit having a fifth database in which DEM data for each specific area is stored;
Means for displaying the image on the display unit of the personal computer when the photograph image with photographing identification information is received from the IC card;
After displaying the photographic image with photographing identification information on the display unit of the personal computer, the photographic image with photographing identification information corresponding to the photographing position and photographing direction from the personal computer is extracted from the second database and the portable Means for transmitting to the IC card of the terminal;
Before shooting position from Kipa Sokon, when photographing the identification information with image corresponding to the imaging direction is not stored in the second database, the designated photographing position from the DEM data of the fifth database 5. The system for providing a photograph with a position and orientation according to claim 1, further comprising means for creating a pseudo image in the designated photographing direction and transmitting the pseudo image to the IC card of the portable terminal. A photograph image with photographing identification information added with photographing identification information including at least time information, photographing direction and photographing position is read into the photograph image, and an icon indicating the direction of the photographing identification information is displayed on a map or a digital photograph image. A program for
On the computer,
Means for storing in a first database a map assigned latitude and longitude;
Means for storing the photographic image with photographing identification information in a second database;
Means for storing, in a third database, shooting icon diagrams in which mesh groups are defined for each time information and in a coordinate system of a map;
Means for storing the photograph image with photographing identification information in the second database, and searching the first database for a map including a photographing position of the photograph image with photographing identification information;
Each time the map is searched, means for defining the shooting position of the photographic image with shooting identification information in the third database in the coordinate system on the searched map for each time information ,
The photographing direction of the photographic image with photographing identification information is read, the photographing direction is defined in the mesh group, and a photographing icon with an arrow according to the direction is generated in the mesh at the defined position to generate the time information. Means for obtaining each shooting icon diagram;
When a position is specified, an integrated shooting icon diagram is generated by combining the shooting icon diagrams for each time information having the position, and this integrated shooting icon diagram and the map of the first database having the specified position are generated. A program for providing a photograph with a position and orientation for executing a function as means for obtaining an image with a shooting position / direction icon obtained by combining the extracted maps and displaying the image on the screen. In the computer,
A fourth database storing the digital aerial image of the map, and when the map is extracted by specifying the position, the digital aerial image of the extracted map is extracted from the fourth database; The program for providing a photograph with a position / orientation according to claim 6 for realizing a function as means for synthesizing the integrated photograph icon diagram after the extracted digital aerial photograph image is superimposed on the extracted map. In the computer,
When a shooting icon of an image with a shooting position / direction icon on the screen is designated, the second database is searched for the photograph image with shooting identification information having the position information corresponding to the designated position; 8. The on-site photo providing program with position and orientation according to claim 6 or 7 for realizing a function as means for displaying the searched photographic image with photographing identification information on the photographing icon of the image with photographing position / direction icon. . On the computer,
The photographic image with the photographic identification information is assigned, the photographing direction is read, the photographic image with the photographic identification information is rotated in the photographing direction, and the image with the photographing position / direction icon corresponding to the positional information of the photographic image is photographed. 9. The program for providing a photograph with position orientation according to claim 6, 7 or 8, for realizing a function as means for displaying the assigned photograph image with photographing identification information on an icon.