JP2008204003A - Pickup image registration device, map image generation device, map image generation system, web server, pickup target position estimation device, pickup image registration method, pickup image registration program, map image generation program and computer-readable recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To generate a map image wherein a streetscape along a road is reproduced by easy processing. <P>SOLUTION: A coordinate conversion part 4 has: a pickup information acquisition part 41 acquiring a pickup image 3a obtained by imaging a pickup target positioned along the road and pickup target position information 3b showing the position of the pickup target; an intersection point calculation part 43 determining coordinates of a perpendicular foot dropped to a closest road line from the position of the pickup target shown by the pickup target position information as image arrangement coordinates in a vector map including information about the road line showing the road; and an image registration part 45 registering the pickup image 3a into a second database 5 associatively to the image arrangement coordinates of the vector map. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a map image generation system, a captured image registration apparatus, a map image generation apparatus, a Web server, and an imaging target position estimation apparatus for displaying an image of a building, a landscape, and the like together with a map.

  A map service that can display a view of a city from above by satellite or aerial photographs is common. However, it is difficult to imagine the cityscape of the city only by looking at the city from above. This is because the structure of the city from above and the structure of the city seen from the viewpoint of pedestrians are completely different.

  Therefore, a virtual city system that allows the city to be seen from the viewpoint of a pedestrian has been developed. The advantages of such a virtual city system are that 1) the local color is easy to understand and useful for real estate services, 2) the virtual search of small-scale facilities in the city is possible, and 3) screen display and eyes. It is easy to make the pedestrian navigation intuitive because it is easy to correspond to the scenery in front of.

  Examples of the virtual city created by the virtual city system as described above include FreeWalk created by the JST CREST Digital City Project, Microsoft PhotoTourism, and SkyPanoramaAware in Awara City.

  In addition, position information is added to a captured image captured by a digital camera with a GPS (Global Positioning System) function or a mobile phone with a GPS function, and the image is transmitted to a server. The server receives the captured image based on the position information. A service for linking to a map image or displaying it on a map image has been put into practical use. An example of such a service is au DuoSnap.

In Patent Document 1, a landscape along an arbitrary road is photographed with a camera or a video camera, the image data is distributed to an information terminal device such as a computer or a mobile phone, and geographical information around the destination is imaged. It is described that it provides as.
JP 2003-067386 (published March 7, 2003)

  However, the above conventional configuration causes the following problems.

  In the above-described virtual city system, captured images obtained by capturing buildings along a road from multiple directions using a digital camera, an in-vehicle camera, or the like are collected over a wide range, and these images are pasted on a three-dimensional geometric model of the building to create a virtual city. It is formed. In addition to enormous costs for collecting such images, the operation of pasting a captured image on a three-dimensional geometric model has to be relied on manually, so that it takes cost to form a virtual city. Therefore, only virtual city data corresponding to a very limited area such as around a major intersection in a large city is provided.

  In addition, in map services such as DuoSnap, the map image and the captured image are linked to each other, or the captured image is superimposed and displayed at a specific position on the map image. With such a configuration, it is difficult to understand the geographical relationship between captured images, and it is difficult to imagine an actual cityscape.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a map image generation system and a captured image registration that can generate a map image that reproduces a cityscape along a road with easy processing. An apparatus, a map image generation device, a Web server, and an imaging target position estimation device are provided.

  In order to solve the above-described problem, the captured image registration apparatus according to the present invention acquires a captured image obtained by imaging an imaging target located along a road and imaging target position information indicating the position of the imaging target. Using the information acquisition means and the map data indicating the coordinates of the map image showing the road line indicating the road, the map image is lowered from the position of the imaging target indicated by the imaging target position information to the nearest road line. It is characterized by comprising arrangement coordinate determining means for determining the coordinates of the legs of the vertical line as image arrangement coordinates, and image registration means for registering the captured image in a database in association with the image arrangement coordinates of the map image.

  In order to solve the above problems, a captured image registration method according to the present invention is a captured image registration method in a captured image registration apparatus including imaging information acquisition means, arrangement coordinate determination means, and image registration means, The imaging information acquisition unit acquires an imaging image obtained by imaging an imaging target located along a road, imaging target position information indicating the position of the imaging target, and the arrangement coordinate determination unit includes: Using the map data indicating the coordinates of the map image showing the road line indicating the road, in the map image, from the position of the imaging target indicated by the imaging target position information to the nearest road line An arrangement coordinate determination step for determining coordinates as image arrangement coordinates, and an image registration in which the image registration means registers the captured image in the database in association with the image arrangement coordinates of the map image. It is characterized in that it comprises a step.

  According to said structure, the captured image which an imaging information acquisition means acquires images the imaging target (for example, building) located along a road. The imaging information acquisition unit acquires imaging target position information indicating the position of the imaging target together with a captured image obtained by imaging the imaging target.

  The arrangement coordinate determination means uses the map data indicating the coordinates of the map image on which the road line indicating the road is shown, so that in the map image, the foot of the perpendicular line dropped from the imaging target position to the nearest road line. The coordinates are determined as image arrangement coordinates. With this process, a specific position on the road line closest to the position of the imaging target is determined from the position of the imaging target indicated by the imaging target position information. The image registration unit registers the captured image in the database in association with the image arrangement coordinate determined by the arrangement coordinate determination unit.

  Therefore, it is possible to construct a database for arranging the picked-up images to be picked up along the road along the road indicated by the map image.

  Therefore, by using the data registered by the captured image registration device, the cityscape along the road can be reproduced as an image by simple processing.

  The captured image registration apparatus uses the map data, and in which direction the road line closest to the position of the imaging target exists in the map image with reference to the position of the imaging target indicated by the imaging target position information. It is preferable that the image registration unit further registers a direction determined by the direction determination unit in the database in association with the captured image.

  According to the above configuration, the direction determining means uses the map data, so that in the map image, the road line closest to the position of the imaging target is based on the position of the imaging target indicated by the imaging target position information. Determine which direction is present. The image registration unit registers the direction determined by the direction determination unit in the database in association with the captured image.

  Therefore, it is possible to construct a database for generating a map image in which the captured image of the imaging target located along the road faces the road side.

  In order to solve the above-described problem, the captured image registration apparatus according to the present invention acquires a captured image obtained by imaging an imaging target located along a road, and imaging position information indicating a position where the imaging target is captured. Using the imaging information acquisition means and map data indicating the coordinates of the map image showing the road line indicating the road, the perpendicular line drawn from the imaging position indicated by the imaging position information to the nearest road line in the map image It is characterized by comprising arrangement coordinate determining means for determining the coordinates of the foot as image arrangement coordinates, and image registration means for registering the captured image in a database in association with the image arrangement coordinates of the map image.

  In order to solve the above-described problem, the captured image registration method according to the present invention shows a captured image obtained by imaging the imaging target located along the road and a position where the imaging target is captured by the imaging information acquisition unit. An imaging information acquisition step for acquiring imaging position information and the arrangement coordinate determination means use map data indicating the coordinates of a map image showing a road line indicating a road, and in the map image, the imaging position information An arrangement coordinate determining step for determining, as image arrangement coordinates, the coordinates of a perpendicular foot drawn from the imaging position indicated by the image to the nearest road line, and the image registration means associates the image with the image arrangement coordinates of the map image. And an image registration step of registering an image in a database.

  According to said structure, the captured image which an imaging information acquisition means acquires images the imaging target (for example, building) located along a road. The imaging information acquisition unit acquires imaging position information indicating a position where the imaging target is captured together with a captured image obtained by imaging the imaging target.

  The arrangement coordinate determining means uses the map data indicating the coordinates of the map image on which the road line indicating the road is shown, and in the map image, the coordinates of the foot of the perpendicular line dropped from the imaging position to the nearest road line Are determined as image arrangement coordinates. With this process, the position on the road line in the map image corresponding to the imaging position is determined from the imaging position indicated by the imaging position information. The image registration unit registers the captured image in the database in association with the image arrangement coordinate determined by the arrangement coordinate determination unit.

  Therefore, it is possible to construct a database for arranging the captured image of the imaging target located along the road along the road indicated by the map image.

  Therefore, by using the data registered by the captured image registration device, the cityscape along the road can be reproduced as an image by simple processing.

  The road line includes a pair of outer edge lines that define the width of the road, and the arrangement coordinate determining means is the other of the map images that is paired with the nearest outer edge line from the imaging position indicated by the imaging position information in the map image. It is preferable to determine the coordinates of the foot of the perpendicular line drawn down to the outer edge line as the image arrangement coordinates.

  When imaging an imaging target along a road, imaging is often performed at a certain distance in order to capture the entire imaging target. Therefore, the imaging target is often imaged from the opposite side of the road.

  According to the above configuration, when the road line includes a pair of outer edge lines that define the width of the road, the position of the imaging target is calculated from the imaging position at which the imaging target is imaged, and the captured image is obtained using the position as the image arrangement coordinates. And can be registered in the database.

  The captured image registration device uses the map data to determine in which direction the road line closest to the imaging position exists in the map image with reference to the imaging position indicated by the imaging position information. It is preferable that the image registration unit further registers the direction determined by the direction determination unit in the database in association with the captured image.

  According to the above configuration, the direction determining means uses the map data, and in which direction the road line closest to the imaging position exists in the map image with reference to the imaging position indicated by the imaging position information. Decide what you are doing. The image registration unit registers the direction determined by the direction determination unit in the database in association with the captured image.

  Therefore, it is possible to construct a database for generating a map image in which the captured image of the imaging target located along the road faces the road side.

  In order to solve the above-described problem, a map image generation apparatus according to the present invention captures an image of an imaging target located along a road, and the map image displays a road line indicating the road from the captured image. Acquisition means for acquiring image arrangement coordinate information indicating coordinates to be arranged on the map, and image arrangement direction information indicating a direction in which the captured image faces the nearest road in the map image, and the image indicated by the image arrangement coordinate information Image processing means for generating a map image in which the captured image is arranged in a direction indicated by the image arrangement direction information is provided at the coordinates of the map image.

  According to said structure, an acquisition means shows the coordinate for arrange | positioning the captured image which imaged the imaging target located along a road, and the said captured image to the map image on which the road line which shows a road was displayed. Image arrangement coordinate information and image arrangement direction information indicating a direction in which the captured image faces the nearest road in the map image are acquired. Then, the image processing means generates a map image in which the captured image is arranged in the direction indicated by the image arrangement direction information at the coordinates in the map image indicated by the image arrangement coordinate information.

  Therefore, it is possible to generate a map image in which a picked-up image obtained by picking up an image pickup target located along the road is arranged toward the nearest road along the road line shown in the map image.

  The map image generation device further includes an image synthesis unit that synthesizes one image from the plurality of captured images by superimposing overlapping regions of the plurality of captured images acquired by the acquisition unit, and the image processing unit includes: It is preferable to generate a map image in which the image synthesized by the image synthesizing unit is arranged in the direction indicated by the image arrangement direction information on the coordinates in the map image indicated by the image arrangement coordinate information.

  When imaging an imaging target that is continuously located along a road, imaging is often performed in multiple steps.

  According to said structure, an image synthetic | combination means synthesize | combines one image from the said some captured image by overlapping the overlap area | region of the some captured image which the acquisition means acquired. The image processing means generates a map image in which the image synthesized by the image synthesizing means is arranged in the direction indicated by the image arrangement direction information at the coordinates of the map image indicated by the image arrangement coordinate information.

  Therefore, even when an imaging target continuously located along the road is captured in multiple times, one image showing a state close to an actual landscape is generated from these captured images, and the image is used. A map image can be generated.

  It is preferable that the image processing unit generates a map image that is visually recognized so that the captured image acquired by the acquisition unit stands up with respect to the map image.

  With the above configuration, it is possible to display a landscape along the road in a three-dimensional manner using a captured image of the imaging target located along the road. Therefore, it is possible to display the captured image so that it is easy to understand in which direction the landscape is captured.

  A map image generation system according to the present invention is a map image generation system including the captured image registration device and the map image generation device, wherein the acquisition means includes a captured image and an image registered by the captured image registration device. It is characterized by acquiring arrangement coordinates.

  With the above configuration, using the captured image and the image arrangement coordinates registered by the captured image registration apparatus, the map image generation device uses the coordinates indicated by the image arrangement coordinates on the map image on which the road line indicating the road is displayed. A map image in which the captured image is arranged at corresponding coordinates can be generated.

  A Web server according to the present invention is characterized by comprising display data generating means for generating data for displaying a map image generated by the map image generating system on a Web page.

  With the above configuration, the map image generated by the map image generation system can be displayed on the Web page.

  Therefore, the map image can be displayed by a terminal device that can browse a Web page.

  Moreover, it is preferable that the Web server further includes banner advertisement data generation means for generating data for displaying a banner advertisement on the Web page.

  According to said structure, the map image produced | generated by the said map image production | generation system can be displayed on a web page. If banner data generation means is provided, a banner advertisement can be displayed on the web page.

  In order to solve the above-described problem, an imaging target position estimation apparatus according to the present invention relates to a plurality of continuously captured images, and includes first imaging target position information indicating the position of the imaging target that was initially captured. Imaging target position information acquisition means for acquiring the second imaging target position information indicating the position of the imaging target last imaged, and captured image number information acquisition means for acquiring the number of captured images indicating the number of the captured images And each of the plurality of captured images based on the first and second imaging target position information acquired by the imaging target position information acquisition unit and the captured image number information acquired by the captured image number information acquisition unit. An imaging target position estimation apparatus comprising: an imaging target position calculating unit that calculates an imaging target position.

  According to said structure, the 1st imaging target position information which shows the position of the imaging target imaged first, the 2nd imaging target position information which shows the position of the imaging target imaged last, and the number of captured images Based on the captured image number information shown, it is possible to calculate imaging target positions corresponding to a plurality of captured images.

  As a method for calculating the imaging target position, for example, the difference between the first imaging target position information and the second imaging target position information is obtained, and this difference is divided by the number obtained by subtracting 1 from the number of captured images. Is calculated, and the imaging target position corresponding to each captured image is calculated from the imaging interval and the first and second imaging target position information.

  Note that the above calculation method is based on the premise that an imaging apparatus that captures a plurality of captured images captures an imaging target while moving linearly at equal intervals.

  Also, a captured image registration program for operating the captured image registration apparatus, a captured image registration program for causing a computer to function as each of the means, and a computer-readable recording medium on which the captured image registration program is recorded are also disclosed in the present invention. Is included in the technical scope.

  Further, a map image generation program for operating the map image generation apparatus, a map image generation program for causing a computer to function as each of the above means, and a computer-readable recording medium on which the map image generation program is recorded are also included in the present invention. Is included in the technical scope.

As described above, the captured image registration apparatus according to the present invention includes a captured image obtained by capturing an imaged object located along a road and imaged object position information indicating the imaged object position information indicating the position of the imaged object. Using the map data indicating the coordinates of the map image showing the road line indicating the road, the foot of the perpendicular line dropped from the imaging target position indicated by the imaging target position information to the nearest road line in the map image An arrangement coordinate determining means for determining the coordinates of the image as the image arrangement coordinates;
Image registration means for registering the captured image in a database in association with the image arrangement coordinates of the map image.

  In the captured image registration method according to the present invention, as described above, the imaging information acquisition unit acquires a captured image obtained by capturing an imaging target located along a road, and imaging target position information indicating the position of the imaging target. The imaging information acquisition step and the arrangement coordinate determination means use map data indicating the coordinates of the map image showing the road line indicating the road, and the position of the imaging target indicated by the imaging target position information in the map image An arrangement coordinate determining step for determining the coordinates of the foot of the perpendicular line drawn down to the nearest road line as image arrangement coordinates, and image registration means registers the captured image in the database in association with the image arrangement coordinates of the map image Image registration process.

  As described above, the captured image registration apparatus according to the present invention captures a captured image obtained by imaging an imaging target located along a road and imaging position information indicating a position where the imaging target is captured. And map data indicating the coordinates of the map image showing the road line indicating the road, and in the map image, the coordinates of the foot of the perpendicular line dropped from the imaging position indicated by the imaging position information to the nearest road line Are arranged as image arrangement coordinates, and image registration means for registering the captured image in a database in association with the image arrangement coordinates of the map image.

  In the captured image registration method according to the present invention, as described above, the imaging information acquisition unit includes the captured image obtained by imaging the imaging target located along the road, and the imaging position information indicating the position where the imaging target is captured. The acquired imaging information acquisition step and the arrangement coordinate determination means use map data indicating the coordinates of the map image on which the road line indicating the road is shown, and in the map image, from the imaging position indicated by the imaging position information, An arrangement coordinate determining step for determining the coordinates of the foot of the perpendicular line dropped to the nearest road line as an image arrangement coordinate, and an image in which the image registration means registers the captured image in the database in association with the image arrangement coordinate of the map image. And a registration step.

  Therefore, there is an effect that it is possible to construct a database for arranging the captured image of the imaging target located along the road along the road indicated by the map image.

  As described above, the map image generation device according to the present invention has a captured image obtained by imaging an imaging target located along a road, and coordinates for arranging the captured image on a map image on which a road line indicating a road is displayed. Acquisition means for acquiring image arrangement coordinate information indicating the image arrangement direction information indicating the direction in which the captured image faces the nearest road in the map image, and the coordinates of the map image indicated by the image arrangement coordinate information And image processing means for generating a map image in which the captured image is arranged in the direction indicated by the image arrangement direction information.

  Therefore, it is possible to generate a map image in which an imaged image obtained by imaging an imaging object located along the road along the road line indicated in the map image is arranged toward the nearest road. Play.

  As described above, the imaging target position estimation apparatus according to the present invention relates to the first imaging target position information indicating the position of the imaging target that was first captured and the last imaging regarding the plurality of captured images that are continuously captured. Imaging target position information acquisition means for acquiring second imaging target position information indicating the position of the captured imaging target, captured image number information acquisition means for acquiring captured image number information indicating the number of the captured images, and the imaging Based on the first and second imaging target position information acquired by the target position information acquisition unit and the captured image number information acquired by the captured image number information acquisition unit, the imaging target positions respectively corresponding to the plurality of captured images are determined. It is a structure provided with the imaging target position calculation means to calculate.

  Therefore, there is an effect that the imaging target positions corresponding to the plurality of captured images can be calculated.

[Embodiment 1]
One embodiment of the present invention will be described below with reference to FIGS. Here, a map image generation system 100 including a server system (map image generation system, Web server) 1 that receives the captured image 3a and the imaging target position information 3b from the mobile phone 11 will be described.

(Outline of the map image generation system 100)
FIG. 2 is a diagram showing an overview of the map image generation system 100 according to the present embodiment. In the map image generation system 100, a building along the road is imaged from the opposite side of the road by a camera provided in the mobile phone 11, and a file of the captured image is attached to an e-mail and transmitted to the server system 1. At this time, a file of imaging target position information indicating the position of the building that is the imaging target is also attached to the e-mail and transmitted. In the imaging target position information, the coordinates of the imaging target are indicated based on the latitude and longitude of the world geodetic system. In the server system 1, the coordinates of the imaging target indicated by the received imaging target position information are used as the orthogonal coordinates of the numerical information map. It converts into the coordinates of the system, and determines the position (image arrangement coordinates) of the imaging target in the numerical information map. And the captured image which imaged the imaging target and image arrangement | positioning coordinate are linked | related and registered into a database.

  When the server system 1 receives a command (HTTP (Hyper Text Transfer Protocol) request) to display a map image from the terminal device 30, the server system 1 generates a map image according to the command, and Map image data that can be displayed by a viewer (such as a web browser) is transmitted to the terminal device 30.

(Configuration of server system 1)
FIG. 1 is a functional block diagram showing the configuration of the server system 1. As shown in FIG. 1, the server system 1 includes a mail reception unit 2, a first database 3, a coordinate conversion unit (captured image registration device) 4, a second database 5, a third database 6, and an image processing unit (map image generation). Device) 7, a map image transmission control unit (display data generation means) 8, and a transmission / reception unit 9.

  The mail receiving unit 2 receives e-mail data including the captured image 3 a and the imaging target position information 3 b from the mobile phone 11 and stores them in the first database 3. This e-mail data may include an imaging date and time and a user ID. Details of the captured image 3a and the imaging target position information 3b will be described later.

  The coordinate conversion unit 4 acquires the captured image 3a and the imaging target position information 3b from the first database 3, performs coordinate conversion of the imaging target position indicated by the imaging target position information 3b to the image arrangement coordinates, and the vector map data 5a. The converted image arrangement coordinates are registered in the second database 5 in association with the captured image 3a.

  The coordinate conversion unit 4 includes an imaging information acquisition unit (imaging information acquisition unit) 41, a road selection unit (arrangement coordinate determination unit) 42, an intersection calculation unit (arrangement coordinate determination unit) 43, a direction calculation unit (direction determination unit) 44, and An image registration unit (image registration means) 45 is provided.

  The imaging information acquisition unit 41 acquires the captured image 3 a and the imaging target position information 3 b from the first database 3.

  The road selection unit 42, the intersection calculation unit 43, and the direction calculation unit 44 perform the process for the coordinate conversion by using the vector map data 5a stored in the second database 5. The vector map data 5a is an electronic map (map data) in which a set point on a road is indicated by coordinates, and the position of the road is indicated as a line segment by connecting the coordinates. As the vector map data 5a, a “numerical map 2500” that is a numerical information map distributed by the Geographical Survey Institute can be used. This numerical map 2500 is composed of a collection of coordinate values in a plane rectangular coordinate system, and is data for displaying a map by connecting the coordinates to each other with a line. The vector map data 5a indicates the coordinates of a map image a to be described later.

  In the vector map data, only the center line of the road (road network) is shown, and in addition to the center line of the road, a pair of boundary lines (outer edge lines) (block vector) that define the width of the road are shown. There is something that has been. In the following description, a case where vector map data in which a center line and a boundary line of a road are shown is used will be described.

  The road selection unit 42 includes a boundary line selection unit 42a and a center line selection unit 42b. The boundary line selection unit 42a selects a boundary line that is closest to the imaging target position indicated by the imaging target position information 3b. The center line selection unit 42b selects the center line at the position closest to the imaging target position indicated by the imaging target position information 3b.

  The intersection calculation unit 43 calculates an intersection when a perpendicular is dropped from the imaging target position with respect to the center line and the boundary line selected by the road selection unit. Among these intersections, the intersection with the boundary line is the image arrangement coordinate for arranging the captured image 3a.

  The direction calculation unit 44 calculates a vector direction (referred to as an image arrangement direction) calculated by the intersection calculation unit 43 and starting from the intersection with the boundary line toward the intersection with the center line. In other words, the direction calculation unit 44 determines in which direction the road facing the imaging target position is located with respect to the imaging target position. 3a is the direction facing the nearest road.

  The image registration unit 45 registers the captured image 3 a in the second database 5 in association with the image arrangement coordinates determined by the intersection calculation unit 43 and the image arrangement direction determined by the direction calculation unit 44. In FIG. 1, the data registered by the image registration unit 45 is shown as registered image data 5b.

  In response to an instruction from the map image transmission control unit 8, the image processing unit 7 converts the map image using the registered image data 5 b stored in the second database 5 and the map image 6 a stored in the third database 6. Generate. The map image 6a is a map image used for generating a final map image (a map image on which the captured image 3a is superimposed) before the captured image 3a is superimposed.

  The image processing unit 7 outputs the generated map image to the map image transmission control unit 8. Note that the image processing unit 7 may store the generated map image in the third database 6. The image processing unit 7 may further superimpose another captured image 3a on the map image once generated (a map image on which the captured image 3a is superimposed).

  The image processing unit 7 includes a map creation unit (acquisition unit, image processing unit) 71 and a synthesis unit (image synthesis unit) 72.

  The map creation unit 71 draws the captured image 3a so as to overlap the coordinates on the map image 6a indicated by the image arrangement coordinates included in the registered image data 5b, and generates a final map image. Specifically, the map creation unit 71 is visually recognized as if the captured image 3a was placed on the map image 6a with the image placement coordinates in the map image 6a facing the image placement direction. Is generated. The coordinates of the map included in the map image generated by the map creation unit 71 correspond to the coordinates indicated by the vector map data 5a.

  In other words, the map creation unit 71 captures the captured image 3a, the captured image 3a in the map image, and the image placement coordinates indicating the coordinates for placing the captured image 3a on the map image on which the road line indicating the road is displayed. The image arrangement direction indicating the direction in which the image 3a is arranged is acquired, and the captured image 3a is arranged in the direction indicated by the image arrangement direction at the coordinates of the map image indicated by the image arrangement coordinate information. Generate a map image.

  The combining unit 72 has a function of determining whether or not these captured images overlap each other when arranging a plurality of captured images on the map image. When the plurality of captured images overlap each other in the map image, One image is synthesized from the plurality of captured images so that the overlapping regions of the captured images overlap. When the composition unit 72 generates a composite image, the map creation unit 71 generates a map image using the composite image.

  The image composition method in the composition unit 72 is not particularly limited. If the captured image 3a includes a line indicating the center of the road or a line indicating the boundary of the road, the vertical direction of the plurality of captured images 3a (orthogonal to the extending direction of the road) using these lines The relative position in the direction of movement) may be adjusted.

  When the transmission / reception unit 9 receives a map image display command from the terminal device 30 via the network, the map image transmission control unit 8 outputs a map image generation command to the image processing unit 7 based on the map image display command. To do. When the map image transmission control unit 8 receives the map image generated from the image processing unit 7, the map image transmission control unit 8 transmits map image data that can be displayed on the terminal device 30 to the terminal device 30 via the transmission / reception unit 9. To do. The terminal device 30 has a general viewer (such as a web browser) for viewing a map image.

(Configuration of mobile phone 11)
FIG. 3 is a functional block diagram showing the configuration of the mobile phone 11. As shown in FIG. 3, the mobile phone 11 includes a transmission / reception unit 12, a display unit 13, an input unit 14, a memory 15, a camera 16, a position information acquisition unit 17, a corrected position information acquisition unit 18, and a mail creation unit 19. Yes.

  The camera 16 is a digital camera such as a CCD (Charge Coupled Devices) camera. A captured image captured by the camera 16 is stored in the memory 15.

  The position information acquisition unit 17 acquires position information indicating the position of the own device from the GPS (Global Positioning System) via the transmission / reception unit 12. This position information is latitude and longitude information of the world geodetic system. In many cases, it is difficult to obtain accurate position information with the GPS function provided in mobile phones currently on the market. The mobile phone 11 shown in FIG. 3 has a configuration that can cope with a case where the position information acquired by the position information acquisition unit 17 includes an error.

  The position information acquired by the position information acquisition unit 17 is displayed on the display unit 13. The user inputs the position of the imaging target (imaging target position) using the displayed position. This input is performed via the input unit 14.

  FIG. 4 is a diagram illustrating an example of position information displayed on the display unit 13. As shown in FIG. 4, the user images the current position (star mark 13 a) acquired by the position information acquisition unit 17 by moving a cursor (cross mark 13 b in FIG. 4) or the like via the input unit 14. It can be changed to the target position. The imaging target position information input via the input unit 14 is received by the corrected position information acquisition unit 18.

  The mail creating unit 19 attaches the captured image file specified by the user among the captured images stored in the memory 15 and the captured target position information file acquired by the corrected position information acquiring unit 18 to the email. The electronic mail is transmitted to the server system 1 via the transmission / reception unit 12. This e-mail may include information on imaging date and time and a user ID. Further, the imaging target position information may be described in the text of the e-mail.

  In addition, the mobile phone which can correct the positional information acquired from GPS is already marketed. An example of such a mobile phone is a mobile phone terminal compatible with EZ Navi Walk.

(Processing flow in the mobile phone 11)
Next, the flow of processing from when a user captures a building (imaging target) along a road and transmits the image to the server system 1 will be described with reference to FIG. FIG. 5 is a flowchart illustrating an example of a process flow in the mobile phone 11.

  The user images the building located along the road with the camera 16 so that the extending direction of the road and the imaging direction are orthogonal to each other (S1). That is, the user images the building along the road from the front. A captured image captured by the camera 16 is stored in the memory 15.

  When the information on the current position of the device itself is acquired by the position information acquisition unit 17 (S2), the position information is displayed on the display unit 13 (S3).

  As shown in FIG. 4, when imaging target position information is input by the user via the input unit 14, the imaging target position information is acquired by the correction position information acquisition unit 18 (S <b> 4).

  Upon receiving a mail creation command for creating an e-mail from the user and designation of a captured image to be attached to the e-mail, the mail creating unit 19 uses the file of the imaging target position information acquired by the corrected position information acquisition unit 18 and the user. The designated captured image file is attached to the e-mail (S5).

  Then, the mail creation unit 19 transmits the electronic mail to the server system 1 via the transmission / reception unit 12.

  The imaging (S1) by the camera 16 may be performed at any stage as long as it is before the creation of the e-mail (S5).

(Rough processing flow in server system 1)
Next, an example of the flow of processing in the server system 1 after receiving an e-mail from the mobile phone 11 will be roughly described. FIG. 6 is a flowchart illustrating an example of a process flow in the server system 1.

  When the mail receiving unit 2 receives an electronic mail including the captured image 3a and the imaging target position information 3b from the mobile phone 11 (S11), the mail receiving unit 2 stores the electronic mail in the first database 3 (S12). .

  The coordinate conversion unit 4 acquires the captured image 3a and the imaging target position information 3b stored in the first database 3, and based on the information of the vector map data 5a, the coordinates indicated by the imaging target position information 3b are used as the image arrangement coordinates. Conversion is performed (S13).

  Then, the coordinate conversion unit 4 associates the converted image arrangement coordinates with the captured image 3a and stores them in the second database 5 (S14).

  When the transmission / reception unit 9 receives a map image display command from the terminal device 30 via the network (YES in S15), the map image transmission control unit 8 sends the map image to the image processing unit 7 based on the map image display command. Output generation instructions.

  The map image display command includes information for specifying coordinates on the map image, a direction in which the map image is viewed, and a display method. Examples of the display method include two-dimensional display (2D), quarter view (2.5D), and three-dimensional display (3D). The direction in which the map image is viewed may be specified on the assumption that the map image is displayed so that the upper direction on the screen when the map image is displayed on the screen of the terminal device 30 is north. .

  When the map image generation command is received, the map creating unit 71 draws the captured image 3a on the coordinates on the map image 6a indicated by the image arrangement coordinates included in the registered image data 5b, and generates a final map image. Then, the generated map image is transmitted to the map image transmission control unit 8 (S16).

  When the map image is received, the map image transmission control unit 8 generates data for the viewer that can display the map image on the terminal device 30, and transmits the data for the viewer to the terminal device 30 via the transmission / reception unit 9. (S17).

  As described above, when a plurality of captured images overlap each other in the map image, the combining unit 72 combines one image from the plurality of captured images so that the overlapping regions of the captured images overlap to create a map. The unit 71 may generate a map image using the composite image.

  The map creation unit 71 may generate a map image before receiving a map image generation command. That is, the map creation unit 71 may generate a map image when the registered image data 5b is registered.

(Processing flow in the coordinate conversion unit 4)
Next, an example of the flow of coordinate conversion processing in the coordinate conversion unit 4 will be described with reference to FIGS. FIG. 7 is a flowchart illustrating an example of the flow of coordinate conversion processing in the coordinate conversion unit 4.

  First, the imaging information acquisition unit 41 acquires the captured image 3a and the imaging target position information 3b from the first database 3 (S21). The imaging information acquisition unit 41 outputs the captured image 3 a to the image registration unit 45 and the imaging target position information 3 b to the road selection unit 42.

  Upon receiving the imaging target position information 3b, the boundary line selection unit 42a selects a boundary line that is closest to the imaging target position indicated by the imaging target position information 3b (S22). FIG. 8 is a diagram for explaining a boundary line selection method by the boundary line selection unit 42a. In FIG. 8, the imaging target position information 3 b is indicated by an x mark 51. The boundary line indicating the width of the road is indicated by a line segment 52a and a line segment 52b, for example, and the center line indicating the center of the road is indicated by a line segment 52c, for example. In the example shown in FIG. 8, the boundary line closest to the x mark 51 is a line segment 52a.

  In this way, the boundary line selection unit 42a selects the boundary line that is closest to the imaging target position indicated by the imaging target position information 3b.

  In addition, when receiving the imaging target position information 3b, the center line selection unit 42b selects the center line that is closest to the imaging target position indicated by the imaging target position information 3b (S23). FIG. 9 is a diagram for explaining a method of selecting a center line by the center line selection unit 42b. In the example shown in FIG. 9, the center line closest to the x mark 51 is a line segment 52c.

  The road selection unit 42 outputs information specifying the boundary line selected by the boundary line selection unit 42 a and the center line selected by the center line selection unit 42 b to the intersection calculation unit 43.

  Upon receiving these pieces of information, the intersection calculation unit 43 calculates the intersections when the perpendicular line is dropped from the imaging target position with respect to the center line and the boundary line selected by the road selection unit 42 (S24). The intersection (perpendicular to the perpendicular) (image arrangement coordinates) when the perpendicular is drawn from the imaging target position to the boundary selected by the road selection unit 42 is the intersection 53 in FIG. In FIG. 9, the intersection point (perpendicular to the perpendicular line) when the perpendicular line is dropped from the imaging target position to the center line selected by the road selection unit 42 is the intersection point 54.

  The intersection calculation unit 43 outputs the calculated coordinates of each intersection to the direction calculation unit 44.

  Upon receiving the coordinates of the intersection point, the direction calculation unit 44 calculates the direction of the vector (image arrangement direction) calculated by the intersection point calculation unit 43 and starting from the intersection point with the boundary line toward the intersection point with the center line (S25). ). FIG. 10 is a diagram illustrating an example of the image arrangement direction calculated by the direction calculation unit 44. In FIG. 10, the image arrangement direction is a direction (the direction of the arrow 55) from the intersection 53 toward the intersection 54. This image arrangement direction may be expressed as an angle with respect to a reference direction (for example, the north direction) of the vector map data 5a. The direction calculation unit 44 outputs the image arrangement coordinates and the calculated image arrangement direction information to the image registration unit 45.

  Upon receiving the information on the image arrangement direction, the image registration unit 45 associates the image arrangement coordinates determined by the intersection calculation unit 43 and the image arrangement direction determined by the direction calculation unit 44 with the captured image 3 a and registers them in the second database 5. Registration as image data 5b (S26).

(Specific examples of map images)
Next, a specific example of the map image generated by the map creation unit 71 will be described with reference to FIGS. 11 and 12. FIG. 11 is a diagram illustrating a method for arranging captured images. FIG. 12 is a diagram illustrating a specific example of a map image generated by the map creation unit 71.

  As shown in FIG. 11, the captured image 3a is arranged on a boundary line (a line segment 52a in FIG. 11) passing through the image arrangement coordinates (intersection 53 in FIG. 11). At this time, the captured image 3a is arranged on the map image so that the lower side of the captured image 3a substantially overlaps the boundary line and the center of the lower side of the captured image 3a coincides with the image arrangement coordinates.

  In order to easily realize such an arrangement, the image arrangement direction calculated by the direction calculation unit 44 is used. That is, the map creation unit 71 arranges the captured image 3a at the image arrangement coordinates in the image arrangement direction (the direction of the arrow 55).

  The map image generated by the map creation unit 71 may be a two-dimensional map or a three-dimensional map. Moreover, it may be visually recognizable as if the captured image 3a is standing on a two-dimensional map.

  Further, the angle of the captured image 3a with respect to the map may be 90 ° or may be other than that. For example, as shown in FIG. 12A, each captured image 3 a may be displayed so that the captured image 3 a falls down inside the block 57 in a state where the map is viewed obliquely from above.

  When the captured image 3a overlaps when the captured image 3a is tilted with the map viewed from directly above, the captured image 3a is displayed as in the captured images 58 and 59 shown in FIG. You may deform | transform into a trapezoid shape and display.

  FIG. 13 is a diagram illustrating an example of a map image generated by the map creation unit 71. As shown in FIG. 13, by connecting captured images 3a obtained by imaging buildings along the road, it is possible to represent the streets along the road in a form close to the actual one.

(Example of registered image data 5b)
Next, an example of registered image data 5b registered in the second database 5 will be described with reference to FIG. FIG. 14 is a diagram illustrating an example of the registered image data 5b. As illustrated in FIG. 14, the registered image data 5 b includes captured image 3 a, information on image layout coordinates and image layout direction corresponding to the captured image 3 a. The registered image data 5b may further include the time when the captured image 3a is captured and the ID of the user who captured the captured image 3a. The map creation unit 71 generates a map image using such registered image data 5b.

  Note that the registered image data 5b does not necessarily include the captured image 3a itself, and may include only information (file name or the like) that identifies the captured image 3a. In this case, the map creation unit 71 may use the captured image 3a of the first database 3 specified by the registered image data 5b.

(Server system 1 as a Web server)
The server system 1 includes a map image transmission control unit 8 that generates data for displaying a map image generated by the map creation unit 71 on a Web page.

  The server system 1 further has a function of displaying a specific imaging target so that it can be distinguished from other imaging targets among the imaging targets included in the captured image arranged on the map image displayed on the Web page. May be. For example, a specific store may be displayed more conspicuously than other stores. By making a specific store stand out in this way, it becomes possible to obtain a fee from the owner of the store.

  The server system 1 may further have a function of displaying a banner advertisement on the web page. That is, the map image transmission control unit 8 may function as banner advertisement data generation means for generating data for displaying a banner advertisement on a Web page. By displaying the banner advertisement on the web page, it is possible to obtain advertisement revenue.

  In addition, a competition principle may be introduced in which a user who has a larger number of shots in a certain area can obtain control of the virtual city in that area. The more users who browse the virtual city, the greater the significance of the control right and the more attractive it becomes. As a result, the number of users who participate in the construction of the map image (virtual city) increases. A loop that leads to an increase in

(Effect of server system 1)
According to the server system 1, it is possible to receive the captured image 3a obtained by capturing the building located along the road from the mobile phone 11, and to arrange the captured image 3a along the road in the map image. At this time, the coordinate conversion unit 4 calculates a position on the map image corresponding to the imaging target position information 3b transmitted from the mobile phone 11, and the map creation unit 71 arranges the captured image 3a at the image arrangement coordinates.

  Further, the direction calculation unit 44 calculates the image arrangement direction in which the captured image 3a is arranged. This image arrangement direction is directed to the imaging position where the captured image 3a is captured. The map creation unit 71 arranges the captured image 3a so as to face the image arrangement direction at the image arrangement coordinates.

  Therefore, it is possible to easily generate a map image in which captured images obtained by capturing an imaging target located along the road along the road line indicated in the map image are arranged toward the inside of the road.

(Example of change)
When the electronic map indicated by the vector map data 5a does not include boundary line (block vector) data, the road selection unit 42 selects the center line closest to the imaging target position, and the intersection calculation unit 43 The coordinates of the foot of the perpendicular line drawn from the imaging target position to the center line may be used as the image arrangement coordinates. Further, the map creating unit 71 may arrange the captured image 3a so that the center line and the lower side of the captured image 3a overlap at the image arrangement coordinates.

  In other words, in the electronic map, the intersection calculation unit 43 determines the coordinates of the foot of the perpendicular line that is lowered from the imaging target position to the nearest center line (road line) as the image placement coordinates, and the image registration unit 45 The captured image is registered in the database in association with the image arrangement coordinates.

  In the above configuration, the mail receiving unit 2, the first database 3, the coordinate conversion unit 4, the second database 5, the third database 6, and the image processing unit 7 are all incorporated in the server system 1, but these are independent. And may be interconnected so that they can communicate.

  Alternatively, the coordinate conversion unit 4 and the image processing unit 7 may be integrally formed to be a map image generation device.

  In the above description, when the map image display command is received from the terminal device 30, the image processing unit 7 generates a map image. However, the image processing unit 7 uses the e-mail received by the mail receiving unit 2 as a cue. May generate a map image.

  The combining unit 72 may perform image composition processing on the captured image 3 a when the captured image 3 a is registered in the second database 5 and store the combined image in the second database 5.

  A map image generation system including the mobile phone (imaging device) 11 and the server system 1 is also included in the technical scope of the present invention.

[Embodiment 2]
The following will describe another embodiment of the present invention with reference to FIGS. In addition, about the member similar to Embodiment 1, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

  The map image generation system 200 of this embodiment includes a server system (map image generation system, Web system) 10. The server system 10 receives imaging position information indicating the position when the imaging target is imaged from the mobile phone 11. When the position information acquisition unit 17 of the mobile phone 11 acquires the position information of its own apparatus from the GPS with little error, the position information can be used as the image pickup position information as it is, and the position is corrected manually (image pickup target position). Therefore, it is more convenient for the user to use the server system 10 than to use the server system 1.

(Configuration of mobile phone 11)
The mobile phone 11 acquires the position information of its own device from the GPS with little error in the position information acquisition unit 17, and the position information, that is, the position information of the mobile phone 11 when the captured image 3 a is captured (imaging position information). ) To the server system 10.

  In other words, the imaging position information acquired by the position information acquisition unit 17 is output to the mail creation unit 19, and the mail creation unit 19 transmits the file of the imaging position information and the file of the captured image 3a attached to an e-mail. To do. Therefore, in the present embodiment, the position information is not corrected by the user, and the corrected position information acquisition unit 18 is not necessary.

(Configuration of server system 10)
FIG. 15 is a functional block diagram showing the configuration of the server system 10. As shown in FIG. 15, in the server system 10 according to the present embodiment, the coordinate conversion unit 4 includes an intersection calculation unit (arrangement coordinate determination unit) 46.

  Further, the mail receiving unit 2 receives an electronic mail including the captured image 3 a and the captured position information 3 c from the mobile phone 11 and stores them in the first database 3. The imaging information acquisition unit 41 acquires the captured image 3 a and the imaging position information 3 c from the first database 3.

  The coordinate conversion unit 4 included in the server system 10 calculates image arrangement coordinates from the coordinates of the imaging position indicated by the imaging position information 3c by using the vector map data 5a.

  The intersection calculation unit 46 calculates the coordinates of the intersection when a perpendicular is dropped from the imaging position with respect to the boundary line facing the boundary line closest to the imaging position, and sets the intersection as the image arrangement coordinates. This process is based on the premise that the imaging target exists at a position opposite to the imaging position across the road.

  The general process flow in the server system 10 is the same as the process flow shown in FIG.

(Processing flow in the coordinate conversion unit 4)
Next, an example of the flow of coordinate conversion processing in the coordinate conversion unit 4 will be described with reference to FIG. FIG. 16 is a flowchart illustrating an example of the flow of coordinate conversion processing in the coordinate conversion unit 4 included in the server system 10.

  First, the imaging information acquisition unit 41 acquires the captured image 3a and the imaging position information 3c from the first database 3 (S31). The imaging information acquisition unit 41 outputs the captured image 3 a to the image registration unit 45 and the imaging position information 3 c to the road selection unit 42.

  Upon receiving the imaging position information 3c, the boundary line selection unit 42a selects a boundary line that is closest to the imaging position indicated by the imaging position information 3c (S32).

  In addition, when the imaging position information 3c is received, the center line selection unit 42b selects the center line that is closest to the imaging position indicated by the imaging position information 3c (S33).

  The road selection unit 42 outputs information specifying the boundary line selected by the boundary line selection unit 42 a and the center line selected by the center line selection unit 42 b to the intersection calculation unit 46.

  Upon receiving these pieces of information, the intersection calculation unit 46 calculates the intersection when the perpendicular is dropped from the imaging position with respect to the center line selected by the road selection unit 42, and the boundary line selected by the road selection unit 42 The coordinates (image arrangement coordinates) of the intersection when the perpendicular line is dropped from the imaging position with respect to the boundary line facing to (S34).

  In FIG. 8, assuming that the cross mark 51 is an imaging position, the intersection calculation unit 46 determines the intersection 56 as image arrangement coordinates. In this case, the intersection calculation unit 46 may first obtain the intersection point 56 that is the foot of the perpendicular line dropped from the imaging position to the nearest boundary line from the imaging position and then obtain the intersection point 56 that faces the intersection point 53.

  The intersection calculation unit 46 outputs the calculated coordinates of each intersection to the direction calculation unit 44.

  Upon receiving the coordinates of the intersection point, the direction calculation unit 44 calculates the direction of the vector (image arrangement direction) calculated by the intersection point calculation unit 46 and starting from the intersection point with the boundary line toward the intersection point with the center line (S35). ). The direction calculation unit 44 outputs the image arrangement coordinates and the calculated image arrangement direction information to the image registration unit 45.

  Upon receiving the information on the image arrangement direction, the image registration unit 45 associates the image arrangement coordinates determined by the intersection calculation unit 46 and the image arrangement direction determined by the direction calculation unit 44 with the captured image 3 a in the second database 5. Register (S36).

[Embodiment 3]
The following will describe still another embodiment of the present invention with reference to FIGS. In addition, about the member similar to Embodiment 1, the same code | symbol is attached | subjected and the description is abbreviate | omitted. The map image generation system 300 of this embodiment includes a server system (map image generation system, Web system) 20. FIG. 17 is a functional block diagram showing the configuration of the server system (map image generation system, Web system) 20.

  As illustrated in FIG. 17, the server system 20 includes an imaging target position estimation unit (imaging target position estimation device) 21 in addition to the configuration of the server system 1. When capturing images of streets along a road, images are often captured continuously along the road. At that time, it is troublesome to correct the position information (in other words, input of the imaging target position information) every time the captured image is captured.

  Therefore, when imaging is performed continuously, the imaging target position in the middle imaging is estimated from the imaging target position in the first imaging and the imaging target position in the last imaging. The imaging target position estimation unit 21 performs estimation of the imaging target position.

  On the other hand, the first imaging target position information 3d indicating the imaging target position in the first imaging and the second imaging target position information 3e indicating the imaging target position in the last imaging are input to the mobile phone 11, and a mail creation unit 19 attaches the files of the first and second imaging target position information together with the files of the plurality of captured images 3 a to the electronic mail and transmits them to the server system 20. The order corresponding to the imaging order is given to the plurality of captured images 3a.

  In addition, in order to show the imaging order of the some captured image 3a, you may utilize an imaging date. That is, among the plurality of captured images 3a, the captured image with the oldest captured date / time is captured first, and the captured image with the latest captured date / time is captured last.

(Configuration of the imaging target position estimation unit 21)
FIG. 18 is a functional block diagram illustrating a configuration of the imaging target position estimation unit 21. As illustrated in FIG. 18, the imaging target position estimation unit 21 includes a movement distance calculation unit (imaging target position information acquisition unit, imaging target position calculation unit) 22, a calculation unit (imaging target position calculation unit) 23, and an imaging count calculation unit. (Captured image number information acquisition means) 24 is provided.

  The movement distance calculation unit 22 acquires the first imaging target position information 3d and the second imaging target position information 3e stored in the first database 3, and the imaging target position indicated by the first imaging target position information 3d and the second The difference from the imaging target position indicated by the imaging target position information 3e is calculated. This difference corresponds to the total movement distance moved by the user for imaging.

  The imaging count calculation unit 24 calculates the number of captured images 3 a stored in the first database 3. The e-mail (data unit) transmitted from the mobile phone 11 includes a plurality of captured images 3a corresponding to a plurality of times of imaging. Calculating the number of captured images 3a is equivalent to calculating the number of captured images.

  The calculating unit 23 divides the total moving distance calculated by the moving distance calculating unit 22 by the number obtained by subtracting 1 from the number of times of imaging calculated by the number of times of imaging calculating unit 24, thereby calculating the moving distance (average moving distance) for one time. calculate. Based on the calculated average moving distance and the first and second imaging target positions, the imaging target position in the middle imaging is calculated. This process is performed on the assumption that the user is taking images of the streets along the road at regular intervals.

  The calculation unit 23 stores the calculated imaging target position of each captured image 3a in the first database 3 as the estimated imaging target position information 3f in association with each captured image 3a.

  The imaging information acquisition unit 41 of the coordinate conversion unit 4 acquires the estimated imaging target position information 3f together with the captured image 3a.

  Note that the above-described configuration of the imaging target position estimation unit 21 is merely an example, and the imaging target position estimation unit 21 determines the position of the imaging target first captured with respect to a plurality of captured images 3a that are continuously captured. An imaging target position information acquisition unit that acquires first imaging target position information 3d to be displayed and second imaging target position information 3e that indicates the position of the last imaged imaging target; Based on the captured image number information acquisition unit that acquires information, the first imaging target position information 3d and the second imaging target position information 3e, and the captured image number information, the imaging target positions respectively corresponding to the plurality of captured images 3a are determined. What is necessary is just to provide the imaging target position calculation part to calculate.

(Processing flow in the mobile phone 11)
An example of a processing flow in the mobile phone 11 that transmits an e-mail to the server system 20 will be described with reference to FIGS. 19 and 20. FIG. 19 is a diagram for explaining an imaging method using the mobile phone 11. FIG. 20 is a flowchart illustrating an example of a process flow in the mobile phone 11. Hereinafter, a case where the user performs imaging three times in succession will be described.

  As shown in FIG. 19, the user moves from point A through point B to point C along the road, and images the buildings on the other side of the road at points A, B, and C. Assume that the distance between the A point and the B point and the distance between the B point and the C point are 5 meters, respectively. That is, the distance D between the points A and C is 10 meters.

  First, the user performs imaging (first imaging) at the point A with the camera 16 (S41 in FIG. 20). The captured image (first captured image) is given the first order, and the first captured image is stored in the memory 15.

  As illustrated in FIG. 4, the user inputs the first imaging target position information 3 d by using the position information displayed on the display unit 13. This input is accepted by the corrected position information acquisition unit 18 (S42).

  When the user moves to the point B, the second imaging is performed (S43). The captured image (second captured image) is given the second order, and the second captured image is stored in the memory 15.

  Further, the user moves to the point C and performs the third imaging (S44). The captured image (third captured image) is assigned the third rank, and the third captured image is stored in the memory 15.

  Then, as shown in FIG. 4, the user inputs the second imaging target position information 3 e by correcting the position information displayed on the display unit 13. This input is received by the corrected position information acquisition unit 18 (S45).

  Upon receiving a mail creation command for commanding creation of an email from the user, the mail creation unit 19 receives the first and second imaging target position information files acquired by the correction position information acquisition unit 18 and the three stored in the memory 15. The file of the captured image 3a is attached to the e-mail (S46).

  Then, the mail creation unit 19 transmits the electronic mail to the server system 20 via the transmission / reception unit 12 (S47).

  Note that the first imaging (S41) may be performed after the input (S42) of the first imaging target position information 3d.

(Processing flow in the imaging target position estimation unit 21)
Subsequently, FIG. 21 shows an example of the flow of processing in the imaging target position estimating unit 21 after the e-mail is received by the mail receiving unit 2 of the server system 20 and the e-mail data is stored in the first database 3. This will be described with reference to FIG. FIG. 21 is a flowchart illustrating an example of a process flow in the imaging target position estimation unit 21.

  When the e-mail data is stored in the first database 3, the movement distance calculation unit 22 acquires the first imaging target position information 3 d and the second imaging target position information 3 e from the first database 3. Then, the movement distance calculation unit 22 calculates the total movement distance that is the difference between the imaging target position indicated by the first imaging target position information 3d and the imaging target position indicated by the second imaging target position information 3e (S51). In the case of the example shown in FIG. 19, the total moving distance is 10 meters. The movement distance calculation unit 22 outputs the calculated total movement distance to the calculation unit 23.

  Further, the imaging number calculation unit 24 calculates the number of the plurality of captured images 3a stored in the first database 3 (S52). In the case of the example illustrated in FIG. 19, the number of captured images 3 a is “3”. The imaging number calculation unit 24 outputs the calculated number of captured images 3 a (imaging number) to the calculation unit 23.

  Upon receiving the total moving distance and the number of captured images 3a, the calculation unit 23 calculates the average moving distance by dividing the total moving distance by the number obtained by subtracting 1 from the number of times of imaging (S53). In the case of the example illustrated in FIG. 19, the imaging count calculation unit 24 calculates 10/2 and calculates “5” as the average movement distance.

  Then, based on the calculated average moving distance and the first and second imaging target positions, the calculation unit 23 calculates the imaging target position in the middle imaging (the imaging target position in the second imaging in the example shown in FIG. 19). Calculate (S54).

  When the imaging target position is calculated, the calculation unit 23 associates each captured image 3a with the imaging target position when the captured image 3a is captured, and calculates the calculated imaging target position (estimated imaging target position information). 1 is stored in the database 3 (S55).

  In addition, after calculating the estimated imaging target position information, a plurality of continuously captured images 3 a may be combined into one image by the combining unit 72, and the combined image may be stored again in the first database 3. .

  Further, the calculation of the total moving distance (S51) may be performed after the calculation of the number of imaging (S52).

(Example of change)
The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention.

  For example, as illustrated in FIG. 19, captured images that are continuously captured may be arranged on a map image using the captured position information. That is, the second embodiment and the third embodiment may be combined.

  The server systems 1, 10, and 20 may acquire the captured image 3a and the imaging target position information 3b from a device other than the mobile phone. Examples of the device other than the mobile phone include a mobile terminal other than the mobile phone, a desktop terminal device, a storage device, and an information recording medium.

  In addition, the position information acquisition unit 17 is not limited to the one that uses GPS, and may use a base station, a wireless LAN access point, a marker, RFID (radio frequency identification), and the like, and GPS And may be used in combination. By using a combination of GPS and other position information providing means, the accuracy of position information may be improved.

  In addition, each block of the server systems 1, 10, and 20 described above, particularly the coordinate conversion unit 4 and the image processing unit 7, may be configured by hardware logic, or realized by software using a CPU as follows. May be.

  That is, the server systems 1, 10, and 20 are a central processing unit (CPU) that executes instructions of a control program that realizes each function, a read only memory (ROM) that stores the program, and a RAM (random) that expands the program. access memory), a storage device (recording medium) such as a memory for storing the program and various data. An object of the present invention is to provide program codes (execution format program, intermediate code program) of control programs (captured image registration program, map image generation program) of the server systems 1, 10, and 20 which are software for realizing the functions described above. A recording medium in which a source program is recorded so as to be readable by a computer is supplied to the server systems 1, 10, and 20, and the computer (or CPU or MPU) reads and executes the program code recorded on the recording medium. Can also be achieved.

  Examples of the recording medium include tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and disks including optical disks such as CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  The server systems 1, 10, and 20 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Also, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  As a map image generation system that generates a map image based on a captured image transmitted from a mobile terminal in a service that provides map information, a map image that reproduces a cityscape along a road can be generated at low cost. Available.

It is a functional block diagram which shows the structure of the server system which concerns on one Embodiment of this invention. It is a figure which shows the outline | summary of the map image generation system which concerns on one Embodiment of this invention. It is a functional block diagram which shows the structure of the mobile telephone which transmits an email to the said server system. It is a figure which shows an example of the positional information displayed on the display part with which the said mobile phone is provided. It is a flowchart which shows an example of the flow of the process in the said mobile telephone. It is a flowchart which shows an example of the flow of a process in the said server system. It is a flowchart which shows an example of the flow of the coordinate transformation process in the coordinate transformation part with which the said server system is provided. It is a figure for demonstrating the selection method of the boundary line by a boundary line selection part. It is a figure for demonstrating the selection method of the centerline by a centerline selection part. It is a figure which shows an example of the image arrangement | positioning direction which a direction calculation part calculates. It is a figure which shows the arrangement | positioning method of a captured image. (A) is a figure which shows an example of the map image which a map preparation part produces | generates, (b) is a figure which shows another example of the map image which a map preparation part produces | generates. It is a figure which shows another example of the map image which a map preparation part produces | generates. It is a figure which shows an example of registration image data. It is a functional block diagram which shows the structure of the server system which concerns on another embodiment of this invention. It is a flowchart which shows an example of the flow of the coordinate transformation process in the coordinate transformation part with which the said server system is provided. It is a functional block diagram which shows the structure of the server system which concerns on this another embodiment of this invention. It is a functional block diagram which shows the structure of the imaging target position estimation part with which the said server system is provided. It is a figure for demonstrating the imaging method using the mobile telephone which concerns on one Embodiment of this invention. It is a flowchart which shows an example of the flow of the process in the said mobile telephone. It is a flowchart which shows an example of the flow of a process in the said imaging target position estimation part.

Explanation of symbols

1 Server system (map image generation system, Web server)
3a Captured image 3b Capture target position information 3c Capture position information 3d First capture target position information 3e Second capture target position information 4 Coordinate converter (captured image registration device)
5 Second database 5a Vector map data (map data)
6a Map image 7 Image processor (Map image generator)
10 Server system (Map image generation system, Web server)
11 Mobile phone 20 Server system (Map image generation system, Web server)
21 Imaging target position estimation unit (imaging target position estimation device)
22 Moving distance calculation unit (imaging target position information acquisition means, imaging target position calculation means)
23 Calculation unit (imaging target position calculation means)
24. Number of times of imaging calculation (captured image number information acquisition means)
41 Imaging information acquisition unit (imaging information acquisition means)
42 Road selection part (placement coordinate determination means)
43 intersection calculation unit (placement coordinate determination means)
44 Direction calculation unit (direction determination means)
45 Image registration unit (image registration means)
46 Intersection calculation unit (placement coordinate determination means)
52a line segment (outer edge line)
52b Line segment (outer edge line)
53 Intersection (vertical foot)
54 Intersection (vertical foot)
71 Map creation unit (acquisition means, image processing means)
72 Compositing unit (image compositing means)

Claims (19)

Imaging information acquisition means for acquiring an imaging image obtained by imaging an imaging target located along a road, and imaging target position information indicating the position of the imaging target;
Using the map data indicating the coordinates of the map image showing the road line indicating the road, in the map image, from the position of the imaging target indicated by the imaging target position information to the nearest road line An arrangement coordinate determining means for determining coordinates as image arrangement coordinates;
An image registration apparatus comprising: an image registration unit that registers the captured image in a database in association with the image arrangement coordinates of the map image. A direction for determining in which direction the road line closest to the position of the imaging target exists in the map image with reference to the position of the imaging target indicated by the imaging target position information using the map data Further comprising a determining means,
2. The captured image registration apparatus according to claim 1, wherein the image registration unit registers the direction determined by the direction determination unit in the database in association with the captured image. Imaging information acquisition means for acquiring a captured image obtained by imaging an imaging target located along a road, and imaging position information indicating a position where the imaging target is captured;
Using the map data indicating the coordinates of the map image showing the road line indicating the road, in the map image, the coordinates of the foot of the perpendicular line drawn from the imaging position indicated by the imaging position information to the nearest road line are imaged An arrangement coordinate determining means for determining the arrangement coordinates;
An image registration apparatus comprising: an image registration unit that registers the captured image in a database in association with the image arrangement coordinates of the map image. The road line includes a pair of outer edge lines that define the width of the road,
In the map image, the arrangement coordinate determining means determines, as image arrangement coordinates, the coordinates of the foot of a perpendicular line drawn from the imaging position indicated by the imaging position information to the other outer edge line paired with the nearest outer edge line. The captured image registration apparatus according to claim 3. The map data further includes direction determining means for determining in which direction the road line closest to the imaging position exists in the map image with reference to the imaging position indicated by the imaging position information. ,
The captured image registration apparatus according to claim 3, wherein the image registration unit registers the direction determined by the direction determination unit in the database in association with the captured image.   A captured image registration program for operating the captured image registration apparatus according to any one of claims 1 to 5, wherein the captured image registration program causes a computer to function as each of the means.   A computer-readable recording medium on which the captured image registration program according to claim 6 is recorded. A captured image obtained by imaging an imaging target located along the road;
Image arrangement coordinate information indicating coordinates for arranging the captured image on a map image on which a road line indicating a road is displayed;
In the map image, acquisition means for acquiring image arrangement direction information indicating a direction in which the captured image faces the nearest road;
Image processing means for generating a map image in which the captured image is arranged in the direction indicated by the image arrangement direction information at the coordinates of the map image indicated by the image arrangement coordinate information. Image generation device. The image processing apparatus further includes image combining means for combining one image from the plurality of captured images by superimposing overlapping regions of the plurality of captured images acquired by the acquisition means,
The image processing means generates a map image in which an image synthesized by the image synthesizing means is arranged at a coordinate in the map image indicated by the image arrangement coordinate information in a direction indicated by the image arrangement direction information. The map image generation apparatus according to claim 8, wherein the map image generation apparatus is a map image generation apparatus.   10. The map image according to claim 8, wherein the image processing unit generates a map image that is visually recognized so that the captured image acquired by the acquisition unit stands up with respect to the map image. Generator.   A map image generation program for operating the map image generation device according to any one of claims 8 to 10, wherein the map image generation program causes a computer to function as each of the means.   The computer-readable recording medium which recorded the map image generation program of Claim 11. A map image generation system comprising the captured image registration device according to claim 1 and the map image generation device according to claim 8.
The map image generation system characterized in that the acquisition means acquires a captured image and image arrangement coordinates registered by the captured image registration device. A map image generation system comprising the captured image registration device according to claim 3 and the map image generation device according to claim 8.
The map image generation system characterized in that the acquisition means acquires a captured image and image arrangement coordinates registered by the captured image registration device.   15. A Web server comprising display data generating means for generating data for displaying a map image generated by the map image generating system according to claim 13 or 14 on a Web page.   16. The web server according to claim 15, further comprising banner advertisement data generation means for generating data for displaying a banner advertisement on the web page. First image target position information indicating the position of the first imaged object and second image target position information indicating the position of the last imaged image regarding a plurality of imaged images that have been continuously imaged. Imaging object position information acquisition means for acquiring;
Captured image number information acquisition means for acquiring captured image number information indicating the number of captured images;
Imaging targets corresponding to the plurality of captured images based on the first and second imaging target position information acquired by the imaging target position information acquisition unit and the captured image number information acquired by the captured image number information acquisition unit, respectively. An imaging target position estimation device comprising: an imaging target position calculation unit that calculates a position. A captured image registration method in a captured image registration apparatus comprising imaging information acquisition means, arrangement coordinate determination means, and image registration means,
An imaging information acquisition step in which the imaging information acquisition means acquires an imaging image obtained by imaging an imaging object located along a road; and imaging object position information indicating a position of the imaging object;
The arrangement coordinate determination means uses map data indicating the coordinates of a map image showing a road line indicating a road, and in the map image, the closest road line from the position of the imaging target indicated by the imaging target position information An arrangement coordinate determining step for determining the coordinates of the foot of the perpendicular line as the image arrangement coordinates;
An image registration method, wherein the image registration means includes an image registration step of registering the captured image in a database in association with the image arrangement coordinates of the map image. A captured image registration method in a captured image registration apparatus comprising imaging information acquisition means, arrangement coordinate determination means, and image registration means,
An imaging information acquisition step in which the imaging information acquisition means acquires an imaging image obtained by imaging an imaging object located along a road, and imaging position information indicating a position where the imaging object is imaged;
The arrangement coordinate determining means uses map data indicating the coordinates of a map image showing a road line indicating a road, and lowers the map image from the imaging position indicated by the imaging position information to the nearest road line. An arrangement coordinate determination step for determining the coordinates of the foot of the perpendicular as the image arrangement coordinates;
An image registration method, wherein the image registration means includes an image registration step of registering the captured image in a database in association with the image arrangement coordinates of the map image.