JP2002189412A - Mapping system and mapping method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a mapping system and a mapping method capable of improving the handling time required in the mapping work and the updating work of a map having 3D(three-dimensional) pictures at a lower cost. SOLUTION: This mapping system is provided with an information processing system 4 which collects picture data including objects which are picked up by the picture pickup system 1, of a user and are related to a map together with positional information of pickup positions of the objects and constructs three-dimensional pictures 48 of the objects updatably on the map data 47 which are preliminarily set virtually based on the picture data and the positional information of the pickup positions of the objects for every picture collection and distributes the three-dimensional pictures in accordance with the request of the user via the Internet utilization system of a user side 2 or the like.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a map creation system and a map creation method, and more particularly to a method for creating and updating a three-dimensional (3D) map based on an image taken by an imaging device such as a camera.
And techniques for distributing.

[0002]

2. Description of the Related Art In recent car navigation systems, DVDs having an information capacity of about 7.5 times or about 13 times that of a CD-ROM are known.
-ROM is being used as a recording medium for map information. With the increase in the information capacity of the DVD-ROM, a map of a 3D image with a more realistic map display has appeared. For example, it is possible to three-dimensionally express a building shape or a street which is a guide for driving (for example, “ ITS Handbook 1999
−2000 ”, Road New Industry Development Organization, p. 19).

[0003] Such a 3D image map is not limited to a car navigation system, but with the rapid development of the information technology (IT) symbolized by the increasing use of the Internet and mobile phones in recent years, for example, the Internet connection service of mobile phones has been developed. PC including
On the Internet (W
eb) It is expected that usage as various map contents such as contents and contents for data broadcasting which can be viewed by digital broadcasting is expanded.

[0004]

However, with regard to the above-described 3D image map contents, the work of creating the map is often labor-intensive, and even if created once, it must be renewed every day. However, it is labor-intensive, time-consuming, and time-consuming, so that it tends to be more expensive, and in such a point, it may become a bottleneck for future needs for expanding usage. This problem becomes more remarkable especially in the case of an object having a high map update need.

That is, the user does not need information of the same accuracy for all objects such as buildings and landscapes on the map, and objects having a higher degree of interest and a higher information value for the user are more required. There is also a need for detailed information (in other words, information on other objects is hardly needed). This object with high information value is likely to be of high information value to other users as well, so it is easy to create more detailed information with a simpler method, and it is updated daily thereafter It is hoped that it will continue.

SUMMARY OF THE INVENTION The present invention has been made in view of such a conventional situation, and it is an object of the present invention to provide a map creation system and a map creation method for improving the work of creating and updating a 3D image at a lower cost. Aim.

The present invention also provides a method for creating a map having more detailed information for an object having a higher information value for a user,
It is another object to provide a map creation system and a map creation method that allow updating.

[0008]

According to the present invention, in order to achieve the above object, images taken by an image pickup device such as a digital camera are collected via the Internet, and a three-dimensional map based on a 3D image is automatically converted to a disk array or the like. And automatically updates the 3D image of a place where this image data frequently gathers, that is, a place where the information value is large.

A map creation system according to the present invention has been completed based on such an idea, and includes image data including an object relating to a map taken by a user's image pickup device together with positional information of the image pickup point. Image collecting means for collecting the object via a communication line, and a three-dimensional image of the object on map data virtually set in advance based on the image data collected by the image collecting means and the position information of the imaging point. And an image constructing means for constructing the image so as to be updated every time the image is collected.

[0010] In the present invention, the image distribution means can include means for distributing using the Internet. Further, in the present invention, the image distribution means may include a means for distributing using two-way digital broadcasting.

[0011] In the map creation method according to the present invention, a step of collecting, via a communication line, image data including an object imaged by a user's imaging device together with positional information of the imaging point, and Constructing a three-dimensional image of the object on map data that is virtually set in advance based on the image data and the position information of the imaging point so that the three-dimensional image can be updated every time the image is collected. And

Further, a map creation system according to the present invention comprises:
Image collection means for collecting, via a communication line, image data including an object relating to a map taken by a user's image pickup device together with positional information of the image pickup point; image data collected by the image collection means; Image constructing means for constructing a three-dimensional image of the object on map data which has been virtually set in advance based on the position information of the point so as to be able to be updated each time the image is collected, and image constructing means constructed by the image constructing means. Image distribution means for distributing a three-dimensional image in response to a user request.

Further, the map creation system according to the present invention comprises an image collection means for collecting, via a communication line, image data including an object relating to a map taken by a user's image pickup device together with positional information of the image pickup point. And constructing a three-dimensional image of the object on the map data which is virtually set in advance based on the image data collected by the image collecting means and the position information of the imaging point so that the three-dimensional image can be updated every time the image is collected. An image constructing means, and an image analyzing means for analyzing and providing an update state of the image collected by the image collecting means or the three-dimensional image constructed by the image constructing means are provided.

[0014]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of a map creation system and a map creation method according to the present invention will be specifically described below with reference to FIGS.

In the case of the present example, the digital map center shown in FIG. 1 is a digital map center (this is a tentative name and the name is Not limited to), the user-side image photographing system 1 that can be distributed (supplied) to the member users, the user-side Internet use system 2, the digital broadcast use system 3, and the digital map center side information. A processing system 4 is provided, and each of the systems 1 to 4 is communicably connected via a communication line NT. Here, for example, ISDN
Includes telephone lines, private lines, and cable TV lines.

The user-side image photographing system 1 is an image pickup apparatus which forms a main body which can easily take a still image or a moving image of a target object such as a building or a landscape around the user at any place as required by the user. (For example, digital camera, DV
Camera 10), a GPS receiver 11 mounted integrally or separately and capable of receiving a position signal (latitude / longitude data) from a GPS satellite, image data captured by the imaging device 10, A recording medium (for example, a removable medium such as a flash memory) 12 for recording the latitude / longitude data received by the GPS receiver 11 at the imaging position in association with each other, and each data of the recording medium 12 is transmitted to a communication line NT such as the Internet. Communication device 13 for transmitting to the digital map center side via
And a controller 14 for controlling the overall operation of the steps # 13 to # 13.

The above elements 10 to 13 can be formed integrally or separately. In this case, with the integrated type,
For example, it can be constituted by an information portable terminal such as a mobile phone, a PHS, a PDA, and a notebook PC. In a separate body, all the elements 10 to 14 can be constituted separately, or only some of them can be integrated. It is possible to combine them and form the rest separately. For example, an image obtained by a portable device equipped with the imaging device 10, the GPS receiver 11, and the controller 14 and each data of the imaging position are recorded on a portable recording medium 12 such as a flash memory. Can be transmitted using the existing PC-connected communication device 13.

User side Internet use system 2
Is a PC (personal computer) 20 and this PC
And a communication device 21 that connects the communication device 20 to the communication line NT. The PC 20 executes a web browsing program (browser) or the like installed on a recording medium such as a hard disk by its CPU, so that a 3D image or the like provided on the digital map center side from the communication device 21 through the communication line NT is provided. Web pages can be browsed. Although the PC 20 is illustrated in this example, the present invention is also applicable to a mobile device such as a mobile phone, a PHS, a PDA, and a wearable computer as long as the terminal can use the Internet.

The user-side digital broadcast utilization system 3 comprises:
A digital TV receiver 30 for receiving a broadcast content such as a digital map content of a 3D image digitally broadcasted by a digital broadcasting system described later of the digital map center side information processing system 4, and an image receiving device for broadcasting the received broadcast content Device 31 and a remote controller 32 for allowing the user to view the image on the receiver 31 and perform various operations such as selecting a program or selecting various buttons related to data broadcasting.
And a communication device 33 connected to the communication line NT so that bidirectional communication is possible while viewing and listening to digital broadcasting by each of the elements 30 to 32. As the receiver 30 and the receiver 31 of the present example, any of a known integrated device (for example, a digital TV with a built-in tuner) or a separate device can be applied.

The digital map center information processing system 4 includes a server 40 which is a computer (computer) responsible for various processing centers in the system, a communication device 41 connecting the server 40 to a communication line NT, and 3D map data. The digital map content of the 3D image stored in 49, satellite broadcasting (BS), communication satellite (CS), cable TV,
Digital broadcasting system 42 for broadcasting by terrestrial waves or the like
And. The digital broadcasting system 42 is not limited to the one built in the digital map center, but can be applied to a system using broadcasting facilities (not shown) on the broadcasting station side.

The server 40 has a built-in C
The CPU 43 includes a PU 43, a memory (RAM, ROM, etc.) 44, a disk array 45 (comprising a disk-type recording medium such as a hard disk), and causes the CPU 43 to execute a 3D image creation program 47 held in the memory 44. Thus, the image data from the user-side image capturing system 1 and its longitude / latitude data are collected via the communication device 41, and the map master data 48 (provided by the Geospatial Information Authority of Japan) in the disk array 43 based on these data. ) Using the virtual map master
The D image is created and updated, and can be distributed to the user via the communication device 41 as needed.

Here, the overall operation of the present embodiment will be described with reference to FIGS.

FIG. 2 illustrates the flow of business at the "Digital Map Center".

In FIG. 2, on the digital map center side, users who can be members of the digital map center (in the example of the figure, individuals, corporations (marketing companies, advertising agencies, and other various types), and municipal governments (the National Police Agency and the expressway) ), Sales, contracts, collection of membership fees (including corporate membership fees, subsidies / subsidies, etc.), etc., thereby signing a membership agreement with the user Tie.

Subsequently, the digital map center performs tasks related to the purchase, distribution, and management of the user-side image photographing system 1, so that at least the GPS receiver 1 of the image photographing system 1 can be provided to users who have become members.
The imaging device 10 with 1 is lent.

On the digital map center side, operations relating to system construction and management are performed. With this, when an image recording (photographing) by a member is performed using the image photographing system 1, the information processing system 4 executes the recording. Collect images from members and create 3D maps based on the images /
Update and update the 3D map using the Internet web (or interactive digital broadcasting) for members (individuals, corporations,
(Government and local governments) and record (keep) the 3D map.

FIG. 3 explains the processing outline of the digital map center side information processing system 4 in accordance with the above-mentioned business flow.

In FIG. 3, on the user side as a member, for example, a scene of a shooting object (object) such as a city view around the place where the user is currently located by the imaging device 10 of the image shooting system 1 distributed according to the membership contract. An image is captured (step S1).

Then, under the control of the controller 12, the captured image data of the object to be photographed is transmitted to the Internet web or the like together with the GPS position data relating to the latitude and longitude information of the photographing position obtained by the GPS receiver 11. It is transmitted from the communication device 14 to the digital map center side via the communication line NT by using (step S2).

In response to this, the digital map center side processes the communication device 41 by the processing of the information processing system 4.
The image data is taken into the server 40 through the server 40, and the server 40 executes the 3D image creation program 4 to calculate the viewpoint (viewing angle) on the map (map master) in the virtual space composed of the map master data 43a. By calculating the difference, a stereoscopic image to be photographed is generated (step S3). At this time, it is possible to obtain a stereoscopic image of the photographing target viewed from various angles by using a plurality of image data photographed at the same point.

The 3D map data 43 constituting a map of the area including the object to be photographed is obtained by sequentially joining the three-dimensional images obtained in this way for each adjacent point.
b is generated on the disk array 43 (step S
4).

After that, the 3D map data 43b generated on the disk array 43 as required by a request from the user or the like is transmitted to each of the user systems 2 on the user side by using the Internet web or two-way digital broadcasting. 3 (step S5). As a result, on the user side,
The desired 3D map data 43b can be viewed using the Internet or digital broadcasting.

FIG. 4 illustrates a detailed example of a process relating to the generation of a 3D map among the above processes.

In FIG. 4, on the digital map center side, a moving image or a moving image taken by the user with the image pickup device 10 (a digital camera with a GPS data input device in the example in the figure) of the image pickup system 1 provided to the user as a member. The image data of the still image is appended with the latitude / longitude data of the shooting location obtained by the GPS receiver 11, and is taken into the server 40 of the information processing system 4 via the communication line NT via the Internet (step S11).

Next, according to the processing of the server 40, if the image data is a still image, the image is displayed, and if the image data is a moving image (see the example in the figure), an image of an arbitrary one frame (hereinafter, in the example in the figure, " A image) is extracted (step S12), and an object to be photographed (hereinafter, referred to as an "object") such as a building or landscape is automatically cut out from the "A image" by edge detection using a known image processing method (step S12). S13).

Then, by the processing of the server 40, the photographing position on the map master is specified from the latitude and longitude data of the image (in the example in the figure, the photographing position on the map master is "A image").
To calculate the position indicated by "----" in the figure), search the map master for a position to which the cut-out object matches (step S14), and specify the position on the specified map master. The object is fixed at the position (coordinates) and the scale of the image is adjusted according to the area on the map (step S15).

Separately, the digital map center fetches a new image (hereinafter, referred to as "B image") to which the latitude and longitude data similar to those of the above "A image" are attached (step S21), As for the “B image”, similarly to the above “A image”, an object is automatically cut out (step S22), and a position to which the cut out object fits is searched and specified on a map master, and the specified image is specified. The object is fixed at the position (coordinates) on the map master and the scale of the image is adjusted according to the area on the map (step S23).

Then, by the processing of the server 40, a three-dimensional diagram is calculated and drawn from the correlation between the images of the "A image" and "B image" obtained above and their coordinate data, and this process is continuously performed. To generate a 3D map on the disk array, and perform a similar calculation each time an image at the same point (an image of approximate coordinate data) is input to generate (update) a constantly changing map (step). S16). Thereafter, in response to a request from the user or the like, the data is converted into a data format and a data amount suitable for distribution conditions and transmitted to the user via the communication line NT (step S17).

Therefore, according to this embodiment, a plurality of city view images photographed by a user such as a member are added to the position (latitude / longitude) information of the photographing point, collected via the Internet, and each image is collected. 3 based on the information of the viewing angle difference at the shooting point
Generate a 3D image and map it on a digital map
Map data is composed, the map is automatically updated each time image data from the user arrives, and this is distributed to the user via the Internet web as needed. It is possible to provide a map creation system and a map creation method that improves the labor of the user at a lower cost, and as the information value is higher for the user,
Since a large amount of information is collected, it is possible to create and update a 3D map having more detailed information.

Further, an analysis program 46 (see FIG. 1) for analyzing the image data itself collected in this way and the update status of the 3D map updated by the 3D image creation program using the image data is provided. Is also possible.

According to this, for example, the situation of a store, a passing person, a car, and the like can be easily grasped, so that it can be used as an application in car navigation, marketing, and the like.

Further, since a map having a higher information value allows more information to be collected, it is possible to use a feature that the information is more detailed and updated more frequently, thereby making it possible to construct a family restaurant or a convenience store. When investigating the location conditions, we also take in information such as people passing by at the target location, and how many stores, how many people pass, and what kind of cars come and go at this point Can be easily monitored,
This is expected to be useful in research, planning, marketing, etc.

Although only members are assumed as users (users) in the present example, the present invention is not limited to this, and it goes without saying that non-members may be used.

[0044]

As described above, according to the present invention,
3D image map creation and update work can be reduced and provided at a lower cost. As a result, objects with higher information value for users can collect more information,
It is possible to create and update maps with more detailed information.

[Brief description of the drawings]

FIG. 1 is a schematic block diagram showing an outline of a map creation system according to an embodiment of the present invention.

FIG. 2 is a schematic flowchart for explaining the flow of business on the digital map center side.

FIG. 3 is a schematic flowchart illustrating the overall operation of the embodiment.

FIG. 4 is a schematic flowchart illustrating a detailed processing example of creating a 3D map.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 user-side image shooting system 2 user-side Internet use system 3 user-side digital broadcast use system 4 digital map center side information processing system 10 imaging device 11 GPS receiver 12 recording medium 13 communication device (for image shooting system) 14 controller 20 PC (Personal computer) 21 Communication device (for Internet use system) 30 Digital TV receiver 31 Receiver 32 Remote control (remote controller) 33 Communication device (for digital broadcast use system) 40 Server 41 Communication device (for information processing system) 42 Digital broadcasting system 43 CPU 44 Memory 45 Disk array 46 Image analysis program 47 3D image creation program 48 Map master data 49 3D map data 43a Map master Over data 43b 3D map data NT communication line

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification code FI Theme coat ゛ (Reference) H04B 7/26 H04N 5/225 Z 5K067 H04N 5/225 5/76 Z 5/76 H04B 7/26 MF Term (Reference) 2C032 HB11 5B050 AA08 BA09 BA10 BA11 BA17 CA07 CA08 DA07 EA07 EA19 FA02 FA06 FA19 5B075 ND08 ND23 PQ02 PQ13 UU13 5C022 AA01 AC41 5C052 AA01 AB03 AB04 CC06 DD04 5K067 AA21 BB04 BB21

Claims (4)

[Claims] An image collection unit that collects, via a communication line, image data including an object related to a map captured by a user's imaging device together with position information of the imaging point; Image constructing means for constructing a three-dimensional image of the object so as to be able to be updated every time the image is collected, on map data which is virtually set in advance based on the image data and the position information of the imaging point. A mapping system characterized by the following. 2. A step of collecting, via a communication line, image data including an object picked up by a user's image pickup device together with positional information of the image pickup point; Constructing a three-dimensional image of the object on map data virtually set in advance based on the position information so that the three-dimensional image can be updated every time the image is collected. 3. An image collecting means for collecting, via a communication line, image data including an object related to a map taken by a user's image pickup device together with position information of the image pickup point, and image data collected by the image collecting means. Image construction means for constructing a three-dimensional image of the object on map data which is virtually set in advance based on the image data and the position information of the imaging point so that the three-dimensional image can be updated every time the image is collected; And an image distributing means for distributing the three-dimensional image constructed in accordance with a user's request. 4. An image collecting means for collecting, via a communication line, image data including an object related to a map taken by a user's image pickup device together with position information of the image pickup point, and image data collected by the image collecting means. Image construction means for constructing a three-dimensional image of the object on map data which is virtually set in advance based on the image data and the position information of the imaging point so that the three-dimensional image can be updated every time the image is acquired; And an image analysis unit for analyzing and providing an update status of the image collected by the above or the three-dimensional image constructed by the image construction unit.