WO2007052333A1

WO2007052333A1 - Geographic information apparatus and geographic information system

Info

Publication number: WO2007052333A1
Application number: PCT/JP2005/020044
Authority: WO
Inventors: Kohei Arai
Original assignee: Saga University
Priority date: 2005-10-31
Filing date: 2005-10-31
Publication date: 2007-05-10
Also published as: JPWO2007052333A1; JP4734660B2

Abstract

When a mobile communication terminal is used to perform an image capture, the outline of objects such as buildings, traffic lights and crossroads in three-dimensional geographic information is displayed based on the three-dimensional geographic information. Then, the user can perform an image capture in accordance with the displayed outline, and an appropriate captured image, which is assumed at the geographic information providing end, can be stored by a geographic information providing apparatus, whereby three-dimensional geographic information on which a high-quality captured image is pasted can be provided to the user.

Description

Specification

Map information apparatus and map information system

Technical field

The present invention relates to a map information providing system that provides map information, and more particularly, to a map information providing system that targets map information that is three-dimensional information.

Background art

As a background art of the present invention, there is a position information management system disclosed in Japanese Patent Laid-Open No. 2003-111128.

[0003] The position information management system of this background art includes a data storage means for storing map data, and landscape image data captured of a landscape around the user's information communication terminal from the information communication terminal via a communication line. Based on the data receiving means received by the data receiving means, the landscape image data received by the data receiving means, and the map data stored in the data storage means! /, The current position where the information communication terminal is located is determined. This configuration includes current position specifying means for specifying.

[0004] According to the position information management system of this background art, the position information from the GPS satellite can be obtained without using the position information from the GPS satellite or the position information by the three-point survey method from a plurality of surrounding base stations. It is possible to identify the current location of the information communication terminal with the same high accuracy as when using information.

[0005] The following technical matters are also disclosed in the publication.

• Identify location based on orientation data in addition to landscape image data

• Identify location using base station area information

• Update stored map data based on landscape image data

'Navigating to the destination specified by the user

Patent Document 1: Japanese Patent Laid-Open No. 2003-111128

Disclosure of the invention

Problems to be solved by the invention

[0006] The position information management system of the background art is capable of receiving radio waves of GPS satellite power. In the environment of difficult buildings or underground malls, it is impossible to identify the location using GPS. In view of this problem, the position accuracy is as high as when using GPS. The purpose was to identify the current location of the information communication terminal.

However, the position information management system of the background art is configured as described above and has the following problems.

• Update the map data using the landscape image data captured by the user's information communication terminal! However, if the landscape image data is updated by mistake because of the use of GPS!

• The landscape image data captured by the user's information communication terminal is captured at the discretion of the user, and the landscape image data as planned by the system cannot be obtained, resulting in poor overall quality. Creating map data

'Renewal is repeated every time landscape image data is uploaded to the system, the load on the system increases, and the landscape does not change frequently, so there is a problem that the update itself is wasteful

The present invention has been made to solve the above-described problems, and an object thereof is to provide a map information system in which image data related to map information is appropriately updated.

Means for solving the problem

[0008] (1) A map information providing apparatus according to the present invention is a map information providing apparatus that transmits 3D map information in response to a request from a mobile communication terminal equipped with a GPS receiver, which is received from a mobile communication terminal. Means for reading out the corresponding 3D map information from the 3D map information storage means based on the positioning information, means for reading out the corresponding satellite image from the satellite image storage means based on the positioning information or the read out 3D map information, and positioning information or reading out And a means for reading out the corresponding captured image from the captured image storage means based on the 3D map information, and a means for pasting the satellite image and the captured image to the 3D map information.

[0009] Thus, in the present invention, 3D map information is read based on positioning information from a mobile communication terminal, a satellite image and a captured image are read as images necessary for this 3D map information, and a 3D map is read. Since the satellite image and the captured image are pasted to the information and provided to the user, the satellite image and the captured image are interpolated to have a highly accurate real image. Original map information can be provided.

A mobile communication terminal is a terminal that can be carried and communicated, and specifically includes a mobile phone, a PHS, a PDA including a communication device, and a notebook computer including a communication device.

The captured image is an image captured by a mobile phone with a camera, a digital camera, an in-vehicle camera, or the like.

[0010] It is also possible to adopt a configuration in which a satellite image is pasted on the top surface of a building and a road, and a captured image is pasted on a side surface of an object having a side surface (a road has no normal side surface). Alternatively, a configuration can be adopted in which a captured image is pasted where there is a captured image, and a satellite image is pasted in addition to that. One image can be pasted first, and the other image can be pasted on top of it.

[0011] (2) A map information providing system according to the present invention includes a mobile communication terminal including an imaging device and a GPS receiver, and a map information providing apparatus that transmits 3D map information in response to a request from the mobile communication terminal. A map information providing system, wherein the map information providing device reads the corresponding 3D map information from the 3D map information storage means based on the positioning information received from the mobile communication terminal, and the positioning information or the read 3D map. Means for reading out the corresponding captured image from the captured image storage means based on the information, means for pasting the captured image on the 3D map information, and recording the captured image from the mobile communication terminal in the captured image storage means based on the positioning information. Means for displaying the outline of the object in the 3D map information during the imaging mode based on the 3D map information. A.

As described above, in the present invention, when imaging is performed with a mobile communication terminal, outlines of objects such as buildings, traffic lights, and intersections in the 3D map information are displayed based on the 3D map information, and the user is encouraged. 3D map information can be captured in accordance with the outline, the map information provider can store the appropriate captured image assumed by the map information provider, and a high-quality captured image is pasted to the user Can be provided.

[0013] The outline need not display the outline of all objects. For example, just the outline of the object located in the middle. Outline is 3D model If Dell is displayed in wireframe, this is the part of the frame (preferably shaded).

[0014] (3) The map information providing system according to the present invention requires a new captured image such as a captured image status stored in the captured image storage means if necessary. In this case, a means for requesting imaging based on positioning information transmitted to the mobile communication terminal is newly included.

Thus, in the present invention, in addition to (2), the map information providing device is a captured image storage means.

When it is determined that a new captured image is necessary according to the captured image status, the user communication power is determined based on the transmitted positioning information. Since the mobile communication terminal is requested to capture an image, the user can capture the captured image required by the map information providing device and collect high-quality captured images by the above-mentioned line while keeping costs down. Can do.

“From captured image status stored in captured image storage means” means, for example, when there is no captured image at a certain location, when there is a captured image, but when the captured date and time is old, there is a captured image but at a specific time This is the case when images are missing. This is an item that can be set appropriately by the equipment operator.

[0015] (4) A map information providing apparatus according to the present invention is a map information providing apparatus that transmits 3D map information in response to a request from a mobile communication terminal including an imaging device and a GPS receiver, as necessary. Based on the positioning information received from the mobile communication terminal, the means for reading out the corresponding 3D map information from the storage means, and the power of the captured image storage means based on the positioning information or the read out three-dimensional map information Means for pasting the captured image on the three-dimensional map information, means for performing a route search from the current position and destination when the destination is set from the mobile communication terminal, and measurement from the mobile communication terminal. It includes means for specifying the imaging direction of the mobile communication terminal at the time of imaging from the position information and the captured image, and creating information for guiding in the path direction using the imaging direction and the path direction.

As described above, in the present invention, the imaging direction of the mobile phone at the time of imaging is specified from the positioning information from the mobile communication terminal and the captured image, and the route direction from the imaging direction to the destination and the imaging direction. By creating information to be guided to the mobile phone, receiving it with a mobile phone, and outputting the guidance, the user can guide the user in the right direction without having to compare the surrounding situation with the 3D map information. Information to be guided includes information on an arrow in the direction of the route, an image in the correct direction of the route, and an image in which the imaging direction force reaches the direction of the route (may be a discontinuous image or a no-llama image). Applicable.

(5) A map information providing apparatus according to the present invention is a map information providing apparatus that transmits 3D map information in response to a request from a mobile communication terminal including an imaging device and a GPS receiver, if necessary. Based on the positioning information received from the mobile communication terminal, the means for reading out the corresponding 3D map information from the storage means, and the power of the captured image storage means based on the positioning information or the read out three-dimensional map information Means, a means for pasting a captured image on three-dimensional map information, a means for the map information providing device to store positioning information and embedded information from the mobile communication terminal in the embedded information storage means, and a request from the mobile communication terminal And means for including embedded information in the area of the 3D map information to be transmitted to the mobile communication terminal in the 3D map information.

As described above, according to the present invention, the positioning information and the embedded information from the mobile communication terminal are stored in the embedded information storage means, and not only the 3D map information is transmitted in response to a request from the mobile communication terminal. By including embedded information related to 3D map information and providing it to the user, the information received by other users can be shared by the user receiving the offer. It is possible to construct a so-called peer-to-peer usage mode in which information is directly exchanged between an unspecified number of individuals.

[0019] (6) The map information providing apparatus or the map information providing system according to the present invention embeds the management information in a format concealed in the image transmitted by the map information providing apparatus to the mobile communication terminal as necessary. Means and a means for recording an image in which management information is embedded.

As described above, according to the present invention, management information is embedded in an image transmitted to the mobile communication terminal in a concealed format, so that an illegally used image can be determined, and an image in which management information is embedded is determined. Since it is recorded, it can be used as evidence that the information has already been provided. [0020] (7) The map information providing system according to the present invention subtracts the billing information of the owner of the mobile communication terminal when necessary when the captured image to be recorded in the captured image storage means is received from the mobile communication terminal. It includes a new means to do.

As described above, in the present invention, when the captured image storage means is constructed using the captured image from the mobile communication terminal! /, The map information providing device is provided to the user who provides the captured image. By subtracting the billing information related to the use of the mobile phone, it is possible to take incentives for the user to take an image using the mobile communication terminal.

These outlines of the invention do not enumerate the features essential to the present invention, and a sub-combination of these features can also be an invention.

BEST MODE FOR CARRYING OUT THE INVENTION

Here, the present invention can be implemented in many different forms. Therefore, it should not be interpreted only by the description of the following embodiment.

In the embodiment, the system will be mainly described. However, as will be apparent to those skilled in the art, the present invention can also be implemented as a program and method usable in a computer. In addition, the present invention can be implemented in hardware, software, or an embodiment of software and hardware. The program can be recorded on any computer-readable medium such as a hard disk, CD-ROM, DVD-ROM, optical storage device or magnetic storage device. In addition, the program can be recorded on another computer via a network.

[0022] (First embodiment of the present invention)

[1. System configuration]

FIG. 1 is a system configuration diagram of a map information system according to the present embodiment.

The map information system according to this embodiment receives GPS satellites and radio waves from a reference station and identifies the current position. The mobile phone 10 with a GPS function and a camera function, the mobile phone 10 and a base station, a mobile communication network, and an IP network And a server 20 that transmits the recorded three-dimensional map information to the mobile phone 10. In addition, a management computer 30 that operates and manages the map information system is also arranged.

[0023] [2. Hardware Configuration]

FIG. 2 is a hardware configuration diagram of components of the map information system according to the present embodiment. The The server 20 is built on a computer. The hardware configuration includes a CPU (Centra 1 Processing Unit) 21, a DRAM (Dynamic Random Access Memory) 22 and other main memory, an external storage device HD (hard disk) 23, and a display. It consists of a display 24 which is a device, a keyboard 25 and a mouse 26 which are input devices, a LAN card 27 which is an expansion card for connecting to a network, a CD-ROM drive 28 and the like.

[0024] For example, the server program stored on the CD-ROM is copied (installed) on the HD23, and the server program is read out to the main memory 22 as necessary to execute such a program. Configure the server (device) with

Further, the management computer 30 has a server 20 constructed, which is almost the same as the hardware configuration of the computer. Strictly speaking, the computer on which the server 20 is constructed uses hardware with high performance and high reliability.

[0025] The hardware configuration of the mobile phone 10 is also largely the same as that of a computer, and there is no keyboard and mouse as input devices. Instead, a plurality of push buttons are provided on the surface of the main body, enabling mobile communication. An example is a configuration in which a device, a device that can realize the camera function, and a device that receives GPS radio waves and identifies the current position are implemented.

The nodeware configuration described here is an example, and so-called persons skilled in the art can make changes.

Of course you can. In addition, GPS also has multiple methods such as single positioning, relative positioning, DGPS positioning, and RTK — GPS positioning.

[0026] [3. Detailed system configuration]

FIG. 3 is a system configuration block diagram of the map information system according to the present embodiment.

The server 20 has the following components.

• Input means to import positioning information, captured images, etc. from mobile phone 10

• Based on the acquired positioning information, the corresponding 3D map information storage means 231 is read out, the corresponding 3D map information is read out from the satellite image storage means 232 based on the positioning information, and the captured image storage means is read out based on the positioning information. Provides map information that reads the captured image from 233 and texture-maps the satellite image and the captured image to the 3D map information Mean 212

• Captured image update means 213 for recording the captured image captured in the captured image storage means 233 based on the positioning information.

• A captured image requesting unit 214 that performs an imaging request to the user when the captured image storage unit 233 needs to be updated based on the positioning information

'Point updating means for updating billing information based on information provided to the user by the map information providing means 215

• Output means for sending 3D map information, imaging requests, frame information, etc. to mobile phone 10 2 16

[0027] [4. Operation]

Next, the operation of the map information providing system according to this embodiment will be described. The operation according to the present embodiment includes a 3D map display operation for displaying 3D map information on which a real image is mapped on the user's mobile phone 10, and a captured image captured by the user's mobile phone 10 as 3D map information. Requests to update the captured image to be stored so that it can be mapped, and to request the captured image to be mapped to 3D map information, and to store the captured image that was captured in response to the request in a 3D map information so that it can be mapped It consists of actions.

[0028] [4. 1 3D Map Display Operation]

FIG. 4 is a flowchart of the 3D map display operation according to this embodiment. First, the user selects a map information providing service using the push button of the mobile phone 10. Then, the cellular phone 10 receives radio waves from the GPS satellite and the reference station and obtains positioning information (step 101). The obtained positioning information is sent to the server 20 through a communication path established between the mobile phone 10 and the server 20.

The server 20 (map information providing means 212) reads 3D map information necessary for display from the 3D map information storage means 231 based on the positioning information (step 111).

The server 20 (map information providing means 212) reads out satellite images and captured images necessary for mapping from the satellite image storage means 232 and captured image storage means 233 based on the positioning information (step 112). Needless to say, it is possible to read the image based on the read 3D map information. The server 20 (map information providing means 212) maps the read satellite image and captured image to the three-dimensional map information. Here, mapping can be performed using various mapping techniques such as texture mapping. As a rule, the satellite image is pasted on the top surface of the 3D map model, and the captured image is pasted on the side surface of the 3D map model. Since satellite images can also be obtained from the perspective, they can be attached to the side. The mapping here can of course be automated, but can be pasted by the worker instead.

The server 20 sends the 3D map information to which the satellite image and the captured image are mapped to the mobile phone 10.

The mobile phone 10 takes in the 3D map information and displays the 3D model on the display. Users can see the surrounding 3D map information. Here, the transmitted 3D map information may be information of a limited range of the current position of the user, or the former, which may be 3D map information of a certain rectangular area. For example, it is necessary to capture the previously described 3D map information according to the movement of the user. In the latter case, even if the user moves to a certain extent, the new 3D map information is captured if it is within the rectangular area. Is not necessary.

[0031] The mobile phone 10 determines whether or not a predetermined time has passed since the previous step 101 (step 131). If it is determined that it has elapsed, the process returns to step 101, and if it is determined that it has not elapsed, Return to step 131. Here, a configuration may be adopted in which the processing returns to step 101 in accordance with the update of the force positioning information in which the 3D map information to be taken in every predetermined time is updated. At this time, it is possible to simply update the positioning information, or to return to step 101 when the movement distance from the previous step 101 exceeds a predetermined threshold.

[0032] Although the map information providing service is implemented in this way, when the user presses the push button on the mobile phone 10 and selects the end of the map information providing service, a service end signal is received. The server 20 (charging update means 215) adds the charging information (step 1 41). The billing information may be added based on the amount of the map information providing service provided. The billing information added by the server 20 (billing update means 215) is acquired (step 142). The acquired billing information is sent to the mobile phone 10. The mobile phone 10 displays the billing information on the display (step 151). Users can view billing information.

Information that identifies the user of the mobile phone 10 (for example, a mobile phone number or a member ID given when registering to receive services) is used between the mobile phone 10 and the server 20 as necessary. There is a need. It is necessary at least for the billing update. The same applies hereinafter.

[0033] [4.2 Captured Image Update Operation]

FIG. 5 is a flowchart of the captured image update operation according to the present embodiment.

First, during the map information providing service (not necessarily during the service), the user uses the push button of the mobile phone 10 to select an imaging instruction. The cellular phone 10 performs imaging according to the imaging instruction (step 201).

The mobile phone 10 obtains positioning information at the time of imaging (step 202).

The user uses the push button of the mobile phone 10 to select upload of the captured image. The captured image and positioning information are sent to the server 20.

The server 20 (captured image update means 213) associates the positioning information with the captured image and stores them in the captured image storage means 233 (step 211). If a captured image with the same positioning information already exists, the captured image is updated with the stored image. However, previous captured images can be retained, and 3D map information with high-quality captured images mapped can be provided through operator confirmation. Automates noise determination processing to detect whether noise is mixed instead of operator confirmation, scale determination processing to determine the scale of the captured image by edge processing of the building etc. from the image, and extraction processing to cut out the necessary image from the scale It can also be configured to

[0035] When the user presses the push button of the mobile phone 10 and selects the end of the map information providing service, the server receives a service end signal, and in addition to adding the charge for the map information providing service, 20 (charging update means 215) subtracts the charging information (step 221). Billing information can be subtracted based on the number of uploaded captured images! /.

[0036] The billing information updated by the server 20 (billing update means 215) is acquired (step 222). The acquired billing information is sent to the mobile phone 10. The mobile phone 10 displays the billing information on the display (step 231). Users can view billing information.

According to this captured image update operation, the update of the captured image can be promoted in a self-propagating manner, and the work for preparing the captured image can be greatly reduced.

[0037] [4. 3 Captured Image Request Operation]

FIG. 6 is a flowchart of the captured image request operation according to the present embodiment.

When at least one user provides a 3D map information service, a captured image request operation can be performed. Here, when no one is using, the captured image requesting operation can be performed with the approval of the user registered by e-mail or the like and the user who has used it. Specifically, in the case of the target user of the captured image requesting operation, a message indicating that this URL is accessed! / Is transmitted.

[0038] The server 20 (captured image requesting unit 214) determines whether or not an image around the current position is stored in the captured image storage unit 233 using the positioning information of the user who is in service (step 301). If so, return to step 301. If it is not stored, the server 20 (captured image request means 214) generates a 3D model that clearly shows the necessary building frame from the 3D map information around the current position (the wireframe frame itself). It may also be one that has been subjected to hidden line treatment, or one that has been lent out on a white outer surface, and a combination, gasoline stand, etc. (Stores and intersections may be clearly specified.) Specify the direction in which imaging is required. The server 20 sends the generated 3D model and positioning information of the imaging position to the mobile phone 10 as an imaging request.

[0039] The mobile phone 10 displays the three-dimensional model on the display (step 331), and the user instructs imaging in the designated direction in accordance with the frame. The mobile phone 10 performs imaging (step 341).

The mobile phone 10 obtains positioning information at the time of imaging (step 351).

The server 20 (captured image update means 213), as in step 211, determines the positioning information and imaging. The image is associated with the image and updated (step 361).

Steps 221 to 231 are also performed in this captured image request operation.

[0040] Since this captured image request operation is frequently performed during the 3D map information providing service, is it OK to perform the captured image request operation for the user in the 3D map information providing service? It is preferable to adopt a configuration for selecting whether or not in advance.

According to this captured image request operation, captured images necessary for the map information providing service can be efficiently collected.

If you want to collect images centered on a specific area in an urban area, you can also set it up so that it will be collected for a strong area.

[0041] In addition, here, the trigger for the captured image request operation is determined only by determining whether the captured image is present or not in step 301, but also when a predetermined period of time has passed since the captured date and time of the captured image. It can also be the target of a captured image request operation and can always hold the latest image.

In addition, although the imaging time is not specifically specified here, the captured image differs depending on the imaging time. Therefore, an imaging request is made at each imaging time so that the captured image storage unit 233 can be constructed at each imaging time. It is also preferable to carry out.

[0042] While the captured image requesting operation server 20 side generated a 3D model that explicitly specified the frame, the captured image update operation was performed on the mobile phone 10 side, and the 3D model specified the frame using 3D map information. Can also be configured to generate. Although it is not mentioned regarding the processing here, which functions are implemented on the client side and what functions are implemented on the server side in a client-server system or the like is almost within the scope of so-called design changes by those skilled in the art. Can be changed.

[0043] (Second embodiment of the present invention)

[1. Detailed system configuration]

FIG. 7 is a system configuration block diagram of the map information system according to the present embodiment. The map information system according to the present embodiment is configured in the same manner as the map information system according to the first embodiment, and further includes route search means 217 for performing a route search from the current position and the destination. It is a different configuration. This route search means 217 is a mobile phone 10 It also realizes a function to identify the direction of cellular phone imaging at the time of imaging from the captured images and to guide it to the obtained route direction.

[0044] [2. Operation]

[2.1 Navigation operation]

FIG. 8 is a flowchart of the navigation operation according to this embodiment.

The user presses the push button on the mobile phone 10 and selects navigation. The mobile phone prompts the user to specify the destination with the same GUI as in-vehicle navigation. The user sets the destination.

The cellular phone 10 obtains positioning information (step 401). The mobile phone 10 sends the destination and positioning information to the server 20.

The server 20 (route search means 217) searches for a route from the destination and positioning information (step 411). The so-called skilled artisan can apply a route searching method that is already known in the art, and will not be described in detail here. The server 20 (route searching means 217 and map information providing means 212) reads 3D map information from the 3D map information storage means 231 based on the route (step 421).

The server 20 (route search means 217 and map information provision means 212) reads the satellite image and the captured image from the satellite image storage means 232 and the captured image storage means 233 based on the route (step 422).

The server 20 (route search means 217 and map information provision means 212) pastes the satellite image and the captured image on the 3D map information, and reveals the route (step 423). In general, the route is clearly indicated by a curve from the current position to the destination. The server 20 sends the 3D map information to the mobile phone 10.

The mobile phone 10 displays the 3D map information on the display (step 431). The user can see a 3D map around the current location, or can see a 3D map other than the current location on the route.

Here, the 3D map information on the route from the current position is collectively sent from the server 20 and displayed on the mobile phone 10, but based on the update of the positioning information accompanying the movement of the user or the predetermined time, 3D map information can be sent out at any time. The billing update can be performed in the same manner as in steps 141 to 151.

[0047] [2. Two-way check operation]

FIG. 9 is a flowchart of the direction confirmation operation according to the present embodiment.

The user instructs the mobile phone 10 to take an image during the navigation operation. The mobile phone 10 performs imaging (step 501).

On the phone, Bay 10 asks for positioning information (step 511).

The user presses the push button on the mobile phone 10 and selects the direction confirmation function. The mobile phone 10 sends a captured image and positioning information to the server 20.

The server 20 obtains an edge of a building or the like by performing image processing on the captured image force (step 521).

) o

[0048] The server 20 reads the 3D map information from the 3D map information storage means 231 from the positioning information, finds the edge and compares the frame with the frame of the 3D map information, and specifies the matching direction (step 531). .

The server 20 refers to the route of the 3D map information for navigation sent to the user, identifies the correct direction on the route, and obtains direction change information from the direction identified in Step 531 (Step 532). . The direction change information includes information that prompts the direction change with an arrow from a message for direction change such as “Change the direction clockwise from the current direction”. The server 20 sends the direction change information to the mobile phone 10.

[0049] The mobile phone 10 displays the direction change information superimposed on the currently displayed three-dimensional information for navigation (step 541).

The billing update can be performed in the same manner as in steps 141 to 151. According to this direction confirmation operation, compared to the case where the user proceeds to the destination while checking the navigation display and the image in the current direction with his / her eyes, the image which is actually facing the navigation and the user's eyes. There is no need to compare. In particular, if the captured image is mapped, if any direction cannot be identified from the same building landscape, it points to the appropriate direction in that case, which is highly convenient.

[0050] (Third embodiment of the present invention)

[1. Detailed system configuration] FIG. 10 is a system configuration block diagram of the map information system according to this embodiment. The map information system according to the present embodiment is configured in the same manner as the map information system according to the first embodiment, receives an image request from a certain user, and provides an image to a user in an area that satisfies the image request. The image requesting means 218 for sending the request and the steganography means 219 for embedding management identification information in the image are newly provided. The steganography technique used in the steganography means is a well-known technique, and a person skilled in the art can embed the embedded information in the target image using various steganography techniques. Instead of the steganography technique, an electronic permeability technique can be used.

[0051] [2. Operation]

FIG. 11 is a flowchart of the user image request operation of the map information system according to this embodiment.

The user presses the push button on the mobile phone 10 and selects an imaging request. The user selects the requested location, direction, time, etc. displayed on the mobile phone 10 display. For example, when an imaging request is selected, a menu for selecting a region is displayed, the selected region is displayed as a map, and the requested point is first selected on the map. When the request point is determined (information is sent out from the server 20 if necessary), the request direction (the direction can be specified) is selected using the 3D map information. Further, the requested imaging time is selected. The cellular phone 10 sends the requested point, requested direction, and requested imaging time to the server 20 as requested information.

[0052] The server 20 (image request means 218) refers to user information that also has an ID and positioning information power (step 601), and determines whether or not the force is around the request point based on the request point (step 61 1). When other user power is available around the request point, send an imaging request to other users.

Step 621).

An imaging request is displayed on the display of the mobile phone 10 of the other user, and the user instructs imaging according to the imaging request. The mobile phone 10 performs imaging. The mobile phone 10 sends the captured image to the server 20.

Server 20 (steganography means 219) provides management information for the captured images. Embed using steganography (step 651). The server 20 sends the processed captured image to the mobile phone 10 of the user who made the request.

The user displays the captured image on the display of the mobile phone 10 (step 661).

If nobody is present at the request point in step 601, error information is sent to the mobile phone 10 of the requesting user. The mobile phone 10 displays powerful error information (step 67 Do: Here, the user can configure the server 20 to hold the request.

In addition, the charging update is performed in the same manner as in steps 141 to 151, and charging is added to the user who has made the imaging request, while imaging is performed in accordance with the imaging request in the same manner as in steps 221 to 231. Thus, a so-called point movement can be realized by subtracting the charge from the user.

[0055] As a result of the steganography, even when the user who has received the captured image refuses payment, a management number can be given to indicate that. When sending the processed captured image to the user who made the imaging request, it is desirable to store the processed captured image in the server 20 as well.

[0056] (Other Embodiments)

[Direction indication display] In each of the above-described embodiments, when the mobile phone 10 displays the three-dimensional map information on the display, for example, when the direction key is pressed, the mobile phone 10 is allocated only by the pressed amount. It can be configured to rotate and display in the direction! Specifically, when the front is displayed, pressing the left directional key for a predetermined time will cause the landscape to change counterclockwise during the time it is pressed!

[3D Album] In the map information system according to the second embodiment, during navigation, an image and a moving image captured by a user's mobile phone are sent to the server 20 as needed together with positioning information, and the navigation is performed. It is possible to embed images and moving images in the 3D map information that has been created based on the positioning information and send it to the mobile phone 10 as a 3D album.

[Embedded information for 3D map information] In the map information system according to the first embodiment, a user uploads a captured image by a captured image update operation, and the uploaded captured image is converted into a 3D model. Use as an image to paste, but take an overview For example, when a restaurant is specified, it can be configured to send out a captured image of the restaurant, a captured image of the food provided, and a description of the restaurant along with positioning information. When requesting display of 3D, it is possible to display 3D map information including embedded information. Furthermore, if a site that displays only embedded information for each genre in a menu format is created, and the user who accesses the empowered site selects “3D map information”, various types of 3D map information of this system will be displayed. It can also be configured to provide a service.

[0059] Although the present invention has been described by the above embodiments, the technical scope of the present invention is not limited to the scope described in the embodiments, and various modifications or improvements can be added to these embodiments. Is possible. Embodiments to which powerful changes or improvements are made are also included in the technical scope of the present invention.

The This is apparent from the claims and the means for solving the problems. Brief Description of Drawings

FIG. 1 is a system configuration diagram of a map information system according to a first embodiment of the present invention.

FIG. 2 is a hardware configuration diagram of components of the map information system according to the first embodiment of the present invention.

FIG. 3 is a system configuration block diagram of the map information system according to the first embodiment of the present invention.

FIG. 4 is a flowchart of a 3D map display operation of the map information system according to the first embodiment of the present invention.

FIG. 5 is a flowchart of a captured image update operation of the map information system according to the first embodiment of the present invention.

FIG. 6 is a flowchart of a captured image request operation of the map information system according to the first embodiment of the present invention.

FIG. 7 is a system configuration block diagram of a map information system according to a second embodiment of the present invention.

FIG. 8 is a flowchart of the navigation operation of the map information system according to the second embodiment of the present invention. FIG. 9 is a flowchart of the direction confirmation operation of the map information system according to the second embodiment of the present invention.

FIG. 10 is a system configuration block diagram of a map information system according to a third embodiment of the present invention.

FIG. 11 is a flowchart of a user image request operation of the map information system according to the third embodiment of the present invention. Explanation of symbols

10 Mobile phone

20 Sano

21 CPU

22 DRAM

23 HD

24 display

25 keyboard

26 mouse

27 LAN card

28 CD—ROM drive

30 Management computer

211 Input means

212 Map information provision means

213 Captured image update means

214 Captured image request means

215 points update means

216 Output means

217 Route search means

218 Image request means

219 Steganographic means

231 3D map information storage means 232 Satellite image storage means 233 Captured image storage means 234 Point information storage means 235 User information storage means 236 User captured image storage means

Claims

The scope of the claims

[1] A map information providing device that transmits 3D map information in response to a request from a mobile communication terminal equipped with a GPS receiver,

Means for reading out the corresponding 3D map information from the 3D map information storage means based on the positioning information received from the mobile communication terminal;

Means for reading out the corresponding satellite image from the satellite image storage means based on the positioning information or the read out three-dimensional map information;

Means for reading out the corresponding captured image from the captured image storage means based on the positioning information or the read out three-dimensional map information;

A map information providing apparatus including means for pasting a satellite image and a captured image on 3D map information.

[2] A map information providing system comprising a mobile communication terminal including an imaging device and a GPS receiver, and a map information providing apparatus that transmits 3D map information in response to a request from the mobile communication terminal,

Map information providing device

Means for pasting the captured image on the 3D map information;

Means for recording the captured image from the mobile communication terminal in the captured image storage means based on the positioning information,

The mobile communication device

A map information providing system including means for displaying an outline of an object in 3D map information in an imaging mode based on 3D map information.

[3] The map information providing device is stored in the captured image storage means! Newly includes means for requesting imaging based on positioning information transmitted to the mobile communication terminal when a new captured image is required based on the state of the captured image. The map information providing system according to claim 2.

[4] A map information providing device that transmits 3D map information in response to a request from a mobile communication terminal including an imaging device and a GPS receiver,

Means for pasting the captured image on the 3D map information;

Means for conducting a route search from the current position and the destination when the destination is set from the mobile communication terminal;

A map information providing apparatus including means for specifying an imaging direction of a mobile communication terminal at the time of imaging from positioning information from a mobile communication terminal and a captured image, and creating information that guides in a route direction using the imaging direction and the route direction.

[5] A map information providing device that transmits 3D map information in response to a request from a mobile communication terminal including an imaging device and a GPS receiver,

Means for pasting the captured image on the 3D map information;

A map information providing device, wherein the positioning information and the embedded information from the mobile communication terminal are embedded and stored in the embedded information storage means;

Embedding in the area of 3D map information to be transmitted to the mobile communication terminal in response to a request from the mobile communication terminal

Information providing device including means for including only information in 3D map information.

[6] The map information providing device

Means for embedding management information in a concealed format in an image to be transmitted to a mobile communication terminal; And a means for recording an image in which management information is embedded.

6. The map information providing apparatus or map information providing system according to any one of claims 1 to 5.

Newly includes means for subtracting charging information of the owner of the mobile communication terminal when the captured image to be recorded in the captured image storage means is received from the mobile communication terminal

The map information providing system according to claim 2 or 3.