GB2425858A

GB2425858A - Map correction

Info

Publication number: GB2425858A
Application number: GB0509119A
Authority: GB
Inventors: Marko Vaenskae
Original assignee: Nokia Oyj
Current assignee: Nokia Oyj
Priority date: 2005-05-04
Filing date: 2005-05-04
Publication date: 2006-11-08
Also published as: GB0509119D0

Abstract

A mobile telecommunications handset 1 with a digital camera is operable as a handheld GPS device and uses GPS circuitry to provide a display of map data together with the location of the user of the handset on the handset's display. Map data is derived from a map data service provider 4. When the user determines that there is an error in the map data displayed on the display, the user operates the camera to capture image data for an image of the actual mapped terrain corresponding to the identified error in the map data. Location data is obtained from the GPS circuitry, corresponding to the location where the image data is captured. The transmitter of the handset 1 is then used to send a message that includes the image data and the location data over a link to the remote map service provider 4 to allow the map data to be corrected.

Description

Map Correction

Description

This invention relates to a method and apparatus for giving feedback and assisting in correcting map data and has particular but not exclusive application to mobile telecommunications apparatus.

It is known to provide an electronic map display for use with position locating devices such as global positioning systems (GPS). Map data corresponding to a map of terrain is displayed on an electronic display and a cursor corresponding to the location of the user is displayed on the map. The map data may comprise data concerning the natural features of a geographical area and/or man made structures and features of the area such as streets, routes, buildings, business locations, points of interest and other useful data relating to the location of features in the area, and the term "terrain" is used herein in a broad sense to cover any or all such features of a mapped geographical area. The display of the map data need not necessarily be to linear scale. GPS systems are used widely in vehicles for navigation purposes and more recently have been proposed for use in other user terminals such as telecommunication handsets and personal digital systems (PDAs).

A problem with such devices is that the map data becomes out of date, for example when road systems are rearranged or buildings are demolished and reconstructed. Thus, the map data need to be kept up to date, which is time consuming and expensive.

The map data may be provided for use on a CD ROM or memory chip for vehicle based systems. For handheld mobile devices, the map data may also be provided over the air through a telecommunications network by a map data service provider in response to a request from the user of the mobile user terminal.

The present invention provides an improved way of correcting map data or assisting in correcting map data in which map correction data is provided by a user of a user terminal to a map data service provider.

According to the invention there is provided apparatus for enabling map data to be corrected in response to a user at a location in a mapped terrain identifying an error between the actual mapped terrain and displayed map data corresponding to the actual mapped terrain, comprising an image capture device to capture image data for an image of the actual mapped terrain corresponding to the identified error in the map data, means to obtain location data corresponding to the location where the image data is captured, and a transmitter to send a message that includes the image data and the location data over a link to a remote map service provider for correcting the map data.

The apparatus may comprise a mobile telecommunications device and the image capture device can comprise a digital camera.

The apparatus may include a processor operable to run a map application to provide the map data to a display. The processor may be operable to receive location data corresponding to the location of the user and provide the display with map data corresponding to the location of the user. The location data may be provided by a GPS device which may be mounted in the apparatus or may be coupled to it through a local link such as Bluetooth.

Further information may be included within the message sent to the map service provider. For example, the apparatus may include compass device to provide the orientation data corresponding to the pointing direction of the image capture device.

More than one image may be captured for the terrain corresponding to the error in the map data. The images may be arranged to overlap in the data correction process performed later by the map service provider.

A user input device may be provided to allow the user to include data corresponding to the captured image in the message. The data may be keyed in using a keypad or predetermined text character strings may be stored for inclusion in the message, which can be selected by the use of an individual key on the keypad. The included data may also comprise voice messaging for example in the form of one or more voice prompts that the user may activate for use and/or use as replacements or as additional data. In another embodiment also the included data e.g. voice prompts or messages may be provided separately. Still in another embodiment the downloading of the included data comprising voice messages or voice prompts may be dependent on the location of the user. Such downloading possibility may be shown to the user on the map.

The invention also includes a map service provider for providing map data to user terminals at remote locations in mapped terrain, comprising a data store for storing map data corresponding to map data used by user terminals in the mapped terrain, a receiver to receive a correction message over a link from one of the user terminals in the mapped terrain for correcting the map data in the data store, the message including image data for an image of actual terrain corresponding to an identified error in the map data, and the message including location data corresponding to the location where the image data is captured, such as to permit correction of the stored map data.

The invention further includes a method of correcting map data in response to a user at a location in a mapped terrain for which an error has been identified between the terrain and displayed map data corresponding to the terrain, the method comprising: using an image capture device to capture image data for an image of the actual mapped terrain corresponding to the identified error in the map data, obtaining location data corresponding to the location where the image data is captured, and sending a message that includes the image data and the location data over a link to be received by a remote map service provider for correcting the map data.

Further, the invention includes a method of providing map data for use by user terminals at remote locations in a mapped terrain, comprising storing map data corresponding to map data used by user terminals in the mapped terrain, receiving a correction message over a link from one of the user terminals in the mapped terrain for correcting the map data in the data store, the message including image data for an image of actual terrain corresponding to an identified error in the map data, and the message including location data corresponding to the location where the image data is captured, such as to permit correction of the stored map data.

A reward may be provided to the user that sends the correction message. In the event that the service provider receives more than one correction message relevant to the identified error in the map data, from more than one terminal, different levels of reward may be provided to the users of the user terminals, with a higher reward being given to the first user terminal to submit the first of the correction messages.

Features and advantages of the present invention will become apparent from the following description of an embodiment thereof given by way of illustrative example with reference to the accompanying drawings, in which: Figure 1 is a schematic perspective view of a mobile telephone handset; Figure 2 is a schematic of hardware components of the handset of Figure 1; and Figure 3 is a schematic illustration of the handset of Figure 1 in use with a map service provider over an air interface.

Figure 1 is a schematic perspective view of a user terminal I in the form of a mobile telecommunications handset which can communicate over a radio link 2 with a mobile telecommunications network 3 coupled to a server 4 that acts as a map data service provider. The network 3 may comprise a GSM, 2.5G, 3G or other suitable networks.

The handset I comprises an outer case 5 that has a front part 5a and rear part 5b, a microphone 6, an earpiece 7, an antenna 8 for communicating over the radio link 2, a subscriber identity module (SIM) card 9 and an associated SIM card reader or interface 10. The handset 1 also includes a user interface 11 comprising a keypad 12 and/or one or more keys and a display e.g. in the form of an LCD display panel 13. The circuitry of the mobile handset includes radio interface circuitry 14, codec circuitry 15 and a memory 16. These circuits operate under the control of a micro controller 17 to provide voice and data communications over the cellular telecommunications radio link 2 through io antenna 8 to the mobile network 3 as well known in the art. The circuitry of Figure 2 is powered by a rechargeable battery 18.

Additionally, the handset I includes Bluetooth TM RF circuitry 19 with an associated antenna 20 to provide a local wireless link to other devices as known in the art.

Also, a location device 21 in the form of a GPS device is included within the handset 1, with an associated antenna arrangement 22. As known in the art, the GPS device can develop coordinate data corresponding to the location of the handset I by comparing signals received from different geostationary satellites.

The GPS device 21 provides this location data to the controller 17.

The handset 1 also includes an image capture device in the form of a digital camera 23 that may be mounted for example on the rear 5b of the casing as illustrated in dotted outline in Figure 1. The camera 23 has a lens 24 with an optical axis 25 defining a pointing direction for the camera, illustrated in dotted outline.

Optionally an electronic compass 26 provides orientation data to controller 17 corresponding to the pointing direction 25 of the camera 23. When an image is captured using the camera 23, image data corresponding to the captured image can be stored in memory 16 together with orientation data from the compass 26 and also location data from the GPS device 21 corresponding to the location of the handset I when the image data was captured. Also, a time and date stamp may be included in the stored data. The time and date stamp may relate to the time of capturing the image. As well known in the art, images captured by a phone-mounted camera can be transmitted as multimedia messages (MMS) over the radio link 2 to the network 3. Such messages may include time and date stamp of the transmission time of the message. A MMS center 27 is coupled to the network 3 for handling MMS messages. As known in the art, the MMS center 27 may comprise a server connected to the network 3.

Also provided is a media charger 28 which can push data to the handset 1. The media charger 28 provides a subscription-based subscription based service for downloading large files to the user terminals such as handset 1, which utilizes network resources efficiently and gives the consumers a pleasant user experience.

In short, each end-user such as the user of handset 1, is able to subscribe to such content channels, in which they are interested. The corresponding content files are delivered to the client application in consumers' mobile devices automatically during the off-peak hours of the network. The consumer can then consume the content wherever and whenever he wants to. The system is not tied to any specific access technology or content type. The billing is based on channel subscriptions.

One embodiment of media charger is based on the client-server architecture. In this example the server comprises media charger 28. The client application resides in the consumer's handset 1, while the server is located in a services network. The server provides interfaces to many mobile consumers to allow them to interact with the server 28.

Mobile consumers such as the user of handseti, access the media charger server 28 with their client application through an access network, which provides such handsets with IP packet access. The system is not tied to any specific access technology and therefore, for example, GPRS, EDGE, and WCDMA can be used. The services offered to the clients include delivery of channel list, giving instructions to download new content files and to manage client's local content storage, and downloading of content files. The consumers are also capable of subscribing to (and un- subscribing from) channels. While most communication between clients and the server is performed over packet connection, subscription may be based on Short Message Service (SMS). A user consumes the content files downloaded using the rendering applications available in the handset 1.

An administrator of the media charger may access the server via a webbased administrator interface. This interface includes tools to manage channels and their contents, and to access usage statistics. The server maintains the service related information in a centralized database. The server includes also a content system, in which the channel content is maintained. The media charger enables reliable transfer of large files to a mobile terminal during off-peak periods.

The reliability of media charger is due to its capability of keeping track on the progress of downloading. If by some chance the download is interrupted, the download can later be continued from the point of interruption without need to download those parts that already have been correctly received.

Referring to Figure 3, the handset I is illustrated schematically with its controller 17 running a map application 29 in which map data provided by a map service provider 4 is displayed on the display 13 of the handset 1. The controller receives information from the GPS device 21 concerning the location of the handset 1 and this is used to select an appropriate region of the map corresponding to the terrain in which the handset 1 is located. Additionally, a cursor is displayed on the map at a location corresponding to the location of the handset as detected by the GPS device 21. The map data used to provide the display may be stored in memory 16. The map data may be provided to the handset I in a pre- programmed semiconductor memory device or may be downloaded through radio link 2 upon request from the map data service provider 4 via the media charger 28. Thus, the handset 1 can be used as a handheld, mobile GPS device.

Considering the map data service provider 4 in more detail, it includes the server 30 with a receiver 31 to receive MMS messages from the MMS center 27, and also a transmitter 32 to send data to the media charger 28 for onward transmission to the handset 1 through the radio link 2. The service provider 4 includes a store 33 containing map data corresponding to mapped terrain. This map data tends to become out of date with time as changes to road systems and buildings take place. Also, other changes may occur. For example, landmarks such as restaurants or cinemas which are indicated as points of interest (POT) may change name or may be used for other purposes and so landmark data contained within the map data in store 33 can also become out of date.

In accordance with the invention, when the user of handset I finds that there is a discrepancy between the map data displayed on the display 13 and the actual terrain or view, an error report is transmitted through the radio link 2 to the map data service provider 4 to enable the map data held in store 33 to be updated.

After identifying the error between the actual map terrain and the displayed map data, as rendered by the map application process 29, the user of handset 1 may capture an image of the actual terrain corresponding to the identified error. The image capture is performed with camera 23. In this example, the pointing direction 25 of camera 23 is directed towards an identifiable landmark 34. The resulting data corresponding to the captured image is stored in memory 16. In one embodiment of the invention the map may comprise additional data such as images of landmarks or other POTs. Such images or data can be compared to the view that the user sees and if a discrepancy is detected, the user may be prompted to capture an image.

As shown in Figure 3, the controller 17 runs a correction message application 35.

This creates a MMS message to be transmitted to the map data service provider via the MMS center 27 over the radio link 2. The correction message application includes the MMS message data corresponding to the captured image of landmark 34 together with location information derived from GPS device 21 corresponding to the location of the handset 1 when the image capture was performed by camera 23. Additionally, orientation information corresponding to pointing direction 25 of camera lens 24 may be included from the compass 26 together with a time and date stamp data.

The message application 35 also has a facility to allow the use of handset 1 to provide text data relating to the message. For example, if the landmark 34 comprises a restaurant which has changed its name, the user may key the new name of the restaurant. Also, predefined key functions may be assigned to some of the keys of keypad 12 to allow pre- defined user messages to be included within the correction message created by message application 35. For example, in the event that the user is travelling in a car and encounters a traffic jam created by road works, the image capture device may be used to capture an image of the road works and the traffic jam, and a predetermined key function may include a text string within the message such as "traffic jam" or "road works and traffic jam". The user messages may also given as voice messages that are either prerecorded or spoken by the user at the time of creating the message.

The message created by message application 35 is then sent as a correction message to the map data service provider 4 as previously described and may be used by the map data service provider to update the map data in store 33.

Thereafter, either periodically or in response to the specific change of the map data, the transmitter 32 transmits updated map data into the media charger 28 for onward transmission through the radio link 2 to the handset 1 where it is stored in memory 16 (Figure 2) so that updated map data can be used when running the map application 29.

In one embodiment of the invention the user may set up a connection to the server 30 for checking if the server already has received MMS messages from the location. The response message from the server 30 to the handset I may comprise information on the number of received messages and information on the time they have been received, wherein the user may abstain from transmitting the image and thereby saving the cost for the transmitting of the MMS message.

For example, if the service provider 4 has received a predetermined number of messages within a predetermined period e.g. one month, there is no need to incur the effort of sending yet another message. The server 30 may inform the user of handset I that a map update to deal with correcting the error is in preparation. Also, the user may receive one or more images from the indicated location or its vicinity that have been received by the server 30 so that the user of handset I may assess if the map service provider 4 already has been informed of the map error.

Many modifications and variations of the described system fall within the scope of the invention. For example, the image capture device 23 may be arranged to capture more than one image of the terrain corresponding to the identified error in the map data to enable the terrain to be seen from more than one angle. The multiple captured images may have overlapping fields of view. The data corresponding to both captured images is included in the correction message by the correction message application 35. The image capture device may also be arranged to capture video instead of or in addition to capturing one or more images.

Incentives may be provided to encourage the users of handsets such as handset 1 to report errors in the map data to the map data content service provider 4. For example, the service provider 4 may provide a reward or prize in response to valid correction data from the user of handset 1. The prize or reward may comprise free update of the map data or of the map application 29 that runs the map data.

It will be understood that the orientation information provided by compass 26 can be provided in other ways, for example when tracking movement of the handset 1 in relation to the map provided by the map display data, by calculating the direction of movement of the handset 1.

Furthermore, the GPS device 21 need not be necessarily installed in the handset 1 but may for example be a GPS device in a motor vehicle which provides location data to the handset I through a local link, for example through the Bluetooth circuitry 19, 20 shown in Figure 2. However, a wired, local link could also be used. Similarly, the orientation information need not necessarily be derived from compass 26 but could be derived from a vehicle mounted GPS system through a local link.

For navigation purposes in the cities, it is useful to have up to date information on the allowed driving directions along streets. The driving direction for a street can be changed from two-way to one-way and the change may force the driver to proceed along a new route. When street maps carry out of date information, this can cause problems or even accidents for a driver. As such a situation may only be temporary, e.g. to road construction or an accident, the map data service provider 4 may use the time stamp data included in the MMS messages for assessing the need to making correction to the map data. If correction messages concerning such changes or obstacles keep being sent after a predetermined time period, the change in road direction or other reported obstacle may be deemed to be a permanent change such that the map or other data in the map needs to be corrected.

In addition to changes in traffic situations, such data is useful for other guidance purposes, particularly with P01. For example, POTs may comprise information on restaurants and tourist and other attractions that are shown on the map or in data associated with the map. This information can be updated in accordance with the invention.

In a further embodiment, information about traffic jams is provided to enable the map application 29 to propose a better and faster route, avoiding the jam.

This may be part of a larger service in which users of handsets such as handset 1 in traffic report jams using captured images as a means of verifying reported data. This function can be activated by pressing a key of the keypad associated with the predetermined function, i.e. traffic jam, or by using a user input that makes use of speech recognition, such that the user voices the words "traffic jam".

In a further modification, the map application 29 run by controller 17 is instead run by a vehicle mounted GPS system and the data therefrom is communicated through a local link, e.g. using the Bluetooth circuitry 19, 20, to the handset I for use on the display 13.

In a further alternative arrangement, the updated map data provided by map data service provider 4, is transmitted to the mobile handset I through a different network, for example a digital broadcast network (not shown).

The media charger application 28 may enable the map distribution to be performed using either a delayed or an immediate distribution of amended map data to users. The map application 29 may also be updated via a wired or short range wireless connection from an access point or similar downloading site, for example through a personal computer.

In a further modification, instead of sending the correction messages through the radio link 1, the messages may be stored on a memory in the handset 1, which is removable therefrom to be taken to the map data service provider 4.

In another embodiment, the correction messages created by application 35 are sent by e-mail rather than MMS.

The map data service provider 4 may register all incoming correction messages in a database so that the identity of the user terminal I can be identified and the correction messages can be sorted according to the location in which the image data was captured.

The correction data received by the map data service provider 4 may be sufficient in itself to enable the map data to be updated automatically or semi automatically without the need for an independent visual inspection by a personnel employed by the map data service provider.

Claims

Claims 1. Apparatus for enabling map data to be corrected in response to a

user at a location in a mapped terrain identifying an error between the actual mapped terrain and displayed map data corresponding to the actual mapped terrain, comprising: an image capture device to capture image data for an image of the actual mapped terrain corresponding to the identified error in the map data, means to obtain location data corresponding to the location where the image data is captured, and a transmitter to send a message that includes the image data and the location data over a link to a remote map service provider for correcting the map data.
2. Apparatus according to claim I comprising mobile telecommunications device, wherein said image capture device comprises a digital camera.
3. Apparatus according to claim 1 or 2 including a display device to display the map data corresponding to the location of the user in the mapped terrain.
4. Apparatus according to claim 3 including a processor operable to run a map application to provide the map data to the display.
5. Apparatus according to claim 4 wherein the processor is operable to receive location data corresponding to the location of the user and to provide the display with map data corresponding to the location of the user.
6. Apparatus according to any preceding claim and including a GPS device to provide the location data.
7. Apparatus according to claim 6 comprising a handheld device that includes the GPS device therein.
8. Apparatus according to claim 6 comprising a handheld device, with the GPS device coupled thereto through a local link..
9. Apparatus according to any preceding claim including a compass device to provide orientation data corresponding to the pointing direction of the image capture device, the transmitter being operable to transmit the orientation data corresponding to pointing direction for the captured image in said message.
10. Apparatus according to any preceding claim wherein the message includes data corresponding to more than one captured image of the terrain corresponding to the identified error in the map data.
11. Apparatus according to claim 9 wherein the images overlap.
12. Apparatus according to any preceding claim including a receiver to receive map correction data from the remote map service provider, for correcting the map data.
13. Apparatus according to any preceding claim including a user input device to permit user defined data corresponding to the or each said captured image to be included in said message.
14. Apparatus according to claim 13 wherein the user input device comprises a keypad.
15. Apparatus according to claim 14 wherein the keypad includes a key operable on an individual actuation to generate a predetermined text character string to be included in the message.
16. Apparatus according to any preceding claim including means to generate a time and date stamp to be included in the message.
17. Apparatus according to any preceding claim including means to permit a comparison of the captured image with an existing database of images to decide whether to include the captured image in the transmitted message.
18. Apparatus according to any preceding claim including means to permit the captured image to be analysed before transmission for determining whether or not a data relating to the map error has been transmitted earlier such as to exceed predetermined criteria.
19. Apparatus according to claim 18 wherein the image capturing device is coupled to the server before sending the message such as to receive data relating to the map error in relation to the predetermined criteria.
20. A map service provider for providing map data to user terminals at remote locations in mapped terrain, comprising a data store for storing map data corresponding to map data used by user terminals in the mapped terrain, a receiver to receive a correction message over a link from one of the user terminals in the mapped terrain for correcting the map data in the data store, the message including image data for an image of actual terrain corresponding to an identified error in the map data, and the message including location data corresponding to the location where the image data is captured, such as to permit correction of the stored map data.
21. A map service provider according to claim 20 including a transmitter to transmit corrected map data with corrections made to the stored map data following receipt of the correction message.
22. A mapping system comprising apparatus as claimed in any one of claims I to 19 and a map service provider as claimed in claim 20 or 22.
23. A method for enabling map data to be corrected in response to a user at a location in a mapped terrain for which an error has been identified between the terrain and displayed map data corresponding to the terrain, the method comprising: using an image capture device to capture image data for an image of the actual mapped terrain corresponding to the identified error in the map data, obtaining location data corresponding to the location where the image data is captured, obtaining time and date stamp data corresponding to the time of capturing the image, and sending a message that includes the image data, the location data and the time and date stamp data over a link to be received by a remote map service provider for correcting the map data.
24. A method of providing map data for use by user terminals at remote locations in a mapped terrain, comprising storing map data corresponding to map data used by user terminals in the mapped terrain, receiving a correction message over a link from one of the user terminals in the mapped terrain for correcting the map data in the data store, the message including image data for an image of actual terrain corresponding to an identified error in the map data, and the message including location data corresponding to the location where the image data is captured, such as to permit correction of the stored map data.
25. A method according to claim 24 including transmitting corrected map data with corrections made to the stored map data following receipt of the correction message, to at least one said user terminal.
26. A method according to claim 24 or 25 including providing a reward to the user that sends the correction message.
27. A method according to claim 25 wherein the service provider receives correction messages pertinent to the identified error in the map data from more than one user terminal and providing different levels of reward to the users of the user terminals, with a higher reward being given to the first user terminal to submit the first of the correction messages.
28. Apparatus for enabling map data to be corrected, substantially as hereinbefore described with reference to the accompanying drawings.
29. A method for enabling map data to be corrected, substantially as hereinbefore described with reference to the accompanying drawings.