Classifications

• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
  • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
  • G01C21/38—Electronic maps specially adapted for navigation; Updating thereof
  • G01C21/3804—Creation or updating of map data
  • G01C21/3833—Creation or updating of map data characterised by the source of data
  • G01C21/3848—Data obtained from both position sensors and additional sensors

Definitions

• This invention relates to an improved navigation device and method.
• Portable navigation devices including GPS (Global Positioning System) signal reception and processing means are well known and are widely employed as in-car navigation systems.
• GPS Global Positioning System
• modern PNDs comprise: a processor,
• electronic gyroscopes and accelerometers which produce signals capable of being processed to determine the current angular and linear acceleration, and in turn, and in conjunction with location information derived from the GPS signal, velocity and relative displacement of the device and thus the vehicle in which it is mounted,
• - input and output means examples including a visual display (which may be touch sensitive to allow for user input), one or more physical buttons to control on/off operation or other features of the device, a speaker for audible output, optionally one or more physical connectors by means of which power and optionally one or more data signals can be transmitted to and received from the device, and
• the PND is manifested primarily in its ability to determine a route between a start or current location and a destination, which can be input by a user of the computing device, by any of a wide variety of different methods, for example by postcode, street name and number, and previously stored well known, favourite or recently visited destinations.
• the PND is enabled by software for computing a "best” or "optimum” route between the start and destination address locations from the map data. A "best" or "optimum” route is determined on the basis of predetermined criteria and need not necessarily be the fastest or shortest route.
• the selection of the route along which to guide the driver can be very sophisticated, and the selected route may take into account existing, predicted and dynamically and/or wirelessly received traffic and road information, historical information about road speeds, and the driver's own preferences for the factors determining road choice.
• the device may continually monitor road and traffic conditions, and offer to or choose to change the route over which the remainder of the journey is to be made due to changed conditions.
• Real time traffic monitoring systems based on various technologies (e.g. mobile phone calls, fixed cameras, GPS fleet tracking) are being used to identify traffic delays and to feed the information into notification systems.
• the navigation device may typically be mounted on the dashboard of a vehicle, but may also be formed as part of an on-board computer of the vehicle or car radio.
• the navigation device may also be (part of) a hand-held system, such as a PDA (Personal Navigation Device) a media player, a mobile phone or the like, and in these cases, the normal functionality of the hand-held system is extended by means of the installation of software on the device to perform both route calculation and navigation along a calculated route.
• a PDA Personal Navigation Device
• the user interacts with the navigation device to select the desired calculated route, optionally from a list of proposed routes.
• the user may intervene in, or guide the route selection process, for example by specifying that certain routes, roads, locations or criteria are to be avoided or are mandatory for a particular journey.
• the route calculation aspect of the PND forms one primary function provided, and the navigation along such a route is another primary function.
• the PND provides visual and/or audible instructions to guide the user along a chosen route to the end of that route, that is the desired destination. It is usual for PNDs to display map information on-screen during the navigation, such information regularly being updated on-screen so that the map information displayed is representative of the current location of the device, and thus of the user or user's vehicle if the device is being used for in-car navigation.
• An icon displayed on-screen typically denotes the current device location, and is centred with the map information of current and surrounding roads and other map features being also displayed. Additionally, navigation information may be displayed, optionally in a status bar above, below or to one side of the displayed map information, examples of navigation information including the distance to the next deviation from the current road required to be taken by the user, the nature of that deviation possibly being represented by a further icon suggestive of the particular type of deviation, for example a left or right turn.
• the navigation function also determines the content, duration and timing of audible instructions by means of which the user can be guided along the route. As can be appreciated a simple instruction such as "turn left in 100 m" requires significant processing and analysis.
• user interaction with the device may be by a touch screen, or additionally or alternately by steering column mounted remote control, by voice activation or by any other suitable method.
• a further important function provided by the device is automatic route re-calculation in the event that
• a route to be calculated with user defined criteria; for example, the user may prefer a scenic route to be calculated by the device, or may wish to avoid any roads on which traffic congestion is likely, expected or currently prevailing.
• the device software would then calculate various routes and weigh more favourably those that include along their route the highest number of points of interest (known as POIs) tagged as being for example of scenic beauty, or, using stored information indicative of prevailing traffic conditions on particular roads, order the calculated routes in terms of a level of likely congestion or delay on account thereof.
• POIs points of interest
• Other POI-based and taffic information-based route calculation and navigation criteria are also possible.
• route calculation and navigation functions are fundamental to the overall utility of PNDs, it is possible to use the device purely for information display, or "free- driving", in which only map information relevant to the current device location is displayed, and in which no route has been calculated and no navigation is currently being performed by the device. Such a mode of operation is often applicable when the user already knows the route along which it is desired to travel and does not require navigation assistance.
• PNDs have been manufactured with integrated digital cameras including one or more charge coupled devices (CCDs) and are thus capable of capturing digital photographic images which are then usually stored in the non-volatile device memory.
• CCDs charge coupled devices
• Such images may be subsequently downloaded onto a user's PC or other digital image bank, as is conventional practice for dedicated digital cameras, by means of a physical, e.g. USB, connection between PC and device.
• the images may be stored in the native non-volatile memory within the device, or on a removable media storage card, such as a secure digital or SD card, or any other such removable digital media, e.g. flash memory.
• One particular advantage of integrating a digital camera into a PND is that the digital image captured may be tagged with specific location information calculated from the GPS signals being or recently received by the device, in addition to standard tag information commonly ascribed to such images, e.g. time and date.
• the S90i device manufactured and sold by Navman ® includes this facility.
• Navman ® also offer a service whereby pre-geospatially tagged images of POIs are available for download from an image server, via a user's PC to which a PND is connected, and can be stored in the memory of the device for later display on the screen of the device when the device location is determined as being within a pre-determined proximity threshold of the particular POI.
• a further useful feature of the storage of specific geospatially tagged images of POIs is that they can be selected from memory as a means of identifying either a desired destination or as a desired waypoint along a route to an alternate, user-selected destination.
• This facility is broadly identical to the searching for and selection of standard POIs for which only textual information is stored as part of the map data used in the navigation, route calculation, and free-driving modes of the PND - the only difference being that the particular POI can be immediately identified on screen by the user by display of a photograph thereof.
• map data does not generally include transient road alterations, such as may be caused by road works, carriageway reductions or alterations, or pedestrianization of roads previously mapped as vehicular thoroughfares.
• a method of operating a PND or navigation system having a digital camera associated therewith by means of which digital image data can be captured said method characterized by performing a pattern recognition technique on said captured digital image data to determine whether the image contains one or more recognizable features, said features having been previously defined by digital information stored in the memory of said device and said pattern recognition technique conducting a comparison between the captured digital image information and at least some of the digital information representative of a feature, and further characterized by the storage of at least some information including an indication of the feature identified for which the pattern recognition technique was successful together with geospatial location data identifying the approximate position of at least one of:
• the information stored by the device after a successful pattern recognition is one or more of the particular captured digital images containing the one or more features identified therein.
• the features for which sets of digital descriptors are provided are such features as are commonly found on, in or around modern roads, examples including pedestrian crossings, traffic lights, speed cameras, warning signs, speed limits, gantries, road markings, and the like, such being features which are easily recognizable and distinguishable, both digitally in the pattern recognition technique, and in reality by drivers of vehicles.
• the capture of digital image data occurs substantially continuously such that a stream of digital data, more akin to a digital video feed, is captured by the PND or system, said pattern recognition technique being performed substantially continuously on said streaming digital data.
• the device or system contains one or more stored graphical icons representative of the one or more features capable of being identified by said pattern recognition technique, the PND or system including a routine whereby the map information displayed on screen is augmented by the display of the graphical icons representing such features at the appropriate position, as previously determined by the PND system on capture of digital image data containing the identified feature.
• the first aspect of the invention forms part of a map data update system
• the PND or navigation system stores information identifying a feature and its location
• said PND or navigation system includes means for uploading such data to a data validation server which processes all received feature identification and corresponding location information, said processing taking into account the fact that some uploaded data will be erroneous and thus determining a relative likelihood that a feature exists at a particular location depending on the number of times a particular feature is identified in a particular location, or within a proximity threshold thereof, said data validation server also creating one or more map update files containing the validated feature information and corresponding location information, said map data update system then subsequently transmitting said one or more map update files containing validated feature data back to the PND or navigation system.
• the map update files created by the validation server contain graphical icon representations of identified features, such being displayed in superposed manner together with the base map data on the screen of the PND or navigation system.
• the PND or system memory stores graphical icon representations of potential features which may be identified in the map update files received from the data validation server, said map update files containing only pointer information (together with corresponding location information) which is identifiable by the PND or navigation system which can thus retrieve the appropriate locally stored graphical icon for display on the device or system screen when displaying map data for an area which includes the location information in the map data update file.
• the PND is provided with an integrated digital camera, or in an alternative embodiment, the PND or navigation system is associated with, and provided with software which is capable of controlling, a digital camera, which may be connected to the PND or navigation system by means of a physical (e.g. cable) or wireless (e.g. Bluetooth) connection.
• a digital camera may be connected to the PND or navigation system by means of a physical (e.g. cable) or wireless (e.g. Bluetooth) connection.
• the digital camera may be detachable from the PND or navigation system.
• the map update files may be downloaded over the internet by connecting a PND to an i internet-connected PC by means of a USB cable, as is currently possible with most existing PNDs.
• a computer program embodied on computer readable media as required, is provided for implementing the methods described above, as is a PND and/or navigation system adapted to perform the methods described.
• FIG. 1 illustrates an example view of a Global Positioning System (GPS);
• GPS Global Positioning System
• Figure 2 illustrates an example block diagram of electronic components of a navigation device
• Figure 3 illustrates an example block diagram of the manner in which a navigation device may receive information over a wireless communication channel
• Figures 4A and 4B are perspective views of an implementation of an embodiment of the navigation device
• Figure 5 shows a schematic diagram of a proposed system whereby base mad data stored locally on a PND can be augmented with graphical indicators representing user- identifiable road-side features.
• FIG 1 illustrates an example view of Global Positioning System (GPS), usable by navigation devices.
• GPS Global Positioning System
• NAVSTAR the GPS incorporates a plurality of satellites which work with the earth in extremely precise orbits. Based on these precise orbits, GPS satellites can relay their location to any number of receiving units.
• the GPS system is implemented when a device, specially equipped to receive GPS data, begins scanning radio frequencies for GPS satellite signals. Upon receiving a radio signal from a GPS satellite, the device determines the precise location of that satellite via one of a plurality of different conventional methods. The device will continue scanning, in most instances, for signals until it has acquired at least three different satellite signals (noting that position is not normally, but can be determined, with only two signals using other triangulation techniques). Implementing geometric triangulation, the receiver utilizes the three known positions to determine its own two-dimensional position relative to the satellites. This can be done in a known manner. Additionally, acquiring a fourth satellite signal will allow the receiving device to calculate its three dimensional position by the same geometrical calculation in a known manner.
• the position and velocity data can be updated in real time on a continuous basis by an unlimited number of users.
• the GPS system is denoted generally by reference numeral 100.
• a plurality of satellites 120 are in orbit about the earth 124.
• the orbit of each satellite 120 is not necessarily synchronous with the orbits of other satellites 120 and, in fact, is likely asynchronous.
• a GPS receiver 140 is shown receiving spread spectrum GPS satellite signals 160 from the various satellites 120.
• the spread spectrum signals 160 continuously transmitted from each satellite 120, utilize a highly accurate frequency standard accomplished with an extremely accurate atomic clock.
• Each satellite 120 as part of its data signal transmission 160, transmits a data stream indicative of that particular satellite 120.
• the GPS receiver device 140 generally acquires spread spectrum GPS satellite signals 160 from at least three satellites 120 for the GPS receiver device 140 to calculate its two-dimensional position by triangulation. Acquisition of an additional signal, resulting in signals 160 from a total of four satellites 120, permits the GPS receiver device 140 to calculate its three-dimensional position in a known manner.
• Figure 2 illustrates an example block diagram of electronic components of a navigation device 200, in block component format. It should be noted that the block diagram of the navigation device 200 is not inclusive of all components of the navigation device, but is only representative of many example components.
• the navigation device 200 is located within a housing (not shown).
• the housing includes a processor 210 connected to an input device 220 and a display screen 240.
• the input device 220 can include a keyboard device, voice input device, touch panel and/or any other known input device utilized to input information; and the display screen 240 can include any type of display screen such as an LCD display, for example.
• the input device 220 and display screen 240 are integrated into an integrated input and display device, including a touchpad or touchscreen input wherein a user need only touch a portion of the display screen 240 to select one of a plurality of display choices or to activate one of a plurality of virtual buttons.
• other types of output devices 250 can also include, including but not limited to, an audible output device.
• input device 240 can also include a microphone and software for receiving input voice commands as well.
• processor 210 is operatively connected to and set to receive input information from input device 240 via a connection 225, and operatively connected to at least one of display screen 240 and output device 241, via output connections 245, to output information thereto. Further, the processor 210 is operatively connected to memory 230 via connection 235 and is further adapted to receive/send information from/to input/output (I/O) ports 270 via connection 275, wherein the I/O port 270 is connectible to an I/O device 280 external to the navigation device 200.
• I/O input/output
• the external I/O device 270 may include, but is not limited to an external listening device such as an earpiece for example.
• the connection to I/O device 280 can further be a wired or wireless connection to any other external device such as a car stereo unit for hands-free operation and/or for voice activated operation for example, for connection to an ear piece or head phones, and/or for connection to a mobile phone for example, wherein the mobile phone connection may be used to establish a data connection between the navigation device 200 and the internet or any other network for example, and/or to establish a connection to a server via the internet or some other network for example.
• the navigation device 200 may establish a "mobile" or telecommunications network connection with the server 302 via a mobile device 400 (such as a mobile phone, PDA, and/or any device with mobile phone technology) establishing a digital connection (such as a digital connection via known Bluetooth technology for example). Thereafter, through its network service provider, the mobile device 400 can establish a network connection (through the internet for example) with a server 302. As such, a "mobile" network connection is established between the navigation device 200 (which can be, and often times is mobile as it travels alone and/or in a vehicle) and the server 302 to provide a "real-time" or at least very “up to date” gateway for information.
• a mobile device 400 such as a mobile phone, PDA, and/or any device with mobile phone technology
• a digital connection such as a digital connection via known Bluetooth technology for example.
• the mobile device 400 can establish a network connection (through the internet for example) with a server 302.
• a "mobile” network connection is established between the navigation device
• the establishing of the network connection between the mobile device 400 (via a service provider) and another device such as the server 302, using the internet 410 for example, can be done in a known manner. This can include use of TCP/IP layered protocol for example.
• the mobile device 400 can utilize any number of communication standards such as CDMA, GSM, WAN, etc.
• an internet connection may be utilized which is achieved via data connection, via a mobile phone or mobile phone technology within the navigation device 200 for example.
• an internet connection between the server 302 and the navigation device 200 is established. This can be done, for example, through a mobile phone or other mobile device and a GPRS (General Packet Radio Service)-connection (GPRS connection is a high-speed data connection for mobile devices provided by telecom operators; GPRS is a method to connect to the internet.
• GPRS General Packet Radio Service
• the navigation device 200 can further complete a data connection with the mobile device 400, and eventually with the internet 410 and server 302, via existing Bluetooth technology for example, in a known manner, wherein the data protocol can utilize any number of standards, such as the GSRM, the Data Protocol Standard for the GSM standard, for example.
• the data protocol can utilize any number of standards, such as the GSRM, the Data Protocol Standard for the GSM standard, for example.
• the navigation device 200 may include its own mobile phone technology within the navigation device 200 itself (including an antenna for example, wherein the internal antenna of the navigation device 200 can further alternatively be used).
• the mobile phone technology within the navigation device 200 can include internal components as specified above, and/or can include an insertable card (e.g. Subscriber Identity Module or SIM card), complete with necessary mobile phone technology and/or an antenna for example.
• mobile phone technology within the navigation device 200 can similarly establish a network connection between the navigation device 200 and the server 302, via the internet 410 for example, in a manner similar to that of any mobile device 400.
• the Bluetooth enabled device may be used to correctly work with the ever changing spectrum of mobile phone models, manufacturers, etc., model/manufacturer specific settings may be stored on the navigation device 200 for example. The data stored for this information can be updated.
• Figure 2 further illustrates an operative connection between the processor 210 and an antenna/receiver 250 via connection 255, wherein the antenna/receiver 250 can be a GPS antenna/receiver for example.
• the antenna and receiver designated by reference numeral 250 are combined schematically for illustration, but that the antenna and receiver may be separately located components, and that the antenna may be a GPS patch antenna or helical antenna for example.
• the electronic components shown in Figure 2 are powered by power sources (not shown) in a conventional manner.
• power sources not shown
• different configurations of the components shown in Figure 2 are considered within the scope of the present application.
• the components shown in Figure 2 may be in communication with one another via wired and/or wireless connections and the like.
• the scope of the navigation device 200 of the present application includes a portable or handheld navigation device 200.
• the portable or handheld navigation device 200 of Figure 2 can be connected or "docked” in a known manner to a motorized vehicle such as a car or boat for example. Such a navigation device 200 is then removable from the docked location for portable or handheld navigation use.
• Figure 3 illustrates an example block diagram of a server 302 and a navigation device 200 capable of communicating via a generic communications channel 318.
• the server 302 and a navigation device 200 can communicate when a connection via communications channel 318 is established between the server 302 and the navigation device 200 (noting that such a connection can be a data connection via mobile device, a direct connection via personal computer via the internet, etc.).
• the server 302 includes, in addition to other components which may not be illustrated, a processor 304 operatively connected to a memory 306 and further operatively connected, via a wired or wireless connection 314, to a mass data storage device 312.
• the processor 304 is further operatively connected to transmitter 308 and receiver 310, to transmit and send information to and from navigation device 200 via communications channel 318.
• the signals sent and received may include data, communication, and/or other propagated signals.
• the transmitter 308 and receiver 310 may be selected or designed according to the communications requirement and communication technology used in the communication design for the navigation system 200. Further, it should be noted that the functions of transmitter 308 and receiver 310 may be combined into a signal transceiver.
• Server 302 is further connected to (or includes) a mass storage device 312, noting that the mass storage device 312 may be coupled to the server 302 via communication link 314.
• the mass storage device 312 contains a store of navigation data and map information, and can again be a separate device from the server 302 or can be incorporated into the server 302.
• the navigation device 200 is adapted to communicate with the server 302 through communications channel 318, and includes processor, memory, etc. as previously described with regard to Figure 2, as well as transmitter 320 and receiver 322 to send and receive signals and/or data through the communications channel 318, noting that these devices can further be used to communicate with devices other than server 302. Further, the transmitter 320 and receiver 322 are selected or designed according to communication requirements and communication technology used in the communication design for the navigation device 200 and the functions of the transmitter 320 and receiver 322 may be combined into a single transceiver.
• Software stored in server memory 306 provides instructions for the processor 304 and allows the server 302 to provide services to the navigation device 200.
• One service provided by the server 302 involves processing requests from the navigation device 200 and transmitting navigation data from the mass data storage 312 to the navigation device 200.
• Another service provided by the server 302 includes processing the navigation data using various algorithms for a desired application and sending the results of these calculations to the navigation device 200.
• the communication channel 318 generically represents the propagating medium or path that connects the navigation device 200 and the server 302.
• Both the server 302 and navigation device 200 include a transmitter for transmitting data through the communication channel and a receiver for receiving data that has been transmitted through the communication channel.
• the communication channel 318 is not limited to a particular communication technology. Additionally, the communication channel 318 is not limited to a single communication technology; that is, the channel 318 may include several communication links that use a variety of technology. For example, the communication channel 318 can be adapted to provide a path for electrical, optical, and/or electromagnetic communications, etc. As such, the communication channel 318 includes, but is not limited to, one or a combination of the following: electric circuits, electrical conductors such as wires and coaxial cables, fiber optic cables, converters, radio-frequency (rf) waves, the atmosphere, empty space, etc. Furthermore, the communication channel 318 can include intermediate devices such as routers, repeaters, buffers, transmitters, and receivers, for example.
• intermediate devices such as routers, repeaters, buffers, transmitters, and receivers, for example.
• the communication channel 318 includes telephone and computer networks. Furthermore, the communication channel 318 may be capable of accommodating wireless communication such as radio frequency, microwave frequency, infrared communication, etc. Additionally, the communication channel 318 can accommodate satellite communication.
• wireless communication such as radio frequency, microwave frequency, infrared communication, etc.
• the communication channel 318 can accommodate satellite communication.
• the communication signals transmitted through the communication channel 318 include, but are not limited to, signals as may be required or desired for given communication technology.
• the signals may be adapted to be used in cellular communication technology such as Time Division Multiple Access (TDMA), Frequency Division Multiple Access (FDMA), Code Division Multiple Access (CDMA), Global System for Mobile Communications (GSM), etc.
• TDMA Time Division Multiple Access
• FDMA Frequency Division Multiple Access
• CDMA Code Division Multiple Access
• GSM Global System for Mobile Communications
• Both digital and analogue signals can be transmitted through the communication channel 318.
• These signals may be modulated, encrypted and/or compressed signals as may be desirable for the communication technology.
• the server 302 includes a remote server accessible by the navigation device 200 via a wireless channel.
• the server 302 may include a network server located on a local area network (LAN), wide area network (WAN), virtual private network (VPN), etc.
• LAN local area network
• WAN wide area network
• VPN virtual private network
• the server 302 may include a personal computer such as a desktop or laptop computer, and the communication channel 318 may be a cable connected between the personal computer and the navigation device 200.
• a personal computer may be connected between the navigation device 200 and the server 302 to establish an internet connection between the server 302 and the navigation device 200.
• a mobile telephone or other handheld device may establish a wireless connection to the internet, for connecting the navigation device 200 to the server 302 via the internet.
• the navigation device 200 may be provided with information from the server 302 via information downloads which may be periodically updated upon a user connecting navigation device 200 to the server 302 and/or may be more dynamic upon a more constant or frequent connection being made between the server 302 and navigation device 200 via a wireless mobile connection device and TCP/IP connection for example.
• the processor 304 in the server 302 may be used to handle the bulk of the processing needs, however, processor 210 of navigation device 200 can also handle much processing and calculation, oftentimes independent of a connection to a server 302.
• a navigation device 200 includes a processor 210, an input device 220, and a display screen 240.
• the input device 220 and display screen 240 are integrated into an integrated input and display device to enable both input of information (via direct input, menu selection, etc.) and display of information through a touch panel screen, for example.
• a touch panel screen for example.
• Such a screen may be a touch input LCD screen, for example, as is well known to those of ordinary skill in the art.
• the navigation device 200 can also include any additional input device 220 and/or any additional output device 241, such as audio input/output devices for example.
• Figures 4A and 4B are perspective views of a navigation device 200.
• the navigation device 200 may be a unit that includes an integrated input and display device 290 (a touch panel screen for example) and the other components of figure 2 (including but not limited to internal GPS receiver 250, microprocessor 210, a power supply, memory systems 220, etc.).
• the navigation device 200 may sit on an arm 292, which itself may be secured to a vehicle dashboard/window/etc, using a large suction cup 294.
• This arm 292 is one example of a docking station to which the navigation device 200 can be docked.
• the navigation device 200 can be docked or otherwise connected to an arm 292 of the docking station by snap connecting the navigation device 292 to the arm 292 for example (this is only one example, as other known alternatives for connection to a docking station are within the scope of the present application).
• the navigation device 200 may then be rotatable on the arm 292, as shown by the arrow of Fig. 4B. To release the connection between the navigation device 200 and the docking station, a button on the navigation device 200 may be pressed, for example (this is only one example, as other known alternatives for disconnection to a docking station are within the scope of the present application).
• a vehicle 500 includes a usually dash-board mounted PND 502.
• the typical arrangement is shown in the picture 504 in which the PND 502 can be seen, as well as the field of view 506 of the driver through the windscreen of the car, said field of view including a a traffic light 508.
• the PND 502 is provided with an integrated digital camera or other digital image capture device which is operated under the control of operating software installed on the device or an alternate software program executing thereon.
• such software includes an option whereby the user may choose a conventional camera mode, in which the device is typically handheld and used as a conventional digital camera might be used, and an alternate option wherein the device may be used in a free image-capture mode, as is envisaged in Figure 5. In this mode of operation (which may be automatically selected by the device on determining that it is attached to its mount device indicated at 510).
• the digital image data is captured continuously through the camera such that as the vehicle moves, a continuous stream of digital image data, akin to streaming video is made available to the processing electronics of the device.
• the capture of digital image data occurs periodically with relatively short period, for example every few seconds, such that a sufficient amount of digital image data is captured by the device to enable a pattern or object recognition technique to be performed on that data.
• the particular recognition technique applied is one of many available techniques, but in principle the technique employs a set of stored digital descriptors or object definitions which describe basic and common objects such as traffic lights, street lamps, road markings and other road-based or road-side landmarks.
• the image or object recognition technique occurs also either periodically or continuously on the received digital image data, but in any event, the processing of captured image data gives a positive or negative result depending on whether any one of a number of objects are recognized in the captured image data at that time being processed.
• the traffic light feature 508 is recognized, and the device can then store a highly compressed message or other data as indicated at 514, 516 representative of both the type of object recognized and some indication of its geospatial location.
• the device may record the current location coordinates or GPS information at the time of capture of the digital information in which the relevant feature was identified by the pattern recognition or other image processing technique.
• An alternative for recording location information is to cause the device to conduct a further location processing routine based on either the device location at the time of digital image capture, or the last stored known position of the device, corrected as required to provide an approximate device location at the time of digital image capture, said further processing routine including a further image processing routine which makes an approximation of the position of the identified feature relative to the actual or approximated device location at the time of digital image capture.
• the relevant time of digital image capture and thus that time which determines the current actual or approximated location of the device, is that at which the digital image which is captured contains the recognized feature.
• the device 502 when a suitable "continuous monitoring" option is enabled in which the integrated or associated digital camera continuously or periodically captures digital image data and conducts one or more pattern recognition techniques thereon, the amount of data stored will increase in proportion to the number of road-side objects identified in the captured image data.
• the devices At a suitable time, for instance when the amount of update data reaches a certain size, or when the device detects a facility for communicating data with a remote server 518, either wirelessly or over a more standard USB connection to an internet-connected PC, the devices causes upload of the update information to said server which validates all received update information from all devices having a digital image capture and processing ability and which have any stored update information to provide.
• the validation procedure effectively amounts to an averaging and/or other statistical procedure for all those updates received by the validation server which include location coordinates more densely distributed in one or more geographic locations than others. For example, a high distribution density of update data indicating a traffic light at or around a road intersection would certainly be suggestive of traffic lights at that intersection.
• the validation server then creates one or more map patches including graphical icons, possibly "on the fly", and made available for later download by the entire user base of a particular device manufacturer. As can be seen at 520, which gives an example of the display of map information on a device screen, a traffic light icon 522 can be made to appear superposed on the base map data 524 in the prescribed position.
• Said map patches are either downloaded from the server 518 upon request from an internet-connected PC on which software, such as that available from the applicant herefor under the TomTom HOMETM brand, has been installed and to which the device may be connected, or alternatively, in the case that the device is provided with wireless communication or telecommunication capability, over the air at predetermined times or again, on request at the behest of the user.
• the map patches are "pushed" to the user base of devices wirelessly when the number or size of map patches reaches a certain level.
• the map patches may contain very limited data, for example an object indicator and corresponding location data and optionally other settings or information.
• the PND or system contains a plurality of graphical icons stored in memory, such being selected for display in superposed relation to the displayed map data during navigation so as to provide enhanced navigation for the user.
• the graphical icons are only displayed when the device is proximate the location of the relevant identified object, that is at a time when the map data being displayed includes the specific location.
• Camera and/or device is provided with software which efficiently recognizes a predefined set of objects
• Map patches are downloaded to the PND over the internet from the server, optionally wirelessly, or over other telecommunications networks.
• pattern recognition technology in PNDs and navigation systems, which are also to be considered as encompassed within the invention.
• camera-enabled PNDs and navigation systems it is possible for camera-enabled PNDs and navigation systems to automatically create map correction data for future transmission to a validation or other back-end processing facility.
• the pattern recognition technique is carried out continuously or periodically on captured image data, and the types of feature which may be recognized are road junctions, layouts and arrangements, signposts indicating travel restrictions along roads and indeed any other road-based or road-side feature which may be appropriately represented by stored digital data, either being part of the underlying map data file, or a subsequent patch or POI data file commonly used in conjunction with said underlying data files.
• the method of the present invention includes the further step of comparing the recognized feature with underlying map data (or ancillary descriptive patch or POI data files) and identifying a discrepancy therebetween of a type which could usefully be corrected.
• a most common difficulty with modern map information is that lesser junctions previously of a "cross-road" type are often turned into roundabout-style junctions by highway authorities, local councils or other administrative authorities having power to change road structures and layouts in a locality.
• Another example may be the introduction of traffic lights or a formal junction at a previously uncontrolled junction.
• the device By means of pattern recognition techniques carried out by the PND or navigation system, it is possible for the device to automatically determine that a particular type of junction, or traffic management measures applicable to such, as identified and displayed on screen by the device based on the underlying map data, are different from the actual junction type or traffic management measures as seen by the associated or integrated device camera when in motion, either in a free-driving or navigation mode.
• This feature may be of great benefit to the overall community of device users, the majority of which are only generally interested in using the device to perform basic navigation to a desired destination, as opposed to using the map correction features which may be provided in the software of the device. Accordingly, provided that a user has already indicated that he is prepared to permit the device to automatically transmit data wirelessly from the device concerning his current or previously traveled locations (an option which is usually set at the first start up of the device), then no further action is required for the device to automatically transmit correction data.
• the locally stored data being representative of features desired to be recognized by the pattern matching technique may take any of a number of different forms, including any one or more of outline data, colour data, pattern data, appearance characteristic or profile data and the like.
• the pre-stored data may include animated images which may be compared as part of the pattern recognition technique with a number of progressively captured images which together provide the effect of animation in those images.

Landscapes

• Engineering & Computer Science (AREA)
• Remote Sensing (AREA)
• Radar, Positioning & Navigation (AREA)
• Automation & Control Theory (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Navigation (AREA)
• Instructional Devices (AREA)
• Traffic Control Systems (AREA)

Applications Claiming Priority (1)

Publications (1)

Family

ID=39778292

Family Applications (1)

Country Status (8)

Cited By (2)

Families Citing this family (22)

Family Cites Families (7)

• 2007
  • 2007-12-20 JP JP2010538352A patent/JP2011506983A/ja not_active Withdrawn
  • 2007-12-20 WO PCT/EP2007/011250 patent/WO2009080070A1/en active Application Filing
  • 2007-12-20 CA CA2709740A patent/CA2709740A1/en not_active Abandoned
  • 2007-12-20 DE DE202007018605U patent/DE202007018605U1/de not_active Expired - Lifetime
  • 2007-12-20 CN CN2007801019785A patent/CN101903745A/zh active Pending
  • 2007-12-20 EP EP07856973A patent/EP2223041A1/de not_active Withdrawn
  • 2007-12-20 DE DE202007018604U patent/DE202007018604U1/de not_active Expired - Lifetime
  • 2007-12-20 AU AU2007362729A patent/AU2007362729A1/en not_active Abandoned
• 2008
  • 2008-10-15 NL NL2002099A patent/NL2002099C2/en not_active IP Right Cessation
  • 2008-10-16 NL NL2002105A patent/NL2002105C2/en not_active IP Right Cessation

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events