EP2518443A1 - Procédé de génération d'une base de données, dispositif de navigation et procédé permettant de déterminer les informations de hauteur - Google Patents

Procédé de génération d'une base de données, dispositif de navigation et procédé permettant de déterminer les informations de hauteur Download PDF

Info

Publication number
EP2518443A1
EP2518443A1 EP11164312A EP11164312A EP2518443A1 EP 2518443 A1 EP2518443 A1 EP 2518443A1 EP 11164312 A EP11164312 A EP 11164312A EP 11164312 A EP11164312 A EP 11164312A EP 2518443 A1 EP2518443 A1 EP 2518443A1
Authority
EP
European Patent Office
Prior art keywords
tile
data structure
vertices
entry
height
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP11164312A
Other languages
German (de)
English (en)
Other versions
EP2518443B1 (fr
Inventor
Vladimir Ivanov
Martin Fischer
CC. Spindler
Simon Schütz
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harman Becker Automotive Systems GmbH
Original Assignee
Harman Becker Automotive Systems GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harman Becker Automotive Systems GmbH filed Critical Harman Becker Automotive Systems GmbH
Priority to EP11164312.8A priority Critical patent/EP2518443B1/fr
Priority to CA2773419A priority patent/CA2773419C/fr
Priority to JP2012097082A priority patent/JP6001310B2/ja
Priority to BR102012009838-5A priority patent/BR102012009838B1/pt
Priority to US13/458,378 priority patent/US9557181B2/en
Priority to KR1020120044237A priority patent/KR101925088B1/ko
Priority to CN201210132297.8A priority patent/CN102779148B/zh
Publication of EP2518443A1 publication Critical patent/EP2518443A1/fr
Application granted granted Critical
Publication of EP2518443B1 publication Critical patent/EP2518443B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/40—Data acquisition and logging
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/38—Electronic maps specially adapted for navigation; Updating thereof
    • G01C21/3804—Creation or updating of map data
    • G01C21/3807—Creation or updating of map data characterised by the type of data
    • G01C21/3826—Terrain data
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/38—Electronic maps specially adapted for navigation; Updating thereof
    • G01C21/3863—Structures of map data
    • G01C21/3867—Geometry of map features, e.g. shape points, polygons or for simplified maps
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/38—Electronic maps specially adapted for navigation; Updating thereof
    • G01C21/3863—Structures of map data
    • G01C21/387—Organisation of map data, e.g. version management or database structures
    • G01C21/3881—Tile-based structures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering

Definitions

  • the invention relates to methods and devices associated with the use of height information in navigation devices.
  • the invention relates in particular to a method of generating a database for a navigation device, to a navigation device and to a method of determining height information for a terrain.
  • the invention relates in particular to such methods and devices which may be used for outputting three-dimensional representations of a terrain.
  • Height information for a terrain is increasingly widely used in navigation devices.
  • One exemplary field in which such height information may be used is the outputting of three-dimensional maps.
  • Optical output devices may be used for outputting electronic maps. Since electronic maps may be displayed on screens of small and/or portable devices, they have the advantage of being versatile and compact.
  • Three-dimensional (3D) maps i.e. perspective representations, may be of particular value to the user owing to their high recognition quality. I.e., the recognition of an environmental region, such as a street intersection, may be facilitated when a three-dimensional map is output, as compared to a conventional two-dimensional representation.
  • height information may be used includes navigation applications or driver assistance.
  • various costs functions used in route search such as fuel consumption costs, may depend on the height difference which is to be covered.
  • Height information allows the height differences covered upon traversal of a route to be determined. The influence of an elevation difference on fuel consumption, or on other driver assistance functions, may be taken into account.
  • the surface structure may be stored as digital elevation model (DEM) data.
  • DEM digital elevation model
  • the DEM data may include triangular patches which respectively are TINs. This allows a representation of the terrain to be efficiently generated at run time using the DEM data.
  • a method of generating a database for a navigation device is provided.
  • Data defining a three-dimensional terrain are retrieved.
  • a first data structure is generated using a tiling which includes a plurality of tiles.
  • an entry is respectively generated in the first data structure.
  • a portion of the three-dimensional terrain contained in the respective tile is compared to at least one pre-defined tile pattern included in a second data structure. Based on a result of the comparison, one of data defining the portion of the three-dimensional terrain or an identifier for a pre-defined tile pattern included in the second data structure is selected for storing in the entry.
  • the first data structure and the second data structure are stored in the database.
  • the pre-defined tile pattern which is found in plural different tiles, such as a flat terrain or a terrain having only a small number of planar facets, has to be stored only once.
  • the "data defining the portion of the three-dimensional terrain" which are stored in the entry are data which, by themselves, provide a full description of the three-dimensional surface, without requiring information from the second data structure to be combined therewith.
  • Coordinates of vertices of a surface mesh defining the three-dimensional terrain may be retrieved from the data defining the three-dimensional terrain or may be generated based on the data defining the three-dimensional terrain.
  • Each one of the vertices respectively has a pair of lateral coordinates and a height coordinate, so that three-dimensional information is available.
  • the entry in the first data structure may respectively be generated such that it includes an identifier for a pre-defined tile pattern if lateral coordinates of all vertices of the surface mesh which are located on the tile correspond to lateral coordinates of vertices in the respective pre-defined tile pattern.
  • the identifier may be stored for the one pre-defined tile pattern for which the lateral coordinates of the vertices of the surface mesh correspond to the coordinates of the pre-defined tile pattern.
  • lateral coordinates are coordinates in the two directions orthogonal to the gravity vector.
  • the relative lateral coordinates of vertices on the tile "correspond to" the lateral coordinates of the vertices in a pre-defined tile pattern if the relative positions, i.e., the x- and y-coordinates of the distance vectors between all pairs of vertices, are identical for both the surface mesh on the tile and the pre-defined tile pattern.
  • an identifier for a pre-defined tile pattern may be stored to describe the topology for the respective tile.
  • a match between the topology of the surface mesh (i.e., its projection into the x-y-plane) and a pre-defined tile pattern allows the storage space to be reduced by storing an identifier to the pre-defined tile pattern which includes the topology information. This allows such identifiers to be used for a greater number of tiles.
  • data defining the portion of the three-dimensional terrain on the respective tile may be stored in the entry of the first data structure.
  • This data may include full DEM data for the respective tile.
  • This data may include one or plural triangulated irregular networks (TINs).
  • the data may include two TINs for defining the surface mesh for the tile for a coarse resolution level, and four additional TINs for defining the surface mesh for the tile for a finer resolution level. This allows a square tile to be subdivided into two triangles (coarse resolution level) or four triangles (finer resolution level), with a TIN being defined for each one of the triangles.
  • a height coordinate of at least one vertex located on the tile is to be stored in the first data structure in addition to the identifier for the pre-defined tile pattern. This allows the height coordinate to be selectively stored only when required, leading to a further reduction in storage space requirements.
  • Height coordinates of all vertices located on the tile may be stored in the entry in the first data structure if height coordinates of any pair of the vertices located on the tile differ from each other by more than a pre-determined threshold.
  • the threshold may be set equal to zero. I.e., the height coordinates of all vertices may be stored in the entry of the first data structure which corresponds to the tile, unless all vertices located on the tile have identical height. Thereby, a faithful representation of elevation data may be obtained.
  • At most one height shift value may be stored in the entry in the first data structure if height coordinates of all vertices located on the tile differ from each other by at most a pre-determined threshold.
  • the threshold may be set equal to zero. I.e., at most one height shift value may be stored for a tile if all vertices located on the tile have identical height. Thereby, storage space requirements may be further reduced.
  • One height shift value may be stored in the entry in the first data structure if the height coordinates of all vertices are different from a default height value.
  • No height shift value may be stored in the entry in the first data structure if the height coordinates of all vertices located on the tile are all equal to the default height value.
  • the default height value may be zero elevation. Thereby, no height coordinate at all needs to be stored for a tile representing flat terrain at sea level.
  • One height shift value, in combination with the identifier for the appropriate tile pattern, is sufficient to describe a tile representing flat terrain offset from sea level.
  • the entry in the first data structure may respectively be generated such that it includes a unique tile identifier for the respective tile.
  • the unique tile identifier may be such that, using the tile identifier, the coordinates of a characteristic point of the tile, such as its center or a corner, may be determined.
  • the identifier for a pre-defined tile pattern may be selected for storing in the first data structure if all vertices located on the tile are located on a boundary, in particular on corners, of the tile. Thereby, at least tiles which represent flat terrain may be represented using an identifier for a pre-defined tile pattern.
  • Each pre-defined tile pattern included in the second data structure may have a data format defined to correspond to the data format used for describing tiles in the first data structure when it is not possible to refer to a tile pattern.
  • each pre-defined tile pattern may respectively include lateral coordinates of a plurality of vertices and an array of indices describing triangular faces, with each of the triangular faces respectively having three of the vertices as corners.
  • the array of indices describing the faces may include pointers to entries in the array of vertices.
  • the pre-defined tile patterns in the second data structure may be user-defined. For illustration, only one pre-defined tile pattern which has vertices only on the corners of the tile may be pre-defined. Alternatively, one or several pre-defined tile patterns may be automatically generated by analyzing the surface mesh for plural different tiles. If a given topology of vertices occurs more than a pre-determined number of times, a corresponding tile pattern may be automatically defined and stored in the second data structure.
  • a database which represent a three-dimensional terrain.
  • the database includes a first data structure having a plurality of entries, each one of the entries including a unique tile identifier for a tile of a tiling, and a second data structure defining at least one pre-defined tile pattern.
  • Each one of the entries in the first data structure includes one of a pointer to a pre-defined tile pattern in the second data structure or data which directly describe the terrain in the respective tile.
  • the data which directly describe the terrain may include an array of 3-tuples of vertex coordinates for plural vertices.
  • the data which directly describe the terrain may further include an array of vertex indices defining plural triangular facets for the respective tile.
  • Each entry in the first data structure of the database may be associated with respectively one tile.
  • Each entry in the first data structure which includes a pointer to a pre-defined tile pattern may selectively include no height coordinate, one height coordinate or more than one height coordinate.
  • the respective entry in the first data structure may be such that it does not include any lateral coordinates of vertices of a surface mesh on the respective tile.
  • a navigation device has a database which represents a three-dimensional terrain and includes a first data structure and a second data structure.
  • the first data structure has a plurality of entries, each one of the entries including a unique tile identifier for a tile of a tiling.
  • the second data structure defines at least one pre-defined tile pattern.
  • the navigation device has a processing device coupled to the database. The processing device is configured to access an entry of the first data structure using the unique identifier for a tile and to determine whether the accessed entry includes a pattern identifier for a pre-defined tile pattern stored in the second data structure.
  • the processing device is configured to then selectively retrieve information on the pre-defined tile pattern from the second data structure if the entry includes the pattern identifier.
  • the processing device is configured to determine a height coordinate of one or plural locations based on the accessed entry of the first data structure and, if the entry includes the pattern identifier, based on the pre-defined tile pattern included in the second data structure.
  • an entry for a tile in the first data structure may selectively include one of a pointer to a tile pattern or data which directly describe the DEM on the respective tile. It is not required to store the full DEM data for each tile. For illustration, tiles which do not include any vertices of the surface mesh in their interior may respectively have an entry in the first data structure which includes a pointer to the second data structure. Storage space requirements may thereby be reduced.
  • the navigation device may include an optical output device.
  • the processing device may be configured to control the optical output device to display a portion of a DEM which is located on a given tile.
  • the processing device may control the optical output device using both data included in the entry in the first data structure for the respective tile and the definition of the tile pattern to which this entry points, if the entry in the first data structure includes an identifier for a pre-defined tile pattern.
  • the processing device may control the optical output device using only data included in the entry in the first data structure if the entry does not include an identifier for a pre-defined tile pattern.
  • Each entry in the first data structure which includes a pointer to a pre-defined tile pattern may selectively include no height coordinate, one height coordinate, or more than one height coordinate.
  • the processing device may be configured such that, if the entry includes a pattern identifier, it respectively determines a pair of lateral coordinates for plural vertices of a surface mesh based on the retrieved information on the pre-defined tile pattern, and that it determines a height coordinate of the vertices based on the entry of the first data structure.
  • the pre-defined tile pattern may be used to determine the vertex topology, while height information may be retrieved from the corresponding entry in the first data structure. Versatility is thereby enhanced.
  • the processing device may be configured to set height coordinates of the vertices of the surface mesh to the same value if the entry of the first data structure includes the pattern identifier and at most one height coordinate. Thus, for a flat tile, at most one height coordinate has to be stored in the entry in the first data structure.
  • the processing device may be configured to determine different height coordinates for the vertices if the entry of the first data structure includes the pattern identifier and a plurality of height coordinates.
  • Entries of the database which do not include an identifier for a pre-defined tile pattern may respectively include information on coordinate 3-tuples of vertices of a surface mesh. Such entries may further include an array of vertex indices which defines the triangular facets of the surface mesh.
  • the database may be a database generated using a method of generating a database of any one aspect or embodiment.
  • a method of determining height information in a navigation device has a database which includes a first data structure having a plurality of entries, each one of the entries including a unique tile identifier for a tile of a tiling, and a second data structure defining at least one pre-defined tile pattern.
  • a first data structure having a plurality of entries, each one of the entries including a unique tile identifier for a tile of a tiling, and a second data structure defining at least one pre-defined tile pattern.
  • an entry of the first data structure is accessed using the unique identifier for a tile. It is determined whether the entry includes a pattern identifier for a pre-defined tile pattern stored in the second data structure. If the entry includes the pattern identifier, information on the pre-defined tile pattern is retrieved from the second data structure. Height coordinate(s) of one or plural locations may be determined based on the accessed entry of the first data structure and, if the entry includes the pattern identifier, based on the pre-defined
  • pre-defined tile pattern(s) in the second data structure may be referenced by an entry for a tile in the first data structure. It is not required to store the full DEM data separately for each tile which includes an identifier for a pre-defined tile pattern. For illustration, tiles which do not include any vertices of the surface mesh in their interior may respectively have an entry in the first data structure which includes a pointer to the second data structure. Storage space requirements may thereby be reduced.
  • the pre-defined tile pattern in the second data structure may define a topology of vertices of a surface mesh.
  • the pre-defined tile pattern may include information on the relative lateral coordinates of vertices on the respective tile. If required, information on height coordinates of the vertices may be stored separately in each entry in the first data structure. For illustration, if the terrain in a tile is flat, but offset from a default height (such as sea level), one height coordinate may be stored in the respective entry in the first data structure for the respective tile. If the tile does not include any vertices in its interior, but the vertices at the corners are at different heights, four height coordinates may be stored in the respective entry in the first data structure.
  • the determined height coordinate(s) of one or more locations may be used for various purposes, such as visualization of three-dimensional terrain, computation of costs incurred upon traversal of a route, route search, or similar.
  • Fig. 1 schematically illustrates a navigation device 1 according to an embodiment.
  • the navigation device 1 comprises a processing device 2 controlling the operation of the navigation device 1.
  • the processing device 2 may comprise a central processing unit, for example in form of one or more microprocessors, digital signal processors or application-specific integrated circuits.
  • the processing device 2 may also include a graphics processor.
  • the navigation device 1 further includes a database 10 stored in a storage device 3.
  • the storage device 3 may comprise any one, or any combination, of various types of memory, such as random access memory, flash memory or a hard drive, but also removable memories such as a compact disk (CD), a DVD, a memory card or the like.
  • the navigation device 1 also includes an optical output device 4.
  • the navigation device 1 may include additional components, such as a position sensor and/or a wireless receiver and/or an input interface 5.
  • the storage device 3 stores a database 10 which defines a three-dimensional terrain.
  • the data in the database 10 may be used by the processing device 2 to generate three-dimensional maps, i.e., to visualize the terrain, to determine fuel consumption or other costs associated with routes, or similar.
  • the database 10 includes a first data structure and a second data structure.
  • the first data structure has a plurality of entries, each associated with one tile of the tiling.
  • Each entry in the first data structure has a unique tile identifier.
  • each entry in the first data structure either includes data which directly define the digital elevation model (DEM) in the respective tile or an identifier for a pre-defined tile pattern. If such an identifier for a pre-defined tile pattern is included, the information in the entry of the first data structure in isolation does not allow the surface to be reconstructed for the tile, unless combined with information in the second data structure.
  • the second data structure includes information on the pre-defined tile pattern(s) which are referenced by entries in the first data structure.
  • an entry in the first data structure includes data which directly describes the DEM in the respective tile
  • the entry may include an array of coordinate 3-tuples of vertices.
  • the entry may further include another array of indices for vertices, which defines triangular facets of a triangulated irregular network (TIN). More than one TIN may be defined for a tile. For illustration, two TINs may be used to define the terrain in a tile on a coarser resolution, and four TINs may be used to define the terrain in the tile on a finer resolution. All of this data may be included in the first data structure if it is not possible to define the topology of the surface mesh in the tile by referring to a pre-defined tile pattern.
  • TIN triangulated irregular network
  • an entry in the first data structure includes an identifier for a pre-defined tile pattern, it does not include any information on the topology of the surface mesh in the respective tile. I.e., the lateral position of one characteristic point of the tile (such as the center or a given corner) can be derived from the unique tile identifier. The lateral positions of vertices of the surface mesh may then be derived using the pre-defined tile pattern to which reference is made in the entry.
  • an entry in the first data structure includes an identifier for a pre-defined tile pattern, it may nevertheless include one or plural height coordinates.
  • the height coordinate(s) included in the first entry may be combined with the topology of the surface mesh defined by the pre-defined tile pattern which is referenced by the entry in the first data structure, in order to determine coordinate 3-tuples of all vertices located on the tile.
  • pre-defined tile patterns may be selected as appropriate for the contemplated application.
  • only one pre-defined tile pattern may be used which represents a tile which has vertices of the surface mesh at its corners, but which does not have vertices in the interior.
  • Such a pre-defined tile pattern describes the topology of the surface mesh on flat terrain.
  • Such a pre-defined tile pattern also describes the topology of the surface mesh for many tiles at coarser resolution levels.
  • many navigation device databases use a large number of resolution levels, such as ten or more resolution levels. At least in the coarsest level(s), the resolution is such that the terrain may be appropriately defined by vertices located on tile corners only.
  • pre-defined tile pattern While implementations using one pre-defined tile pattern will be illustrated in the following, a greater number of pre-defined tile patterns may be used in other implementations.
  • Fig. 2 is a schematic view of a database 10.
  • the database 10 may be used in the navigation device 1.
  • the database 10 represents a three-dimensional terrain. If it is desired to provide plural different resolution levels, data structures as explained in the following may be provided for each one of the resolution levels. Alternatively, separate first data structures 11 may be provided for plural different resolution levels, while one second data structure 12 may be used for plural different resolution levels.
  • the database 10 has a first data structure 11 and a second data structure 12.
  • a plurality of entries 13-18 are stored in the first data structure 11.
  • Each one of the entries 13-18 is respectively associated with one tile of a tiling.
  • the second data structure 12 includes data defining a pre-defined tile pattern.
  • the data in the second data structure 12 may have a data format which corresponds to that used for DEM data in entries of the first data structure, but with height information omitted.
  • Each one of the entries 13-18 includes a unique tile identifier.
  • the unique tile identifier indicated as Tile_ID_1, Tile_ID_2 etc. is such that it allows the x- and y- coordinates of one characteristic point of the tile (e.g., the center or a corner) to be determined.
  • a subset of entries 13, 15 and 18 in the first data structure respectively includes data which directly define the portion of the DEM on the respective tile.
  • Various data formats may be used.
  • the DEM data in entries 13, 15 and 18 may respectively define one or plural TINs.
  • the DEM data may include an array of 3-tuples of vertex coordinates and an array of vertex indices which defines which vertices of the vertex array respectively form a triangular facet of a surface mesh.
  • the DEM data may include additional information, such as an array of normal vectors for the triangular facets.
  • the respective entry 13, 15 or 18 is accessed.
  • the height of the one or more locations may be determined from the DEM data and independently of the second data structure 12.
  • entries 14, 16 and 17 in the first data structure respectively includes an identifier 19, indicated as "Pattern1", for a pre-defined tile pattern stored in the second data structure 12.
  • These entries 14, 16 and 17 do not include 3-tuples of vertex coordinates for the various vertices of the DEM.
  • the entries 14, 16 and 17 do not include information on the topology of the surface mesh within the respective tiles. I.e., no information on the x- and y- coordinates of vertices of the surface mesh relative to each other needs to be stored in the entries 14, 16 and 17.
  • Some of the entries which include an identifier 19 for a pre-defined tile pattern, such as entry 14, may not include any height coordinate. This indicates that all vertices of the surface mesh defined by the respective pre-defined tile pattern are located at a default height.
  • the default height may be sea level.
  • Some of the entries which include an identifier 19 for a pre-defined tile pattern, such as entry 16 may include only one height coordinate. This indicates that all vertices of the surface mesh defined by the respective pre-defined tile pattern are located at the same height which is offset from the default height. Thereby, flat terrain offset from the default height may be represented using one single height shift value only.
  • Some of the entries which include an identifier 19 for a pre-defined tile pattern, such as entry 17, may include more than one height coordinate.
  • One height coordinate for each vertex of the respective pre-defined tile pattern may be stored in the associated entry 17.
  • Such a data structure may be used when the vertices of the surface mesh defined by the respective pre-defined tile pattern are not all located at the same height on the respective tile. Thereby, non-flat terrain may be represented, provided the topology (i.e., relative x- and y-locations) of the vertices match one of the pre-defined tile patterns.
  • the second data structure 12 includes information on the pre-defined tile pattern. This information may be generally similar to the format in which DEM data are stored for entries 13, 15 and 18 in the first data structure. However, if the pre-defined tile pattern only includes information on the topology of the surface mesh, height information may be absent from the second data structure 12.
  • the second data structure 12 may include an array defining 2-tuples of lateral vertex coordinates for each pre-defined tile pattern. The lateral vertex coordinates are measured relative to the pre-defined location of the tile, such as tile center or one of the corners.
  • the second data structure 12 may further include an array of vertex indices defining which vertices form the triangular facets of a TIN. If the tile pattern corresponds to a pattern which only has vertices at the corners of the tile, the index array of vertex indices may define two triangular facets which, in combination, cover the whole tile.
  • the respective entry 14, 16 or 17 is accessed.
  • the corresponding data defining the tile pattern is retrieved from the second data structure 12.
  • the unique tile identifier the absolute x- and y-position of a characteristic point of the tile may be determined.
  • the x- and y-coordinates of all vertices of the surface mesh on the respective tile may be determined.
  • the height coordinates of the vertices may be determined.
  • the z-values for all vertices are set to default height (e.g., sea level). If the entry in the first data structure has one height coordinate, the z-values for all vertices are set to this value. If the entry in the first data structure has one height coordinate, the z-values for the various vertices are set to the various values included in the respective entry 17.
  • the sequence of height values in the entry 17 in the first data structure 11 may in this case correspond to the sequence in which vertices are listed in the vertex array in the second data structure 12.
  • the height information thus determined may be used for various purposes. For illustration, a three-dimensional visualization of the terrain may be generated. Costs, such as fuel consumption, associated with different routes may be computed, taking into account differences in elevation.
  • Fig. 3 is a plan view of a terrain.
  • a tiling 20 is superimposed onto the terrain.
  • the terrain includes regions which are flat, such as a lake or sea 21.
  • the terrain may include additional regions which are flat, such as a river 22.
  • the storage space may be reduced.
  • the topology of terrain which is flat within a tile may be defined by reference to the tile pattern.
  • data entries generated for tiles 23-25 in the first data structure may include an identifier for the pre-defined tile pattern which has vertices at its corners only. With the tiles 23-25 being located at sea level, it is not required to store any height coordinates in the respective entry of the first data structure.
  • a data entry for a tile 26 generated in the first data structure may include an identifier for the pre-defined tile pattern which has vertices at its corners only. If the tile 26 is located above or below sea level, one single height coordinate may be stored in the respective entry of the first data structure.
  • the technique of using one or more pre-defined tile pattern(s) may be used both when generating the database and when reconstructing terrain from the database.
  • Fig. 4 is a schematic perspective view for illustrating the reconstruction of terrain from the database, when the database is configured as described with reference to Figs. 1 and 2 .
  • the entries for each one of tiles 31-34 in the first data structure of the database may include a pointer to the tile pattern which has vertices only at the corners of the tile.
  • the absolute x- and y-coordinates of vertices 41-44 located on tile 31 may be determined by combining the position of a characteristic point of the tile 31, such as the centre, which is derivable from the unique tile identifier with the relative positions of vertices stored in the second data structure.
  • the z-coordinate of vertices 41-44 can again be determined based on the entry for tile 31 in the first data structure. If the entry does not have any z-coordinate, the elevation of all vertices 41-44 is set to default height.
  • the default height may be sea level.
  • the entry for tile 32 in the first data structure may not include any z-coordinate value.
  • the elevation of vertices 43-46 at the corners of tile 32 is set to default height, e.g. sea level.
  • the entry for tile 33 in the first data structure may include four z-coordinates.
  • the x- and y-coordinates of vertices 41, 42, 47 and 50 located on tile 33 may be determined by combining the position of a characteristic point of the tile 33, such as the centre, which is derivable from the unique tile identifier with the relative positions of vertices stored in the second data structure for the respective tile pattern.
  • the z-coordinates of vertices 41, 42, 47 and 50 are set to the values given in the entry for tile 33 in the first data structure. Thereby, a portion of a surface mesh which is not parallel to ground plane, but which does not have any vertices in the interior of the tile may also be represented.
  • the entry for tile 34 in the first data structure may include only one z-coordinate value.
  • the elevation of all vertices 47-50 at the corners of tile 34 is set to the z-coordinate value stored in the entry for tile 34 in the first data structure.
  • the surface mesh on the respective tile may thus be reconstructed by combining the topology defined by the pre-defined tile pattern with the height coordinates stored in the entry of the first data structure, if any.
  • entries in the first data structure may be generated.
  • the topology of the vertices of the surface mesh on the respective tile may respectively be compared to the pre-defined tile pattern(s).
  • the definition of the pre-defined tile pattern in the second data structure may include an index array defining triangular facets, such as facets 51 and 52.
  • a representation of the surface mesh on the various tiles may be obtained which corresponds to the data available for tiles for which the DEM data is directly stored in the first data structure.
  • Fig. 5 illustrates, in plan view, a tile having a center 54 and vertices 55-58 at its corners.
  • the first data structure 11 may be such that the location of the center 54, or of another characteristic point of the tile, is derivable from the unique tile identifier.
  • the second data structure includes lateral coordinates of the vertices 55-58, measured relative to the characteristic point. The absolute lateral (x- and y-) coordinates of the vertices may thus be determined, as described above.
  • Fig. 6 is a flow chart of a method 60 of generating a database.
  • the method 60 is performed by an electronic processing device, such as a computer.
  • the method 60 may be performed before the database is deployed to a navigation device.
  • the data may include a surface mesh.
  • the data may define one or plural TIN(s).
  • the TIN(s) may be defined on a tiling.
  • the data may for example be height values in a satellite image which are not yet in the form of a surface mesh.
  • one or plural TIN(s) may be determined so as to represent the three-dimensional terrain.
  • a corresponding tiling may also be defined.
  • a tile of a tiling is selected.
  • the method 60 may iterate through plural tiles of a tiling.
  • the tile selected at 62 may be a tile at a corner of the tiling in the first iteration.
  • the surface mesh of the TIN(s) on the respective tile is compared to one or plural pre-defined tile patterns.
  • the TIN(s) on the respective tile include plural vertices.
  • the relative lateral coordinates of the vertices of the TIN(s) on the respective tile may be determined.
  • the relative lateral coordinates of the vertices, which define the topology of the surface mesh on the respective tile may be compared to the one or plural pre-defined tile patterns. It is determined whether the topology of the vertices of the TIN(s) on the respective tile match one of the pre-defined tile pattern(s).
  • the vertex topology of the TIN(s) on the tile matches the pre-defined tile pattern only if there is no vertex in the interior of the tile, and all vertices are located at the corners of the tile.
  • DEM data describing the portion of the TIN(s) on the tile are stored in the entry in a first data structure of the database.
  • the DEM data may include a vertex array having coordinate 3-tuples of vertex coordinates for all vertices and an index array describing which ones of the vertices respectively form the various triangular facets.
  • the entry in the first data structure further includes a unique identifier for the respective tile.
  • an entry for the respective tile is generated in the first data structure.
  • the entry includes an identifier which points to the tile pattern which matches the vertex topology of the TIN(s) on the respective tile.
  • the entry does not include lateral coordinates for the various vertices.
  • the entry in the first data structure further includes a unique identifier for the respective tile.
  • the entry may be generated such that it includes no height coordinate if all vertices are located at default height.
  • the entry may be generated such that it includes one height coordinate if all vertices are located at the same height which is different from default height.
  • the entry may be generated such that it includes one height coordinate for each vertex if the vertices are not all located at the same height.
  • the first data structure and the second data structure are stored to thus generate the database.
  • Fig. 7 is a flow chart of a procedure 70 for further explaining the method of Fig. 6 .
  • the procedure of Fig. 7 may be used to implement steps 64-65 in the method of Fig. 6 if there is only one pre-defined tile pattern which has vertices only at the corners of the tile.
  • the method proceeds to 72.
  • an entry is generated for the tile which includes a unique tile identifier and data defining one or plural TIN(s).
  • the TIN(s) may include one or plural vertex arrays and an index array which defines the various triangular facets.
  • the method 60 may then continue at 66.
  • the procedure proceeds to 73.
  • an entry is generated for the tile which includes a unique tile identifier and an identifier for the pre-defined tile pattern.
  • the procedure proceeds to 75.
  • height coordinates of all vertices located on the tile are stored in the entry in the first data structure.
  • the procedure proceeds to 76.
  • 76 it is determined whether the height coordinates of all vertices correspond to a default value.
  • the default value may be sea level.
  • the procedure proceeds to 77.
  • one height value which corresponds to the (identical) height coordinate of all vertices is stored in the entry in the first data structure. The method 60 may then continue at 66.
  • the procedure proceeds to 78.
  • the entry for the respective tile is left unmodified, i.e., no height coordinate at all is written into the entry.
  • the method 60 may then continue at 66.
  • tile pattern which has vertices only at the corners of the tile has been illustrated in some embodiments, a greater number of tile patterns may be used.
  • the tile pattern(s) may define various topologies for the vertices of the surface mesh on the respective tile.
  • Fig. 8 illustrates a tile pattern 80 having another exemplary topology.
  • the pre-defined tile patterns may have topologies in which a square tile is bi-sected into two triangles. Each one of the resulting triangles may again be bi-sected in a symmetric manner, where required to accommodate elevation changes in the terrain surface.
  • the pre-defined tile patterns may respectively be selected from a set of topologies in which a tile is entirely covered by rectangular isosceles triangles only, which in combination cover the square tile.
  • pre-defined tile patterns were described which describe the topology of the surface mesh only, it is also possible to use pre-defined tile patterns which include some height information.
  • Embodiments of the invention may be used for generating databases for use in navigation devices. Such databases may be used, for example, for visualizing three-dimensional terrain via an optical output device of a navigation device, for route search or other driver assistance applications, without being limited thereto.

Landscapes

  • Engineering & Computer Science (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Instructional Devices (AREA)
  • Processing Or Creating Images (AREA)
  • Navigation (AREA)
  • Image Generation (AREA)
EP11164312.8A 2011-04-29 2011-04-29 Procédé de génération d'une base de données, dispositif de navigation et procédé permettant de déterminer les informations de hauteur Active EP2518443B1 (fr)

Priority Applications (7)

Application Number Priority Date Filing Date Title
EP11164312.8A EP2518443B1 (fr) 2011-04-29 2011-04-29 Procédé de génération d'une base de données, dispositif de navigation et procédé permettant de déterminer les informations de hauteur
CA2773419A CA2773419C (fr) 2011-04-29 2012-04-02 Methode de creation d'une base de donnees pour dispositif de navigation et methode permettant de determiner la hauteur
JP2012097082A JP6001310B2 (ja) 2011-04-29 2012-04-20 データベースを生成する方法、ナビゲーション装置、及び、高さ情報を定める方法
BR102012009838-5A BR102012009838B1 (pt) 2011-04-29 2012-04-26 Método para gerar um banco de dados, dispositivo de navegação e método para determinar informações de altura
US13/458,378 US9557181B2 (en) 2011-04-29 2012-04-27 System for determining height information
KR1020120044237A KR101925088B1 (ko) 2011-04-29 2012-04-27 데이터베이스 생성 방법, 네비게이션 장치, 및 높이 정보 판정 방법
CN201210132297.8A CN102779148B (zh) 2011-04-29 2012-04-28 产生数据库的方法、导航装置和确定高度信息的方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP11164312.8A EP2518443B1 (fr) 2011-04-29 2011-04-29 Procédé de génération d'une base de données, dispositif de navigation et procédé permettant de déterminer les informations de hauteur

Publications (2)

Publication Number Publication Date
EP2518443A1 true EP2518443A1 (fr) 2012-10-31
EP2518443B1 EP2518443B1 (fr) 2016-06-08

Family

ID=44597037

Family Applications (1)

Application Number Title Priority Date Filing Date
EP11164312.8A Active EP2518443B1 (fr) 2011-04-29 2011-04-29 Procédé de génération d'une base de données, dispositif de navigation et procédé permettant de déterminer les informations de hauteur

Country Status (7)

Country Link
US (1) US9557181B2 (fr)
EP (1) EP2518443B1 (fr)
JP (1) JP6001310B2 (fr)
KR (1) KR101925088B1 (fr)
CN (1) CN102779148B (fr)
BR (1) BR102012009838B1 (fr)
CA (1) CA2773419C (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109804419A (zh) * 2016-11-04 2019-05-24 奥迪股份公司 用于运行半自主或自主的机动车的方法和机动车

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9418478B2 (en) 2012-06-05 2016-08-16 Apple Inc. Methods and apparatus for building a three-dimensional model from multiple data sets
US10140638B2 (en) * 2012-12-06 2018-11-27 International Business Machines Corporation Providing information technology resiliency in a cloud-based services marketplace
US9279777B2 (en) * 2013-08-06 2016-03-08 International Business Machines Corporation Analyzing strain distribution in semiconductor structures using nano-beam diffraction
US9922002B2 (en) * 2014-04-28 2018-03-20 Palo Alto Research Center Incorporated Efficient representations of graphs with multiple edge types
US20150356088A1 (en) * 2014-06-06 2015-12-10 Microsoft Corporation Tile-based geocoder
CN105466445B (zh) * 2016-01-05 2018-03-13 武汉大学 一种基于地形语义的路径规划方法
US10395408B1 (en) * 2016-10-14 2019-08-27 Gopro, Inc. Systems and methods for rendering vector shapes
CN114993316B (zh) * 2022-05-24 2024-05-31 清华大学深圳国际研究生院 一种基于平面拟合的地面机器人自主导航方法及机器人

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030142523A1 (en) * 2002-01-25 2003-07-31 Zoltan Biacs Method and system for storage and fast retrieval of digital terrain model elevations for use in positioning systems
EP1435507A2 (fr) * 2002-12-31 2004-07-07 Robert Bosch Gmbh Système et procédé hiérarchique pour chargement de données sur demande dans un système de navigation
US20060109267A1 (en) * 2004-11-23 2006-05-25 Metavr Three-dimensional visualization architecture
US20100194606A1 (en) * 2006-12-05 2010-08-05 Dirk Otte Method for operating a driver information system, driver information system and data carrier

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4179693A (en) * 1977-05-23 1979-12-18 Rockwell Internation Corporation Autonomous, check-pointing, navigational system for an airborne vehicle
US6577714B1 (en) * 1996-03-11 2003-06-10 At&T Corp. Map-based directory system
US5781146A (en) * 1996-03-11 1998-07-14 Imaging Accessories, Inc. Automatic horizontal and vertical scanning radar with terrain display
US6239808B1 (en) * 1998-04-03 2001-05-29 Nvidia Corporation Method and apparatus for determining texture values of graphical images
EP1034818A1 (fr) * 1999-03-05 2000-09-13 Andrea Dr. Talkenberg Dispositif de navigation pour le golf
US7640098B2 (en) * 2001-07-31 2009-12-29 Stenbock & Everson, Inc. Process for generating travel plans on the internet
KR100450631B1 (ko) * 2001-11-07 2004-09-30 학교법인 인하학원 보간법을 이용한 격자형 디이엠 생성방법
WO2003063979A2 (fr) * 2002-01-27 2003-08-07 Geshwind David M Procédés, pièces et plateaux pour jeux schématisant des processus écologiques concurrents mais sans combat, y compris jeux de stratégie et d'occupation de territoire en plusieurs phases utilisant des pièces de taille croissante sur grilles géométriques
US6978260B2 (en) * 2002-04-23 2005-12-20 Hewlett-Packard Development Company, L.P. System and method for storing data
US20050064567A1 (en) 2003-09-23 2005-03-24 Jiunn-Jyi Lay Anaerobic hydrogen-producing process
US7328403B2 (en) * 2003-10-22 2008-02-05 Intel Corporation Device for structured data transformation
US8115765B2 (en) * 2004-05-26 2012-02-14 Sony Online Entertainment Llc Rule-based procedural terrain generation
US8368686B2 (en) * 2004-05-26 2013-02-05 Sony Online Entertainment Llc Resource management for rule-based procedural terrain generation
KR100662507B1 (ko) * 2004-11-26 2006-12-28 한국전자통신연구원 다목적 지리정보 데이터 저장 방법
US7728837B2 (en) * 2006-03-06 2010-06-01 Microsoft Corporation Angular animation of a physical model
KR20070099298A (ko) * 2006-04-04 2007-10-09 (주)아너스베이 모바일 내비게이션용 3차원 형상정보 생성방법 및 장치
EP1879001B1 (fr) 2006-07-10 2016-04-27 Harman Becker Automotive Systems GmbH Description du format pour une base de données de navigation
EP1944702B1 (fr) 2007-01-10 2018-07-25 Harman Becker Automotive Systems GmbH Base de données de navigation adaptée à être mise à jour
US8788128B1 (en) * 2008-08-01 2014-07-22 Rockwell Collins, Inc. Precision navigation for landing
US20100082564A1 (en) * 2008-10-01 2010-04-01 Navteq North America, Llc Spatial Index for Locating Geographic Data Parcels Stored on Physical Storage Media
US8884955B1 (en) * 2012-05-04 2014-11-11 Google Inc. Surface simplification based on offset tiles

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030142523A1 (en) * 2002-01-25 2003-07-31 Zoltan Biacs Method and system for storage and fast retrieval of digital terrain model elevations for use in positioning systems
EP1435507A2 (fr) * 2002-12-31 2004-07-07 Robert Bosch Gmbh Système et procédé hiérarchique pour chargement de données sur demande dans un système de navigation
US20060109267A1 (en) * 2004-11-23 2006-05-25 Metavr Three-dimensional visualization architecture
US20100194606A1 (en) * 2006-12-05 2010-08-05 Dirk Otte Method for operating a driver information system, driver information system and data carrier

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109804419A (zh) * 2016-11-04 2019-05-24 奥迪股份公司 用于运行半自主或自主的机动车的方法和机动车

Also Published As

Publication number Publication date
US9557181B2 (en) 2017-01-31
CN102779148A (zh) 2012-11-14
CN102779148B (zh) 2017-11-21
BR102012009838A8 (pt) 2018-01-02
KR101925088B1 (ko) 2019-02-27
KR20120122939A (ko) 2012-11-07
US20120274632A1 (en) 2012-11-01
CA2773419A1 (fr) 2012-10-29
EP2518443B1 (fr) 2016-06-08
BR102012009838B1 (pt) 2020-02-11
JP2012234534A (ja) 2012-11-29
JP6001310B2 (ja) 2016-10-05
CA2773419C (fr) 2015-08-04
BR102012009838A2 (pt) 2018-01-02

Similar Documents

Publication Publication Date Title
EP2518443B1 (fr) Procédé de génération d'une base de données, dispositif de navigation et procédé permettant de déterminer les informations de hauteur
CA2771549C (fr) Dispositif de navigation, methode de determination de la hauteur d'une coordonnee et methode de generation de base de donnees
US9574897B2 (en) Method of generating a database for a navigation device, method of outputting a three-dimensional map, and navigation device
JP5950673B2 (ja) ナビゲーション装置用データベース、地形の三次元表示を出力する方法、およびデータベースを生成する方法
EP2565583B1 (fr) Dispositif de navigation, procédé de génération de carte et procédé de génération d'une base de données
KR20050085926A (ko) 모바일 네비게이션 유닛을 위한 진보된 3ｄ 시각화를 위한시스템 및 방법
EP2589933B1 (fr) Dispositif de navigation, procédé pour prédire la visibilité d'une face triangulaire dans une vue de carte électronique
US9196088B2 (en) System and method for classification of three-dimensional models in a virtual environment
CN102779165A (zh) 栅格地图图片库的建立方法
US20090051702A1 (en) Process and apparatus for generating map data in real time
CA2769363C (fr) Dispositif de navigation, methode de production d'une structure de toiture tridimensionnelle et methode de production d'une base de donnees
Liu et al. A Unified Indexing Strategy for the Mixed Data of a Future Marine GIS
CN110276835A (zh) 用于高效建筑覆盖区确定的方法和设备

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17P Request for examination filed

Effective date: 20130430

17Q First examination report despatched

Effective date: 20130715

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20150626

INTG Intention to grant announced

Effective date: 20151215

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 805566

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160715

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602011027212

Country of ref document: DE

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160608

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160908

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 805566

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160608

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160909

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161008

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161010

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602011027212

Country of ref document: DE

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20170309

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170429

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170430

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170430

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170429

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170429

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20110429

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160608

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160608

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20200319

Year of fee payment: 10

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210430

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230526

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240320

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240320

Year of fee payment: 14