EP4551904A1 - Map item cluster control - Google Patents
Map item cluster controlInfo
- Publication number
- EP4551904A1 EP4551904A1 EP23736514.3A EP23736514A EP4551904A1 EP 4551904 A1 EP4551904 A1 EP 4551904A1 EP 23736514 A EP23736514 A EP 23736514A EP 4551904 A1 EP4551904 A1 EP 4551904A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- map
- item
- items
- cluster
- poi
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3679—Retrieval, searching and output of POI information, e.g. hotels, restaurants, shops, filling stations, parking facilities
- G01C21/3682—Retrieval, searching and output of POI information, e.g. hotels, restaurants, shops, filling stations, parking facilities output of POI information on a road map
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3667—Display of a road map
- G01C21/367—Details, e.g. road map scale, orientation, zooming, illumination, level of detail, scrolling of road map or positioning of current position marker
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
- G06F16/287—Visualization; Browsing
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
Definitions
- a moving map display is a type of navigation system output that, instead of numerically displaying the current geographical coordinates determined by the navigation unit or a heading and distance indication of a certain waypoint, displays the unit's current location near a center of a map.
- the moving map moves to keep the unit's position near the center of the display.
- a symbol such as an icon representing the location of a navigation device carried in a vehicle remains stationary on the display screen while a map or chart image moves beneath the symbol.
- the display thus portrays the physical movement of the vehicle on the displayed map or chart.
- the portrayal typically shows a simulated two-dimensional (2D) overhead view of the vehicle location on the moving map, but some devices also simulate a three-dimensional (3D) view from the perspective of the device.
- Some moving map display systems also provide a method of displaying an elevation of the vehicle above sea level or the earth's surface.
- a moving map may be rotated in a heading-up, track-up or north-up fashion.
- the moving map In a heading-up orientation, the moving map is rotated such that the aircraft heading angle is located at the top of a display.
- the moving map In a track-up orientation the moving map is rotated such that the aircraft track compass angle is located at the top of the display.
- map elements above the center position of the map are in front of the aircraft, while map elements below the center position of the map are behind the aircraft.
- map elements could be in any orientation depending on the heading of the aircraft relative to north.
- map elements exhibit a flow of movement from in front of the aircraft to behind the aircraft, which could be oriented in any possible rotation angle depending on the heading of the aircraft.
- the machine readable instructions include a map control module that receives a stream of map data characterizing a geographic region proximal to a vehicle and outputs a moving map based on the stream of map data on a display.
- the moving map is confined by a boundary of the display corresponding to a portion of the geographic region that changes as a function of time.
- the moving map is divisible into a matrix of cells.
- the machine readable instructions also include a map item control that receives a stream of point of interest (POI) data characterizing a plurality of POIs within the boundary and categorizes each of the plurality of POIs to define a set of categories.
- the map item control determines a display location of a map item within the matrix of cells for each of the plurality of POIs and determines an importance for each POI within a same category.
- the map item control forms a set of clusters of map items. Each map item in a given cluster of map items of the set of clusters of map items has a same cell and a same category. Also, the map item control selects a top-item for each cluster of map items having the same category.
- the top- item of each respective cluster of map items corresponds to a POI of the plurality of POIs within the corresponding cluster of map items with a greatest importance.
- the map item control overlays the set of clusters of map items on the moving map.
- a display location of each cluster of map items in the set of clusters of map items is based on a display location of the top-item of the respective cluster of map items.
- the map control module outputs a moving map based on the map data on a display.
- the moving map is confined by a boundary of the display corresponding to a portion of the geographic region that changes as a function of time.
- the moving map is divisible into a matrix of cells.
- the machine readable instructions also include a map item control that receives POI data characterizing a plurality of POIs within the boundary and categorizes each of the plurality of POIs to define a set of categories.
- the map item control also determines a display location of a map item within the matrix of cells for each of the plurality of POIs and determines an importance for each POI of the plurality of POIs within a same category.
- the map item control forms a set of clusters of map items.
- Each map item in a given cluster of map items of the set of clusters of map items has a same cell and a same category.
- the map item control selects a top-item for each cluster of map items.
- the top-item of each respective cluster of map items corresponds to a POI of the plurality of POIs within the corresponding cluster of map items with a greatest importance.
- the map item control overlays a first set of map items for the set of clusters of map items on the moving map.
- a display location of each map item in the first set of map items is based on a display location of the top-item of each respective cluster of map items, and each map item in the first set of map items includes a cluster tag indicating a number of hidden-items of a respective cluster of map items of the set of clusters of map items.
- the map item control overlays a second set of map items on the moving map. Each map item in the second set of map items represents a single POI of the plurality of POIs.
- Yet another example relates to a method of clustering map items on a display. The method includes receiving, by a map control module operating on a computing platform, a stream of map data characterizing a geographic region proximal to a vehicle.
- the method also includes outputting, by the map control module, a moving map, based on the map data on a display.
- the moving map is confined by a boundary of the display corresponding to a portion of the geographic region that changes as a function of time.
- the moving map is divisible into a matrix of cells.
- the method includes receiving, by a map item control operating on the computing platform, a stream of POI data characterizing a plurality of POIs within the boundary and categorizing, by the map item control, each of the plurality of POIs to define a set of categories.
- the method further includes determining, by the map item control, an importance for each of the plurality of POIs within a same category.
- the method yet further includes forming, by the map item control, a set of clusters of map items.
- Each map item in a given cluster of map items of the set of clusters of map items has a same cell and a same category.
- the method includes selecting, by the map item control, a top-item for each respective cluster of map items that corresponds to a POI of the plurality of POIs within the corresponding cluster of map items with a greatest importance.
- the method also includes overlaying, by the map item control, a first set of map items for the set of clusters of map items on the moving map.
- a display location of each map item in the first set of map items is based on a display location of the top-item of each respective cluster of map items, and each map item in the first set of map items includes a cluster tag indicating a number of hidden-items of a respective cluster of map items of the set of clusters of map items.
- the method further includes overlaying, by the map item control, a second set of map items on the moving map, wherein each map item in the second set of map items represents a single POI of the plurality of POIs.
- FIG.2 illustrates a screenshot of an example of a moving map output on a display of a vehicle.
- FIG.3 illustrates a moving map with a boundary and map items.
- FIG.4 illustrates a portion of a moving map.
- FIG.5 illustrates a moving map wherein clusters of map items representing points of interest (POIs) have been formed.
- FIG.6A illustrates a portion of a moving map in a first stage of an animation that includes a cluster of map items.
- FIG.6B illustrates the portion of the moving map in a second stage of the animation.
- FIG.6C illustrates the portion of the moving map in a third stage of the animation.
- FIG.7 illustrates a portion of a moving map wherein a map item, representing a new or changing map item, is to be added to the moving map.
- FIG.8 illustrates a flowchart of an example method for outputting a moving map and for controlling map items on the moving map.
- FIG.9 illustrates a flowchart of an example method for updating a map- item output on a moving map.
- FIG.10 illustrates a flowchart of an example method showing a logical flow for evaluating whether or not a screen cell can potentially bind a candidate map- item in a moving map.
- FIG.11 illustrates a flowchart of an example method showing a logical flow for computing the strength at which a particular screen cell may bind a candidate map-item.
- FIG.12 illustrates a flowchart of an example method showing the logical flow for evaluating the update or addition of a map-item into a cluster.
- DETAILED DESCRIPTION [0022] This description relates to systems and methods for clustering map items (e.g., icons and descriptors) that represent points of interest (POIs) on a moving map.
- the system can be implemented in a vehicle, such as an aircraft or a terrestrial vehicle, and the moving map assists with navigation.
- the moving map is oriented in a heading-up or track-up fashion, and map items flow from the top of a display downward to a bottom of the display if the vehicle is in motion.
- map elements can be in any orientation depending on the heading of the aircraft relative to north.
- the POIs on the moving map may be non-stationary (other aircraft, moving vehicles, etc.) and flow in any direction within screen space (alternatively referred to as screen real estate).
- Screen space defines the medium where presentation of overlapping data, including icons creates visual ambiguity.
- icons on the moving map, and descriptors corresponding to the icons that are in close geographical proximity may or may-not be visually overlapping.
- the system executes clustering within the screen space of the moving map presented to the operator of the vehicle (e.g., a pilot) rather than in geographical space. To execute this clustering, the screen space is subdivided into a matrix of cells. For computational efficiency, the matrix dimensions are constant (unchanging) because these dimensions correspond to an unchanging physical screen space.
- the system can accommodate a re-sizing of the moving map by changing the cell size, but such re-sizing is a relatively infrequent operation.
- screen space is fixed by the physical dimensions of the display installed in the vehicle, and the content on the moving map is fluidly moving through and within that screen space.
- This screen matrix is decomposed into cells that each have the same size.
- cells are rectangular having a width and height tuned a size to enable iconography to not significantly overlap.
- Any particular screen cell may contain nothing, a single icon (and corresponding description) representing a single POI, or a single top-item for a cluster of map items (or more simply, a cluster). If a cell contains an icon representing a top-item of a cluster, the item will have a cluster tag (e.g., indicia) indicating an ordinal number of hidden-items corresponding to POIs within the cluster that are the same category.
- cluster tag e.g., indicia
- Clustering map items on the moving map curtails visual overlap of map items (e.g., icons and descriptors) to improve readability of the moving map. More particularly, clustering allows proximal map items on the moving map that represent POIs of the same category to be collapsed into clusters when the map items would otherwise visually overlap in screen space. When a cluster of a particular category is formed, one or more POIs corresponding to the cluster will have a greatest importance. If multiple items have the same importance tie breaking is executed whereby the first POI to arrive in the cluster is selected is presumed to have the greatest importance.
- map items e.g., icons and descriptors
- the map item for the greatest importance POI within a cluster is referred to as the top-item of the cluster.
- a map-item can include an icon and a description (e.g., a text label).
- the top-item retains the corresponding icon and label and is associated with a cluster tag (indicia) indicating an ordinal number of the number of hidden-items within the cluster.
- a map-item containing this cluster tag is recognizable as a top-item, and the cluster tag advertises the number of additional hidden-items that are not visible but reside conceptually below the top-item in screen space.
- FIG.1 illustrates an example of a map system 100 for a vehicle 102, such as an aircraft or a terrestrial vehicle.
- the map system 100 can include a map server 104 that can generate output for a display 108.
- the map server 104 is implemented with a computing platform.
- the display 108 is an output only display.
- the display 108 is an interactive display, such as a touch screen.
- the display 108 can output, for example, a moving map for a navigation display.
- the output of the display 108 represents a two- dimensional (2D) map.
- the output of the display 108 represents a three-dimensional (3D) map.
- the map server 104 is coupled to a network 112 via a utility network interface 116 (e.g., a communication link).
- the network 112 can be representative of a secure communication channel.
- R number of data sources 120 communicate on the network 112, where R is an integer greater than or equal to one.
- Each of the R number of data sources 120 can represent an external (e.g., offboard) source of data, such as another vehicle (e.g., another aircraft, such as a wingman, surveillance aircraft, etc.), a ground station, a server (e.g., a computing platform), a satellite, etc.
- the R number of data sources 120 provide data, such as real-time data characterizing an environment of operation of the vehicle 102.
- the map server 104 provides similar data to the R number of data sources 120, or some subset thereof.
- the vehicle 102 includes G number of sensors 124 installed thereon to detect features of the environment of operation.
- the G number of sensors 124 are employable to observe, detect, and track various POIs in an area of interest (e.g., a battlespace) of the vehicle 102.
- the G number of sensors 124 can represent, for example, a receiver for a global navigation satellite system (GNSS), such as the global positioning system (GPS), the GLONASS system, the BeiDou Navigation Satellite System or the Galileo system.
- GNSS global navigation satellite system
- GPS global positioning system
- GLONASS global positioning system
- BeiDou Navigation Satellite System BeiDou Navigation Satellite System
- Galileo system Galileo system
- the G number of sensors 124 includes a camera, a radar system, an infrared sensor, a temperature sensor, a proximity sensor, etc. In fact, nearly any sensor that is employable to observe, to detect and/or track POIs in the area of interest of the vehicle 102 is employable in the G number of sensors 124.
- the G number of sensors 124 communicate with the map server 104 through a sensor interface 128, such as a data bus.
- the map server 104 can include memory 132 that stores machine readable instructions.
- the memory 132 can be implemented as a non-transitory machine readable medium.
- the memory 132 could be volatile memory (e.g., random access memory), non-volatile memory (e.g., a hard drive, a solid state drive, flash memory, etc.) or a combination thereof.
- the map server 104 can include a processing unit 136 (e.g., one or more processor cores) that accesses the memory 132 and executes the machine readable instructions.
- the memory 132 can store application software for controlling operations of the vehicle 102.
- the memory 132 can store application software for processing data and controlling the output of the display 108.
- the map server 104 is representative of one computing platform that is present on the vehicle 102.
- the map server 104 includes a map control module 140 that controls the display 108.
- the map control module 140 is configured to process a stream of map data provided from the R number of data sources 120 and/or the G number of sensors 124 (or some subset thereof) to generate a map that is output on the display 108. More particularly, one or more of the R number of data sources 120 can represent a geographical map of a region of the earth (or multiple regions of the earth).
- the G number of sensors 124 represent either active or passive sensors for observing the area of interest of the vehicle (e.g., the battlespace).
- active sensors would include lidar and radar.
- passive sensors would be infrared (IR), and anti-radiation homing (ARH), and electronic warfare support measures (ESM) type sensors.
- IR infrared
- ARH anti-radiation homing
- EMM electronic warfare support measures
- physical sensors may be offboard (not mounted on the vehicle 102) and provide information about the POIs through the network 112 (e.g., a data link). These off-board sensors are thus represented as one or more of the R number of data sources 120.
- the map output on the display 108 can be a moving map, such as a two- dimensional (2D) overhead view moving map (alternatively referred to as a god's eye view map), such as a topological map.
- the moving map output on the display 108 can represent a first person perspective three-dimensional (3D) map.
- FIG.2 illustrates a screenshot 200 of an example of a moving map output on display of a vehicle, such as the display 108 of FIG.1.
- the screenshot 200 represents a geographical region proximal to the vehicle.
- the moving map will be updated (e.g., in real-time) as the vehicle moves.
- the screenshot 200 includes a boundary 204 circumscribing the screenshot 200 of the moving map.
- the memory 132 also includes a map item control 144.
- the map item control 144 represents a software module that can overlay items on the moving map output on the display 108. More particularly, the map item control 144 communicates with the map control module 140 to add map items representing points of interest (POIs) onto the moving map with a boundary that defines the limits of the moving map (e.g., the boundary 204 of FIG.1).
- POIs points of interest
- the map item control 144 determines a display location for each map item corresponding to each respective POI.
- the map item control 144 monitors a stream of POI data from the R number of data sources 120 and/or the data from the sensors 124 (or some subset thereof) to identify POIs that are to be represented as map items on the moving map. For each such POI, the map item control 144 determines a category (e.g., flavor) of the respective POI. There is an unlimited number of categories, and the type of categories depends on the type of vehicle 102 employed.
- the categories of POIs can be, for example, sorties, such as other aircraft, drones, tanks, surface to air missile systems, transport vehicles, radar vehicles, infantry troops, etc.
- the POIs could be, for example, drop points, buildings, airports, etc.
- the categories of POIs can be, for example, other vehicles, restaurants, coffee shops, gas stations, retail stores, etc.
- the lists of categories are not meant to be exhaustive, and in other examples, more ore less categories are included.
- the category of each POI can be dynamic based on the stream of POI data provided by one or more of the data sources 120 and/or one or more of the sensors 124. For example, consider a situation where the vehicle 102 is a fighter jet traversing enemy territory. In this situation, a given POI that is determined to initially be a transport vehicle may activate a radar system, and the radar is detected by one of the sensors 124 or one of the data sources 120. Accordingly, the category for the given POI changes from a transport vehicle to a radar vehicle. [0036] The map item control 144 also determines a display location within the moving map for map items corresponding each POI.
- the map item control 144 divides the moving map in to a 2D matrix of cells, and each POI is situated in a corresponding cell. More generally, the map control module 140 and the map item control 144 are configured to operate in concert to output the moving map on the display 108, and screen space of the moving map is divided into a regular matrix of cells each of which has the same width and height. This matrix is fixed in screen space coordinates of the display 108 and does not change (or rarely changes) for computational efficiency. Each cell of the matrix represents a bin for evaluation of potential clustering. If two or more map items are the same category and are within the same cell, those map items are evaluated by the map item control 144 for potential clustering.
- FIG.3 illustrates a moving map 300 with a boundary 304 that corresponds to the boundary 204 of FIG.2.
- geographic information e.g., topology
- the moving map 300 includes map items 306 that include icons and corresponding descriptors representing different POIs labeled, "Item A" --Item F".
- the descriptors could, for example, have text identifying a category of the POI.
- the moving map 300 is divided into a matrix of cells 308 (only one of which is labeled). Each cell 308 represents a sub-region of a region represented by the moving map 300. Each cell 308 has corners that correspond to relative locations on a display (e.g., the display 108 of FIG.1).
- the moving map 300 also includes a vehicle icon 312 proximal to a center of the moving map 300 that represents a location of the vehicle relative to other features on the moving map 300.
- map items 306 representing the POIs move.
- map items 306 representing POIs that are in close proximity begin to overlap. This overlapping can obfuscate the POIs.
- a hostile target e.g., an enemy base
- the obfuscation gets worse, and can make the moving map 300 virtually unreadable. It is understood that the POIs represented by the map items 306 may or may not be close in terms of geographic proximity.
- the map items 306 can be significantly separated by altitude or range (depending on the scale of the moving map 300).
- the proximity addressed herein is related to screen location proximity, which may or may not be related to geographic proximity.
- the map item control 144 includes a cluster control module 148.
- the cluster control module 148 can cluster map items that are the same category and are in the same cell.
- the cluster control module 148 assigns an importance to each POI.
- the importance of each POI is based on an importance of the respective POI relative to the vehicle 102.
- the importance can be dynamic. For instance, as noted, the vehicle 102 can be a fighter jet.
- the vehicle 102 may be traversing hostile territory, and some of the POIs represent enemy combatants. In this situation, enemy combatants that are actively engaging the vehicle 102 would be given a greater importance than enemy combatants that are not actively engaging the vehicle 102. For instance, suppose that the vehicle 102 is traversing enemy territory, a first POI represents a first tank and a second POI represents a second tank and a third POI represents a third tank. Additionally, suppose that the first tank has a turret aimed away from the vehicle 102 and the second tank has a turret aimed toward the vehicle 102 and the third tank is firing a projectile toward the vehicle 102.
- the third tank would have the greatest importance
- the second tank would have the second greatest importance
- the first tank would have the lowest importance.
- airports could be assigned a numerical importance value equal to their longest runway length, or number of runways, or number of terminals, or even an inverse importance equal to the landing queue wait time. Whatever the desired external ranking scheme, a numerical importance value is applied to each airport. When a cluster is formed, the numerical importance values are examined to determine which item has the greatest importance.
- selection can be performed to choose either the oldest item to enter the cluster, or the newest item to enter the cluster.
- one POI in a cluster is ultimately chosen as the greatest importance and is then selected for visual presentation to the operator (e.g., pilot) as a top-item for the respective cluster.
- the actions of the POIs can change the importance dynamically. Continuing with the example of the three tanks, suppose that a sensor 124 or a data source 120 detects that the second tank moves its turret in a direction away from the vehicle and the first tank moves it turret toward the vehicle 102. In this situation, the first tank and the second tank would switch importances.
- the cluster control module 148 clusters map items for POIs of the same category and the same cell based on an importance of the POIs. For each category of POI, the cluster control module 148 selects the map item corresponding to the POI with the greatest importance as a top-item for a cluster of map items of the same category that are within a snap distance.
- the snap distance is a predetermined pixel distance on the display 108. In some examples, the snap distance is a circle with a diameter that is about equal to a leg of a cell (e.g., a length of one leg of the cell 308 of FIG.3).
- FIG.4 illustrates a portion of a moving map 400 (e.g., a portion of the moving map 300 of FIG.3).
- FIGS.3 and 4 employ the same reference numbers to denote the same structures.
- FIG.4 there are three map items 306, labeled "Item D", "Item C" and "Item E”. It is presumed that POIs corresponding to Item D, Item C and Item E have been assigned to the same category. Additionally, it is presumed that Item D has a greater importance than Item C and Item E. [0043] Item E and Item C are within a snap distance 404 of the map item 306 representing Item D.
- the snap distance 404 is a circle with a diameter equal to a leg 406 of a cell 308.
- a cluster control module e.g., the cluster control module 148 of FIG.1
- the cluster 408 is to be overlaid on a moving map (e.g., the moving map 300 of FIG.3) as a single map item (e.g., a top- item), a descriptor 410 ("Item D") that identifies a category (e.g., tank 4) of the corresponding POI.
- the map items 306 are for Item E and Item C are "greyed out" to indicate that these map items 306 are hidden from view (referred to as hidden-items).
- the cluster 408 includes a cluster tag 412 (e.g., indicia) that identifies a number of hidden-items corresponding to POIs within the cluster.
- the cluster tag 412 is a '2' indicating that there are two hidden-items corresponding to POIs of the same category, namely Item E and Item C within the cluster 408.
- Item E and Item C remain within the cluster 408, even if Item D changes cells and Item E and Item C reside in different cells (potentially).
- FIG.5 illustrates a moving map 500 wherein clusters of map items representing POIs have been formed.
- FIGS.3 and 5 employ the same reference numbers to denote the same structures.
- FIG.5 illustrates a moving map 500 with the boundary 304 that corresponds to the boundary 204 of FIG.2.
- the moving map 500 includes the map items 306 and corresponding descriptors that represent a single POI.
- the moving map 500 also includes a first cluster 508 and a second cluster 512.
- the first cluster 508 and the second cluster 512 are represented with a top-item 306, a corresponding descriptor 516 and an associated cluster tag 520 (e.g., indicia).
- the descriptor 516 identifies the POI with the greatest importance in the corresponding cluster, namely, "Item D" in the first cluster 508 and "Item B" in the second cluster 512.
- the cluster tag 520 identifies an ordinal number of hidden- items for POIs that are represented by the first cluster 508 and the second cluster 512, respectively.
- the moving map 500 of FIG.5 is simpler and easier for a reader to process.
- Conventional algorithms for implementing clustering are computationally expensive.
- Conventional clustering solutions require computations that grow exponentially with the number of items.
- Such strategies involve spatial analysis of distances between each screen item and a statistical identification of clumps (clusters) of overlapping items.
- On a conventional moving map presented to an aircraft pilot not only are the map contents visually flowing past the pilot as the vehicle is in motion, items themselves may be in motion causing clusters to form and break apart.
- clustering of map items in the manner illustrated in FIG.5 provides a fluid environment without becoming computationally overwhelming.
- the top-item is selected (Item D and Item B) and the icon for the top-item (with a location already selected on the display) for the cluster is selected to represent the entire cluster.
- the display location of each cluster of map items is simply the display location of the top- item in the cluster of map items.
- the cluster tag 520 is employable to quickly indicate to a viewer that a particular map item is a cluster.
- map items 306 without a cluster tag 520 are quickly recognized to be representative of a single POI. Accordingly, the moving map 500 provides a computationally inexpensive and visually appealing manner to represent clusters of map items 306.
- an operator e.g., a pilot or driver
- the map control module 140 can output user controls (e.g., virtual buttons) that if actuated, toggle clustering of map items on and off.
- an individual cluster of map items can be selected (e.g., by touching and/or employing a virtual pointer), and the hidden items of a particular cluster of map items can be revealed.
- the map item control 144 is configured to continuously monitor the status of the vehicle 102, the R number of data sources 120 and the G number of sensors 124 to update the moving map. In particular, as the vehicle and/or POIs represented as map items on the moving map change locations, the moving map is updated. In some situations, such movement can cause clusters of map items to break.
- FIGS.6A, 6B and 6C illustrate an animation of a cluster being broken. The animation can be output on a moving map, such as the moving map 500.
- FIG.6A illustrates a portion of a moving map 600 in a first stage of the animation that includes a cluster 604.
- the cluster 604 includes a top-item 608 (Item D) and a cluster tag 610 with a value of '2', indicating that the cluster 604 has two hidden- items, namely a first hidden-item 612 and a second hidden-item 616 (Item C, and Item E, respectively).
- the top-item 608 includes an arrow 618 indicating a direction of travel of the top-item 608.
- the map item 612 (Item C) and the map item 616 are "greyed out” in FIG.6A, but would be invisible in an output representing the moving map 600.
- the cluster 604 includes a snap distance 620 that defines a boundary of the cluster 604. Additionally, as is illustrated, the cluster 604 with the snap distance 620 crosses the boundary between a first cell 624 and a second cell 628.
- FIG.6B illustrates the portion of the moving map 600 in a second stage. In FIG.6B, the second hidden-item 616 moves in a direction indicated by an arrow 630 relative to the top-item 608. However, a point of the second hidden-item 616 is still within the snap distance 620 of the cluster 604.
- FIG.6C illustrates the portion of the moving map 600 in a third stage.
- the second hidden-item 616 moves outside of the snap distance 620 of the cluster 604. Accordingly, the second hidden-item 616 is converted into a displayed solo map item 616 (representing a single POI), and the cluster tag 610 is decremented by one to reflect the change.
- the operations provided by the map item control 144 avoids the cluster breaking apart unnecessarily to avoid unneeded distractions on the moving map.
- a conventional approach employing na ⁇ ve machine learning techniques would show a cluster breaking apart the moment a top-item moves into a new cell different from the cell that a subordinate hidden-item resides in.
- a conventional na ⁇ ve approach would show a cluster breaking apart the moment a hidden-item moves into a new cell different from the cell which the superior top-item resides. Accordingly, the conventional approach would have a visual discontinuity.
- this visual discontinuity is avoided by the map item control 144, because hidden-items of are bound to the (visible) top-item of a cluster even in situations where the hidden-items and the top-item are spatially located in different cells of the moving map.
- the approach employed by the map control module 140 avoids the visual problems of clusters constantly breaking and reforming as top-items and hidden-items flow across cell boundaries that is common in the conventional approach.
- the binding a hidden-item to the top-item of a cluster is executed by leveraging a snap distance (e.g., the snap distance 620 of FIGS.6A-6C) of spatial distance within the display 108.
- a snap distance e.g., the snap distance 620 of FIGS.6A-6C
- the binding of the subordinate hidden-item to the corresponding top- item is broken.
- the hidden-item can then be re-evaluated with regards to a presentation of the hidden-item within screen space, allowing the hidden- item to become a solo-item if the map item now resides singularly within a particular cell, or join to a new cluster as either a hidden-item or top-item.
- the map item control 144 continuously monitors the R number of data sources 120 and/or the sensors 124 for new and/or changing (e.g., category changing) map items. New and category changing map items are treated in the same manner. Responsive to detecting a new or changing map item, the map control module 140 determines an importance and a screen location for the new or changing map item.
- the cluster control module 148 considers the new or changing map item for clustering. More particularly, the cluster control module 148 determines if the new or changing map item is to be added to a cluster. Additionally, the cluster control module 148 determines if the display location (or other feature) of the cluster should change based on an importance of the new or changing map item.
- FIG.7 illustrates a portion of a moving map 700, such as a portion of the moving map 500 of FIG.5, wherein a map item 704 (representing a new or changing map item) that is labeled Item G and the map item 704 is to be added to the moving map 700.
- map item 708 (labeled Item A), a second map item 712 (labeled Item B), a third map item 716 (labeled Item C), a fourth map item 720 (labeled Item D), a fifth map item 724 (labeled Item E) and a sixth map item 728 (labeled Item F).
- Each map item also includes a snap distance 732.
- a map item control calculates a binding strength 736 between the map item 704 and the first map item 708, the second map item 712, the third map item 716, the fourth map item 720, the fifth map item 724 and the sixth map item 728.
- the binding strength is set to 0.0 for each map item that has a distance between the map item 704 greater than the snap distance 732.
- the binding strength 736 between the map item 704 and the first map item 708, the third map item 716, the fifth map item 724 and the sixth map item 728 is set to 0.0.
- the map item control assigns a positive binding strength 736 between the map item 704 and the second map item 712 and the fourth map item 720 because the map item 704 is within the snap distance 732 of the second map item 712 and the fourth map item 720.
- the binding strength 736 is inversely proportional to the distance between the map item 704 and other map items. That is, the shorter the distance between the map item 704 and the other map items, such as the second map item 712 and the fourth map item 720, the greater the binding strength 736.
- the map item 704 (Item G) has a larger binding strength 736 (0.621) for the fourth map item 720 (Item D) than the binding strength 736 (0.565) for the second map item 712 (Item B).
- a cluster that includes the fourth map item 720 and the map item 704 is formed with the fourth map item 720 being the top-item and the map item 704 being a hidden-item.
- a cluster is formed with the map item 704 and the fourth map item 720 with the map item 704 being the top-item and the map item 720 being a hidden-item.
- FIG.8 illustrates a flowchart of an example method 800 for outputting a moving map and for controlling map items on the moving map.
- the method 800 can be executed by a computing platform, such as the map server 104 of FIG.1.
- a map control module e.g., the map control module 140 of FIG.1 of the map server receives a stream of map data characterizing a geographic region proximal to a vehicle (e.g., the vehicle 102 of FIG.1).
- the stream of map data can be provided from external data sources (e.g., the R number of data sources 120 of FIG.1) and/or sensors on the vehicle (e.g., the G number of sensors 124 of FIG.1).
- a moving map is output on a display (e.g., the display 108 of FIG.1).
- the moving map can be, for example similar to the moving map depicted in the screenshot 200.
- the moving map can be a 2D map (e.g., an overhead view) or a 3D map (e.g., a first person perspective).
- the moving map is confined by a boundary of the display corresponding to a portion of the geographic region that changes as a function of time, and the moving map is divisible into a matrix of cells.
- a map item control e.g., the map item control 144 of the map server
- the map item control categorizes each of the POIs to define a set of categories.
- the map item control determines an importance of each POI within the same category that is positioned within the same cell of the moving map.
- the map item control forms a set of clusters of map items, wherein a given cluster of the set of clusters represents POIs that are in a same cell and a same category, wherein each cluster includes a plurality of POIs.
- the map item control selects a top-item for each cluster of the set of clusters. The top-item of each respective cluster of map items corresponds to a POI of the plurality of POIs within the corresponding cluster of map items with a greatest importance.
- FIG.9 illustrates a flowchart of an example method 900 for updating a map-item output on a moving map.
- the method 900 can be executed by a computing platform, such as the map server 104 of FIG.1.
- the method 900 begins, and at 915, a map control module (e.g., the map control module 140 of FIG.1) of the map server initiates an item update.
- a determination is made by the map control module as to whether the map-item has changed flavor (e.g., category). If the determination at 915 is positive (e.g., YES), the method 900 proceeds to 925. If the determination at 915 is negative (e.g. NO) the method 900 proceeds to 930.
- the map-item is purged from the map, and the method 900 proceeds to 930.
- a determination is made by the map control module as to whether the screen location of the map-item is outside the bounds of a screen matrix (e.g., a matrix of cells). If the determination at 930 is positive (e.g., YES), the method 900 proceeds to 935. If the determination at 930 is negative (e.g., NO), the method 900 proceeds to 940.
- the map-item is purged from the map, and the method 900 proceeds to 945, where the map-item update is completed, and the method 900 ends.
- the best target cell may be a logical target cell, or a neighbor cell if this new map-item is of lesser importance to some neighboring item and is logically bound to the neighbor cell.
- a determination is made by the map control module as to whether the existing cell (EC) for the map-item is a target cell (TC). If the determination at 955 is positive (e.g., YES), the method 900 proceeds to 960. If the determination at 955 is negative (e.g., NO), the method 900 proceeds to 965. At 960, the map-item is updated in the existing cell, and the method 900 proceeds to 945.
- the map-item is removed from the existing cell and the map-item is updated in the target cell, and the method 900 proceeds to 945. More specifically, because the map-item is a solo-item the existing cell contains only that item, such that the solo-item is migrated to the target cell. [0072]
- a determination is made by the map control module as to whether the map-item is a top-item in the existing cell. If the determination at 980 is positive (e.g., YES), the method 900 proceeds to 985. If the determination at 970 is negative (e.g., NO), the method 900 proceeds to 990.
- map-items in the existing cell are moved from the existing cell to the target cell, and the target cell is updated, even in conditions where the items in the existing cell do not belong to the target cell, and the method 900 proceeds to 945.
- the map-item is removed from the existing cell and added to the target cell, and the map-item is updated in the target cell, and the method 900 proceeds to 945. More specifically, the map-item being updated is an existing hidden-item whose existing cell is different than the target cell, and the map- item is not bound to the existing cell, such that the map-item is migrated to the target cell.
- FIG.10 illustrates a flowchart of an example method 1000 showing a logical flow for evaluating whether or not a screen cell (e.g., of a matrix of cells) can potentially bind a candidate map-item in a moving map.
- the method 1000 can be executed by a computing platform, such as the map server 104 of FIG.1.
- the method 1000 begins.
- a map control module e.g., the map control module 140 of FIG.1 of the map server determines if the cell has zero (0) items. If the determination at 1015 is positive (e.g., YES), the method 1000 proceeds to 1020. If the determination at 1015 is negative (e.g., NO), the method 1000 proceeds to 1025.
- the cell does not bind the candidate map-item.
- the map control module determines if the candidate map-item (CI) is a top item. If the determination at 1025 is positive (e.g., YES), the method 1000 proceeds to 1020. If the determination at 1025 is negative (e.g., NO), the method 1000 proceeds to 1030. At 1030, the screen distance between the top-item and the candidate map-item is computed, and the method proceeds to 1035. [0076] At 1035, the map control module determines if the computed distance meets or exceeds a snap limit. If the determination at 1035 is positive (e.g., YES), the method 1000 proceeds to 1020.
- FIG.11 illustrates a flowchart of an example method 1100 showing a logical flow for computing the strength at which a particular screen cell (e.g., of a matrix of cells) may bind a candidate map-item.
- the binding strength is analogous to a gravitational pull the cell has on a candidate map-item.
- the method 1100 can be executed by a computing platform, such as the map server 104 of FIG.1.
- the method 1100 begins. [0078] At 1115, a map control module (e.g., the map control module 140 of FIG.1) of the map server determines if the cell has zero (0) items. If the determination at 1115 is positive (e.g., YES), the method 1100 proceeds to 1120. If the determination at 1115 is negative (e.g., NO), the method 1100 proceeds to 1125. At 1120, binding strength is set to zero (0). [0079] At 1125, the map control module computes the screen distance between the top-item and the candidate map-item, and the method proceeds to 1130. At 1130, the map control module determines if the computed distance meets or exceeds a snap limit.
- a map control module e.g., the map control module 140 of FIG.1 of the map server determines if the cell has zero (0) items. If the determination at 1115 is positive (e.g., YES), the method 1100 proceeds to 1120. If the determination at 1115 is negative (e
- the method 1100 proceeds to 1120. If the determination at 1130 is negative (e.g., NO), the method 1100 proceeds to 1135. [0080] At 1135, the map control module determines if the computed distance is zero (0). If the determination at 1135 is positive (e.g., YES), the method 1100 proceeds to 1140. If the determination at 1135 is negative (e.g., NO), the method 1100 proceeds to 1145. At 1140, the binding strength is set to infinity (or some arbitrary large number).
- the cell has infinite binding strength.
- the map control module determines if the importance of the candidate map-item (CI) is less than the importance of the top item. If the determination at 1145 is positive (e.g., YES), the method 1100 proceeds to 1150. If the determination at 1145 is negative (e.g., NO), the method 1100 proceeds to 1160. At 1150, the binding strength is set to the reciprocal of the computed distance (e.g., 1/distance).
- the candidate map-item is of lesser or equal importance than the top-item, and therefore the cell has a binding strength equal to the reciprocal (alternatively referred to as the inverse) of the distance.
- the binding strength is set to the negative reciprocal of the computed distance (e.g., -1/distance).
- FIG.12 illustrates a flowchart of an example method 1200 showing the logical flow for evaluating the update or addition of a map-item into a cluster. This logic flow works even in situations where the cluster is a placeholder containing zero (0) items.
- the method 1200 can be executed by a computing platform, such as the map server 104 of FIG.1.
- the method 1200 begins.
- a map control module e.g., the map control module 140 of FIG.1 of the map server determines if the cluster has a flavor different from the flavor of the candidate map-item. If the determination at 1205 is positive (e.g., YES), the method 1200 proceeds to 1210. If the determination at 1205 is negative (e.g., NO), the method 1200 proceeds to 1215. At 1210, the addition of the candidate map-item is rejected for the cluster. [0085] At 1215, the map control module determines if the cluster has zero (0) items.
- the method 1200 proceeds to 1220. If the determination at 1215 is negative (e.g., NO), the method 1200 proceeds to 1225. At 1220, the candidate map-item is added to the cluster as a solo item. [0086] At 1225, the map control module determines if the candidate map-item (CI) has an importance less than a current top-item of the cluster. If the determination at 1225 is positive (e.g., YES), the method 1200 proceeds to 1230. If the determination at 1225 is negative (e.g., NO), the method 1200 proceeds to 1235. At 1230, the top- item in the cluster is recomputed.
- the map control module determines if the candidate map-item (CI) is a last accessed item and the candidate map-item has an importance greater than a current top-item of the cluster. If the determination at 1235 is positive (e.g., YES), the method 1200 proceeds to 1240. If the determination at 1235 is negative (e.g., NO), the method 1200 proceeds to 1245. At 1240, the candidate map-item is updated as the new top-item of the cluster.
- the map control module determines if the candidate map-item (CI) is an existing item (EI) in a cluster and the candidate map-item has an importance greater than a current top-item of the cluster. If the determination at 1235 is positive (e.g., YES), the method 1200 proceeds to 1240. If the determination at 1245 is negative (e.g., NO), the method 1200 proceeds to 1250. [0089] At 1250, the map control module determines if the candidate map-item (CI) is a new item and the candidate map-item has an importance greater than a current top-item of the cluster. If the determination at 1250 is positive (e.g., YES), the method 1200 proceeds to 1255.
- the method 1200 proceeds to 1260.
- the candidate map-item is added to the cluster as a new top-item.
- the candidate map-item is added to the cluster as a new hidden-item, such that the top-item in the cluster does not change.
- the term “includes” means includes but not limited to, the term “including” means including but not limited to.
- the term “based on” means based at least in part on. Additionally, where the disclosure or claims recite “a,” “an,” “a first,” or “another” element, or the equivalent thereof, it should be interpreted to include one or more than one such element, neither requiring nor excluding two or more such elements.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Remote Sensing (AREA)
- Databases & Information Systems (AREA)
- Radar, Positioning & Navigation (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Automation & Control Theory (AREA)
- Human Computer Interaction (AREA)
- Navigation (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US17/858,237 US12038951B2 (en) | 2022-07-06 | 2022-07-06 | Map item cluster control |
| PCT/US2023/024451 WO2024010657A1 (en) | 2022-07-06 | 2023-06-05 | Map item cluster control |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4551904A1 true EP4551904A1 (en) | 2025-05-14 |
Family
ID=87070807
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP23736514.3A Pending EP4551904A1 (en) | 2022-07-06 | 2023-06-05 | Map item cluster control |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US12038951B2 (en) |
| EP (1) | EP4551904A1 (en) |
| CA (1) | CA3247552A1 (en) |
| WO (1) | WO2024010657A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20240119068A1 (en) * | 2022-09-27 | 2024-04-11 | Incucomm, Inc. | System and method for real-time data categorization |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7373244B2 (en) * | 2004-04-20 | 2008-05-13 | Keith Kreft | Information mapping approaches |
| JP2008292511A (en) * | 2005-09-02 | 2008-12-04 | Panasonic Corp | Navigation device |
| DE602006004000D1 (en) * | 2006-03-28 | 2009-01-15 | Harman Becker Automotive Sys | Storage and interest-related view in a navigation system |
| US8671355B2 (en) | 2007-10-05 | 2014-03-11 | Mapquest, Inc. | Methods and systems for decluttering icons representing points of interest on a map |
| JP4625512B2 (en) * | 2008-04-28 | 2011-02-02 | クラリオン株式会社 | Facility search device and facility search method |
| EP2503289B1 (en) | 2011-03-22 | 2016-06-22 | Harman Becker Automotive Systems GmbH | Management of icons for digital maps |
| US20140005860A1 (en) * | 2012-06-28 | 2014-01-02 | Marion Chance | Wirelessly Controlled Vehicle Message System |
| US10073896B2 (en) | 2015-03-13 | 2018-09-11 | Thinkware Corporation | System and method for providing nearby search service using POI clustering scheme |
| US10025978B2 (en) | 2015-09-15 | 2018-07-17 | Adobe Systems Incorporated | Assigning of topical icons to documents to improve file navigation |
| US9927951B2 (en) | 2015-12-21 | 2018-03-27 | Sap Se | Method and system for clustering icons on a map |
| US20170357414A1 (en) | 2016-06-12 | 2017-12-14 | Apple Inc. | Map Application with Novel Search, Browsing and Planning Tools |
| EP4451197A3 (en) | 2017-04-27 | 2024-11-13 | Snap Inc. | Map-based graphical user interface indicating geospatial activity metrics |
| US11511627B2 (en) * | 2017-11-17 | 2022-11-29 | Aisin Corporation | Display device and computer program |
| US11169658B2 (en) | 2019-12-31 | 2021-11-09 | Snap Inc. | Combined map icon with action indicator |
| JP7578419B2 (en) | 2020-05-13 | 2024-11-06 | トヨタ自動車株式会社 | Information processing device, display system, display control method, and program |
-
2022
- 2022-07-06 US US17/858,237 patent/US12038951B2/en active Active
-
2023
- 2023-06-05 EP EP23736514.3A patent/EP4551904A1/en active Pending
- 2023-06-05 CA CA3247552A patent/CA3247552A1/en active Pending
- 2023-06-05 WO PCT/US2023/024451 patent/WO2024010657A1/en not_active Ceased
Also Published As
| Publication number | Publication date |
|---|---|
| WO2024010657A1 (en) | 2024-01-11 |
| CA3247552A1 (en) | 2024-01-11 |
| US12038951B2 (en) | 2024-07-16 |
| US20240095263A1 (en) | 2024-03-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10540902B2 (en) | Flight planning and communication | |
| EP2431960B1 (en) | Ground navigational display, system and method displaying buildings in three-dimensions | |
| EP2390629B1 (en) | Displaying obstacles in perspective view | |
| EP2587222B1 (en) | System for displaying images with multi-resolution integration | |
| US9293051B2 (en) | Methods and systems for displaying a vertical profile for an aircraft procedure with nonuniform scaling | |
| US20060005147A1 (en) | Methods and systems for controlling the display of maps aboard an aircraft | |
| US20140074395A1 (en) | Method of displaying points of interest and related portable electronic device | |
| EP2584318B1 (en) | System and method for dynamically rendering bounded region labels on a moving map display | |
| US9842567B2 (en) | Electronic chart display device and method of displaying information relating to electronic chart | |
| EP1959239A1 (en) | Target zone display system and method | |
| JP2812639B2 (en) | Route search system and route search method | |
| US9163944B2 (en) | System and method for displaying three dimensional views of points of interest | |
| US12304648B2 (en) | System and method for separating avionics charts into a plurality of display panels | |
| US20100066566A1 (en) | Apparatus and method of displaying an aircraft's position | |
| US20130300587A1 (en) | System and method for displaying runway approach texture objects | |
| EP3628977B1 (en) | Systems and methods for associating critical flight reference data with a flight path vector symbol | |
| US11112249B1 (en) | Systems and methods for four-dimensional routing around concave polygon avoidances | |
| US10304242B1 (en) | Transparent display terrain representation systems and methods | |
| US12038951B2 (en) | Map item cluster control | |
| EP2927639B1 (en) | Avionics system and method for displaying optimised ownship position on a navigation display | |
| US10490091B1 (en) | Systems and methods for avoidance traversal analysis for flight-plan routing | |
| US20090322753A1 (en) | Method of automatically selecting degree of zoom when switching from one map to another | |
| EP2776786B1 (en) | Method and system for determining a relation between a first scene and a second scene | |
| US10706821B2 (en) | Mission monitoring system | |
| CN113671982A (en) | Visual leading system applied to indoor outburst combat of unmanned aerial vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20241022 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| P01 | Opt-out of the competence of the unified patent court (upc) registered |
Free format text: CASE NUMBER: APP_22972/2025 Effective date: 20250514 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| 17Q | First examination report despatched |
Effective date: 20250922 |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |