EP3362992A1 - Rule based completion of maps with partial data - Google Patents

Rule based completion of maps with partial data

Info

Publication number
EP3362992A1
EP3362992A1 EP16855596.9A EP16855596A EP3362992A1 EP 3362992 A1 EP3362992 A1 EP 3362992A1 EP 16855596 A EP16855596 A EP 16855596A EP 3362992 A1 EP3362992 A1 EP 3362992A1
Authority
EP
European Patent Office
Prior art keywords
map
layout
building
rule set
complete
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP16855596.9A
Other languages
German (de)
French (fr)
Other versions
EP3362992A4 (en
Inventor
Jason R. Wither
Jasvinder Singh
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of EP3362992A1 publication Critical patent/EP3362992A1/en
Publication of EP3362992A4 publication Critical patent/EP3362992A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/05Geographic models
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/10Geometric CAD
    • G06F30/13Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B29/00Maps; Plans; Charts; Diagrams, e.g. route diagram
    • G09B29/10Map spot or coordinate position indicators; Map reading aids
    • G09B29/106Map spot or coordinate position indicators; Map reading aids using electronic means
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/38Electronic maps specially adapted for navigation; Updating thereof
    • G01C21/3804Creation or updating of map data
    • G01C21/3807Creation or updating of map data characterised by the type of data
    • G01C21/383Indoor data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00Details relating to CAD techniques
    • G06F2111/04Constraint-based CAD
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00Details relating to CAD techniques
    • G06F2111/08Probabilistic or stochastic CAD
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20076Probabilistic image processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20112Image segmentation details
    • G06T2207/20128Atlas-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30236Traffic on road, railway or crossing

Definitions

  • aspects of exemplary embodiments relate to generating a map of a layout of a building or other geographic location from partial map data.
  • a map defining a complete layout of locations within a geographic location There are a variety of situations in which there is a desire to create a map defining a complete layout of locations within a geographic location.
  • One such application is determining an indoor layout within a building.
  • a method of generating a map indicating a layout of an arrangement of areas within a building comprising obtaining a partially complete map of a layout of a region of interest and generating a map including at least some unknown portions of the layout of the building, wherein the map is based on utilizing the rule set and the partially complete map and the map preserves the layout information of the partially complete map.
  • Figure 1 illustrates a method to use a rule set to complete a partial map in accordance with an embodiment.
  • Figure 2 illustrates a method to utilize a rule and set to complete a partial map using cost functions in accordance with an embodiment.
  • Figure 3A illustrates an example of a map of a mall.
  • Figure 3B illustrates an example of rules describing geometrical constraints in a mall in accordance with an embodiment.
  • Figure 3C illustrates an example of additional rules for a mall in accordance with an embodiment.
  • Figure 3D illustrates an example of a method to determine a most likely layout of a mall in accordance with an embodiment.
  • Figure 4A illustrates an example of a map of a hospital.
  • Figure 4B illustrates an example of a rule set for a mall in accordance with an embodiment.
  • Figure 5A illustrates an example of hypothesis testing to determine a room layout based on a scoring technique in accordance with an embodiment.
  • Figure 5B illustrates an example of a room rule set in accordance with the example of Figure 5A.
  • Figure 6 illustrates how incremental updates in a partial map generate changes to the complete map in accordance with an embodiment.
  • Figure 7 illustrates how a confidence in different regions of the maps of Figure 6 changes with incremental updates in accordance with an embodiment.
  • Figure 8 illustrates method of generating a rule set in accordance with an embodiment.
  • FIG. 9 illustrates an apparatus in accordance with an embodiment.
  • An apparatus and method is disclosed to generate a more complete map of a layout of a building based on partial map data.
  • the more complete map is determined in a region of interest based on determining a most likely map in a region of interest that is consistent with, and preserves, the partial map data.
  • a rule set is used to generate the map, where the rule set may include at least one probabilistic rule. Examples of a rule set include rules for geometrical constraints describing spatial relationships and semantic rules not based strictly on spatial relationships.
  • a cost function is used to determine the most likely layout based on partially complete map information and the rule set.
  • the partial map information may be generated based on crowd sourced trajectory data obtained from mobile devices. Map information may also be provided to mobile devices.
  • a method of generating a map indicating a layout of an arrangement of areas within a building comprising obtaining a partially complete map of a layout of a region of interest and generating a map including at least some unknown portions of the layout of the building, wherein the map is based on utilizing the rule set and the partially complete map and the map preserves the layout information of the partially complete map.
  • a method of generating a map indicating a layout of an arrangement of areas within a building comprising identifying a partial layout of the building based on a plurality of trajectories representing movement of at least one mobile device within the building, selecting a rule set describing constraints on the arrangement of areas within the building, the rule set including at least one probabilistic rule describing spatial relationships of a plurality of different areas of the building, and determining a complete layout in a region of interest based on utilizing the rule set to determine a most likely complete layout consistent with the partial layout.
  • the rule set further comprises non-probabilistic rules describing geometrical constraints of the building.
  • the method of generating the map indicating the layout of the arrangement of areas within the building further comprises determining a building type from a plurality of building types and the selecting a rule set includes selecting a rule set specific to the building type.
  • the rule set incudes for a particular building type, at least one geometrical constraint rule describing geometrical constraints of a size of plurality of different area types and probabilistic relationships between the plurality of different area types.
  • the rule set further comprises a point of interest rule based on point of interest information identifying an attribute of at least one area of the building.
  • the point of interest rule defines a probability of a size of the at least one area of the building.
  • the point of interest rule define a probability of an attribute of an area proximate to the point of interest.
  • a method of providing location services for the interior of a building comprising obtaining a partially complete map of an interior of a building via crowd sourced information representing the movement of at least one mobile device user in the interior of the building, selecting a rule set describing at least one probabilistic constraint on the arrangement of areas within the building, and generating a map of at least some unknown portions of the interior of the building based on utilizing the rule set and the partially complete map.
  • the map preserves the information of the partially complete map.
  • the method of providing location services for the interior of a building comprises providing visualization data to display the map.
  • a method comprising providing map information of a layout in a region of interest of a building.
  • the map information is generated from partially complete map layout information by utilizing at least one probabilistic rule to determine a most likely layout of the region of interest that preserves the partially complete map layout information.
  • Figure 1 is a flow chart illustrating an embodiment of a computer implemented method of using a set of rules to complete a partially completed map of a building in a region of interest.
  • a partial map 105 is obtained of a layout of an arrangement of areas, such as a layout of the interior of a building.
  • the partial map may include at least some exterior spaces.
  • the partial map 105 is generated or otherwise provided based on trajectory (e.g., trace) data crowd sourced from one or more mobile devices and corresponds to regions traversed by mobile device users.
  • the trajectory data may be based on sensor data from sensors disposed on individual mobile devices.
  • individual mobile devices may include sensors, such as accelerometers, to determine position based on user movement.
  • individual mobile devices may include position sensors to determine position based on global positioning signals (if available) and any other available local wireless network signals such as Bluetooth or wireless LAN.
  • the partial map 105 may be based on instances of trajectory data. From the trajectory data, the layout of frequently trafficked areas may be identified from a pattern analysis, such as locations of main hallways. Additionally, there may be sufficient instances of trajectory data to identify other layout features based on pattern matching, such as room entrances. For example, trajectory data of one or more instances showing a mobile device moving off from a hallway may indicate a room or store entrance. However, there may be insufficient trajectory data in one or more portions of a building from which to generate a partial layout. Thus, the partial map is incomplete in at least one portion of a region of interest.
  • a rule set is selected 110 to aid in completing the partial map.
  • the set of rules of the rule set permits hypothesis testing of different options for extending or completing the layout of the map in a region of interest.
  • a selection is made of a current best hypothesis consistent with the rule set and the known partial map 105.
  • the rule set may include some deterministic rules and also includes at least one probabilistic rule.
  • the rules of the rule set are used as terms in a cost function analysis.
  • the completion of the map may be for a desired geographic location, such as an entire interior of a building. However, more generally the map may be completed in a desired region of interest. Moreover, in some circumstances extending the partially complete map into at least on unknown region may be sufficient. For example, in a mall the desired region of interest may be the public areas of the mall and thus not include private offices in the mall. As another example, in some cases the desired region may be a subset of an entire geographic location, such as a wing of a mall. Additionally, in some embodiments the map may be completed only in regions for which there is a minimum confidence that the map that is generated is accurate to within some desired statistical confidence or accuracy. For example, if there is partial map data for only one wing of a mall, the map may be completed only in the portion of the mall for which there is sufficient partial data to generate a complete map with a desire minimum level of confidence.
  • the rules include a set of probabilistic geometrical constraints reflecting likely relationships between different areas of a layout, where an individual area is a unit of space.
  • a unit of space may be a room type, office unit, store unit, hallway, corridor, etc.
  • Individual areas may be further classified into area types, such as based on size (e.g., larger area, medium area, small area) or function (e.g., food store, non-food store, etc.).
  • the probabilistic aspects of the geometrical constraints describe probable spatial arrangements in a layout.
  • there are often likely spatial relationships based on economic considerations, aesthetics, design and construction efficiency, and human behavior.
  • mall design has evolved slowly over many decades.
  • many mall designs have a set of design attributes from which probabilistic rules can be constructed.
  • a probability that a neighboring room will have a certain size may be used in analyzing a hypothesis that in a layout the neighboring room is of a particular size.
  • geometric constraints may include size constraints of individual units of space, reflecting probable sizes and size variances, probabilities of interior or exterior hallways and hallway sizes, and probabilities that certain types of units of space (e.g., certain types or rooms or store) neighbor each other.
  • crowd sourced information may include names of individual regions within a geographic location. For example, names of individual stores or a total number of stores may be available. As examples, the name of a store may be obtained from a store Wi-Fi access point, from a crowd sourced picture taken on a mobile device, from someone checking into a social media site and posting information describing a location, or by requesting users of mobile devices to provide feedback.
  • point of interest (POI) information may be available from public sources (e.g., websites), or information beacons (e.g., wireless points of individual stores in a mall). As examples, information may be available on overall building footprint, points of interest in the building (e.g., a name of a store in a mall), and total number of stores. This semantic information may also include the type of building and year built.
  • the most likely complete map is determined 115 in a regions of interest based on the rule set and the partial map, where the most likely complete map has a layout of space consistent with the partial map information. That is, a complete map is generated which is an extension of the partial map 105. Thus, the complete map is consistent with and preserves the known information of the partial map 105. Thus, for example, if the partially complete map has information indicating a known hallway and a known set of room entrances, the complete map will preserve the known hallway information and the known set of room entrances. The complete map this provides additional information that is likely to be true, but which does not contradict the known partial map information. Additionally, in one embodiment the partial map information is stored to permit incremental updates of the partial map information to be created. Moreover, the raw trace data from which the partial map is generated may also be stored to permit incremental updates of both the features of the partial map and the trace data from which the partial map is generated.
  • the complete map is used to generate a visualization 120.
  • the visualization may include a representation that provides layout information within a region of interest or a sub-region thereof.
  • additional information may be provided to indicate to a user a confidence factor in different regions of the map to show which portions of the map have a higher likelihood of being accurate than others.
  • the map information and confidence information may be provided to mobile devices as a service.
  • updates are performed 125 when additional data becomes available that increase the coverage of the partial map 105.
  • Figure 2 illustrates an embodiment of a computer implemented method to generate a complete map in a region of interest based on trajectory (trace) data.
  • Partial map coverage information 205 is obtained.
  • the partial map coverage data may be determined from trajectory data crowd sourced from mobile devices.
  • the trajectory data may be limited to path information.
  • more generally other types of information may be crowd sourced from mobile devices indicative of human behavior such as a length of time a user spent at a particular location, speed of movement of a user, acceleration, etc.
  • a rule set 210 is selected, where the rule set includes geometrical constraints and may also include other rules.
  • the rule set includes probabilistic rules and may be selected based on various factors, including information on the use of the building, geographic location, the year of construction, or other factors.
  • each rule is selected to be used as a term in a cost function.
  • a plurality of different cost functions are tested 215 in parallel.
  • at least one probabilistic optimization method is applied to determine a layout having an optimized layout that is consistent with the partial coverage data.
  • a set of N different methods e.g., belief propagation, Mote Carlo methods, or other multi-variable optimization approaches
  • the results of the highest scoring method is selected as an optimized layout.
  • the results of a highest scoring cost function selected 220 to determine the most likely complete map may then be used to identify an optimal interior layout (e.g., of rooms, hallways, open spaces) such that the total cost is minimized, and known areas of the partial map are preserved.
  • an optimal interior layout e.g., of rooms, hallways, open spaces
  • a map visualization is generated 225 for display of layout information for a region of interest.
  • the visualization also shows regions of the map having a lower statistical confidence.
  • the partial map data may be stored to permit incremental updates of the partial map as more data become available. Additionally, the trajectory data may be stored to permit incremental updates of the trajectory data. This aids is generated an updated map when additional data becomes available.
  • the rule set may be generated in a variety of different ways.
  • a particular category of building tends to have certain implicit rules on a likely layout of the building based on economic considerations, aesthetics, design and construction efficiency, and human behavior. Additionally, the year of construction, size, and general geographic location may be relevant in terms of building design trends. For example, modern shopping malls in the United States often have one or more larger anchor stores, some mid-size stores, and a set of smaller stores. While there are few truly identical shopping malls, there are many shopping malls that are similar in terms of geometrical constraints and the likelihoods that certain stores of certain sizes will be next to each other. There are also several common overall mall footprints regarding common overall mall sizes and shapes.
  • hospitals are typically organized in a different way than malls.
  • most types of rooms are clustered and relatively small compared to many other classes of buildings.
  • patient rooms are typically clustered, labs are often clustered, and operating rooms are often clustered.
  • Hospitals also often have exterior hallways.
  • Figure 3A illustrates an example of a mall layout having a variety of different stores.
  • trajectory data is illustrated as dashed lines 305.
  • a hallway 310 may be known due to frequent traffic.
  • an entrance to a small store and an anchor store may be determined from instances of trajectory data.
  • the challenge then is to take the incomplete partial map data and use rules to generate a more complete map in a region of interest for which there is incomplete data, such as for stores along the hallway 310.
  • a rule set may be selected that reflects common industry practices in designing shopping malls. For example, in many malls many stores have approximately the same store front width. There are also often larger anchor sores. Food stores and restaurants are often smaller and clustered around an open area (e.g., a food court). Hallways are often in the interior, except at the entrance. Many stores have approximately the same store front width. There are various probabilities associated with a likely store layout, such as store size variance, store size consistency, neighboring and/or nearby stire likelihoods (that specific store types are proximate each other), likelihoods of size similarities of a store to other stores, and likelihoods that hallways are located in the interior or exterior of a mall.
  • Figure 3B is an illustrative example of a set of geometric constraints derived from a set of known mall maps to form examples of learned values.
  • Other geometric constraints could be derived from known mall maps. Additionally, the geometric constraints could be customized based on factors such as overall mall size, year of construction, geographic location, or other factors.
  • the set of rules for a mall can include other semantic rules. Some of these semantic rules may be deterministic while others may be probabilistic. Crowd sourcing may be used to determine the name of one or more stores in a mall. Additionally, beacons may also be used to identify individual stores. Malls often have store clustering. If a given store type is detected (e.g., Gap®), there may be an associated probability of a specific store of similar type being nearly (e.g., a Prada® store near a Gap®store). There may be a total number of shops available from a POI database (DB). There may be some overall shape probabilities associated with the mall footprint size, number of anchor stores, etc. Shop size may also be based on the mall footprint and hallway geometry.
  • DB POI database
  • Figure 3D illustrates an example of the rule set of Figures 3B and 3C applied to a mall.
  • the mall is partially mapped in that a hallway skeleton is mapped along with some store entrances or boundaries.
  • the identity of one or more stores may be known.
  • the building footprint may also be known.
  • a set of cost function methods is then applied 320 in parallel to the initial information 315.
  • the result of the highest scoring method is then selected 325 to create a map in a region of interest showing the most likely position of walls, identities of stores, and hallway widths.
  • Figure 4A illustrates an example of a hospital layout.
  • the hospital includes a cluster of four operating rooms (ORs), nurses’ stations, patient rooms, and labs.
  • Figure 4B illustrates an example of rule set of learned values based on analyzing several hospital designs.
  • the rule set includes rules for the size of each type of room, a size variance, a nearby size consistency, a next to patient room probability, a next to lab probability, a next to operating room probability, a likelihood of a size similarity to a detected room of the same category; and a chance of hallways on the exterior.
  • Figures 5, 6, and 7 illustrate a relatively simple room layout with a simple example rule set applied to illustrate some aspects of hypothesis testing, incremental updates, and confidence levels.
  • Figure 5A illustrates an example of a simple building with five rooms in plot 505.
  • Plot 510 illustrates trajectory data 512, and 514 as well as a detected hallway and a detected room entrance. Hypothesis testing is then performed for three different possible layouts in plots 515, 520, and 530.
  • the rule set is comparatively simple and includes a room width rule, a rule similarity rule, and a room entrance rule are employed.
  • a room width rule may generate a score based on a current width, an ideal width, and a scaling factor.
  • a room similarity rule generates a score based on a current room size, a size of rooms to the left, a size of rooms to the right, and a scaling factor.
  • a room entrance location rule generates a score based on a length of a wall from an entrance to a left side of a room, a length of a wall from an entrance to a right side of a room, and a scaling factor.
  • FIG. 6 shows an example of how map accuracy increases when additional trajectory information becomes available.
  • Plot 600-A shows a known hallway 610 and trajectory data 615 to determine the location of one room entrance 620.
  • plot 600-B illustrates that additional trajectory data 625 may become available to determine a second room entrance 630.
  • plot 600-C at some still later point in additional point in term, there may yet be still additional trajectory data available such that trajectory data 635 is available to determine a third room entrance 640 and trajectory data 645 is available to determine a fourth room entrance 650.
  • Plot 605-A illustrates a map generated from the information in plot 600-A.
  • Plot 605-B illustrates a map generated based on the information in plot 600-B.
  • Plot 600-C illustrates a map based on the partial trajectory data of plot 600-C.
  • the maps increase in accuracy when more trajectory data becomes available.
  • the complete map is always consistent with the known layout information regarding known room entrances.
  • the complete map is a most likely map in a region of interest that is consistent with and extends the information of partial map information.
  • Figure 7 illustrates how the incremental updates increase a confidence in the output map.
  • the confidence that the layout of individual rooms in the map is correct increases. This may be visually displayed such as by a color code, a change in texture, or a textual display, or by other techniques.
  • This additional confidence information may be provided to indicate to a user the confidence that various portions of the layout of complete map are correct.
  • the confidence information could also be used in other ways. For example, a complete map could be provided only in regions satisfying a minimum confidence level. As another option, users might be able to select a desired minimum confidence level to display map information. As still yet another example, in a crowd sourcing application, users could be invited to provide information on regions having a low confidence.
  • Figure 8 illustrates an example of an algorithm to generate learned rules for a rule set.
  • a set of potential rules is identified 805 for a building category.
  • Training data 810 is provided. Examples of training data include labeled maps for buildings of a particular category. For example, for malls, the training data may include labeled maps of known malls. The training data may also include other semantic information. For example, in the case of malls, the semantic information may include other non-layout information different than the labeled maps.
  • a learning algorithm computes parameters 815 of relevant rules based on the training data.
  • the output 820 is a rule set with weighted parameters generated from the training data. The rules are created to be flexible enough to be used along with trace data to fill in unknown parts of building layouts without modifying existing known rooms or halls.
  • FIG. 9 is a block diagram of an apparatus in accordance with an embodiment.
  • a map assembly unit 900 includes a processor 910 and a memory 915.
  • the map assembly unit 900 is implemented as one or more servers.
  • the map assembly unit 900 may, in some embodiments, receive trace data directly from mobile devices 901. However, more generally the trace data could be obtained from another entity.
  • the map assembly unit 900 may also provide map information or location information to an individual mobile device for display on a display of a mobile device having its own processor, memory, and display.
  • the map assembly unit 920 may be used to implement any of the previously described methods or subsets thereof.
  • One or more individual components of the map assembly unit 900 may be implemented as software stored on the memory 915 and executing on the processor 910.
  • a trajectory/trace data collection unit 920 obtains trajectory data crowd sourced from mobile devices and performs any necessary data cleanup.
  • a rule set generation unit 925 is provided to generate probabilistic rules based on training data.
  • a partial map coverage generation unit 930 determines a partial map from the trajectory data, where the partial map may as identifying hallways and one or more building layout areas, such as a room or store entrance.
  • a rule set selection unit 935 is used to select a rule set for a particular use.
  • a map completion unit 940 generates a complete map in a region of interest based on the rules of the rule set and which preserves the partial map information.
  • a map visualization unit 945 generates map visualization information, which may, for example, be provided to mobile devices to generate a map display. Additionally, the map information may be used to aid in providing other types of location services, such as services based on the location of a user of a mobile device.
  • crowd sourcing may also include data from the sensors of a mobile devices suggesting item placement. For example, temperature sensors in a mobile device may suggest the location of portions of a food store having refrigerated items. Accelerometer information and motion sensors in a mobile device may suggest hand and arm movements, such as reaching for shelves. Crowd sourced information may also include social media postings, such as users posting that they are going to a store to purchase a particular type of food.
  • exterior spaces While applications have been described for mapping an interior of a building, additional extension are contemplated to include exterior spaces. For example, many building include at least some exterior spaces. Moreover, in some instances exterior spaces are organized into units of space analogous to rooms or stores.
  • the present invention may also be tangibly embodied as a set of computer instructions stored on a computer readable medium, such as a memory device.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Geometry (AREA)
  • General Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Computer Hardware Design (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Software Systems (AREA)
  • Educational Technology (AREA)
  • Educational Administration (AREA)
  • Business, Economics & Management (AREA)
  • Mathematical Physics (AREA)
  • Structural Engineering (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Mathematics (AREA)
  • Civil Engineering (AREA)
  • Architecture (AREA)
  • Computer Graphics (AREA)
  • Automation & Control Theory (AREA)
  • Navigation (AREA)
  • Processing Or Creating Images (AREA)

Abstract

A rule set is used to generate an indoor map of a building from partial map data. In one embodiment, the partial map data is based at least in part on crowd sourced trajectory data. In one embodiment, a probabilistic rule set describes relationships in space usage of the indoor building. Hypothesis testing is performed. A most likely complete layout is determined, based on the partial coverage data and the rule set, which preserves the partial map data.

Description

    RULE BASED COMPLETION OF MAPS WITH PARTIAL DATA
  • Aspects of exemplary embodiments relate to generating a map of a layout of a building or other geographic location from partial map data.
  • There are a variety of situations in which there is a desire to create a map defining a complete layout of locations within a geographic location. One such application is determining an indoor layout within a building. As one example, it may be desirable to create a complete layout of stores within a shopping mall. As another example, it may be desirable to create a layout of rooms within a hospital. As another example, it may be desirable to create a complete layout of a college campus. As yet another example, it may be desirable to create a layout of aisles within an individual store.
  • However, creating maps of indoor places is a difficult problem. Traditionally this problem has been solved in a very brute force way, with lots of manual effort in creating a map of each new place. Using crowd sourced data is a possible solution to this problem. In a crowd sourcing approach, data is obtained from many different users and then combined to generate a map. For example, individual users of mobile devices may provide data from their mobile devices as they move around a geographic location, which is then aggregated. However, crowd sourcing suffers from potential coverage problems. The crowd sourced data will tend to reflect the popularity of different areas in terms of foot traffic. As a consequence, less popular places may require an excessively long period of time before crowd sourced data becomes available.
  • According to an aspect of an exemplary embodiment, there is provided a method of generating a map indicating a layout of an arrangement of areas within a building, the method comprising obtaining a partially complete map of a layout of a region of interest and generating a map including at least some unknown portions of the layout of the building, wherein the map is based on utilizing the rule set and the partially complete map and the map preserves the layout information of the partially complete map.
  • Figure 1 illustrates a method to use a rule set to complete a partial map in accordance with an embodiment.
  • Figure 2 illustrates a method to utilize a rule and set to complete a partial map using cost functions in accordance with an embodiment.
  • Figure 3A illustrates an example of a map of a mall.
  • Figure 3B illustrates an example of rules describing geometrical constraints in a mall in accordance with an embodiment.
  • Figure 3C illustrates an example of additional rules for a mall in accordance with an embodiment.
  • Figure 3D illustrates an example of a method to determine a most likely layout of a mall in accordance with an embodiment.
  • Figure 4A illustrates an example of a map of a hospital.
  • Figure 4B illustrates an example of a rule set for a mall in accordance with an embodiment.
  • Figure 5A illustrates an example of hypothesis testing to determine a room layout based on a scoring technique in accordance with an embodiment.
  • Figure 5B illustrates an example of a room rule set in accordance with the example of Figure 5A.
  • Figure 6 illustrates how incremental updates in a partial map generate changes to the complete map in accordance with an embodiment.
  • Figure 7 illustrates how a confidence in different regions of the maps of Figure 6 changes with incremental updates in accordance with an embodiment.
  • Figure 8 illustrates method of generating a rule set in accordance with an embodiment.
  • Figure 9 illustrates an apparatus in accordance with an embodiment.
  • An apparatus and method is disclosed to generate a more complete map of a layout of a building based on partial map data. The more complete map is determined in a region of interest based on determining a most likely map in a region of interest that is consistent with, and preserves, the partial map data. A rule set is used to generate the map, where the rule set may include at least one probabilistic rule. Examples of a rule set include rules for geometrical constraints describing spatial relationships and semantic rules not based strictly on spatial relationships. In one embodiment, a cost function is used to determine the most likely layout based on partially complete map information and the rule set. The partial map information may be generated based on crowd sourced trajectory data obtained from mobile devices. Map information may also be provided to mobile devices.
  • According to an aspect of an exemplary embodiment, there is provided a method of generating a map indicating a layout of an arrangement of areas within a building, the method comprising obtaining a partially complete map of a layout of a region of interest and generating a map including at least some unknown portions of the layout of the building, wherein the map is based on utilizing the rule set and the partially complete map and the map preserves the layout information of the partially complete map.
  • According to an aspect of an exemplary embodiment, there is provided a method of generating a map indicating a layout of an arrangement of areas within a building, the method comprising identifying a partial layout of the building based on a plurality of trajectories representing movement of at least one mobile device within the building, selecting a rule set describing constraints on the arrangement of areas within the building, the rule set including at least one probabilistic rule describing spatial relationships of a plurality of different areas of the building, and determining a complete layout in a region of interest based on utilizing the rule set to determine a most likely complete layout consistent with the partial layout.
  • The rule set further comprises non-probabilistic rules describing geometrical constraints of the building.
  • The method of generating the map indicating the layout of the arrangement of areas within the building, the method further comprises determining a building type from a plurality of building types and the selecting a rule set includes selecting a rule set specific to the building type.
  • The rule set incudes for a particular building type, at least one geometrical constraint rule describing geometrical constraints of a size of plurality of different area types and probabilistic relationships between the plurality of different area types.
  • The rule set further comprises a point of interest rule based on point of interest information identifying an attribute of at least one area of the building.
  • The point of interest rule defines a probability of a size of the at least one area of the building.
  • The point of interest rule define a probability of an attribute of an area proximate to the point of interest.
  • According to an aspect of an exemplary embodiment, there is provided a method of providing location services for the interior of a building, comprising obtaining a partially complete map of an interior of a building via crowd sourced information representing the movement of at least one mobile device user in the interior of the building, selecting a rule set describing at least one probabilistic constraint on the arrangement of areas within the building, and generating a map of at least some unknown portions of the interior of the building based on utilizing the rule set and the partially complete map. The map preserves the information of the partially complete map.
  • The method of providing location services for the interior of a building, comprises providing visualization data to display the map.
  • According to an aspect of an exemplary embodiment, there is provided a method comprising providing map information of a layout in a region of interest of a building. The map information is generated from partially complete map layout information by utilizing at least one probabilistic rule to determine a most likely layout of the region of interest that preserves the partially complete map layout information.
  • Figure 1 is a flow chart illustrating an embodiment of a computer implemented method of using a set of rules to complete a partially completed map of a building in a region of interest. In one embodiment, a partial map 105 is obtained of a layout of an arrangement of areas, such as a layout of the interior of a building. However, more generally, the partial map may include at least some exterior spaces.
  • In one embodiment, the partial map 105 is generated or otherwise provided based on trajectory (e.g., trace) data crowd sourced from one or more mobile devices and corresponds to regions traversed by mobile device users. As examples, the trajectory data may be based on sensor data from sensors disposed on individual mobile devices. For example, individual mobile devices may include sensors, such as accelerometers, to determine position based on user movement. Additionally, individual mobile devices may include position sensors to determine position based on global positioning signals (if available) and any other available local wireless network signals such as Bluetooth or wireless LAN.
  • As an example, the partial map 105 may be based on instances of trajectory data. From the trajectory data, the layout of frequently trafficked areas may be identified from a pattern analysis, such as locations of main hallways. Additionally, there may be sufficient instances of trajectory data to identify other layout features based on pattern matching, such as room entrances. For example, trajectory data of one or more instances showing a mobile device moving off from a hallway may indicate a room or store entrance. However, there may be insufficient trajectory data in one or more portions of a building from which to generate a partial layout. Thus, the partial map is incomplete in at least one portion of a region of interest.
  • A rule set is selected 110 to aid in completing the partial map. The set of rules of the rule set permits hypothesis testing of different options for extending or completing the layout of the map in a region of interest. In one embodiment, a selection is made of a current best hypothesis consistent with the rule set and the known partial map 105. In one embodiment, the rule set may include some deterministic rules and also includes at least one probabilistic rule. In one embodiment, the rules of the rule set are used as terms in a cost function analysis.
  • The completion of the map may be for a desired geographic location, such as an entire interior of a building. However, more generally the map may be completed in a desired region of interest. Moreover, in some circumstances extending the partially complete map into at least on unknown region may be sufficient. For example, in a mall the desired region of interest may be the public areas of the mall and thus not include private offices in the mall. As another example, in some cases the desired region may be a subset of an entire geographic location, such as a wing of a mall. Additionally, in some embodiments the map may be completed only in regions for which there is a minimum confidence that the map that is generated is accurate to within some desired statistical confidence or accuracy. For example, if there is partial map data for only one wing of a mall, the map may be completed only in the portion of the mall for which there is sufficient partial data to generate a complete map with a desire minimum level of confidence.
  • In one embodiment, the rules include a set of probabilistic geometrical constraints reflecting likely relationships between different areas of a layout, where an individual area is a unit of space. As examples, a unit of space may be a room type, office unit, store unit, hallway, corridor, etc. Individual areas may be further classified into area types, such as based on size (e.g., larger area, medium area, small area) or function (e.g., food store, non-food store, etc.).
  • The probabilistic aspects of the geometrical constraints describe probable spatial arrangements in a layout. In the design of a building intended for a specific purpose, there are often likely spatial relationships based on economic considerations, aesthetics, design and construction efficiency, and human behavior. There may also be correlations with geographic location and year of constructions. For example, mall design has evolved slowly over many decades. There are common designs for malls of certain size ranges, dates of construction, and geographic location. In a probabilistic sense, many mall designs have a set of design attributes from which probabilistic rules can be constructed. For example, if there is partial map information indicating the presence of a first room entrance of room of a first size, then a probability that a neighboring room will have a certain size may be used in analyzing a hypothesis that in a layout the neighboring room is of a particular size.
  • As examples, geometric constraints may include size constraints of individual units of space, reflecting probable sizes and size variances, probabilities of interior or exterior hallways and hallway sizes, and probabilities that certain types of units of space (e.g., certain types or rooms or store) neighbor each other.
  • Additionally, other rules may be included that are based on other semantic information which is not strictly based on spatial considerations alone. In some cases, crowd sourced information may include names of individual regions within a geographic location. For example, names of individual stores or a total number of stores may be available. As examples, the name of a store may be obtained from a store Wi-Fi access point, from a crowd sourced picture taken on a mobile device, from someone checking into a social media site and posting information describing a location, or by requesting users of mobile devices to provide feedback. Additionally, point of interest (POI) information may be available from public sources (e.g., websites), or information beacons (e.g., wireless points of individual stores in a mall). As examples, information may be available on overall building footprint, points of interest in the building (e.g., a name of a store in a mall), and total number of stores. This semantic information may also include the type of building and year built.
  • The most likely complete map is determined 115 in a regions of interest based on the rule set and the partial map, where the most likely complete map has a layout of space consistent with the partial map information. That is, a complete map is generated which is an extension of the partial map 105. Thus, the complete map is consistent with and preserves the known information of the partial map 105. Thus, for example, if the partially complete map has information indicating a known hallway and a known set of room entrances, the complete map will preserve the known hallway information and the known set of room entrances. The complete map this provides additional information that is likely to be true, but which does not contradict the known partial map information. Additionally, in one embodiment the partial map information is stored to permit incremental updates of the partial map information to be created. Moreover, the raw trace data from which the partial map is generated may also be stored to permit incremental updates of both the features of the partial map and the trace data from which the partial map is generated.
  • In one embodiment, the complete map is used to generate a visualization 120. The visualization may include a representation that provides layout information within a region of interest or a sub-region thereof. In one embodiment, additional information may be provided to indicate to a user a confidence factor in different regions of the map to show which portions of the map have a higher likelihood of being accurate than others. The map information and confidence information may be provided to mobile devices as a service. In one embodiment, updates are performed 125 when additional data becomes available that increase the coverage of the partial map 105.
  • Figure 2 illustrates an embodiment of a computer implemented method to generate a complete map in a region of interest based on trajectory (trace) data. Partial map coverage information 205 is obtained. For example, the partial map coverage data may be determined from trajectory data crowd sourced from mobile devices. The trajectory data may be limited to path information. However, more generally other types of information may be crowd sourced from mobile devices indicative of human behavior such as a length of time a user spent at a particular location, speed of movement of a user, acceleration, etc. For example, in the case of a mall, users often sit in certain areas of the mall, such as food courts. This additional information may in some cases be available as an auxiliary source of information. A rule set 210 is selected, where the rule set includes geometrical constraints and may also include other rules. The rule set includes probabilistic rules and may be selected based on various factors, including information on the use of the building, geographic location, the year of construction, or other factors.
  • In one embodiment, each rule is selected to be used as a term in a cost function. In one embodiment, a plurality of different cost functions are tested 215 in parallel. In a cost function analysis, at least one probabilistic optimization method is applied to determine a layout having an optimized layout that is consistent with the partial coverage data. In one embodiment, a set of N different methods (e.g., belief propagation, Mote Carlo methods, or other multi-variable optimization approaches) are applied, and the results of the highest scoring method is selected as an optimized layout.
  • The results of a highest scoring cost function selected 220 to determine the most likely complete map. The rules may then be used to identify an optimal interior layout (e.g., of rooms, hallways, open spaces) such that the total cost is minimized, and known areas of the partial map are preserved.
  • A map visualization is generated 225 for display of layout information for a region of interest. In one embodiment, the visualization also shows regions of the map having a lower statistical confidence.
  • The partial map data may be stored to permit incremental updates of the partial map as more data become available. Additionally, the trajectory data may be stored to permit incremental updates of the trajectory data. This aids is generated an updated map when additional data becomes available.
  • The rule set may be generated in a variety of different ways. A particular category of building tends to have certain implicit rules on a likely layout of the building based on economic considerations, aesthetics, design and construction efficiency, and human behavior. Additionally, the year of construction, size, and general geographic location may be relevant in terms of building design trends. For example, modern shopping malls in the United States often have one or more larger anchor stores, some mid-size stores, and a set of smaller stores. While there are few truly identical shopping malls, there are many shopping malls that are similar in terms of geometrical constraints and the likelihoods that certain stores of certain sizes will be next to each other. There are also several common overall mall footprints regarding common overall mall sizes and shapes.
  • In contrast, hospitals are typically organized in a different way than malls. As an example, in many hospitals most types of rooms are clustered and relatively small compared to many other classes of buildings. For example, patient rooms are typically clustered, labs are often clustered, and operating rooms are often clustered. Hospitals also often have exterior hallways.
  • Figure 3A illustrates an example of a mall layout having a variety of different stores. In this example, trajectory data is illustrated as dashed lines 305. A hallway 310 may be known due to frequent traffic. In this example, there is trajectory data for a subset of small stores and also for a larger anchor store. Thus, an entrance to a small store and an anchor store may be determined from instances of trajectory data. The challenge then is to take the incomplete partial map data and use rules to generate a more complete map in a region of interest for which there is incomplete data, such as for stores along the hallway 310.
  • For the case of a shopping mall, a rule set may be selected that reflects common industry practices in designing shopping malls. For example, in many malls many stores have approximately the same store front width. There are also often larger anchor sores. Food stores and restaurants are often smaller and clustered around an open area (e.g., a food court). Hallways are often in the interior, except at the entrance. Many stores have approximately the same store front width. There are various probabilities associated with a likely store layout, such as store size variance, store size consistency, neighboring and/or nearby stire likelihoods (that specific store types are proximate each other), likelihoods of size similarities of a store to other stores, and likelihoods that hallways are located in the interior or exterior of a mall.
  • Figure 3B is an illustrative example of a set of geometric constraints derived from a set of known mall maps to form examples of learned values. In this example, there are three different common store sizes and associated size variances. There are also probabilities associated with nearby store size consistency, next to a store probability, next to an anchor store probability, next to a food store probability, a likelihood of size similarity to detected store of same category, and a probability of hallways neighboring the exterior of the building. More generally, other geometric constraints could be derived from known mall maps. Additionally, the geometric constraints could be customized based on factors such as overall mall size, year of construction, geographic location, or other factors.
  • Additionally, as illustrated in the example of Figure 3C, the set of rules for a mall can include other semantic rules. Some of these semantic rules may be deterministic while others may be probabilistic. Crowd sourcing may be used to determine the name of one or more stores in a mall. Additionally, beacons may also be used to identify individual stores. Malls often have store clustering. If a given store type is detected (e.g., Gap®), there may be an associated probability of a specific store of similar type being nearly (e.g., a Prada® store near a Gap®store). There may be a total number of shops available from a POI database (DB). There may be some overall shape probabilities associated with the mall footprint size, number of anchor stores, etc. Shop size may also be based on the mall footprint and hallway geometry.
  • Figure 3D illustrates an example of the rule set of Figures 3B and 3C applied to a mall. In this example, the mall is partially mapped in that a hallway skeleton is mapped along with some store entrances or boundaries. The identity of one or more stores may be known. The building footprint may also be known. There is thus a set of initial information 315 that includes partial map information and a rule set. A set of cost function methods is then applied 320 in parallel to the initial information 315. The result of the highest scoring method is then selected 325 to create a map in a region of interest showing the most likely position of walls, identities of stores, and hallway widths.
  • Figure 4A illustrates an example of a hospital layout. In this example, the hospital includes a cluster of four operating rooms (ORs), nurses’ stations, patient rooms, and labs. Figure 4B illustrates an example of rule set of learned values based on analyzing several hospital designs. The rule set includes rules for the size of each type of room, a size variance, a nearby size consistency, a next to patient room probability, a next to lab probability, a next to operating room probability, a likelihood of a size similarity to a detected room of the same category; and a chance of hallways on the exterior.
  • Figures 5, 6, and 7 illustrate a relatively simple room layout with a simple example rule set applied to illustrate some aspects of hypothesis testing, incremental updates, and confidence levels. Figure 5A illustrates an example of a simple building with five rooms in plot 505. Plot 510 illustrates trajectory data 512, and 514 as well as a detected hallway and a detected room entrance. Hypothesis testing is then performed for three different possible layouts in plots 515, 520, and 530. In the examples of plots 515, 520, and 530 the rule set is comparatively simple and includes a room width rule, a rule similarity rule, and a room entrance rule are employed. As illustrated in Figure 5B, a room width rule may generate a score based on a current width, an ideal width, and a scaling factor. A room similarity rule generates a score based on a current room size, a size of rooms to the left, a size of rooms to the right, and a scaling factor. A room entrance location rule generates a score based on a length of a wall from an entrance to a left side of a room, a length of a wall from an entrance to a right side of a room, and a scaling factor. Thus, different room layouts consistent with initial partial map information may be scored. In this example, plot 515 has the highest score, while plots 520 and 530 have lower scores.
  • One aspect of hypothesis testing is that the accuracy of the complete map increases if additional partial map information becomes available. Figure 6 shows an example of how map accuracy increases when additional trajectory information becomes available. Plot 600-A shows a known hallway 610 and trajectory data 615 to determine the location of one room entrance 620. At some later point in time, plot 600-B illustrates that additional trajectory data 625 may become available to determine a second room entrance 630. As illustrated in plot 600-C, at some still later point in additional point in term, there may yet be still additional trajectory data available such that trajectory data 635 is available to determine a third room entrance 640 and trajectory data 645 is available to determine a fourth room entrance 650.
  • Plot 605-A illustrates a map generated from the information in plot 600-A. Plot 605-B illustrates a map generated based on the information in plot 600-B. Plot 600-C illustrates a map based on the partial trajectory data of plot 600-C. As can be seen in plots 605-A, 605-B, and 605-C, the maps increase in accuracy when more trajectory data becomes available. However, note that the complete map is always consistent with the known layout information regarding known room entrances. Thus, the complete map is a most likely map in a region of interest that is consistent with and extends the information of partial map information.
  • Figure 7 illustrates how the incremental updates increase a confidence in the output map. As more trajectory data become available, the confidence that the layout of individual rooms in the map is correct increases. This may be visually displayed such as by a color code, a change in texture, or a textual display, or by other techniques. For the purposes of illustration, suppose that there is a first (low) confidence C1, a second (medium) confidence C2, a third medium (high confidence) C3, a higher confidence C4. This additional confidence information may be provided to indicate to a user the confidence that various portions of the layout of complete map are correct. Moreover, the confidence information could also be used in other ways. For example, a complete map could be provided only in regions satisfying a minimum confidence level. As another option, users might be able to select a desired minimum confidence level to display map information. As still yet another example, in a crowd sourcing application, users could be invited to provide information on regions having a low confidence.
  • Figure 8 illustrates an example of an algorithm to generate learned rules for a rule set. A set of potential rules is identified 805 for a building category. Training data 810 is provided. Examples of training data include labeled maps for buildings of a particular category. For example, for malls, the training data may include labeled maps of known malls. The training data may also include other semantic information. For example, in the case of malls, the semantic information may include other non-layout information different than the labeled maps. A learning algorithm computes parameters 815 of relevant rules based on the training data. The output 820 is a rule set with weighted parameters generated from the training data. The rules are created to be flexible enough to be used along with trace data to fill in unknown parts of building layouts without modifying existing known rooms or halls.
  • Figure 9 is a block diagram of an apparatus in accordance with an embodiment. A map assembly unit 900 includes a processor 910 and a memory 915. In one embodiment, the map assembly unit 900 is implemented as one or more servers. The map assembly unit 900 may, in some embodiments, receive trace data directly from mobile devices 901. However, more generally the trace data could be obtained from another entity. The map assembly unit 900 may also provide map information or location information to an individual mobile device for display on a display of a mobile device having its own processor, memory, and display. In one embodiment, the map assembly unit 920 may be used to implement any of the previously described methods or subsets thereof.
  • One or more individual components of the map assembly unit 900 may be implemented as software stored on the memory 915 and executing on the processor 910. A trajectory/trace data collection unit 920 obtains trajectory data crowd sourced from mobile devices and performs any necessary data cleanup. In one embodiment, a rule set generation unit 925 is provided to generate probabilistic rules based on training data. A partial map coverage generation unit 930 determines a partial map from the trajectory data, where the partial map may as identifying hallways and one or more building layout areas, such as a room or store entrance. A rule set selection unit 935 is used to select a rule set for a particular use. In the most general case, there may be a large number of different rule sets, such as rule sets tailored to particular classes of building and further tailored based on factors such as likely year of construction, geographic location, or other factors. A map completion unit 940 generates a complete map in a region of interest based on the rules of the rule set and which preserves the partial map information. A map visualization unit 945 generates map visualization information, which may, for example, be provided to mobile devices to generate a map display. Additionally, the map information may be used to aid in providing other types of location services, such as services based on the location of a user of a mobile device.
  • Additional applications and extensions are contemplated beside mapping of rooms or other units of space in a building. Another application is to generate a map of an interior of a store. Stores often locate goods according to certain general marketing rules. For example, in a food store dairy products are often located at the back of the store, produce tends to be located at an edge, and frozen foods are located in the middle of the store. Thus for a crowd sourcing could be used to generate partial information on food placement and probabilistic rules used to determine a most likely complete map of the interior of the store. Additionally, crowd sourcing may also include data from the sensors of a mobile devices suggesting item placement. For example, temperature sensors in a mobile device may suggest the location of portions of a food store having refrigerated items. Accelerometer information and motion sensors in a mobile device may suggest hand and arm movements, such as reaching for shelves. Crowd sourced information may also include social media postings, such as users posting that they are going to a store to purchase a particular type of food.
  • While applications have been described for mapping an interior of a building, additional extension are contemplated to include exterior spaces. For example, many building include at least some exterior spaces. Moreover, in some instances exterior spaces are organized into units of space analogous to rooms or stores.
  • While the invention has been described in conjunction with specific embodiments, it will be understood that it is not intended to limit the invention to the described embodiments. On the contrary, it is intended to cover alternatives, modifications, and equivalents as may be included within the spirit and scope of the invention as defined by the appended claims. The present invention may be practiced without some or all of these specific details. In addition, well known features may not have been described in detail to avoid unnecessarily obscuring the invention. In accordance with the present invention, the components, process steps, and/or data structures may be implemented using various types of operating systems, programming languages, computing platforms, computer programs, and/or computing devices. In addition, those of ordinary skill in the art will recognize that devices such as hardwired devices, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), or the like, may also be used without departing from the scope and spirit of the inventive concepts disclosed herein. The present invention may also be tangibly embodied as a set of computer instructions stored on a computer readable medium, such as a memory device.

Claims (15)

  1. A computer implemented method of generating a map indicating a layout of an arrangement of areas within a building, the method comprising:
    obtaining a partially complete map of a layout of a region of interest; and
    generating a map including at least some unknown portions of the layout of the building, wherein the map is based on utilizing the rule set and the partially complete map and the map preserves the layout information of the partially complete map.
  2. The method of claim 1, wherein the partially complete map is determined based on crowd-sourced trajectory data from at least one mobile device.
  3. The method of claim 1, wherein the rule set includes at least one probabilistic rule describing geometrical constraints on the arrangement of areas within the building.
  4. The method of claim 3, wherein the generating a map comprises performing hypothesis testing of different layouts consistent with the rule set and the partially complete map.
  5. The method of claim 3, wherein a cost function analysis is performed to determine a most likely complete map in the region of interest.
  6. The method of claim 3, wherein the rule set includes, for a particular building class, at least one geometrical constraint rule describing geometrical constraints of a size of plurality of different area types and probabilistic relationships between the plurality of different area types.
  7. The method of claim 1, further comprising:
    obtaining an updated partially complete map; and
    generating an updated map, wherein the updated map is based on utilizing the rule set and the updated partially complete map, wherein the map preserves the layout information of the updated partially complete map.
  8. The method of claim 1, further comprising generating a display illustrating the map with a visual indication of a confidence factor of individual areas of the layout.
  9. A computer implemented method of generating a map indicating a layout of an arrangement of areas within a building, the method comprising:
    identifying a partial layout of the building based on a plurality of trajectories representing movement of at least one mobile device within the building;
    selecting a rule set describing constraints on the arrangement of areas within the building, the rule set including at least one probabilistic rule describing spatial relationships of a plurality of different areas of the building; and
    determining a complete layout in a region of interest based on utilizing the rule set to determine a most likely complete layout consistent with the partial layout.
  10. The method of claim 9, wherein the rule set further comprises non-probabilistic rules describing geometrical constraints of the building.
  11. The method of claim 10, further comprising:
    determining a building type from a plurality of building types; and
    wherein the selecting a rule set includes selecting a rule set specific to the building type.
  12. The method of claim 9, wherein the partial layout is stored, the method further comprising:
    identifying an updated partial layout of the building based on an updated plurality of trajectories; and
    determining an updated complete layout based on utilizing the relationships of the rule set and the updated plurality of trajectories to determine a most likely complete layout consistent with the update partial layout.
  13. The method of claim 9, further comprising generating a display illustrating the complete layout in a region of interest with a visual indication of a confidence factor of individual areas of the complete layout.
  14. The method of claim 9, wherein the rule set further comprises a point of interest rule based on point of interest information identifying an attribute of at least one area of the building.
  15. A system, comprising:
    a map assembly unit including at least one processor and a memory, the map assembly unit configured to generate a map of at least some unknown portions of an interior of a building based on utilizing a probabilistic rule set and a partially complete map, wherein the map preserves the information of the partially complete map.
EP16855596.9A 2015-10-13 2016-06-07 Rule based completion of maps with partial data Withdrawn EP3362992A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14/881,564 US10185788B2 (en) 2015-10-13 2015-10-13 Rule based completion of maps with partial data
PCT/KR2016/005962 WO2017065378A1 (en) 2015-10-13 2016-06-07 Rule based completion of maps with partial data

Publications (2)

Publication Number Publication Date
EP3362992A1 true EP3362992A1 (en) 2018-08-22
EP3362992A4 EP3362992A4 (en) 2019-01-16

Family

ID=58499584

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16855596.9A Withdrawn EP3362992A4 (en) 2015-10-13 2016-06-07 Rule based completion of maps with partial data

Country Status (4)

Country Link
US (1) US10185788B2 (en)
EP (1) EP3362992A4 (en)
KR (1) KR102092916B1 (en)
WO (1) WO2017065378A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10541751B2 (en) * 2015-11-18 2020-01-21 Crowdcomfort, Inc. Systems and methods for providing geolocation services in a mobile-based crowdsourcing platform
US10817558B1 (en) 2016-06-25 2020-10-27 Anuja Dilip Pundlik Methods for producing sitemap for use with geographic information systems
WO2018222511A2 (en) * 2017-06-02 2018-12-06 Apple Inc. Venues map application and system providing a venue directory
US10740965B2 (en) 2018-06-01 2020-08-11 Trx Systems, Inc. Mapping complex building models
CN111581754B (en) * 2020-04-13 2024-03-12 华南理工大学 Method, system, computer equipment and storage medium for generating waterfront scene point network

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7668400B2 (en) * 2006-07-31 2010-02-23 Hewlett-Packard Development Company, L.P. Image layout constraint generation
US8838376B2 (en) * 2012-03-30 2014-09-16 Qualcomm Incorporated Mashup of AP location and map information for WiFi based indoor positioning
EP2885609B1 (en) 2012-08-15 2021-04-21 Google LLC Crowd-sourcing indoor locations
US9116000B2 (en) * 2012-10-22 2015-08-25 Qualcomm, Incorporated Map-assisted sensor-based positioning of mobile devices
US9066207B2 (en) * 2012-12-14 2015-06-23 Apple Inc. Managing states of location determination
JP6150531B2 (en) 2013-01-21 2017-06-21 三菱重工業株式会社 Terrain information acquisition device, terrain information acquisition system, terrain information acquisition method and program
US10038982B2 (en) 2014-02-18 2018-07-31 Commscope Technologies Llc System and method for information enhancement in a mobile environment

Also Published As

Publication number Publication date
KR20180053433A (en) 2018-05-21
KR102092916B1 (en) 2020-03-24
US10185788B2 (en) 2019-01-22
US20170103145A1 (en) 2017-04-13
WO2017065378A1 (en) 2017-04-20
EP3362992A4 (en) 2019-01-16

Similar Documents

Publication Publication Date Title
WO2017065378A1 (en) Rule based completion of maps with partial data
US8346472B2 (en) System and method for navigating a facility
US7974632B2 (en) Method and system for the localization of a mobile WLAN client
US20070149216A1 (en) Location determination techniques
EP1796419A1 (en) Location determination techniques in a wireless communication network
CN110933632B (en) Terminal indoor positioning method and system
US20140128093A1 (en) Portal transition parameters for use in mobile device positioning
JP2015531053A (en) System, method, and computer program for dynamically creating a radio map
Fichtner et al. Semantic enrichment of octree structured point clouds for multi‐story 3D pathfinding
JP6135672B2 (en) Method for reconstructing a map of the environment surrounding a wireless device, and wireless device implementing the method
WO2012009330A1 (en) Methods and apparatuses for use in generating an encoded routeability graph description
Nikoohemat et al. Indoor 3D modeling and flexible space subdivision from point clouds
Wichmann Indoor positioning systems in hospitals: A scoping review
Petrenko et al. Exploring mobility indoors: an application of sensor‐based and GIS systems
Conesa et al. Geographical and fingerprinting data to create systems for indoor positioning and indoor/outdoor navigation
Georgiou et al. Constructing informative bayesian map priors: A multi-objective optimisation approach applied to indoor occupancy grid mapping
CN102110311A (en) A method of computing a collision-free velocity for an agent in a crowd simulation environment
Lyu et al. A computational method for indoor landmark extraction
Xu et al. An efficient indoor Wi-Fi positioning method using virtual location of AP
Asli et al. Adults’ visual cue preferences and wayfinding abilities in healthcare centers
Claridades et al. Developing a data model of indoor points of interest to support location‐based services
Chen et al. GraphLoc: A graph-based method for indoor subarea localization with zero-configuration
JP6754574B2 (en) Moving object measurement system and method to identify the number of people in the area to be measured
JP7422682B2 (en) Improved geographic indexing
Minea et al. Developing a Solution for Mobility and Distribution Analysis Based on Bluetooth and Artificial Intelligence

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20180307

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 17/50 20060101ALI20180906BHEP

Ipc: G06T 17/05 20110101AFI20180906BHEP

Ipc: G09B 29/10 20060101ALI20180906BHEP

A4 Supplementary search report drawn up and despatched

Effective date: 20181218

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 17/50 20060101ALI20181212BHEP

Ipc: G06T 17/05 20110101AFI20181212BHEP

Ipc: G09B 29/10 20060101ALI20181212BHEP

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 111/08 20200101ALN20211119BHEP

Ipc: G06F 111/04 20200101ALN20211119BHEP

Ipc: G06F 30/13 20200101ALI20211119BHEP

Ipc: G09B 29/10 20060101ALI20211119BHEP

Ipc: G06T 17/05 20110101AFI20211119BHEP

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 111/08 20200101ALN20211222BHEP

Ipc: G06F 111/04 20200101ALN20211222BHEP

Ipc: G01C 21/00 20060101ALI20211222BHEP

Ipc: G06F 30/13 20200101ALI20211222BHEP

Ipc: G09B 29/10 20060101ALI20211222BHEP

Ipc: G06T 17/05 20110101AFI20211222BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20220209

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

18W Application withdrawn

Effective date: 20220411