WO2020215437A1 - 应用于电子地图的空间关键字查询的近似搜索方法 - Google Patents
应用于电子地图的空间关键字查询的近似搜索方法 Download PDFInfo
- Publication number
- WO2020215437A1 WO2020215437A1 PCT/CN2019/088771 CN2019088771W WO2020215437A1 WO 2020215437 A1 WO2020215437 A1 WO 2020215437A1 CN 2019088771 W CN2019088771 W CN 2019088771W WO 2020215437 A1 WO2020215437 A1 WO 2020215437A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- keyword
- spatial
- query
- approximate
- keywords
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2462—Approximate or statistical queries
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
Definitions
- the invention belongs to the technical field of positioning, and specifically relates to an approximate search method for spatial keyword query of electronic maps based on the Spark platform.
- Spatial keyword query takes the user's geographic location information and multiple query keywords as parameters, and returns spatial objects that have spatial and text relevance to these parameters.
- the so-called approximate keyword search refers to searching for a string similar to the query string under a given distance measurement.
- the mainstream solution is based on a space-first index structure.
- the space-first structure is not efficient for index optimization of spatial text objects with tens of keywords on average. Therefore, how to develop an approximate search method for spatial keyword query based on text matching priority to avoid unnecessary text matching process, reduce matching overhead, and achieve better search results. It is the direction that those skilled in the art need to study.
- R-tree Another form of B-tree development towards multi-dimensional space, which divides space objects into ranges, and each node corresponds to a region and a disk page , The non-leaf node's disk page stores the area range of all its child nodes, and the area of all child nodes of the non-leaf node falls within its area range.
- IR-tree Based on the inverted index and the R-tree index, the calculation model of the text similarity through the inverted index.
- BFIR-tree IR-tree based on massive data processing
- CBFIR-tree dynamic BFIR-tree
- S2I-V structure model structure that should be processed differently for keywords of different frequencies
- eBRQ based on keywords contained Range query
- aBRQ k nearest neighbor query based on approximate keywords
- false positive rate false detection rate
- KNN algorithm Proximity algorithm, is one of the simplest methods in data mining classification technology.
- I-Node A leaf R-tree node, which stores an inverted list that maps each keyword to a spatial keyword object.
- the technical problem to be solved by the present invention is to provide an approximate search method for spatial keyword query applied to electronic maps, which can avoid unnecessary text matching processes, reduce matching costs, and achieve better search results.
- An approximate search method for spatial keyword query applied to electronic maps which includes the following steps: S1: read each piece of data in a data set to construct an index, and jump to step S2 for each keyword of a single piece of data; S2 : Compare the frequency of the keyword with the frequency threshold. If the frequency value is higher than the preset frequency threshold, skip to S3; if the frequency is lower than the preset frequency threshold, skip to S4; S3 : Use the mapping function to map keywords to R-tree, and organize the space text objects containing the keywords, and jump to S5; S4: Map keywords to the object list, jump to S5; S5: For leaf nodes Calculate the minimum bounding rectangle to represent their spatial area.
- Step S5 includes the following steps: S61: For non-leaf nodes, calculate the distance from the query point to the MBR of the node, and check whether it matches The given circular area intersects; S62: Select possible child nodes based on the pruning ability of string matching, and visit the corresponding list or R-tree when reaching the leaf node to find the space text object within the given range from the given point ; S63: Obtain the current candidate results, and take the intersection of the temporary results of each keyword as the final solution set.
- step S7 includes the following steps: S71: read the number of keywords to be queried, if the keyword is a single keyword, jump to S72 , If the keyword is multiple keywords, skip to S73; S72: find the global kNN set by combining the k nearest neighbors corresponding to each string similar to the keyword; S73: extend the LBAK tree to support approximate keys The k nearest neighbor query for word inclusion.
- the present invention combines the pruning capabilities of spatial matching and text matching in a hybrid index mode, thereby avoiding many unnecessary text matching processes, reducing matching costs, redundant storage of strings, and reducing Cost of storage space.
- FIG. 1 is a schematic diagram of the working process of Embodiment 1.
- Figure 2 is a schematic diagram of the influence of the query percentage of the present invention on the query area of the solution when the query percentage gradually increases;
- Figure 3 is a schematic diagram of the influence of the number of keywords in the present invention on the query area of the scheme when the number of keywords gradually increases.
- An approximate search method for spatial keyword query applied to electronic maps which includes the following steps:
- step S1 Read each piece of data in the data set for index construction, and jump to step S2 for each keyword of a single piece of data;
- S2 Compare the frequency of the keyword with the frequency threshold. If the frequency value is higher than the preset frequency threshold, skip to S3; if the frequency value is lower than the preset frequency threshold, skip to S4;
- S3 Use the mapping function to map the keyword to the R-tree, and organize the space text objects containing the keyword, and jump to S5;
- S5 For the objects in the leaf nodes, calculate the minimum bounding rectangle to represent their spatial area. For non-leaf nodes, collect the minimum bounding rectangles of its child nodes and form a larger minimum bounding rectangle to represent the space coverage of the node ;
- S7 Query algorithm for k nearest neighbor queries contained in approximate keywords: For k nearest neighbor queries contained in approximate keywords with a single keyword, simply find the k nearest neighbors corresponding to each similar string ( Called ⁇ K1,K2,...,Kn ⁇ ). Then find the global kNN set in the union of all possible ⁇ K1,K2,...,Kn ⁇ . For multiple keywords, the situation is more complicated, because the k nearest neighbors of a specific keyword may not contain other query keywords. In this case, the LBAK tree is extended to support k nearest neighbor queries contained in approximate keywords. Since the LBAK tree is similar to BFIR-TREE, the latter's eBKQ algorithm can be quickly modified to support k nearest neighbor queries contained in approximate keywords.
- mapping function in step S2 has the following attributes:
- Attribute 1 For a given two strings si and sj, if the size of ⁇ (si) and ⁇ (sj) is compared in a linear time relative to the length of the given string, then the ⁇ function is called efficient Comparison of. Based on attribute 1, we can effectively organize strings based on B+-tree and handle string update operations.
- Attribute 2 Given a string q and a string interval [si,sj], if the mapping function ⁇ can efficiently return the minimum edit distance between q and the string interval, then ⁇ is called a lower bound deterministic mapping. Bed-Tree stores the minimum and maximum strings smin and smax in all strings at the same time, which represent the boundaries of the strings in the Bed-Tree under a given mapping.
- the string in the root node n is represented as ⁇ s1,...,sk ⁇ , and its candidate string interval: ⁇ (smin,s1),(s1,s2),...,(sk-1,sk),( sk,smax) ⁇ .
- the experiment was performed on a cluster of 17 nodes with two configurations: (1) 8 machines with 6-core Intel Xeon E5-2603 v3 1.60GHz processors and 20GB RAM; (2) 2 machines with 6-core Intel Xeon E5-2620 2.00GHz processor and 56GB RAM machine; (3) 7 machines equipped with 6-core Intel Xeon E5-2609 1.90GHz processor and 16GB RAM.
- Each slave node uses 15GB of memory and all available 6 cores for subsequent calculations. All nodes are running on the Ubuntu 14.04.2 LTS system, with Hadoop 2.4.1 and Spark 1.3.0 installed. Perform related experiments on two real massive data sets.
- Bed-first-tree When the query area is small, Bed-first-tree is slightly better than LBAK-Tree. When the query area expands, Bed-first-tree is more scalable and stable. As the number of query keywords increases, the performance of both increases first and then continues to decline. Generally, when there is only one query keyword, many results will be retrieved, and when two query keywords are assigned, many nodes become irrelevant solutions, so the number of visits to nodes is greatly reduced, resulting in a reduction in search overhead. However, when the number of query keywords continues to increase, the overhead of string search will become a major problem. Therefore, when the keyword size is greater than 2, its performance shows a downward trend. Therefore, the technical solution of the present invention is suitable for service applications based on geographic location such as public comment.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Probability & Statistics with Applications (AREA)
- Remote Sensing (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (3)
- 一种应用于电子地图的空间关键字查询的近似搜索方法,其特征在于,包括如下步骤:S1:读取数据集的各条数据进行索引构建、针对单条数据的各个关键字分别跳转至步骤S2;S2:将关键字的频率与频率阈值进行比对,若该频率值高于预设的频率阈值,则跳转至S3、若该频率值低于预设的频率阈值,则跳转至S4;S3:采用映射函数将关键字映射到R-tree,并组织包含该关键字的空间文本对象,跳转至S5;S4:将关键字映射到对象列表中,跳转至S5;S5:对于叶子节点中的对象、计算其最小边界矩形来表示它们的空间区域,对于非叶子节点,收集其子节点的最小边界矩形并组成更大的最小边界矩形以代表该节点的空间覆盖范围;S6:在S5构建的空间框架内实现对基于近似关键字包含的k个最近邻查询的查询搜索;S7:在S5构建的空间框架内实现对近似关键字包含的k最近邻查询的查询搜索。
- 如权利要求1所述应用于电子地图的空间关键字查询的近似搜索方法,其特征在于,步骤S6包括如下步骤:S61:对于非叶子节点,计算从查询点到该节点的MBR的距离,并检查它是否与给定圆形区域相交;S62:基于字符串匹配的剪枝能力选择可能的子节点,并在到达叶节点时访问相应的列表或R树以查找离给定点在给定范围内的空间文本对象;S63:获取当前的候选结果、对每个关键字的临时结果取交集作为最后解集。
- 如权利要求1所述应用于电子地图的空间关键字查询的近似搜索方法,其特征在于,步骤S7包括如下步骤:S71:读取待查询关键字的数目,若关键字为单关键字,跳转至S72,若关键字为多关键字,跳转至S73;S72:将每个与关键字相似的字符串对应的k个最近邻的并集中找到全局的kNN集合;S73:扩展LBAK树以支持近似关键字包含的k最近邻查询。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910334422.5A CN110046216A (zh) | 2019-04-24 | 2019-04-24 | 应用于电子地图的空间关键字查询的近似搜索方法 |
| CN201910334422.5 | 2019-04-24 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020215437A1 true WO2020215437A1 (zh) | 2020-10-29 |
Family
ID=67278949
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2019/088771 Ceased WO2020215437A1 (zh) | 2019-04-24 | 2019-05-28 | 应用于电子地图的空间关键字查询的近似搜索方法 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110046216A (zh) |
| WO (1) | WO2020215437A1 (zh) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022161368A1 (zh) * | 2021-01-27 | 2022-08-04 | 京东城市(北京)数字科技有限公司 | 空间二元组的确定方法、装置、计算机设备和存储介质 |
| CN116303434A (zh) * | 2023-02-20 | 2023-06-23 | 厦门亿力吉奥信息科技有限公司 | 基于网格r树混合索引构建方法、检索方法和装置 |
| CN121502033A (zh) * | 2026-01-14 | 2026-02-10 | 烟台大学 | 一种基于距离约束的视频时空量化范围检索方法及系统 |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113849498B (zh) * | 2021-08-18 | 2022-08-23 | 北京邮电大学 | 一种索引构建及查询方法 |
| CN113779039A (zh) * | 2021-09-26 | 2021-12-10 | 辽宁工程技术大学 | Top-k集合空间关键字近似查询方法 |
| CN113934944B (zh) * | 2021-10-13 | 2025-01-24 | 深圳大学 | 一种面向空间文本数据的空间结构匹配方法 |
| CN117349337A (zh) * | 2023-08-31 | 2024-01-05 | 天津航天机电设备研究所 | 基于分层默克尔树的时空关键字区块链查询方法 |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090037403A1 (en) * | 2007-07-31 | 2009-02-05 | Microsoft Corporation | Generalized location identification |
| CN102214215A (zh) * | 2011-06-07 | 2011-10-12 | 陆嘉恒 | 一种基于文本信息的快速反近邻查询方法 |
| CN104376112A (zh) * | 2014-11-27 | 2015-02-25 | 苏州大学 | 一种路网上空间关键字检索的方法 |
-
2019
- 2019-04-24 CN CN201910334422.5A patent/CN110046216A/zh active Pending
- 2019-05-28 WO PCT/CN2019/088771 patent/WO2020215437A1/zh not_active Ceased
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090037403A1 (en) * | 2007-07-31 | 2009-02-05 | Microsoft Corporation | Generalized location identification |
| CN102214215A (zh) * | 2011-06-07 | 2011-10-12 | 陆嘉恒 | 一种基于文本信息的快速反近邻查询方法 |
| CN104376112A (zh) * | 2014-11-27 | 2015-02-25 | 苏州大学 | 一种路网上空间关键字检索的方法 |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022161368A1 (zh) * | 2021-01-27 | 2022-08-04 | 京东城市(北京)数字科技有限公司 | 空间二元组的确定方法、装置、计算机设备和存储介质 |
| CN116303434A (zh) * | 2023-02-20 | 2023-06-23 | 厦门亿力吉奥信息科技有限公司 | 基于网格r树混合索引构建方法、检索方法和装置 |
| CN121502033A (zh) * | 2026-01-14 | 2026-02-10 | 烟台大学 | 一种基于距离约束的视频时空量化范围检索方法及系统 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110046216A (zh) | 2019-07-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2020215437A1 (zh) | 应用于电子地图的空间关键字查询的近似搜索方法 | |
| Zhang et al. | Processing spatial keyword query as a top-k aggregation query | |
| Lo et al. | Progressive skylining over web-accessible databases | |
| Gao et al. | On efficient reverse skyline query processing | |
| Al-Baghdadi et al. | Topic-based community search over spatial-social networks | |
| Liu et al. | Semantic-aware query processing for activity trajectories | |
| Nutanong et al. | Memory-efficient algorithms for spatial network queries | |
| Xuan et al. | Voronoi-based multi-level range search in mobile navigation | |
| Wang et al. | Update strategy based on region classification using ELM for mobile object index | |
| Ji et al. | Scalable nearest neighbor query processing based on inverted grid index | |
| Zheng et al. | Searching activity trajectory with keywords | |
| CN104750860B (zh) | 一种不确定数据的数据存储方法 | |
| Chen et al. | Analysis and evaluation of the top-k most influential location selection query | |
| Lin et al. | General spatial skyline operator | |
| Qi et al. | Efficient top-k spatial distance joins | |
| WO2020215436A1 (zh) | 应用于电子地图的空间关键字查询的搜索方法 | |
| Lin et al. | Efficient general spatial skyline computation | |
| Abdallah et al. | Towards a gml-enabled knowledge graph platform | |
| CN110059148A (zh) | 应用于电子地图的空间关键字查询的准确搜索方法 | |
| Ding et al. | Exploring the use of diverse replicas for big location tracking data | |
| CN107766407A (zh) | 一种采用两阶段搜索的轨迹相似性连接查询方法 | |
| Aung et al. | Index structure for nearest neighbors search with required keywords on spatial database | |
| CN114764482B (zh) | 一种位置推荐信息获得方法、装置、电子设备及存储介质 | |
| Li et al. | Top-k queries over digital traces | |
| Hu et al. | TBSI: a Transformer-based spatial learned index for efficient construction and query |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19926088 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 19926088 Country of ref document: EP Kind code of ref document: A1 |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 02.02.2022) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 19926088 Country of ref document: EP Kind code of ref document: A1 |