WO2016112618A1 - 一种基于距离的求解二维空间中代表性节点集的算法 - Google Patents
一种基于距离的求解二维空间中代表性节点集的算法 Download PDFInfo
- Publication number
- WO2016112618A1 WO2016112618A1 PCT/CN2015/081146 CN2015081146W WO2016112618A1 WO 2016112618 A1 WO2016112618 A1 WO 2016112618A1 CN 2015081146 W CN2015081146 W CN 2015081146W WO 2016112618 A1 WO2016112618 A1 WO 2016112618A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- skyline
- algorithm
- radius
- representative
- points
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
- G06F16/24534—Query rewriting; Transformation
- G06F16/2454—Optimisation of common expressions
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
Definitions
- the invention relates to a new distance-based algorithm for solving a representative node set in a two-dimensional space (New Distance-based Representative Skyline, NDRS for short).
- Skyline query processing on centralized database including BNL algorithm (Block Nested Loop), SFS algorithm (Sort Filter Skyline), Divide and Conquer algorithm, Bitmap algorithm, Index algorithm (Index) [5], NN algorithm (Nearest Neighbor), BBS (Branch and Bound Skyline) [3] and so on.
- BNL algorithm Block Nested Loop
- SFS algorithm Sort Filter Skyline
- Divide and Conquer algorithm Bitmap algorithm
- Index algorithm Index
- NN algorithm Nearest Neighbor
- BBS Brainnch and Bound Skyline
- Lin Xuemin and others first proposed the concept of “Top-k representative Skyline (TRS)” in 2007, that is, select k Skyline points from Skyline points as “representative Skyline points”. And the selected k nodes need to satisfy the following conditions: the number of points in the data set dominated by the selected k Skyline points is greater than or equal to the arbitrarily selected k Skyline points from the Skyline point set. (dominate) the number of points in the data set.
- Er( ⁇ ,S) represents the maximum distance value that can be obtained from all non-representative skyline points in the Skyline point to the nearest representative skyline point, and then solved by the dynamic programming algorithm to obtain the final representative Skyline point set, called DRS algorithm.
- ⁇ represents the set of points of “Representative Skyline”
- S refers to the set of all nodes in the data set. This patent will primarily use the definition of representative Skyline based on distance.
- the TRS algorithm has an obvious disadvantage, that is, the selected "representative Skyline point" has a certain degree of bias, and tends to be relatively dense in the data concentration point, and its time complexity (O(km 2 +nlog(m))) is too high, where n represents the number of points in the data set and m represents the number of Skyline points. Therefore, the effectiveness of TRS will be difficult to guarantee in the context of large data scales and concentrated data distribution.
- the DRS algorithm solves the defect that TRS does not represent the entire Skyline point set well, the time complexity is still too high (O(
- the invention provides a new distance-based algorithm for solving representative Skyline node sets in two-dimensional space, and the time complexity of the algorithm is O(k 2 log 3 m), which is much lower than the time complexity of the DRS algorithm.
- An algorithm for solving a representative set of nodes in a two-dimensional space based on distance comprising the following steps:
- S1 input data set, calculate the Skyline point set Q in the data set by using the BNL algorithm; sort the point set Q to find the Manhattan distance value from the initial point to any other Skyline point and store it;
- the center point center(i, j) of the plurality of Skyline points ⁇ p i , . . . p j ⁇ covered by the region [i, j] and the circle of the circle centered on the center point are obtained.
- the minimum radius radius(i,j), 1 ⁇ i ⁇ j ⁇ m, where m is the number of elements of the Skyline point set; defining centre(i,j) p u , satisfied
- the representative Skyline solved by the NDRS algorithm can accurately represent the overall situation of the Skyline point set, by feeding back k "representative Skyline” points to the decision maker, and then selecting the representative Skyline for the decision maker.
- the point "expansion interval" is developed, and the second decision is made to the Skyline point in the interval, which perfectly solves the problem that the Skyline point set is too large to be detrimental to the decision maker's decision making, and makes the Skyline technology better serve the multi-objective decision.
- the time complexity of the algorithm of the present invention is O(k 2 log 3 m) compared to the DRS algorithm, which is much lower than the time complexity of the DRS algorithm.
- Figure 2 is a schematic diagram of a point set
- FIG. 3 Schematic diagram of multiple Skyline points covered by a region [i, j]
- Figure 4 shows the coverage ring of interval [3,6] and interval [5,6]
- Figure 5 shows the change of the radius(i,j) of the interval [1,5] with the value of center(i,j).
- a distance-based algorithm for solving representative node sets in two-dimensional space, using a binary parameter search technique, introducing a Testing function to test the feasibility of distance, and redesigning a new algorithm for calculating radius, making the program The execution time is greatly reduced.
- the specific process is as follows:
- the BNL algorithm is used to find the Skyline point set that can cover the entire data set.
- This preprocessing algorithm can be done within the time complexity of O(nlogn).
- Input B, the sorted Skyline point set (containing m elements), and the subscript S i where 1 ⁇ i ⁇ m.
- the algorithm applies the Distance-Testing strategy, which is the RSP algorithm.
- the general framework of the algorithm is as follows:
- Input sorted Skyline point set (including m elements), center(i,j), radius(i,j) when 1 ⁇ i ⁇ j ⁇ m
- the NDRS algorithm mainly uses the Distance-Testing technique, which is mainly used to solve the representative Skyline point ("RSP") in the case where the Skyline point set is known, and is called the DisBase algorithm.
- RSS representative Skyline point
- the main idea of the DisBase algorithm is to select from the corresponding subscripts of m rows of Skyline points.
- S 0 0, a total of k subscripts, these subscripts satisfy the following conditions: when 1 ⁇ i ⁇ k-1, there is radius(1,S 1 ) ⁇ B opt ⁇ raidus(1,S 1 +1), and Radius(S i +1,S i+1 ) ⁇ B opt ⁇ raidus(S i +1,S i+1 +1) and the final
- the time complexity of this part is O(klogm.logm), and then the final k representative Skyline points (ie RSP) are returned by Testing(B opt ).
- the time complexity of this part is O(k.logm), so The time complexity of the algorithm is O(k 2 log 3 m).
- Theorem 1 When B ⁇ B opt , Testing (B) is correct.
- Theorem 2 Let B opt be a circle whose k radius is not greater than B opt can completely cover the minimum value of the Skyline point set, then
- the technique for solving Skyline has been relatively perfect. Based on the pre-processed Skyline point set, the present invention further searches for k representative Skyline points by the NDRS algorithm, which greatly reduces the decision-making range of the decision maker.
- the BNL algorithm is used to find the Skyline point set ⁇ p 1 , p 2 ..., p 6 ⁇ that can cover the entire data set. .
- Figure 4 Covering rings for interval [3,6] and interval [5,6].
- the Skyline point set ⁇ p 1 , p 2 ..., p 6 ⁇ has been obtained through the preprocessing stage and can be found between any two Skyline points in the time of O(1). distance.
- 2,
- 4,
- 6,
- 4,
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
Description
Claims (2)
- 一种基于距离的求解二维空间中代表性节点集的算法,包含以下步骤:S1,输入数据集,用BNL算法计算数据集中的Skyline点集Q;对点集Q排序后求出初始点到其它任意Skyline点的曼哈顿距离值并存储;S2,求出Skyline点集中的k个代表性Skyline点;首先引入Testing(B)算法判断是否存在k个当1≤i≤j≤m,radius(i,j)<=B时由半径为radius(i,j)的圆环所能覆盖的区域能够包含整个Skyline点集,如果是,返回正确,否则返回错误;然后设定{S0,S1,....Sk-1},共k个下标,其中S0=1令1≤i≤k-1;满足Testing(radius(Si-1,Si))为错误且Testing(radius(Si-1,Si+1))为正确,则令Bopt=Er(κ,S),其中,κ代表“代表性Skyline点”集合,是输入值,S代表数据集中所有节点集合,||p,p′||表示点p与p′之间的欧式距离;S3,将Bopt带入Testing(Bopt)中,返回k个代表性Skyline点。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510021696.0A CN104573036B (zh) | 2015-01-16 | 2015-01-16 | 一种基于距离的求解二维空间中代表性节点集的方法 |
| CN201510021696.0 | 2015-01-16 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2016112618A1 true WO2016112618A1 (zh) | 2016-07-21 |
Family
ID=53089098
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2015/081146 Ceased WO2016112618A1 (zh) | 2015-01-16 | 2015-06-10 | 一种基于距离的求解二维空间中代表性节点集的算法 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN104573036B (zh) |
| WO (1) | WO2016112618A1 (zh) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104573036B (zh) * | 2015-01-16 | 2018-07-27 | 深圳大学 | 一种基于距离的求解二维空间中代表性节点集的方法 |
| CN105760549B (zh) * | 2016-03-22 | 2019-01-18 | 南京邮电大学 | 基于属性图模型的近邻查询方法 |
| CN106503245B (zh) * | 2016-11-08 | 2019-07-26 | 深圳大学 | 一种支撑点集合的选择方法及装置 |
| CN107633024B (zh) * | 2017-08-30 | 2023-05-12 | 清华大学 | 多维属性最优点组的快速搜索方法 |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102945283A (zh) * | 2012-11-19 | 2013-02-27 | 武汉大学 | 一种语义Web服务组合方法 |
| CN103020234A (zh) * | 2012-12-17 | 2013-04-03 | 东北大学 | 一种面向同构对称发布及订阅系统的Top-k查询方法 |
| CN104573036A (zh) * | 2015-01-16 | 2015-04-29 | 深圳大学 | 一种基于距离的求解二维空间中代表性节点集的算法 |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101339553A (zh) * | 2008-01-14 | 2009-01-07 | 浙江大学 | 面向海量数据近似快速聚类和索引方法 |
| CN103150336B (zh) * | 2013-02-04 | 2016-01-20 | 浙江大学 | 一种基于用户聚类的skyline在线计算方法 |
-
2015
- 2015-01-16 CN CN201510021696.0A patent/CN104573036B/zh not_active Expired - Fee Related
- 2015-06-10 WO PCT/CN2015/081146 patent/WO2016112618A1/zh not_active Ceased
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102945283A (zh) * | 2012-11-19 | 2013-02-27 | 武汉大学 | 一种语义Web服务组合方法 |
| CN103020234A (zh) * | 2012-12-17 | 2013-04-03 | 东北大学 | 一种面向同构对称发布及订阅系统的Top-k查询方法 |
| CN104573036A (zh) * | 2015-01-16 | 2015-04-29 | 深圳大学 | 一种基于距离的求解二维空间中代表性节点集的算法 |
Non-Patent Citations (1)
| Title |
|---|
| TAO, YUFEI ET AL.: "Distance_based Representative Skyline", IEEE 25 TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING, 2 April 2009 (2009-04-02), pages 893 - 896, ISSN: 1084-4627 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104573036A (zh) | 2015-04-29 |
| CN104573036B (zh) | 2018-07-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019201081A1 (zh) | 用于估计观测变量之间的因果关系的方法、装置和系统 | |
| CN112465637B (zh) | 反洗钱智能自动导侦的方法、计算机可读存储介质 | |
| CN103838803A (zh) | 一种基于节点Jaccard相似度的社交网络社团发现方法 | |
| CN104217015A (zh) | 基于互为共享最近邻的层次聚类方法 | |
| WO2016112618A1 (zh) | 一种基于距离的求解二维空间中代表性节点集的算法 | |
| Jiang et al. | IVE: accelerating enumeration-based subgraph matching via exploring isolated vertices | |
| Neo et al. | Maxent loss: Constrained maximum entropy for calibration under out-of-distribution shift | |
| CN107729348A (zh) | 一种基于辐射伸展图的高维数据的近似最近邻检索方法及检索系统 | |
| CN108287866A (zh) | 一种大规模网络中基于节点密度的社区发现方法 | |
| CN111107493B (zh) | 一种移动用户位置预测方法与系统 | |
| CN113706459B (zh) | 一种自闭症患者异常脑区的检测及模拟修复装置 | |
| CN112579831B (zh) | 基于SimRank全局矩阵平滑收敛的网络社区发现方法、装置及存储介质 | |
| Priya et al. | Community Detection in Networks: A Comparative study | |
| Imaduwage | Skippool: Improved sparse hierarchical graph pooling with differentiable exploration | |
| CN114678069B (zh) | 器官移植的免疫排斥预测及信号通路确定装置 | |
| CN105302894A (zh) | 一种基于并行关联规则的舆情热点跟踪方法与跟踪装置 | |
| CN109558907A (zh) | 非独立同分布下基于k均值算法的数据分析方法及系统 | |
| CN109379282B (zh) | 基于多标签传播的网络社区检测方法 | |
| Lin et al. | Multifaceted Scenario-Aware Hypergraph Learning for Next POI Recommendation | |
| Beirami et al. | Predicting missing attribute values using cooperative particle swarm optimization | |
| CN113723240A (zh) | 基于Boosting和样本差异的通用指纹定位方法及系统 | |
| CN115688918A (zh) | 一种基于割点集最大流的计算方法 | |
| Liu et al. | Learn: Selecting samples without training verification for communication-efficient vertical federated learning | |
| Dou et al. | Probabilistic parallelisation of blocking non-matched records for big data | |
| Mu et al. | A memetic algorithm using local structural information for detecting community structure in complex networks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15877535 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 15877535 Country of ref document: EP Kind code of ref document: A1 |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 01.06.2018) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 15877535 Country of ref document: EP Kind code of ref document: A1 |