CN114003956A - Spatial data analysis scheduling system and method applying big data analysis - Google Patents
Spatial data analysis scheduling system and method applying big data analysis Download PDFInfo
- Publication number
- CN114003956A CN114003956A CN202111295713.1A CN202111295713A CN114003956A CN 114003956 A CN114003956 A CN 114003956A CN 202111295713 A CN202111295713 A CN 202111295713A CN 114003956 A CN114003956 A CN 114003956A
- Authority
- CN
- China
- Prior art keywords
- data
- spatial
- information
- spatial data
- block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
- G06F21/6227—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database where protection concerns the structure of data, e.g. records, types, queries
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Health & Medical Sciences (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Image Analysis (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a spatial data analysis scheduling system and a spatial data analysis scheduling method applying big data analysis, wherein the system comprises a spatial data acquisition module, a data receiving module, a spatial data analysis module and a result feedback module; the spatial data acquisition module is used for acquiring real-time spatial data of a target object and carrying out topology processing on the spatial data of the target object to obtain topology related data; the data receiving module is used for receiving the topology related data of the spatial data acquisition module and carrying out encryption processing to obtain encrypted spatial information; the spatial data analysis module is used for analyzing and processing the encrypted spatial information transmitted by the data receiving module; the result feedback module is used for feeding back the result analyzed by the spatial data analysis module to the resource database unit; the invention reasonably schedules the spatial data by analyzing the density of the spatial data so as to lead the spatial data to achieve the purpose of reasonable storage state and resource utilization.
Description
Technical Field
The invention relates to the technical field of data analysis, in particular to a spatial data analysis scheduling system and method applying big data analysis.
Background
At present, in the field of spatial data analysis, pure traditional analysis and big data analysis exist, and in practical application, the analysis route is either based on the traditional analysis route or the big data analysis route, but in the aspect of resource utilization of spatial information, a lot of resources are improperly utilized, the resources cannot be reasonably and effectively utilized, and the situation that the space for information storage is influenced by spatial data distribution happens occasionally; in addition, uneven spatial data information also causes interference and influence on each other, and influences on the accuracy of data to a certain extent, so that effective and reasonable scheduling and utilization of the spatial data information are effective means for solving the problem of complex spatial data at present; there are also security issues in spatial data transmission that are currently in need of resolution.
Disclosure of Invention
The present invention provides a spatial data analysis scheduling system and method using big data analysis to solve the above problems in the background art.
In order to solve the technical problems, the invention provides the following technical scheme: the spatial data analysis scheduling system applying big data analysis comprises a spatial data acquisition module, a data receiving module, a spatial data analysis module and a result feedback module; the spatial data acquisition module is used for acquiring real-time spatial data of a target object and carrying out topology processing on the spatial data of the target object to obtain topology related data; the data receiving module is used for receiving the topology related data of the spatial data acquisition module and carrying out encryption processing to obtain encrypted spatial information; the spatial data analysis module is used for analyzing and processing the encrypted spatial information transmitted by the data receiving module; and the result feedback module is used for feeding back the analysis result of the spatial data analysis module to the resource database unit.
Further, the spatial data acquisition module comprises a target detection unit and a resource database retrieval unit;
the target detection unit is used for realizing real-time acquisition of basic spatial data information of the target object in a mode that the spatial data acquisition module detects the target object;
the resource database retrieval unit is used for the spatial data acquisition module to extract the same spatial data information from the resource database unit in the result feedback module for direct utilization;
the spatial data acquisition module firstly utilizes the resource database retrieval unit to retrieve the target object, and if the resource database unit has the same target object, the spatial data is directly utilized; if the resource database unit does not have the same data as the target object, the spatial data acquisition module further starts the target detection unit to acquire the basic spatial data information of the target object.
The spatial data acquisition module is firstly provided with a resource database retrieval unit for effectively utilizing the existing data resources, so that the data processing time is saved; when the same data is not retrieved from the resource database, the data is acquired and then transmitted to the resource database unit after being processed, so that the data in the resource database is richer.
Furthermore, the spatial data analysis module comprises a data extraction unit and an analysis scheduling unit;
the data extraction unit decrypts the spatial data information encrypted by the data receiving unit and extracts the decrypted spatial data to obtain initial spatial block data; the analysis scheduling unit can simultaneously analyze the spatial information in the spatial data analysis module and the resource information in the resource database unit in the data feedback module, and perform data analysis scheduling on the data in the spatial data analysis module and the resource database unit in the data feedback module.
The spatial data analysis module is provided with a data extraction unit which can extract and utilize the effective information in the data receiving unit, and the analysis scheduling unit processes and analyzes the information in the data extraction unit and schedules the data to be scheduled, so that the data information in the spatial block can be shared.
The invention also provides a spatial data analysis scheduling method applying the big data analysis, which comprises the following steps:
step S100: acquiring spatial data information, and if the spatial data information is existing, directly referring to the spatial data information; if the space data information is not the existing space data information, topology processing is carried out after the space data information is acquired, and topology related data are obtained;
step S200: continuously encrypting the topology related data obtained by processing in the step S100 to obtain encrypted processing data;
step S300: decrypting the encrypted data obtained in the step S200, and extracting information in the topology related data to obtain initial space block data; carrying out spatial analysis on the initial spatial block data to judge whether scheduling is needed; obtaining second space block data information through analysis scheduling processing, wherein data which is not analyzed and scheduled to be processed is first space block data information;
step S400: comparing the first spatial block data or the second spatial block data in the step S300 with the resource database, respectively; if the first spatial block data or the second spatial block data can be matched with the same spatial data, recording the frequency of the spatial data; and if the first spatial block data or the second spatial block data are not matched with the same spatial data, the resource database updates and records the first spatial block data or the second spatial block data.
The importance degree of the spatial information can be effectively judged by recording the frequency of the matched spatial data, and the resource abundance of the database can be increased by updating and recording the unmatched spatial information, so that the aim of reasonably sharing the resources is fulfilled.
Further, in step S100, topology processing is performed on the acquired spatial data information to obtain topology-related data, where the topology-related data includes a topology relationship, and the specific process is as follows:
step S110: the acquired spatial data information comprises image structure information and land distribution information, wherein the image structure information is an irregular polygon image formed by adjacent m lands with different areas, and m isThe land parcel distribution information includes a reference number P of the land parcel as a natural numbermAdjacent point N of land blocks with different areasiAnd the vector relation between adjacent points
Step S120: performing topology processing on the image structure information and the parcel distribution information in the step S110 to obtain a topological relation, wherein the topological relation comprises a vector relationAnd parcel number PmTopological relation between, i.e. PmCorrespond toAnd adjacent point NiWith a landmark block number PmTopological relation between, i.e. PmCorresponding to the starting point Ni+dAnd endpoint Ni+eB, c, d and e all belong to natural numbers;
the spatial plot data information is converted into the relation between the vector and the plot, so that the spatial information in the plot can be effectively set in relation to the vector password standard and the proportion problem of the vectors contained in different plots can be judged;
step S130: relating the different vectors in step S120And parcel number PmThe topological relation between the two is taken as a set A, the orientation quantity relationAre respectively marked as a set BiRespectively calculating the specific gravities of different elements
The position information of the land blocks to which the land blocks belong can be obviously distinguished by using the ratio of different vectors to measure the total proportion of different vectors contained in different land blocks by using the overall vector relation set in the space blocks as denominators, namely, the land blocks are preliminarily judged to have the number of the adjacent land blocks and the proportion of the contained space data information.
Step S140: based on the specific gravity G of different elements in step S130iThe land parcel is marked with the number PmSpecific gravity G of different elements iniAnd adding and summing, namely dividing the sum into an m space block set according to the proportion relation after summing, wherein the m space block set is a first space block and a second space block which have the summing proportion sequenced from large to small.
The target detection unit carries out topology processing on the spatial data information, so that the problem that the extraction deviation of the spatial data information is large due to the complex terrain can be avoided, the storage space of the spatial data can be effectively saved by utilizing the topology processing, and the relation between the spatial data can be reflected more simply; and one plot label at least corresponds to one vector relationship, the vector relationships of different plot labels are different, but the contained elements may be repeated, because the plots and the plots are in an adjacent state, the specific weight of the vector elements can be calculated to obtain which plot contains the most vector relationship, and the spatial plots containing the most vectors are sequenced, so that the spatial plots containing different levels of vectors are encrypted, and effective protection is achieved.
Further, the encryption processing data includes a spatial data similarity password, and the specific process of step S200 is as follows:
step S210: receiving the m-space block set information in step S140, and extracting the vector relationship of each space block in the m-space block setSetting a known data vector password as a system;
step S220: respectively setting space data similarity passwords for each space block in the m space block set, wherein the space data similarity passwords comprise known data vector passwords set by a systemSpatial data vector password with unknown input unlock contentSystem setting known data vector cipherVector relationships for spatial blocks
Step S230: the cosine similarity is used for measuring the space data similarity, and the cosine similarity is used for measuring the known data vector password set by the system by calculating the cosine included angle between vectorsSpatial data vector password with unknown input unlock contentThe similarity between them; is provided withAndthe similarity between them isThenThe calculation is as follows:
whereinThe system is set to the modulus of the known data vector cipher,modulo of a spatial data vector password that unlocks the content for unknown input.
Whether the password is correct or not can be effectively converted into mathematical calculation by utilizing cosine similarity, the password is set for vector data in each land block, and the vector proportion in each land block is different, so the difficulty degree of each vector corresponding to the password is different, the password can be solved only when the vector direction and the vector size preset by the system are completely the same as the input vector, the angle deviation is not equal to the unlocking triggering value set by the system, the unlocking triggering value set secondly is only possible, and the safety of the password is improved.
Further, the specific process in step S300 is as follows:
step S310: decrypting the data similarity password in step S220, and inputting the relation with the vectorSame space data vector cipherSo thatWhen the password is not decrypted, the password is decrypted;
step S320: extracting information in the space block after password unlocking to obtain initial space block data, wherein the initial space block data comprises adjacent points N in the corresponding space blockiWith a landmark block number PmTopological relation between them;
step S330: based on the adjacent point N in the spatial block in step S320iWith a landmark block number PmThe topological relation between the adjacent points N in all the space blocks is calculated by the density calculationiCalculation of average Density and Adjacent Point N within spatial BlockiPractice ofAnd (4) calculating the density.
The password is unlocked by utilizing the set trigger unlocking numerical value, only one numerical value improves the safety of data extraction, and the density value calculation after information extraction is used for further evaluating the acquired spatial data information, so that the resource utilization rate is improved.
Further, the specific process in step S330 is as follows:
step S331: establishing a two-dimensional coordinate axis for the irregular polygon image obtained in the step S110; the coordinates of a point on the irregular polygon image are (f)i,gi);
Step S332: based on the coordinates (f) in step S331i,gi) Selecting the minimum Minf of the abscissa of the point on the irregular polygon imageiA point on the Y coordinate axis and the minimum value Ming of the ordinateiEstablishing a rectangular coordinate system for one point on the X coordinate axis; defining the minimum Minf of the abscissaiMaximum value Maxf to abscissaiIs the length of the rectangle, defines the minimum value Ming of the ordinateiMaximum value Maxg to ordinateiIs the width of the rectangle, the coordinates within the rectangle containing all coordinates (f) within the irregular polygoni,gi);
The adjacent points of the irregular polygon are set on the X axis and the Y axis, quantitative analysis of the adjacent points of the polygon in a two-dimensional coordinate system is facilitated, all data of the irregular polygon belong to the first quadrant and are positive values, and convenience is brought to calculation.
Step S333: maximum value Maxf based on abscissa in step S332iMinimum MinfiAnd maximum value Maxg of ordinateiMinimum MingiCalculating the area of the rectangle as WMoment=(Maxfi-Minfi)×(Maxgi-Mingi) The rectangular area WMomentQuartering to obtain four new rectangular areas W', recording adjacent points N in all spatial blocksiThe number of coordinates of (a) is set C, using the formula: determining a single new lower adjacency of the rectangular area W ═ C/WPoint NiThe average density γ of;
the rectangular area of the whole body to which the polygon belongs is solved to carry out four equal parts, so that the analysis of the space blocks contained in the local rectangular area is facilitated, and each new rectangular area is equal, so that the deviation of the calculation density caused by different denominators can be avoided.
Step S334: let the new rectangle in step S332 be RjJ ═ {1,2,3,4}, four new rectangles are named as rectangles R clockwise from the origin of coordinates1Rectangle R2Rectangle R3And rectangle R4And is provided with a rectangle R1Has vertex coordinates of (0,0) and (0, Maxg)i/2)、(Maxfi/2,Maxgi/2)、(Maxfi2, 0); rectangle R2Has a vertex coordinate of (0, Maxg)i/2)、(0,Maxgi)、(Maxfi/2,Maxgi)、(Maxfi/2,Maxgi2); rectangle R3Has a vertex coordinate of (Maxf)i/2,Maxgi/2)、(Maxfi/2,Maxgi)、(Maxfi,Maxgi)、(MaxfiMax/2); rectangle R4Has a vertex coordinate of (Maxf)i/2,0)、(Maxfi/2,Maxgi/2)、(Maxfi,Maxgi/2)、(Maxfi,0);
The position coordinates of the four vertexes of the new rectangle are expressed, so that the analysis of the positions of the single adjacent points is facilitated, and the rectangle of the adjacent points is better determined.
Step S335: based on the adjacent point N in step S332iActual coordinates (f) ofi,gi) Respectively to the abscissa fiAnd ordinate giF is judged to be 0 < >i<<MaxfiAnd 0 < gi<<MaxgiObtaining the actual coordinates (f)i,gi) Belonging to a rectangle RjAnd storing the actual coordinates belonging to the rectangle into the corresponding rectangle set Rj(ii) a Using the formula:get each new rectangle RjOfAdjacent point NiDensity value
And respectively comparing the abscissa and the ordinate of the adjacent point with the vertex coordinates of the four rectangles to judge the position of the adjacent point, and then respectively calculating the density in each rectangle to obtain the result, namely the density value of the adjacent point of the space block contained in each rectangle.
Step S336: the actual adjacent point N in step S335iDensity valueRespectively connected with adjacent points NiComparing the average density gamma of the two; if present, isThen the rectangle RjData information of the contained space block is scheduled toIs rectangular RjObtaining data information of a second space block from the contained space block; if each rectangle RjAre all internally provided withThe first space block data information is directly obtained without scheduling.
Setting spatial data information in a coordinate system, which is beneficial to quantitative analysis of adjacent points, wherein the adjacent points can be regarded as information key points in data acquisition, and when the information key points are densely distributed in a certain spatial area, the information key points can interfere with each other or data information of different resources cannot be reasonably utilized by other spaces, so that scheduling of the spatial data information is set; the scheduling basis is the density value of the space adjacent point, the acquired space data is integrally planned, the acquired space image data is not a regular image, so that the image regularization is favorable for performing density analysis on each space block to acquire an average value, the average value is used as a measurement standard, the calculation of average density values corresponding to different areas is favorable for performing effective measurement when facing space images under different conditions, the whole area is divided to calculate the actual density of each space, and information in a space block with too high density can be scheduled to a space block with lower density, so that the space data information resource is reasonably utilized, and the space block with lower density can continuously and effectively store data information.
Compared with the prior art, the invention has the following beneficial effects: the method firstly solves the problem that the spatial data is inaccurate in information due to external factors such as terrain and landform during extraction, secondly performs encryption processing on the spatial data in the transmission process, prevents the spatial data information from leaking, effectively protects the spatial data, and finally performs density analysis on the spatial information, reasonably utilizes useful resources, reduces the resource burden of high-density spatial blocks, and possibly causes interference due to complex and variable data.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
FIG. 1 is a flow chart of a spatial data analysis scheduling system and method employing big data analysis in accordance with the present invention;
FIG. 2 is a flowchart illustrating the overall steps of the spatial data analysis scheduling system and method using big data analysis according to the present invention;
FIG. 3 is a method step of performing topology processing on the acquired spatial data information according to the spatial data analysis scheduling system and method applying big data analysis of the present invention;
FIG. 4 is a method step of spatial data similarity password setting for the spatial data analysis scheduling system and method applying big data analysis according to the present invention;
FIG. 5 is a method step of determining whether scheduling is required for the initial spatial block data according to the spatial data analysis scheduling system and method applying big data analysis of the present invention;
FIG. 6 is a step of a method for calculating the average density and actual density of spatial blocks in the system and method for spatial data analysis scheduling using big data analysis according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1-6, the present invention provides the following technical solutions: the spatial data analysis scheduling system applying big data analysis comprises a spatial data acquisition module, a data receiving module, a spatial data analysis module and a result feedback module; the spatial data acquisition module is used for acquiring real-time spatial data of a target object and carrying out topology processing on the spatial data of the target object to obtain topology related data; the data receiving module is used for receiving the topology related data of the spatial data acquisition module and carrying out encryption processing to obtain encrypted spatial information; the spatial data analysis module is used for analyzing and processing the encrypted spatial information transmitted by the data receiving module; and the result feedback module is used for feeding back the analysis result of the spatial data analysis module to the resource database unit.
The spatial data acquisition module comprises a target detection unit and a resource database retrieval unit;
the target detection unit is used for realizing real-time acquisition of basic spatial data information of the target object in a mode that the spatial data acquisition module detects the target object;
the resource database retrieval unit is used for the spatial data acquisition module to extract the same spatial data information from the resource database unit in the result feedback module for direct utilization;
the spatial data acquisition module firstly utilizes the resource database retrieval unit to retrieve the target object, and if the resource database unit has the same target object, the spatial data is directly utilized; if the resource database unit does not have the same data as the target object, the spatial data acquisition module further starts the target detection unit to acquire the basic spatial data information of the target object.
The spatial data acquisition module is firstly provided with a resource database retrieval unit for effectively utilizing the existing data resources, so that the data processing time is saved; when the same data is not retrieved from the resource database, the data is acquired and then transmitted to the resource database unit after being processed, so that the data in the resource database is richer.
The spatial data analysis module comprises a data extraction unit and an analysis scheduling unit;
the data extraction unit decrypts the spatial data information encrypted by the data receiving unit and extracts the decrypted spatial data to obtain initial spatial block data; the analysis scheduling unit can simultaneously analyze the spatial information in the spatial data analysis module and the resource information in the resource database unit in the data feedback module, and perform data analysis scheduling on the data in the spatial data analysis module and the resource database unit in the data feedback module.
The spatial data analysis module is provided with a data extraction unit which can extract and utilize the effective information in the data receiving unit, and the analysis scheduling unit processes and analyzes the information in the data extraction unit and schedules the data to be scheduled, so that the data information in the spatial block can be shared.
The invention also provides a spatial data analysis scheduling method applying the big data analysis, which comprises the following steps:
step S100: acquiring spatial data information, and if the spatial data information is existing, directly referring to the spatial data information; if the space data information is not the existing space data information, topology processing is carried out after the space data information is acquired, and topology related data are obtained;
in step S100, topology processing is performed on the acquired spatial data information to obtain topology-related data, where the topology-related data includes a topology relationship, and the specific process is as follows:
step S110: set acquired nullThe inter-data information includes image structure information and plot distribution information, the image structure information is irregular polygon image formed by m plots with different areas adjacent to each other, m is natural number, and the plot distribution information includes the mark P of the plotmAdjacent point N of land blocks with different areasiAnd the vector relation between adjacent points
Step S120: performing topology processing on the image structure information and the parcel distribution information in the step S110 to obtain a topological relation, wherein the topological relation comprises a vector relationAnd parcel number PmTopological relation between, i.e. PmCorrespond toAnd adjacent point NiWith a landmark block number PmTopological relation between, i.e. PmCorresponding to the starting point Ni+dAnd endpoint Ni+eB, c, d and e all belong to natural numbers;
the spatial plot data information is converted into the relation between the vector and the plot, so that the spatial information in the plot can be effectively set in relation to the vector password standard and the proportion problem of the vectors contained in different plots can be judged;
step S130: relating the different vectors in step S120And parcel number PmThe topological relation between the two is taken as a set A, the orientation quantity relationAre respectively marked as a set BiRespectively calculating the specific gravities of different elements
Using the integral vector relation set in the space block as denominator, calculating the occupation ratio of different vectors to measure the total proportion of different vectors contained in different blocks, so as to obviously distinguish the position information of the land block, i.e. preliminarily judging the number of adjacent land blocks and the proportion of contained space data information;
step S140: based on the specific gravity G of different elements in step S130iThe land parcel is marked with the number PmSpecific gravity G of different elements iniAnd adding and summing, namely dividing the sum into an m space block set according to the proportion relation after summing, wherein the m space block set is a first space block and a second space block which have the summing proportion sequenced from large to small.
For example, the irregular polygon image in the acquired image structure information is a pentagon image, and the pentagon image is formed by mutually adjoining 4 land blocks with different areas; the land parcel labels are respectively P1、P2、P3、P4Land parcel P1The corresponding vector relationship isLand parcel P2The corresponding vector relationship isLand parcel P3The corresponding vector relationship isLand parcel P4The corresponding vector relationship isThe set A isCollectionCollectionCollectionCollectionCollectionCollection CollectionCollectionCollectionCollectionCollectionComputingG3=G4=G7=G82/11, the weights of all elements in each plot are added to obtain the weight of each plot and the weight is sorted.
The target detection unit carries out topology processing on the spatial data information, so that the problem that the extraction deviation of the spatial data information is large due to the complex terrain can be avoided, the storage space of the spatial data can be effectively saved by utilizing the topology processing, and the relation between the spatial data can be reflected more simply; and one plot label at least corresponds to one vector relationship, the vector relationships of different plot labels are different, but the contained elements may be repeated, because the plots and the plots are in an adjacent state, the specific weight of the vector elements can be calculated to obtain which plot contains the most vector relationship, and the spatial plots containing the most vectors are sequenced, so that the spatial plots containing different levels of vectors are encrypted, and effective protection is achieved.
Step S200: continuously encrypting the topology related data obtained by processing in the step S100 to obtain encrypted processing data; the encryption processing data includes a spatial data similarity password, and the specific process of step S200 is as follows:
step S210: receiving the m-space block set information in step S140, and extracting the vector relationship of each space block in the m-space block setSetting a known data vector password as a system;
step S220: respectively setting space data similarity passwords for each space block in the m space block set, wherein the space data similarity passwords comprise known data vector passwords set by a systemSpatial data vector password with unknown input unlock contentSystem setting known data vector cipherVector relationships for spatial blocks
Step S230: the similarity of spatial data is measured by cosine similarity, and the cosine similarity is measured by calculating cosine included angle between vectorsUniformly setting known data vector cipherSpatial data vector password with unknown input unlock contentThe similarity between them; is provided withAndthe similarity between them isThenThe calculation is as follows:
whereinThe system is set to the modulus of the known data vector cipher,modulo of a spatial data vector password that unlocks the content for unknown input.
For example: when vectorWith input unlock vector passwordDirections being the same and coincident, then representing vectorsWith input unlock vector passwordThe included angle of (A) is 0, namely the input password completely accords with the set password;
whether the password is correct or not can be effectively converted into mathematical calculation by utilizing cosine similarity, the password is set for vector data in each land block, and the vector proportion in each land block is different, so the difficulty degree of each vector corresponding to the password is different, the password can be solved only when the vector direction and the vector size preset by the system are completely the same as the input vector, the angle deviation is not equal to the unlocking triggering value set by the system, the unlocking triggering value set secondly is only possible, and the safety of the password is improved.
Step S300: decrypting the encrypted data obtained in the step S200, and extracting information in the topology related data to obtain initial space block data; carrying out spatial analysis on the initial spatial block data to judge whether scheduling is needed; obtaining second space block data information through analysis scheduling processing, wherein data which is not analyzed and scheduled to be processed is first space block data information; the specific process in step S300 is as follows:
step S310: decrypting the data similarity password in step S220, and inputting the relation with the vectorSame space data vector cipherSo thatWhen the password is not decrypted, the password is decrypted;
step S320: extracting information in the space block after password unlocking to obtain initial space block data, wherein the initial space block data comprises adjacent points N in the corresponding space blockiWith a landmark block number PmRubbing with each otherFlapping relation;
step S330: based on the adjacent point N in the spatial block in step S320iWith a landmark block number PmThe topological relation between the adjacent points N in all the space blocks is calculated by the density calculationiCalculation of average Density and Adjacent Point N within spatial BlockiAnd (4) calculating the actual density.
The password is unlocked by utilizing the set trigger unlocking numerical value, only one numerical value improves the safety of data extraction, and the density value calculation after information extraction is used for further evaluating the acquired spatial data information, so that the resource utilization rate is improved.
The specific process in step S330 is as follows:
step S331: establishing a two-dimensional coordinate axis for the irregular polygon image obtained in the step S110; the coordinates of a point on the irregular polygon image are (f)i,gi);
Step S332: based on the coordinates (f) in step S331i,gi) Selecting the minimum Minf of the abscissa of the point on the irregular polygon imageiA point on the Y coordinate axis and the minimum value Ming of the ordinateiEstablishing a rectangular coordinate system for one point on the X coordinate axis; defining the minimum Minf of the abscissaiMaximum value Maxf to abscissaiIs the length of the rectangle, defines the minimum value Ming of the ordinateiMaximum value Maxg to ordinateiIs the width of the rectangle, the coordinates within the rectangle containing all coordinates (f) within the irregular polygoni,gi);
The adjacent points of the irregular polygon are set on the X axis and the Y axis, quantitative analysis of the adjacent points of the polygon in a two-dimensional coordinate system is facilitated, all data of the irregular polygon belong to the first quadrant and are positive values, and convenience is brought to calculation.
Step S333: maximum value Maxf based on abscissa in step S332iMinimum MinfiAnd maximum value Maxg of ordinateiMinimum MingiCalculating the area of the rectangle as WMoment=(Maxfi-Minfi)×(Maxgi-Mingi) The rectangular area WMomentQuartering to obtain four new rectangular areas W', recording adjacent points N in all spatial blocksiThe number of coordinates of (a) is set C, using the formula: obtaining a single new lower adjacent point N with a rectangular area W ═ C/WiThe average density γ of;
the rectangular area of the whole body to which the polygon belongs is solved to carry out four equal parts, so that the analysis of the space blocks contained in the local rectangular area is facilitated, and each new rectangular area is equal, so that the deviation of the calculation density caused by different denominators can be avoided.
Step S334: let the new rectangle in step S332 be RjJ ═ {1,2,3,4}, four new rectangles are named as rectangles R clockwise from the origin of coordinates1Rectangle R2Rectangle R3And rectangle R4And is provided with a rectangle R1Has vertex coordinates of (0,0) and (0, Maxg)i/2)、(Maxfi/2,Maxgi/2)、(Maxfi2, 0); rectangle R2Has a vertex coordinate of (0, Maxg)i/2)、(0,Maxgi)、(Maxfi/2,Maxgi)、(Maxfi/2,Maxgi2); rectangle R3Has a vertex coordinate of (Maxf)i/2,Maxgi/2)、(Maxfi/2,Maxgi)、(Maxfi,Maxgi)、(MaxfiMax/2); rectangle R4Has a vertex coordinate of (Maxf)i/2,0)、(Maxfi/2,Maxgi/2)、(Maxfi,Maxgi/2)、(Maxfi,0);
The position coordinates of the four vertexes of the new rectangle are expressed, so that the analysis of the positions of the single adjacent points is facilitated, and the rectangle of the adjacent points is better determined.
Step S335: based on the adjacent point N in step S332iActual coordinates (f) ofi,gi) Respectively to the abscissa fiAnd ordinate giF is judged to be 0 < >i<<MaxfiAnd 0 < gi<<MaxgiObtaining the actual coordinates (f)i,gi) Belonging to a rectangle RjAnd storing the actual coordinates belonging to the rectangle into the corresponding rectangle set Pj(ii) a Using the formula:get each new rectangle RjActual adjacent point NiDensity value
And respectively comparing the abscissa and the ordinate of the adjacent point with the vertex coordinates of the four rectangles to judge the position of the adjacent point, and then respectively calculating the density in each rectangle to obtain the result, namely the density value of the adjacent point of the space block contained in each rectangle.
Step S336: the actual adjacent point N in step S335iDensity valueRespectively connected with adjacent points NiComparing the average density gamma of the two; if present, isThen the rectangle RjData information of the contained space block is scheduled toIs rectangular RjObtaining data information of a second space block from the contained space block; if each rectangle RjAre all internally provided withThe first space block data information is directly obtained without scheduling.
For example, an XY axis coordinate system is established, and the coordinates of the adjacent points of the pentagon are respectively: n is a radical of1(0,2),N2(1.5,1),N3(1.5,4.5),N4(2,2),N5(3.5,0),N6(3.5,5),N7(4,1),N8(5,3.5), four vertices of the rectangle are (0,0), (0,5), (5,5) and (0,5)5,0), the area W of the rectangleMomentNew rectangle area W 'is 6.25, calculated average density γ C/W' is 8/6.25 is 1.28; memory rectangle R1Has coordinates of (0,0), (0,2.5), (2.5,0), and a rectangle R2Has coordinates of (0,2.5), (0,5), (2.5 ), and a rectangle R3Has coordinates of (2.5 ), (2.5,5), (5,2.5), and a rectangle R4The coordinates of (2.5 ), (2.5,0), (5,2.5) and (5,0), comparing the adjacent point with the coordinates of the four rectangles, judging the rectangle to which the adjacent point belongs, if P is1={N1,N2,N4},P2={N3},P3={N6,N8},P4={N5,N7}, calculating And if the actual densities are all smaller than the average density, the data of the first space block does not need to be scheduled.
Setting spatial data information in a coordinate system, which is beneficial to quantitative analysis of adjacent points, wherein the adjacent points can be regarded as information key points in data acquisition, and when the information key points are densely distributed in a certain spatial area, the information key points can interfere with each other or data information of different resources cannot be reasonably utilized by other spaces, so that scheduling of the spatial data information is set; the scheduling basis is the density value of the space adjacent point, the acquired space data is integrally planned, the acquired space image data is not a regular image, so that the image regularization is favorable for performing density analysis on each space block to acquire an average value, the average value is used as a measurement standard, the calculation of average density values corresponding to different areas is favorable for performing effective measurement when facing space images under different conditions, the whole area is divided to calculate the actual density of each space, and information in a space block with too high density can be scheduled to a space block with lower density, so that the space data information resource is reasonably utilized, and the space block with lower density can continuously and effectively store data information.
Step S400: comparing the first spatial block data or the second spatial block data in the step S300 with the resource database, respectively; if the first spatial block data or the second spatial block data can be matched with the same spatial data, recording the frequency of the spatial data; and if the first spatial block data or the second spatial block data are not matched with the same spatial data, the resource database updates and records the first spatial block data or the second spatial block data.
The importance degree of the spatial information can be effectively judged by recording the frequency of the matched spatial data, and the resource abundance of the database can be increased by updating and recording the unmatched spatial information, so that the aim of reasonably sharing the resources is fulfilled.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that changes may be made in the embodiments and/or equivalents thereof without departing from the spirit and scope of the invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (8)
1. The spatial data analysis scheduling system applying big data analysis is characterized by comprising a spatial data acquisition module, a data receiving module, a spatial data analysis module and a result feedback module; the spatial data acquisition module is used for acquiring real-time spatial data of a target object and carrying out topology processing on the spatial data of the target object to obtain topology related data; the data receiving module is used for receiving the topology related data of the spatial data acquisition module and carrying out encryption processing to obtain encrypted spatial information; the spatial data analysis module is used for analyzing and processing the encrypted spatial information transmitted by the data receiving module; and the result feedback module is used for feeding back the result analyzed by the spatial data analysis module to the resource database unit.
2. The system and method for spatial data analysis scheduling using big data analysis according to claim 1, wherein: the spatial data acquisition module comprises a target detection unit and a resource database retrieval unit;
the target detection unit is used for acquiring basic spatial data information of a target object in real time in a mode that the spatial data acquisition module detects the target object;
the resource database retrieval unit is used for the spatial data acquisition module to extract the same spatial data information from the resource database unit in the result feedback module for direct utilization;
the spatial data acquisition module firstly utilizes the resource database retrieval unit to retrieve the target object, and if the resource database unit has the same target object, the spatial data is directly utilized; if the resource database unit does not have the same data as the target object, the spatial data acquisition module further starts the target detection unit to acquire the basic spatial data information of the target object.
3. The system and method for spatial data analysis scheduling using big data analysis according to claim 1, wherein: the spatial data analysis module comprises a data extraction unit and an analysis scheduling unit;
the data extraction unit decrypts the spatial data information encrypted by the data receiving unit and extracts the decrypted spatial data to obtain initial spatial block data; the analysis scheduling unit may simultaneously analyze the spatial information in the spatial data analysis module and the resource information in the resource database unit in the data feedback module, and perform data analysis scheduling on data in the spatial data analysis module and the resource database unit in the data feedback module.
4. The spatial data analysis scheduling method applying big data analysis is characterized by comprising the following steps of:
step S100: acquiring spatial data information, and if the spatial data information is existing, directly referring to the spatial data information; if the space data information is not the existing space data information, topology processing is carried out after the space data information is acquired, and topology related data are obtained;
step S200: continuously encrypting the topology related data obtained by processing in the step S100 to obtain encrypted processing data;
step S300: decrypting the encrypted data obtained in the step S200, and extracting information in the topology related data to obtain initial space block data; carrying out spatial analysis on the initial spatial block data to judge whether scheduling is needed; obtaining second space block data information through analysis scheduling processing, wherein data which is not analyzed and scheduled to be processed is first space block data information;
step S400: comparing the first spatial block data or the second spatial block data in the step S300 with a resource database, respectively; if the first spatial block data or the second spatial block data can be matched with the same spatial data, recording the frequency of the spatial data; and if the first spatial block data or the second spatial block data are not matched with the same spatial data, the resource database updates and records the first spatial block data or the second spatial block data.
5. The spatial data analysis scheduling method applying big data analysis according to claim 4, wherein: in the step S100, topology processing is performed on the acquired spatial data information to obtain topology-related data, where the topology-related data includes a topology relationship, and the specific process is as follows:
step S110: the acquired spatial data information comprises image structure information and land distribution information, wherein the image structure information is an irregular polygonal image formed by mutually adjoining m land parcels with different areas, m is a natural number, and the land distribution information comprises a mark P of the land parcelmAdjacent point N of land blocks with different areasiAnd the vector relation between adjacent pointsi={1,2,3......n};
Step S120: performing topology processing on the image structure information and the parcel distribution information in the step S110 to obtain the topological relation, where the topological relation includes a vector relationAnd parcel number PmTopological relation between, i.e. PmCorrespond toAnd adjacent point NiWith a landmark block number PmTopological relation between, i.e. PmCorresponding to the starting point Ni+dAnd endpoint Ni+eB, c, d and e all belong to natural numbers;
step S130: relating the different vectors in the step S120And parcel number PmThe topological relation between the two is taken as a set A, the orientation quantity relationAre respectively marked as a set BiRespectively calculating the specific gravities of different elements
Step S140: based on the specific gravity G of different elements in the step S130iThe land parcel is marked with the number PmSpecific gravity G of different elements iniAnd adding and summing, namely dividing the sum into an m space block set according to the proportion relation after summing, wherein the m space block set is a first space block and a second space block which have the summing proportion sequenced from large to small.
6. The spatial data analysis scheduling method applying big data analysis according to claim 5, wherein: the encryption processing data includes a spatial data similarity password, and the specific process of step S200 is as follows:
step S210: receiving the m-space block set information in step S140, and extracting the vector relationship of each space block in the m-space block setSetting a known data vector password as a system;
step S220: respectively setting space data similarity passwords for each space block in the m space block set, wherein the space data similarity passwords comprise known data vector passwords set by a systemSpatial data vector password with unknown input unlock contentThe system sets a known data vector cipherVector relationships for spatial blocks
Step S230: using cosine similarity metric spaceData similarity, cosine similarity measures the system setting known data vector password by calculating the cosine angle between vectorsSpatial data vector password with unknown input unlock contentThe similarity between them; is provided withAndthe similarity between them isThenThe calculation is as follows:
7. the spatial data analysis scheduling method applying big data analysis according to claim 6, wherein: the specific process in step S300 is as follows:
step S310: decrypting the data similarity password in the step S220, and inputting the relation with the vectorSame space data vector cipherSo thatWhen the password is not decrypted, the password is decrypted;
step S320: extracting information in the space block after password unlocking to obtain initial space block data, wherein the initial space block data comprises adjacent points N in the corresponding space blockiWith a landmark block number PmTopological relation between them;
step S330: based on the adjacent point N in the spatial block in the step S320iWith a landmark block number PmThe topological relation between the adjacent points N in all the space blocks is calculated by the density calculationiCalculation of average Density and Adjacent Point N within spatial BlockiAnd (4) calculating the actual density.
8. The spatial data analysis scheduling method applying big data analysis according to claim 7, wherein: the specific process in step S330 is as follows:
step S331: establishing a two-dimensional coordinate axis for the irregular polygon image obtained in the step S110; the coordinates of a point on the irregular polygon image are set to (f)i,gi);
Step S332: based on the coordinates (f) in the step S331i,gi) Selecting the minimum Minf of the abscissa of the point on the irregular polygon imageiA point on the Y coordinate axis and the minimum value Ming of the ordinateiEstablishing a rectangular coordinate system for one point on the X coordinate axis; defining the minimum Minf of the abscissaiMaximum value Maxf to abscissaiIs the length of the rectangle, defines the minimum value Ming of the ordinateiMaximum value Maxg to ordinateiIs the width of a rectangle, the coordinates within the rectangle containing all coordinates (f) within an irregular polygoni,gi);
Step S333: a maximum value Maxf based on the abscissa in the step S332iMinimum MinfiAnd maximum value Maxg of ordinateiMinimum MingiCalculating the area of the rectangle as WMoment=(Maxfi-Minfi)×(Maxgi-Mingi) The rectangular area WMomentQuartering to obtain four new rectangular areas W', recording adjacent points N in all spatial blocksiThe number of coordinates of (a) is set C, using the formula: obtaining a single new lower adjacent point N with a rectangular area W ═ C/WiThe average density γ of;
step S334: note that the new rectangle in step S332 is RjJ ═ {1,2,3,4}, four new rectangles are named as rectangles R clockwise from the origin of coordinates1Rectangle R2Rectangle R3And rectangle R4And is provided with a rectangle R1Has vertex coordinates of (0,0) and (0, Maxg)i/2)、(Maxfi/2,Maxgi/2)、(Maxfi2, 0); rectangle R2Has a vertex coordinate of (0, Maxg)i/2)、(0,Maxgi)、(Maxfi/2,Maxgi)、(Maxfi/2,Maxgi2); rectangle R3Has a vertex coordinate of (Maxf)i/2,Maxgi/2)、(Maxfi/2,Maxgi)、(Maxfi,Maxgi)、(MaxfiMax/2); rectangle R4Has a vertex coordinate of (Maxf)i/2,0)、(Maxfi/2,Maxgi/2)、(Maxfi,Maxgi/2)、(Maxfi,0);
Step S335: based on the adjacent point N in the step S332iActual coordinates (f) ofi,gi) Respectively to the abscissa fiAnd ordinate giF is judged to be 0 < >i<<MaxfiAnd 0 < gi<<MaxgiObtaining the actual coordinates (f)i,gi) Belonging to a rectangle RjAnd storing the actual coordinates belonging to the rectangle into the corresponding rectangle set Pj(ii) a Using the formula:get each new rectangle RjActual adjacent point NiDensity value
Step S336: the actual adjacent point N in the step S335 is determinediDensity valueRespectively connected with adjacent points NiComparing the average density gamma of the two; if present, isThen the rectangle RjData information of the contained space block is scheduled toIs rectangular RjObtaining data information of a second space block from the contained space block; if each rectangle RjAre all internally provided withThe first space block data information is directly obtained without scheduling.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111295713.1A CN114003956B (en) | 2021-11-03 | 2021-11-03 | Spatial data analysis scheduling system and method applying big data analysis |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111295713.1A CN114003956B (en) | 2021-11-03 | 2021-11-03 | Spatial data analysis scheduling system and method applying big data analysis |
Publications (2)
Publication Number | Publication Date |
---|---|
CN114003956A true CN114003956A (en) | 2022-02-01 |
CN114003956B CN114003956B (en) | 2022-10-25 |
Family
ID=79926984
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202111295713.1A Active CN114003956B (en) | 2021-11-03 | 2021-11-03 | Spatial data analysis scheduling system and method applying big data analysis |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114003956B (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050132149A1 (en) * | 2003-12-11 | 2005-06-16 | W. Daniel Hillis | Spatial-to-temporal data translation and scheduling and control |
CN103136214A (en) * | 2011-11-24 | 2013-06-05 | 中国移动通信集团公司 | Scheduling method and system and equipment of spatial data |
CN103870591A (en) * | 2014-03-28 | 2014-06-18 | 武汉聪源科技有限责任公司 | Method and system for carrying out parallel spatial analysis service based on spatial data |
CN110750608A (en) * | 2019-10-10 | 2020-02-04 | 浪潮软件股份有限公司 | Spatial data analysis automatic scheduling method based on rule base |
CN111666313A (en) * | 2020-05-25 | 2020-09-15 | 中科星图股份有限公司 | Correlation construction and multi-user data matching method based on multi-source heterogeneous remote sensing data |
CN113515600A (en) * | 2021-09-13 | 2021-10-19 | 速度时空信息科技股份有限公司 | Automatic calculation method for spatial analysis based on metadata |
-
2021
- 2021-11-03 CN CN202111295713.1A patent/CN114003956B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050132149A1 (en) * | 2003-12-11 | 2005-06-16 | W. Daniel Hillis | Spatial-to-temporal data translation and scheduling and control |
CN103136214A (en) * | 2011-11-24 | 2013-06-05 | 中国移动通信集团公司 | Scheduling method and system and equipment of spatial data |
CN103870591A (en) * | 2014-03-28 | 2014-06-18 | 武汉聪源科技有限责任公司 | Method and system for carrying out parallel spatial analysis service based on spatial data |
CN110750608A (en) * | 2019-10-10 | 2020-02-04 | 浪潮软件股份有限公司 | Spatial data analysis automatic scheduling method based on rule base |
CN111666313A (en) * | 2020-05-25 | 2020-09-15 | 中科星图股份有限公司 | Correlation construction and multi-user data matching method based on multi-source heterogeneous remote sensing data |
CN113515600A (en) * | 2021-09-13 | 2021-10-19 | 速度时空信息科技股份有限公司 | Automatic calculation method for spatial analysis based on metadata |
Also Published As
Publication number | Publication date |
---|---|
CN114003956B (en) | 2022-10-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111199214B (en) | Residual network multispectral image ground object classification method | |
CN109141426B (en) | Method for matching navigation adaptation area by underwater gravity | |
US8320682B2 (en) | Evaluation of edge direction information | |
CN113344956B (en) | Ground feature contour extraction and classification method based on unmanned aerial vehicle aerial photography three-dimensional modeling | |
Mikhail et al. | Detection and sub-pixel location of photogrammetric targets in digital images | |
CN110033484A (en) | Set high extracting method to the high closed forest sample of a kind of combination UAV image and TLS point cloud | |
CN110363299B (en) | Spatial case reasoning method for outcrop rock stratum layering | |
CN115358486B (en) | Port freight volume prediction method, system and application based on stereoscopic satellite images | |
CN106067172A (en) | A kind of underwater topography image based on suitability analysis slightly mates and mates, with essence, the method combined | |
CN112229403A (en) | Method for improving marine gravity reconstruction precision based on geodetic level three-dimensional correction principle | |
CN116030352B (en) | Long-time-sequence land utilization classification method integrating multi-scale segmentation and super-pixel segmentation | |
CN109671109A (en) | Point off density cloud generation method and system | |
CN114003956B (en) | Spatial data analysis scheduling system and method applying big data analysis | |
CN113436223A (en) | Point cloud data segmentation method and device, computer equipment and storage medium | |
Marques et al. | Crater delineation by dynamic programming | |
CN111192302A (en) | Feature matching method based on motion smoothness and RANSAC algorithm | |
Hashemian et al. | Study of sampling methods for accuracy assessment of classified remotely sensed data | |
CN114266138B (en) | Method for recognizing and verifying urban edge area by using cloud data | |
CN104616302A (en) | Real-time object identification method | |
CN113079468A (en) | Indoor positioning method and system based on Wifi signal RSSI (received Signal Strength indicator) characteristics | |
CN111598036A (en) | Urban group geographic environment knowledge base construction method and system of distributed architecture | |
CN110909067A (en) | Visual analysis system and method for ocean multidimensional data | |
Makarenko et al. | Analysis of terrestrial radioactive contamination | |
Gaffar et al. | Prediction of the Topographic Shape of the Ground Surface Using IDW Method through the Rectangular-Neighborhood Approach | |
CN117952322B (en) | Engineering management system based on BIM technology |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |