CN109284263A - A kind of the point cloud chart browsing method and relevant apparatus of LAS file - Google Patents

A kind of the point cloud chart browsing method and relevant apparatus of LAS file Download PDF

Info

Publication number
CN109284263A
CN109284263A CN201811158461.6A CN201811158461A CN109284263A CN 109284263 A CN109284263 A CN 109284263A CN 201811158461 A CN201811158461 A CN 201811158461A CN 109284263 A CN109284263 A CN 109284263A
Authority
CN
China
Prior art keywords
file
las
coordinate
point cloud
cloud chart
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811158461.6A
Other languages
Chinese (zh)
Inventor
黄文琦
明哲
许爱东
严叶舟
蒋屹新
陈华军
杨航
关泽武
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CSG Electric Power Research Institute
China Southern Power Grid Co Ltd
Research Institute of Southern Power Grid Co Ltd
Original Assignee
China Southern Power Grid Co Ltd
Research Institute of Southern Power Grid Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Southern Power Grid Co Ltd, Research Institute of Southern Power Grid Co Ltd filed Critical China Southern Power Grid Co Ltd
Priority to CN201811158461.6A priority Critical patent/CN109284263A/en
Publication of CN109284263A publication Critical patent/CN109284263A/en
Pending legal-status Critical Current

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

This application discloses a kind of point cloud chart browsing methods of LAS file, comprising: from the interior access shared file, LAS file each in shared file is carried out information deconsolidation process, multiple elements is obtained, all elements is stored in RDD;Coordinate extraction process is carried out to all elements in RDD by multiple nodes of Spark frame, multiple groups coordinate data is obtained, all coordinate datas is stored in new RDD in the form of element;Element each in new RDD is formatted according to text file form, obtains multiple coordinate text files, all coordinate text files are stored in ALLuxio, so that terminal gets corresponding coordinate text file from ALLuxio, and carry out browsing displaying.The coordinate data extraction rate in LAS file is improved by ALLuxio and Spark, the delay of the point cloud chart browsing of LAS file is reduced, improves browse efficiency.

Description

A kind of the point cloud chart browsing method and relevant apparatus of LAS file
Technical field
This application involves field of computer technology, in particular to a kind of point cloud chart browsing method, the point cloud chart of LAS file are clear Look at system, server and computer readable storage medium.
Background technique
With the continuous development of robot technology, can be used during power grid maintenance and management power grid robot into Row corresponding operation.During in the specific time, after needing to analyze power grid robot data, directly browse in the terminal Corresponding point cloud chart piece, that is, the coordinate data for needing terminal to get a cloud.Currently, point cloud coordinate data mainly from Corresponding coordinate data is extracted in provided data i.e. LAS file when power grid robot manipulating task.
Since LAS file data volume itself is bigger, and user needs non-when browsing very intuitive point cloud chart piece Often big pageview, therefore just need to extract from a large amount of LAS file to need point cloud data.In the prior art, due to preceding The browser at end can not directly read corresponding LAS file, need to extract the coordinate of LAS file on backstage, be supplied to Browser is shown.
But since LAS file content is complicated, data volume is very big, and formatting to a large amount of LAS file is ten Divide time-consuming.For example, there is 30 terminals to browse LAS file, each terminal also needs to browse multiple and different clouds every time File, if the backstage that these LAS files are placed on server handled, the speed that terminal browses point cloud chart piece is lower, Also can be larger for the processing pressure on backstage, whole flow path efficiency is lower in the process flow.
Therefore, the Important Problems that the point cloud chart browse efficiency of LAS file is those skilled in the art's concern how to be improved.
Summary of the invention
The purpose of the application be to provide a kind of point cloud chart browsing method of LAS file, point cloud chart browsing system, server with And computer readable storage medium, LAS file is stored by ALLuxio, reuses Spark frame in LAS file Coordinate data extract, accelerate reading and the storage speed of a large amount of LAS files, and can be improved in LAS file Coordinate data extraction rate reduces the delay of the point cloud chart browsing of LAS file, improves browse efficiency.
In order to solve the above technical problems, the application provides a kind of point cloud chart browsing method of LAS file, comprising:
Original LAS files multiple in ALLuxio are read out according to default library, multiple LAS files are obtained, by all institutes LAS file is stated to be saved in a text format in the shared file of memory;
From the interior access shared file, LAS file each in the shared file is subjected to information deconsolidation process, Multiple elements are obtained, all elements are stored in RDD;Wherein, the element includes the file home subscriber of LAS file Name, file absolute path and LAS information;
Coordinate extraction process is carried out to all elements in RDD by multiple nodes of Spark frame, obtains multiple groups All coordinate datas are stored in new RDD by coordinate data in the form of element;
Each element in the new RDD is formatted according to text file form, obtains multiple coordinate text texts All coordinate text files are stored in the ALLuxio, so that terminal gets correspondence from the ALLuxio by part Coordinate text file, and carry out browsing displaying.
Optionally, terminal gets corresponding coordinate text file from the ALLuxio, and carries out browsing displaying, packet It includes:
The terminal gets corresponding coordinate text file in the form of streaming from the ALLuxio, and to the seat Mark text file carries out browsing displaying.
Optionally, browsing displaying is carried out, comprising:
The terminal carries out point cloud chart drawing modification according to the coordinate text file, will obtain point cloud chart and shows, To complete browse operation.
Optionally, further includes:
After the terminal exits the browse operation of the point cloud chart, the coordinate text file is deleted.
The application also provides a kind of point cloud chart browsing system of LAS file, comprising:
Shared file obtains module, for being read out according to default library to original LAS files multiple in ALLuxio, obtains To multiple LAS files, all LAS files are saved in a text format in the shared file of memory;
LAS file declustering processing module is used for from the interior access shared file, will be each in the shared file LAS file carries out information deconsolidation process, obtains multiple elements, all elements are stored in RDD;
Coordinate extraction process module carries out all elements in RDD for multiple nodes by Spark frame Coordinate extraction process obtains multiple groups coordinate data, and all coordinate datas are stored in new RDD in the form of element;
Coordinate data format converting module, for element each in the new RDD to be carried out lattice according to text file form Formula conversion, obtains multiple coordinate text files, all coordinate text files is stored in the ALLuxio, so as to terminal Corresponding coordinate text file is got from the ALLuxio, and carries out browsing displaying.
Optionally, the coordinate data format converting module, further includes:
Display unit is browsed, for carrying out point cloud chart drawing modification according to the coordinate text file, point cloud chart will be obtained It is shown, to complete browse operation.
The application also provides a kind of server characterized by comprising
Memory, for storing computer program;
Processor, the step of point cloud chart browsing method as described above is realized when for executing the computer program.
The application also provides a kind of computer readable storage medium, and calculating is stored on the computer readable storage medium The step of machine program, the computer program realizes point cloud chart browsing method as described above when being executed by processor.
The point cloud chart browsing method of a kind of LAS file provided herein, comprising: according to default library in ALLuxio Multiple original LAS files are read out, and obtain multiple LAS files, all LAS files are saved in a text format interior In the shared file deposited;From the interior access shared file, LAS file each in shared file progress information is torn open Divide processing, obtains multiple elements, all elements are stored in RDD;Wherein, the element includes the file of LAS file Home subscriber name, file absolute path and LAS information;By multiple nodes of Spark frame to all elements in RDD Coordinate extraction process is carried out, multiple groups coordinate data is obtained, all coordinate datas is stored in new RDD in the form of element In;Each element in the new RDD is formatted according to text file form, obtains multiple coordinate text files, it will All coordinate text files are stored in the ALLuxio, so that terminal gets corresponding coordinate from the ALLuxio Text file, and carry out browsing displaying.
A large amount of LAS file is read out and is stored by ALLuxio distributed memory system, due to ALLuxio sheet Body is written and read based on memory, the speed of reading and the storage of LAS file can be improved, then pass through the multiple of Spark frame Node carries out corresponding data extraction to LAS file, accelerates the extraction rate to the middle coordinate data of all LAS files, and Spark frame is to save centre output result in memory, to a large amount of LAS files suitable for the application in calculating process The case where data are operated generally speaking accelerates LAS file in data storage and data processing stage in the application Read or write speed and processing speed reduce time-consuming when handling a large amount of LAS files, improve the coordinate extraction rate of LAS file, into And promote efficiency when browsing to point cloud chart.
The application also provides point cloud chart browsing system, server and the computer readable storage medium of a kind of LAS file, With the above beneficial effect, this will not be repeated here.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this The embodiment of application for those of ordinary skill in the art without creative efforts, can also basis The attached drawing of offer obtains other attached drawings.
Fig. 1 is a kind of flow chart of the point cloud chart browsing method of LAS file provided by the embodiment of the present application;
Fig. 2 is a kind of structural schematic diagram of the point cloud chart browsing system of LAS file provided by the embodiment of the present application.
Specific embodiment
The core of the application be to provide a kind of point cloud chart browsing method of LAS file, point cloud chart browsing system, server with And computer readable storage medium, LAS file is stored by ALLuxio, reuses Spark frame in LAS file Coordinate data extract, accelerate reading and the storage speed of a large amount of LAS files, and can be improved in LAS file Coordinate data extraction rate reduces the delay of the point cloud chart browsing of LAS file, improves browse efficiency.
To keep the purposes, technical schemes and advantages of the embodiment of the present application clearer, below in conjunction with the embodiment of the present application In attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is Some embodiments of the present application, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art Every other embodiment obtained without making creative work, shall fall in the protection scope of this application.
(LAS is that the airborne laser radar under american photography measurement and remote sensing mechanism measured the committee in 2003 to usual LAS The airborne lidar measurement data format of the standard of publication) file be in addition to that can carry out statistical place to data therein Reason, obtains statistical result.It is depicted as point cloud chart further, it is also possible to which the coordinate data of LAS file is extracted, for technology people Member carries out browsing viewing.
In the prior art, LAS file can not be handled for browsing the client of point cloud chart, is needed in ordinary circumstance LAS file is stored in backstage to handle, obtains the file about coordinate points, is carried out according to the coordinate point data in this document The drafting of point cloud chart obtains the point cloud chart for browsing.But LAS file data volume itself is huger, also, browses point It needs a large amount of coordinate data to support point cloud chart when cloud atlas, therefore just needs to handle a large amount of LAS file, and LAS text Part content is complicated, is handled by backstage LAS file, and efficiency is extremely low, time-consuming more long, that is, improves point cloud chart clear Delay when looking at, reduces efficiency.
Therefore, the embodiment of the present application provides a kind of point cloud chart browsing method of LAS file, is deposited by ALLuxio distribution A large amount of LAS file is read out and is stored by storage system, due to being written and read based on memory for ALLuxio itself, Ke Yiti The speed of reading and the storage of high LAS file, then corresponding data are carried out to LAS file by multiple nodes of Spark frame It extracts, accelerates the extraction rate to the middle coordinate data of all LAS files, and Spark frame is by in calculating process Between output result save in memory, the case where operation suitable for the application to a large amount of LAS file datas, generally speaking The read or write speed and processing speed for accelerating LAS file in the application in data storage and data processing stage, when processing is big Time-consuming is reduced when measuring LAS file, improves the coordinate extraction rate of LAS file, and then promoted when browsing to point cloud chart Efficiency.
Referring to FIG. 1, Fig. 1 is a kind of process of the point cloud chart browsing method of LAS file provided by the embodiment of the present application Figure.
This method may include:
S101 is read out original LAS files multiple in ALLuxio according to default library, obtains multiple LAS files, will All LAS files are saved in a text format in the shared file of memory;
This step is intended to be read out original LAS file according to default library, will read result and is stored in shared file. Wherein, default library can be C++ (programming language) corresponding LAS document analysis library, and it is right to be also possible to Python (programming language) The library LASIO answered.Wherein, reading process mainly is read out to obtain data information to original LAS file, by corresponding data Information is stored in shared file as LAS file.
Wherein, the shared file saved in memory is saved in the form of chained list, and each element in chained list is equal The information for saving a LAS file, by the file that the multiple users of this storage of linked list are submitted, therefore this chained list is referred to as shared text Part.
Wherein, ALLuxio is a distributed file system highly fault tolerant, allows file with the speed of memory in cluster frame It is reliably shared in frame.More than 300 times of the handling capacity ratio HDFS high of Alluxio.Alluxio is that processing is slow in memory Deposit file, and allow different frame can the speed of memory access cache file.Spark can just be made by ALLuxio Capable caching is deposited within frame, improves the reading speed of data.Also, ALLuxio is suitable for the reading and storage of big data quantity, Therefore it can be very good to improve the reading speed of original LAS file in this step.
LAS file each in shared file is carried out information deconsolidation process, obtained by S102 from the interior access shared file To multiple elements, all elements are stored in RDD;Wherein, element includes that the file home subscriber name of LAS file, file are exhausted To path and LAS information;
Calculative LAS file is mainly got in this step from memory, and the LAS file is carried out simple Pretreatment, that is, deconsolidation process, pretreated result is saved with the storage form of Spark frame.
Wherein, shared file is to save the chained list of multiple LAS files in memory, can be carried out in memory by multiple users Operation, that is, when multiple users need to carry out coordinate extraction to different LAS file can will send instructions under these users LAS file is both placed in shared file, is read out simultaneously.It avoids the occurrence of LAS file process task and needs the case where being lined up.
Further, the LAS file in shared file is subjected to information deconsolidation process in this step, obtains multiple elements. Namely file home subscriber name, file absolute path and the LAS information in LAS file are extracted as an element list Position is stored in RDD.Therefore, each element also just include the file home subscriber name of LAS file, file absolute path and LAS information, wherein LAS information refers to the LAS information of completion.
Wherein, the RDD (Resilient Distributed Dataset) of this step is called elasticity distribution formula data set, It is data abstraction most basic in Spark frame.Element in RDD can carry out parallel computation, improve the processing speed of data Degree.
S103 passes through a kind of Spark (computing engines for the Universal-purpose quick for aiming at large-scale data processing design) frame Multiple nodes in RDD all elements carry out coordinate extraction process, obtain multiple groups coordinate data, by all coordinate datas with The form of element is stored in new RDD;
Step S102 is mainly the preparation stage that Spark frame is calculated, therefore, on the basis of step S101, This step is intended to extract operation to the coordinate data in all elements by Spark frame.Extraction operation is mainly extracted XYZ coordinate data in LAS information, after obtaining XYZ coordinate data using file home subscriber name and file absolute path as One new element is stored into new RDD.
The RDD and element of all steps are using memory as the storage medium of caching in the present embodiment, to improve number According to reading speed and efficiency.
Wherein, XYZ coordinate is three-dimensional coordinate.
S104 formats element each in new RDD according to text file form, obtains multiple coordinate text texts All coordinate text files are stored in ALLuxio by part, so that terminal gets corresponding coordinate text text from ALLuxio Part, and carry out browsing displaying.
On the basis of step S103, this step is intended to that element each in RDD is carried out format in the form of text file Conversion, obtains multiple coordinate text files, all coordinate text files is stored in ALLuxio, terminal can be from ALLuxio The coordinate text file after extracting is got, the drafting and displaying of point cloud chart are carried out.
It should be noted that can be " user name _ correspondence by file designation to be easily managed coordinate text file The form of las filename ".
Terminal in this step gets corresponding coordinate text file from ALLuxio, and carries out browsing displaying, can be with Include:
Terminal gets corresponding coordinate text file in the form of streaming from ALLuxio, and to coordinate text file into Row browsing is shown.
Wherein, coordinate text file is got in the form of streaming mainly transmits phase in the form of data flow in a browser The data answered.
Browsing displaying is carried out in this step, comprising:
Terminal carries out point cloud chart drawing modification according to coordinate text file, will obtain point cloud chart and shows, to complete Browse operation.
This step is intended to carry out the drawing modification of point cloud chart according to coordinate text file, obtains point cloud chart.And by the cloud Figure is shown in the terminal, to complete browse operation.
This step can also include:
After terminal exits the browse operation of point cloud chart, coordinate text file is deleted.
This step is intended to delete coordinate text file after exiting the browse operation of point cloud chart.
To sum up, a large amount of LAS file is read out and is stored by ALLuxio distributed memory system by the present embodiment, Due to being written and read based on memory for ALLuxio itself, the speed of reading and the storage of LAS file can be improved, then pass through Multiple nodes of Spark frame carry out corresponding data extraction to LAS file, accelerate the middle coordinate data to all LAS files Extraction rate, and Spark frame be in calculating process by centre output result save in memory, be suitable for the application In the case where a large amount of LAS file datas are operated, it is generally speaking equal in data storage and data processing stage in the application The read or write speed and processing speed for accelerating LAS file reduce time-consuming when handling a large amount of LAS files, improve LAS file Coordinate extraction rate, and then promote efficiency when browsing to point cloud chart.
Based on the point cloud chart browsing method of a upper embodiment, the embodiment of the present application also provides a kind of depositing for processing LAS file Storage system improves the processing speed of LAS file so that the processing for reducing LAS file is time-consuming.
The system may include: HDFS, Alluxio and the MongoDB (data based on distributed document storage Library).Wherein, HDFS mainly uses store data long term, and receives the related data of user's upload.Alluxio is mainly used for depositing Storage carries out the data of operation calculating, is used to store the LAS file after decompression in the present embodiment.MongoDB is for storing Structural data.
The present embodiment it is specifically used during, can have following steps:
Step 1, it is contemplated that the file type that user is uploaded can be a large amount of small documents, if carrying out to this class file large quantities of The upload of amount, it may be desirable to which a large amount of uplink time influences execution efficiency.So present system provides for compressed file upload Mode allows user to upload the compressed file for needing the All Files uploaded to be packaged into ZIP format, completes to upload Afterwards, by file storage into HDFS.
Step 2, when file is completely stored in HDFS after corresponding User Catalog, system will be automatically to compressed file It is decompressed to obtain and identical file structure before user's compression.And this document structure is stored in MongoDB.
Step 3, it is contemplated that user needs to operate oneself file in browser front end, and system is needed user's File structure carries out traversal spanning tree and feeds back to front end.But if bibliographic structure is excessively complicated, ergodic process will be delayed very much Slowly.Therefore we used the modes that file traversal is combined with database, and obtained bibliographic structure is stored in database, come Traversal time is greatly decreased.Concrete operations are: obtaining the file structure that user currently uploads;Before reading user in database File structure, in the file structure before current file structure is spliced to;Obtained new file structure is stored in number According in library;Obtained new file structure is back to front end to show.Reduce the time for obtaining file structure.
Step 4, to improve System Error-tolerance Property, bibliographic structure can all be examined when obtaining bibliographic structure every time It tests, unknown cause causes data base directory and the unmatched situation of HDFS catalogue in order to prevent.Concrete operations are: reading from database After taking the file structure at family, the first-level nodes of file structure are obtained;It reads again most top under User Catalog in HDFS File structure;Obtain two kinds of structures are compared, if there is unmatched situation, then using HDFS as reference object, Extra node in database is deleted, or addition lacks node.
Step 5, the LAS file for extracting user's upload, it is transferred in Alluxio from HDFS and is stored, after accelerating The speed that continuous data are extracted.
Optionally, step 5 may include:
Backstage the LAS file for needing to convert is selected from Alluxio according to obtained index.Due to currently used LAS File, which reads tool, two kinds of C++ (a kind of programming language) and a kind of Python (programming language), and Python is in terms of big data It is supportive to be higher than C++, therefore the reading tool of Python is used to obtain LAS file internals.Using LASIO (function library name) library The index of acquisition is read one by one, by the data information that each file is read be deposited into a text format one it is shared File internal, and using " the absolute path & of & user name and file " as boundary standard.It prevents because file data is shared Cause error in data or loss.For shared file, provided with one second retention periods, in a retention periods, own The convert file that user submits will be all stored in current shared file.When retention time reach one second and the last one Write operation is completed, and the shared file is just transferred to Spark and is converted, then a newly-built shared file is subsequent for saving The file information, until not new until carrying out the LAS file handled.
The embodiment of the present application provides a kind of storage system for handling LAS file, by combining HDFS, Alluxio with And MongoDB three's storage organization, the excessive situation of processing data volume, such as the treatment process of LAS file can be coped with, is reduced The time-consuming of Data processing, improves document processing speeds.
A kind of point cloud chart browsing system of LAS file provided by the embodiments of the present application is introduced below, is described below A kind of LAS file point cloud chart browsing system and a kind of above-described point cloud chart browsing method of LAS file can be mutual right It should refer to.
Referring to FIG. 2, Fig. 2 is a kind of structure of the point cloud chart browsing system of LAS file provided by the embodiment of the present application Schematic diagram.
The system may include:
Shared file obtains module 100, for being read out according to default library to multiple original LAS files, obtains multiple All LAS files are saved in shared file by LAS file in a text format;
LAS file declustering processing module 200, for accessing the shared file from interior, by LAS text each in shared file Part carries out information deconsolidation process, obtains multiple elements, all elements are stored in RDD;
Coordinate extraction process module 300 carries out all elements in RDD for multiple nodes by Spark frame Coordinate extraction process obtains multiple groups coordinate data, and all coordinate datas are stored in new RDD in the form of element;
Coordinate data format converting module 400, for element each in new RDD to be carried out format according to text file form Conversion, obtains multiple coordinate text files, all coordinate text files is stored in ALLuxio, so that terminal is from ALLuxio Corresponding coordinate text file is got, and carries out browsing displaying.
Optionally, the coordinate data format converting module 400 can also include:
Display unit is browsed, for carrying out point cloud chart drawing modification according to coordinate text file, point cloud chart progress will be obtained It has been shown that, to complete browse operation.
The embodiment of the present application also provides a kind of server, comprising:
Memory, for storing computer program;
Processor realizes point cloud chart browsing method as described above in Example when for executing the computer program Step.
The embodiment of the present application also provides a kind of computer readable storage medium, stores on the computer readable storage medium There is computer program, the computer program realizes point cloud chart browsing method as described above in Example when being executed by processor The step of.
The computer readable storage medium may include: USB flash disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic or disk etc. is various to deposit Store up the medium of program code.
Each embodiment is described in a progressive manner in specification, the highlights of each of the examples are with other realities The difference of example is applied, the same or similar parts in each embodiment may refer to each other.For device disclosed in embodiment Speech, since it is corresponded to the methods disclosed in the examples, so being described relatively simple, related place is referring to method part illustration ?.
Professional further appreciates that, unit described in conjunction with the examples disclosed in the embodiments of the present disclosure And algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered Think beyond scope of the present application.
The step of method described in conjunction with the examples disclosed in this document or algorithm, can directly be held with hardware, processor The combination of capable software module or the two is implemented.Software module can be placed in random access memory (RAM), memory, read-only deposit Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technology In any other form of storage medium well known in field.
System, server are browsed to a kind of point cloud chart browsing method of LAS file provided herein, point cloud chart above And computer readable storage medium is described in detail.Used herein principle and implementation of the specific case to the application Mode is expounded, the description of the example is only used to help understand the method for the present application and its core ideas.It should It points out, it for those skilled in the art, can also be to this Shen under the premise of not departing from the application principle Please some improvement and modification can also be carried out, these improvement and modification are also fallen into the protection scope of the claim of this application.

Claims (8)

1. a kind of point cloud chart browsing method of LAS file characterized by comprising
Original LAS files multiple in ALLuxio are read out according to default library, obtain multiple LAS files, it will be all described LAS file is saved in a text format in the shared file of memory;
The shared file is read from the memory, LAS file each in the shared file is subjected to information deconsolidation process, is obtained To multiple elements, all elements are stored in RDD;Wherein, the element includes the file home subscriber of LAS file Name, file absolute path and LAS information;
Coordinate extraction process is carried out to all elements in RDD by multiple nodes of Spark frame, obtains multiple groups coordinate All coordinate datas are stored in new RDD by data in the form of element;
Each element in the new RDD is formatted according to text file form, obtains multiple coordinate text files, it will All coordinate text files are stored in the ALLuxio, so that terminal gets corresponding coordinate from the ALLuxio Text file, and carry out browsing displaying.
2. point cloud chart browsing method according to claim 1, which is characterized in that terminal is got from the ALLuxio Corresponding coordinate text file, and carry out browsing displaying, comprising:
The terminal gets corresponding coordinate text file in the form of streaming from the ALLuxio, and to the coordinate text This document carries out browsing displaying.
3. point cloud chart browsing method according to claim 1, which is characterized in that carry out browsing displaying, comprising:
The terminal carries out point cloud chart drawing modification according to the coordinate text file, will obtain point cloud chart and shows, so as to Complete browse operation.
4. point cloud chart browsing method according to claim 3, which is characterized in that further include:
After the terminal exits the browse operation of the point cloud chart, the coordinate text file is deleted.
5. a kind of point cloud chart of LAS file browses system characterized by comprising
Shared file obtains module, for being read out according to default library to original LAS files multiple in ALLuxio, obtains more All LAS files are saved in the shared file of memory by a LAS file in a text format;
LAS file declustering processing module, for accessing the shared file from interior, by LAS file each in the shared file Information deconsolidation process is carried out, multiple elements is obtained, all elements is stored in RDD;
Coordinate extraction process module carries out coordinate to all elements in RDD for multiple nodes by Spark frame Extraction process obtains multiple groups coordinate data, and all coordinate datas are stored in new RDD in the form of element;
Coordinate data format converting module turns for element each in the new RDD to be carried out format according to text file form It changes, obtains multiple coordinate text files, all coordinate text files are stored in the ALLuxio, so that terminal is from institute It states and gets corresponding coordinate text file in ALLuxio, and carry out browsing displaying.
6. point cloud chart according to claim 5 browses system, which is characterized in that the coordinate data format converting module, Further include:
Display unit is browsed, for carrying out point cloud chart drawing modification according to the coordinate text file, point cloud chart progress will be obtained It has been shown that, to complete browse operation.
7. a kind of server characterized by comprising
Memory, for storing computer program;
Processor realizes such as Claims 1-4 described in any item point cloud chart browsing sides when for executing the computer program The step of method.
8. a kind of computer readable storage medium, which is characterized in that be stored with computer on the computer readable storage medium Program realizes such as Claims 1-4 described in any item point cloud chart browsing methods when the computer program is executed by processor The step of.
CN201811158461.6A 2018-09-30 2018-09-30 A kind of the point cloud chart browsing method and relevant apparatus of LAS file Pending CN109284263A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811158461.6A CN109284263A (en) 2018-09-30 2018-09-30 A kind of the point cloud chart browsing method and relevant apparatus of LAS file

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811158461.6A CN109284263A (en) 2018-09-30 2018-09-30 A kind of the point cloud chart browsing method and relevant apparatus of LAS file

Publications (1)

Publication Number Publication Date
CN109284263A true CN109284263A (en) 2019-01-29

Family

ID=65182236

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811158461.6A Pending CN109284263A (en) 2018-09-30 2018-09-30 A kind of the point cloud chart browsing method and relevant apparatus of LAS file

Country Status (1)

Country Link
CN (1) CN109284263A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113806090A (en) * 2021-09-17 2021-12-17 东云睿连(武汉)计算技术有限公司 Big data job running method and system based on Alluxio

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108009979A (en) * 2017-12-15 2018-05-08 湖北大学 Three-dimensional point cloud compression and storage method and system based on space-time data fusion
CN108304538A (en) * 2018-01-30 2018-07-20 广东奡风科技股份有限公司 A kind of ETL system and its method based entirely on distributed memory calculating

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108009979A (en) * 2017-12-15 2018-05-08 湖北大学 Three-dimensional point cloud compression and storage method and system based on space-time data fusion
CN108304538A (en) * 2018-01-30 2018-07-20 广东奡风科技股份有限公司 A kind of ETL system and its method based entirely on distributed memory calculating

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ALLUXIO: "使用Alluxio高效存储Spark RDD", 《HTTPS://BLOG.CSDN.NET/ALLUXIO/ARTICLE/DETAILS/59536999》 *
魔幻白夜: "python处理点云数据并生成三维点云模型", 《HTTPS://WWW.CNBLOGS.COM/MHBY/P/8493002.HTML》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113806090A (en) * 2021-09-17 2021-12-17 东云睿连(武汉)计算技术有限公司 Big data job running method and system based on Alluxio

Similar Documents

Publication Publication Date Title
US11163739B2 (en) Database table format conversion based on user data access patterns in a networked computing environment
US9678969B2 (en) Metadata updating method and apparatus based on columnar storage in distributed file system, and host
US11074225B2 (en) Synchronization of index copies in an LSM tree file system
US20140156683A1 (en) Integrating event processing with map-reduce
CN111427847B (en) Indexing and querying method and system for user-defined metadata
CN108475276A (en) It is stored for key-value in the memory in multimodal data library
CN107766541B (en) Distribution and utilization global full-volume data transmission and storage method and device, and electronic equipment
CN110781197B (en) Hive offline synchronous verification method and device and electronic equipment
CN114049927A (en) Disease data processing method and device, electronic equipment and readable medium
CN108182204A (en) The processing method and processing device of data query based on house prosperity transaction multi-dimensional data
CN109284263A (en) A kind of the point cloud chart browsing method and relevant apparatus of LAS file
Fredian et al. MDSplus extensions for long pulse experiments
JP2019021194A5 (en)
Sinthong et al. AFrame: Extending DataFrames for large-scale modern data analysis (Extended Version)
JP2014130492A (en) Generation method for index and computer system
Ma et al. Efficient attribute-based data access in astronomy analysis
CN114860780A (en) Data warehouse, data processing system and computer device
CN109977104B (en) Data management method and device
CN113672556A (en) Batch file migration method and device
Krijnen et al. Efficient binary serialization of IFC models using HDF5
CN115840786B (en) Data lake data synchronization method and device
CN112527911B (en) Data storage method, device, equipment and medium
CN116611418B (en) Report processing method and device based on online editing, electronic equipment and medium
CN107967369B (en) Method for converting data in cache into array structure
CN114398390A (en) Radar data storage and reading method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190129

RJ01 Rejection of invention patent application after publication