CN112214469A - Drive test data processing method, device, server and storage medium - Google Patents
Drive test data processing method, device, server and storage medium Download PDFInfo
- Publication number
- CN112214469A CN112214469A CN202011186145.7A CN202011186145A CN112214469A CN 112214469 A CN112214469 A CN 112214469A CN 202011186145 A CN202011186145 A CN 202011186145A CN 112214469 A CN112214469 A CN 112214469A
- Authority
- CN
- China
- Prior art keywords
- drive test
- data
- test data
- target
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 266
- 238000003860 storage Methods 0.000 title claims abstract description 44
- 238000003672 processing method Methods 0.000 title claims abstract description 16
- 238000000034 method Methods 0.000 claims abstract description 26
- 230000008676 import Effects 0.000 claims abstract description 24
- 238000012545 processing Methods 0.000 claims abstract description 16
- 238000005192 partition Methods 0.000 claims abstract description 14
- 238000004422 calculation algorithm Methods 0.000 claims description 79
- 238000004458 analytical method Methods 0.000 claims description 13
- 238000004140 cleaning Methods 0.000 claims description 11
- 238000013500 data storage Methods 0.000 claims description 8
- 238000000638 solvent extraction Methods 0.000 claims description 8
- 230000000007 visual effect Effects 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 6
- 230000003287 optical effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000003491 array Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000010998 test method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/176—Support for shared access to files; File sharing support
Abstract
The embodiment of the invention discloses a drive test data processing method, a drive test data processing device, a drive test server and a storage medium, wherein the method comprises the following steps: acquiring original drive test data imported by a user through a data import interface; determining data description information of the original drive test data; and storing the original drive test data partition to a distributed file system according to the data description information. According to the embodiment of the invention, the drive test data is stored in the distributed file system, and a user can obtain the corresponding drive test data by accessing the distributed file system, so that the drive test data is shared, and the drive test data resource is maximally utilized; meanwhile, the cost of local storage of the drive test data is reduced, and the risk of loss of the drive test data is reduced.
Description
Technical Field
The embodiment of the invention relates to the technical field of communication, in particular to a method and a device for processing drive test data, a server and a storage medium.
Background
The road test is a most common test method for road wireless signals in the communication industry, and is mainly used for obtaining evaluation indexes such as serving cell signal strength, voice quality, signal strength indication, signal quality indication and the like so as to evaluate network quality and further optimize a wireless network.
The traditional drive test mode is that a drive test person uses a professional test instrument to test a test area, then the obtained drive test data is imported into a personal office computer of the drive test person to be analyzed, and finally an analysis result is obtained and a drive test report is output. The drive test data is only stored locally in a personal computer of a drive test person, and when other test persons need to acquire the drive test data of the same test area to form a drive test report, the other test persons need to perform repeated tests. The test mode ensures that the drive test data cannot be shared between people, companies and companies, and between demands and requirements, thereby increasing the workload of drive test personnel.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method, an apparatus, a server, and a storage medium for processing drive test data, so as to implement sharing of drive test data and maximize utilization of drive test data resources.
In a first aspect, an embodiment of the present invention provides a method for processing drive test data, including:
acquiring original drive test data imported by a user through a data import interface;
determining data description information of the original drive test data;
and storing the original drive test data partition to a distributed file system according to the data description information.
Further, the step of storing the original drive test data partition to the distributed file system according to the data description information includes:
analyzing the original drive test data according to a preset standard data structure to obtain structured drive test data;
cleaning the structured drive test data to obtain target drive test data;
and storing the target drive test data partition to a distributed file system according to the data description information.
Further, the method also comprises the following steps:
acquiring target drive test data according to a first calling operation of a user;
acquiring a target data algorithm according to a second calling operation of the user;
and generating a drive test analysis report according to the target drive test data and the target data algorithm.
Further, the obtaining of the target drive test data according to the first invoking operation of the user includes:
generating a data calling request of target drive test data according to a first calling operation of a user;
determining whether the user has the calling authority of the target drive test data or not according to the data calling request;
and if the user has the calling authority of the target drive test data, acquiring the target drive test data from the distributed file system according to the data calling request.
Further, the algorithm for acquiring the target data according to the second calling operation of the user comprises:
and acquiring a target data algorithm based on the programming operation of the user on the visual programming interface.
Further, the algorithm for acquiring the target data according to the second calling operation of the user comprises:
generating an algorithm calling request of a target data algorithm according to a second calling operation of the user;
determining whether the user has the calling authority of the target data algorithm or not according to the algorithm calling request;
and if the user has the calling authority of the target data algorithm, acquiring the target data algorithm from the distributed file system according to the algorithm calling request.
In a second aspect, an embodiment of the present invention provides a drive test data processing apparatus, including:
the system comprises an original data acquisition module, a data import interface and a data import interface, wherein the original data acquisition module is used for acquiring original drive test data imported by a user through the data import interface;
the description information determining module is used for determining data description information of the original drive test data;
and the data storage module is used for storing the original drive test data into a distributed file system in a partitioning manner according to the data description information.
Further, the data storage module comprises:
the analysis unit is used for analyzing the original drive test data according to a preset standard data structure to obtain structured drive test data;
the cleaning unit is used for cleaning the structured drive test data to obtain target drive test data;
and the storage unit is used for storing the target drive test data into the distributed file system in a partitioning manner according to the data description information.
In a third aspect, an embodiment of the present invention provides a server, including:
one or more processors;
a storage device for storing one or more programs,
when the one or at least one program is executed by the one or more processors, the one or more processors are caused to implement the drive test data processing method provided by any embodiment of the present invention.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a drive test data processing method provided in any embodiment of the present invention.
According to the drive test data processing method provided by the embodiment of the invention, the drive test data is stored in the distributed file system, and a user can obtain the corresponding drive test data by accessing the distributed file system, so that the drive test data is shared, and the drive test data resources are utilized to the maximum extent; meanwhile, the cost of local storage of the drive test data is reduced, and the risk of loss of the drive test data is reduced.
Drawings
Fig. 1 is a schematic flowchart of a method for processing drive test data according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a drive test data processing method according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a drive test data processing apparatus according to a third embodiment of the present invention.
Fig. 4 is a schematic structural diagram of a server according to a fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the steps as a sequential process, many of the steps can be performed in parallel, concurrently or simultaneously. In addition, the order of the steps may be rearranged. A process may be terminated when its operations are completed, but may have additional steps not included in the figure. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.
Furthermore, the terms "first," "second," and the like may be used herein to describe various orientations, actions, steps, elements, or the like, but the orientations, actions, steps, or elements are not limited by these terms. These terms are only used to distinguish one direction, action, step or element from another direction, action, step or element. The terms "first", "second", etc. are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, "plurality", "batch" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Example one
Fig. 1 is a schematic flow chart of a drive test data processing method according to an embodiment of the present invention, which is applicable to a drive test scenario. As shown in fig. 1, a method for processing drive test data according to an embodiment of the present invention includes:
and S110, acquiring original drive test data imported by a user through a data import interface.
Specifically, the original drive test data is original data obtained when a drive tester tests in a test area. The original drive test data mainly comprises: service area signal strength, voice quality, signal strength indication, signal quality indication, area identification code, uplink and downlink average throughput rate, geographical position of the test equipment and the like.
The data import interface is an entrance for uploading original drive test data to the cloud storage by a user. And the user imports the original drive test data through the data import interface, namely the user executes the uploading operation of the original drive test data through the data import interface. In this embodiment, the original drive test data may be imported by a common file type (i.e., an import file of the original drive test data), such as a file type of xls, doc, txt, xml, csv, or a common compressed file type, such as a compressed file type of zip, tar, gz, or the like.
And S120, determining data description information of the original drive test data.
Specifically, the data description information is information related to the related attributes of the original drive test data, which is input by a user, such as a drive test data type, a test date, a test area, a data compression format, a data file type, a provincial code of the test area, a city code, a district code, and the like.
And S130, storing the original drive test data into a distributed file system in a partitioning mode according to the data description information.
Specifically, the original drive test data are classified according to the data description information, and the original drive test data of different types are stored in different storage areas of the distributed file system, that is, partitioned storage is performed. In this embodiment, the Distributed File System is a Hadoop Distributed File System (HDFS), and storing the original drive test data in a partition manner in the Distributed File System means storing the original drive test data in a hive library of a spark calculation framework.
Optionally, the method for storing the original drive test data partition in the distributed file system according to the data description information includes steps S131 to S133 (not shown in fig. 1).
S131, analyzing the original drive test data according to a preset standard data structure to obtain structured drive test data.
Specifically, the preset standard data structure is a structure of data stored in the hive library. Since the requirements of different drive test personnel for performing drive test may be different, the formats of the original drive test data uploaded by different users may also be different. Therefore, in order to avoid confusion of original drive test data in different formats, the original drive test data is analyzed according to a preset standard data structure, so that the uploaded original drive test data has a uniform format, and structured drive test data is formed.
Generally, when analyzing the original drive test data, the system scans (for example, scans once every 5 minutes) the import file containing the original drive test data at regular time, analyzes the import file, converts the original drive test data into the structured drive test data, and stores the structured drive test data in the hive library.
And S132, cleaning the structured drive test data to obtain target drive test data.
Specifically, the structured drive test data is cleaned in order to filter invalid data in the structured drive test data to obtain target drive test data, so that the stored data is more simplified. The main way of executing the cleaning operation is to verify the relevant fields in the structured drive test data, and when the structured drive test data does not have the values of the relevant fields, the structured drive test data is considered as invalid data and is filtered out. For example, the "signal strength indication" field in the structured drive test data is verified, and if one structured drive test data does not have the value of "signal strength indication", the structured drive test data is considered as invalid data.
And S133, storing the target drive test data into a distributed file system in a partitioning manner according to the data description information.
Specifically, the type of the target drive test data is determined according to the data description information, and then the target drive test data is stored in a storage area of the distributed file system corresponding to the type. For example, the category of the target drive test data is divided according to the geographical position of the test area, and then the target drive test data is stored in a partition mode according to the test date, the test area, the provincial code, the city code and the district code of the test area in the data description information.
The drive test data processing method provided by the embodiment of the invention obtains original drive test data imported by a user through a data import interface; determining data description information of the original drive test data; and storing the original drive test data partition to a distributed file system according to the data description information. The drive test data are stored in the distributed file system, and a user can obtain the corresponding drive test data by accessing the distributed file system, so that the drive test data are shared, and the drive test data resources are maximally utilized; meanwhile, the cost of local storage of the drive test data is reduced, and the risk of loss of the drive test data is reduced.
Example two
Fig. 2 is a schematic flow chart of a drive test data processing method according to a second embodiment of the present invention, which is a further refinement of the above embodiment. As shown in fig. 2, a drive test data processing method according to a second embodiment of the present invention includes:
s210, acquiring original drive test data imported by a user through a data import interface.
And S220, determining data description information of the original drive test data.
And S230, analyzing the original drive test data according to a preset standard data structure to obtain structured drive test data.
And S240, cleaning the structured drive test data to obtain target drive test data.
And S250, storing the target drive test data into a distributed file system in a partitioning manner according to the data description information.
And S260, acquiring target drive test data according to the first calling operation of the user.
Specifically, after the target drive test data is stored in the distributed file system, the user can access the distributed file system to obtain the target drive test data for use and analysis, so as to obtain a drive test report.
Further, the step of acquiring the target drive test data according to the first invoking operation of the user specifically includes steps S261 to S263 (not shown in fig. 2).
And S261, generating a data calling request of the target drive test data according to the first calling operation of the user.
In this embodiment, a visual metadata dictionary is preset, and the metadata dictionary includes description information of target drive test data stored in a distributed file system. The user can query the target drive test data stored in the distributed file system through the visual metadata dictionary to select and determine the target drive test data required to be used. And generating a data calling instruction of the target drive test data according to a selection instruction of a user on the target drive test data so as to acquire the target drive test data. The data call request typically includes user information and a storage path for the target drive test data.
S262, determining whether the user has the calling authority of the target drive test data or not according to the data calling request.
Generally, target drive test data uploaded by a plurality of users is stored in a distributed file system, and the users only have access rights to the data uploaded by the users for the security of the data and the rights and interests of each user. When one user needs to use the target drive test data uploaded by other users, a data use application needs to be provided for the other users, and when the other users agree with the data use application, the user obtains the calling authority of the target drive test data.
Then, according to the user information of the data calling request, whether the user has the calling authority or not can be determined. When the target drive test data is the drive test data uploaded by the user, or the target drive test data is the drive test data uploaded by other users, but the other users agree with the data use application proposed by the user, the user has the calling right of the target drive test data under both the two conditions.
And S263, if the user has the calling authority of the target drive test data, acquiring the target drive test data from the distributed file system according to the data calling request.
Specifically, if the user has the calling authority of the target drive test data, which indicates that the user can use the target drive test data, the target drive test data is acquired from the distributed file system according to the storage path of the target drive test data in the data calling request.
And S270, acquiring a target data algorithm according to the second calling operation of the user.
Specifically, the target data algorithm refers to an algorithm program for analyzing and calculating target drive test data. In this embodiment, the distributed file system further includes a data algorithm uploaded by a plurality of users, and the data algorithm is used for calculating the drive test data. In this embodiment, a user may directly perform a programming operation through a visual programming interface to write a target data algorithm. Therefore, the data algorithm stored in the distributed file system can be a data algorithm written by a user through a visual programming interface, and can also be a data algorithm imported by the user through a data import interface.
Optionally, the algorithm for obtaining the target data according to the second invoking operation of the user includes: and acquiring a target data algorithm based on the programming operation of the user on the visual programming interface.
Optionally, the algorithm for obtaining the target data according to the second invoking operation of the user includes: generating an algorithm calling request of a target data algorithm according to a second calling operation of the user; determining whether the user has the calling authority of the target data algorithm or not according to the algorithm calling request; and if the user has the calling authority of the target data algorithm, acquiring the target data algorithm from the distributed file system according to the algorithm calling request.
Specifically, the calling mode of the data algorithm stored in the distributed file system is consistent with the calling mode of the target road test data. When a user needs to use a data algorithm uploaded by other users, firstly, an algorithm calling request is generated according to a target data algorithm determined by the user, and the algorithm calling request comprises user information and a storage path of the target data algorithm. And then determining whether the user has the calling authority of the target data algorithm according to the user information of the algorithm calling request. If the user does not have the calling authority of the target data algorithm, the user cannot call the target data algorithm at the current moment, and the user can firstly put forward an algorithm using request to an uploading user of the target data algorithm so as to obtain the calling authority of the target data algorithm. And if the user has the calling authority of the target data algorithm, calling the target data algorithm from the distributed file system according to the storage path of the target data algorithm of the algorithm calling request.
Further, when determining a target data algorithm, a user can search for a data algorithm meeting the requirements of the user through keyword (metadata), and then sends an algorithm use application. Therefore, for some data algorithms with higher universality, the user does not need to repeat programming, and the workload of the user is reduced.
And S280, generating a drive test analysis report according to the target drive test data and the target data algorithm.
Specifically, the target drive test data is loaded into a target data algorithm for calculation to obtain calculation result data, and a drive test analysis report is generated. In this embodiment, the drive test analysis report may be a direct data report, or may be a graphical report generated by graphically representing calculation result data, where the graphical report may generate a PDF format for export.
In addition, the data of the drive test analysis report can be exported to other database systems for webpage query and call, the import of relational databases such as pg, MySQL, oracle and the like is supported, and the report can be downloaded to a local PC terminal for storage and reference.
The drive test data processing method provided by the embodiment of the invention stores the drive test data into the distributed file system, and a user can obtain the corresponding drive test data by accessing the distributed file system, so that the drive test data is shared, and the drive test data resources are utilized to the maximum extent; meanwhile, the cost of local storage of the drive test data is reduced, and the risk of loss of the drive test data is reduced. The embodiment also realizes the sharing of the data algorithm, reduces the repeated change of users, improves the working efficiency and can realize the technical communication and value exchange between the same lines.
EXAMPLE III
Fig. 3 is a schematic structural diagram of a drive test data processing apparatus according to a third embodiment of the present invention, which is applicable to a drive test scenario. The drive test data processing apparatus provided in this embodiment can implement the drive test data processing method provided in any embodiment of the present invention, and has a corresponding functional structure and beneficial effects of the implementation method.
As shown in fig. 3, a drive test data processing apparatus provided in a third embodiment of the present invention includes: a raw data acquisition module 310, a description information determination module 320, and a data storage module 330, wherein:
the original data obtaining module 310 is configured to obtain original drive test data imported by a user through a data import interface;
the description information determining module 320 is configured to determine data description information of the original drive test data;
the data storage module 330 is configured to store the original drive test data partition to the distributed file system according to the data description information.
Further, the data storage module 330 includes:
the analysis unit is used for analyzing the original drive test data according to a preset standard data structure to obtain structured drive test data;
the cleaning unit is used for cleaning the structured drive test data to obtain target drive test data;
and the storage unit is used for storing the target drive test data into the distributed file system in a partitioning manner according to the data description information.
Further, the method also comprises the following steps:
the target drive test data acquisition module is used for acquiring target drive test data according to a first calling operation of a user;
the target data algorithm obtaining module is used for obtaining a target data algorithm according to a second calling operation of the user;
and the analysis report production module is used for generating a drive test analysis report according to the target drive test data and the target data algorithm.
Further, the target drive test data acquisition module is specifically configured to:
generating a data calling request of target drive test data according to a first calling operation of a user;
determining whether the user has the calling authority of the target drive test data or not according to the data calling request;
and if the user has the calling authority of the target drive test data, acquiring the target drive test data from the distributed file system according to the data calling request.
Further, the target data algorithm obtaining module is specifically configured to:
and acquiring a target data algorithm based on the programming operation of the user on the visual programming interface.
Further, the target data algorithm obtaining module is further configured to:
generating an algorithm calling request of a target data algorithm according to a second calling operation of the user;
determining whether the user has the calling authority of the target data algorithm or not according to the algorithm calling request;
and if the user has the calling authority of the target data algorithm, acquiring the target data algorithm from the distributed file system according to the algorithm calling request.
The drive test data processing device provided by the third embodiment of the invention stores the drive test data to the distributed file system through the original data acquisition module, the description information determination module and the data storage module, and a user can acquire the corresponding drive test data by accessing the distributed file system, so that the drive test data is shared, and the drive test data resources are utilized to the maximum extent; meanwhile, the cost of local storage of the drive test data is reduced, and the risk of loss of the drive test data is reduced.
Example four
Fig. 4 is a schematic structural diagram of a server according to a fourth embodiment of the present invention. FIG. 4 illustrates a block diagram of an exemplary server 412 suitable for use in implementing embodiments of the present invention. The server 412 shown in fig. 4 is only an example and should not bring any limitations to the function and scope of use of the embodiments of the present invention.
As shown in FIG. 4, server 412 is in the form of a general purpose server. Components of server 412 may include, but are not limited to: one or more processors 416, a storage device 428, and a bus 418 that couples the various system components including the storage device 428 and the processors 416.
A program/utility 440 having a set (at least one) of program modules 442 may be stored, for instance, in storage 428, such program modules 442 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. The program modules 442 generally perform the functions and/or methodologies of the described embodiments of the invention.
The server 412 may also communicate with one or more external devices 414 (e.g., keyboard, pointing terminal, display 424, etc.), with one or more terminals that enable a user to interact with the server 412, and/or with any terminals (e.g., network card, modem, etc.) that enable the server 412 to communicate with one or more other computing terminals. Such communication may occur via input/output (I/O) interfaces 422. Further, server 412 may communicate with one or more networks (e.g., a Local Area Network (LAN), Wide Area Network (WAN), and/or a public Network, such as the Internet) via Network adapter 420. As shown in FIG. 4, network adapter 420 communicates with the other modules of server 412 via bus 418. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the server 412, including but not limited to: microcode, end drives, Redundant processors, external disk drive Arrays, RAID (Redundant Arrays of Independent Disks) systems, tape drives, and data backup storage systems, among others.
The processor 416 executes various functional applications and data processing by running programs stored in the storage device 428, for example, implementing a method for processing drive test data provided by any embodiment of the present invention, which may include:
acquiring original drive test data imported by a user through a data import interface;
determining data description information of the original drive test data;
and storing the original drive test data partition to a distributed file system according to the data description information.
EXAMPLE five
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a method for processing drive test data according to any embodiment of the present invention, where the method may include:
acquiring original drive test data imported by a user through a data import interface;
determining data description information of the original drive test data;
and storing the original drive test data partition to a distributed file system according to the data description information.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, or the like, as well as conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or terminal. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A drive test data processing method is characterized by comprising the following steps:
acquiring original drive test data imported by a user through a data import interface;
determining data description information of the original drive test data;
and storing the original drive test data partition to a distributed file system according to the data description information.
2. The method of claim 1, wherein storing the original drive test data partition to a distributed file system according to the data description information comprises:
analyzing the original drive test data according to a preset standard data structure to obtain structured drive test data;
cleaning the structured drive test data to obtain target drive test data;
and storing the target drive test data partition to a distributed file system according to the data description information.
3. The method of claim 2, further comprising:
acquiring target drive test data according to a first calling operation of a user;
acquiring a target data algorithm according to a second calling operation of the user;
and generating a drive test analysis report according to the target drive test data and the target data algorithm.
4. The method of claim 3, wherein obtaining the target drive test data according to the first invocation operation of the user comprises:
generating a data calling request of target drive test data according to a first calling operation of a user;
determining whether the user has the calling authority of the target drive test data or not according to the data calling request;
and if the user has the calling authority of the target drive test data, acquiring the target drive test data from the distributed file system according to the data calling request.
5. The method of claim 3, wherein the obtaining target data algorithm according to the second invocation by the user comprises:
and acquiring a target data algorithm based on the programming operation of the user on the visual programming interface.
6. The method of claim 3, wherein the obtaining target data algorithm according to the second invocation by the user comprises:
generating an algorithm calling request of a target data algorithm according to a second calling operation of the user;
determining whether the user has the calling authority of the target data algorithm or not according to the algorithm calling request;
and if the user has the calling authority of the target data algorithm, acquiring the target data algorithm from the distributed file system according to the algorithm calling request.
7. A drive test data processing apparatus, characterized by comprising:
the system comprises an original data acquisition module, a data import interface and a data import interface, wherein the original data acquisition module is used for acquiring original drive test data imported by a user through the data import interface;
the description information determining module is used for determining data description information of the original drive test data;
and the data storage module is used for storing the original drive test data into a distributed file system in a partitioning manner according to the data description information.
8. The apparatus of claim 7, wherein the data storage module comprises:
the analysis unit is used for analyzing the original drive test data according to a preset standard data structure to obtain structured drive test data;
the cleaning unit is used for cleaning the structured drive test data to obtain target drive test data;
and the storage unit is used for storing the target drive test data into the distributed file system in a partitioning manner according to the data description information.
9. A server, comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the drive test data processing method of any of claims 1-6.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the drive test data processing method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011186145.7A CN112214469A (en) | 2020-10-29 | 2020-10-29 | Drive test data processing method, device, server and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011186145.7A CN112214469A (en) | 2020-10-29 | 2020-10-29 | Drive test data processing method, device, server and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112214469A true CN112214469A (en) | 2021-01-12 |
Family
ID=74057627
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011186145.7A Pending CN112214469A (en) | 2020-10-29 | 2020-10-29 | Drive test data processing method, device, server and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112214469A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113923208A (en) * | 2021-09-29 | 2022-01-11 | 北京轻舟智航科技有限公司 | Processing method for downloading mass drive test data |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101296470A (en) * | 2008-06-23 | 2008-10-29 | 北京民享科技有限责任公司 | Wireless network overlapping road detecting software supporting TD-SCDMA |
| CN101365207A (en) * | 2007-08-09 | 2009-02-11 | 中兴通讯股份有限公司 | Road measurement terminal equipment for single tone measurement and road measurement method |
| CN106227899A (en) * | 2016-08-31 | 2016-12-14 | 北京京航计算通讯研究所 | The storage of the big data of a kind of internet of things oriented and querying method |
| CN108595622A (en) * | 2018-04-23 | 2018-09-28 | 泰华智慧产业集团股份有限公司 | Method and system based on big data analysis bicycle board string simultaneously |
| CN109446296A (en) * | 2018-09-10 | 2019-03-08 | 上海勋立信息科技有限公司 | A kind of magnanimity unstructured data treating method and apparatus |
| CN111782465A (en) * | 2020-06-23 | 2020-10-16 | 杭州溪塔科技有限公司 | Fluent-based container log collection method and system and storage medium |
-
2020
- 2020-10-29 CN CN202011186145.7A patent/CN112214469A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101365207A (en) * | 2007-08-09 | 2009-02-11 | 中兴通讯股份有限公司 | Road measurement terminal equipment for single tone measurement and road measurement method |
| CN101296470A (en) * | 2008-06-23 | 2008-10-29 | 北京民享科技有限责任公司 | Wireless network overlapping road detecting software supporting TD-SCDMA |
| CN106227899A (en) * | 2016-08-31 | 2016-12-14 | 北京京航计算通讯研究所 | The storage of the big data of a kind of internet of things oriented and querying method |
| CN108595622A (en) * | 2018-04-23 | 2018-09-28 | 泰华智慧产业集团股份有限公司 | Method and system based on big data analysis bicycle board string simultaneously |
| CN109446296A (en) * | 2018-09-10 | 2019-03-08 | 上海勋立信息科技有限公司 | A kind of magnanimity unstructured data treating method and apparatus |
| CN111782465A (en) * | 2020-06-23 | 2020-10-16 | 杭州溪塔科技有限公司 | Fluent-based container log collection method and system and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 刘晓龙: "基于云计算的移动通信4G网络优化", 《2016山西省通信学会学术年会》, pages 148 - 158 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113923208A (en) * | 2021-09-29 | 2022-01-11 | 北京轻舟智航科技有限公司 | Processing method for downloading mass drive test data |
| CN113923208B (en) * | 2021-09-29 | 2023-07-18 | 北京轻舟智航科技有限公司 | Processing method for downloading massive drive test data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108427939B (en) | Model generation method and device | |
| CN110321958B (en) | Training method of neural network model and video similarity determination method | |
| CN109582717B (en) | Database unified platform for electric power big data and reading method thereof | |
| CN110457277A (en) | Service process performance analysis method, device, equipment and storage medium | |
| CN110737726B (en) | Method and device for determining test data of interface to be tested | |
| JP2019534487A (en) | System and method for determining optimal strategy | |
| WO2022121337A1 (en) | Data exploration method and apparatus, and electronic device and storage medium | |
| CN111949545A (en) | Automatic testing method, system, server and storage medium | |
| CN115825313B (en) | Chromatographic information detection method, device, electronic equipment and computer readable medium | |
| CN110879776A (en) | Test case generation method and device | |
| CN109582906B (en) | Method, device, equipment and storage medium for determining data reliability | |
| CN115034596A (en) | Risk conduction prediction method, device, equipment and medium | |
| CN112214469A (en) | Drive test data processing method, device, server and storage medium | |
| CN113468247A (en) | Fish species identification method and device and storage medium | |
| CN116827971B (en) | Block chain-based carbon emission data storage and transmission method, device and equipment | |
| CN111367813B (en) | Automatic testing method and device for decision engine, server and storage medium | |
| CN111488386B (en) | Data query method and device | |
| CN116433388B (en) | Data storage resource partitioning method, device, electronic equipment and computer medium | |
| CN115022201B (en) | Data processing function test method, device, equipment and storage medium | |
| CN116244387A (en) | Entity relationship construction method, device, electronic equipment and storage medium | |
| CN114465919B (en) | Network service testing method, system, electronic equipment and storage medium | |
| CN112379967B (en) | Simulator detection method, device, equipment and medium | |
| CN113360182B (en) | Method and apparatus for system performance diagnostics | |
| CN113656391A (en) | Data detection method and device, storage medium and electronic equipment | |
| CN112286808B (en) | Application program testing method and device, electronic equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |