CN113923208A - Processing method for downloading mass drive test data - Google Patents
Processing method for downloading mass drive test data Download PDFInfo
- Publication number
- CN113923208A CN113923208A CN202111154386.8A CN202111154386A CN113923208A CN 113923208 A CN113923208 A CN 113923208A CN 202111154386 A CN202111154386 A CN 202111154386A CN 113923208 A CN113923208 A CN 113923208A
- Authority
- CN
- China
- Prior art keywords
- directory
- information
- file
- drive test
- test data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The embodiment of the invention relates to a processing method for downloading mass drive test data, which comprises the following steps: calling a virtual file system interface to create a first virtual directory and a second virtual directory; creating a directory mapping relation between a first virtual directory and a basic drive test data sharing directory of a local sharing server; generating shared directory file list information; generating first virtual directory file list information; creating a corresponding relation between a second virtual directory and a remote cloud storage platform; acquiring list information of selectable drive test data files; generating second virtual directory file list information; acquiring a first directory access instruction; generating a first data file downloading instruction; if the first file path information is matched with the path of the first virtual directory, downloading a basic drive test data file from a basic drive test data sharing directory; and if the path information of the first file is matched with the path of the second virtual directory, downloading the optional drive test data file from the remote cloud storage platform. The invention can reduce the network flow and the concurrency.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a processing method for downloading mass drive test data.
Background
In the field of automatic driving or unmanned technology processing, mass drive test data collected, analyzed and processed every day can exceed the Tera (TB) level, and if each company constructs a data center by itself to process data storage and calling of such a large quantity, the data operation and maintenance cost is very high. With the maturity and development of cloud storage technology, many companies begin to rent public clouds to store and call mass drive test data, and the data deployment mode can greatly reduce the operation and maintenance cost of independent data maintenance of each company. But this also causes additional problems for the user, such as low network traffic, excessive network bandwidth resource overhead, etc.
Disclosure of Invention
The invention aims to provide a processing method for downloading mass drive test data, electronic equipment and a computer readable storage medium aiming at the defects of the prior art, wherein the mass drive test data stored on a remote cloud storage platform are divided into two types: the method comprises the following steps of (1) indiscriminately selecting basic drive test data and optional drive test data; the method comprises the steps that a local deployment local sharing server downloads latest basic drive test data packets from a remote cloud storage platform in batches at fixed time; a first virtual directory corresponding to the shared directory of the local sharing server and a second virtual directory corresponding to the remote cloud storage platform are created at the user side. According to the invention, when a user needs to acquire the basic drive test data file list and download the basic drive test data file, the connection with the remote cloud storage platform is not needed, a large amount of network bandwidth resources can be released, and the network flow and the network concurrency can be greatly reduced.
In order to achieve the above object, a first aspect of the embodiments of the present invention provides a processing method for downloading a large amount of drive test data, where the method includes:
calling a virtual file system interface to create a first virtual directory and a second virtual directory;
creating a directory mapping relation between the first virtual directory and a basic drive test data sharing directory of a local sharing server; calling a file access interface of the local sharing server, acquiring basic drive test data file list information under a root directory and under subdirectories of each level of the basic drive test data sharing directory, and generating shared directory file list information; performing first virtual directory file list conversion processing on the shared directory file list information to generate corresponding first virtual directory file list information;
creating a corresponding relation between the second virtual directory and a remote cloud storage platform; calling a data access API (application program interface) of the remote cloud storage platform, and acquiring optional drive test data file list information from the remote cloud storage platform; performing second virtual directory file list conversion processing on the selectable drive test data file list information to generate corresponding second virtual directory file list information;
acquiring a first directory access instruction input by a user; the first directory access instruction comprises first directory path information;
displaying corresponding virtual directory file list information to a user according to the first directory path information, acquiring file information selected by the user in the displayed virtual directory file list information, and generating a first data file downloading instruction; the first data file downloading instruction comprises first file path information and first file name information;
if the first file path information is matched with the path of the first virtual directory, performing basic drive test data shared directory path conversion processing on the first file path information to generate corresponding shared directory path information; the shared directory path information and the first file name information form corresponding shared directory data file information; calling a file access interface of the local sharing server, and downloading a basic drive test data file matched with the shared directory data file information from the basic drive test data shared directory;
if the first file path information is matched with the path of the second virtual directory, calling a data access API (application program interface) of the remote cloud storage platform, and downloading the optional drive test data file matched with the first file name information from the remote cloud storage platform.
Preferably, the method further comprises:
the local sharing server calls a server data access API (application programming interface) provided by the remote cloud storage platform at a designated downloading time point every day, and downloads a latest complete basic drive test data file package from the remote cloud storage platform; and storing each latest basic drive test data file in the new complete basic drive test data file package under a corresponding root directory or under each level of subdirectories in the basic drive test data sharing directory according to a preset basic drive test data file-storage directory corresponding relation.
Preferably, the shared directory file list information includes a plurality of first data file information sets; the first data file information set at least comprises first data file path information, first data file name information, first data file type information and first data file size information; the first data file path information comprises first root directory path information; the first root directory path information is specifically a preset shared directory root directory identifier;
the selectable drive test data file list information comprises a plurality of second data file information sets; the second data file information set at least comprises second data file path information, second data file name information, second data file type information and second data file size information; the second data file path information is null.
Preferably, the performing a first virtual directory file list conversion process on the shared directory file list information to generate corresponding first virtual directory file list information specifically includes:
taking the root directory path information of the first virtual directory as a first root directory identifier;
replacing the first root directory path information of each first data file information set in the shared directory file list information with the first root directory identifier;
and using the shared directory file list information after the replacement of the root directory path as the first virtual directory file list information.
Preferably, the performing a second virtual directory file list conversion process on the selectable drive test data file list information to generate corresponding second virtual directory file list information specifically includes:
taking the root directory path information of the second virtual directory as a second root directory identifier;
setting the second root directory path information of each second data file information set in the optional drive test data file list information using the second root directory identifier;
and using the list information of the selectable drive test data files after the root directory path setting is finished as the list information of the second virtual directory files.
Preferably, the displaying the corresponding virtual directory file list information to the user according to the first directory path information, acquiring file information selected by the user in the displayed virtual directory file list information, and generating the first data file downloading instruction specifically includes:
if the first directory path information is matched with the path information of the first virtual directory, displaying the first virtual directory file list information to a user; acquiring file information selected by a user in the displayed first virtual directory file list information, and generating a first data file downloading instruction;
if the first directory path information is matched with the path information of the second virtual directory, displaying the file list information of the second virtual directory to a user; and acquiring file information selected by a user in the displayed second virtual directory file list information, and generating the first data file downloading instruction.
Preferably, the performing a basic drive test data shared directory path conversion process on the first file path information to generate corresponding shared directory path information specifically includes:
in the first file path information, recording a character string matched with the root directory path information of the first virtual directory as a third directory identifier;
replacing the third root directory identifier of the first file path information with a preset shared directory root directory identifier;
and taking the first file path information after the replacement of the root directory as the shared directory path information.
A second aspect of an embodiment of the present invention provides an electronic device, including: a memory, a processor, and a transceiver;
the processor is configured to be coupled to the memory, read and execute instructions in the memory, so as to implement the method steps of the first aspect;
the transceiver is coupled to the processor, and the processor controls the transceiver to transmit and receive messages.
A third aspect of embodiments of the present invention provides a computer-readable storage medium storing computer instructions that, when executed by a computer, cause the computer to perform the method of the first aspect.
The embodiment of the invention provides a processing method for downloading mass drive test data, electronic equipment and a computer readable storage medium, wherein the mass drive test data stored on a remote cloud storage platform are divided into two types: the method comprises the following steps of (1) indiscriminately selecting basic drive test data and optional drive test data; the method comprises the steps that a local deployment local sharing server downloads latest basic drive test data packets from a remote cloud storage platform in batches at fixed time; a first virtual directory corresponding to the shared directory of the local sharing server and a second virtual directory corresponding to the remote cloud storage platform are created at the user side. By the method and the system, the difference operation of local or remote data downloading is not sensed by the user in a virtual directory working mode, so that the working efficiency is improved; when a user needs to acquire the basic drive test data file list and download the basic drive test data file, the user does not need to be connected with a remote cloud storage platform and directly downloads the basic drive test data file from a shared directory of a local shared server, a large amount of network bandwidth resources are released, and network flow and network concurrency are greatly reduced.
Drawings
Fig. 1 is a schematic diagram of a processing method for downloading a large amount of drive test data according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an electronic device according to a second embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention provides a processing method for downloading massive drive test data, which is suitable for a massive drive test data management system, wherein the massive drive test data management system comprises a client, a local sharing server and a remote cloud storage platform, wherein the client is respectively connected with the local sharing server and the remote cloud storage platform, the client and the local sharing server are positioned in a local network, and the local sharing server is connected with the remote cloud storage platform; the method comprises the steps that a first virtual directory and a second virtual directory corresponding to a local shared server and a remote cloud storage platform are created at a client, and corresponding file list information and basic data files are downloaded from the shared directory based on the mapping relation between the first virtual directory and the shared directory of the local shared server when a user needs to obtain a basic drive test data file list and download drive test basic data files; when a user needs to obtain a selectable drive test data file list and download selectable drive test data files, downloading corresponding file list information and selectable data files from a remote cloud storage platform based on the corresponding relation between a second virtual directory and the remote cloud storage platform; fig. 1 is a schematic diagram of a processing method for downloading a large amount of drive test data according to an embodiment of the present invention, as shown in fig. 1, the method mainly includes the following steps:
Here, the client establishes two Virtual directories, i.e. a first human Virtual directory, locally in advance by using a Virtual File System (VFS) interface in the operating system; the virtual directory is created to save the series of instruction operations of the user on data downloading, so that the complexity of data downloading operation of the user is reduced, and the working efficiency and the use experience of the user are improved.
the shared directory file list information comprises a plurality of first data file information sets; the first data file information set at least comprises first data file path information, first data file name information, first data file type information and first data file size information; the first data file path information includes first root directory path information; the first root directory path information is specifically a preset shared directory root directory identifier.
Here, in the embodiment of the present invention, a shared directory, that is, a basic drive test data shared directory is provided in the local shared server to store the shared basic drive test data file, where the directory includes a root directory and multiple levels of subdirectories; in addition, the local sharing server also provides a group of file access interfaces formed by a series of network directory file access instructions, wherein the file access instructions are similar to file system instructions of an operating system and at least comprise directory traversal instructions, file selection instructions, file copying instructions and the like;
when creating a directory mapping relationship between a first virtual directory and a basic drive test data sharing directory of a local sharing server, the embodiment of the invention performs directory mapping configuration on the first virtual directory and the basic drive test data sharing directory through a network mapping interface of an operating system, thereby creating the directory mapping relationship between the first virtual directory and the basic drive test data sharing directory;
after the directory mapping relationship is successfully created, the embodiment of the invention calls a directory traversal instruction of a file access interface of the local sharing server to perform sub-directory and file information traversal under the directory on the basis drive test data files under the root directory and under each level of sub-directory of the basis drive test data sharing directory, so as to obtain the information of the file list of the basis drive test data under the root directory and under each level of sub-directory and generate shared directory file list information;
after the shared directory file list information is obtained, because the root directory information of the path information of each file is also the root directory identifier of the basic drive test data shared directory, if the shared directory file list information is directly used as the directory traversal basis of the first virtual directory, the root directory identifier of the basic drive test data shared directory needs to be changed into the absolute path identifier of the first virtual directory at the local client; therefore, the file list information corresponding to the absolute path of the first virtual directory, that is, the first virtual directory file list information, can be obtained only by performing the first virtual directory file list conversion processing on the shared directory file list information;
further, performing a first virtual directory file list conversion process on the shared directory file list information to generate corresponding first virtual directory file list information, specifically including: taking the root directory path information of the first virtual directory as a first root directory identifier; replacing first root directory path information of each first data file information set in the shared directory file list information by using a first root directory identifier; and using the shared directory file list information after the root directory path replacement as first virtual directory file list information.
the selectable drive test data file list information comprises a plurality of second data file information sets; the second data file information set at least comprises second data file path information, second data file name information, second data file type information and second data file size information; the second data file path information is null.
Here, in the embodiment of the present invention, a large amount of drive test data is stored on a remote cloud storage platform, and the large amount of drive test data is divided into two categories, namely basic drive test data and optional drive test data according to the use frequency of the data, where the basic drive test data basically belongs to the necessary data in different use scenes, and the optional drive test data is optional in different use scenes; under the conventional condition, the total data amount of the selectable drive test data is far larger than that of the basic drive test data;
the remote cloud storage platform provides a group of data access Application Program Interfaces (API), the API is similar to common service applications, and directory information in similar file access interfaces is not provided, so that the interaction times between the client and the remote cloud storage platform can be reduced, and the data downloading efficiency is improved; the data access API interface at least comprises an optional drive test data file list application API, an optional drive test data file download API and the like;
because the system may have a plurality of remote cloud storage platforms and a plurality of clients, the corresponding relationship between the second virtual directory and the remote cloud storage platforms needs to be bound;
after the corresponding relation between the second virtual directory and the remote cloud storage platform is bound, calling an optional drive test data file list application API in a data access API interface, and acquiring optional drive test data file list information from the remote cloud storage platform; the list information lists file lists of all the selectable drive test data in the cloud, and the path information of the second data files of each second data file information set in the selectable drive test data file list information is empty because a directory structure is not adopted;
after the selectable drive test data file list information is obtained, because the path information of each file, that is, the path information of the second data file, is empty and cannot be used as a directory traversal basis of the second virtual directory, the second data file path information of each second data file information set in the selectable drive test data file list information needs to be converted into an absolute path identifier of the second virtual directory at the local client, so that the file list information corresponding to the absolute path of the second virtual directory, that is, the second virtual directory file list information can be obtained;
further, performing a second virtual directory file list conversion process on the optional drive test data file list information to generate corresponding second virtual directory file list information, specifically including: taking the root directory path information of the second virtual directory as a second root directory identifier; setting second root directory path information of each second data file information set in the selectable drive test data file list information by using the second root directory identifier; and using the optional drive test data file list information after the root directory path setting as second virtual directory file list information.
Step 4, acquiring a first directory access instruction input by a user;
wherein the first directory access instruction comprises first directory path information;
here, the first directory access instruction is a directory locating instruction in the operating system; such as cd instructions for a DOS operating system or a Linux operating system.
Step 5, displaying corresponding virtual directory file list information to a user according to the first directory path information, acquiring file information selected by the user in the displayed virtual directory file list information, and generating a first data file downloading instruction;
the first data file downloading instruction comprises first file path information and first file name information;
after obtaining the first directory access instruction, the client judges whether the first directory path information carried by the client is related to the first virtual directory and the second virtual directory, and if so, outputs a directory traversal result by using corresponding first virtual directory file list information and second virtual directory file list information;
the method specifically comprises the following steps: step 51, if the first directory path information is matched with the path information of the first virtual directory, displaying the first virtual directory file list information to a user; acquiring file information selected by a user in the displayed first virtual directory file list information, and generating a first data file downloading instruction;
here, as long as the first directory path information includes the path information of the first virtual directory, it is described that the first directory path information matches the path information of the first virtual directory; the client uses the first virtual directory file list information as a directory traversal result of the current directory, namely the first virtual directory, and displays the directory traversal result; when displaying, a text display mode similar to an instruction line can be adopted, and a tree-shaped or chain-table type display mode of a graphical interface can also be adopted; the user can select the basic drive test data file to be downloaded from the displayed directory traversal result, namely the first virtual directory file list information;
step 52, if the first directory path information is matched with the path information of the second virtual directory, displaying the file list information of the second virtual directory to the user; and acquiring file information selected by a user in the displayed second virtual directory file list information, and generating a first data file downloading instruction.
Here, as long as the first directory path information includes the path information of the second virtual directory, it is described that the first directory path information matches the path information of the second virtual directory; the client uses the second virtual directory file list information as a directory traversal result of the current directory, namely the second virtual directory, and displays the directory traversal result; when displaying, a text display mode similar to an instruction line can be adopted, and a tree-shaped or chain-table type display mode of a graphical interface can also be adopted; the user can thus select the optional drive test data files to be downloaded from the displayed directory traversal result, i.e., the second virtual directory file list information.
Here, as long as the first file path information in the first data file download instruction includes the path information of the first virtual directory, it means that the first file path information matches the path of the first virtual directory; at this time, the first file path information should include absolute path information of the first virtual directory at the local client, that is, root directory path information of the first virtual directory, which is not matched with the root directory information of the basic drive test data shared directory, so that the first file path information needs to be subjected to the basic drive test data shared directory path conversion processing to generate corresponding shared directory path information;
further, performing a basic drive test data shared directory path conversion process on the first file path information to generate corresponding shared directory path information, specifically including: in the first file path information, recording a character string matched with the root directory path information of the first virtual directory as a third directory identifier; replacing the third root directory identifier of the first file path information by using a preset shared directory root directory identifier; taking the first file path information after the root directory replacement as shared directory path information;
after the path information conversion is completed, the embodiment of the present invention invokes a file selection instruction of a file access interface of the local sharing server to locate the basic drive test data file matched with the shared directory data file information, and copies the located basic drive test data file from the basic drive test data shared directory to a local designated storage location of the client using a file copy instruction, thereby completing a processing flow of downloading the basic drive test data file matched with the shared directory data file information from the basic drive test data shared directory.
And 7, if the path information of the first file is matched with the path of the second virtual directory, calling a data access API (application program interface) of the remote cloud storage platform, and downloading the optional drive test data file matched with the first file name information from the remote cloud storage platform.
Here, as long as the first file path information in the first data file download instruction includes the path information of the second virtual directory, it means that the first file path information matches the path of the second virtual directory; at this time, because the remote cloud storage platform adopts a directory structure, operations related to path conversion like step 6 are not required, and only the first file name information is used as an uploading parameter of the selectable drive test data file downloading API to send a selectable drive test data file downloading request to the remote cloud storage platform; after receiving the optional drive test data file downloading request with the first file name information, the remote cloud storage platform retrieves the optional drive test data file corresponding to the first file name information from the cloud storage system, and sends the optional drive test data file serving as the return data of the optional drive test data file downloading request back to the client; after receiving the optional drive test data file sent by the remote cloud storage platform, the client saves the optional drive test data file in a local designated storage position of the client, so that the processing flow of downloading the optional drive test data file matched with the first file name information from the remote cloud storage platform is completed.
In addition, the embodiment of the invention also comprises: the local sharing server calls a server data access API (application programming interface) provided by the remote cloud storage platform at a designated downloading time point every day, and downloads the latest complete basic drive test data file package from the remote cloud storage platform; and storing each latest basic drive test data file in the new complete basic drive test data file package under a corresponding root directory or under each level of subdirectories in the basic drive test data sharing directory according to a preset basic drive test data file-storage directory corresponding relation.
Here, in order to use data without delaying the working hours, the above-mentioned designated download time point is generally set to a time point of night, for example, 12 o' clock at night.
Fig. 2 is a schematic structural diagram of an electronic device according to a second embodiment of the present invention. The electronic device may be a terminal device or a server for implementing the method of the embodiment of the present invention, or may be a terminal device or a server connected to the terminal device or the server for implementing the method of the embodiment of the present invention. As shown in fig. 2, the electronic device may include: a processor 301 (e.g., a CPU), a memory 302, a transceiver 303; the transceiver 303 is coupled to the processor 301, and the processor 301 controls the transceiving operation of the transceiver 303. Various instructions may be stored in memory 302 for performing various processing functions and implementing the processing steps described in the foregoing method embodiments. Preferably, the electronic device according to an embodiment of the present invention further includes: a power supply 304, a system bus 305, and a communication port 306. The system bus 305 is used to implement communication connections between the elements. The communication port 306 is used for connection communication between the electronic device and other peripherals.
The system bus 305 mentioned in fig. 2 may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The system bus may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus. The communication interface is used for realizing communication between the database access device and other equipment (such as a client, a read-write library and a read-only library). The Memory may include a Random Access Memory (RAM) and may also include a Non-Volatile Memory (Non-Volatile Memory), such as at least one disk Memory.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), a Graphics Processing Unit (GPU), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
It should be noted that the embodiment of the present invention also provides a computer-readable storage medium, which stores instructions that, when executed on a computer, cause the computer to execute the method and the processing procedure provided in the above-mentioned embodiment.
The embodiment of the present invention further provides a chip for executing the instructions, where the chip is configured to execute the processing steps described in the foregoing method embodiment.
The embodiment of the invention provides a processing method for downloading mass drive test data, electronic equipment and a computer readable storage medium, wherein the mass drive test data stored on a remote cloud storage platform are divided into two types: the method comprises the following steps of (1) indiscriminately selecting basic drive test data and optional drive test data; the method comprises the steps that a local deployment local sharing server downloads latest basic drive test data packets from a remote cloud storage platform in batches at fixed time; a first virtual directory corresponding to the shared directory of the local sharing server and a second virtual directory corresponding to the remote cloud storage platform are created at the user side. By the method and the system, the difference operation of local or remote data downloading is not sensed by the user in a virtual directory working mode, so that the working efficiency is improved; when a user needs to acquire the basic drive test data file list and download the basic drive test data file, the user does not need to be connected with a remote cloud storage platform and directly downloads the basic drive test data file from a shared directory of a local shared server, a large amount of network bandwidth resources are released, and network flow and network concurrency are greatly reduced.
Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied in hardware, a software module executed by a processor, or a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are merely exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (9)
1. A processing method for downloading mass drive test data is characterized by comprising the following steps:
calling a virtual file system interface to create a first virtual directory and a second virtual directory;
creating a directory mapping relation between the first virtual directory and a basic drive test data sharing directory of a local sharing server; calling a file access interface of the local sharing server, acquiring basic drive test data file list information under a root directory and under subdirectories of each level of the basic drive test data sharing directory, and generating shared directory file list information; performing first virtual directory file list conversion processing on the shared directory file list information to generate corresponding first virtual directory file list information;
creating a corresponding relation between the second virtual directory and a remote cloud storage platform; calling a data access API (application program interface) of the remote cloud storage platform, and acquiring optional drive test data file list information from the remote cloud storage platform; performing second virtual directory file list conversion processing on the selectable drive test data file list information to generate corresponding second virtual directory file list information;
acquiring a first directory access instruction input by a user; the first directory access instruction comprises first directory path information;
displaying corresponding virtual directory file list information to a user according to the first directory path information, acquiring file information selected by the user in the displayed virtual directory file list information, and generating a first data file downloading instruction; the first data file downloading instruction comprises first file path information and first file name information;
if the first file path information is matched with the path of the first virtual directory, performing basic drive test data shared directory path conversion processing on the first file path information to generate corresponding shared directory path information; the shared directory path information and the first file name information form corresponding shared directory data file information; calling a file access interface of the local sharing server, and downloading a basic drive test data file matched with the shared directory data file information from the basic drive test data shared directory;
if the first file path information is matched with the path of the second virtual directory, calling a data access API (application program interface) of the remote cloud storage platform, and downloading the optional drive test data file matched with the first file name information from the remote cloud storage platform.
2. The processing method for downloading massive drive test data according to claim 1, wherein the method further comprises:
the local sharing server calls a server data access API (application programming interface) provided by the remote cloud storage platform at a designated downloading time point every day, and downloads a latest complete basic drive test data file package from the remote cloud storage platform; and storing each latest basic drive test data file in the new complete basic drive test data file package under a corresponding root directory or under each level of subdirectories in the basic drive test data sharing directory according to a preset basic drive test data file-storage directory corresponding relation.
3. The processing method for downloading massive drive test data according to claim 1,
the shared directory file list information comprises a plurality of first data file information sets; the first data file information set at least comprises first data file path information, first data file name information, first data file type information and first data file size information; the first data file path information comprises first root directory path information; the first root directory path information is specifically a preset shared directory root directory identifier;
the selectable drive test data file list information comprises a plurality of second data file information sets; the second data file information set at least comprises second data file path information, second data file name information, second data file type information and second data file size information; the second data file path information is null.
4. The processing method for downloading massive drive test data according to claim 3, wherein the performing a first virtual directory file list conversion process on the shared directory file list information to generate corresponding first virtual directory file list information specifically includes:
taking the root directory path information of the first virtual directory as a first root directory identifier;
replacing the first root directory path information of each first data file information set in the shared directory file list information with the first root directory identifier;
and using the shared directory file list information after the replacement of the root directory path as the first virtual directory file list information.
5. The processing method for downloading massive drive test data according to claim 3, wherein the performing second virtual directory file list conversion processing on the selectable drive test data file list information to generate corresponding second virtual directory file list information specifically includes:
taking the root directory path information of the second virtual directory as a second root directory identifier;
setting the second root directory path information of each second data file information set in the optional drive test data file list information using the second root directory identifier;
and using the list information of the selectable drive test data files after the root directory path setting is finished as the list information of the second virtual directory files.
6. The processing method for downloading massive drive test data according to claim 1, wherein the displaying, according to the first directory path information, corresponding virtual directory file list information to a user, acquiring file information selected by the user from the displayed virtual directory file list information, and generating a first data file downloading instruction specifically includes:
if the first directory path information is matched with the path information of the first virtual directory, displaying the first virtual directory file list information to a user; acquiring file information selected by a user in the displayed first virtual directory file list information, and generating a first data file downloading instruction;
if the first directory path information is matched with the path information of the second virtual directory, displaying the file list information of the second virtual directory to a user; and acquiring file information selected by a user in the displayed second virtual directory file list information, and generating the first data file downloading instruction.
7. The processing method for downloading massive drive test data according to claim 1, wherein the performing basic drive test data shared directory path conversion processing on the first file path information to generate corresponding shared directory path information specifically includes:
in the first file path information, recording a character string matched with the root directory path information of the first virtual directory as a third directory identifier;
replacing the third root directory identifier of the first file path information with a preset shared directory root directory identifier;
and taking the first file path information after the replacement of the root directory as the shared directory path information.
8. An electronic device, comprising: a memory, a processor, and a transceiver;
the processor is used for being coupled with the memory, reading and executing the instructions in the memory to realize the method steps of any one of claims 1 to 7;
the transceiver is coupled to the processor, and the processor controls the transceiver to transmit and receive messages.
9. A computer-readable storage medium having stored thereon computer instructions which, when executed by a computer, cause the computer to perform the method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111154386.8A CN113923208B (en) | 2021-09-29 | 2021-09-29 | Processing method for downloading massive drive test data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111154386.8A CN113923208B (en) | 2021-09-29 | 2021-09-29 | Processing method for downloading massive drive test data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113923208A true CN113923208A (en) | 2022-01-11 |
| CN113923208B CN113923208B (en) | 2023-07-18 |
Family
ID=79237254
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111154386.8A Active CN113923208B (en) | 2021-09-29 | 2021-09-29 | Processing method for downloading massive drive test data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113923208B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114553931A (en) * | 2022-02-23 | 2022-05-27 | 广州小鹏汽车科技有限公司 | Processing method and device for vehicle shared storage space, vehicle and system |
| CN116233115A (en) * | 2023-02-14 | 2023-06-06 | 中国科学院计算机网络信息中心 | Efficient continuous controlled sharing distribution method and system for mass data files |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080005145A1 (en) * | 2006-06-30 | 2008-01-03 | Data Equation Limited | Data processing |
| CN111045985A (en) * | 2019-11-25 | 2020-04-21 | 北京百度网讯科技有限公司 | File storage processing method, server, electronic device and storage medium |
| CN111667605A (en) * | 2020-06-10 | 2020-09-15 | 北京百度网讯科技有限公司 | Automatic driving test data storage method and device and electronic equipment |
| CN112214469A (en) * | 2020-10-29 | 2021-01-12 | 北京红山信息科技研究院有限公司 | Drive test data processing method, device, server and storage medium |
-
2021
- 2021-09-29 CN CN202111154386.8A patent/CN113923208B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080005145A1 (en) * | 2006-06-30 | 2008-01-03 | Data Equation Limited | Data processing |
| CN111045985A (en) * | 2019-11-25 | 2020-04-21 | 北京百度网讯科技有限公司 | File storage processing method, server, electronic device and storage medium |
| CN111667605A (en) * | 2020-06-10 | 2020-09-15 | 北京百度网讯科技有限公司 | Automatic driving test data storage method and device and electronic equipment |
| CN112214469A (en) * | 2020-10-29 | 2021-01-12 | 北京红山信息科技研究院有限公司 | Drive test data processing method, device, server and storage medium |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114553931A (en) * | 2022-02-23 | 2022-05-27 | 广州小鹏汽车科技有限公司 | Processing method and device for vehicle shared storage space, vehicle and system |
| CN114553931B (en) * | 2022-02-23 | 2024-03-08 | 广州小鹏汽车科技有限公司 | Processing method, device, vehicle and system for shared storage space of vehicle |
| CN116233115A (en) * | 2023-02-14 | 2023-06-06 | 中国科学院计算机网络信息中心 | Efficient continuous controlled sharing distribution method and system for mass data files |
| CN116233115B (en) * | 2023-02-14 | 2023-09-19 | 中国科学院计算机网络信息中心 | Efficient continuous controlled sharing distribution method and system for mass data files |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113923208B (en) | 2023-07-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10146671B2 (en) | Testing of software upgrade | |
| US20150154224A1 (en) | Method, device, processing center and system for desktop synchronization | |
| CN113923208A (en) | Processing method for downloading mass drive test data | |
| CN110569298B (en) | Data docking and visualization method and system | |
| CN113645071B (en) | Cluster deployment method, system, medium and electronic terminal | |
| CN108829588B (en) | Processing method, deployment system and device for testing application program | |
| US20170153909A1 (en) | Methods and Devices for Acquiring Data Using Virtual Machine and Host Machine | |
| US20140181940A1 (en) | File management method and system and storage mediums | |
| CN108319550A (en) | A kind of test system and test method | |
| US20190140894A1 (en) | System and method for enabling hybrid integration platform through runtime auto-scalable deployment model for varying integration | |
| CN111049913B (en) | Data file transmission method and device, storage medium and electronic equipment | |
| CN116450165A (en) | Method, system, terminal and storage medium for quickly building environment and deploying program | |
| CN114070889B (en) | Configuration method, traffic forwarding device, storage medium, and program product | |
| CN111399896B (en) | Patch acquisition method, device, equipment and storage medium | |
| CN111431951B (en) | Data processing method, node equipment, system and storage medium | |
| CN115373831A (en) | Data processing method, device and computer readable storage medium | |
| CN108604226A (en) | For the cross-platform system and method for keeping the comment to electronic document synchronous | |
| CN107566212B (en) | Resource monitoring management method and device | |
| WO2023226602A1 (en) | Virtual machine acceleration hardware adjusting method and apparatus, storage medium and electronic apparatus | |
| US20230205598A1 (en) | Method and system for integrating multiple cloud platforms with diagraming tools | |
| CN111510472A (en) | Client cluster management method, system, terminal and storage medium | |
| CN117215714A (en) | Method, device, equipment and computer readable storage medium for synchronizing container mirror images | |
| CN117033315A (en) | File updating method, system, storage medium and electronic equipment | |
| CN117539502A (en) | Application system management method and device, storage medium and electronic equipment | |
| CN116384364A (en) | Automatic generation method, device, equipment and medium for data report |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |