Disclosure of Invention
In view of this, an object of the present application is to provide a seismic data acquisition method, a seismic data processing method, and a seismic data processing device, so as to share seismic data and make the process of using data simpler and more convenient.
The embodiment of the application provides a seismic data acquisition method, which is applied to a client and comprises the following steps:
sending a seismic data acquisition request to a server;
receiving an index file of seismic data in a data lake sent by a server, wherein the data lake comprises a plurality of distributed databases, and the distributed databases store a plurality of seismic data;
taking the seismic data with the type of a preset type in the seismic attribute information as first seismic data based on the seismic attribute information of each seismic data recorded in the index file;
based on the storage position of the first seismic data recorded in the index file, taking the first seismic data with the nearest storage position as second seismic data;
and acquiring the second seismic data by using a data channel of a distributed database for storing the second seismic data.
Further, the format of the seismic data is standard SEG-Y.
The embodiment of the application also provides a seismic data processing method, which is applied to a server side and comprises the following steps:
receiving a seismic data acquisition request sent by a client;
and sending the index file of the seismic data in the data lake to the client based on the seismic data acquisition request so that the client acquires the seismic data according to the index file.
Further, the format of the seismic data is standard SEG-Y.
Further, the seismic data processing method further comprises:
determining seismic attribute information and a storage position of the seismic data;
and determining an index file of the seismic data based on the seismic attribute information and the storage position of the seismic data.
The embodiment of the present application further provides a seismic data acquisition device, the seismic data acquisition device includes:
the request sending module is used for sending a seismic data acquisition request to the server;
the system comprises a receiving module, a processing module and a processing module, wherein the receiving module is used for receiving an index file of seismic data in a data lake, the index file is sent by a server, the data lake comprises a plurality of distributed databases, and the distributed databases store a plurality of seismic data;
the first processing module is used for taking the seismic data with the type being a preset type in the seismic attribute information as first seismic data based on the seismic attribute information of each seismic data recorded in the index file;
the second processing module is used for taking the first seismic data with the nearest storage position as second seismic data based on the storage position of the first seismic data recorded in the index file;
and the acquisition module is used for acquiring the second seismic data by utilizing a data channel of a distributed database for storing the second seismic data.
Further, the format of the seismic data is standard SEG-Y.
An embodiment of the present application further provides a seismic data processing apparatus, which includes:
the request receiving module is used for receiving a seismic data acquisition request sent by a client;
and the sending module is used for sending the index file of the seismic data in the data lake to the client based on the seismic data acquisition request so as to enable the client to acquire the seismic data according to the index file.
Further, the format of the seismic data is standard SEG-Y.
Further, the seismic data processing apparatus further comprises an index generation module, wherein the index generation module is configured to:
determining seismic attribute information and a storage position of the seismic data;
and determining an index file of the seismic data based on the seismic attribute information and the storage position of the seismic data.
An embodiment of the present application further provides an electronic device, including: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating over the bus when the electronic device is operating, the machine-readable instructions when executed by the processor performing the steps of the seismic data acquisition method or seismic data processing method as described above.
Embodiments of the present application also provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the computer program performs the steps of the seismic data acquisition method or the seismic data processing method as described above.
According to the seismic data acquisition method, the seismic data processing method and the seismic data processing device, the client sends a seismic data acquisition request to the server; receiving an index file of seismic data in a data lake sent by a server, wherein the data lake comprises a plurality of distributed databases, and the distributed databases store a plurality of seismic data; taking the seismic data with the type of a preset type in the seismic attribute information as first seismic data based on the seismic attribute information of each seismic data recorded in the index file; based on the storage position of the first seismic data recorded in the index file, taking the first seismic data with the nearest storage position as second seismic data; acquiring the second seismic data by using a data channel of a distributed database for storing the second seismic data; the server receives a seismic data acquisition request sent by the client; and sending the index file of the seismic data in the data lake to the client based on the seismic data acquisition request so that the client acquires the seismic data according to the index file. Compared with the seismic data acquisition method and the seismic data processing method in the prior art, the seismic data can be shared, and the data using process is simpler and more convenient.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. Every other embodiment that can be obtained by a person skilled in the art without making creative efforts based on the embodiments of the present application falls within the protection scope of the present application.
First, an application scenario to which the present application is applicable will be described. The method and the device can be applied to application scenarios of data acquisition and data processing, for example, when earthquake and geological research is carried out, the earthquake data need to be acquired from the database.
Research shows that the traditional seismic data processing technology adopts a stand-alone software mode and must be used in a stand-alone mode, data and software can be shared only in a local machine, and if the data and the software are shared by other people, local files need to be installed, seismic data files need to be shared, and a large amount of manual operation is needed.
Based on this, the embodiment of the application provides a seismic data acquisition method and a seismic data processing method, so that seismic data are shared, and the process of using the data is simpler and more convenient.
Referring to fig. 1, fig. 1 is a flowchart of a seismic data acquisition method according to an embodiment of the present disclosure. As shown in fig. 1, the seismic data acquisition method provided in the embodiment of the present application is applied to a client, and includes:
and S101, sending a seismic data acquisition request to a server.
In this step, when a user needs to acquire seismic data, the client may send a seismic data acquisition request to the server, so that the server sends an index file of the seismic data to the client, and the user selects the seismic data to be acquired from the index file through the client.
The format of the seismic data is a standardized SEG-Y format after normalization processing.
S102, receiving an index file of seismic data in a data lake sent by a server, wherein the data lake comprises a plurality of distributed databases, and the distributed databases store a plurality of seismic data.
The data lake comprises a plurality of distributed databases, a plurality of seismic data are stored in the distributed databases, the stored seismic data comprise a plurality of types, and the same type of seismic data may be stored in different distributed databases.
The index file comprises attribute information of each seismic data, wherein the attribute information comprises the type, the data size, the data content and the like of the seismic data; the index file also includes the storage location of each seismic data, i.e., the particular distributed database in which the seismic data is stored, and the particular location in which the seismic data is stored.
S103, based on the seismic attribute information of each seismic data recorded in the index file, taking the seismic data of which the type is a preset type in the seismic attribute information as first seismic data.
In the step, the index file records the seismic attribute information of each seismic data, the type of the seismic data can be determined through the seismic attribute information, a plurality of seismic data with preset types are obtained, and the seismic data are used as the first seismic data.
The preset type can be one or more types of seismic data required by the user.
Therefore, the seismic data are subjected to first-level indexing through the seismic attribute information in the index file, the seismic data meeting the user requirements are screened out, and the calculation amount in the data acquisition process is further reduced.
And S104, based on the storage position of the first seismic data recorded in the index file, using the first seismic data with the nearest storage position as second seismic data.
In this step, the distributed server in which each first seismic data is stored may be determined according to the storage location of the first seismic data recorded in the index file, the distributed server closest to the communication distance of the client is determined, and the first seismic data corresponding to the distributed server closest to the communication distance is used as the second seismic data.
Therefore, the second-level index of the seismic data is carried out through the storage position information in the index file, the required second seismic data is finally determined, the operation carried out when the data required to be acquired is determined can be reduced, and the waste of resources is avoided.
And S105, acquiring the second seismic data by using a data channel of a distributed database for storing the second seismic data.
In this step, after determining the storage location of the second data in the index file, the acquisition request of the second seismic data may be sent, and the second seismic data may be acquired through a data channel of a distributed database storing the second seismic data.
The seismic data acquisition method provided by the embodiment of the application sends a seismic data acquisition request to a server; receiving an index file of seismic data in a data lake sent by a server, wherein the data lake comprises a plurality of distributed databases, and the distributed databases store a plurality of seismic data; taking the seismic data with the type of a preset type in the seismic attribute information as first seismic data based on the seismic attribute information of each seismic data recorded in the index file; based on the storage position of the first seismic data recorded in the index file, taking the first seismic data with the nearest storage position as second seismic data; and acquiring the second seismic data by using a data channel of a distributed database for storing the second seismic data. Compared with the seismic data acquisition method in the prior art, the seismic data are stored in the distributed server, the seismic data are shared, secondary indexing is performed by using the index file, operation during data acquisition is reduced, and resource waste is avoided.
Referring to fig. 2, fig. 2 is a flowchart of a seismic data processing method according to an embodiment of the present application. As shown in fig. 2, the seismic data processing method provided in the embodiment of the present application is applied to a server, and includes:
s201, receiving a seismic data acquisition request sent by a client.
S202, sending the index file of the seismic data in the data lake to the client based on the seismic data acquisition request, so that the client acquires the seismic data according to the index file.
In the step, after receiving a seismic data acquisition request sent by a client at a server, an index file of seismic data in a data lake can be determined, and the index file is sent to the client, so that a user can select seismic data of a required preset type according to information in the index file through the client, and further obtain the selected seismic data.
Optionally, the format of the seismic data is standard SEG-Y.
The format of the seismic data is a standardized SEG-Y format after standardization processing.
Optionally, the seismic data processing method further includes:
determining seismic attribute information and a storage position of the seismic data;
and determining an index file of the seismic data based on the seismic attribute information and the storage position of the seismic data.
In this step, an index file of the seismic data may be generated based on the seismic attribute information and the storage location of the seismic data.
Specifically, a text file header and a binary header of the seismic data can be read, and a file header of an index file is generated according to the text file header and the binary header, wherein the file header of the index file comprises attribute information of the seismic data in the text file header and the binary header; generating a seismic information head of an index file containing seismic data attribute information by analyzing a binary head of the seismic data; determining the storage position of the seismic data through the data volume of the seismic data; generating primary index information and secondary index information according to the seismic data attribute information and the storage position; the index file comprises first-level index information and second-level index information, the first-level index information comprises seismic data attribute information, and the second-level index comprises a storage position of the seismic data.
The seismic data processing method provided by the embodiment of the application receives a seismic data acquisition request sent by a client; and sending the index file of the seismic data in the data lake to the client based on the seismic data acquisition request so that the client acquires the seismic data according to the index file. Compared with the seismic data processing method in the prior art, the method and the system have the advantages that the client carries out secondary indexing by using the index file, so that the seismic data are obtained, the operation during data obtaining is reduced, and the waste of resources is avoided.
Referring to fig. 3, fig. 3 is a schematic structural diagram of a seismic data acquisition device according to an embodiment of the present disclosure. As shown in fig. 3, the seismic data acquisition apparatus 300 includes:
a request sending module 310, configured to send a seismic data acquisition request to a server;
the receiving module 320 is configured to receive an index file of seismic data in a data lake, where the data lake includes multiple distributed databases, and the multiple distributed databases store multiple seismic data;
the first processing module 330 is configured to use, as first seismic data, seismic data of which the type is a preset type in the seismic attribute information based on the seismic attribute information of each seismic data recorded in the index file;
the second processing module 340 is configured to use the first seismic data with the closest storage location as the second seismic data based on the storage location of the first seismic data recorded in the index file;
an obtaining module 350, configured to obtain the second seismic data by using a data channel of a distributed database storing the second seismic data.
The seismic data device provided by the embodiment of the application sends a seismic data acquisition request to the server; receiving an index file of seismic data in a data lake sent by a server, wherein the data lake comprises a plurality of distributed databases, and the distributed databases store a plurality of seismic data; taking the seismic data with the type of a preset type in the seismic attribute information as first seismic data based on the seismic attribute information of each seismic data recorded in the index file; based on the storage position of the first seismic data recorded in the index file, taking the first seismic data with the nearest storage position as second seismic data; and acquiring the second seismic data by using a data channel of a distributed database for storing the second seismic data. Compared with the seismic data acquisition device in the prior art, the seismic data are stored in the distributed server, the seismic data are shared, secondary indexing is performed by using the index file, operation during data acquisition is reduced, and resource waste is avoided.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a seismic data processing apparatus according to an embodiment of the present disclosure. As shown in fig. 4, the seismic data processing apparatus 400 includes:
a request receiving module 410, configured to receive a seismic data acquisition request sent by a client;
a sending module 420, configured to send, based on the seismic data acquisition request, an index file of seismic data in a data lake to the client, so that the client acquires the seismic data according to the index file.
Further, the seismic data processing apparatus 400 further includes an index generation module 430, and the index generation module 430 is configured to:
determining seismic attribute information and a storage position of the seismic data;
and determining an index file of the seismic data based on the seismic attribute information and the storage position of the seismic data.
The seismic data processing device provided by the embodiment of the application receives a seismic data acquisition request sent by a client; and sending the index file of the seismic data in the data lake to the client based on the seismic data acquisition request so that the client acquires the seismic data according to the index file. Compared with the seismic data processing device in the prior art, the method and the system have the advantages that the index file is used, so that the client carries out secondary indexing, further seismic data are obtained, the operation during data obtaining is reduced, and the waste of resources is avoided.
Referring to fig. 5, fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. As shown in fig. 5, the electronic device 500 includes a processor 510, a memory 520, and a bus 530.
The memory 520 stores machine-readable instructions executable by the processor 510, when the electronic device 500 runs, the processor 510 communicates with the memory 520 through the bus 530, and when the machine-readable instructions are executed by the processor 510, the steps in the seismic data acquisition method shown in fig. 1 and the seismic data processing method embodiment shown in fig. 2 may be performed.
An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps in the seismic data acquisition method shown in fig. 1 and the steps in the seismic data processing method embodiment shown in fig. 2 may be executed.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present application, and are used for illustrating the technical solutions of the present application, but not limiting the same, and the scope of the present application is not limited thereto, and although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope disclosed in the present application; such modifications, changes or substitutions do not depart from the spirit and scope of the exemplary embodiments of the present application, and are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.