CN117955991A - Service processing method, device, equipment and storage medium - Google Patents

Service processing method, device, equipment and storage medium Download PDF

Info

Publication number
CN117955991A
CN117955991A CN202410165241.5A CN202410165241A CN117955991A CN 117955991 A CN117955991 A CN 117955991A CN 202410165241 A CN202410165241 A CN 202410165241A CN 117955991 A CN117955991 A CN 117955991A
Authority
CN
China
Prior art keywords
data
data packet
service
server
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202410165241.5A
Other languages
Chinese (zh)
Inventor
王顺吉
张军
刘康俊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Wuyi Vision Digital Twin Technology Co ltd
Original Assignee
Beijing Wuyi Vision Digital Twin Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Wuyi Vision Digital Twin Technology Co ltd filed Critical Beijing Wuyi Vision Digital Twin Technology Co ltd
Publication of CN117955991A publication Critical patent/CN117955991A/en
Pending legal-status Critical Current

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present disclosure provides a service processing method, apparatus, device, and storage medium. In the embodiment of the disclosure, the construction equipment in the distributed storage system responds to the trigger event for constructing the data for the target service, so that the data packet of the type corresponding to the target service can be constructed in a targeted and automatic manner according to the specific type of the target service, and under the condition of responding to the data change, the constructed latest data can be synchronized to different geographic areas in time, the consistency of the distributed storage of the data is ensured, the data synchronization efficiency and the speed of accessing the data by users in different geographic areas are improved, and the communication pressure can be reduced for the data storage scene with large data quantity.

Description

Service processing method, device, equipment and storage medium
The present application claims priority from China national intellectual property agency, application number 202311841240X, entitled "service processing method, distributed storage System, device and storage Medium", filed at 28, 12, 2023, the entire contents of which are incorporated herein by reference.
Technical Field
The disclosure relates to the technical field of distributed storage, and in particular relates to a service processing method, a device, equipment and a storage medium.
Background
For the distributed access scene of data, it is important to ensure the consistency of the data, especially for the application scene with larger data volume, complex file type and frequent version update, if the data change cannot be responded in time and the latest data cannot be constructed in a targeted manner according to specific change information, the consistency of the access data of different geographic areas is difficult to ensure, and the user experience is affected.
Disclosure of Invention
In order to achieve that data can be acquired without delay in different geographic areas, the disclosure provides a service processing method, a device, equipment and a storage medium.
In a first aspect, an embodiment of the present disclosure provides a service processing method, configured for a device for constructing a distributed storage system, where the method includes: responding to a trigger event of the target service construction data, and acquiring a program code file corresponding to the target service; determining a corresponding file directory structure and attribute information of each file according to the program code file; constructing a first data packet of a description type according to the file directory structure and the attribute information; determining executable program files included in the program code files; and generating a second data packet of the executable type according to the executable program file.
In an alternative manner, generating a second data packet of an executable type according to an executable program file includes: analyzing detailed information of the executable program file; encrypting the detailed information of the executable program file; and determining a file packet comprising the encrypted executable program file as a second data packet.
In an alternative manner, the method further comprises: pushing the first data packet to a first server of a first data center of the distributed storage system; synchronously pushing the first data packet to a first server of at least one second data center in communication connection through a first server of the first data center; each second data center is located in a different geographic location and each second data center is located in a different geographic location than the first data center.
In an alternative manner, the method further comprises: pushing the second data packet to a second server of the first data center of the distributed storage system; synchronously pushing the second data packets to a second server of at least one second data center of the communication connection through a second server of the first data center; each second data center is located in a different geographic location and each second data center is located in a different geographic location than the first data center.
In an alternative manner, the method further comprises: and synchronously updating the received second data packets to a third server of the corresponding second data center through the second server of each second data center.
In a second aspect, an embodiment of the present disclosure further provides a service processing method, configured to be used at a user side, where the method includes: receiving a service request; determining the service data type of the requested target service according to the service request; the service data types include description types and/or executable types; acquiring a first data packet of a description type and/or a second data packet of an executable type from a distributed storage system according to the service data type; analyzing the first data packet and/or the second data packet; and executing the target service according to the parsed data packet information.
In a third aspect, an embodiment of the present disclosure provides a service processing apparatus for a building device of a distributed storage system, the apparatus including: the acquisition module is used for responding to a trigger event of the target service construction data and acquiring a program code file corresponding to the target service; the first determining module is used for determining a corresponding file directory structure and attribute information of each file according to the program code file; the first processing module is used for constructing a first data packet of a description type according to the file directory structure and the attribute information; a second determining module, configured to determine an executable program file included in the program code file; and the second processing module is used for generating a second data packet of an executable type according to the executable program file.
In an optional manner, the second processing module is configured to generate, according to the executable program file, a second data packet of an executable type, specifically: the second processing module is used for: analyzing detailed information of the executable program file; encrypting the detailed information of the executable program file; and determining a file packet comprising the encrypted executable program file as a second data packet.
In an alternative manner, the method further comprises: the first pushing module is used for pushing the first data packet to a first server of a first data center of the distributed storage system; synchronously pushing the first data packet to a first server of at least one second data center in communication connection through a first server of the first data center; each second data center is located in a different geographic location and each second data center is located in a different geographic location than the first data center.
In an alternative manner, the method further comprises: the second pushing module is used for pushing the second data packet to a second server of the first data center of the distributed storage system; synchronously pushing the second data packets to a second server of at least one second data center of the communication connection through a second server of the first data center; each second data center is located in a different geographic location and each second data center is located in a different geographic location than the first data center.
In an alternative manner, the method further comprises: and the updating module is used for synchronously updating the received second data packets to the third server of the corresponding second data center through the second server of each second data center.
In a fourth aspect, an embodiment of the present disclosure further provides a service processing apparatus, configured to be used at a user side, where the apparatus includes: the receiving module is used for receiving the service request; the determining module is used for determining the service data type of the requested target service according to the service request; the service data types include description types and/or executable types; the acquisition module is used for acquiring the first data packet of the description type and/or the second data packet of the executable type from the distributed storage system according to the service data type; the processing module is used for analyzing the first data packet and/or the second data packet; and the execution module is used for executing the target service according to the parsed data packet information.
In a fifth aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory storing a computer program product; the processor is configured to execute the computer program product and when the computer program product is executed, implement the service processing method of the first aspect or the second aspect.
In a sixth aspect, an embodiment of the present disclosure provides a computer readable storage medium, on which computer program instructions are stored, which when executed implement the service processing method of the first aspect or the second aspect.
In the embodiment of the disclosure, the construction equipment in the distributed storage system responds to the trigger event for constructing the data for the target service, so that the data packet of the type corresponding to the target service can be constructed in a targeted and automatic manner according to the specific type of the target service, and under the condition of responding to the data change, the constructed latest data can be synchronized to different geographic areas in time, the consistency of the distributed storage of the data is ensured, the data synchronization efficiency and the speed of accessing the data by users in different geographic areas are improved, and the communication pressure can be reduced for the data storage scene with large data quantity.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and other drawings may be obtained according to these drawings without inventive effort for a person of ordinary skill in the art.
Fig. 1 is a schematic structural diagram of a distributed storage system according to an embodiment of the present disclosure.
Fig. 2a is a flowchart of a service processing method according to an embodiment of the present disclosure.
Fig. 2b is a flowchart of another service processing method according to an embodiment of the present disclosure.
Fig. 2c is a schematic diagram of a data synchronization process related to an execution process of a service processing method according to an embodiment of the present disclosure.
Fig. 3a is a block diagram of a service processing device according to an embodiment of the present disclosure.
Fig. 3b is a block diagram of another service processing device according to an embodiment of the present disclosure.
Fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure.
Detailed Description
The present disclosure is further described in detail below with reference to the drawings and examples. The features and advantages of the present disclosure will become more apparent from the description.
The word "exemplary" is used herein to mean "serving as an example, embodiment, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. Although various aspects of the embodiments are illustrated in the accompanying drawings, the drawings are not necessarily drawn to scale unless specifically indicated.
In addition, technical features described below in the different embodiments of the present disclosure may be combined with each other as long as they do not collide with each other.
Fig. 1 is a schematic structural diagram of a distributed storage system according to an embodiment of the present application, as shown in fig. 1, in the system, the system includes: build device 10, first data center 100, and a plurality of second data centers, fig. 1 illustrates second data center 200 and second data center 300 as examples; wherein each data center comprises a first server and a second server.
That is, the first data center 100 is provided therein with a first server and a second server. The second data center 200 is also provided with a first server and a second server. The second data center 300 is also provided with a first server and a second server.
As shown in fig. 1, in the embodiment of the present disclosure, the construction apparatus 10 is configured to construct a first data packet of a description type and a second data packet of an execution type corresponding to a target service using a continuous integration construction tool, and push the first data packet to a first server 101 of a first data center 100, and push the second data packet to a second server 102 of the first data center 100. Alternatively, the integrated build tool may be Jenkins, which should be noted that the integrated build tool is not limited to this in practical application and may be selected according to practical requirements.
Wherein the first server 101 of the first data center 100 is configured to synchronously push the first data packet to the first server of at least one second data center connected by communication; for example, as shown in fig. 1, the first server 101 of the first data center 100 pushes the first data packet sync to the first server 201 in the second data center 200 and the first server 301 in the second data center 300. A second server 102 of the first data center 100 for synchronously pushing second data packets to a second server of at least one second data center of the communication connection; for example, as shown in fig. 1, the second server 102 of the first data center 100 pushes the second data packet sync to the first server 202 in the second data center 200 and the first server 302 in the second data center 300. Each second data center is configured to provide the first data packet and the second data packet to the user terminal, so that the user terminal provides the target service to the user according to the first data packet and the second data packet, and a process of providing the target service to the user terminal by the system will be described in the following embodiments, which will not be described in detail herein.
In the embodiment of the present disclosure, when the construction apparatus 10 constructs the first data packet and the second data, the construction apparatus 10 responds to a trigger event for constructing the data for the target service, based on which, as shown in fig. 1, the construction apparatus 10 may acquire a program code file corresponding to the target service from the warehouse management system 20; further, the construction apparatus 10 may construct a corresponding first data packet of the description type and a corresponding second data packet of the execution type according to the program code file. The specific type of the triggering event of the construction data is not limited, and may alternatively be triggered by a timing task, for example, a timing task for periodically updating the service data; or may be triggered by an application scenario change, for example, a new function needs to be added or an application error needs to be modified in a certain application scenario; or may be user-operated, e.g., manually by a developer after submission of new program code; the method can also be that the continuous integrated system automatically detects automatic triggering after the source code is changed, and the specific triggering mode can be determined according to actual requirements.
Based on the above, in any manner, when the construction device 10 is triggered to construct a data packet for a target service, after the construction device 10 obtains a program code file corresponding to the target service from the warehouse management system 20, a corresponding file directory structure and attribute information of each file may be determined according to the program code file, and then a first data packet of a description type is constructed according to the file directory structure and the attribute information; and determining executable program files included in the data packet according to the program code files, analyzing detailed information of each executable program file, and generating a second data packet of an executable type according to the detailed information of each executable program file.
In the embodiment of the present disclosure, the type and specific content of the first data packet are not limited, alternatively, the type of the first data packet may be a data packet for storing metadata, where the content includes, but is not limited to, descriptive information describing identification information, version number, type, data source, dependency relationship, compatibility, and the like of a software program file, and specifically, the content may be increased or decreased according to actual requirements.
Accordingly, the embodiments of the present disclosure are not limited in terms of the type and content of the second data packet, and alternatively, the type of the second data packet may be a data packet for storing configuration information of the engine and the plug-in, which information needs to be used by other software components for further operations; optionally, the corresponding content includes, but is not limited to, a base configuration: such as port number, server address, user credentials, etc.; plug-in configuration: such as each plug-in on/off state, inter-plug-in communication settings, plug-in input/output settings, etc.; log configuration: such as log level, location of log files, rotation policy of the log, etc.; performance configuration: such as thread count, connection pool size, cache size, etc., to optimize system performance; safety configuration: such as user rights management, encryption settings, access control lists, etc.; data source configuration: such as databases, file systems, web services, etc.; advanced configuration: such as cluster configuration of a distributed system, failover policies, etc.; monitoring and warning configuration: such as when to monitor the operating state of the system and how to send alerts or notifications when anomalies or errors occur; expansion and integration configuration: for example, loading and managing the configuration of third party plug-ins or modules; environment variables and configuration files: such as environment variables required to ensure proper operation of the software, configuration texts for external configuration, etc., the specific contents may be determined according to actual requirements.
In the embodiment of the present disclosure, when the construction device 10 generates the second data packet, the detailed information of each executable program file may be further encrypted to generate a file packet including the encrypted detailed information of all executable program files as the second data packet. The embodiment of the present disclosure is not limited to a specific Algorithm for encrypting the detailed information of each executable program file, and may alternatively be implemented by using the information summarization Algorithm 5 (MESSAGE DIGEST Algorithm 5, md 5), which is not limited thereto.
Further alternatively, in order to improve the synchronization efficiency and reduce the processing of large data volume, the encrypted detailed information may be stored in a lightweight data exchange format (JavaScript Object Notation, JSON), which is not limited to this in practical application. Optionally, the encrypted JSON file at least includes a file size of each executable program file, so as to verify the integrity of each executable program file and consistency of data in the synchronization process, and after the content of each executable program file is encrypted by MD5, the content of each executable program file has uniqueness, so that the content can be used for determining whether copies of each executable program file in different geographic locations are identical or tampered.
In this embodiment of the present disclosure, as shown in fig. 1, each data center in the distributed storage system further includes a third server of the same type as the second server, where each second server is used as a primary server, and the third server of the same type is used as a standby server, and after receiving the second data packet, the second server of each data center synchronously updates the received second data packet to the third server of the corresponding data center in real time, so as to be used for expanding the copy of the second data packet and ensuring the fault tolerance of the system. Further alternatively, when the second server of any one data center fails, the third server of the same type may be switched to the main server, so as to ensure that data storage and data synchronization between other data centers are performed normally. Accordingly, among the first servers of all data centers in the distributed storage system, the first server 101 of the first data center 100 serves as a main server, the first servers of other data centers serve as standby servers, and after the first server 101 of the first data center 101 receives the first data packet, the first data packet can be synchronized with the first servers of the other data centers in real time.
In the embodiments of the present disclosure, the specific types of the first server, the second server, and the third server in each data center are not limited, alternatively, the first server in each data center may be a BaGet database server for storing and retrieving metadata of Jenkins automation construction; the second server and the third server in each data center may be SEAWEEDFS object storage servers for storing and externally providing configuration information of the Jenkins automation built engines and plug-ins to meet the storage requirements for large data volumes.
In the embodiment of the present disclosure, different data centers are located in different geographic locations, for example, the first data center 100 shown in fig. 1 may be in the open sea, the second data center 200 may be in beijing, and the second data center 300 may be in the capital, although it is not limited thereto. Based on the above, jenkins sends the first data packet and the second data packet which are automatically constructed to the first server and the second server which are located in the Shanghai, and then the first server in the Shanghai synchronizes the received first data packet to the first server of Beijing and Chengdu respectively at the first time; accordingly, the second server in the Shanghai synchronizes the received second data packet to the second server in Beijing and Chengdu respectively at the first time. Because each data center is further provided with a third server of the same type as the second server, the second server of each data center can be synchronized to the third server of the data center in real time after receiving the second data packet. Therefore, under the condition that the second server of any one data center fails, the third server can be used for continuously executing the data distributed storage task, and the disaster tolerance of the system is improved.
Optionally, in order to ensure consistency of data, before the data center in Shanghai synchronizes data with other data centers, it is also possible to verify whether the data packet is tampered before synchronization through Jenkins. Optionally, reading the second data packet built by the Jenkins and reading the corresponding second data packet in the second server in the Shanghai may be performed by Jenkins, and since the content of the second data packet is encrypted by MD5 and has consistency, jenkins may identify the content of the second data packet and compare the content of the second data packet with the content of the second data packet to ensure that the second data packet is not tampered before synchronization. Based on this, jenkins may execute the synchronization instruction in case it is determined that it has not been tampered with, and synchronize the second data packet stored by the second server in the sea into the second server in beijing and capitalization by a specified transmission Protocol, such as file transfer Protocol (FILE TRANSFER Protocol, FTP), hypertext transfer Protocol (HyperText Transfer Protocol, HTTP), or other file transfer Protocol, or using a synchronization tool, such as a remote data synchronization tool (Remote Synchronization, RSYNC). In response to this, the control unit, beijing and Cheng can also receive the second data in the same way the packet is checked to ensure that the second data packet has not been tampered with during transmission. The checksum synchronization process for the first data packet is also similar and will not be described in detail herein.
Further alternatively, for each synchronization operation, jenkins may also record relevant logs for data tracking and maintenance, such as information of synchronization packet identification, synchronization status (success or failure), and time stamp, and the specific content is not limited.
It should be noted that, in the embodiment of the present disclosure, the timing of triggering the data synchronization between the data centers is not limited, alternatively, the data synchronization may be automatically triggered, for example, jenkins may configure a task of automatically executing a synchronization command after automatically constructing the first data packet and the second data packet, so as to synchronize the first data packet and the second data packet constructed this time from the data center in the Shanghai to the data center in the Beijing and the cheng, respectively; alternatively, it may also be manually triggered, for example, an administrator or developer may manually trigger Jenkins to initiate a synchronization task through a command line tool or web interface; alternatively, the method may be triggered by a monitoring event having a monitoring function on the storage system, for example, when the monitoring event monitors that the application scenario involves a program code or data change, the method triggers Jenkins to start a synchronization task.
It should be further noted that, in the embodiment of the present disclosure, the synchronization timing of the first data packet and the second data packet is not limited, and since the first data packet stores descriptive metadata, generally, the metadata is not frequently changed after Jenkins is constructed, the data synchronization operation may be performed only once after the construction, or may be performed only when necessary information is changed. Because the second data packet stores configuration information of the engine or the plug-in, the executable program files may be frequently changed in specific applications, so that a change state needs to be monitored in real time, when the existence of related content change is monitored, jenkins are triggered in time to construct new data content and trigger a data synchronization task, and instantaneity and consistency of access data among different geographic positions are ensured.
According to the distributed storage system provided by the embodiment of the disclosure, the data are stored in a distributed manner by adopting the main server and the standby server at different geographic positions, so that the same data can be ensured to be synchronously stored at different geographic positions, and the speed of accessing the data by users at different geographic positions can be improved; and the continuous integrated construction tool is adopted to automatically respond to the triggering event aiming at the target service construction data, the data packet of the type corresponding to the target service can be constructed in a targeted and automatic way according to the specific type of the target service, in addition, under the condition of responding to the data change, the constructed latest data can be synchronized to different geographic areas in time, the consistency of the distributed data storage is ensured, the data synchronization efficiency is improved, and the communication pressure can be reduced for the data storage scene with large data volume.
Based on the above system structure, the embodiment of the disclosure also provides a service processing method, which can be applied to the construction equipment of the distributed storage system. FIG. 2a is a flow chart of the service processing method, as shown in FIG. 2a, the method includes:
S1a, responding to a trigger event of target service construction data, and acquiring a program code file corresponding to target service;
s2a, determining a corresponding file directory structure and attribute information of each file according to the program code file;
s3a, constructing a first data packet of a description type according to the file directory structure and the attribute information;
s4a, determining executable program files included in the program code files;
s5a, generating a second data packet of the executable type according to the executable program file.
In an alternative embodiment, the construction device generates the second data packet of the executable type according to the executable program file, and may be implemented in the following manner: analyzing detailed information of the executable program file; encrypting the detailed information of the executable program file; and determining a file packet comprising the encrypted executable program file as a second data packet.
In an alternative embodiment, the construction device may further push the first data packet to the first server of the first data center of the distributed storage system, so as to synchronously push the first data packet to the first server of the at least one second data center of the communication connection through the first server of the first data center. Accordingly, the construction device can also push the second data packet to the second server of the first data center of the distributed storage system, so as to synchronously push the second data packet to the second server of the at least one second data center of the communication connection through the second server of the first data center. Wherein each second data center is located in a different geographic location and each second data center is located in a different geographic location than the first data center.
In an alternative embodiment, the construction device may also update the received second data packets synchronously via the second server of each second data center to the third server of the corresponding second data center.
It should be noted that, regarding the specific data synchronization process involved in the implementation process of the above method, reference may be made to the description of the corresponding portion in the above system embodiment, which is not repeated herein.
Based on the above system structure, the embodiment of the disclosure further provides a service processing method, which can be applied to a user side. Fig. 2b is a flowchart of the service processing method, as shown in fig. 2b, the method includes:
S1b, receiving a service request;
s2b, determining a service data type of the requested target service according to the service request, wherein the service data type comprises a description type and/or an executable type;
S3b, acquiring a first data packet of a description type and/or a second data packet of an executable type from the distributed storage system according to the service data type;
S4b, analyzing the first data packet and/or the second data packet;
s5b, executing the target service according to the analyzed data packet information.
In the embodiment of the disclosure, when a user has a service use requirement, the user may send a service request to a service end providing a service through the user end, and optionally, the service end providing the service may be a second server of any second data center in the distributed storage system. Based on this, after receiving the service request input by the user for the target service, the user side may determine, according to the service request, that the service data type required for the requested target service is a description type and/or an execution type. Further, according to the determined service data type, a first data packet describing the type may be acquired from a first server of a second data center providing the target service and/or a second data packet executing the type may be acquired from a second server of the second data center. Based on the above, the user side may parse the obtained first data packet and/or second data packet under the condition that the first data packet and the second data packet required for executing the target service are obtained, execute the target service according to the parsed data packet information, and present the execution result of the target service to the user.
Based on this, the data communication process corresponding to the execution flow of the method is shown in fig. 2c, where the user side directly interacts with the user, receives the service request input by the user, acquires the corresponding first data packet and the second data packet from the second data center according to the service request input by the user, and in combination with the system structure, it can be known that the first data packet of the second data center is synchronously pushed by the first server of the first data center; the second data packet of the second data center is synchronously pushed by the second server of the first data center, and the first data packet and the second data packet stored in the first data center are respectively pushed to the first server and the second server of the first data center after being respectively generated by the continuous integration construction tool. As shown in fig. 2c, the user side is further configured to execute the target service according to the acquired first data packet and second data packet and present the service result to the user.
It should be noted that, regarding the specific data synchronization process involved in the implementation process of the above method, reference may be made to the description of the corresponding portion in the above system embodiment, which is not repeated herein.
In the embodiment of the disclosure, the construction equipment in the distributed storage system responds to the trigger event for constructing the data for the target service, so that the data packet of the type corresponding to the target service can be constructed in a targeted and automatic manner according to the specific type of the target service, and under the condition of responding to the data change, the constructed latest data can be synchronized to different geographic areas in time, the consistency of the distributed storage of the data is ensured, the data synchronization efficiency and the speed of accessing the data by users in different geographic areas are improved, and the communication pressure can be reduced for the data storage scene with large data quantity.
It is understood that the foregoing embodiments are merely examples, and modifications may be made to the foregoing embodiments in actual implementation, and those skilled in the art may understand that the modification methods of the foregoing embodiments without performing any inventive effort fall within the protection scope of the present disclosure, and are not repeated in the embodiments.
All the above optional solutions may be mutually referred to or combined to form an optional embodiment of the disclosure, which is not described herein in detail.
Based on the same inventive concept, the embodiments of the present disclosure provide a service processing apparatus applied to the above-mentioned construction device of the distributed storage system, and also provide a service processing apparatus applied to the user side, and since the principle of the problem solved by the above-mentioned service processing apparatus is similar to the foregoing service processing method and the function of the distributed storage system, the implementation of the above-mentioned service processing apparatus may refer to the description of the corresponding parts in the foregoing system embodiment, and the repetition is omitted.
Fig. 3a is a block diagram of a service processing apparatus 300a according to an embodiment of the present disclosure, where the service processing apparatus 300a may be applied to the above-described construction device of the distributed storage system. As shown in fig. 3a, the service processing apparatus 300a may include: an acquisition module 301a, a first determination module 302a, a first processing module 303a, a second determination module 304a, and a second processing module 305a; wherein,
The acquiring module 301a is configured to acquire a program code file corresponding to a target service in response to a trigger event for constructing data for the target service;
The first determining module 302a is configured to determine, according to the program code file, a corresponding file directory structure and attribute information of each file therein;
The first processing module 303a is configured to construct a first data packet of a description type according to the file directory structure and the attribute information;
The second determining module 304a is configured to determine an executable program file included in the program code file;
the second processing module 305a is configured to generate a second data packet of an executable type according to the executable program file.
In an alternative manner, the second processing module 305a generates, according to the executable program file, a second data packet of an executable type for: analyzing detailed information of the executable program file; encrypting the detailed information of the executable program file; and determining a file packet comprising the encrypted executable program file as a second data packet.
In an alternative way, the second processing module 305a is further configured to: the first data packet is pushed to a first server of a first data center of the distributed storage system to synchronously push the first data packet to a first server of at least one second data center of the communication connection through the first server of the first data center. Accordingly, the second processing module 305a is further configured to: pushing the second data packets to a second server of the first data center of the distributed storage system to synchronously push the second data packets to a second server of at least one second data center of the communication connection through the second server of the first data center. Wherein each second data center is located in a different geographic location and each second data center is located in a different geographic location than the first data center.
In an alternative manner, the second processing module 305a is further configured to update the received second data packet synchronously to the third server of the corresponding second data center through the second server of each second data center.
It should be noted that, regarding the specific data synchronization process involved in the execution process of each module in the service processing apparatus, reference may be made to the description of the corresponding portion in the above system embodiment, which is not repeated herein.
Accordingly, fig. 3b is a block diagram illustrating a service processing apparatus 300b according to an embodiment of the present disclosure, where the service processing apparatus 300b may be applied to a user terminal. As shown in fig. 3a, the service processing apparatus 300b may include: a receiving module 301b, a determining module 302b, an obtaining module 303b, a processing module 304b and an executing module 305b; wherein,
The receiving module 301b is configured to receive a service request;
the determining module 302b is configured to determine a service data type of the requested target service according to the service request; the service data types include description types and/or executable types;
the obtaining module 303b is configured to obtain, according to the service data type, a first data packet of a description type and/or a second data packet of an executable type from the distributed storage system;
the processing module 304b is configured to parse the first data packet and/or the second data packet;
The execution module 305b is configured to execute the target service according to the parsed packet information.
It should be noted that, regarding the specific data synchronization process involved in the execution process of each module in the service processing apparatus, reference may be made to the description of the corresponding portion in the above system embodiment, which is not repeated herein.
The embodiment of the disclosure further provides an electronic device, and referring to the figure, fig. 4 is a block diagram of the electronic device provided by the embodiment of the disclosure. As shown in fig. 4, the electronic device 400 may include a processor 401, a memory 402, and a program or an instruction stored in the memory 402 and executable on the processor 401, where the program or the instruction implements steps of the method embodiment for constructing a device for a distributed storage system, or implements steps of the method embodiment for a user side.
It should be noted that, regarding the function of executing each step by the processor of the above-mentioned computer device, the specific data synchronization process involved can be referred to the description of the above-mentioned system embodiment, which is not repeated here.
It should be further noted that, in the embodiments of the present disclosure, the electronic device includes a mobile electronic device and a non-mobile electronic device, and the specific type is not limited.
The embodiments of the present disclosure further provide a computer readable storage medium, on which a computer program is stored, where the computer program when executed by a processor implements each step of the building apparatus for a distributed storage system in the foregoing method embodiment, or implements each step for a client in the foregoing method embodiment, and the same technical effects can be achieved, and for avoiding repetition, a detailed description is omitted herein.
The processor is a processor in the electronic device in the above embodiment. Readable storage media include computer readable storage media such as Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic or optical disks, and the like.
The present disclosure is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments in part. In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.
Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. The specific meaning of the terms in this disclosure will be understood by those of ordinary skill in the art as the case may be.
It should be noted that, without conflict, the embodiments of the present disclosure and features of the embodiments may be combined with each other. The present disclosure is not limited to any single aspect, nor to any single embodiment, nor to any combination and/or permutation of these aspects and/or embodiments. Moreover, each aspect and/or embodiment of the disclosure may be used alone or in combination with one or more other aspects and/or embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present disclosure, and not for limiting the same; although the present disclosure has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the embodiments of the disclosure, and are intended to be included within the scope of the claims and specification of the present disclosure.

Claims (10)

1. A service processing method, characterized by a build device for a distributed storage system, the method comprising:
responding to a trigger event of target service construction data, and acquiring a program code file corresponding to the target service;
Determining a corresponding file directory structure and attribute information of each file according to the program code file;
constructing a first data packet of a description type according to the file directory structure and the attribute information;
Determining executable program files included in the program code files;
And generating a second data packet of an executable type according to the executable program file.
2. The method of claim 1, wherein generating a second data packet of an executable type from the executable program file comprises:
Analyzing the detailed information of the executable program file;
encrypting the detailed information of the executable program file;
and determining a file packet comprising the encrypted executable program file as a second data packet.
3. The method as recited in claim 2, further comprising:
Pushing the first data packet to a first server of a first data center of the distributed storage system;
Synchronously pushing the first data packet to a first server of at least one second data center in communication connection through a first server of the first data center; each of the second data centers is located in a different geographic location and each of the second data centers is located in a different geographic location than the first data center.
4. The method as recited in claim 2, further comprising:
pushing the second data packet to a second server of a first data center of the distributed storage system;
Synchronously pushing the second data packet to a second server of at least one second data center in communication connection through a second server of the first data center; each of the second data centers is located in a different geographic location and each of the second data centers is located in a different geographic location than the first data center.
5. The method as recited in claim 4, further comprising:
And synchronously updating the received second data packets to a third server of the corresponding second data center through the second server of each second data center.
6. A service processing method, which is used for a user terminal, the method comprising:
Receiving a service request;
determining the service data type of the requested target service according to the service request; the service data types include description types and/or executable types;
Acquiring a first data packet of a description type and/or a second data packet of a variable type from a distributed storage system according to the service data type;
Analyzing the first data packet and/or the second data packet;
And executing the target service according to the parsed data packet information.
7. A service processing apparatus for use in a building device of a distributed storage system, the apparatus comprising:
The acquisition module is used for responding to a trigger event of the target service construction data and acquiring a program code file corresponding to the target service;
a first determining module, configured to determine, according to the program code file, a corresponding file directory structure and attribute information of each file therein;
the first processing module is used for constructing a first data packet of a description type according to the file directory structure and the attribute information;
A second determining module, configured to determine an executable program file included in the program code file;
And the second processing module is used for generating a second data packet of an executable type according to the executable program file.
8. A service processing apparatus for use at a user terminal, the apparatus comprising:
the receiving module is used for receiving the service request;
A determining module, configured to determine a service data type of a requested target service according to the service request; the service data types include description types and/or executable types;
the acquisition module is used for acquiring a first data packet of a description type and/or a second data packet of an executable type from the distributed storage system according to the service data type;
The processing module is used for analyzing the first data packet and/or the second data packet;
and the execution module is used for executing the target service according to the parsed data packet information.
9. An electronic device, the electronic device comprising:
a processor and a memory storing a computer program product;
The processor is configured to execute the computer program product and the computer program product is configured to implement the method of any of the preceding claims 1 to 5 or 6 when executed.
10. A computer readable storage medium, characterized in that it has stored thereon computer program instructions for implementing the method according to any of the preceding claims 1 to 5 or 6 when executed.
CN202410165241.5A 2023-12-28 2024-02-05 Service processing method, device, equipment and storage medium Pending CN117955991A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202311841240X 2023-12-28
CN202311841240 2023-12-28

Publications (1)

Publication Number Publication Date
CN117955991A true CN117955991A (en) 2024-04-30

Family

ID=90794318

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202410165241.5A Pending CN117955991A (en) 2023-12-28 2024-02-05 Service processing method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN117955991A (en)

Similar Documents

Publication Publication Date Title
CN107295080B (en) Data storage method applied to distributed server cluster and server
CN110825420B (en) Method, device, equipment and storage medium for updating configuration parameters of distributed cluster
US9753954B2 (en) Data node fencing in a distributed file system
JP5548829B2 (en) Computer system, data management method, and data management program
CN111190747A (en) Message loss detection method and device for message queue
CN112506702B (en) Disaster recovery method, device, equipment and storage medium for data center
CN111259072A (en) Data synchronization method and device, electronic equipment and computer readable storage medium
KR100728076B1 (en) Method, device and system for synchronizing of data providing for the handling of an interrupted synchronization process
CN113596187B (en) Domain name configuration management system
CN113190620A (en) Method, device, equipment and storage medium for synchronizing data between Redis clusters
CN117955991A (en) Service processing method, device, equipment and storage medium
CN111241200A (en) sSQLite database-based main and standby synchronous processing method and device
CN113032477B (en) Long-distance data synchronization method and device based on GTID and computing equipment
CN109167826B (en) Method, device and system for putting WEB application on shelf
CN109753292B (en) Method and device for deploying multiple applications in multiple single instance database service
CN112787868A (en) Information synchronization method and device
KR100671789B1 (en) Method for Synchronizing and Transmitting Data Between Distributed Spatial Data and System therefor
US7644306B2 (en) Method and system for synchronous operation of an application by a purality of processing units
TWI748653B (en) System and method for determining operation status of device by updating execution status
EP3895015A1 (en) Collecting repeated diagnostics data from across users participating in a document collaboration session
CN115297129B (en) Method and device for establishing data communication network
CN116302711B (en) Disaster recovery method and device based on cloud platform mirror image, electronic equipment and storage medium
CN111226204A (en) Method and device for synchronizing log data without reaction and with protected integrity
CN117156474B (en) Remote intelligent operation and maintenance system and operation and maintenance method thereof
CN116708176A (en) Message processing method, device, server and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination