CN116737772A - Data processing method, device, computer equipment and storage medium - Google Patents

Data processing method, device, computer equipment and storage medium Download PDF

Info

Publication number
CN116737772A
CN116737772A CN202310736505.3A CN202310736505A CN116737772A CN 116737772 A CN116737772 A CN 116737772A CN 202310736505 A CN202310736505 A CN 202310736505A CN 116737772 A CN116737772 A CN 116737772A
Authority
CN
China
Prior art keywords
processing system
data
main processing
backup
user interaction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310736505.3A
Other languages
Chinese (zh)
Inventor
马永福
刘雪峰
葛凯文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Youzhuju Network Technology Co Ltd
Original Assignee
Beijing Youzhuju Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Youzhuju Network Technology Co Ltd filed Critical Beijing Youzhuju Network Technology Co Ltd
Priority to CN202310736505.3A priority Critical patent/CN116737772A/en
Publication of CN116737772A publication Critical patent/CN116737772A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating

Abstract

The present disclosure provides a data processing method, apparatus, computer device, and storage medium, including: acquiring user interaction data to be processed; inputting the user interaction data to a first main processing system and a second backup processing system so as to process the user interaction data through the first main processing system and the second backup processing system at the same time, wherein a first logic code of the first main processing system comprises a second logic code of the second backup processing system; and after receiving the data query request, under the condition that the first main processing system is detected to be faulty, acquiring target data corresponding to the data query request from the second backup processing system.

Description

Data processing method, device, computer equipment and storage medium
Technical Field
The disclosure relates to the technical field of computers, and in particular relates to a data processing method, a data processing device, computer equipment and a storage medium.
Background
With the increasing of data volume, in the field of data query, in order to promote high availability of data query, a set of main data system and a set of backup data system are generally deployed, and when the main data system fails, the backup data system is started to perform data processing and query. However, in this method, it may take more time to start the backup data processing system, so that the data query cannot be performed in time.
Disclosure of Invention
The embodiment of the disclosure at least provides a data processing method, a data processing device, computer equipment and a storage medium.
In a first aspect, an embodiment of the present disclosure provides a data processing method, including:
acquiring user interaction data to be processed;
inputting the user interaction data to a first main processing system and a second backup processing system so as to process the user interaction data through the first main processing system and the second backup processing system at the same time, wherein a first logic code of the first main processing system comprises a second logic code of the second backup processing system;
and after receiving the data query request, under the condition that the first main processing system is detected to be faulty, acquiring target data corresponding to the data query request from the second backup processing system.
In one possible implementation, the detecting that the first main processing system fails includes:
the method comprises the steps that data cannot be acquired from a first main processing system, or the time length for acquiring the data from the first main processing system exceeds a preset time length, or an error reporting instruction for the data acquired from the first main processing system is received.
In a possible embodiment, the method further comprises:
after the logic code of the first main processing system is detected to be updated, under the condition that a preset updating condition is met, updating the logic code in the second backup processing system based on the updated logic code of the first main processing system.
In a possible implementation manner, the preset updating condition includes:
and the updated logic code running time of the first main processing system exceeds the preset time, and the first main processing system is not detected to have faults.
In a possible implementation manner, the first main processing system and the second backup processing system process the user interaction data by the following method:
processing the user interaction data according to a data processing method corresponding to each data index to obtain initial data;
and respectively polymerizing the initial data according to each preset aggregation granularity to obtain aggregation data under each preset aggregation granularity.
In a possible implementation manner, the preset aggregate granularity of the second backup processing system includes at least one first aggregate granularity, the preset aggregate granularity of the first main processing system includes the at least one first aggregate granularity and at least one second aggregate granularity, and the importance of the first aggregate granularity is higher than that of the second aggregate granularity.
In a possible implementation manner, the obtaining, from the second backup processing system, the target data corresponding to the data query request when the first main processing system is detected to be faulty includes:
and under the condition that the first main processing system is detected to be faulty and the query field of the data query request is the field under the first aggregation granularity, acquiring target data corresponding to the data query request from the second backup processing system.
In a second aspect, an embodiment of the present disclosure further provides a data processing apparatus, including:
the acquisition module is used for acquiring user interaction data to be processed;
the input module is used for inputting the user interaction data to a first main processing system and a second backup processing system so as to process the user interaction data through the first main processing system and the second backup processing system at the same time, wherein a first logic code of the first main processing system comprises a second logic code of the second backup processing system;
and the query module is used for acquiring target data corresponding to the data query request from the second backup processing system under the condition that the first main processing system is detected to have faults after the data query request is received.
In a third aspect, embodiments of the present disclosure further provide a computer device, comprising: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory in communication via the bus when the computer device is running, the machine-readable instructions when executed by the processor performing the steps of the first aspect, or any of the possible implementations of the first aspect.
In a fourth aspect, the presently disclosed embodiments also provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the first aspect, or any of the possible implementations of the first aspect.
In the data processing method, the device, the computer equipment and the storage medium provided by the embodiment of the disclosure, after the user interaction data to be processed is acquired, the first main processing system and the second backup processing system operate simultaneously, and process the received user interaction data, so that after a data query request is received, under the condition that the first main processing system is detected to have a fault, the second backup processing system also operates synchronously and processes the user interaction data synchronously, and therefore the second backup processing system can respond to the data query request quickly, the problem of data delay in the process of data query is solved, and the usability of the processing system is improved.
The foregoing objects, features and advantages of the disclosure will be more readily apparent from the following detailed description of the preferred embodiments taken in conjunction with the accompanying drawings.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for the embodiments are briefly described below, which are incorporated in and constitute a part of the specification, these drawings showing embodiments consistent with the present disclosure and together with the description serve to illustrate the technical solutions of the present disclosure. It is to be understood that the following drawings illustrate only certain embodiments of the present disclosure and are therefore not to be considered limiting of its scope, for the person of ordinary skill in the art may admit to other equally relevant drawings without inventive effort.
FIG. 1 illustrates a flow chart of a data processing method provided by an embodiment of the present disclosure;
FIG. 2 illustrates an overall flow chart of a data processing method provided by an embodiment of the present disclosure;
FIG. 3 illustrates a schematic architecture of a data processing apparatus provided by an embodiment of the present disclosure;
fig. 4 shows a schematic structural diagram of a computer device according to an embodiment of the disclosure.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present disclosure more apparent, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are only some embodiments of the present disclosure, but not all embodiments. The components of the embodiments of the present disclosure, which are generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure provided in the accompanying drawings is not intended to limit the scope of the disclosure, as claimed, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be made by those skilled in the art based on the embodiments of this disclosure without making any inventive effort, are intended to be within the scope of this disclosure.
According to research, in the related art, after the system is backed up, the backup data system is started when the main data system fails, on one hand, the backup data system needs to take a certain time to start, and on the other hand, the data processing needs to be performed after the backup data system is started to acquire the data query result, and the data processing process needs to take a certain time, so that the data delay is longer under the condition that the main data system fails.
Based on the above study, the present disclosure provides a data processing method, apparatus, computer device and storage medium, where after user interaction data to be processed is obtained, a first main processing system and a second backup processing system operate simultaneously, and process received user interaction data at the same time, so that after a data query request is received, under the condition that a failure of the first main processing system is detected, the second backup processing system also operates synchronously and processes the user interaction data synchronously, so that the second backup processing system can quickly respond to the data query request, thereby solving the problem of data delay during data query, and improving the usability of the processing system.
It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures.
The term "and/or" is used herein to describe only one relationship, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist together, and B exists alone. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality, for example, including at least one of A, B, C, and may mean including any one or more elements selected from the group consisting of A, B and C.
It will be appreciated that prior to using the technical solutions disclosed in the embodiments of the present disclosure, the user should be informed and authorized of the type, usage range, usage scenario, etc. of the personal information related to the present disclosure in an appropriate manner according to the relevant legal regulations.
For example, in response to receiving an active request from a user, a prompt is sent to the user to explicitly prompt the user that the operation it is requesting to perform will require personal information to be obtained and used with the user. Thus, the user can autonomously select whether to provide personal information to software or hardware such as an electronic device, an application program, a server or a storage medium for executing the operation of the technical scheme of the present disclosure according to the prompt information.
As an alternative but non-limiting implementation, in response to receiving an active request from a user, the manner in which the prompt information is sent to the user may be, for example, a popup, in which the prompt information may be presented in a text manner. In addition, a selection control for the user to select to provide personal information to the electronic device in a 'consent' or 'disagreement' manner can be carried in the popup window.
It will be appreciated that the above-described notification and user authorization process is merely illustrative and not limiting of the implementations of the present disclosure, and that other ways of satisfying relevant legal regulations may be applied to the implementations of the present disclosure.
For the sake of understanding the present embodiment, first, a detailed description will be given of a data processing method disclosed in an embodiment of the present disclosure, and an execution body of the data processing method provided in the embodiment of the present disclosure is generally a server.
Referring to fig. 1, a flowchart of a data processing method according to an embodiment of the present disclosure is shown, where the method includes steps 101 to 103, where:
step 101, obtaining user interaction data to be processed.
Step 102, inputting the user interaction data to a first main processing system and a second backup processing system, so as to process the user interaction data through the first main processing system and the second backup processing system at the same time, wherein a first logic code of the first main processing system comprises a second logic code of the second backup processing system.
Step 103, after receiving the data query request, acquiring target data corresponding to the data query request from the second backup processing system under the condition that the first main processing system is detected to be faulty.
The following is a detailed description of the above steps.
Aiming at step 101,
The user interaction data to be processed may be interaction data generated by a certain application program or a plurality of online users of a certain platform, may be interaction data generated in a specific time interval, and may be interaction data in a preset time range before the current time.
The user interaction data may refer to specific interaction data for performing data analysis, and may be, for example, viewing data, click data, download data, etc. of the user. The user interaction data acquired by different data processing systems can be different, and the specific user interaction data can be set according to actual conditions.
Aiming at step 102,
In a possible implementation manner, the first main processing system and the second backup processing system may be processing systems deployed on different devices, for example, the first main processing system may be deployed in a machine room a, the second backup processing system may be deployed in a machine room B, and the first main processing system and the second backup processing system do not affect each other and do not interfere with each other when performing data processing.
The logic code may refer to code that needs to be executed by the processing system when performing data processing, where the first logic code of the first main processing system includes the second logic code of the second backup processing system. Alternatively, the first main logic code of the first main processing system may be identical to the second logic code of the second backup processing system; alternatively, the second logical code of the second backup processing system may be a portion of code in the first logical code of the first primary processing system.
In an alternative embodiment, in the case that the second logic code of the second backup processing system is part of the first logic code of the first main processing system, the second logic code may be automatically synchronized from the first logic code, and specifically, which codes in the first logic code are synchronized as the second logic code to the second backup processing system may be related to a specific processing task.
Specifically, after the user interaction data to be processed is input to the first main processing system and the second backup processing system respectively, the first main processing system and the second backup processing system may process the user interaction data according to the following method:
and a1, processing the user interaction data according to a data processing method corresponding to each data index to obtain initial data.
And a2, respectively aggregating the initial data according to each preset aggregation dimension to obtain aggregation data under each preset aggregation dimension.
The data index may refer to a metric for measuring performance of a business or product, and may include, for example, the number of clicks, the number of times of completion, the number of shares, etc. The data processing methods corresponding to different data indexes can be different.
For example, for the data index "play times", the corresponding data processing method may be: a play time exceeding 3 seconds is regarded as one play. Therefore, for the data index of the playing times, when the user interaction data is preprocessed, the playing time length of each piece of user interaction data can be determined, and under the condition that the playing time length exceeds 3 seconds, the playing times of the piece of user interaction data can be marked as 1, otherwise, the playing times of the piece of user interaction data can be marked as 0.
In a possible implementation manner, in order to improve the stability of the processing system, in the first main processing system, the processing procedure of each data index (that is, the procedure of processing the user interaction data according to the corresponding data processing method) may be performed through a plurality of task queues.
Illustratively, the plurality of task queues may include a queue 1 and a queue 2, where the queue 1 may be used to process data indexes having an importance level higher than a first preset value, and the queue 2 may be used to process data indexes having an importance level less than or equal to the first preset value. The importance of each data index may be preset.
In a possible implementation manner, each preset aggregation granularity may include a plurality of high-frequency query fields, and the aggregation of the initial data according to each preset aggregation granularity may refer to the aggregation of the initial data according to the high-frequency query fields under each preset aggregation granularity.
The query field includes a query dimension and a query index, where the query index may be a certain data index, and the query dimension may be a dimension for defining the query field, for example, may include attribute information of a user corresponding to data to be filtered, or may include attribute information (such as data generation time and the like) of the data to be filtered.
The attribute information of the user may be obtained after legal authorization of the user, for example, the user may register during registration.
In a possible implementation manner, the preset aggregate granularity of the second backup processing system includes at least one first aggregate granularity, the preset aggregate granularity of the first main processing system includes the at least one first aggregate granularity and at least one second aggregate granularity, and the importance of the first aggregate granularity is higher than that of the second aggregate granularity.
Here, the importance of each aggregation granularity may be preset, or the importance of each aggregation granularity may be set based on the search frequency of the user, where the importance of the aggregation granularity where the field with a high search frequency is located is higher, and the importance of the aggregation granularity where the field with a lower search frequency is located is lower.
Correspondingly, in contrast to the above-mentioned logical code synchronization, when the first logical code is synchronized to the second backup processing system, the logical code corresponding to the second aggregate granularity may be used as the second logical code and synchronized to the second backup processing system.
In practical applications, the importance of each aggregation granularity may change along with the search frequency of the user, so that the logic code of the second backup processing system may not be unchanged, that is, the second logic code of the second backup processing system may also change along with the change of the search frequency of the fields of each aggregation granularity. For example, the logic code corresponding to the aggregation granularity of the first N bits of importance may be synchronized to the second backup processing system as the second logic code, and if the aggregation granularity of the first N bits of importance changes along with the search frequency of the user, the logic code of the second backup system may be updated correspondingly based on the updated logic code of the aggregation granularity of the first N bits.
In another possible implementation manner, in order to improve the aggregation efficiency of each aggregation granularity, after the user interaction data is processed according to the data processing method corresponding to each data index to obtain initial data, the initial data may be pre-aggregated according to the minimum preset aggregation granularity, and then re-aggregated according to each preset aggregation granularity on the basis of the pre-aggregated initial data to obtain the aggregation data under each preset aggregation granularity.
Wherein the minimum preset aggregate granularity may be any granularity smaller than the preset aggregate granularity by way of example.
It should be noted that, since the first main processing system and the second backup processing system are disposed at different locations, the parameter configuration files of the first main processing system and the second backup processing system are different.
In one possible scenario, the functionality of the processing system may be updated, but the updated functionality may conflict with other components of the processing system after deployment to the processing system, or the logic code of the new functionality itself may have problems, thus causing a failure of the processing system after deployment of the logic code of the updated functionality to the processing system. If the updated logic codes are deployed to both the first main processing system and the second backup processing system, the first main processing system and the second backup processing system may fail at the same time, so that the data query cannot be performed.
Because the logic code of the second backup processing system is automatically synchronized from the first logic code of the first main processing system, the present disclosure provides an alternative embodiment, after detecting that the logic code of the first main processing system is updated, in the case that a preset update condition is met, updating the logic code in the second backup processing system based on the updated logic code of the first main processing system.
Here, the preset update condition may include that the updated logic code running time of the first main processing system exceeds a preset time, and that the first main processing system is not detected to be failed.
The purpose of setting the update condition is to ensure that the updated logic code can normally run after the first main processing system runs for a period of time, so that the probability of failure of the second backup processing system can be reduced when the updated logic code is updated to the second backup processing system in this case, and high availability of the processing system is further ensured.
Aiming at step 103,
In a possible implementation manner, the detecting that the first main processing system fails may include: the method comprises the steps that data cannot be acquired from a first main processing system, or the time length for acquiring the data from the first main processing system exceeds a preset time length, or an error reporting instruction for the data acquired from the first main processing system is received.
Here, the failure to acquire data from the first main processing system may mean that the data acquired from the first main processing system is empty; the time period for acquiring the data from the first main processing system exceeding the preset time period may refer to that the time interval between the time of sending the data acquisition request to the first main processing system and the time of receiving the data returned by the first main processing system exceeds the preset time period.
The receiving of the data error reporting instruction may refer to receiving an error reporting instruction fed back by the user side. In practical applications, the error reporting instruction of the single user may be inaccurate, so the receiving the error reporting instruction for the data acquired from the first main processing system may refer to receiving more than K error reporting instructions for the data acquired from the first main processing system in a preset time period, where K is a preset positive integer.
By the method, when the operation condition of the first main processing system is monitored, the feedback condition of the user side is combined, the processing logic of the first main processing system is prevented from being failed, the switching to the second backup processing system is facilitated when the first main processing system fails, and the reliability of data is improved.
Continuing step 102, when the preset aggregate granularity of the first main processing system includes at least one first aggregate granularity sum included in the second backup processing system and at least one second aggregate granularity not included in the second backup processing system, and when the first main processing system fails, the purpose of switching to the second backup processing system is to acquire data from the second backup processing system, and if the second backup processing system does not itself include the data included in the data query request, the data cannot be acquired at the moment even if the system switching is performed.
Therefore, when the first main processing system is detected to be faulty, when the target data corresponding to the data query request is acquired from the second backup processing system, the target data corresponding to the data query request may be acquired from the second backup processing system when the first main processing system is detected to be faulty and the query field of the data query request is the field under the first aggregation granularity.
If the query field of the data query request is not the field under the first aggregation granularity, the indication information for indicating the system fault can be directly fed back to prompt the user to query later. For example, an indication of "system failure, please query later" may be sent to the user.
Optionally, the query priorities of the first main processing system and the second backup processing system may be preset, where the query priority of the first main processing system is higher than that of the second backup processing system in the case that the first main processing system does not fail, and after any data query request is received, a data query may be performed from the first main processing system with a higher query priority. And under the condition that the first main processing system is detected to be faulty, the query priority of the first main processing system can be adjusted, the query priority of the first main processing system is lower than that of the second backup processing system, and after any data query request is received, the data query can be directly carried out from the second backup processing system with higher query priority.
In a possible implementation manner, in case that the first main processing system is detected to be faulty, fault information may be sent to the target user side, so as to prompt that maintenance is performed on the first main processing system as soon as possible. The target client may refer to an operation and maintenance client, for example.
The overall flow of the data processing method is described below with reference to specific flowcharts. Referring to fig. 2, an overall flowchart of a data processing method according to an embodiment of the disclosure includes:
After the user interaction data is acquired, the user interaction data is respectively input to the first main processing system and the second backup processing system.
The first main processing system and the second backup processing system can process the user interaction data according to the data processing method corresponding to each data index (namely, the data index processing in the figure) to obtain initial data, and then pre-aggregate the initial data according to the minimum aggregation granularity and then input the pre-aggregate initial data into each aggregation module.
Each aggregation module is used for executing a corresponding aggregation task, and the first main processing system comprises a granularity 1 aggregation task, a granularity 2 aggregation task, a granularity 3 aggregation task and a granularity 4 aggregation task; the second backup processing system comprises a granularity 1 aggregation task, a granularity 2 aggregation task and a granularity 3 aggregation task, and each aggregation task can be provided with an independent storage module for data storage after aggregation is completed.
The multiple query platforms (i.e. platform 1, platform 2, platform 3, and platform 4 in the figure) can query the data from the storage module through the unified query service, and can judge whether to acquire the data from the first main processing system or the second backup processing system through the judging module.
The detailed description of the above steps is described with reference to fig. 1, and will not be repeated here.
It should be noted that the processing system may be a system with high real-time requirement, for example, an advertisement data processing system, and the user needs to adjust the advertisement delivery plan according to the real-time data, so that the second backup processing system needs to operate synchronously with the first main processing system to ensure high availability of the processing system and low latency. For systems with higher real-time requirements for other applications, the above method is also applicable, and the disclosure is not limited.
In the data processing method provided by the disclosure, after the user interaction data to be processed is obtained, the first main processing system and the second backup processing system operate simultaneously, and process the received user interaction data at the same time, so that under the condition that the first main processing system is detected to have a fault after a data query request is received, the second backup processing system also operates synchronously and processes the user interaction data synchronously, and therefore the second backup processing system can respond to the data query request rapidly, the problem of data delay in the process of data query is solved, and the usability of the processing system is improved.
It will be appreciated by those skilled in the art that in the above-described method of the specific embodiments, the written order of steps is not meant to imply a strict order of execution but rather should be construed according to the function and possibly inherent logic of the steps.
Based on the same inventive concept, the embodiments of the present disclosure further provide a data processing device corresponding to the data processing method, and since the principle of solving the problem by the device in the embodiments of the present disclosure is similar to that of the data processing method in the embodiments of the present disclosure, the implementation of the device may refer to the implementation of the method, and the repetition is omitted.
Referring to fig. 3, a schematic architecture diagram of a data processing apparatus according to an embodiment of the disclosure is provided, where the apparatus includes: an acquisition module 301, an input module 302, and a query module 303; wherein, the liquid crystal display device comprises a liquid crystal display device,
an acquiring module 301, configured to acquire user interaction data to be processed;
an input module 302, configured to input the user interaction data to a first main processing system and a second backup processing system, so as to process the user interaction data through the first main processing system and the second backup processing system at the same time, where a first logic code of the first main processing system includes a second logic code of the second backup processing system;
And the query module 303 is configured to obtain, after receiving the data query request, target data corresponding to the data query request from the second backup processing system if it is detected that the first main processing system fails.
In one possible implementation, the detecting that the first main processing system fails includes:
the method comprises the steps that data cannot be acquired from a first main processing system, or the time length for acquiring the data from the first main processing system exceeds a preset time length, or an error reporting instruction for the data acquired from the first main processing system is received.
In a possible implementation manner, the apparatus further includes an updating module 304, configured to:
after the logic code of the first main processing system is detected to be updated, under the condition that a preset updating condition is met, updating the logic code in the second backup processing system based on the updated logic code of the first main processing system.
In a possible implementation manner, the preset updating condition includes:
and the updated logic code running time of the first main processing system exceeds the preset time, and the first main processing system is not detected to have faults.
In a possible implementation manner, the first main processing system and the second backup processing system process the user interaction data by the following method:
processing the user interaction data according to a data processing method corresponding to each data index to obtain initial data;
and respectively polymerizing the initial data according to each preset aggregation granularity to obtain aggregation data under each preset aggregation granularity.
In a possible implementation manner, the preset aggregate granularity of the second backup processing system includes at least one first aggregate granularity, the preset aggregate granularity of the first main processing system includes the at least one first aggregate granularity and at least one second aggregate granularity, and the importance of the first aggregate granularity is higher than that of the second aggregate granularity.
In a possible implementation manner, in the case that the first main processing system is detected to be faulty, the query module 303 is configured to, when acquiring, from the second backup processing system, target data corresponding to the data query request:
and under the condition that the first main processing system is detected to be faulty and the query field of the data query request is the field under the first aggregation granularity, acquiring target data corresponding to the data query request from the second backup processing system.
The process flow of each module in the apparatus and the interaction flow between the modules may be described with reference to the related descriptions in the above method embodiments, which are not described in detail herein.
Based on the same technical concept, the embodiment of the disclosure also provides computer equipment. Referring to fig. 4, a schematic structural diagram of a computer device 400 according to an embodiment of the disclosure includes a processor 401, a memory 402, and a bus 403. The memory 402 is configured to store execution instructions, including a memory 4021 and an external memory 4022; the memory 4021 is also referred to as an internal memory, and is used for temporarily storing operation data in the processor 401 and data exchanged with the external memory 4022 such as a hard disk, the processor 401 exchanges data with the external memory 4022 through the memory 4021, and when the computer device 400 operates, the processor 401 and the memory 402 communicate with each other through the bus 403, so that the processor 401 executes the following instructions:
acquiring user interaction data to be processed;
inputting the user interaction data to a first main processing system and a second backup processing system so as to process the user interaction data through the first main processing system and the second backup processing system at the same time, wherein a first logic code of the first main processing system comprises a second logic code of the second backup processing system;
And after receiving the data query request, under the condition that the first main processing system is detected to be faulty, acquiring target data corresponding to the data query request from the second backup processing system.
In a possible implementation manner, in an instruction executed by the processor 401, the detecting that the first main processing system fails includes:
the method comprises the steps that data cannot be acquired from a first main processing system, or the time length for acquiring the data from the first main processing system exceeds a preset time length, or an error reporting instruction for the data acquired from the first main processing system is received.
In a possible implementation manner, in an instruction executed by the processor 401, the method further includes:
after the logic code of the first main processing system is detected to be updated, under the condition that a preset updating condition is met, updating the logic code in the second backup processing system based on the updated logic code of the first main processing system.
In a possible implementation manner, in the instruction executed by the processor 401, the preset update condition includes:
and the updated logic code running time of the first main processing system exceeds the preset time, and the first main processing system is not detected to have faults.
In a possible implementation manner, in the instructions executed by the processor 401, the first main processing system and the second backup processing system process the user interaction data by:
processing the user interaction data according to a data processing method corresponding to each data index to obtain initial data;
and respectively polymerizing the initial data according to each preset aggregation granularity to obtain aggregation data under each preset aggregation granularity.
In a possible implementation manner, in the instructions executed by the processor 401, the preset aggregate granularity of the second backup processing system includes at least one first aggregate granularity, and the preset aggregate granularity of the first main processing system includes the at least one first aggregate granularity and at least one second aggregate granularity, where the importance of the first aggregate granularity is higher than the second aggregate granularity.
In a possible implementation manner, in an instruction executed by the processor 401, in a case where the first main processing system is detected to fail, the obtaining, from the second backup processing system, target data corresponding to the data query request includes:
and under the condition that the first main processing system is detected to be faulty and the query field of the data query request is the field under the first aggregation granularity, acquiring target data corresponding to the data query request from the second backup processing system.
The disclosed embodiments also provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the data processing method described in the method embodiments above. Wherein the storage medium may be a volatile or nonvolatile computer readable storage medium.
Embodiments of the present disclosure further provide a computer program product, where the computer program product carries program code, where instructions included in the program code may be used to perform steps of a data processing method described in the foregoing method embodiments, and specifically reference may be made to the foregoing method embodiments, which are not described herein.
Wherein the above-mentioned computer program product may be realized in particular by means of hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied as a computer storage medium, and in another alternative embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK), or the like.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described system and apparatus may refer to corresponding procedures in the foregoing method embodiments, which are not described herein again. In the several embodiments provided in the present disclosure, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. The above-described apparatus embodiments are merely illustrative, for example, the division of the units is merely a logical function division, and there may be other manners of division in actual implementation, and for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some communication interface, device or unit indirect coupling or communication connection, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present disclosure may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer readable storage medium executable by a processor. Based on such understanding, the technical solution of the present disclosure may be embodied in essence or a part contributing to the prior art or a part of the technical solution, or in the form of a software product stored in a storage medium, including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiments of the present disclosure. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Finally, it should be noted that: the foregoing examples are merely specific embodiments of the present disclosure, and are not intended to limit the scope of the disclosure, but the present disclosure is not limited thereto, and those skilled in the art will appreciate that while the foregoing examples are described in detail, it is not limited to the disclosure: any person skilled in the art, within the technical scope of the disclosure of the present disclosure, may modify or easily conceive changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features thereof; such modifications, changes or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the disclosure, and are intended to be included within the scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.

Claims (10)

1. A method of data processing, comprising:
acquiring user interaction data to be processed;
inputting the user interaction data to a first main processing system and a second backup processing system so as to process the user interaction data through the first main processing system and the second backup processing system at the same time, wherein a first logic code of the first main processing system comprises a second logic code of the second backup processing system;
And after receiving the data query request, under the condition that the first main processing system is detected to be faulty, acquiring target data corresponding to the data query request from the second backup processing system.
2. The method of claim 1, wherein the detecting that the first primary processing system has failed comprises:
the method comprises the steps that data cannot be acquired from a first main processing system, or the time length for acquiring the data from the first main processing system exceeds a preset time length, or an error reporting instruction for the data acquired from the first main processing system is received.
3. The method according to claim 1, wherein the method further comprises:
after the logic code of the first main processing system is detected to be updated, under the condition that a preset updating condition is met, updating the logic code in the second backup processing system based on the updated logic code of the first main processing system.
4. A method according to claim 3, wherein the preset update condition comprises:
and the updated logic code running time of the first main processing system exceeds the preset time, and the first main processing system is not detected to have faults.
5. The method of claim 1, wherein the first primary processing system and the second backup processing system process the user interaction data by:
processing the user interaction data according to a data processing method corresponding to each data index to obtain initial data;
and respectively polymerizing the initial data according to each preset aggregation granularity to obtain aggregation data under each preset aggregation granularity.
6. The method of claim 5, wherein the predetermined aggregate granularity of the second backup processing system comprises at least one first aggregate granularity, the predetermined aggregate granularity of the first primary processing system comprises the at least one first aggregate granularity and at least one second aggregate granularity, and the first aggregate granularity is higher in importance than the second aggregate granularity.
7. The method of claim 6, wherein the obtaining, from the second backup processing system, target data corresponding to the data query request in the event that a failure of the first primary processing system is detected, comprises:
and under the condition that the first main processing system is detected to be faulty and the query field of the data query request is the field under the first aggregation granularity, acquiring target data corresponding to the data query request from the second backup processing system.
8. A data processing apparatus, comprising:
the acquisition module is used for acquiring user interaction data to be processed;
the input module is used for inputting the user interaction data to a first main processing system and a second backup processing system so as to process the user interaction data through the first main processing system and the second backup processing system at the same time, wherein a first logic code of the first main processing system comprises a second logic code of the second backup processing system;
and the query module is used for acquiring target data corresponding to the data query request from the second backup processing system under the condition that the first main processing system is detected to have faults after the data query request is received.
9. A computer device, comprising: a processor, a memory and a bus, said memory storing machine readable instructions executable by said processor, said processor and said memory communicating over the bus when the computer device is running, said machine readable instructions when executed by said processor performing the steps of the data processing method according to any of claims 1 to 7.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when run by a processor, performs the steps of the data processing method according to any of claims 1 to 7.
CN202310736505.3A 2023-06-20 2023-06-20 Data processing method, device, computer equipment and storage medium Pending CN116737772A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310736505.3A CN116737772A (en) 2023-06-20 2023-06-20 Data processing method, device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310736505.3A CN116737772A (en) 2023-06-20 2023-06-20 Data processing method, device, computer equipment and storage medium

Publications (1)

Publication Number Publication Date
CN116737772A true CN116737772A (en) 2023-09-12

Family

ID=87900830

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310736505.3A Pending CN116737772A (en) 2023-06-20 2023-06-20 Data processing method, device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116737772A (en)

Similar Documents

Publication Publication Date Title
US11269718B1 (en) Root cause detection and corrective action diagnosis system
CN107015991B (en) Self-checking method, device and system for data consistency and service device
CN110362455B (en) Data processing method and data processing device
US9355005B2 (en) Detection apparatus and detection method
CN112367345B (en) Data processing method, server device and computer readable storage medium
US10437695B2 (en) Fault information providing server and fault information providing method for users of in-vehicle terminals
US11567756B2 (en) Causality determination of upgrade regressions via comparisons of telemetry data
CN113220540B (en) Service management method, device, computer equipment and storage medium
US10019309B2 (en) Analytics-based dynamic adaptation of client-server mobile applications
US8719622B2 (en) Recording and preventing crash in an appliance
US8370800B2 (en) Determining application distribution based on application state tracking information
US10318911B1 (en) Persistenceless business process management system and method
CN112598529B (en) Data processing method and device, computer readable storage medium and electronic equipment
US11886296B2 (en) Inhibiting recommendation of driver installations for drivers that are likely to cause a system failure
CN110865907A (en) Method and system for providing service redundancy between master server and slave server
US10237161B2 (en) System and method for dynamically testing networked target systems
US11386153B1 (en) Flexible tagging and searching system
US11086738B2 (en) System and method to automate solution level contextual support
CN116737772A (en) Data processing method, device, computer equipment and storage medium
CN112005221A (en) Automatic remediation via communication with peer devices across multiple networks
CN111131198B (en) Updating method and device for network security policy configuration
CN112099879A (en) Configuration information management method and device, computer equipment and storage medium
CN111475400A (en) Verification method of service platform and related equipment
CN113300901B (en) Data stream monitoring method and device, electronic equipment and storage medium
CN114546705B (en) Operation response method, operation response device, electronic apparatus, and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination