CN117421140A - Data processing method, device, equipment and medium - Google Patents

Data processing method, device, equipment and medium Download PDF

Info

Publication number
CN117421140A
CN117421140A CN202311449454.2A CN202311449454A CN117421140A CN 117421140 A CN117421140 A CN 117421140A CN 202311449454 A CN202311449454 A CN 202311449454A CN 117421140 A CN117421140 A CN 117421140A
Authority
CN
China
Prior art keywords
data
receiving
target
information
release
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311449454.2A
Other languages
Chinese (zh)
Inventor
宋建东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Desai Xiwei Automobile Electronics Co ltd
Original Assignee
Nanjing Desai Xiwei Automobile Electronics Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Desai Xiwei Automobile Electronics Co ltd filed Critical Nanjing Desai Xiwei Automobile Electronics Co ltd
Priority to CN202311449454.2A priority Critical patent/CN117421140A/en
Publication of CN117421140A publication Critical patent/CN117421140A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/544Buffers; Shared memory; Pipes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2228Indexing structures
    • G06F16/2272Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • G06F16/2379Updates performed during online database operations; commit processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/542Event management; Broadcasting; Multicasting; Notifications

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a data processing method, a device, equipment and a medium. The method is applied to a data center system, and the data center system is connected with a release object and a receiving object, and comprises the following steps: when receiving data to be distributed, which is sent by a distribution object, determining a target receiving object, and acquiring receiving frequency information of the target receiving object; performing data conflict detection on the release index information in the shared memory according to the receiving index information of all the receiving objects in the shared memory to obtain a conflict detection result; and processing the data to be distributed into target distribution data matched with the target receiving object according to the conflict detection result and the receiving frequency information. And processing the received data to be issued according to the receiving frequency information of the target receiving object to obtain target issued data. The data interaction between different modules can be realized without additionally adapting the data interfaces of other modules. The safety and stability of data interaction are guaranteed.

Description

Data processing method, device, equipment and medium
Technical Field
The present invention relates to the field of data management technologies, and in particular, to a data processing method, apparatus, device, and medium.
Background
The intelligent automobile has become a new development trend. The intelligent vehicle is a comprehensive system integrating the functions of environment sensing, planning decision, multi-level auxiliary driving and the like, and the intelligent vehicle is a typical high-tech complex by intensively applying the technologies of computers, modern sensing, information fusion, communication, artificial intelligence, automatic control and the like.
The schemes such as the scheme of the current scheme of the integrated berthing, the intelligent driving scheme and the cabin berthing all involve a large number of modules, but the requirements of data interaction and data management of a plurality of modules exist, and in order to achieve the flexibility of the scheme, each sub-module is required to have relatively high independence and low coupling.
However, each module in these schemes needs to be additionally configured with a data interface adapted to other modules, and there are security problems that the data is inconvenient for backtracking in later periods and interaction between modules.
Disclosure of Invention
The invention provides a data processing method, a device, equipment and a medium, which are used for realizing cross-module data processing and interaction.
According to a first aspect of the present invention, there is provided a data processing method applied to a data center system, the data center system including a shared memory, the data center system being connected to a distribution object and a reception object, the method comprising:
when receiving data to be distributed, which is sent by a distribution object, determining a target receiving object, and acquiring receiving frequency information of the target receiving object;
performing data conflict detection on the release index information in the shared memory according to the receiving index information of all the receiving objects in the shared memory to obtain a conflict detection result;
and processing the data to be issued into target issued data matched with the target receiving object according to the conflict detection result and the receiving frequency information.
According to another aspect of the present invention, there is provided a data processing apparatus comprising:
the information acquisition module is used for determining a target receiving object when receiving data to be distributed, which is sent by a distributing object, and acquiring receiving frequency information of the target receiving object;
the result determining module is used for carrying out data conflict detection on the release index information in the shared memory according to the receiving index information of all the receiving objects in the shared memory to obtain a conflict detection result;
and the data processing module is used for processing the data to be issued into target issued data matched with the target receiving object according to the conflict detection result and the receiving frequency information.
According to a third aspect of the present invention, there is provided an electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the data processing method according to any one of the embodiments of the present invention.
According to a fourth aspect of the present invention, there is provided a computer readable storage medium storing computer instructions for causing a processor to execute a data processing method according to any one of the embodiments of the present invention.
The technical scheme of the embodiment of the invention is applied to a data center system which comprises a shared memory, wherein the data center system is connected with a release object and a receiving object, and the method comprises the following steps: when receiving data to be distributed, which is sent by a distribution object, determining a target receiving object, and acquiring receiving frequency information of the target receiving object; performing data conflict detection on the release index information in the shared memory according to the receiving index information of all the receiving objects in the shared memory to obtain a conflict detection result; and processing the data to be distributed into target distribution data matched with the target receiving object according to the conflict detection result and the receiving frequency information. And processing the received data to be issued according to the receiving frequency information of the target receiving object to obtain target issued data. The data interaction between different modules can be realized without additionally adapting the data interfaces of other modules. The safety and stability of data interaction are guaranteed.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a data processing method according to a first embodiment of the present invention;
FIG. 2 is a diagram showing an example of interactions in a data processing method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a data processing apparatus according to a second embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device implementing an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
Fig. 1 is a flowchart of a data processing method according to an embodiment of the present invention, where the embodiment is applicable to a data interaction situation between multiple modules, and is applied to a data center system, where the data center system includes a shared memory, and the data center system is connected to a release object and a receiving object, where the method may be performed by a data processing apparatus, where the data processing apparatus may be implemented in a form of hardware and/or software, and where the data processing apparatus may be configured in an electronic device. As shown in fig. 1, the method includes:
s110, when the data to be distributed sent by the distribution object is received, determining a target receiving object, and acquiring receiving frequency information of the target receiving object.
In this embodiment, a publishing object may be understood as an object for publishing data, such as a module or an application that publishes data. Data to be distributed may be understood as data that needs to be sent to other objects. A target receiving object may be understood as an object that receives data to be distributed. The reception frequency information can be understood as the frequency at which the reception object receives data.
Specifically, when the processor receives the data to be distributed sent by the distribution object, the processor may determine the target receiving object corresponding to the data to be distributed according to a preset list or the like, for example, the list may include an association relationship between the ID of the distribution object and the ID of the receiving object, and obtain the receiving frequency information of the target receiving object from the preset list, or may be the receiving frequency information obtained by monitoring the receiving frequency of the target receiving object.
When receiving data to be published of a published object for the first time, firstly searching from a preset list, and refusing to publish if the published object has permission to publish the data of the type or not according with the condition. And if the condition is met, determining a target receiving object, and acquiring receiving frequency information of the target receiving object.
S120, carrying out data conflict detection on the release index information in the shared memory according to the receiving index information of all the receiving objects in the shared memory, and obtaining a conflict detection result.
In this embodiment, the shared memory may be understood as a memory space for storing data to be distributed, where both the distributing object and the receiving object may access, and the shared memory includes information of the distributing object: the current publishing object ID, the index of publishing object publishing, and the information of receiving object: the ID of the received object and the index of each received object (removing the pseudo-cache) open up a space for storing the published data, which is logically a ring buffer. The reception index information can be understood as a record for characterizing reception data of the reception object. The distribution index information can be understood as a record for characterizing distribution data of the distribution object. The collision detection result may be understood as a detection result of whether there is a data collision.
It is to be understood that after the data center system is powered on and started, each publishing object or receiving object is started, and the data center interface is called to find whether a corresponding address space is opened up, if no active opening up space is available, the opened up space is mapped into the own memory space.
Specifically, the processor may traverse the receiving index information of all the receiving objects in the shared memory, and because the ring buffer queue may generate a data collision, the processor may determine whether there are receiving objects on the release index information of the data to be released of the current release object and the number of the receiving objects by comparing the receiving index information with the release index information, so as to obtain a collision detection result.
S130, processing the data to be distributed into target distribution data matched with a target receiving object according to the conflict detection result and the receiving frequency information.
In this embodiment, the target distribution data may be understood as data in a reception format corresponding to the target reception object.
Specifically, the processor may process the data to be issued according to the corresponding conflict policy when the conflict detection result is that there is a conflict, so as to obtain target issue data, and process the data to be issued according to the receiving frequency information when the conflict detection result is that there is no conflict, so as to form target issue data matched with the target receiving object. When receiving object first subscribed data, the processor searches from the preset list whether the received object has permission to receive the data, if not, the received object is failed to subscribe, if so, the unique value of the received object is updated at the position of the received index information corresponding to the received object in the shared memory, the latest release index information of the current release is obtained, and the target release data is received from the latest part.
The technical scheme of the embodiment of the invention is applied to a data center system which comprises a shared memory, wherein the data center system is connected with a release object and a receiving object, and the method comprises the following steps: when receiving data to be distributed, which is sent by a distribution object, determining a target receiving object, and acquiring receiving frequency information of the target receiving object; performing data conflict detection on the release index information in the shared memory according to the receiving index information of all the receiving objects in the shared memory to obtain a conflict detection result; and processing the data to be distributed into target distribution data matched with the target receiving object according to the conflict detection result and the receiving frequency information. And processing the received data to be issued according to the receiving frequency information of the target receiving object to obtain target issued data. The data interaction between different modules can be realized without additionally adapting the data interfaces of other modules. The safety and stability of data interaction are guaranteed.
Further, the step of processing the data to be issued into target issue data matched with the target receiving object according to the collision detection result and the receiving frequency information may be further optimized as follows:
a1, determining target receiving index information belonging to target receiving objects from the receiving index information.
In this embodiment, the target reception index information may be understood as an index value indicating that the target reception object is currently to receive.
Specifically, the processor may determine, from the identification of the reception index information, the identification of the target reception object, and further determine the target reception index information pertaining to the target reception object.
And b1, when the conflict detection result is that data conflict exists, processing the data to be issued into target issued data matched with a target receiving object according to a preset conflict configuration strategy.
In this embodiment, the preset conflict configuration policy may be understood as a policy for resolving a data conflict, such as an issue object infinite wait policy; according to the received object priority coverage policy, the published object waits for a certain time policy, etc.
Specifically, when the conflict detection result indicates that a data conflict exists, the processor may process the data to be issued into target issued data matched with the target receiving object according to a preset conflict configuration policy.
The preset conflict configuration policy may be an infinite waiting policy for the publishing object, where the processor may temporarily publish the data to be published, and ensure that each data is processed; the coverage policy may be performed according to the priority of the receiving object, so as to ensure that the data with high priority is processed, the low priority is skipped according to the security policy, and the issuing object waits for a certain time policy, etc.
And c1, when the conflict detection result shows that the data conflict does not exist, processing the data to be issued into target issued data according to the issued index information, the target receiving index information and the receiving frequency information.
Specifically, when the collision detection result indicates that there is no data collision, the processor may process the data to be issued into target issued data according to the issued index information, the target receiving index information, and the receiving frequency information.
The step of processing the data to be distributed into the target distribution data according to the distribution index information, the target receiving index information and the receiving frequency information can be optimized as follows:
determining an index difference value between the release index information and the target receiving index information; if the index difference value is larger than the set threshold value, determining target release data according to the historical release data, the data to be released and the receiving frequency information; otherwise, determining target release data according to the data to be released and the receiving frequency information.
In the present embodiment, the index difference value can be understood as a value reflecting the difference between the number of publications and the number of receptions. Setting the threshold may be understood as determining a threshold for acquiring a plurality of data, such as 1 or the like.
Specifically, the processor may make a difference between the release index information and the target receiving index information to obtain an index difference value, and compare the index difference value with a set threshold, and when the index difference value is greater than the set threshold, the processor may find a preset policy corresponding to the receiving object to determine whether to report the data to be released of the latest target release index information or report all unreported release index values, so that the preset policy may package the historical release data and the data to be released, split the packaged data according to the receiving frequency information, and determine the target release data. When the index difference value is smaller than or equal to the set threshold value, the processor processes the data to be released according to the receiving frequency information, and determines target release data.
According to the technical scheme, conflict detection is conducted on the release index information through the receiving index information, when data conflict exists, the data to be released is processed according to a preset conflict configuration strategy, when the data conflict does not exist, whether data packaging is conducted or not is determined through an index difference value between the target receiving index information and the release index information, and then the packaged data is processed through the receiving frequency information, so that target release data matched with a target receiving object is formed. The data interaction between different modules can be realized without additionally adapting the data interfaces of other modules. The safety and stability of data interaction are guaranteed.
As a first alternative embodiment of the present embodiment, after processing the data to be distributed into target distribution data matching the target receiving object according to the collision detection result and the receiving frequency information, the method further includes:
and releasing the target release data to the shared memory, updating release index information, generating a notification signal and sending the notification signal to the target receiving object, so that the target receiving object acquires the target release data from the shared memory when receiving the notification signal.
In this embodiment, the notification signal may be understood as a signal for prompting that the target reception object has issued data.
Specifically, the processor may issue the target issue data to a corresponding position in the shared memory, update the issue index information, for example, increment a value of the issue index information, generate a notification signal, and send the notification signal to the target receiving object, so that when the target receiving object receives the notification signal, the target receiving object obtains updated issue index information from the shared memory, and receives the corresponding target issue data according to the updated issue index information.
In the first alternative embodiment of the first embodiment, by such a setting, the target receiving object may not acquire the target published data through the callback interface, and at the same time, the target receiving object may acquire the data satisfying its receiving frequency. The interaction of data among different modules is realized.
As a second alternative embodiment of the first embodiment, on the basis of the above embodiment, further comprising:
when the data to be distributed meets the preset packaging conditions, acquiring historical data information under a set time length, and determining the packaging data according to the historical data information and the data to be distributed.
In the present embodiment, the preset packing condition may be understood as a condition for packing a plurality of data, which may be set by a reception object. The set duration may be understood as a set length of time, corresponding to data to be packaged in the preset packaging conditions. The historical data information can be understood as data stored for a set period of time. Packed data may be understood as unified data formed.
Specifically, the processor may receive a preset packing condition, for example, set a time reference/set data to be distributed of a time period, then the processor may accumulate the time/duration of the received data to be distributed, and when the data to be distributed meets the preset packing condition, acquire historical data information under the set duration already stored in the shared memory, and perform unified arrangement and packing on the historical data information and the data to be distributed, so as to obtain packed data.
In the second alternative embodiment of the first embodiment, by such a setting, when the preset packing condition is satisfied, the data is packed according to the set time length, so as to form the packed data. The automatic packaging of the data is realized, so that the receiving object can directly acquire all relevant data concerned.
As a third alternative embodiment of the first embodiment, on the basis of the above embodiment, further comprising:
when the detection condition is met, index value information of a set period of the release object and index information to be detected of each receiving object at the current moment are obtained, overtime receiving objects meeting the overtime processing condition are determined according to the index value information and the index information to be detected, and the overtime receiving objects are processed according to a preset overtime strategy.
In the present embodiment, the detection condition can be understood as a set detection period or the like. The set period of time may be understood as the length of time of detection. The index information to be detected can be understood as all the current index information, including the receiving index information and the issuing index information. The preset timeout policy may be understood as a release policy when there is a timeout receiving object. The timeout processing condition may be understood as a condition for judging whether or not the reception object is timed out. A timeout receiving object may be understood as a receiving object that does not receive data for more than a certain period of time.
Specifically, when the detection condition is met, the processor may acquire index value information of a set period of the release object and index information to be detected of each receiving object at the current moment, determine release frequency of the release object and receiving frequency of each receiving object, and may also detect whether any receiving object is in a blocked or "dead-in" state according to the index value information and the index information to be detected, thereby determining a timeout receiving object meeting the timeout processing condition, and process the timeout receiving object according to a preset timeout policy, such as a restart or prompt policy, and store release data under the set period at this time, so as to facilitate the subsequent timeout receiving object to re-receive the release data.
According to the third optional embodiment of the first embodiment, through the arrangement, the release progress of the release object, the receiving progress of each receiving object and the release data condition can be monitored, so that the stability of data interaction is ensured.
As a fourth optional embodiment of the first embodiment, on the basis of the foregoing embodiment, after managing data to be published according to a publishing policy and receiving frequency information, obtaining target published data matched with a target receiving object and publishing the target published data to a shared memory, the method further includes:
and synchronously storing the target release data and the corresponding release event at the associated cloud.
In this embodiment, the associated cloud may be understood as a cloud for event monitoring of a data center system. A published event may be understood as an event formed by all the published processes corresponding to each time the data center system receives a published object.
Specifically, the data center system further provides network communication capability, the processor can transmit data to be published in real time between different domains, and can synchronously store target published data and corresponding published events at the associated cloud, and after the publication is completed, the associated cloud is used for re-simulating the published events of the published objects.
According to the fourth optional embodiment of the first embodiment, through the arrangement, the simulator and the actual environment are subjected to data interaction together, and the flow of the board terminal is simulated and replayed at the cloud end, so that the backtracking of the published data and the published event is facilitated.
For example, in order to facilitate understanding of interactions between a receiving object and a publishing object in the present invention, fig. 2 is a diagram of an example of interactions in a data processing method according to an embodiment of the present invention, where, as shown in fig. 2, one publishing object may correspond to N receiving objects, different types of data are published for different receiving objects, and a process of timeout receiving objects and collision detection may be performed by monitoring objects. The shared memory contains information of the release object, current release object ID, index of release object release, information of the receiving object, ID of the receiving object and index of each receiving object (removing pseudo cache), and a space is opened for storing release data, and the space is logically a ring buffer. The publishing object creates a related shared memory and publishes data according to the frequency of publication. The receiving object maps the shared memory into the own memory, waits for the issuing object to issue data in a waiting mode (block waiting, sleep waiting, etc.) of the receiving object, and decides whether to report in real time or wait for the receiving object to inquire according to the type of the receiving object. The monitoring object monitors the state of the current issuing object, the issuing frequency, the issuing data, the state of the receiving object and the receiving frequency, and detects the overtime receiving object and the data conflict.
Example two
Fig. 3 is a schematic structural diagram of a data processing apparatus according to a second embodiment of the present invention. As shown in fig. 3, the apparatus includes:
an information acquisition module 31, configured to determine a target receiving object when receiving data to be distributed sent by a distribution object, and acquire receiving frequency information of the target receiving object;
the result determining module 32 is configured to perform data collision detection on the release index information in the shared memory according to the reception index information of all the reception objects in the shared memory, so as to obtain a collision detection result;
and a data processing module 33, configured to process the data to be issued into target issue data matched with the target receiving object according to the conflict detection result and the receiving frequency information.
The technical scheme of the embodiment of the invention is applied to a data center system which comprises a shared memory, wherein the data center system is connected with a release object and a receiving object, and the method comprises the following steps: when receiving data to be distributed, which is sent by a distribution object, determining a target receiving object, and acquiring receiving frequency information of the target receiving object; performing data conflict detection on the release index information in the shared memory according to the receiving index information of all the receiving objects in the shared memory to obtain a conflict detection result; and processing the data to be distributed into target distribution data matched with the target receiving object according to the conflict detection result and the receiving frequency information. And processing the received data to be issued according to the receiving frequency information of the target receiving object to obtain target issued data. The data interaction between different modules can be realized without additionally adapting the data interfaces of other modules. The safety and stability of data interaction are guaranteed.
Further, the data processing module includes:
an information determination unit configured to determine target reception index information belonging to the target reception object from the reception index information;
the first processing unit is used for processing the data to be issued into target issued data matched with the target receiving object according to a preset conflict configuration strategy when the conflict detection result is that data conflict exists;
and the second processing unit is used for processing the data to be distributed into the target distribution data according to the distribution index information, the target receiving index information and the receiving frequency information when the conflict detection result shows that the data conflict does not exist.
The second processing unit is specifically configured to:
determining an index difference value between the release index information and the target receiving index information;
if the index difference value is larger than a set threshold value, determining the target release data according to the historical release data, the data to be released and the receiving frequency information;
otherwise, determining the target release data according to the data to be released and the receiving frequency information.
Optionally, the apparatus further comprises: and a data release module.
The data issuing module is configured to issue the target issue data to the shared memory after processing the data to be issued into target issue data matched with the target receiving object according to the conflict detection result and the receiving frequency information, update the issue index information, and generate a notification signal and send the notification signal to the target receiving object, so that the target receiving object obtains the target issue data from the shared memory when receiving the notification signal.
Optionally, the apparatus further comprises:
and the data packaging module is used for acquiring historical data information under a set duration when the data to be distributed meets a preset packaging condition, and determining packaging data according to the historical data information and the data to be distributed.
Optionally, the apparatus further comprises: and a timeout detection module.
The overtime detection module is used for acquiring index value information of a set period of the release object and index information to be detected of each receiving object at the current moment when the detection condition is met, determining an overtime receiving object meeting the overtime processing condition according to the index value information and the index information to be detected, and processing the overtime receiving object according to a preset overtime strategy.
Optionally, the apparatus further comprises: and a data synchronization module.
And the data synchronization module is used for managing the data to be distributed according to the distribution strategy and the receiving frequency information, obtaining target distribution data matched with the target receiving object, distributing the target distribution data to the shared memory, and synchronously storing the target distribution data and the corresponding distribution event at the associated cloud.
The data processing device provided by the embodiment of the invention can execute the data processing method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
Example III
Fig. 4 shows a schematic diagram of an electronic device 40 that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Electronic equipment may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 4, the electronic device 40 includes at least one processor 41, and a memory communicatively connected to the at least one processor 41, such as a Read Only Memory (ROM) 42, a Random Access Memory (RAM) 43, etc., in which the memory stores a computer program executable by the at least one processor, and the processor 41 may perform various suitable actions and processes according to the computer program stored in the Read Only Memory (ROM) 42 or the computer program loaded from the storage unit 48 into the Random Access Memory (RAM) 43. In the RAM 43, various programs and data required for the operation of the electronic device 40 may also be stored. The processor 41, the ROM 42 and the RAM 43 are connected to each other via a bus 44. An input/output (I/O) interface 45 is also connected to bus 44.
Various components in electronic device 40 are connected to I/O interface 45, including: an input unit 46 such as a keyboard, a mouse, etc.; an output unit 47 such as various types of displays, speakers, and the like; a storage unit 48 such as a magnetic disk, an optical disk, or the like; and a communication unit 49 such as a network card, modem, wireless communication transceiver, etc. The communication unit 49 allows the electronic device 40 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The processor 41 may be various general and/or special purpose processing components with processing and computing capabilities. Some examples of processor 41 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processor, controller, microcontroller, etc. The processor 41 performs the various methods and processes described above, such as data processing methods.
In some embodiments, the data processing method may be implemented as a computer program tangibly embodied on a computer-readable storage medium, such as the storage unit 48. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 40 via the ROM 42 and/or the communication unit 49. When the computer program is loaded into RAM 43 and executed by processor 41, one or more steps of the data processing method described above may be performed. Alternatively, in other embodiments, the processor 41 may be configured to perform the data processing method in any other suitable way (e.g. by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
A computer program for carrying out methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computing system may include clients and servers. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service are overcome.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.

Claims (10)

1. A data processing method, applied to a data center system, the data center system including a shared memory, the data center system being connected with a release object and a receiving object, the method comprising:
when receiving data to be distributed, which is sent by a distribution object, determining a target receiving object, and acquiring receiving frequency information of the target receiving object;
performing data conflict detection on the release index information in the shared memory according to the receiving index information of all the receiving objects in the shared memory to obtain a conflict detection result;
and processing the data to be issued into target issued data matched with the target receiving object according to the conflict detection result and the receiving frequency information.
2. The method according to claim 1, wherein the processing the data to be distributed into target distribution data matched with the target receiving object according to the collision detection result and the receiving frequency information includes:
determining target receiving index information belonging to the target receiving object from the receiving index information;
when the conflict detection result is that data conflict exists, the data to be distributed is processed into target distributed data matched with the target receiving object according to a preset conflict configuration strategy;
and when the conflict detection result shows that no data conflict exists, processing the data to be distributed into the target distribution data according to the distribution index information, the target receiving index information and the receiving frequency information.
3. The method according to claim 2, wherein the processing the data to be distributed into the target distribution data according to the distribution index information, the target reception index information, and the reception frequency information includes:
determining an index difference value between the release index information and the target receiving index information;
if the index difference value is larger than a set threshold value, determining the target release data according to the historical release data, the data to be released and the receiving frequency information;
otherwise, determining the target release data according to the data to be released and the receiving frequency information.
4. The method according to claim 1, further comprising, after processing the data to be distributed into target distribution data matching the target receiving object according to the collision detection result and the receiving frequency information:
and releasing the target release data to the shared memory, updating the release index information, generating a notification signal and sending the notification signal to the target receiving object, so that the target receiving object acquires the target release data from the shared memory when receiving the notification signal.
5. The method as recited in claim 1, further comprising:
when the data to be distributed meets the preset packaging condition, acquiring historical data information under a set time length, and determining packaging data according to the historical data information and the data to be distributed.
6. The method as recited in claim 1, further comprising:
when the detection condition is met, index value information of a set period of the release object and index information to be detected of each receiving object at the current moment are obtained, overtime receiving objects meeting the overtime processing condition are determined according to the index value information and the index information to be detected, and the overtime receiving objects are processed according to a preset overtime strategy.
7. The method according to claim 1, wherein after managing the data to be distributed according to the distribution policy and the receiving frequency information, obtaining target distribution data matched with the target receiving object and distributing the target distribution data to the shared memory, further comprises:
and synchronously storing the target release data and the corresponding release event at the associated cloud.
8. A data processing apparatus, comprising:
the information acquisition module is used for determining a target receiving object when receiving data to be distributed, which is sent by a distributing object, and acquiring receiving frequency information of the target receiving object;
the result determining module is used for carrying out data conflict detection on the release index information in the shared memory according to the receiving index information of all the receiving objects in the shared memory to obtain a conflict detection result;
and the data processing module is used for processing the data to be issued into target issued data matched with the target receiving object according to the conflict detection result and the receiving frequency information.
9. An electronic device, the electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the data processing method of any one of claims 1-7.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores computer instructions for causing a processor to implement the data processing method of any one of claims 1-7 when executed.
CN202311449454.2A 2023-11-02 2023-11-02 Data processing method, device, equipment and medium Pending CN117421140A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311449454.2A CN117421140A (en) 2023-11-02 2023-11-02 Data processing method, device, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311449454.2A CN117421140A (en) 2023-11-02 2023-11-02 Data processing method, device, equipment and medium

Publications (1)

Publication Number Publication Date
CN117421140A true CN117421140A (en) 2024-01-19

Family

ID=89524569

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311449454.2A Pending CN117421140A (en) 2023-11-02 2023-11-02 Data processing method, device, equipment and medium

Country Status (1)

Country Link
CN (1) CN117421140A (en)

Similar Documents

Publication Publication Date Title
CN113766487B (en) Cloud mobile phone information acquisition method, device, equipment and medium
CN116150051A (en) Command processing method, device and system
CN113703946B (en) Application recovery method and device, electronic equipment and computer readable storage medium
CN110881224B (en) Network long connection method, device, equipment and storage medium
CN113641544B (en) Method, apparatus, device, medium and product for detecting application state
CN113791792A (en) Application calling information acquisition method and device and storage medium
CN116431313A (en) Scheduling method, device, equipment and medium for polling task
CN117421140A (en) Data processing method, device, equipment and medium
CN116450176A (en) Version updating method and device, electronic equipment and storage medium
CN113835728B (en) Data updating method and device, electronic equipment and storage medium
CN115118475A (en) Method, device, equipment and medium for dispatching cryptographic equipment cluster
CN115225556A (en) Detection method, device, equipment and storage medium
CN103220187A (en) Method and device for detecting state of three-layer port
CN114567540B (en) Master-slave node switching method, device, equipment, medium and program product
CN114928540B (en) Preemption method and device, electronic equipment and storage medium
CN115525415B (en) Data processing method, device, equipment and medium
CN117785403A (en) Heartbeat task execution device for equipment, electronic equipment and storage medium
CN117499224A (en) Internet of things equipment edge gateway access method, device, equipment and medium
CN116594764A (en) Application program updating method and device, electronic equipment and storage medium
CN114756286A (en) TBOX end data acquisition method and device, electronic equipment and storage medium
CN116279215A (en) Data processing method and device, electronic equipment and storage medium
CN117596288A (en) Message transmission method and device, electronic equipment and storage medium
CN116185695A (en) Log processing method and device, electronic equipment and storage medium
CN117033029A (en) Data transmission method, device, equipment and medium
CN117909165A (en) Data acquisition method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination