CN114138778A - Data processing system, method, device, equipment and computer readable medium - Google Patents
Data processing system, method, device, equipment and computer readable medium Download PDFInfo
- Publication number
- CN114138778A CN114138778A CN202111405119.3A CN202111405119A CN114138778A CN 114138778 A CN114138778 A CN 114138778A CN 202111405119 A CN202111405119 A CN 202111405119A CN 114138778 A CN114138778 A CN 114138778A
- Authority
- CN
- China
- Prior art keywords
- data
- target
- theme
- subsystem
- basic data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2291—User-Defined Types; Storage management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F16/275—Synchronous replication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present application relates to a data processing system, method, apparatus, device and computer readable medium. The data processing system includes: the basic data subsystem is used for monitoring basic data and storing the basic data to a plurality of original subjects, wherein the original subjects are used for classifying the basic data; the intermediate data layer is connected with the basic data subsystem and used for synchronizing basic data according to the plurality of original topics, extracting target data from the basic data of the plurality of original topics according to target service requirements and storing the target data to a target customization topic; and the service subsystem is connected with the intermediate data layer and is used for sending the target service requirement to the intermediate data layer so as to enable the intermediate data layer to create a target customization theme and monitor the target customization theme so as to acquire target data from the target customization theme. The method and the device solve the technical problem of overhigh coupling degree between the basic data system and the service system.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a data processing system, method, apparatus, device, and computer readable medium.
Background
There are often numerous business systems that need to access and use its data.
In the related art, the coupling degree between the basic data system and the service system is too high, so that the basic data system is more and more complicated. On one hand, the business system usually acquires data from the basic data system by means of timing query, but if the query is too frequent, the basic data system may crash, and if the query is not frequent, both sides of data may have a certain response delay. On the other hand, the business system is limited by the business requirement and needs to customize data, so the basic data system needs to be customized for different business systems, and as the business systems accessed by the basic data system are more and more, the basic data system becomes more and more complex.
Aiming at the problem of over-high coupling degree between a basic data system and a service system, an effective solution is not provided at present.
Disclosure of Invention
The application provides a data processing system, a method, a device, equipment and a computer readable medium, which aim to solve the technical problem of overhigh coupling degree between a basic data system and a service system.
According to an aspect of an embodiment of the present application, there is provided a data processing system including:
the basic data subsystem is used for monitoring basic data and storing the basic data to a plurality of original subjects, wherein the original subjects are used for classifying the basic data;
the intermediate data layer is connected with the basic data subsystem and used for synchronizing basic data according to the plurality of original topics, extracting target data from the basic data of the plurality of original topics according to target service requirements and storing the target data to a target customization topic;
and the service subsystem is connected with the intermediate data layer and is used for sending the target service requirement to the intermediate data layer so as to enable the intermediate data layer to create a target customization theme and monitor the target customization theme so as to acquire target data from the target customization theme.
According to another aspect of the embodiments of the present application, there is provided a data processing method applied to an intermediate data layer, including:
synchronizing basic data on a basic data subsystem according to a plurality of original topics of the basic data subsystem, wherein the basic data subsystem is used for providing basic data services, and the plurality of original topics are used for classifying the basic data;
extracting target data from the basic data of a plurality of original subjects according to target service requirements, wherein the target service requirements are sent by a service subsystem, and the service subsystem is used for providing target service;
and storing the target data to a target customization theme so that the business subsystem acquires the target data from the target customization theme, wherein the target customization theme is created in advance according to the target business requirements.
Optionally, synchronizing the underlying data on the underlying data subsystem according to the plurality of original topics of the underlying data subsystem comprises:
receiving data to be synchronized under the condition that the data to be synchronized exists in a target message queue, wherein the target message queue is a data cache queue between a basic data subsystem and an intermediate data layer;
extracting a theme identifier from the data to be synchronized, wherein the theme identifier is used for representing an original theme of the data to be synchronized on a basic data subsystem;
determining a target original theme consistent with the theme identification on the intermediate data layer;
and storing the data to be synchronized to the target original theme so as to complete the synchronization with the basic data of the basic data subsystem.
Optionally, before storing the target data to the target customized topic, the method further includes creating the target customized topic as follows:
under the condition that a target service requirement sent by a service subsystem is received, theme customizing data and a parent theme identifier are extracted from the target service requirement, wherein the parent theme identifier is used for representing a parent theme to which the target customizing theme is subscribed;
creating an initial theme model and distributing a data cache space for the initial theme model;
replacing default configuration parameters of a data interface of the initial theme model with theme customization data to obtain a target customization theme;
and linking the target custom theme to the target parent theme indicated by the parent theme identification so that the target custom theme is subscribed to the target parent theme, wherein the target parent theme comprises the original theme and/or other custom themes.
Optionally, extracting the target data from the basic data of the plurality of original topics according to the target service requirement includes:
acquiring a filtering function, a filtering condition parameter and a filtering strategy parameter from the theme customization data, wherein the filtering condition parameter is used for indicating the data attribute, the data type, the data format and the data range of the required data of the target customization theme;
and configuring a filtering function according to the filtering condition parameters, and transferring the target filtering strategy parameters serving as the parameters to the filtering function so as to extract target data meeting the filtering conditions from a plurality of original subjects according to the target strategy through the filtering function.
Optionally, after subscribing to the target parent topic through the target customized topic, the method further includes:
under the condition that cache data in a target parent theme is updated, acquiring updated data;
and sending the updating data to the target custom theme subscribed to the target parent theme.
Optionally, in a case that there are a plurality of customized topics chained between the original topic and the business subsystem, the method further includes deleting the customized topics on the chain as follows:
acquiring a parent theme identifier and a child theme identifier of the theme to be deleted from the configuration parameters of the theme to be deleted, wherein the child theme identifier is used for representing a child theme subscribed to the theme to be deleted;
determining a target parent theme subscribed by the theme to be deleted through the parent theme identification, and determining a target child theme subscribed to the theme to be deleted through the child theme identification;
and deleting the theme to be deleted, and linking the target sub-theme to the target parent theme so that the target sub-theme is subscribed to the target parent theme.
According to another aspect of the embodiments of the present application, there is provided a data processing apparatus applied to an intermediate data layer, including:
the data synchronization module is used for synchronizing basic data on the basic data subsystem according to a plurality of original themes of the basic data subsystem, wherein the basic data subsystem is used for providing basic data service, and the plurality of original themes are used for classifying the basic data;
the data extraction module is used for extracting target data from the basic data of a plurality of original subjects according to target business requirements, wherein the target business requirements are sent by the business subsystem, and the business subsystem is used for providing target business services;
and the data customization module is used for storing the target data to a target customization theme so as to enable the business subsystem to acquire the target data from the target customization theme, wherein the target customization theme is created in advance according to the target business requirements.
According to another aspect of the embodiments of the present application, there is provided an electronic device, including a memory, a processor, a communication interface, and a communication bus, where the memory stores a computer program executable on the processor, and the memory and the processor communicate with each other through the communication bus and the communication interface, and the processor implements the steps of the method when executing the computer program.
According to another aspect of embodiments of the present application, there is also provided a computer readable medium having non-volatile program code executable by a processor, the program code causing the processor to perform the above-mentioned method.
Compared with the related art, the technical scheme provided by the embodiment of the application has the following advantages:
the technical scheme of the application provides a data processing system, which comprises: the basic data subsystem is used for monitoring basic data and storing the basic data to a plurality of original subjects, wherein the original subjects are used for classifying the basic data; the intermediate data layer is connected with the basic data subsystem and used for synchronizing basic data according to the plurality of original topics, extracting target data from the basic data of the plurality of original topics according to target service requirements and storing the target data to a target customization topic; and the service subsystem is connected with the intermediate data layer and is used for sending the target service requirement to the intermediate data layer so as to enable the intermediate data layer to create a target customization theme and monitor the target customization theme so as to acquire target data from the target customization theme. According to the method and the device, the basic data system and the service system are decoupled, the intermediate data layer is extracted, various processing is carried out on data in the intermediate data layer to adapt to different service systems, and the technical problem that the coupling degree between the basic data system and the service system is too high is solved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the technical solutions in the embodiments or related technologies of the present application, the drawings needed to be used in the description of the embodiments or related technologies will be briefly described below, and it is obvious for those skilled in the art to obtain other drawings without any creative effort.
FIG. 1 is a schematic diagram of an alternative data processing system according to an embodiment of the present application;
FIG. 2 is a diagram illustrating an alternative hardware environment for a data processing method according to an embodiment of the present application;
FIG. 3 is a flow chart of an alternative data processing method provided in accordance with an embodiment of the present application;
FIG. 4 is a schematic diagram of an alternative intermediate data layer provided in accordance with an embodiment of the present application;
FIG. 5 is a schematic diagram of an alternative theme customization interface provided in accordance with an embodiment of the present application;
FIG. 6 is a block diagram of an alternative data processing apparatus according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of an alternative electronic device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for the convenience of description of the present application, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.
In the related art, the coupling degree between the basic data system and the service system is too high, so that the basic data system is more and more complicated. On one hand, the business system usually acquires data from the basic data system by means of timing query, but if the query is too frequent, the basic data system may crash, and if the query is not frequent, both sides of data may have a certain response delay. On the other hand, the business system is limited by the business requirement and needs to customize data, so the basic data system needs to be customized for different business systems, and as the business systems accessed by the basic data system are more and more, the basic data system becomes more and more complex.
To solve the problems mentioned in the background, according to an aspect of the embodiments of the present application, there is provided an embodiment of a data processing system, as shown in fig. 1, including:
the basic data subsystem 101 is configured to monitor basic data and store the basic data into a plurality of original topics, where the plurality of original topics are used to classify the basic data;
the intermediate data layer 103 is connected with the basic data subsystem and is used for synchronizing basic data according to a plurality of original topics, extracting target data from the basic data of the plurality of original topics according to target service requirements and storing the target data to a target customization topic;
and the business subsystem 105 is connected with the intermediate data layer and is used for sending the target business requirement to the intermediate data layer so as to enable the intermediate data layer to create the target customization theme and monitor the target customization theme so as to acquire the target data from the target customization theme.
In the embodiment of the application, the basic data subsystem provides basic data service, changes of basic data are monitored in the service process, and when the data change, the changed data are sent to the intermediate data layer for synchronization. The basic data subsystem may perform basic classification, i.e., the original topic, when storing the basic data. The basic data subsystem stores basic data according to different topic classifications. The underlying data subsystem need not be adapted to the business needs of the business subsystem and the themes required by the business subsystem are specifically tailored.
In the embodiment of the application, the intermediate data layer is divided into two parts, one part is completely synchronous with the basic data subsystem, namely the same original themes are correspondingly set in the own database completely according to the theme classification on the basic data subsystem, and the basic data stored under each original theme is also synchronous with the basic data subsystem. The other part is specially designed for the business subsystem and is used for customizing a target customization theme required by the business subsystem according to the business requirement of the business subsystem, and the target customization theme subscribes to a data source of data required by the business subsystem, namely the front part of the original theme, so that the target data required by the business subsystem is extracted from one or more original themes through the target customization theme.
Optionally, a plurality of customized themes can be set between the business subsystem and the original theme, so that the basic data in the original theme is filtered once or more times to form the target data finally required by the business subsystem.
In the embodiment of the application, the service subsystem subscribes to one or more themes of the intermediate data layer according to the requirement of the service subsystem, and executes the service logic of the service subsystem when the data is changed.
According to the method and the device, the basic data system and the service system are decoupled, the intermediate data layer is extracted, the basic data system only needs to complete basic data monitoring, classifying and storing tasks, various processing is carried out on data in the intermediate data layer so as to adapt to different service systems, and the technical problem that the coupling degree between the basic data system and the service system is too high is solved.
According to another aspect of embodiments of the present application, there is provided an embodiment of a data processing method applied to an intermediate data layer.
Alternatively, in the embodiment of the present application, the data processing method may be applied to a hardware environment formed by the terminal 201 and the server 203 as shown in fig. 2. As shown in fig. 2, the server 203 is connected to the terminal 201 through a network, which may be used to provide services (such as data synchronization services, demand customization services, etc.) for the terminal or a client installed on the terminal, and a database 205 may be provided on the server or independent of the server, and may be used to provide data storage services for the server 203, and the network includes but is not limited to: wide area network, metropolitan area network, or local area network, and the terminal 201 includes but is not limited to a PC, a cell phone, a tablet computer, and the like.
A data processing method in the embodiment of the present application may be executed by the server 203, or may be executed by both the server 203 and the terminal 201, as shown in fig. 3, the method may include the following steps:
step S302, synchronizing basic data on a basic data subsystem according to a plurality of original topics of the basic data subsystem, wherein the basic data subsystem is used for providing basic data service, and the plurality of original topics are used for classifying the basic data;
step S304, extracting target data from the basic data of a plurality of original subjects according to target service requirements, wherein the target service requirements are sent by a service subsystem, and the service subsystem is used for providing target service;
step S306, storing the target data to a target customization theme so that the business subsystem acquires the target data from the target customization theme, wherein the target customization theme is created in advance according to the target business requirement.
In the embodiment of the present application, as shown in fig. 4, the intermediate data layer and the basic data subsystem are completely synchronized, that is, the same original topics are also set in the database of the intermediate data layer (original topics such as users and components exist in the basic data subsystem, and original topics such as users and components are also set in the intermediate data layer) according to the topic classification on the basic data subsystem, and the basic data stored in each original topic is also kept synchronized with the basic data subsystem. The intermediate data layer can customize a target customized theme (such as computer department users, male users, users in all ages, materials, finished products and the like) required by the service subsystem according to the service requirement of the service subsystem, and the target customized theme subscribes a data source of data required by the service subsystem, namely an original theme on the intermediate data layer (such as original themes subscribed by the computer department users, the male users and the users in all ages are users, and original themes subscribed by the materials and the finished products are components), so that target data required by the service subsystem is extracted from one or more original themes through the target customized theme.
In the related technology, a business system directly queries a basic data system and acquires data, the basic data system needs to customize special subjects for different business systems, and the basic data system is more and more bloated and complicated due to high coupling. According to the method and the device, the basic data system and the service system are decoupled, the intermediate data layer is extracted, the basic data system only needs to complete basic data monitoring, classifying and storing tasks, various processing is carried out on data in the intermediate data layer to adapt to different service systems, and the technical problem that the coupling degree between the basic data system and the service system is too high is solved.
Optionally, synchronizing the underlying data on the underlying data subsystem according to the plurality of original topics of the underlying data subsystem comprises:
step 2, extracting a theme identifier from the data to be synchronized, wherein the theme identifier is used for representing an original theme of the data to be synchronized on a basic data subsystem;
step 3, determining a target original theme consistent with the theme identification on the intermediate data layer;
and 4, storing the data to be synchronized to the target original theme so as to complete the synchronization with the basic data of the basic data subsystem.
In the embodiment of the application, the basic data subsystem and the intermediate data layer are communicated through the message queue, and the coupling degree between the basic data subsystem and the intermediate data layer is reduced, so that the basic data subsystem can execute other tasks without receiving a feedback signal of the intermediate data layer, and similarly, the intermediate data layer does not need to deal with different states of the basic data subsystem.
In the embodiment of the application, when data is synchronized, the intermediate data layer needs to store the data according to the data structure, the attribute, the data type and the like of the original theme.
Alternatively, since the intermediate data layer is data-synchronized with the basic data subsystem, when the basic data subsystem is abnormal and cannot provide the basic data service, the intermediate data layer can be used as a temporary basic data system to provide the basic data service.
Optionally, before storing the target data to the target customized topic, the method further includes creating the target customized topic as follows:
step 2, creating an initial theme model and distributing a data cache space for the initial theme model;
step 3, replacing default configuration parameters of a data interface of the initial theme model with theme customization data to obtain a target customization theme;
and 4, linking the target customized theme to the target parent theme indicated by the parent theme identification so as to enable the target customized theme to subscribe to the target parent theme, wherein the target parent theme comprises the original theme and/or other customized themes.
Fig. 5 is a schematic diagram of an optional theme customization interface provided in the present application, where various attributes of a target customization theme, such as a theme name, a theme description, a partition number, a copy number, a filter attribute, a filter condition, a filter value, a filter expression, and the like, may be configured on the theme customization interface.
In the embodiment of the application, the theme customization data is used for configuring the data structure, the attribute, the data type and the data range of the data under the target customization theme. The theme customization data also comprises one or more data filtering rules of the target customization theme, and each rule consists of three parts, namely a filtering function, a filtering condition parameter and a filtering strategy parameter. When filtering data, the filtering rules are converted into ognl (object Graph Navigation language) expressions, so as to filter data in the original topics and other customized topics of the middle data layer.
In the embodiment of the application, when customizing the theme, the original theme can be subscribed, and other customizing themes can also be subscribed, so that a plurality of customizing themes can be included between the business subsystem and the original theme, and basic data in the original theme is filtered once or more times to form target data finally required by the business subsystem.
Optionally, extracting the target data from the basic data of the plurality of original topics according to the target service requirement includes:
and 2, configuring a filtering function according to the filtering condition parameters, and transmitting the target filtering strategy parameters serving as the form parameters to the filtering function so as to extract target data meeting the filtering conditions from a plurality of original subjects according to the target strategy through the filtering function.
In the embodiment of the application, the filtering condition parameter is used for indicating the data attribute, the data type, the data format and the data range of the required data of the target customized theme, and the filtering policy parameter is used for determining the policy of filtering the data by a user.
Optionally, after subscribing to the target parent topic through the target customized topic, the method further includes:
and step 2, sending the updating data to a target customization theme subscribed to the target parent theme.
In the embodiment of the application, once the data of the parent theme is updated, the child theme receives the updated data. If a plurality of customized themes are chained between the business subsystem and the original theme, the data updated by the original theme is updated to the business subsystem step by step.
Optionally, in a case that there are a plurality of customized topics chained between the original topic and the business subsystem, the method further includes deleting the customized topics on the chain as follows:
step 2, determining a target parent theme subscribed by the theme to be deleted through the parent theme identification, and determining a target child theme subscribed to the theme to be deleted through the child theme identification;
and 3, deleting the theme to be deleted, and linking the target sub theme to the target parent theme so as to enable the target sub theme to subscribe the target parent theme.
In the embodiment of the present application, the customized topic may be deleted without affecting the subscription relationship, so as to stop tracking the topic, specifically, a sub topic of the topic to be deleted is linked to a parent topic of the topic to be deleted, so that the sub topic subscribes to the parent topic.
According to another aspect of the embodiments of the present application, as shown in fig. 6, there is provided a data processing apparatus applied to an intermediate data layer, including:
a data synchronization module 601, configured to synchronize basic data on a basic data subsystem according to a plurality of original topics of the basic data subsystem, where the basic data subsystem is configured to provide a basic data service, and the plurality of original topics are configured to classify the basic data;
the data extraction module 603 is configured to extract target data from the basic data of the multiple original topics according to a target service requirement, where the target service requirement is sent by a service subsystem, and the service subsystem is configured to provide a target service;
and the data customization module 605 is configured to store the target data in a target customization theme, so that the business subsystem acquires the target data from the target customization theme, where the target customization theme is created in advance according to a target business requirement.
It should be noted that the data synchronization module 601 in this embodiment may be configured to execute step S302 in this embodiment, the data extraction module 603 in this embodiment may be configured to execute step S304 in this embodiment, and the data customization module 605 in this embodiment may be configured to execute step S306 in this embodiment.
It should be noted here that the modules described above are the same as the examples and application scenarios implemented by the corresponding steps, but are not limited to the disclosure of the above embodiments. It should be noted that the modules described above as a part of the apparatus may operate in a hardware environment as shown in fig. 1, and may be implemented by software or hardware.
Optionally, the data synchronization module is specifically configured to:
receiving data to be synchronized under the condition that the data to be synchronized exists in a target message queue, wherein the target message queue is a data cache queue between a basic data subsystem and an intermediate data layer;
extracting a theme identifier from the data to be synchronized, wherein the theme identifier is used for representing an original theme of the data to be synchronized on a basic data subsystem;
determining a target original theme consistent with the theme identification on the intermediate data layer;
and storing the data to be synchronized to the target original theme so as to complete the synchronization with the basic data of the basic data subsystem.
Optionally, the data processing apparatus further includes a theme customizing module, configured to:
under the condition that a target service requirement sent by a service subsystem is received, theme customizing data and a parent theme identifier are extracted from the target service requirement, wherein the parent theme identifier is used for representing a parent theme to which the target customizing theme is subscribed;
creating an initial theme model and distributing a data cache space for the initial theme model;
replacing default configuration parameters of a data interface of the initial theme model with theme customization data to obtain a target customization theme;
and linking the target custom theme to the target parent theme indicated by the parent theme identification so that the target custom theme is subscribed to the target parent theme, wherein the target parent theme comprises the original theme and/or other custom themes.
Optionally, the data extraction module is specifically configured to:
acquiring a filtering function, a filtering condition parameter and a filtering strategy parameter from the theme customization data, wherein the filtering condition parameter is used for indicating the data attribute, the data type, the data format and the data range of the required data of the target customization theme;
and configuring a filtering function according to the filtering condition parameters, and transferring the target filtering strategy parameters serving as the parameters to the filtering function so as to extract target data meeting the filtering conditions from a plurality of original subjects according to the target strategy through the filtering function.
Optionally, the data processing apparatus further includes a data subscription module, configured to:
under the condition that cache data in a target parent theme is updated, acquiring updated data;
and sending the updating data to the target custom theme subscribed to the target parent theme.
Optionally, the data processing apparatus further includes a theme deletion module, configured to, in a case that a plurality of customized themes in a chain exist between the original theme and the business subsystem, delete the customized theme on the chain as follows:
acquiring a parent theme identifier and a child theme identifier of the theme to be deleted from the configuration parameters of the theme to be deleted, wherein the child theme identifier is used for representing a child theme subscribed to the theme to be deleted;
determining a target parent theme subscribed by the theme to be deleted through the parent theme identification, and determining a target child theme subscribed to the theme to be deleted through the child theme identification;
and deleting the theme to be deleted, and linking the target sub-theme to the target parent theme so that the target sub-theme is subscribed to the target parent theme.
According to another aspect of the embodiments of the present application, an electronic device is provided, as shown in fig. 7, and includes a memory 701, a processor 703, a communication interface 705, and a communication bus 707, where the memory 701 stores a computer program that is executable on the processor 703, the memory 701 and the processor 703 communicate with each other through the communication interface 705 and the communication bus 707, and the processor 703 implements the steps of the method when executing the computer program.
The memory and the processor in the electronic equipment are communicated with the communication interface through a communication bus. The communication bus may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc.
The Memory may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.
There is also provided, in accordance with yet another aspect of an embodiment of the present application, a computer program product or computer program comprising computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the steps of any of the embodiments described above.
Optionally, in an embodiment of the present application, a computer readable medium is configured to store program code for the processor to perform the following steps:
synchronizing basic data on a basic data subsystem according to a plurality of original topics of the basic data subsystem, wherein the basic data subsystem is used for providing basic data services, and the plurality of original topics are used for classifying the basic data;
extracting target data from the basic data of a plurality of original subjects according to target service requirements, wherein the target service requirements are sent by a service subsystem, and the service subsystem is used for providing target service;
and storing the target data to a target customization theme so that the business subsystem acquires the target data from the target customization theme, wherein the target customization theme is created in advance according to the target business requirements.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments, and this embodiment is not described herein again.
When the embodiments of the present application are specifically implemented, reference may be made to the above embodiments, and corresponding technical effects are achieved.
It is to be understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or any combination thereof. For a hardware implementation, the Processing units may be implemented within one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, micro-controllers, microprocessors, other electronic units configured to perform the functions described herein, or a combination thereof.
For a software implementation, the techniques described herein may be implemented by means of units performing the functions described herein. The software codes may be stored in a memory and executed by a processor. The memory may be implemented within the processor or external to the processor.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is merely a logical division, and in actual implementation, there may be other divisions, for example, multiple modules or components may be combined or integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially implemented or make a contribution to the prior art, or may be implemented in the form of a software product stored in a storage medium and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk. It is noted that, in this document, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The above description is merely exemplary of the present application and is presented to enable those skilled in the art to understand and practice the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A data processing system, comprising:
the basic data subsystem is used for monitoring basic data and storing the basic data to a plurality of original subjects, wherein the original subjects are used for classifying the basic data;
the intermediate data layer is connected with the basic data subsystem and used for synchronizing the basic data according to the original topics, extracting target data from the basic data of the original topics according to target service requirements and storing the target data to a target customization topic;
and the business subsystem is connected with the intermediate data layer and is used for sending the target business requirement to the intermediate data layer so as to enable the intermediate data layer to create the target customization theme and monitor the target customization theme so as to acquire the target data from the target customization theme.
2. A data processing method is applied to an intermediate data layer and is characterized by comprising the following steps:
synchronizing basic data on a basic data subsystem according to a plurality of original subjects of the basic data subsystem, wherein the basic data subsystem is used for providing basic data services, and the original subjects are used for classifying the basic data;
extracting target data from the basic data of the original topics according to target service requirements, wherein the target service requirements are sent by a service subsystem, and the service subsystem is used for providing target service;
and storing the target data to a target customization theme so that the business subsystem acquires the target data from the target customization theme, wherein the target customization theme is created in advance according to the target business requirement.
3. The method of claim 2, wherein synchronizing the underlying data on the underlying data subsystem according to a plurality of original topics of the underlying data subsystem comprises:
receiving data to be synchronized under the condition that the data to be synchronized exists in a target message queue, wherein the target message queue is a data buffer queue between the basic data subsystem and the intermediate data layer;
extracting a theme identifier from the data to be synchronized, wherein the theme identifier is used for representing an original theme of the data to be synchronized on the basic data subsystem;
determining a target original theme consistent with the theme identification on the intermediate data layer;
and storing the data to be synchronized to the target original theme so as to complete the synchronization with the basic data of the basic data subsystem.
4. The method of any of claims 2 to 3, wherein prior to storing the target data to the target customization theme, the method further comprises creating the target customization theme as follows:
under the condition that the target service requirement sent by the service subsystem is received, theme customizing data and a parent theme identifier are extracted from the target service requirement, wherein the parent theme identifier is used for representing a parent theme to which the target customizing theme is subscribed;
creating an initial theme model and distributing a data cache space for the initial theme model;
replacing default configuration parameters of a data interface of the initial theme model with the theme customization data to obtain the target customization theme;
and linking the target custom theme to a target parent theme indicated by the parent theme identification so that the target custom theme is subscribed to the target parent theme, wherein the target parent theme comprises the original theme and/or other custom themes.
5. The method of claim 4, wherein extracting target data from the base data of the plurality of original topics according to target business requirements comprises:
acquiring a filtering function, a filtering condition parameter and a filtering strategy parameter from the theme customization data, wherein the filtering condition parameter is used for indicating the data attribute, the data type, the data format and the data range of the required data of the target customization theme;
and configuring the filtering function according to the filtering condition parameters, and transmitting target filtering strategy parameters serving as form parameters to the filtering function so as to extract the target data meeting the filtering conditions from the original subjects according to the target strategy through the filtering function.
6. The method of claim 5, wherein after subscribing to the target parent topic via the target custom topic, the method further comprises:
under the condition that the cache data in the target parent theme is updated, acquiring updated data;
and sending the updating data to the target customization theme subscribed to the target parent theme.
7. The method of claim 5, wherein in the event that there are multiple custom topics in a chain between the original topic and the business subsystem, the method further comprises deleting the custom topics in the chain as follows:
acquiring a parent theme identifier and a child theme identifier of a theme to be deleted from configuration parameters of the theme to be deleted, wherein the child theme identifier is used for representing a child theme subscribed to the theme to be deleted;
determining a target parent theme subscribed by the theme to be deleted through the parent theme identification, and determining a target child theme subscribed by the theme to be deleted through the child theme identification;
deleting the topic to be deleted, and linking the target sub topic to the target parent topic so as to enable the target sub topic to subscribe to the target parent topic.
8. A data processing apparatus, applied to an intermediate data layer, comprising:
the data synchronization module is used for synchronizing basic data on a basic data subsystem according to a plurality of original subjects of the basic data subsystem, wherein the basic data subsystem is used for providing basic data services, and the original subjects are used for classifying the basic data;
the data extraction module is used for extracting target data from the basic data of the original topics according to target business requirements, wherein the target business requirements are sent by a business subsystem, and the business subsystem is used for providing target business services;
and the data customization module is used for storing the target data to a target customization theme so as to enable the business subsystem to acquire the target data from the target customization theme, wherein the target customization theme is created in advance according to the target business requirement.
9. An electronic device comprising a memory, a processor, a communication interface and a communication bus, wherein the memory stores a computer program operable on the processor, and the memory and the processor communicate via the communication bus and the communication interface, wherein the processor implements the steps of the method according to any of the claims 2 to 7 when executing the computer program.
10. A computer-readable medium having non-volatile program code executable by a processor, wherein the program code causes the processor to perform the method of any of claims 2 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111405119.3A CN114138778A (en) | 2021-11-24 | 2021-11-24 | Data processing system, method, device, equipment and computer readable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111405119.3A CN114138778A (en) | 2021-11-24 | 2021-11-24 | Data processing system, method, device, equipment and computer readable medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114138778A true CN114138778A (en) | 2022-03-04 |
Family
ID=80392200
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111405119.3A Pending CN114138778A (en) | 2021-11-24 | 2021-11-24 | Data processing system, method, device, equipment and computer readable medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114138778A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114579193A (en) * | 2022-03-08 | 2022-06-03 | 国泰新点软件股份有限公司 | Multi-system loading method, device, equipment and storage medium |
-
2021
- 2021-11-24 CN CN202111405119.3A patent/CN114138778A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114579193A (en) * | 2022-03-08 | 2022-06-03 | 国泰新点软件股份有限公司 | Multi-system loading method, device, equipment and storage medium |
| CN114579193B (en) * | 2022-03-08 | 2024-01-12 | 国泰新点软件股份有限公司 | Multi-system loading method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2017202007B2 (en) | Notification feed across multiple client devices | |
| US10764252B2 (en) | Communicating with machine to machine devices | |
| JP2020507162A5 (en) | ||
| US7941410B2 (en) | Method and system of managing conflicts for a set of synchronized folders | |
| EP2948875B1 (en) | Method and system for using a recursive event listener on a node in hierarchical data structure | |
| US11853737B1 (en) | Metadata driven product configuration management | |
| CN110543512B (en) | Information synchronization method, device and system | |
| CN105786950A (en) | Method and device for processing data | |
| CN107766488B (en) | Information query method, terminal and computer readable storage medium | |
| CN114138778A (en) | Data processing system, method, device, equipment and computer readable medium | |
| CN114416883A (en) | Block chain light node data synchronization method, device, equipment and readable storage medium | |
| KR20180011183A (en) | How to Remove Message Notifications, Systems, and Servers | |
| CN113220182B (en) | Information prompting method and device, storage medium and electronic equipment | |
| US8713059B2 (en) | Management of computer-file sharing between at least two devices | |
| CN113934742A (en) | Data updating method, node information storage method, electronic device, and medium | |
| CN113168357A (en) | Collecting duplicate diagnostic data from users participating in a document collaboration session | |
| EP3834150A1 (en) | Scalable system for dynamic user audience determination | |
| CN112130924B (en) | Application system data analysis method and device | |
| US11301482B2 (en) | Assist system and assist method | |
| US11886277B2 (en) | Systems, apparatuses, and methods for assessing recovery viability of backup databases | |
| JP6015051B2 (en) | Groupware system, cache method and cache program in groupware system | |
| US20160162572A1 (en) | Alerting system based on newly disambiguated features | |
| WO2015184830A1 (en) | Method and device for managing file in apparatus | |
| US20050038882A1 (en) | Automated eRoom archive tool and method | |
| US20200334047A1 (en) | Systems and computer-implemented methods for managing application configurations |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |