CN113987089A - System cascading method, data processing method and device - Google Patents
System cascading method, data processing method and device Download PDFInfo
- Publication number
- CN113987089A CN113987089A CN202111615452.7A CN202111615452A CN113987089A CN 113987089 A CN113987089 A CN 113987089A CN 202111615452 A CN202111615452 A CN 202111615452A CN 113987089 A CN113987089 A CN 113987089A
- Authority
- CN
- China
- Prior art keywords
- data
- data object
- target
- cascade
- data processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2365—Ensuring data consistency and integrity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Software Systems (AREA)
- Computer Security & Cryptography (AREA)
- Human Computer Interaction (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention provides a system cascading method, a data processing method and a data processing device. The system cascading method comprises the following steps: acquiring a first data object to be cascaded and a target cascade system in a system to be cascaded; creating a second data object in the target cascade system; establishing a mapping relation between a first data object and a second data object; and uploading the data content corresponding to the first data object to the second data object based on the mapping relation, so that the target cascade system extracts the data content corresponding to the first data object from the second data object based on the mapping relation. The system cascading method provided by the invention can better adapt to the operating environment in a complex scene, reduces the number of processes to be maintained and the time cost for problem troubleshooting, and reduces the logical burden of a lower-level system and the burden of a physical server CPU.
Description
Technical Field
The invention relates to the technical field of computer communication, in particular to a system cascading method, a data processing method and a data processing device.
Background
In the conventional system cascade, a data list which can be requested in a lower system is pushed to an upper system, and the upper system integrates and displays the data list. And if the superior system receives the corresponding request of the client, finding the corresponding inferior system according to the mapping relation to perform data request operation. After the lower system finishes processing, the data set is fed back to the upper system, and the data set is forwarded to the client program sending the request after the upper system replies the confirmation message. However, with the increase of application scenarios, in the data transmission process between the upper and lower systems in these conventional cascading methods, bidirectional data transmission between the upper and lower systems is required, which causes great difficulty in operation and maintenance, aggravates network load of the upper and lower systems, and increases CPU loss of the physical server. Therefore, how to implement light-weight cascade between systems to reduce the loss of network resources in the data transmission process between cascaded systems becomes a problem to be solved urgently.
Disclosure of Invention
Therefore, the technical problem to be solved by the present invention is to overcome the defect in the prior art that bidirectional data transmission between an upper system and a lower system frequently results in increased server loss, thereby providing a new system cascading method, a data processing method and a device.
The technical scheme provided by the invention is as follows:
a first aspect of an embodiment of the present invention provides a system concatenation method, including: acquiring a first data object to be cascaded and a target cascade system in a system to be cascaded; creating a second data object in the target cascade system; establishing a mapping relation between the first data object and the second data object; and uploading the data content corresponding to the first data object to the second data object based on the mapping relation, so that the target cascade system extracts the data content corresponding to the first data object from the second data object based on the mapping relation.
Optionally, the creating a second data object in the target cascade system includes acquiring an object attribute of the first data object; creating a second data object in the target cascade system based on the object attributes.
Optionally, the establishing a mapping relationship between the first data object and the second data object includes: acquiring a first identifier of a first data object and a second identifier of a second data object; and establishing a mapping relation between the first data object and the second data object based on the corresponding relation between the first identification and the second identification.
Optionally, the method further comprises: obtaining a change operation of the first data object, the change operation comprising: delete, modify, and data write; and controlling the second data object to execute the change operation based on the mapping relation.
A second aspect of the embodiments of the present invention provides a data processing method, including: when a third system receives a data processing request, determining a third data object in the third system based on the data processing request and a mapping relation corresponding to the third system, wherein the data processing request comprises: a data processing operation, a target data object and a fourth system to which the target data object belongs, wherein the third system and the fourth system are in system cascade by adopting the method of the first aspect and any one optional implementation manner thereof; corresponding data content is extracted from the third data object, and the data processing operation is performed on the data content.
Optionally, the determining a third data object in a third system based on the data processing request and the mapping relationship corresponding to the third system includes: judging whether a target identifier of the target data object exists in the mapping relation; when the target identification exists in the mapping relation, extracting a third identification corresponding to the target identification based on the mapping relation; determining the third data object based on the third identification.
A third aspect of the embodiments of the present invention provides a system cascade apparatus, including: the system comprises an acquisition module, a data processing module and a data processing module, wherein the acquisition module is used for acquiring a first data object to be cascaded and a target cascade system in the system to be cascaded; a first processing module for creating a second data object in the target cascade system; the second processing module is used for establishing a mapping relation between the first data object and the second data object; and the third processing module is configured to upload the data content corresponding to the first data object to the second data object based on the mapping relationship, so that the target cascade system extracts the data content corresponding to the first data object from the second data object based on the mapping relationship.
A fourth aspect of the embodiments of the present invention provides a data processing apparatus, including: a fourth processing module, configured to determine, when a data processing request is received by a first system, a third data object in the first system based on the data processing request and a mapping relationship corresponding to the first system, where the data processing request includes: data processing operation, a target data object and a second system to which the target data object belongs, wherein the first system and the second system are in system cascade by adopting the device in the third aspect; and the fifth processing module is used for extracting corresponding data content from the third data object and executing the data processing operation on the data content.
A fifth aspect of an embodiment of the present invention provides an electronic device, including: a memory and a processor, the memory and the processor being communicatively connected to each other, the memory having stored therein computer instructions, and the processor being configured to execute the computer instructions to perform the method according to the first aspect, the second aspect, or any one of the optional embodiments thereof.
A sixth aspect of embodiments of the present invention provides a computer-readable storage medium storing computer instructions for causing a computer to perform the method according to the first aspect, the second aspect and any one of the optional implementation manners thereof.
The technical scheme of the invention has the following advantages:
the invention provides a system cascading method and a system cascading device, which are used for uploading partial data requested by a lower system to a data area corresponding to a higher system by establishing a mapping relation between data objects by the upper system and the lower system, so that the cascade of the upper system and the lower system is realized. Therefore, when the superior system needs to read the data of the inferior system, the operation required by the superior system and the inferior system is not needed, the data can be directly read from the corresponding data area in the superior system, the repeated request of the superior system and the inferior system is not needed, and the network burden between the superior system and the inferior system and the processing pressure of a CPU are reduced. The method adopts a one-way transmission mode, thereby distinguishing the process of requesting forwarding in the original cascade state. The whole query request can complete the whole query process in the same level system and directly return to the client program. Compared with the traditional cascading mode, the load of a logically lower system is reduced, and the value of the method is higher in the cascading system with more hierarchies.
The invention provides a data processing method and a data processing device, when a third system receives a data processing request, a third data object in the third system is determined based on the data processing request and a mapping relation corresponding to the third system, wherein the data processing request comprises the following steps: the third system and the fourth system adopt the cascade method provided by another embodiment of the invention to carry out system cascade; corresponding data content is extracted from the third data object and data processing operations are performed on the data content. The data processing is carried out by using the system cascade method of another embodiment of the invention in the data processing process, so that the data processing is more convenient, the corresponding lower system can be conveniently found according to the data to be processed, the target data can be directly and correspondingly processed in the lower system, the upper system does not need to send instructions to the lower system, the running space in the data processing process is greatly saved, and the running load of the upper system and the lower system is reduced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a flow chart of a system cascading method in an embodiment of the invention;
FIG. 2 is a flowchart illustrating the creation of a second data object in the target cascade system in accordance with an embodiment of the present invention;
FIG. 3 is a flowchart illustrating the process of creating a mapping relationship between a first data object and a second data object according to an embodiment of the present invention;
FIG. 4 is an expanded view of a single-tier service operation process in accordance with an embodiment of the present invention;
FIG. 5 is a diagram illustrating a multi-level system connection processing method according to an embodiment of the present invention;
FIG. 6 is a flow chart of a data processing method according to an embodiment of the present invention;
FIG. 7 is a flowchart illustrating determining a third data object in the first system based on the data processing request and the mapping relationship corresponding to the first system according to an embodiment of the present invention;
FIG. 8 is a schematic structural diagram of a system cascade device in an embodiment of the present invention;
FIG. 9 is a diagram illustrating an exemplary data processing apparatus according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of an electronic device in an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the conventional system cascade, a data list which can be requested in a lower system is pushed to an upper system, and the upper system integrates and displays the data list. And if the superior system receives the corresponding request of the client, finding the corresponding inferior system according to the mapping relation to perform data request operation. After the lower system finishes processing, the data set is fed back to the upper system and is forwarded to the client program sending the request by the upper system. However, with the increase of application scenarios, the conventional cascading method cannot meet various application scenarios. Such as: passing through a unidirectional network gate, multiple key data copies and multiple concurrent voltage division of a single system.
Scenario-a conventional cascade system passes through a unidirectional gatekeeper: since unidirectional gatekeeper transfers typically only allow one byte to be replied to as an acknowledge byte. In a conventional state, the cascade connection is a bidirectional transmission process, and if a unidirectional gatekeeper is supposed to pass through, unidirectional data push is necessarily carried out in a manner similar to a gateway to carry out interaction. The process quantity and the communication process interface of the whole system are increased, and the difficulty is increased for subsequent operation and maintenance work.
Scene two, a conventional cascade system makes multiple copies of key data: generally, the process of multiple copies of data in a cascade system is very complicated and tedious, and each logic level stores data corresponding to each level. It is inevitable to add more processes or threads to be maintained to process such multiple copies of the important data separately. Another problem is that when a network or process abnormality occurs in a lower-level service, the history query operation of the upper-level system is affected.
Scenario three conventional cascade systems request partial pressure: assuming that the lower system is established in a non-cluster mode, in a conventional cascade mode, if an upper level requests or subscribes a large amount of data to the lower level, the network burden of the upper and lower systems is increased, and the burden is caused to a physical server CPU. The main cause of the burden is the large number of repeated data transfers.
Based on the above problem, an embodiment of the present invention provides a system concatenation method, as shown in fig. 1, the method specifically includes the following steps:
step S101: the method comprises the steps of obtaining a first data object to be cascaded and a target cascade system in the system to be cascaded.
In practical application, the system to be cascaded is a lower-level system, the target cascading system is a higher-level system, the first data object in the system to be cascaded is a storage location corresponding to data in the lower-level system, the first data object may correspond to a storage location of one data, or may correspond to multiple storage locations corresponding to multiple data, and the corresponding storage location may be specifically selected according to data that the lower-level system allows the higher-level system to access. It should be noted that, in the embodiment of the present invention, the lower level target system has an independent storage space, the data source of the lower level system is controlled and managed only by the lower level itself, and it is not necessary to report and approve the data source to the upper level service, and the upper level and the lower level exist in an independent manner.
Step S102: a second data object is created in the target cascade system.
The second data object is a storage position used for storing data in the target cascade system, if the upper system and the lower system form a cascade relation, the lower system pushes the data requested by the upper system to the upper system, and the upper system also establishes a corresponding data area for the data pushed by the lower system; other storage spaces of the upper-level system can form a cascade relationship with other lower-level systems to form a one-to-many processing mode.
Step S103: and establishing a mapping relation between the first data object and the second data object.
If the lower system is cascade-connected, the selected data is pushed to the data area corresponding to the upper system, and the upper system integrates and displays the data, so that a mapping binding relationship is formed.
Step S104: and uploading the data content corresponding to the first data object to the second data object based on the mapping relation, so that the target cascade system extracts the data content corresponding to the first data object from the second data object based on the mapping relation.
The system cascading method provided by the embodiment of the invention establishes the mapping relation among the data objects in the upper system and the lower system, uploads partial data requested by the lower system to the data area corresponding to the upper system, thereby realizing the cascading of the upper system and the lower system, so that when the upper system needs to read the partial data of the lower system, the upper system and the lower system do not need to mutually request, the upper system and the lower system can directly read from the corresponding data area in the upper system, the repeated request of the upper system and the lower system is not needed, the adoption of a gateway to process a unidirectional isolated network environment is avoided, only two sets of same programs need to be respectively placed in a unidirectional isolated network, and the cascading effect is achieved by pushing the data in the lower system. The workload of program development is reduced, the maintenance work in the future is further reduced, and the network burden between the upper and lower systems and the processing pressure of a CPU are reduced. In addition, the upper level adopts an independent copy mapping mechanism, so that the data can be subjected to lightweight backup, and compared with the integral backup, the method is more flexible and changeable and has strong configuration.
Specifically, in an embodiment, the step S102, as shown in fig. 2, specifically includes the following steps:
step S201: object properties of a first data object are obtained.
Wherein the object attributes include: storing attribute information such as the type and specific numerical requirements of data content, such as: the numerical value of the A data is required to be 0-100, etc. The data attribute in the lower cascade system server is relatively complex, and the data attribute in the lower data is determined first, so that the analysis and backup of the upper system are facilitated.
Step S202: a second data object is created in the target cascade system based on the object attributes.
After the upper system and the lower system are cascaded, the upper system creates a corresponding data attribute area according to the acquired data attribute so as to store the data uploaded by the lower system. Therefore, the data attributes of the upper and lower mapping parts are the same, and the backup and extraction processes are convenient.
Through the steps, the lightweight backup of the superior system to the subordinate system data can be realized, the huge volume of the whole data backup is avoided, and the method is flexible and reliable. There may be localized files in the upper level system that the lower level system uploads the data portion. In the cascade state of the upper and lower levels, an offline data mechanism is added for the reliability of data transmission. Under the condition that all the data to be sent of the cascaded measuring points are offline at the upper level, offline data files can be generated locally, and binary information stored according to a time sequence is consumed in the files. And after the superior service is online, offline data compensation is carried out, and the data of the current measuring point is continuously pushed only after the compensation is finished.
Specifically, in an embodiment, the step S103, as shown in fig. 3, specifically includes the following steps:
step S301: a first identification of the first data object and a second identification of the second data object are obtained.
In the cascade process, the subordinate system selects the cascade data attribute and the data area as a unique identifier which is marked as a unique identifier (1); the superordinate system also creates a data area of the corresponding data attribute, which is marked as a unique identifier (2).
Step S302: and establishing a mapping relation between the first data object and the second data object based on the corresponding relation between the first identification and the second identification.
After the cascade operation of the upper system and the lower system, the identifier (1) and the data attribute in the system are pushed to the upper system, the upper system creates a data area corresponding to the data attribute according to the cascade message pushed by the lower system, the identifier is the identifier (2), and the identifier (2) is bound with the identifier (1) of the lower system to complete the mapping process. The mapping relation between the data objects is established by using the unique identification of the data objects, so that the accuracy of the mapping relation is guaranteed, and the efficiency of subsequent data query and reading is improved.
Specifically, in an embodiment, the step S104 specifically includes the following steps:
step S401: a change operation of the first data object is obtained.
Wherein the changing operation comprises: delete, modify, and data write. Specifically, if the server of the lower system performs data change on the data of the lower system, for example: operations such as deleting, modifying, data writing and the like trigger cascade messages, information of data modification is pushed to a server of a superior system, and the superior server also performs corresponding operations on mapped data. Therefore, the consistency of the stored data content of the concatenated data objects in the upper and lower systems is ensured.
Step S402: and controlling the second data object to execute the change operation based on the mapping relation.
If the mapping relationship established by the upper level and the lower level, when the cascade message is triggered, the upper level searches the corresponding mapping data according to the obtained information and executes the corresponding operation. In such an operating state, the upper and lower mapping data will be consistent, and even if the lower server is disconnected or loses part of the content, the acquisition of the corresponding data content by the upper server will not be affected. In addition, the upper level system is managed in a flat manner, and the cascading data does not exist in the virtualization data. The data from the cascade is not actually different from the local data. Under the abnormal condition of the lower system, the upper system can still normally operate the cascade data. The influence in the use process is reduced.
Through the above steps, the system cascade method provided in the embodiment of the present invention establishes the mapping relationship between the data objects in the upper and lower systems, and uploads part of the data requested by the lower system to the data area corresponding to the upper system, thereby implementing cascade of the upper and lower systems. As illustrated in fig. 4, a development diagram is provided for the single-layer system service operation process. Therefore, when the superior system needs to read the data of the inferior system, the operation required by the superior system and the inferior system is not needed, the data can be directly read from the corresponding data area in the superior system, the repeated request of the superior system and the inferior system is not needed, and the network burden between the superior system and the inferior system and the processing pressure of a CPU are reduced. The method adopts a one-way transmission mode, thereby distinguishing the process of requesting forwarding in the original cascade state. The whole query request can complete the whole query process in the same level system and directly return to the client program. Compared with the traditional cascading mode, the load of a logically lower system is reduced, and the value of the method is higher in the cascading system with more hierarchies. Fig. 5 is a schematic diagram of a cascade processing manner of a multi-stage system.
An embodiment of the present invention further provides a data processing method, as shown in fig. 6, the data processing method specifically includes the following steps:
step S501: and when the third system receives the data processing request, determining a third data object in the third system based on the data processing request and the mapping relation corresponding to the third system.
Wherein the data processing request comprises: the data processing operation, the target data object and the fourth system to which the target data object belongs, and the third system and the fourth system carry out system cascade by adopting the system cascade method provided by another embodiment of the invention.
Specifically, for example, a two-stage system is cascaded, the third system is an upper-stage system, and the fourth system is a lower-stage system. In the data processing process, when an upper system receives partial data to be processed of a lower system, a target data area corresponding to the processed data is determined, and according to the cascade mapping relation of the upper system and the lower system, if the data area is the upper mapping part and the lower mapping part, a third data object where a root of the target data is stored in the upper system is determined, wherein the third data object is a storage position where the target data is stored.
Step S502: corresponding data content is extracted from the third data object and data processing operations are performed on the data content.
Specifically, the above steps have found the data content corresponding to the data operation required in the local storage space of the upper system, and the required data processing can be directly performed on the data content.
The data processing method provided by the embodiment of the invention performs data processing by using the system cascade method of another embodiment of the invention in the data processing process, does not need interaction of data processing requests of upper and lower levels, and can conveniently perform corresponding operation on lower-level data to be processed. Moreover, a certain level of client only performs message processing at the level, so that the pressure of the bottommost cascade system is reduced, and the more cascade levels, the more obvious the embodiment is.
Specifically, in an embodiment, the step S501, as shown in fig. 7, specifically includes the following steps:
step S601: and judging whether the mapping relation has a target identifier of the target data object.
In the data processing process, if a target identifier corresponding to an identifier of target data to be processed can be found in the mapping relationship stored in the upper system, it indicates that a system cascade relationship is established between a lower data area where the target data is located and the upper system, and a mapping binding is formed.
Step S602: and when the target identification exists in the mapping relation, extracting a third identification corresponding to the target identification based on the mapping relation.
If the target data is in a data area in the process of mapping at the upper level and the lower level, the unique identifier (3) corresponding to the target data can be found.
Step S603: a third data object is determined based on the third identification.
According to the cascade relation of the upper and lower systems, the corresponding target identifier (4) in the upper system can be found according to the identifier (3), and the data area of the data object to be processed in the upper system can be determined according to the target identifier (4).
By executing the above steps, the data processing method provided in the embodiment of the present invention performs data processing by using the system cascade method according to another embodiment of the present invention during data processing, so that the data processing is more convenient, and the target identifier of the corresponding upper system can be conveniently found according to the unique identifier of the data to be processed, so that the upper system directly performs corresponding processing on the target data in the local system according to the target identifier, and the upper system does not need to issue an instruction to the lower system, thereby greatly saving the operating space during data processing, and reducing the operating burden of the upper system and the lower system.
An embodiment of the present invention further provides a system cascade apparatus, as shown in fig. 8, the system cascade apparatus includes:
the first obtaining module 101 is configured to obtain a first data object to be cascaded in a system to be cascaded and a target cascading system. For details, refer to the related description of step S101 in the above method embodiment, and no further description is provided here.
The first processing module 102 is configured to create a second data object in the target cascade system. For details, refer to the related description of step S102 in the above method embodiment, and no further description is provided here.
The second processing module 103 is configured to establish a mapping relationship between the first data object and the second data object. For details, refer to the related description of step S103 in the above method embodiment, and no further description is provided here.
The third processing module 104 is configured to upload, based on the mapping relationship, data content corresponding to the first data object to the second data object, so that the target cascade system extracts, based on the mapping relationship, data content corresponding to the first data object from the second data object. For details, refer to the related description of step S104 in the above method embodiment, and no further description is provided here.
Through the above steps, the system cascade method provided in the embodiment of the present invention establishes the mapping relationship between the data objects in the upper and lower systems, and uploads part of the data requested by the lower system to the data area corresponding to the upper system, thereby implementing cascade of the upper and lower systems. Therefore, when the superior system needs to read the data of the inferior system, the operation required by the superior system and the inferior system is not needed, the data can be directly read from the corresponding data area in the superior system, the repeated request of the superior system and the inferior system is not needed, and the network burden between the superior system and the inferior system and the processing pressure of a CPU are reduced. The method adopts a one-way transmission mode, thereby distinguishing the process of requesting forwarding in the original cascade state. The whole query request can complete the whole query process in the same level system and directly return to the client program. Compared with the traditional cascading mode, the load of a logically lower system is reduced, and the value of the method is higher in the cascading system with more hierarchies.
An embodiment of the present invention further provides a data processing apparatus, as shown in fig. 9, the data processing apparatus includes:
a fourth processing module 201, configured to determine, when the first system receives the data processing request, a third data object in the first system based on the data processing request and a mapping relationship corresponding to the first system, where the data processing request includes: the first system and the second system adopt the system cascade device provided by another embodiment of the invention to carry out system cascade. For details, refer to the related description of step S501 in the above method embodiment, and no further description is provided here.
A fifth processing module 202, configured to extract corresponding data content from the third data object, and perform a data processing operation on the data content. For details, refer to the related description of step S502 in the above method embodiment, and no further description is provided herein.
By executing the above steps, the data processing method provided in the embodiment of the present invention performs data processing by using the system cascade method according to another embodiment of the present invention during data processing, so that the data processing is more convenient, and a corresponding lower system can be conveniently found according to data to be processed, so that the target data can be directly and correspondingly processed in the lower system, and the upper system does not need to issue an instruction to the lower system, thereby greatly saving an operation space during data processing, and reducing an operation load of the upper and lower systems.
There is also provided an electronic device according to an embodiment of the present invention, as shown in fig. 10, the electronic device may include a processor 901 and a memory 902, where the processor 901 and the memory 902 may be connected by a bus or in another manner, and fig. 10 illustrates an example of a connection by a bus.
The memory 902, which is a non-transitory computer readable storage medium, may be used for storing non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the methods in the method embodiments of the present invention. The processor 901 executes various functional applications and data processing of the processor by executing non-transitory software programs, instructions and modules stored in the memory 902, that is, implements the methods in the above-described method embodiments.
The memory 902 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created by the processor 901, and the like. Further, the memory 902 may include high speed random access memory, and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 902 may optionally include memory located remotely from the processor 901, which may be connected to the processor 901 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
One or more modules are stored in the memory 902, which when executed by the processor 901 performs the methods in the above-described method embodiments.
The specific details of the electronic device may be understood by referring to the corresponding related descriptions and effects in the above method embodiments, and are not described herein again.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware related to instructions of a computer program, and the program can be stored in a computer readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Flash Memory (Flash Memory), a Hard Disk (Hard Disk Drive, abbreviated as HDD) or a Solid State Drive (SSD), etc.; the storage medium may also comprise a combination of memories of the kind described above.
Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the invention, and such modifications and variations fall within the scope defined by the appended claims.
Claims (10)
1. A system cascading method, comprising:
acquiring a first data object to be cascaded and a target cascade system in a system to be cascaded;
creating a second data object in the target cascade system;
establishing a mapping relation between the first data object and the second data object;
and uploading the data content corresponding to the first data object to the second data object based on the mapping relation, so that the target cascade system extracts the data content corresponding to the first data object from the second data object based on the mapping relation.
2. The method of claim 1, wherein creating the second data object in the target cascade system comprises:
acquiring the object attribute of the first data object;
creating a second data object in the target cascade system based on the object attributes.
3. The method of claim 1, wherein the establishing a mapping relationship between the first data object and the second data object comprises:
acquiring a first identifier of a first data object and a second identifier of a second data object;
and establishing a mapping relation between the first data object and the second data object based on the corresponding relation between the first identification and the second identification.
4. The method of claim 1, further comprising:
obtaining a change operation of the first data object, the change operation comprising: delete, modify, and data write;
and controlling the second data object to execute the change operation based on the mapping relation.
5. A data processing method, comprising:
when a third system receives a data processing request, determining a third data object in the third system based on the data processing request and a mapping relation corresponding to the third system, wherein the data processing request comprises: a fourth system of data processing operations, target data objects and their belongings, the third system and the fourth system performing system cascade by using the method according to any one of claims 1 to 4;
corresponding data content is extracted from the third data object, and the data processing operation is performed on the data content.
6. The method of claim 5, wherein determining a third data object in a third system based on the data processing request and a mapping relationship corresponding to the third system comprises:
judging whether a target identifier of the target data object exists in the mapping relation;
when the target identification exists in the mapping relation, extracting a third identification corresponding to the target identification based on the mapping relation;
determining the third data object based on the third identification.
7. A system cascade apparatus, comprising:
the system comprises an acquisition module, a data processing module and a data processing module, wherein the acquisition module is used for acquiring a first data object to be cascaded and a target cascade system in the system to be cascaded;
a first processing module for creating a second data object in the target cascade system;
the second processing module is used for establishing a mapping relation between the first data object and the second data object;
and the third processing module is configured to upload the data content corresponding to the first data object to the second data object based on the mapping relationship, so that the target cascade system extracts the data content corresponding to the first data object from the second data object based on the mapping relationship.
8. A data processing apparatus, comprising:
a fourth processing module, configured to determine, when a data processing request is received by a first system, a third data object in the first system based on the data processing request and a mapping relationship corresponding to the first system, where the data processing request includes: a data processing operation, a target data object and a second system to which the target data object belongs, wherein the first system and the second system are in system cascade by adopting the device as claimed in claim 7;
and the fifth processing module is used for extracting corresponding data content from the third data object and executing the data processing operation on the data content.
9. An electronic device, comprising:
a memory and a processor communicatively coupled to each other, the memory having stored therein computer instructions, the processor executing the computer instructions to perform the method of any of claims 1-6.
10. A computer-readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111615452.7A CN113987089B (en) | 2021-12-28 | 2021-12-28 | System cascading method, data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111615452.7A CN113987089B (en) | 2021-12-28 | 2021-12-28 | System cascading method, data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113987089A true CN113987089A (en) | 2022-01-28 |
| CN113987089B CN113987089B (en) | 2022-08-26 |
Family
ID=79734573
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111615452.7A Active CN113987089B (en) | 2021-12-28 | 2021-12-28 | System cascading method, data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113987089B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114640595A (en) * | 2022-03-11 | 2022-06-17 | 杭州数梦工场科技有限公司 | Cascading method, device, electronic equipment and storage medium |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110268018A1 (en) * | 2006-08-22 | 2011-11-03 | Alcatel Lucent | Gateway, base station, communication network and synchronization method thereof |
| CN104104653A (en) * | 2013-04-03 | 2014-10-15 | 中国移动通信集团公司 | Page information synchronization method, device and system |
| CN106844727A (en) * | 2017-02-10 | 2017-06-13 | 珠海经济特区远宏科技有限公司大连分公司 | The treatment of large nuber of images characteristic distributed capture and hierarchical application system and method |
| CN108076081A (en) * | 2016-11-09 | 2018-05-25 | 菜鸟智能物流控股有限公司 | Method, device and system for synchronizing service data |
| CN108200110A (en) * | 2016-12-08 | 2018-06-22 | 杭州海康威视系统技术有限公司 | A kind of data processing method, apparatus and system |
| CN108446283A (en) * | 2017-02-16 | 2018-08-24 | 杭州海康威视数字技术股份有限公司 | Date storage method and device |
| CN110266768A (en) * | 2019-05-24 | 2019-09-20 | 视联动力信息技术股份有限公司 | A kind of data transmission method and system |
| CN110392025A (en) * | 2018-04-20 | 2019-10-29 | 伊姆西Ip控股有限责任公司 | Method, equipment and the computer program product of managing distributing type system |
| CN110781815A (en) * | 2019-10-25 | 2020-02-11 | 四川东方网力科技有限公司 | Video data processing method and system |
| US10599753B1 (en) * | 2013-11-11 | 2020-03-24 | Amazon Technologies, Inc. | Document version control in collaborative environment |
| CN110955704A (en) * | 2019-12-03 | 2020-04-03 | 北京锐安科技有限公司 | Data management method, device, equipment and storage medium |
| CN113220791A (en) * | 2021-06-03 | 2021-08-06 | 西安热工研究院有限公司 | Data cascade synchronization system and method |
| CN113254534A (en) * | 2021-06-04 | 2021-08-13 | 四川省明厚天信息技术股份有限公司 | Data synchronization method and device and computer storage medium |
| CN113626522A (en) * | 2021-08-02 | 2021-11-09 | Oppo广东移动通信有限公司 | Data synchronization method, device, medium and equipment |
| CN113836223A (en) * | 2021-08-26 | 2021-12-24 | 浪潮软件科技有限公司 | Heterogeneous database data synchronization method |
-
2021
- 2021-12-28 CN CN202111615452.7A patent/CN113987089B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110268018A1 (en) * | 2006-08-22 | 2011-11-03 | Alcatel Lucent | Gateway, base station, communication network and synchronization method thereof |
| CN104104653A (en) * | 2013-04-03 | 2014-10-15 | 中国移动通信集团公司 | Page information synchronization method, device and system |
| US10599753B1 (en) * | 2013-11-11 | 2020-03-24 | Amazon Technologies, Inc. | Document version control in collaborative environment |
| CN108076081A (en) * | 2016-11-09 | 2018-05-25 | 菜鸟智能物流控股有限公司 | Method, device and system for synchronizing service data |
| CN108200110A (en) * | 2016-12-08 | 2018-06-22 | 杭州海康威视系统技术有限公司 | A kind of data processing method, apparatus and system |
| CN106844727A (en) * | 2017-02-10 | 2017-06-13 | 珠海经济特区远宏科技有限公司大连分公司 | The treatment of large nuber of images characteristic distributed capture and hierarchical application system and method |
| CN108446283A (en) * | 2017-02-16 | 2018-08-24 | 杭州海康威视数字技术股份有限公司 | Date storage method and device |
| CN110392025A (en) * | 2018-04-20 | 2019-10-29 | 伊姆西Ip控股有限责任公司 | Method, equipment and the computer program product of managing distributing type system |
| CN110266768A (en) * | 2019-05-24 | 2019-09-20 | 视联动力信息技术股份有限公司 | A kind of data transmission method and system |
| CN110781815A (en) * | 2019-10-25 | 2020-02-11 | 四川东方网力科技有限公司 | Video data processing method and system |
| CN110955704A (en) * | 2019-12-03 | 2020-04-03 | 北京锐安科技有限公司 | Data management method, device, equipment and storage medium |
| CN113220791A (en) * | 2021-06-03 | 2021-08-06 | 西安热工研究院有限公司 | Data cascade synchronization system and method |
| CN113254534A (en) * | 2021-06-04 | 2021-08-13 | 四川省明厚天信息技术股份有限公司 | Data synchronization method and device and computer storage medium |
| CN113626522A (en) * | 2021-08-02 | 2021-11-09 | Oppo广东移动通信有限公司 | Data synchronization method, device, medium and equipment |
| CN113836223A (en) * | 2021-08-26 | 2021-12-24 | 浪潮软件科技有限公司 | Heterogeneous database data synchronization method |
Non-Patent Citations (3)
| Title |
|---|
| BARRY的异想世界: "JPA对象关系映射 -- 级联操作", 《HTTPS://BLOG.CSDN.NET/QQ_33920904/ARTICLE/DETAILS/104932621》 * |
| SIYU ZHU等: "A Text Detection System for Natural Scenes With Convolutional Feature Learning and Cascaded Classification", 《PROCEEDINGS OF THE IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION》 * |
| 李彦卓: "基于异步处理框架的在线客服交流平台研究与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114640595A (en) * | 2022-03-11 | 2022-06-17 | 杭州数梦工场科技有限公司 | Cascading method, device, electronic equipment and storage medium |
| CN114640595B (en) * | 2022-03-11 | 2023-08-18 | 杭州数梦工场科技有限公司 | Cascading method, device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113987089B (en) | 2022-08-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11809726B2 (en) | Distributed storage method and device | |
| RU2471227C2 (en) | Peer-to-peer synchronisation assisted with service unit | |
| US9031910B2 (en) | System and method for maintaining a cluster setup | |
| CN109766330B (en) | Data slicing method and device, electronic equipment and storage medium | |
| CN109714188B (en) | Configuration data management method, device and storage medium based on Zookeeper | |
| US11429566B2 (en) | Approach for a controllable trade-off between cost and availability of indexed data in a cloud log aggregation solution such as splunk or sumo | |
| US20160342588A1 (en) | Topology aware distributed storage system | |
| US8392437B2 (en) | Method and system for providing deduplication information to applications | |
| CN109460252B (en) | Configuration file processing method and device based on git and computer equipment | |
| CN110958300B (en) | Data uploading method, system, device, electronic equipment and computer readable medium | |
| CN113987089B (en) | System cascading method, data processing method and device | |
| CN112748877A (en) | File integration uploading method and device and file downloading method and device | |
| CN114489762A (en) | Method and system for realizing multi-version application and electronic equipment | |
| US11321374B2 (en) | External storage of unstructured database objects | |
| CN113157658A (en) | Client log collecting and distributing method and device and computer equipment | |
| US20180060974A1 (en) | Social networking relationships processing method, system, and storage medium | |
| WO2022121387A1 (en) | Data storage method and apparatus, server, and medium | |
| CN114564211A (en) | Cluster deployment method, cluster deployment device, equipment and medium | |
| CN114896276A (en) | Data storage method and device, electronic equipment and distributed storage system | |
| CN114490509A (en) | Tracking change data capture log history | |
| CN112711466A (en) | Hanging affair inspection method and device, electronic equipment and storage medium | |
| CN112988879A (en) | Method, system, device, storage medium and processor for accessing database | |
| CN110968267A (en) | Data management method, device, server and system | |
| CN111614743B (en) | File detection method and device, computer equipment and storage medium | |
| CN111488242B (en) | Method and system for tagging and routing striped backups to single deduplication instances on a deduplication device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |