CN107885617B - Method, system, computer device and readable storage medium for exporting business data - Google Patents

Method, system, computer device and readable storage medium for exporting business data Download PDF

Info

Publication number
CN107885617B
CN107885617B CN201710979033.9A CN201710979033A CN107885617B CN 107885617 B CN107885617 B CN 107885617B CN 201710979033 A CN201710979033 A CN 201710979033A CN 107885617 B CN107885617 B CN 107885617B
Authority
CN
China
Prior art keywords
data
document
processed
file
exported
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710979033.9A
Other languages
Chinese (zh)
Other versions
CN107885617A (en
Inventor
张善庆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yonyou Network Technology Co Ltd
Original Assignee
Yonyou Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yonyou Network Technology Co Ltd filed Critical Yonyou Network Technology Co Ltd
Priority to CN201710979033.9A priority Critical patent/CN107885617B/en
Publication of CN107885617A publication Critical patent/CN107885617A/en
Application granted granted Critical
Publication of CN107885617B publication Critical patent/CN107885617B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • G06F11/1469Backup restoration techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/80Database-specific techniques

Abstract

The invention provides a method for exporting business data, a system for exporting the business data, computer equipment and a computer readable storage medium. The method for exporting the service data comprises the following steps: determining a document to be processed according to a problem document of a source system; determining business data to be exported according to metadata of the document to be processed; exporting business data to be exported from a source system to generate export data; the export data is uploaded to the target system to recover the export data. The invention only exports the data needed by the analysis problem, but not exports the data in the whole database, and can be quickly uploaded to the target system, thereby reducing the data transmission amount, saving the time of the user and being convenient for quickly solving the problem of the user.

Description

Method, system, computer device and readable storage medium for exporting business data
Technical Field
The present invention relates to the technical field of business data, and in particular, to a method for exporting business data, a system for exporting business data, a computer device, and a computer-readable storage medium.
Background
In the ERP system, as data is more and more, when a user has a data problem or other business problems, a large amount of time is required for backing up the data and uploading and recovering the data, which brings great influence to the client and even fails to locate the problem. But in fact, analyzing the problem does not require all the data in the database, only the data related to the problem data or problem business.
Therefore, how to rapidly export business data and recover problem data becomes an urgent problem to be solved.
Disclosure of Invention
The present invention is directed to solving at least one of the problems of the prior art or the related art.
To this end, a first aspect of the present invention is directed to a method of deriving traffic data.
A second aspect of the present invention is to provide a system for deriving traffic data.
A third aspect of the invention is directed to a computer device.
A fourth aspect of the present invention is directed to a computer-readable storage medium.
In view of the above, according to an aspect of the present invention, a method for deriving service data is provided, including: determining a document to be processed according to a problem document of a source system; determining business data to be exported according to metadata of the document to be processed; exporting business data to be exported from a source system to generate export data; the export data is uploaded to the target system to recover the export data.
When data problems or business problems occur in a user source system, firstly, documents required for solving analysis problems are determined and determined as documents to be processed according to problem documents in the source system, and only the documents required for solving the analysis problems are determined as the documents to be processed in the process, but archive data of the documents in the whole system is not determined as the data to be exported, so that data transmission quantity is reduced, and transmission speed is increased. The business data to be exported is then determined by the metadata of the document to be processed, which is data describing other data, or structural data providing information about some kind of resource. Just because metadata is data describing a reference object such as information resources or data, it can identify resources, evaluate resources, track changes of resources in the using process, thereby realizing simple and efficient management of a large amount of networked data, effective search and discovery of information resources, and integrated organization and effective management of used resources. And after determining the business data to be exported, exporting the business data to be exported from the source system to generate export data, and uploading the export data to the target system to recover the export data. Therefore, the problem-solving data is determined and exported, the exported data volume is small, the problem-solving data can be exported, uploaded and restored quickly, the consumed time is reduced, and the problem of a user can be solved quickly. The process of recovering and exporting data can select the test environment recovery of the uploaded target system, can also select the test environment recovery of the user source system, and can be selected according to actual needs.
The method for deriving service data according to the present invention may further have the following technical features:
in the above technical solution, preferably, the process of determining the document to be processed according to the question document of the source system specifically includes: acquiring the problem documents and the upstream and downstream relation information of the problem documents according to the business flow of the problem documents; acquiring a process having an upstream-downstream relationship with the service flow according to the upstream-downstream relationship information; and determining the problem bill and the bill in the flow as the bill to be processed.
In the technical scheme, the process of determining the document to be processed according to the problem document of the source system specifically includes: the method comprises the steps of firstly obtaining an upstream and downstream relation of a question document according to a business flow on the question document, obtaining a flow with the upstream and downstream relation with the business flow according to upstream and downstream relation information, confirming all documents related to a business document business chain from a flow line, and determining the question document and all documents related to the document business chain as documents to be exported. In this way, all documents involved in the business chain corresponding to the matched problem document ensure that all documents relevant to the problem resolution are exported.
In any of the above technical solutions, preferably, the process of determining the business data to be exported according to the metadata of the document to be processed specifically includes: inquiring the file quoted by the document to be processed through the metadata of the document to be processed; judging whether a file quoted by the document to be processed has a quoted file or not; if the document quoted by the document to be processed does not have a quoted document, directly determining the business data of the document quoted by the document to be processed as the business data to be exported; and if the file quoted by the document to be processed has a quoted file, inquiring the file quoted by the quoted file until the file quoted by the quoted file does not quote other files, and determining the service data of the file quoted by the document to be processed and the service data of the file quoted by the quoted file as the service data to be exported.
In the technical scheme, the process of determining the business data to be exported through the metadata of the document to be processed specifically comprises the following steps: firstly, the document quoted by the document to be processed is inquired through the metadata of the document to be processed, and the change of the resource in the using process is tracked through the metadata of the problem document, so that the effective discovery of the data resource is realized. Judging whether the file quoted by the document to be processed has a quoted file, if not, directly determining the business data of the file quoted by the document to be processed as the business data to be exported; if the file is quoted, the file quoted is continuously found, and so on, all the related files are found finally, and the service data of all the files are determined as the service data to be exported. Therefore, all the service data related to the problem data are determined, so that the service data can be exported and analyzed, solved and recovered.
In any of the above technical solutions, preferably, before uploading the export data to the target system to recover the export data, the method further includes: and carrying out encrypted backup on the export data.
In the technical scheme, after all the archival data related to the problem data are exported to the data in the corresponding format, the data are encrypted and backed up, so that the loss of the original exported data caused by the failure of analysis and recovery of the exported data is prevented, and the safety of user data is ensured.
In any of the above technical solutions, preferably, uploading the export data to the target system to recover the export data, specifically including: compressing the exported data to generate compressed data; and uploading the compressed data to a test environment of the target system and recovering the compressed data.
In the technical scheme, the process of uploading the export data to a target system to recover the export data specifically comprises the following steps: firstly, export data is compressed into compressed data with corresponding formats, then the compressed data is uploaded to a test environment of a target system and the compressed data is recovered, and the compressed data is used for uploading, so that the size of an uploaded data file is reduced, the uploading speed is improved, the uploading time is saved, and the problem of a user is solved. Of course, the recovery can also be performed in the test environment of the user source system, and the selection can be performed according to the actual situation or the user requirement.
In any of the above technical solutions, preferably, the recovered export data is subjected to anti-theft processing.
In the technical scheme, the data of the user system is related to some resource data of the user, and the recovered exported data is subjected to anti-theft processing, so that the exported data is prevented from being used by others, the safety of the data is ensured, and the loss of the user caused by the use of the exported data is avoided.
According to a second aspect of the present invention, a system for deriving service data is provided, including: the first determining unit is used for determining the bill to be processed according to the problem bill of the source system; the second determining unit is used for determining business data to be exported according to the metadata of the document to be processed; a derivation unit configured to derive traffic data to be derived from a source system to generate derived data; and the recovery unit is used for uploading the export data to the target system so as to recover the export data.
According to the system for exporting the business data, when a data problem or a business problem occurs in a user source system, the first determining unit determines and solves the bill required by the analysis problem according to the problem bill in the source system, and determines the bill as the bill to be processed. The second determination unit then determines the business data to be exported from the metadata of the document to be processed, which is data describing other data or structural data providing information about some kind of resource. Just because metadata is data describing a reference object such as information resources or data, it can identify resources, evaluate resources, track changes of resources in the using process, thereby realizing simple and efficient management of a large amount of networked data, effective search and discovery of information resources, and integrated organization and effective management of used resources. When the business data to be exported is determined, the exporting unit exports the business data to be exported from the source system to generate exported data, and the restoring unit uploads the exported data to the target system to restore the exported data. Therefore, the problem-solving data is determined and exported, the exported data volume is small, the problem-solving data can be exported, uploaded and restored quickly, the consumed time is reduced, and the problem of a user can be solved quickly. The process of recovering and exporting data can select the test environment recovery of the uploaded target system, can also select the test environment recovery of the user source system, and can be selected according to actual needs.
The system for deriving service data according to the present invention may further have the following technical features:
in the foregoing technical solution, preferably, the first determining unit specifically includes: the first obtaining subunit is used for obtaining the problem document and the upstream and downstream relation information of the problem document according to the business flow of the problem document; the second acquiring subunit is configured to acquire, according to the upstream and downstream relationship information, a flow having an upstream and downstream relationship with the service flow; and the first determining subunit is used for determining the problem bill and the bill in the flow as the bill to be processed.
In the technical scheme, the process of determining the to-be-processed document by the first determining unit according to the problem document of the source system specifically includes: the method comprises the steps that firstly, a first obtaining subunit obtains the upstream and downstream relation of a question document according to a business flow on the question document, according to upstream and downstream relation information, a second obtaining subunit obtains a flow with the upstream and downstream relation with the business flow, all documents related to a business document business chain are confirmed from a flow line, and a first confirming subunit confirms the question document and all documents related to the business document chain as documents to be exported. In this way, all documents involved in the business chain corresponding to the matched problem document ensure that all documents relevant to the problem resolution are exported.
In any of the above technical solutions, preferably, the second determining unit specifically includes: the query unit is used for querying the file quoted by the document to be processed through the metadata of the document to be processed; the judging unit is used for judging whether the file quoted by the document to be processed has a quoted file or not; the second determining subunit is used for directly determining the business data of the file quoted by the document to be processed as the business data to be exported if the file quoted by the document to be processed does not have a quoted file; and the third determining subunit is used for inquiring the file quoted by the quoted file if the file quoted by the to-be-processed document has the quoted file until the file quoted by the quoted file does not quote other files, and determining the service data of the file quoted by the to-be-processed document and the service data of the file quoted by the quoted file as the service data to be exported.
In the technical scheme, the process of determining the business data to be exported by the second determining unit according to the metadata of the document to be processed specifically includes: firstly, the query unit queries the document quoted by the document to be processed through the metadata of the document to be processed, and tracks the change of resources in the using process through the metadata of the problem document, so that the effective discovery of the data resources is realized. The judging unit judges whether the file quoted by the document to be processed has a quoted file, if the file is not quoted, the second determining subunit directly determines the service data of the file quoted by the document to be processed as the service data to be exported; if the file is quoted, the quoted file is continuously found, and so on, and finally all the related files are found, and the third determining subunit determines the service data of all the files as the service data to be exported. Therefore, all the service data related to the problem data are determined, so that the service data can be exported and analyzed, solved and recovered.
In any of the above technical solutions, preferably, the backup unit is configured to perform encrypted backup on the export data.
In the technical scheme, after all the archive data related to the problem data are exported to the data in the corresponding format, the backup unit encrypts and backs up the data first, so that the loss of the original export data caused by the failure of analysis and recovery of the export data is prevented, and the safety of user data is ensured.
In any of the above technical solutions, preferably, the recovery unit specifically includes: the compression unit is used for compressing the derived data to generate compressed data; and the uploading unit is used for uploading the compressed data to the test environment of the target system and recovering the compressed data.
In this technical solution, the recovering unit uploads the export data to the test environment of the target system to recover the export data process, which specifically includes: the method comprises the steps that firstly, the compression unit compresses the exported data into compressed data with corresponding formats, then the uploading unit uploads the compressed data to a test environment of a target system and recovers the compressed data, and the compressed data is uploaded, so that the size of an uploaded data file is reduced, the uploading speed is improved, the uploading time is saved, and the user problem is solved. Of course, the recovery can also be performed in the test environment of the user source system, and the selection can be performed according to the actual situation or the user requirement.
In any of the above technical solutions, preferably, the anti-theft unit is configured to perform anti-theft processing on the recovered export data.
In the technical scheme, the data of the user system is related to some resource data of the user, the anti-theft unit carries out anti-theft processing on the recovered exported data, the exported data is prevented from being used by other people, the safety of the data is ensured, and the loss of the user caused by the other use of the exported data is avoided.
According to a third aspect of the present invention, there is provided a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program: determining a document to be processed according to a problem document of a source system; determining business data to be exported according to metadata of the document to be processed; exporting business data to be exported from a source system to generate export data; the export data is uploaded to the target system to recover the export data.
The invention provides a computer device, which realizes that when a processor executes a computer program: when data problems or business problems occur in a user source system, firstly, documents required for solving analysis problems are determined and determined as documents to be processed according to the problem documents in the source system, only the documents required for solving the analysis problems are determined as the documents to be processed in the process, and archive data of the documents in the whole system is not determined as data to be exported, so that data transmission quantity is reduced, and transmission speed is increased. The business data to be exported is then determined by the metadata of the document to be processed, which is data describing other data, or structural data providing information about some kind of resource. Just because metadata is data describing a reference object such as information resources or data, it can identify resources, evaluate resources, track changes of resources in the using process, thereby realizing simple and efficient management of a large amount of networked data, effective search and discovery of information resources, and integrated organization and effective management of used resources. And after determining the business data to be exported, exporting the business data to be exported from the source system to generate export data, and uploading the export data to the target system to recover the export data. Therefore, the problem-solving data is determined and exported, the exported data volume is small, the problem-solving data can be exported, uploaded and restored quickly, the consumed time is reduced, and the problem of a user can be solved quickly. The process of recovering and exporting data can select the test environment recovery of the uploaded target system, can also select the test environment recovery of the user source system, and can be selected according to actual needs.
According to a fourth aspect of the invention, there is provided a computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of: determining a document to be processed according to a problem document of a source system; determining business data to be exported according to metadata of the document to be processed; exporting business data to be exported from a source system to generate export data; the export data is uploaded to the target system to recover the export data.
The present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements: when data problems or business problems occur in a user source system, firstly, documents required for solving analysis problems are determined and determined as documents to be processed according to the problem documents in the source system, only the documents required for solving the analysis problems are determined as the documents to be processed in the process, and archive data of the documents in the whole system is not determined as data to be exported, so that data transmission quantity is reduced, and transmission speed is increased. The business data to be exported is then determined by the metadata of the document to be processed, which is data describing other data, or structural data providing information about some kind of resource. Just because metadata is data describing a reference object such as information resources or data, it can identify resources, evaluate resources, track changes of resources in the using process, thereby realizing simple and efficient management of a large amount of networked data, effective search and discovery of information resources, and integrated organization and effective management of used resources. And after determining the business data to be exported, exporting the business data to be exported from the source system to generate export data, and uploading the export data to the target system to recover the export data. Therefore, the problem-solving data is determined and exported, the exported data volume is small, the problem-solving data can be exported, uploaded and restored quickly, the consumed time is reduced, and the problem of a user can be solved quickly. The process of recovering and exporting data can select the test environment recovery of the uploaded target system, can also select the test environment recovery of the user source system, and can be selected according to actual needs.
Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 shows a flow chart of a method of exporting traffic data according to an embodiment of the present invention;
fig. 2 shows a flow chart of a method of exporting traffic data according to another embodiment of the present invention;
fig. 3 shows a flow chart of a method of exporting traffic data according to still another embodiment of the present invention;
FIG. 4 shows a schematic block diagram of a system for exporting traffic data according to an embodiment of the present invention;
FIG. 5 shows a schematic block diagram of a system for exporting traffic data according to another embodiment of the present invention;
FIG. 6 shows a schematic block diagram of a computer device of one embodiment of the present invention.
Detailed Description
So that the manner in which the above recited aspects, features and advantages of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to the embodiments thereof which are illustrated in the appended drawings. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described herein, and therefore the scope of the present invention is not limited to the specific embodiments disclosed below.
An embodiment of a first aspect of the present invention provides a method for exporting business data, and fig. 1 shows a schematic flow chart of the method for exporting business data according to an embodiment of the present invention:
step 102, determining a bill to be processed according to a problem bill of a source system;
104, determining business data to be exported according to metadata of the document to be processed;
106, exporting the business data to be exported from the source system to generate export data;
and step 108, uploading the export data to the target system to recover the export data.
When data problems or business problems occur in a user source system, firstly, documents required for solving analysis problems are determined and determined as documents to be processed according to problem documents in the source system, and only the documents required for solving the analysis problems are determined as the documents to be processed in the process, but archive data of the documents in the whole system is not determined as the data to be exported, so that data transmission quantity is reduced, and transmission speed is increased. The business data to be exported is then determined by the metadata of the document to be processed, which is data describing other data, or structural data providing information about some kind of resource. Just because metadata is data describing a reference object such as information resources or data, it can identify resources, evaluate resources, track changes of resources in the using process, thereby realizing simple and efficient management of a large amount of networked data, effective search and discovery of information resources, and integrated organization and effective management of used resources. And after determining the business data to be exported, exporting the business data to be exported from the source system to generate export data, and uploading the export data to the target system to recover the export data. Therefore, the problem-solving data is determined and exported, the exported data volume is small, the problem-solving data can be exported, uploaded and restored quickly, the consumed time is reduced, and the problem of a user can be solved quickly. The process of recovering and exporting data can select the test environment recovery of the uploaded target system, can also select the test environment recovery of the user source system, and can be selected according to actual needs.
Fig. 2 is a flowchart illustrating a method of deriving service data according to another embodiment of the present invention. Wherein, the method comprises the following steps:
step 202, acquiring the problem document and the upstream and downstream relation information of the problem document according to the business flow of the problem document;
step 204, acquiring a process having an upstream-downstream relationship with the service flow according to the upstream-downstream relationship information;
step 206, determining the problem documents and the documents in the process as documents to be processed;
step 208, inquiring the file quoted by the document to be processed through the metadata of the document to be processed;
step 210, judging whether the file quoted by the bill to be processed has a quoted file, if not, entering step 212, and if so, entering step 214;
step 212, directly determining the business data of the archive quoted by the document to be processed as the business data to be exported;
step 214, inquiring the file quoted by the quoted file until the file quoted by the quoted file does not quote other files, and determining the service data of the file quoted by the document to be processed and the service data of the file quoted by the quoted file as the service data to be exported;
step 216, exporting the business data to be exported from the source system to generate export data;
step 218, performing encrypted backup on the export data;
step 220, compressing the exported data to generate compressed data;
step 222, uploading the compressed data to the test environment of the target system and recovering the compressed data.
In an embodiment of the present invention, preferably, the problem document and the upstream and downstream relationship information of the problem document are obtained according to the business flow of the problem document; acquiring a process having an upstream-downstream relationship with the service flow according to the upstream-downstream relationship information; and determining the problem bill and the bill in the flow as the bill to be processed.
In the embodiment, the upstream and downstream relation of the document is firstly obtained according to the business flow on the problem document, the flow with the upstream and downstream relation with the business flow is obtained according to the upstream and downstream relation information, all related documents on the business document business chain are confirmed from the flow line, and the problem document and all related documents on the document business chain are determined as the documents to be exported. In this way, all documents involved in the business chain corresponding to the matched problem document ensure that all documents relevant to the problem resolution are exported.
In an embodiment of the present invention, preferably, the archive referred by the document to be processed is queried through metadata of the document to be processed; judging whether a file quoted by the document to be processed has a quoted file or not; if the document quoted by the document to be processed does not have a quoted document, directly determining the business data of the document quoted by the document to be processed as the business data to be exported; and if the file quoted by the document to be processed has a quoted file, inquiring the file quoted by the quoted file until the file quoted by the quoted file does not quote other files, and determining the service data of the file quoted by the document to be processed and the service data of the file quoted by the quoted file as the service data to be exported.
In the embodiment, firstly, the file quoted by the document to be processed is inquired through the metadata of the document to be processed, and the change of the resource in the using process is tracked through the metadata of the problem document, so that the effective discovery of the data resource is realized. Judging whether the file quoted by the document to be processed has a quoted file, if not, directly determining the business data of the file quoted by the document to be processed as the business data to be exported; if the file is quoted, the file quoted is continuously found, and so on, all the related files are found finally, and the service data of all the files are determined as the service data to be exported. Therefore, all the service data related to the problem data are determined, so that the service data can be exported and analyzed, solved and recovered.
In an embodiment of the present invention, before uploading the export data to the test environment of the target system to recover the export data, the method further includes: and carrying out encrypted backup on the export data.
In this embodiment, after all the archive data related to the problem data are exported as data in a corresponding format, for example, the archive data can be exported as a dat file, and the data is encrypted and backed up first, so that the original exported data is prevented from being lost due to failure in analyzing and recovering the exported data, and the security of the user data is ensured.
In one embodiment of the present invention, preferably, the derived data is compressed to generate compressed data; and uploading the compressed data to a test environment of the target system and recovering the compressed data.
In the embodiment, the exported data is compressed into the compressed data with the corresponding format, then the compressed data is uploaded to the test environment of the target system and the compressed data is recovered, and the compressed data is used for uploading, so that the size of an uploaded data file is reduced, the uploading speed is improved, the uploading time is saved, and the user problem is solved. Of course, the recovery can also be performed in the test environment of the user source system, and the selection can be performed according to the actual situation or the user requirement.
In one embodiment of the present invention, the recovered export data is preferably subject to anti-theft processing.
In this embodiment, the data of the user system relates to some resource data of the user, and the recovered export data is subjected to anti-theft processing, for example, watermarking processing is performed on the recovered data, so that the export data is prevented from being used by others, the security of the data is ensured, and the loss of the user caused by other uses of the export data is avoided.
Fig. 3 is a flowchart illustrating a method of exporting traffic data according to still another embodiment of the present invention. Wherein, the method comprises the following steps:
step 302, determining a question document;
step 304, determining a problem document business chain;
step 306, finding all business chain documents;
step 308, finding the archives related to all the business chain documents through the metadata;
step 310, judging whether the file has a reference relation, if so, entering step 312, otherwise, entering step 316;
step 312, continue to search for the referenced archive through the metadata;
step 314, exporting the referenced archive data, and then repeating step 310;
step 316, exporting the archive data;
step 318, compressing and backing up all exported archive data;
in step 320, all the exported archive data are compressed and backed up.
The embodiment is a scheme for rapidly exporting the problem document data, which can rapidly export the problem data of the user, and the scheme has the following advantages:
(1) the data volume is small, and the compressed data file is very small and can be quickly uploaded, backed up and restored;
(2) the consumed time is less, and the user problem is convenient to solve quickly;
(3) and the data security is ensured by encryption processing.
In a second aspect of the present invention, a system 400 for exporting service data is provided, and fig. 4 shows a schematic block diagram of the system 400 for exporting service data according to an embodiment of the present invention:
a first determining unit 402, configured to determine a to-be-processed document according to a question document of a source system;
a second determining unit 404, configured to determine, through the metadata of the to-be-processed document, to-be-exported business data;
a deriving unit 406, configured to derive traffic data to be derived from the source system to generate derived data;
a recovery unit 408 for uploading the export data to the target system to recover the export data.
According to the system 400 for exporting business data, when a data problem or a business problem occurs in a user source system, firstly, the first determining unit 402 determines and solves the bill required by the analysis problem according to the problem bill in the source system, and determines the bill as a to-be-processed bill. The second determination unit 404 then determines the business data to be exported from the metadata of the document to be processed, which is data describing other data, or structural data for providing information about some kind of resource. Just because metadata is data describing a reference object such as information resources or data, it can identify resources, evaluate resources, track changes of resources in the using process, thereby realizing simple and efficient management of a large amount of networked data, effective search and discovery of information resources, and integrated organization and effective management of used resources. When the business data to be exported is determined, the export unit 406 exports the business data to be exported from the source system to generate export data, and the recovery unit 408 uploads the export data to the target system to recover the export data. Therefore, the problem-solving data is determined and exported, the exported data volume is small, the problem-solving data can be exported, uploaded and restored quickly, the consumed time is reduced, and the problem of a user can be solved quickly. The process of recovering and exporting data can select the test environment recovery of the uploaded target system, can also select the test environment recovery of the user source system, and can be selected according to actual needs.
Fig. 5 shows a schematic block diagram of a system 500 for deriving traffic data according to another embodiment of the present invention. The system 500 for deriving service data includes:
a first determining unit 502, configured to determine a to-be-processed document according to a problem document of a source system;
a second determining unit 504, configured to determine, through metadata of a to-be-processed document, to-be-exported business data;
a deriving unit 506, configured to derive traffic data to be derived from the source system to generate derived data;
a recovery unit 508, configured to upload the export data to the target system to recover the export data;
a backup unit 510 for performing encrypted backup on the export data;
and an anti-theft unit 512 for performing anti-theft processing on the recovered export data.
The first determining unit 502 specifically includes:
the first obtaining subunit 5022 is configured to obtain the question document and the upstream and downstream relationship information of the question document according to the service flow of the question document;
a second obtaining subunit 5024, configured to obtain, according to the upstream and downstream relationship information, a flow having an upstream and downstream relationship with the service flow;
the first determining subunit 5026 is configured to determine the question document and the document in the flow as the document to be processed.
The second determining unit 504 specifically includes:
the query unit 5042 is configured to query, through the metadata of the to-be-processed document, an archive referred by the to-be-processed document;
the judging unit 5044 is configured to judge whether a file referenced by the to-be-processed document exists;
a second determining subunit 5046, configured to directly determine, if the document referred by the to-be-processed document does not have a reference document, the service data of the document referred by the to-be-processed document as the service data to be exported;
and a third determining subunit 5048, configured to, if the file referenced by the to-be-processed document has a reference file, query the file referenced by the reference file until the file referenced by the reference file no longer references other files, and determine the service data of the file referenced by the to-be-processed document and the service data of the file referenced by the reference file as the service data to be exported.
The recovery unit 508 specifically includes:
a compression unit 5082, configured to compress the derived data to generate compressed data;
an upload unit 5084, configured to upload the compressed data to a test environment of the target system and recover the compressed data.
In an embodiment of the present invention, preferably, the first determining unit 502 specifically includes: the first obtaining subunit 5022 is configured to obtain the question document and the upstream and downstream relationship information of the question document according to the service flow of the question document; a second obtaining subunit 5024, configured to obtain, according to the upstream and downstream relationship information, a flow having an upstream and downstream relationship with the service flow; the first determining subunit 5026 is configured to determine the question document and the document in the flow as the document to be processed.
In this embodiment, the process of determining the to-be-processed document by the first determining unit 502 according to the question document of the source system specifically includes: first, the first obtaining subunit 5022 obtains the upstream and downstream relations of the document according to the business flow on the problem document, and according to the upstream and downstream relation information, the second obtaining subunit 5024 obtains the flow with the upstream and downstream relations with the business flow, confirms all documents related to the business document business chain from the flow line, and the first determining subunit 5026 determines the problem document and all documents related to the business chain of the document as the documents to be exported. In this way, all documents involved in the business chain corresponding to the matched problem document ensure that all documents relevant to the problem resolution are exported.
In an embodiment of the present invention, preferably, the second determining unit 504 specifically includes: the query unit 5042 is configured to query, through the metadata of the to-be-processed document, an archive referred by the to-be-processed document; the judging unit 5044 is configured to judge whether a file referenced by the to-be-processed document exists; a second determining subunit 5046, configured to directly determine, if the document referred by the to-be-processed document does not have a reference document, the service data of the document referred by the to-be-processed document as the service data to be exported; and a third determining subunit 5048, configured to, if the file referenced by the to-be-processed document has a reference file, query the file referenced by the reference file until the file referenced by the reference file no longer references other files, and determine the service data of the file referenced by the to-be-processed document and the service data of the file referenced by the reference file as the service data to be exported.
In this embodiment, the process of determining the business data to be exported by the second determining unit 504 through the metadata of the document to be processed specifically includes: firstly, the query unit 5042 queries the document referenced by the to-be-processed document through the metadata of the to-be-processed document, and tracks the change of the resource in the using process through the metadata of the problem document, so that the effective discovery of the data resource is realized. The determining unit 5044 determines whether the document referred by the to-be-processed document has a reference document, and if the document is not referred, the second determining subunit 5046 determines the service data of the document referred by the to-be-processed document as the service data to be exported; if the file is referred to, the referred file is continuously found, and so on, and finally all related files are found, and the third determining subunit 5048 determines the service data of all files as the service data to be exported. Therefore, all the service data related to the problem data are determined, so that the service data can be exported and analyzed, solved and recovered.
In one embodiment of the present invention, the backup unit 510 is preferably configured to perform encrypted backup on the export data.
In this embodiment, after exporting all the archive data related to the problem data into data of a corresponding format, for example, into a dat file, the backup unit 510 performs encrypted backup on the data first, so as to prevent the original export data from being lost due to failure in analyzing and recovering the export data, thereby ensuring the security of the user data.
In an embodiment of the present invention, preferably, the recovery unit 508 specifically includes: a compression unit 5082, configured to compress the derived data to generate compressed data; an upload unit 5084, configured to upload the compressed data to a test environment of the target system and recover the compressed data.
In this embodiment, the recovering unit 508 uploads the export data to the test environment of the target system to recover the export data process, which specifically includes: first, the compression unit 5082 compresses the export data into compressed data in a corresponding format, then the upload unit 5084 uploads the compressed data to the test environment of the target system and recovers the compressed data, and the compressed data is used for uploading, so that the size of an uploaded data file is reduced, the uploading speed is increased, the uploading time is saved, and the problem of a user is solved. Of course, the recovery can also be performed in the test environment of the user source system, and the selection can be performed according to the actual situation or the user requirement.
In an embodiment of the present invention, it is preferable that the anti-theft unit 512 is configured to perform anti-theft processing on the recovered export data.
In this embodiment, the data of the user system is related to some resource data of the user, and the anti-theft unit 512 performs anti-theft processing on the recovered export data, for example, performs watermarking processing on the recovered data to prevent the export data from being used by others, thereby ensuring the security of the data and avoiding the loss of the user due to the other use of the export data.
According to a third aspect of the present invention, there is provided a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program: determining a document to be processed according to a problem document of a source system; determining business data to be exported according to metadata of the document to be processed; exporting business data to be exported from a source system to generate export data; the export data is uploaded to the target system to recover the export data.
In embodiments of the third aspect of the present invention, a computer device is provided, and fig. 6 shows a schematic block diagram of a computer device 600 according to an embodiment of the present invention. Wherein the computer device 600 comprises:
a memory 602, a processor 604, and a computer program stored on the memory 602 and executable on the processor 604, the processor 604 implementing the following steps when executing the computer program: determining a document to be processed according to a problem document of a source system; determining business data to be exported according to metadata of the document to be processed; exporting business data to be exported from a source system to generate export data; the export data is uploaded to the target system to recover the export data.
In the computer device 600 provided by the present invention, the processor 604 implements the following when executing the computer program: when data problems or business problems occur in a user source system, firstly, documents required for solving analysis problems are determined and determined as documents to be processed according to the problem documents in the source system, only the documents required for solving the analysis problems are determined as the documents to be processed in the process, and archive data of the documents in the whole system is not determined as data to be exported, so that data transmission quantity is reduced, and transmission speed is increased. The business data to be exported is then determined by the metadata of the document to be processed, which is data describing other data, or structural data providing information about some kind of resource. Just because metadata is data describing a reference object such as information resources or data, it can identify resources, evaluate resources, track changes of resources in the using process, thereby realizing simple and efficient management of a large amount of networked data, effective search and discovery of information resources, and integrated organization and effective management of used resources. And after determining the business data to be exported, exporting the business data to be exported from the source system to generate export data, and uploading the export data to the target system to recover the export data. Therefore, the problem-solving data is determined and exported, the exported data volume is small, the problem-solving data can be exported, uploaded and restored quickly, the consumed time is reduced, and the problem of a user can be solved quickly. The process of recovering and exporting data can select the test environment recovery of the uploaded target system, can also select the test environment recovery of the user source system, and can be selected according to actual needs.
An embodiment of the fourth aspect of the present invention provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of: determining a document to be processed according to a problem document of a source system; determining business data to be exported according to metadata of the document to be processed; exporting business data to be exported from a source system to generate export data; the export data is uploaded to the target system to recover the export data.
The present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements: when data problems or business problems occur in a user source system, firstly, documents required for solving analysis problems are determined and determined as documents to be processed according to the problem documents in the source system, only the documents required for solving the analysis problems are determined as the documents to be processed in the process, and archive data of the documents in the whole system is not determined as data to be exported, so that data transmission quantity is reduced, and transmission speed is increased. The business data to be exported is then determined by the metadata of the document to be processed, which is data describing other data, or structural data providing information about some kind of resource. Just because metadata is data describing a reference object such as information resources or data, it can identify resources, evaluate resources, track changes of resources in the using process, thereby realizing simple and efficient management of a large amount of networked data, effective search and discovery of information resources, and integrated organization and effective management of used resources. And after determining the business data to be exported, exporting the business data to be exported from the source system to generate export data, and uploading the export data to the target system to recover the export data. Therefore, the problem-solving data is determined and exported, the exported data volume is small, the problem-solving data can be exported, uploaded and restored quickly, the consumed time is reduced, and the problem of a user can be solved quickly. The process of recovering and exporting data can select the test environment recovery of the uploaded target system, can also select the test environment recovery of the user source system, and can be selected according to actual needs.
In the description herein, the description of the terms "one embodiment," "some embodiments," "specific embodiments," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (14)

1. A method for exporting service data, comprising:
determining a document to be processed according to a problem document of a source system;
determining business data to be exported according to the metadata of the document to be processed;
exporting the business data to be exported from the source system to generate export data;
uploading the export data to a target system to recover the export data;
the process of determining business data to be exported through the metadata of the document to be processed comprises the following steps:
judging whether the file quoted by the document to be processed has a quoted file or not;
and if the document quoted by the document to be processed does not have the quoted document, directly determining the business data of the document quoted by the document to be processed as the business data to be exported.
2. The method for exporting business data according to claim 1, wherein the process of determining the document to be processed according to the question document of the source system specifically comprises:
acquiring the problem bill and the upstream and downstream relation information of the problem bill according to the business flow of the problem bill;
acquiring a process having an upstream-downstream relationship with the service flow according to the upstream-downstream relationship information;
and determining the problem bill and the bill in the flow as the bill to be processed.
3. The method for exporting business data according to claim 1, wherein the process of determining business data to be exported according to the metadata of the document to be processed further comprises:
and if the file quoted by the to-be-processed document has the quoted file, inquiring the file quoted by the quoted file until the file quoted by the quoted file does not quote other files, and determining the service data of the file quoted by the to-be-processed document and the service data of the file quoted by the quoted file as the service data to be exported.
4. The method of exporting traffic data according to claim 1, wherein before uploading said exported data to a target system to recover said exported data, further comprising:
and carrying out encrypted backup on the export data.
5. The method for exporting business data according to claim 1, wherein uploading the exported data to a target system to recover the exported data comprises:
compressing the export data to generate compressed data;
uploading the compressed data to a test environment of the target system and recovering the compressed data.
6. The method for deriving traffic data according to any of claims 1 to 5, further comprising:
and carrying out anti-theft processing on the recovered export data.
7. A system for exporting service data, comprising:
the first determining unit is used for determining the bill to be processed according to the problem bill of the source system;
the second determining unit is used for determining business data to be exported according to the metadata of the bill to be processed;
a derivation unit, configured to derive the traffic data to be derived from the source system to generate derived data;
a recovery unit, configured to upload the export data to a target system to recover the export data;
the second determining unit specifically includes:
the query unit is used for querying the file quoted by the to-be-processed document through the metadata of the to-be-processed document;
the judging unit is used for judging whether the file quoted by the document to be processed has a quoted file or not;
and the second determining subunit is configured to, if the document referred by the to-be-processed document does not have the referred document, directly determine the service data of the document referred by the to-be-processed document as the service data to be exported.
8. The system for deriving service data according to claim 7, wherein the first determining unit specifically includes:
the first obtaining subunit is used for obtaining the question bill and the upstream and downstream relation information of the question bill according to the business flow of the question bill;
a second obtaining subunit, configured to obtain, according to the upstream and downstream relationship information, a process having an upstream and downstream relationship with the service flow;
and the first determining subunit is used for determining the question bill and the bill in the flow as the bill to be processed.
9. The system for deriving service data according to claim 7, wherein the second determining unit further comprises:
and the third determining subunit is configured to, if the file referenced by the to-be-processed document has the referenced file, query the file referenced by the referenced file until the file referenced by the referenced file no longer references other files, and determine the service data of the file referenced by the to-be-processed document and the service data of the file referenced by the referenced file as the service data to be exported.
10. The system for exporting traffic data according to claim 7, further comprising:
and the backup unit is used for carrying out encryption backup on the export data.
11. The system for deriving service data according to claim 7, wherein the recovery unit specifically includes:
the compression unit is used for compressing the export data to generate compressed data;
and the uploading unit is used for uploading the compressed data to the test environment of the target system and recovering the compressed data.
12. The system for deriving traffic data according to any of claims 7 to 11, further comprising:
and the anti-theft unit is used for carrying out anti-theft processing on the recovered export data.
13. A computer arrangement comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the method of deriving traffic data according to any of claims 1 to 6 when executing the computer program.
14. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of deriving traffic data according to any of claims 1 to 6.
CN201710979033.9A 2017-10-19 2017-10-19 Method, system, computer device and readable storage medium for exporting business data Active CN107885617B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710979033.9A CN107885617B (en) 2017-10-19 2017-10-19 Method, system, computer device and readable storage medium for exporting business data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710979033.9A CN107885617B (en) 2017-10-19 2017-10-19 Method, system, computer device and readable storage medium for exporting business data

Publications (2)

Publication Number Publication Date
CN107885617A CN107885617A (en) 2018-04-06
CN107885617B true CN107885617B (en) 2021-05-11

Family

ID=61781997

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710979033.9A Active CN107885617B (en) 2017-10-19 2017-10-19 Method, system, computer device and readable storage medium for exporting business data

Country Status (1)

Country Link
CN (1) CN107885617B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109636556B (en) * 2018-12-07 2023-01-10 用友网络科技股份有限公司 Bill recommendation method and system and computer-readable storage medium
CN112232755A (en) * 2020-09-16 2021-01-15 金蝶软件(中国)有限公司 Receipt processing method and device, computer equipment and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105335250A (en) * 2014-07-28 2016-02-17 浙江大华技术股份有限公司 Distributed file system-based data recovery method and device
CN105573859A (en) * 2014-10-15 2016-05-11 中兴通讯股份有限公司 Data recovery method and device of database
CN106547643A (en) * 2015-09-21 2017-03-29 阿里巴巴集团控股有限公司 The restoration methods and device of abnormal data

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6910111B1 (en) * 2002-12-20 2005-06-21 Veritas Operating Corporation Volume restoration using an accumulator map
CN101714107A (en) * 2009-10-23 2010-05-26 金蝶软件(中国)有限公司 Database backup and recovery method and device in ERP system
CN102236672B (en) * 2010-05-06 2016-08-24 深圳市腾讯计算机系统有限公司 A kind of data lead-in method and device
US20160232478A1 (en) * 2015-02-10 2016-08-11 International Business Machines Corporation Using source data to predict and detect software deployment and shelfware
CN107193871B (en) * 2017-04-12 2018-10-16 腾讯科技(深圳)有限公司 Database recovering method and device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105335250A (en) * 2014-07-28 2016-02-17 浙江大华技术股份有限公司 Distributed file system-based data recovery method and device
CN105573859A (en) * 2014-10-15 2016-05-11 中兴通讯股份有限公司 Data recovery method and device of database
CN106547643A (en) * 2015-09-21 2017-03-29 阿里巴巴集团控股有限公司 The restoration methods and device of abnormal data

Also Published As

Publication number Publication date
CN107885617A (en) 2018-04-06

Similar Documents

Publication Publication Date Title
US9098432B1 (en) System and method for data deduplication of backup images
CN109597717B (en) Data backup and recovery method and device, electronic equipment and storage medium
US20120011101A1 (en) Integrating client and server deduplication systems
US9841898B2 (en) Subsegmenting for efficient storage, resemblance determination, and transmission
US7478113B1 (en) Boundaries
US9952936B2 (en) Storage system and method of controlling storage system
US20120303595A1 (en) Data restoration method for data de-duplication
CN112261038B (en) Big data acquisition method and system, computer equipment and storage medium thereof
CN112286728A (en) Data backup method, device, equipment and computer storage medium
CN104572340A (en) Incremental backup system and method
CN103095843A (en) Method and client of data backup based on version vectors
CN105302675A (en) Method and device for data backup
CN107885617B (en) Method, system, computer device and readable storage medium for exporting business data
US10795860B1 (en) WAN optimized micro-service based deduplication
CN111078464A (en) Method, device and system for backing up data
CN113064760B (en) Database synthesis backup method and device, computer equipment and storage medium
CN116560914B (en) Incremental backup method, system and storage medium under virtual machine CBT failure
CN103838645B (en) Remote difference synthesis backup method based on Hash
CN112380067A (en) Metadata-based big data backup system and method under Hadoop environment
US8255367B2 (en) File management apparatus, method, and program
CN102082791A (en) Data backup implementation method, client, server and system
Du et al. Deduplicated disk image evidence acquisition and forensically-sound reconstruction
CN112395266B (en) Data file processing method, first server and computer storage medium
CN110569172B (en) Performance monitoring system of service level
CN112765279A (en) Database synchronization method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant