CN113486020A - Source switching method of basic data platform, related device and computer storage medium - Google Patents
Source switching method of basic data platform, related device and computer storage medium Download PDFInfo
- Publication number
- CN113486020A CN113486020A CN202110850015.7A CN202110850015A CN113486020A CN 113486020 A CN113486020 A CN 113486020A CN 202110850015 A CN202110850015 A CN 202110850015A CN 113486020 A CN113486020 A CN 113486020A
- Authority
- CN
- China
- Prior art keywords
- source
- data
- cutting
- layer data
- report
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 79
- 238000013499 data model Methods 0.000 claims abstract description 43
- 238000012545 processing Methods 0.000 claims abstract description 42
- 238000012795 verification Methods 0.000 claims description 52
- 238000004590 computer program Methods 0.000 claims description 7
- 230000003213 activating effect Effects 0.000 claims description 4
- 230000004913 activation Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 238000013506 data mapping Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application provides a source switching method of a basic data platform, a related device and a computer storage medium, wherein the method comprises the following steps: firstly, acquiring basic layer data of a basic data platform; then, processing the basic layer data of the basic data platform into a middle layer data model of a target system according to a preset storage mode to obtain source-cut middle layer data; judging whether the intermediate layer data after source cutting is different from the intermediate layer data before source cutting; if the difference exists between the intermediate layer data after source cutting and the intermediate layer data before source cutting, determining the reason of the difference; correcting the intermediate layer data subjected to source cutting according to a solving mode corresponding to the reason to obtain corrected intermediate layer data; and finally, processing the corrected intermediate layer data into an application layer data model to obtain a first tangent source report. Therefore, the purpose of helping each data mart to quickly and effectively complete the data source cutting work is achieved.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a source switching method for a basic data platform, a related apparatus, and a computer storage medium.
Background
Source-cutting means receiving data from an original system and receiving data from another system instead.
In order to unify data sources of a main data mart, cleaned and integrated data needs to be uniformly acquired from a basic data platform, so that the working target of outputting the same source is realized.
At present, a method special for source cutting does not exist, and the existing source cutting workflow is complex.
Disclosure of Invention
In view of the above, the present application provides a source switching method for a basic data platform, a related apparatus and a computer storage medium.
The first aspect of the present application provides a method for helping each data mart to quickly and effectively complete data source switching work source for a basic data platform, including:
acquiring basic layer data of a basic data platform;
processing the basic layer data of the basic data platform into a middle layer data model of a target system according to a preset storage mode to obtain source-cut middle layer data;
judging whether the intermediate layer data after source cutting is different from the intermediate layer data before source cutting;
if the difference exists between the intermediate layer data after source cutting and the intermediate layer data before source cutting, determining the reason of the difference;
correcting the intermediate layer data subjected to source cutting according to a solving mode corresponding to the reason to obtain corrected intermediate layer data;
and processing the corrected intermediate layer data into an application layer data model to obtain a first tangent source report.
Optionally, the source switching method of the basic data platform further includes:
and if the data of the middle layer after source cutting is judged to be not different from the data of the middle layer before source cutting, processing the data of the middle layer after source cutting into an application layer data model to obtain a second source cutting report.
Optionally, in another embodiment of the present application, after the processing the modified intermediate layer data into the application layer data model to obtain the first tangent source report, the method further includes:
receiving a first verification result; the first verification result shows whether the data in the first tangent source report is wrong or not;
if the first verification result shows that the data in the first source-cutting report is wrong, returning to execute the step of judging whether the data of the middle layer after source cutting is different from the data of the middle layer before source cutting;
and if the first verification result shows that the data in the first source-cutting report is correct, ending the current source cutting.
Optionally, in another embodiment of the present application, if it is determined that the source-cut intermediate layer data is not different from the intermediate layer data before source cutting, processing the source-cut intermediate layer data into an application layer data model to obtain a second source-cut report, further including:
receiving a second verification result; the second verification result shows whether the data in the second source cutting report is wrong or not;
if the second verification result shows that the data in the second source cutting report is wrong, returning to execute the step of judging whether the data of the middle layer after the source cutting and the data of the middle layer before the source cutting are different;
and if the second verification result shows that the data in the second source cutting report is correct, ending the current source cutting.
A second aspect of the present application provides a source switching device of a basic data platform, including:
the acquisition unit is used for acquiring the basic layer data of the basic data platform;
the first processing unit is used for processing the basic layer data of the basic data platform into an intermediate layer data model of a target system according to a preset storage mode to obtain source-cut intermediate layer data;
the judging unit is used for judging whether the intermediate layer data after source cutting is different from the intermediate layer data before source cutting;
a determining unit, configured to determine a reason for the difference if the determining unit determines that the data of the middle layer after source cutting is different from the data of the middle layer before source cutting;
a correcting unit, configured to correct the source-cut intermediate layer data according to a solution corresponding to the reason, so as to obtain corrected intermediate layer data;
and the second processing unit is used for processing the corrected intermediate layer data into the application layer data model to obtain a first tangent source report.
Optionally, the source switching device of the basic data platform further includes:
and the second processing unit is further configured to process the source-cut intermediate layer data into an application layer data model to obtain a second source-cut report if the judgment unit judges that the source-cut intermediate layer data is not different from the intermediate layer data before the source-cut.
Optionally, the source switching device of the basic data platform further includes:
a first receiving unit configured to receive a first verification result; the first verification result shows whether the data in the first tangent source report is wrong or not;
a first activation unit, configured to activate the determination unit to perform the determination on whether the data in the source-cut intermediate layer is different from the data in the non-source-cut intermediate layer if the first verification result indicates that the data in the first source-cut report is incorrect;
and the first ending unit is used for ending the current source cutting if the first verification result shows that the data in the first source cutting report is correct.
Optionally, the source switching device of the basic data platform further includes:
a second receiving unit configured to receive a second verification result; the second verification result shows whether the data in the second source cutting report is wrong or not;
the second activation unit is used for activating the judgment unit to judge whether the data of the middle layer after source cutting is different from the data of the middle layer before source cutting if the second verification result shows that the data of the second source cutting report is wrong;
and the second ending unit is used for ending the current source cutting if the second verification result shows that the data in the second source cutting report is correct.
A third aspect of the present application provides an electronic device comprising:
one or more processors;
a storage device having one or more programs stored thereon;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of source-cutting of an underlying data platform of any of the first aspects.
A fourth aspect of the present application provides a computer storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method of source switching of an underlying data platform according to any one of the first aspects.
In view of the foregoing, in the basic data platform source cutting method, the related apparatus, and the computer storage medium provided in the present application, the basic data platform source cutting method includes: firstly, acquiring basic layer data of a basic data platform; then, processing the basic layer data of the basic data platform into a middle layer data model of a target system according to a preset storage mode to obtain source-cut middle layer data; judging whether the intermediate layer data after source cutting is different from the intermediate layer data before source cutting; if the difference exists between the intermediate layer data after source cutting and the intermediate layer data before source cutting, determining the reason of the difference; correcting the intermediate layer data subjected to source cutting according to a solving mode corresponding to the reason to obtain corrected intermediate layer data; and finally, processing the corrected intermediate layer data into an application layer data model to obtain a first tangent source report. Therefore, the purpose of helping each data mart to quickly and effectively complete the data source cutting work is achieved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a detailed flowchart of a source switching method of a basic data platform according to an embodiment of the present disclosure;
fig. 2 is a detailed flowchart of a source-switching method of an underlying data platform according to another embodiment of the present application;
fig. 3 is a schematic diagram of a source cutting apparatus of an underlying data platform according to another embodiment of the present application;
fig. 4 is a schematic diagram of a source cutting apparatus of an underlying data platform according to another embodiment of the present application;
fig. 5 is a schematic view of an electronic device implementing a source switching method of an underlying data platform according to another embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first", "second", and the like, referred to in this application, are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence of functions performed by these devices, modules or units, but the terms "include", or any other variation thereof are intended to cover a non-exclusive inclusion, so that a process, method, article, or apparatus that includes a series of elements includes not only those elements but also other elements that are not explicitly listed, or includes elements inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The embodiment of the application provides a source switching method for a basic data platform, which specifically comprises the following steps as shown in fig. 1:
s101, obtaining basic layer data of a basic data platform.
Specifically, the base layer data of the base data platform may be obtained by, but not limited to, subscribing in the base data platform, which is not limited herein.
S102, processing the basic layer data of the source-cutting report basic data platform into a middle layer data model of a target system according to a preset storage mode to obtain source-cut middle layer data.
The middle layer data model stores the latest full data. And the preset storage mode, namely the storage process when the base layer data is processed, is used for cumulatively updating the data into the intermediate layer data model.
S103, judging whether the intermediate layer data after source cutting of the source cutting report is different from the intermediate layer data before source cutting.
Specifically, if it is determined that the data of the middle layer after the source cutting of the source cutting report is different from the data of the middle layer before the source cutting, step S104 is executed. If it is determined that the intermediate layer data after the source cutting of the source cutting report is not different from the intermediate layer data before the source cutting, step S107 is executed.
And S104, determining the reason of the source-cutting report difference.
Specifically, according to the current existing difference, the problem that the basic layer data of the source-cutting report basic data platform is processed into the intermediate layer data model of the target system according to a preset storage mode and is rewritten or the problem of data mapping in the basic data platform is determined.
And S105, correcting the middle layer data after the source cutting of the source cutting report according to a solution mode corresponding to the source cutting report reason to obtain the corrected middle layer data.
If the basic layer data of the source-cutting report basic data platform is processed into a middle layer data model of the target system according to a preset storage mode, rewriting and correcting the program logic problem after source cutting; and if the data mapping problem in the basic data platform exists, the data mapping method assists the upstream to correct the data quality problem.
And S106, processing the corrected intermediate layer data into an application layer data model to obtain a first tangent source report.
The application layer data model, also called a fact table, is a model for generating a report.
And S107, processing the source-cutting report source-cutting intermediate layer data into an application layer data model to obtain a second source-cutting report.
According to the scheme, the source cutting method of the basic data platform comprises the following steps: firstly, acquiring basic layer data of a basic data platform; then, processing the basic layer data of the source-cutting report basic data platform into an intermediate layer data model of a target system according to a preset storage mode to obtain source-cut intermediate layer data; judging whether the data of the intermediate layer after source cutting of the source report is different from the data of the intermediate layer before source cutting; if the data of the middle layer after the source cutting of the source cutting report is judged to be different from the data of the middle layer before the source cutting, determining the reason of the source cutting report difference; correcting the data of the middle layer after the source cutting of the source cutting report according to a solution mode corresponding to the source cutting report reason to obtain corrected data of the middle layer; finally, processing the corrected intermediate layer data into an application layer data model to obtain a first tangent source report; and if the data of the middle layer after the source cutting of the source report is judged to be not different from the data of the middle layer before the source cutting, directly processing the data of the middle layer after the source cutting of the source report into an application layer data model to obtain a second source cutting report. Therefore, the purpose of helping each data mart to quickly and effectively complete the data source cutting work is achieved.
Optionally, in another embodiment of the present application, an implementation of the source-cutting method of the basic data platform, as shown in fig. 2, includes:
s201, obtaining basic layer data of a basic data platform.
It should be noted that the specific implementation process of step S201 is the same as the specific implementation process of step S101, and reference may be made to this.
S202, processing the basic layer data of the source-cutting report basic data platform into an intermediate layer data model of the target system according to a preset storage mode to obtain source-cut intermediate layer data.
It should be noted that the specific implementation process of step S202 is the same as the specific implementation process of step S201, and reference may be made to this.
S203, judging whether the data of the middle layer after source cutting of the source cutting report is different from the data of the middle layer before source cutting.
Specifically, if it is determined that the data of the middle layer after the source cutting of the source cutting report is different from the data of the middle layer before the source cutting, step S204 is executed. If it is determined that the data of the middle layer after source cutting of the source-cut report is not different from the data of the middle layer before source cutting, step S207 is executed.
It should be noted that the specific implementation process of step S203 is the same as the specific implementation process of step S103, and can be referred to each other.
And S204, determining the reason of the source-cutting report form difference.
It should be noted that the specific implementation process of step S204 is the same as the specific implementation process of step S104, and reference may be made to this process.
S205, according to the solution mode corresponding to the source cutting report form reason, correcting the middle layer data after the source cutting report form is cut to obtain the corrected middle layer data.
It should be noted that the specific implementation process of step S205 is the same as the specific implementation process of step S105, and reference may be made to this.
And S206, processing the corrected intermediate layer data into an application layer data model to obtain a first tangent source report.
It should be noted that the specific implementation process of step S206 is the same as the specific implementation process of step S106, and reference may be made to this process.
S208, receiving a first verification result.
The first verification result of the source-cutting report indicates whether the data in the first source-cutting report of the source-cutting report is wrong.
Specifically, if the first verification result of the source-cutting report indicates that the data in the first source-cutting report of the source-cutting report is incorrect, the step S203 is executed again; if the first verification result of the source-cutting report indicates that the data in the first source-cutting report of the source-cutting report is correct, step S210 is executed.
And S210, ending the current source switching.
And S207, processing the source-cutting report source-cutting intermediate layer data into an application layer data model to obtain a second source-cutting report.
It should be further noted that the specific implementation process of step S207 is the same as the specific implementation process of step S107, and reference may be made to this.
S209, receiving a second verification result.
And the second verification result of the source-cutting report shows whether the data in the second source-cutting report of the source-cutting report is wrong or not.
Specifically, if the second verification result of the source-cutting report indicates that the data in the second source-cutting report of the source-cutting report is incorrect, the step S203 is executed again; if the second verification result of the source-cutting report indicates that the data in the second source-cutting report of the source-cutting report is correct, step S210 is executed.
According to the scheme, the source cutting method of the basic data platform comprises the following steps: and after the first source-cutting report form or the second source-cutting report form is obtained, correcting and perfecting the first source-cutting report form or the second source-cutting report form through the first verification result or the second verification result fed back by the service end or the service department. Therefore, the purpose of helping each data mart to quickly and effectively complete the data source cutting work is achieved.
The embodiment of the present application provides a source switching device for a basic data platform, as shown in fig. 3, specifically including:
an obtaining unit 301, configured to obtain base layer data of a base data platform.
The first processing unit 302 is configured to process the base layer data of the source-cut report base data platform into the middle layer data model of the target system according to a preset storage manner, so as to obtain source-cut middle layer data.
The judging unit 303 is configured to judge whether the intermediate layer data after source cutting of the source report is different from the intermediate layer data before source cutting.
A determining unit 304, configured to determine a reason for the source-cutting report difference if the source-cutting report judging unit 303 judges that the intermediate layer data after the source cutting of the source-cutting report is different from the intermediate layer data before the source cutting.
And a correcting unit 305, configured to correct the intermediate layer data after the source cutting of the source cutting report according to the solution corresponding to the source cutting report reason, so as to obtain the corrected intermediate layer data.
And a second processing unit 306, configured to process the corrected intermediate layer data into an application layer data model to obtain a first tangent source report.
For a specific working process of the unit disclosed in the above embodiment of the present application, reference may be made to the content of the corresponding method embodiment, as shown in fig. 1, which is not described herein again.
Optionally, in another embodiment of the present application, an implementation manner of the source cutting apparatus of the basic data platform further includes:
and the second processing unit is further configured to, if the source-cutting report judgment unit 303 judges that the data of the middle layer after the source cutting of the source-cutting report is not different from the data of the middle layer before the source cutting, process the data of the middle layer after the source cutting of the source-cutting report into the data model of the application layer to obtain a second source-cutting report.
For a specific working process of the unit disclosed in the above embodiment of the present application, reference may be made to the content of the corresponding method embodiment, as shown in fig. 1, which is not described herein again.
According to the above scheme, the source switching device of the basic data platform provided by the application comprises: first, the obtaining unit 301 obtains the basic layer data of the basic data platform; then, the first processing unit 302 processes the base layer data of the source-cutting report base data platform into the intermediate layer data model of the target system according to a preset storage mode to obtain source-cut intermediate layer data; the judging unit 303 judges whether the data of the intermediate layer after source cutting of the source report is different from the data of the intermediate layer before source cutting; if the judging unit 303 judges that the data of the intermediate layer after source cutting of the source report is different from the data of the intermediate layer before source cutting, the determining unit 304 determines the reason for the difference of the source cutting report; the correcting unit 305 corrects the intermediate layer data after the source cutting of the source cutting report according to the solution mode corresponding to the source cutting report reason to obtain the corrected intermediate layer data; finally, the second processing unit 306 processes the corrected intermediate layer data into an application layer data model to obtain a first tangent source report; if the determining unit 303 determines that the data of the middle layer after source cutting of the source cutting report is not different from the data of the middle layer before source cutting, the second processing unit 306 directly processes the data of the middle layer after source cutting of the source cutting report into the data model of the application layer to obtain a second source cutting report. Therefore, the purpose of helping each data mart to quickly and effectively complete the data source cutting work is achieved.
Optionally, in another embodiment of the present application, an implementation of the source cutting apparatus of the basic data platform, as shown in fig. 4, includes:
an obtaining unit 401 is configured to obtain base layer data of a base data platform.
A first processing unit 402, configured to process the base layer data of the source-cut report base data platform into the middle layer data model of the target system according to a preset storage manner, so as to obtain source-cut middle layer data.
The determining unit 403 is configured to determine whether the intermediate layer data after source cutting of the source report is different from the intermediate layer data before source cutting.
A determining unit 404, configured to determine a reason for the source-cutting report difference if the source-cutting report judging unit 403 judges that the intermediate layer data after the source cutting of the source-cutting report is different from the intermediate layer data before the source cutting.
And a correcting unit 405, configured to correct the intermediate layer data after the source cutting report is source cut according to the solution mode corresponding to the source cutting report reason, so as to obtain the corrected intermediate layer data.
And a second processing unit 406, configured to process the corrected intermediate layer data into an application layer data model to obtain a first tangent source report.
A first receiving unit 407, configured to receive the first verification result.
The first verification result of the source-cutting report indicates whether the data in the first source-cutting report of the source-cutting report is wrong.
A first activating unit 408, if the first verification result of the source cutting report indicates that the data in the first source cutting report of the source cutting report is incorrect, the source cutting report judging unit 403 is activated to execute the source cutting report to judge whether the data of the middle layer after the source cutting of the source cutting report is different from the data of the middle layer before the source cutting;
the first ending unit 409 is configured to end the current source cutting if the first verification result of the source cutting report indicates that the data in the first source cutting report of the source cutting report is correct.
For a specific working process of the unit disclosed in the above embodiment of the present application, reference may be made to the content of the corresponding method embodiment, as shown in fig. 2, which is not described herein again.
Optionally, in another embodiment of the present application, an implementation manner of the source cutting apparatus of the basic data platform includes:
the second processing unit 406 is further configured to, if the source-cutting report determining unit 403 determines that there is no difference between the data of the middle layer after the source cutting of the source-cutting report and the data of the middle layer before the source cutting, process the data of the middle layer after the source cutting of the source-cutting report into the data model of the application layer to obtain a second source-cutting report.
For a specific working process of the unit disclosed in the above embodiment of the present application, reference may be made to the content of the corresponding method embodiment, as shown in fig. 2, which is not described herein again.
Optionally, in another embodiment of the present application, an implementation manner of the source cutting apparatus of the basic data platform includes:
and the second receiving unit is used for receiving a second verification result.
And the second verification result of the source-cutting report shows whether the data in the second source-cutting report of the source-cutting report is wrong or not.
A second activating unit, configured to, if the second verification result of the source cutting report indicates that data in the second source cutting report of the source cutting report is incorrect, execute the source cutting report judgment unit 403 to judge whether the intermediate layer data after the source cutting of the source cutting report is different from the intermediate layer data before the source cutting of the source cutting report.
And the second ending unit is used for ending the current source cutting if the second verification result of the source cutting report shows that the data in the second source cutting report of the source cutting report is correct.
For a specific working process of the unit disclosed in the above embodiment of the present application, reference may be made to the content of the corresponding method embodiment, as shown in fig. 2, which is not described herein again.
According to the above scheme, the source switching device of the basic data platform provided by the application comprises: and after the first source-cutting report form or the second source-cutting report form is obtained, correcting and perfecting the first source-cutting report form or the second source-cutting report form through the first verification result or the second verification result fed back by the service end or the service department. Therefore, the purpose of helping each data mart to quickly and effectively complete the data source cutting work is achieved.
Another embodiment of the present application provides an electronic device, as shown in fig. 5, including:
one or more processors 501.
A storage device 502 on which one or more programs are stored.
The one or more programs, when executed by the one or more processors 501, cause the one or more processors 501 to implement the source-cut method of the underlying data platform as described in any of the above embodiments.
Another embodiment of the present application provides a computer storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method for source switching of an underlying data platform as described in any one of the above embodiments.
In the above embodiments disclosed in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The apparatus and method embodiments described above are illustrative only, as the flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in the embodiments of the present disclosure may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part. The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a live broadcast device, or a network device) to execute all or part of the steps of the method according to the embodiments of the present disclosure. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Those skilled in the art can make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A source switching method of a basic data platform is characterized by comprising the following steps:
acquiring basic layer data of a basic data platform;
processing the basic layer data of the basic data platform into a middle layer data model of a target system according to a preset storage mode to obtain source-cut middle layer data;
judging whether the intermediate layer data after source cutting is different from the intermediate layer data before source cutting;
if the difference exists between the intermediate layer data after source cutting and the intermediate layer data before source cutting, determining the reason of the difference;
correcting the intermediate layer data subjected to source cutting according to a solving mode corresponding to the reason to obtain corrected intermediate layer data;
and processing the corrected intermediate layer data into an application layer data model to obtain a first tangent source report.
2. The source cutting method according to claim 1, further comprising:
and if the data of the middle layer after source cutting is judged to be not different from the data of the middle layer before source cutting, processing the data of the middle layer after source cutting into an application layer data model to obtain a second source cutting report.
3. The source cutting method according to claim 1, wherein the processing the modified intermediate layer data into the application layer data model to obtain a first source cutting report further comprises:
receiving a first verification result; the first verification result shows whether the data in the first tangent source report is wrong or not;
if the first verification result shows that the data in the first source-cutting report is wrong, returning to execute the step of judging whether the data of the middle layer after source cutting is different from the data of the middle layer before source cutting;
and if the first verification result shows that the data in the first source-cutting report is correct, ending the current source cutting.
4. The method according to claim 2, wherein if it is determined that the intermediate layer data after source cutting is not different from the intermediate layer data before source cutting, the method further comprises, after processing the intermediate layer data after source cutting into an application layer data model to obtain a second source cutting report:
receiving a second verification result; the second verification result shows whether the data in the second source cutting report is wrong or not;
if the second verification result shows that the data in the second source cutting report is wrong, returning to execute the step of judging whether the data of the middle layer after the source cutting and the data of the middle layer before the source cutting are different;
and if the second verification result shows that the data in the second source cutting report is correct, ending the current source cutting.
5. A source switching device of an underlying data platform, comprising:
the acquisition unit is used for acquiring the basic layer data of the basic data platform;
the first processing unit is used for processing the basic layer data of the basic data platform into an intermediate layer data model of a target system according to a preset storage mode to obtain source-cut intermediate layer data;
the judging unit is used for judging whether the intermediate layer data after source cutting is different from the intermediate layer data before source cutting;
a determining unit, configured to determine a reason for the difference if the determining unit determines that the data of the middle layer after source cutting is different from the data of the middle layer before source cutting;
a correcting unit, configured to correct the source-cut intermediate layer data according to a solution corresponding to the reason, so as to obtain corrected intermediate layer data;
and the second processing unit is used for processing the corrected intermediate layer data into the application layer data model to obtain a first tangent source report.
6. The source cutting device of claim 5, further comprising:
and the second processing unit is further configured to process the source-cut intermediate layer data into an application layer data model to obtain a second source-cut report if the judgment unit judges that the source-cut intermediate layer data is not different from the intermediate layer data before the source-cut.
7. The source cutting device of claim 5, further comprising:
a first receiving unit configured to receive a first verification result; the first verification result shows whether the data in the first tangent source report is wrong or not;
a first activation unit, configured to activate the determination unit to perform the determination on whether the data in the source-cut intermediate layer is different from the data in the non-source-cut intermediate layer if the first verification result indicates that the data in the first source-cut report is incorrect;
and the first ending unit is used for ending the current source cutting if the first verification result shows that the data in the first source cutting report is correct.
8. The source cutting device of claim 6, further comprising:
a second receiving unit configured to receive a second verification result; the second verification result shows whether the data in the second source cutting report is wrong or not;
the second activation unit is used for activating the judgment unit to judge whether the data of the middle layer after source cutting is different from the data of the middle layer before source cutting if the second verification result shows that the data of the second source cutting report is wrong;
and the second ending unit is used for ending the current source cutting if the second verification result shows that the data in the second source cutting report is correct.
9. An electronic device, comprising:
one or more processors;
a storage device having one or more programs stored thereon;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of source-cut of the underlying data platform of any of claims 1-4.
10. A computer storage medium, having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method of source switching of an underlying data platform as claimed in any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110850015.7A CN113486020B (en) | 2021-07-27 | 2021-07-27 | Source cutting method of basic data platform, related device and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110850015.7A CN113486020B (en) | 2021-07-27 | 2021-07-27 | Source cutting method of basic data platform, related device and computer storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113486020A true CN113486020A (en) | 2021-10-08 |
| CN113486020B CN113486020B (en) | 2024-02-23 |
Family
ID=77944001
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110850015.7A Active CN113486020B (en) | 2021-07-27 | 2021-07-27 | Source cutting method of basic data platform, related device and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113486020B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105631004A (en) * | 2015-12-28 | 2016-06-01 | 华夏银行股份有限公司 | Data processing method and system |
| CN107197174A (en) * | 2017-05-12 | 2017-09-22 | 西安诺瓦电子科技有限公司 | Video controller and video control method |
| CN108702660A (en) * | 2016-05-11 | 2018-10-23 | Oppo广东移动通信有限公司 | Communication means, terminal device and the network equipment |
| CN110489406A (en) * | 2019-07-29 | 2019-11-22 | 天闻数媒科技（湖南）有限公司 | A kind of basic data cleaning and synchronous method, apparatus and storage medium |
| CN111782251A (en) * | 2020-08-18 | 2020-10-16 | 广联达科技股份有限公司 | Software function module updating method and device and computer equipment |
-
2021
- 2021-07-27 CN CN202110850015.7A patent/CN113486020B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105631004A (en) * | 2015-12-28 | 2016-06-01 | 华夏银行股份有限公司 | Data processing method and system |
| CN108702660A (en) * | 2016-05-11 | 2018-10-23 | Oppo广东移动通信有限公司 | Communication means, terminal device and the network equipment |
| CN107197174A (en) * | 2017-05-12 | 2017-09-22 | 西安诺瓦电子科技有限公司 | Video controller and video control method |
| CN110489406A (en) * | 2019-07-29 | 2019-11-22 | 天闻数媒科技（湖南）有限公司 | A kind of basic data cleaning and synchronous method, apparatus and storage medium |
| CN111782251A (en) * | 2020-08-18 | 2020-10-16 | 广联达科技股份有限公司 | Software function module updating method and device and computer equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113486020B (en) | 2024-02-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111178815A (en) | Method and device for generating process instance template and computer readable storage medium | |
| CN111309506A (en) | Method, equipment, server and readable storage medium for positioning compiling errors | |
| CN110825705A (en) | Data set caching method and related device | |
| CN113760476A (en) | Task dependency processing method and related device | |
| CN113486020A (en) | Source switching method of basic data platform, related device and computer storage medium | |
| CN112114903A (en) | File loading method and device | |
| CN110968548A (en) | Data correction method, device, storage medium and processor | |
| CN114626683A (en) | Product update message notification method and device based on RPA and AI and electronic equipment | |
| CN108075876B (en) | Time calibration method, device and system | |
| CN102841987B (en) | Method and device for processing gene sequence data | |
| CN112130491B (en) | Device state control method and device, storage medium and electronic device | |
| CN106874029B (en) | Mirror image file loading method and device | |
| CN111090451A (en) | Service configuration method, device and storage medium | |
| CN110955450A (en) | Application package file attribution statistical method, system and storage medium | |
| CN112784318A (en) | Method, device and storage medium for generating unique identification code of equipment | |
| CN110517010B (en) | Data processing method, system and storage medium | |
| CN110069539B (en) | Data association method and system | |
| CN109710583B (en) | Method and device for automatically updating parameters in Simulink model | |
| CN113516403A (en) | Delivery flow monitoring method and device, server and computer storage medium | |
| CN112269600A (en) | BIOS hot key setting method and related equipment | |
| CN110795100A (en) | Branch merging method and device | |
| CN111176576A (en) | Metadata modification method, device, equipment and storage medium of storage volume | |
| CN110427211B (en) | Demonstration data calling method and device | |
| CN112671577B (en) | Terminal equipment upgrading method and device, network node and computer storage medium | |
| CN112486843A (en) | Data processing method and device, electronic equipment and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |