CN114281812A - Data storage method, device, equipment and medium - Google Patents

Data storage method, device, equipment and medium Download PDF

Info

Publication number
CN114281812A
CN114281812A CN202111607970.4A CN202111607970A CN114281812A CN 114281812 A CN114281812 A CN 114281812A CN 202111607970 A CN202111607970 A CN 202111607970A CN 114281812 A CN114281812 A CN 114281812A
Authority
CN
China
Prior art keywords
data
network equipment
condition
quality
checking
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111607970.4A
Other languages
Chinese (zh)
Inventor
瞿珂
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CCB Finetech Co Ltd
Original Assignee
CCB Finetech Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by CCB Finetech Co Ltd filed Critical CCB Finetech Co Ltd
Priority to CN202111607970.4A priority Critical patent/CN114281812A/en
Publication of CN114281812A publication Critical patent/CN114281812A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the application provides a data storage method, a data storage device, data storage equipment and a data storage medium. The method comprises the following steps: acquiring first data stored in a temporary area of the private network equipment under the condition that the first data meet a first preset condition; and performing quality inspection on the first data by using a Spark engine based on a preset inspection rule to generate a quality inspection report, and controlling the private network equipment to transfer the first data from a temporary area of the private network equipment to a formal area of the private network equipment under the condition that a data inspection result included in the quality inspection report meets a second preset condition, so that the database reads and stores the first data from the formal area of the private network equipment. According to the embodiment of the application, the efficiency of data inspection can be improved, and the pressure of the database can be effectively reduced.

Description

Data storage method, device, equipment and medium
Technical Field
The present application belongs to the field of computers, and in particular, to a data storage method, apparatus, device, and medium.
Background
In real life, financial institutions such as banks often involve massive data, and the data all need relevant supervision agencies to perform quality inspection so as to ensure the correctness of the data. However, in the prior art, the data is generally subjected to quality check after being stored in the database. However, since the amount of data involved is large and the data quality varies, repeated inspection of the data quality is likely to occur during the inspection process, which not only reduces the efficiency of data quality inspection, but also causes an excessive database pressure.
Disclosure of Invention
The embodiment of the application provides a data storage method, a data storage device, data storage equipment and a data storage medium, which can improve the data quality inspection efficiency and reduce the database pressure.
In a first aspect, an embodiment of the present application provides a data warehousing method, where the method includes: acquiring first data stored in a temporary area of the private network equipment under the condition that the first data meet a first preset condition;
performing quality check on the first data by using a Spark engine based on a preset checking rule to generate a quality check report,
and controlling the special network equipment to transfer the first data from the temporary area of the special network equipment to the formal area of the special network equipment so that the database reads and stores the first data from the formal area of the special network equipment under the condition that the data checking result included in the quality checking report meets a second preset condition.
In an optional implementation of the first aspect, the method further comprises:
and controlling the private network equipment to store the first data and the quality inspection report in a temporary area of the private network equipment under the condition that the data inspection result included in the quality inspection report does not meet a second preset condition, so that the first equipment acquires the first data and the quality inspection report from the temporary area of the private network equipment to correct the first data according to the quality inspection report.
In an alternative implementation manner of the first aspect, the first data stored in the temporary area of the private network device is data that is transmitted by the first device to the temporary area of the private network device through a file transfer protocol.
In an optional implementation manner of the first aspect, the first preset condition is that a data size of the first data is consistent with a data size that the dedicated network device parses from an extensible markup language XML file corresponding to the first data.
In an optional implementation manner of the first aspect, the preset checking rule includes that all data in the first data satisfy a first condition, and a preset proportion of data in the first data satisfy a second condition.
In an alternative embodiment of the first aspect, the preset checking rule is configured in the EXCEL table by using an automated generation tool.
In a second aspect, an embodiment of the present application provides a data warehousing device, where the device includes:
the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring first data under the condition that the first data stored in a temporary area of the special network equipment meets a first preset condition;
the quality inspection module is used for performing quality inspection on the first data by using a Spark engine based on a preset inspection rule to generate a quality inspection report;
and the unloading module is used for controlling the special network equipment to unload the first data from the temporary area of the special network equipment to the formal area of the special network equipment under the condition that the data checking result included in the quality checking report meets a second preset condition, so that the database reads and stores the first data from the formal area of the special network equipment.
In a third aspect, a data warehousing device is provided, including: a memory for storing computer program instructions; and a processor, configured to read and execute the computer program instructions stored in the memory, so as to execute the data warehousing method provided in any optional implementation manner of the first aspect and the second aspect.
In a fourth aspect, a computer storage medium is provided, on which computer program instructions are stored, which when executed by a processor implement the resource space method provided by any of the optional embodiments of the first and second aspects.
In a fifth aspect, a computer program product is provided, and when executed by a processor of an electronic device, instructions in the computer program product cause the electronic device to perform the data warehousing method provided in any optional implementation manner of the first and second aspects.
According to the data warehousing method, the data warehousing device, the data warehousing equipment and the medium, under the condition that first data stored in a temporary area of special network equipment meets a first preset condition, the first data are obtained, the quality of the first data is checked by a Spark engine based on a preset checking rule to generate a quality checking report, and under the condition that a data checking result included in the quality checking report meets a second preset condition, the special network equipment is controlled to transfer the first data originally stored in the temporary area of the special network equipment to a formal area of the special network equipment, so that a database can directly read and store the first data from the formal area of the special network equipment.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments of the present application will be briefly described below, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is an architecture diagram of a data warehousing method provided in an embodiment of the present application;
fig. 2 is a schematic flowchart of a data warehousing method according to an embodiment of the present application;
fig. 3 is a schematic flow chart of another data warehousing method provided in the embodiment of the present application;
fig. 4 is a schematic structural diagram of a data warehousing device according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a data warehousing device according to an embodiment of the present application.
Detailed Description
Features and exemplary embodiments of various aspects of the present application will be described in detail below, and in order to make objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are intended to be illustrative only and are not intended to be limiting. It will be apparent to one skilled in the art that the present application may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the present application by illustrating examples thereof.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone.
In order to solve the problem of excessive database pressure caused by uneven quality of data to be stored in a database in the prior art, embodiments of the present application provide a data storage method, apparatus, device and medium. The method mainly comprises the steps of acquiring first data under the condition that the first data stored in a temporary area of the special network equipment meets a first preset condition, carrying out quality inspection on the first data based on a preset inspection rule and a Spark engine to generate a quality inspection report, and controlling the special network equipment to transfer the first data originally stored in the temporary area of the special network equipment to a formal area of the special network equipment under the condition that a data inspection result included in the quality inspection report meets a second preset condition, so that the database can directly read and store the first data from the formal area of the special network equipment.
The following describes in detail a data entry method, an apparatus, a device, and a storage medium provided in the embodiments of the present application with specific embodiments in conjunction with the accompanying drawings.
It should be noted that the data entry method provided in the embodiment of the present application may be applied to the architecture shown in fig. 1, and is specifically described in detail with reference to fig. 1.
Fig. 1 is an architecture diagram of a data warehousing method according to an embodiment of the present application.
As shown in fig. 1, the architecture diagram may include a first device 10, a dedicated network device 20, an inspection device 30, and a database 40. Information interaction is carried out between the first device 10 and the special network device 20, between the special network device 20 and the checking device 30, and between the special network device 20 and the database 40, so that data warehousing is realized.
Based on the above-mentioned architecture, before storing the first data in the database, as shown in fig. 2, the first device sends the first data and an Extensible Markup Language (XML) file of the first data to the private network device by way of a file transfer protocol, stores the first data and the XML file of the first data in a temporary area of the private network device, further parses the XML file of the first data by the private network device, determines whether the first data is completely uploaded according to the size of the parsed data, and if the first data is completely uploaded, the checking device obtains the first data, performs a quality check on the first data by using a Spark engine based on a preset checking rule to generate a quality check report of the first data, so that when a data check result included in the quality check report is qualified, and controlling the private network equipment to transfer the first data from the temporary area of the private network equipment to the formal area of the private network equipment so that the database reads and stores the first data from the temporary area of the private network equipment. Therefore, the quality inspection of the data can be completed before the data is put into the database, the situation that the data is repeatedly inspected in the database is avoided, and the pressure of the database is reduced while the efficiency of data inspection is improved.
According to the above-mentioned architecture, the following describes in detail the data entry method provided in the embodiment of the present application with reference to fig. 3, where the embodiment of the present application takes an execution subject as an example of an inspection device, and the data entry method provided in the embodiment of the present application is described in detail.
Fig. 3 is a schematic flow chart of a data warehousing method according to an embodiment of the present application.
As shown in fig. 3, the data entry method may specifically include the following steps:
s110, when the first data stored in the temporary area of the private network device satisfies a first preset condition, obtaining the first data.
The dedicated network device is used for connecting the first device and the inspection device, the dedicated network device may be divided into a temporary area and a formal area, so as to store the relevant data according to the actual situation, and it should be noted that the first device and the inspection device may modify the data stored in the temporary area of the dedicated network device, but may not modify the data stored in the formal area of the dedicated network device. The first device may be a server or a terminal of an organization such as a bank, and the like, which may be related to mass data, and the checking device is configured to perform quality checking on the mass data related to the first device. The first data stored in the temporary area of the private network device is data that the first device transmits to the temporary area of the private network device through a file transfer protocol, and may be, for example, Examination and Analysis System Technology (EAST) data, deposit data, loan data, and the like related to a bank, which is not specifically limited herein. The file transfer protocol is a set of standard protocols for file transfer over a network, and allows a user to perform data transfer with an inspection device in the form of file operations, such as file addition, deletion, modification, and check. The first preset condition is that the data size of the first data is consistent with the data size obtained by analyzing the XML file corresponding to the first data by the special network equipment.
Specifically, when the data size of the first data stored in the temporary area of the private network device is consistent with the data size parsed by the private network device from the XML file corresponding to the first data, the inspection device may directly obtain the first data from the temporary area of the private network device. Therefore, the XML file corresponding to the first data can be analyzed to judge whether the first data is uploaded completely or not based on the first data transmitted to the temporary area of the private network in a standard reporting mode of a file transfer protocol, so that the problem of low reported data quality is solved to a certain extent, and the checking equipment can be ensured to acquire the complete first data so as to carry out quality checking.
And S120, performing quality inspection on the first data by using a Spark engine based on a preset inspection rule to generate a quality inspection report.
The preset checking rule is at least one rule which is preset based on actual experience and is used for checking whether the quality checking report of the data is qualified or not. The preset checking rule includes a first condition that all data in the first data satisfy, and a second condition that a preset proportion of data in the first data satisfy, where the first condition and the second condition are preset based on actual needs, and are not specifically limited herein. That is to say, the preset checking rules in the embodiment of the present application are divided into two types, where one type is a first condition that all data in the first data satisfy, that is, a mandatory condition. The other is the second data which is satisfied by the preset proportion of the data in the first data, namely the non-mandatory condition. In addition, it should be appreciated that the preset audit rules can be configured in the EXCEL table using an automated tool to quickly cope with the constant updating of the preset audit rules. Spark engine is a fast, general-purpose computing engine dedicated to large-scale data processing to improve the efficiency of data checking. The quality inspection report is a visual result report generated by inspecting the first data based on a preset inspection rule.
Specifically, after the checking device obtains the first data, the checking device performs quality check on the first data by using a Spark engine based on a first condition that all data in the first data included in a preset checking rule satisfy and a second condition that a preset proportion of data in the first data satisfy, so as to generate a quality check report of the first data. Therefore, the quality of the first data can be checked through the preset checking rule and the Spark engine, the data quality of the first data can be guaranteed, and the efficiency of data quality checking can be improved.
Additionally, in some embodiments, the pre-set audit report may include an internal data collision class. For example, uniqueness checks; class of data loss, e.g., non-null check, completeness check; violating the encoding specification class, such as date range check, time and date format check, special character check; violating a technical specification class, e.g., range code value check, numerical value check, length check; the business logic classes, such as, for example, a numerical comparison check, a score total check, etc., are not limited herein.
And S130, controlling the special network equipment to transfer the first data from the temporary area of the special network equipment to the formal area of the special network equipment so that the database reads and stores the first data from the formal area of the special network equipment when the data checking result included in the quality check report meets a second preset condition.
Wherein the second preset condition is a condition preset based on actual experience and used for judging whether the quality inspection report is qualified. In the embodiment of the present application, the second preset condition is set based on a preset checking rule. The data checking result is a result of quality checking of each data in the first data based on a preset checking rule.
Specifically, after the quality inspection report of the first data is generated, in a case where the inspection device determines that a data inspection result included in the quality inspection report satisfies a second preset condition, that is, when the quality inspection report of the first data is qualified, the inspection device may control, by means of a signal or an instruction, the dedicated network device to forward the temporary area of the dedicated network device to the formal area of the dedicated network device, so that the database may directly read and store the first data from the formal area of the dedicated network device. Therefore, the situation that the first data stored in the temporary area of the special network equipment is changed by the first equipment or the checking equipment to cause lower data quality is avoided, the accuracy of the data can be improved, and the pressure of the database is further relieved.
In one example, the preset check rule includes a first condition that the data date of the data is within 12/12 to 12/30, and a second condition that 90% of the data relates to the transaction amount higher than X dollars. If the data checking result included in the quality checking report generated by the checking device indicates that the data checking result of all data involved in the first data is within 12 th and 12 th numbers 12 and 30 th numbers, and the transaction amount of 90% of the data involved in the first data is higher than the X element, the data checking result involved in the quality checking report of the first data meets a second preset condition, and the private network device can be controlled to transfer the first data from the temporary area of the private network device to the formal area of the private network device, so that the database can directly read and store the first data from the formal area of the private network device. It should be noted that the first condition and the second condition mentioned above are only examples for describing the embodiments of the present application more clearly, and do not limit the substance of the first condition and the second condition.
According to the embodiment of the application, under the condition that the first data stored in the temporary area of the special network equipment meets the first preset condition, the first data is obtained, the quality inspection report is generated on the basis of the preset inspection rule and the Spark engine performs quality inspection on the first data, and under the condition that the data inspection result included in the quality inspection report meets the second preset condition, the special network equipment is controlled to transfer the first data originally stored in the temporary area of the special network equipment to the formal area of the special network equipment, so that the database can directly read and store the first data from the formal area of the special network equipment.
In order to more fully describe the data entry method provided in the embodiment of the present application, in an embodiment, the data entry method mentioned above may further include:
and in the case that the data checking result included in the quality checking report does not satisfy the second preset condition, storing the first data and the quality checking report in a temporary area of the private network equipment, so that the first equipment acquires the first data and the quality checking report from the temporary area of the private network equipment to correct the first data according to the quality checking report.
In this embodiment, in a case that the data check result of the quality check report of the first data does not satisfy the second preset condition, that is, the quality check report of the first data is not qualified, the inspection device may store the first data and the quality check report in the temporary area of the dedicated network device, so that the first device actively acquires the first data and the corresponding quality check report from the temporary area of the dedicated network device, and further corrects the first data according to the quality check report. Therefore, the checking result of the first data can be fed back to the first equipment, so that the problems and risks existing in the first data can be corrected in time, the risks are effectively reduced, the corrected first data can be continuously checked subsequently, the quality of the data put in a warehouse is guaranteed, and the pressure of the database can be effectively reduced.
In an embodiment, the first data and the check log of the first data may be stored in a temporary area of the dedicated network device when a data check result included in the quality check report does not satisfy a second preset condition, where the check log includes the quality check report of the first data and a check process, so that the first device can read the first data and the check log of the first data, correct the first data according to the check report of the first data, and facilitate to continue checking the corrected first data, so as to ensure quality of the data in the database, and further, pressure of the database can be effectively reduced.
Based on the same inventive concept, the embodiment of the application also provides a data storage device. The description will be made with reference to FIG. 4
Fig. 4 is a schematic structural diagram of a data warehousing device according to an embodiment of the present application.
As shown in fig. 4, the data warehousing device 400 may include: an acquisition module 410, a quality check module 420, and a control module 430.
An obtaining module 410, configured to obtain first data when the first data stored in the temporary area of the private network device meets a first preset condition;
the quality inspection module 420 is configured to perform quality inspection on the first data by using a Spark engine based on a preset inspection rule to generate a quality inspection report;
and the control module 430 is configured to, in a case that a data checking result included in the quality check report satisfies a second preset condition, control the private network device to forward the first data from the temporary area of the private network device to the formal area of the private network device, so that the database reads and stores the first data from the formal area of the private network device.
In an embodiment, the data warehousing device mentioned above may further include: and a storage module.
And the storage module is used for storing the first data and the quality inspection report in a temporary area of the special network equipment under the condition that a data inspection result included in the quality inspection report does not meet a second preset condition, so that the first equipment acquires the first data and the quality inspection report from the temporary area of the special network equipment, and the first data are corrected according to the quality inspection report.
In one embodiment, the first data stored in the temporary area of the private network device is data that the first device transmits to the temporary area of the private network device via a file transfer protocol.
In one embodiment, the first preset condition is that the data size of the first data is consistent with the data size parsed by the dedicated network device from the XML file corresponding to the first data.
In one embodiment, the preset checking rule includes that all data in the first data satisfy a first condition, and a preset proportion of data in the first data satisfy a second condition.
In one embodiment, the pre-set checking rules are configured in the EXCEL table using an automated generation tool.
According to the embodiment of the application, under the condition that the first data stored in the temporary area of the special network equipment meets the first preset condition, the first data is obtained, the quality inspection report is generated on the basis of the preset inspection rule and the Spark engine performs quality inspection on the first data, and under the condition that the data inspection result included in the quality inspection report meets the second preset condition, the first data originally stored in the temporary area of the special network equipment is transferred to the formal area of the special network equipment, so that the database can directly read and store the first data from the formal area of the special network equipment.
Each module in the data storage device provided in the embodiment of the present application may implement the method steps in the embodiments shown in fig. 2 or fig. 3, and may achieve the technical effects corresponding thereto, and for brevity, no further description is given here.
Fig. 5 is a schematic structural diagram of a data warehousing device according to an embodiment of the present application.
As shown in fig. 5, the data warehousing device 500 in the present embodiment includes an input device 501, an input interface 502, a central processing unit 503, a memory 504, an output interface 505, and an output device 506. The input interface 502, the central processing unit 503, the memory 504, and the output interface 505 are connected to each other through a bus 510, and the input device 501 and the output device 506 are connected to the bus 510 through the input interface 502 and the output interface 505, respectively, and further connected to other components of the data-warehousing device 500.
Specifically, the input device 501 receives input information from the outside and transmits the input information to the central processor 503 through the input interface 502; the central processor 503 processes input information based on computer-executable instructions stored in the memory 504 to generate output information, temporarily or permanently stores the output information in the memory 504, and then transmits the output information to the output device 506 through the output interface 505; the output device 506 outputs the output information to the exterior of the data-warehousing device 500 for use by the user.
In one embodiment, the data-warehousing device 500 shown in fig. 5 comprises: a memory 504 for storing programs; the processor 503 is configured to execute the program stored in the memory to perform the method of the embodiment shown in fig. 2 or fig. 3 provided in the embodiments of the present application.
Embodiments of the present application further provide a computer-readable storage medium having computer program instructions stored thereon; the computer program instructions, when executed by a processor, implement the method of the embodiments shown in fig. 2 or fig. 3 provided by the embodiments of the present application.
It is to be understood that the present application is not limited to the particular arrangements and instrumentality described above and shown in the attached drawings. A detailed description of known methods is omitted herein for the sake of brevity. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the present application are not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications and additions or change the order between the steps after comprehending the spirit of the present application.
The functional blocks shown in the above structural block diagrams may be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic Circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, plug-in, function card, or the like. When implemented in software, the elements of the present application are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted by a data signal carried in a carrier wave over a transmission medium or a communication link. A "machine-readable medium" may include any medium that can store or transfer information. Examples of machine-readable media include electronic circuits, semiconductor Memory devices, Read-Only memories (ROMs), flash memories, erasable ROMs (eroms), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, Radio Frequency (RF) links, and so forth. The code segments may be downloaded via computer networks such as the internet, intranet, etc.
It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, the present application is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, may be performed in an order different from the order in the embodiments, or may be performed simultaneously.
As will be apparent to those skilled in the art, for convenience and brevity of description, the specific working processes of the systems, modules and units described above may refer to corresponding processes in the foregoing method embodiments, and are not described herein again. It should be understood that the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the present application, and these modifications or substitutions should be covered within the scope of the present application.

Claims (10)

1. A method for data warehousing, the method comprising:
acquiring first data stored in a temporary area of a private network device under the condition that the first data meets a first preset condition;
performing quality inspection on the first data by using a Spark engine based on a preset inspection rule to generate a quality inspection report;
and controlling the special network equipment to transfer the first data from the temporary area of the special network equipment to the formal area of the special network equipment so that the database reads and stores the first data from the formal area of the special network equipment when the data checking result included in the quality checking report meets a second preset condition.
2. The method of claim 1, further comprising:
and if the data checking result included in the quality checking report does not satisfy the second preset condition, controlling the private network device to store the first data and the quality checking report in a temporary area of the private network device, so that the first device acquires the first data and the quality checking report from the temporary area of the private network device to correct the first data according to the quality checking report.
3. The method according to claim 1, wherein the first data stored in the temporary area of the dedicated network device is data that the first device transmits to the temporary area of the dedicated network device via a file transfer protocol.
4. The method according to claim 1, wherein the first preset condition is that the data size of the first data is consistent with the data size parsed by the dedicated network device from the extensible markup language XML file corresponding to the first data.
5. The method of claim 1, wherein the predetermined checking rule comprises a first condition satisfied by all of the first data and a second condition satisfied by a predetermined percentage of the first data.
6. The method of claim 1, wherein the preset checking rules are configured in an EXCEL table using an automated generation tool.
7. A data warehousing apparatus, the apparatus further comprising:
the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring first data stored in a temporary area of the special network equipment under the condition that the first data meets a first preset condition;
the quality inspection module is used for performing quality inspection on the first data by using a Spark engine based on a preset inspection rule to generate a quality inspection report;
and the unloading module is used for controlling the special network equipment to unload the first data from the temporary area of the special network equipment to the formal area of the special network equipment under the condition that the data checking result included in the quality checking report meets a second preset condition, so that the database reads and stores the first data from the formal area of the special network equipment.
8. An information processing apparatus characterized by comprising: a processor and a memory storing computer program instructions;
the processor reads and executes the computer program instructions to implement the data-binning method of any of claims 1-6.
9. A computer storage medium having stored thereon computer program instructions which, when executed by a processor, implement a data warehousing method as claimed in any one of claims 1-6.
10. A computer program product, wherein instructions in the computer program product, when executed by a processor of an electronic device, cause the electronic device to perform the data warehousing method of any of claims 1-6.
CN202111607970.4A 2021-12-22 2021-12-22 Data storage method, device, equipment and medium Pending CN114281812A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111607970.4A CN114281812A (en) 2021-12-22 2021-12-22 Data storage method, device, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111607970.4A CN114281812A (en) 2021-12-22 2021-12-22 Data storage method, device, equipment and medium

Publications (1)

Publication Number Publication Date
CN114281812A true CN114281812A (en) 2022-04-05

Family

ID=80875732

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111607970.4A Pending CN114281812A (en) 2021-12-22 2021-12-22 Data storage method, device, equipment and medium

Country Status (1)

Country Link
CN (1) CN114281812A (en)

Similar Documents

Publication Publication Date Title
CN109359277B (en) Data monitoring method, device and computer storage medium
CN112052172B (en) Rapid test method and device for third-party channel and electronic equipment
CN107862425B (en) Wind control data acquisition method, device and system and readable storage medium
CN111967976A (en) Risk enterprise determination method and device based on knowledge graph
CN110688828A (en) File processing method and device, file processing system and computer equipment
CN111259040A (en) SQL statement auditing method and system
CN114118047A (en) Report generation method, device, equipment and computer storage medium
CN112559489A (en) Block chain supervision method and equipment based on cross-chain and storage medium
CN114416852A (en) Data processing method, device, equipment and medium
CN111427582B (en) RTL code management method, device, equipment and computer readable storage medium
CN112363939A (en) Method, system and equipment for quickly generating fuzzy test network protocol template
US11790249B1 (en) Automatically evaluating application architecture through architecture-as-code
CN116957764A (en) Account data processing method and device, electronic equipment and storage medium
CN114281812A (en) Data storage method, device, equipment and medium
CN115357594A (en) Block chain-based data model updating method and related equipment
CN113254944B (en) Vulnerability processing method, system, electronic device, storage medium and program product
CN112819621B (en) Intelligent contract resource loss testing method and system
CN115062312A (en) Intelligent contract vulnerability detection method, device, equipment and storage medium
CN111815442B (en) Link prediction method and device and electronic equipment
CN114218313A (en) Data management method, device, electronic equipment, storage medium and product
CN107229651A (en) Unique constraints abnormal determination method, abnormality eliminating method and device
CN117076546B (en) Data processing method, terminal device and computer readable storage medium
CN113010424B (en) Interface automatic test processing method, system, computer equipment and storage medium
CN114817929B (en) Method and device for dynamically tracking and processing vulnerability of Internet of things, electronic equipment and medium
CN117648315A (en) Data quality inspection system, method, device and equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination