CN115081421A - Template generation method of data warehouse, computer equipment and storage medium - Google Patents

Template generation method of data warehouse, computer equipment and storage medium Download PDF

Info

Publication number
CN115081421A
CN115081421A CN202210732230.1A CN202210732230A CN115081421A CN 115081421 A CN115081421 A CN 115081421A CN 202210732230 A CN202210732230 A CN 202210732230A CN 115081421 A CN115081421 A CN 115081421A
Authority
CN
China
Prior art keywords
document
data warehouse
investigation
data
feedback
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202210732230.1A
Other languages
Chinese (zh)
Inventor
陈旋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ping An Technology Shenzhen Co Ltd
Original Assignee
Ping An Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ping An Technology Shenzhen Co Ltd filed Critical Ping An Technology Shenzhen Co Ltd
Priority to CN202210732230.1A priority Critical patent/CN115081421A/en
Publication of CN115081421A publication Critical patent/CN115081421A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/166Editing, e.g. inserting or deleting
    • G06F40/186Templates
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/211Schema design and management
    • G06F16/212Schema design and management with details for data modelling support
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/283Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The application discloses a template generation method of a data warehouse, computer equipment and a storage medium, wherein the method comprises the steps of obtaining a research feedback document; performing data detail layer processing on the investigation feedback document to obtain a corresponding detailed design document of the data warehouse; the process is coded for query engine debugging. By the method, the logic model design and the physical model design can be integrated, the detailed layer processing of the data of the research and development feedback document is completed, the manual maintenance is reduced, and the research and development efficiency of a data warehouse is promoted.

Description

Template generation method of data warehouse, computer equipment and storage medium
Technical Field
The present application relates to the field of internet technologies, and in particular, to a template generation method for a data warehouse, a computer device, and a storage medium.
Background
In the information technology and data intelligence environment, data warehouses provide many economic and efficient computing resources in various fields. A data warehouse is a theme-oriented, integrated, relatively stable data collection that reflects historical changes used to support administrative decisions. The traditional data warehouse construction needs to go through the processes of system investigation, data model design, mapping, script research and development, testing, deployment and the like, wherein the system investigation, the model design and the mapping are related to the efficiency and the quality of the data warehouse construction. The existing model design commonly used in the industry is divided into a logic model and a physical model, wherein the logic model is designed firstly, then the logic model is converted into the physical model, and a periodic payment part is a mapping document.
However, in the practical process, it is found that such documents have the problems of more maintenance fields, higher maintenance cost, large information redundancy, low maintenance efficiency, lack of automation function of the documents, and the like, many steps in the development process of the data warehouse need manual operation, the learning cost of project personnel is higher, and the efficiency of the actual operation process is also lower.
Disclosure of Invention
The technical problem mainly solved by the application is to provide a template generation method, computer equipment and a storage medium for a data warehouse, which can simplify the warehousing process of the data warehouse and improve the efficiency.
In order to solve the above technical problem, the first technical solution adopted by the present application is: a template generation method of a data warehouse is provided, and the method comprises the following steps: acquiring a research feedback document; performing data detail layer processing on the investigation feedback document to obtain a corresponding detailed design document of the data warehouse; the process is coded for query engine debugging.
In order to solve the above technical problem, the second technical solution adopted by the present application is: a computer device is provided, the computer device comprising a processor and a memory, the memory coupled to the processor; the memory is used for storing a computer program that can be run on the processor, and the processor executes the computer program to implement the method provided in the first technical scheme of the present application.
In order to solve the above technical problem, the third technical solution adopted by the present application is: there is provided a computer readable storage medium having a computer program stored thereon, the computer program when executed by a processor implementing the method as provided in the first aspect of the present application.
The beneficial effect of this application is: different from the prior art, the method comprises the steps of firstly obtaining a research feedback document, then carrying out data detail layer processing on the research feedback document to obtain a corresponding detailed design document of a data warehouse, and finally coding a processing process for debugging a query engine. The template generation method of the data warehouse integrates logic model design and physical model design, manual maintenance is reduced, and research and development efficiency of the data warehouse is promoted. The template generation method of the data warehouse can rapidly generate import files of other systems, seamless butt joint is achieved in the subsequent data warehouse research and development process, manual operation is reduced, and research and development efficiency is improved.
Furthermore, according to the template generation method of the data warehouse, updating of template documents, data detail layer processing and code file acquisition are simpler through an operation mode of adding an automatic button, so that the maintenance process of the documents in the data warehouse is more standardized, document format confusion caused by artificial difference is reduced, and the steps are clearer.
Drawings
FIG. 1 is a schematic flow chart diagram illustrating a first embodiment of a template generation method for a data warehouse of the present application;
FIG. 2 is a schematic flow chart diagram illustrating a second embodiment of a template generation method for a data warehouse of the present application;
FIG. 3 is a schematic flow chart diagram illustrating a third embodiment of a template generation method for a data warehouse of the present application;
FIG. 4 is a schematic diagram of a template generation interface of the template generation method of the data warehouse of the present application;
FIG. 5 is a schematic block diagram of the circuit configuration of an embodiment of the computer apparatus of the present application;
FIG. 6 is a schematic block diagram of a circuit configuration of an embodiment of a computer-readable storage medium of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first", "second" and "third" in this application are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implying any indication of the number of technical features indicated. Thus, a feature defined as "first," "second," or "third" may explicitly or implicitly include at least one of the feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless explicitly specifically limited otherwise. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
With the advent of the big data age, in the face of the diversity of big data, data warehouse technologies have been developed in storing and processing the big data. The data warehouse is a theme-oriented, integrated, relatively stable data set reflecting historical changes, is used for supporting decision-making and analysis-oriented data processing, is an effective integration for a plurality of data sources, is recombined according to the theme after integration, contains historical data, and generally does not modify the data stored in the data warehouse.
The traditional data warehouse construction needs to be carried out through the processes of system investigation, data model design, mapping, script research and development, testing, deployment and the like, wherein the system investigation, the model design and the mapping are related to the efficiency and the quality of the data warehouse construction. The existing model design commonly used in the industry is divided into a logic model and a physical model, wherein the logic model is designed firstly, then the logic model is converted into the physical model, and a periodic payment part is a mapping document.
However, in practice, such documents are found to have the problems of more maintenance fields, higher maintenance cost, large information redundancy, low maintenance efficiency, lack of automation functions of the documents, and the like. For example, the same fields exist between the table and the middle of the table in some documents, so that the information redundancy is large, the maintenance efficiency is low, and the consistency is difficult to guarantee. The field naming standard translation, the generation of other system import format documents, the generation of codes according to design and the like all need manual operation, the learning cost of project personnel is high, and the efficiency of the actual operation process is low. In order to improve or solve the above technical problem, the present application proposes at least the following embodiments.
As shown in fig. 1, fig. 1 is a schematic flowchart of a first embodiment of a template generation method of a data warehouse according to the present application. The template generation method of the data warehouse comprises the following steps:
step S101: and acquiring a research feedback document.
The acquisition of the research feedback document needs to firstly acquire a warehousing template document, the warehousing template document is subjected to table structure information research, and research information is supplemented to the warehousing template document to obtain the research feedback document.
The investigation part is a foundation stone for data warehouse construction, and needs to determine the target and the demand for constructing the data warehouse, perform comprehensive investigation, know the real demand and determine the problem to be solved by the data warehouse. The rationality of data warehouse construction is based on investigation content, a complete list of tables, specific use of each table and content of stored data can be obtained through investigation, and a foundation is laid for subsequent data warehouse research and development.
The warehousing template document is lack of data content related to business and oriented to subjects, and can be understood that the warehousing template document is only a frame and needs to be investigated to obtain investigation information such as a complete list of tables, the meaning of each table and storage content, and the warehousing template document is supplemented by the information obtained by investigation to obtain a document which can meet the requirements of clients, namely, an investigation feedback document which can be further processed.
Optionally, after the research feedback document is obtained, determining whether the template of the research feedback document is the latest; if yes, the confirmation is passed; and if not, copying the content in the document to the latest template by adopting an automatic function to obtain a final investigation feedback document.
Step S102: and carrying out data detail layer processing on the research feedback document to obtain a corresponding detailed design document of the data warehouse.
The content of the data detail layer processing comprises two aspects of logic model design and physical model design. The logical model reflects the project personnel's view of the data store, is determined from business rules, and is a basic blueprint about business objects, data items of the business objects, and relationships between the business objects. The contents of the logical model include all entities and relationships, and the attributes of each entity need to be determined. The goal of the logical model is to describe the data in as detail as possible, and not to consider how it is physically implemented. The physical model is based on the logical model, considers various specific technical implementation factors, carries out data architecture design, and really realizes the storage of data in a data warehouse. The contents of the physical model include determining all tables and columns, confirming relationships between tables, and the like.
Optionally, the research feedback document is subjected to logic model design and physical model design. The logical model design includes defining topic classifications in the data detail layer. The physical model design comprises standardizing Chinese names of fields of the research feedback document, defining Chinese names of forms processed in a data detail layer, defining field use standards in the data detail layer, performing Chinese name standardized English name escape on the research feedback document, and perfecting other information in the data detail layer, wherein the other information in the data detail layer comprises protocol codes, event numbers and original layer table names. It should be understood that the contents of the logical model design and the physical model design are not limited to the above-described aspects, and may be other contents.
Step S103: the process is coded for query engine debugging.
Optionally, a first instruction generated by a code file generation automation button triggering the template generation interface is received, and the processing procedure is automatically coded in response to the first instruction.
That is, an automation button is arranged on the template generation interface, a user triggers the automation button on the template generation interface, the system receives a first instruction generated by the automatic button for generating the code file triggering the template generation interface, and then the processing process is automatically coded in response to the first instruction.
In the preferred embodiment of the application, the acquired research feedback document is subjected to data detail layer processing, then the processing process code is automated to generate a corresponding code, and the code is independently used for query engine debugging, so that manual operation is reduced, and the subsequent data warehouse research and development efficiency is improved. According to the method, the research and development process of the data warehouse is clearer, the process is simpler and more standardized, the same template document is used in multiple steps of the research and development process of the data warehouse, and the problems of information redundancy and difficult maintenance caused by too many documents are avoided. In addition, the embodiment adopts an automatic function, the specific research and development process of the data warehouse is simplified, the learning cost of the project personnel is higher due to the original operation, the new member can learn to use in less time, and the learning cost is reduced.
Fig. 2 is a schematic flowchart of a template generation method of the data warehouse according to the second embodiment of the present application, as shown in fig. 2. The method comprises the following steps:
step S201: and acquiring the warehousing template document.
Step S202: and performing table structure information investigation on the warehousing template document, and supplementing the information obtained by the investigation to the warehousing template document to obtain an investigation feedback document.
Step S203: and confirming whether the template of the research feedback document is up to date.
If the template of the research feedback document is not the latest, executing step S204: and copying the content in the document to the latest template by adopting an automatic function to obtain a final investigation feedback document.
If the template of the research feedback document is determined to be the latest, or after the step S204 is executed, the step S205 is executed: the survey feedback document is examined.
The content checking comprises checking whether field names and field descriptions in the investigation feedback document are available, checking whether the field descriptions in the investigation feedback document are detailed, checking whether code values are full, and checking whether the investigation feedback document needs to encrypt field marks. It is to be understood that the examination content is not limited to the above-described aspect, and may be other content.
If the check is passed, step S206 is executed: and performing data detail layer processing on the investigation feedback document to obtain a corresponding detailed design document of the data warehouse.
Optionally, a fourth instruction generated by a data detail layer processing automation button of the trigger template generation interface is received, and the data detail layer processing is automatically performed on the investigation feedback document in response to the fourth instruction to obtain a corresponding detailed design document of the data warehouse.
That is, an automation button is arranged on the template generation interface, a user triggers the automation button on the template generation interface, the system receives a fourth instruction generated by the data detail layer processing automation button triggering the template generation interface, and then the data detail layer processing is automatically carried out on the investigation feedback document in response to the fourth instruction.
Step S207: and generating a database aided design software import document by using the data warehouse detailed design document.
Optionally, a second instruction generated by an import document automation button of the database aided design software triggered to generate the template generation interface is received, and the import document of the database aided design software is automatically generated by using the detailed design document of the data warehouse in response to the second instruction.
That is, an automation button is arranged on the template generation interface, a user triggers the automation button on the template generation interface, the system receives a second instruction generated by the automatic button for generating the database aided design software import document triggering the template generation interface, and then the system automatically generates the database aided design software import document by using the detailed design document of the data warehouse in response to the second instruction.
According to the method, the warehousing template document is subjected to table structure information investigation to obtain the investigation feedback document, whether the template of the investigation feedback document is the latest or not is confirmed, the investigation feedback document is checked, data detail layer processing is carried out on the investigation feedback document after the checking is passed, then a database aided design software import document is generated in an automatic mode, the database aided design software import document can be synchronously transmitted to a data asset management platform for project personnel to inquire logical mapping, seamless butt joint is achieved in the subsequent data warehouse research and development process, manual operation is reduced, and the data warehouse research and development efficiency is improved.
Fig. 3 is a schematic flowchart of a template generation method of the data warehouse according to the third embodiment of the present application, as shown in fig. 3. The method comprises the following steps:
step S301: and acquiring the warehousing template document.
Step S302: and performing table structure information investigation on the warehousing template document, and supplementing the information obtained by the investigation to the warehousing template document to obtain an investigation feedback document.
Step S303: and confirming whether the template of the research feedback document is up to date.
If the template of the research feedback document is not the latest, executing step S304: and copying the content in the document to the latest template by adopting an automatic function to obtain a final investigation feedback document.
If the template of the research feedback document is determined to be the latest, or after the step S304 is executed, the step S305 is executed: the survey feedback document is examined.
If the check is passed, step S306 is executed: and performing data detail layer processing on the investigation feedback document to obtain a corresponding detailed design document of the data warehouse.
Step S307: and generating a scheduling job deployment package by using the detailed design document of the data warehouse.
Optionally, a third instruction generated by an automation button for generating the scheduling job deployment package of the trigger template generation interface is received, and the scheduling job deployment package is generated by using the detailed design document of the data warehouse in response to the third instruction.
That is, an automation button is set on the template generation interface, and when a user triggers the automation button on the template generation interface, the system receives a third instruction generated by the automation button for generating the scheduling job deployment package, which triggers the template generation interface, and then generates the scheduling job deployment package by using the detailed design document of the data warehouse in response to the third instruction.
In this embodiment, a warehousing template document is subjected to table structure information research to obtain a research feedback document, whether a template of the research feedback document is the latest is determined, the research feedback document is checked, data detail layer processing is performed on the research feedback document after the check is passed, a scheduling job deployment package is generated in an automatic mode, the scheduling job deployment package can be deployed to a deployment scheduling platform to complete data warehousing operation of a data warehouse, and after group authorization is completed on the job package, whether relevant information is correct or not is determined, whether code value standards are transcoded or not is determined, and whether fields are encrypted or not is determined, the scheduling job deployment package can be put into production for verification. The embodiment can realize the light weight of the research and development process of the data warehouse, project personnel can only pay attention to the content part related to the warehousing of the data warehouse as required, a project group can realize that a plurality of steps adopt different members to use the same document, the common cooperation is realized, the mutual interference is avoided, and the subsequent document review is more concise and efficient.
Fig. 4 shows the template generating interface 20, in the template generating interface 20, a project person can click the code file generation automation button 210, the database design assisting software import document generation automation button 220, the scheduling job deployment package generation automation button 230, and the data detail layer processing automation button 240 to realize the corresponding code file generation automation, the database design assisting software import document generation automation, the scheduling job deployment package generation automation, and the data detail layer processing automation, so as to reduce human operations, reduce document format confusion caused by human differences, standardize a document maintenance process more, make each step more clear, make the project person concentrate on the model content itself more, and do not need to pay more attention to factors such as document circulation, thereby effectively improving the research and development efficiency of the data warehouse. And through generating code file automation button 210, generating database aided design software import document automation button 220 and generating scheduling job deployment package automation button 230, files imported into other systems can be generated rapidly, seamless docking is realized in the subsequent data warehouse research and development process, and efficiency is improved.
Fig. 5 shows an electronic device 30 according to an embodiment of the present application, which may specifically include a processor 310 and a memory 320. The processor 310 is coupled to the memory 320.
The processor 310 is used for running a computer program, and the processor 310 may also be referred to as a CPU (Central Processing Unit). The processor 310 may be an integrated circuit chip having signal processing capabilities. The processor 310 may also be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 320 is used for storing computer programs, and may be a RAM, a ROM, or other types of storage devices. In particular, memory 320 may include one or more computer-readable storage media, which may be non-transitory. Memory 320 may also include high speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 320 is used to store at least one program code.
Processor 310 is configured to execute computer programs stored in memory 320 to implement the operations described in the embodiments of the template generation method of the data repository of the present application.
In some embodiments, the electronic device 30 may further include: a peripheral interface 330 and at least one peripheral. The processor 310, memory 320, and peripheral interface 330 may be connected by buses or signal lines. Various peripheral devices may be connected to peripheral interface 330 via a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 340, display 350, audio circuitry 360, and power source 370.
The peripheral interface 330 may be used to connect at least one peripheral related to I/O (Input/output) to the processor 310 and the memory 320. In some embodiments, processor 310, memory 320, and peripheral interface 330 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 310, the memory 320 and the peripheral interface 330 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.
The Radio Frequency circuit 340 is used for receiving and transmitting RF (Radio Frequency) signals, also called electromagnetic signals. The radio frequency circuit 340 communicates with a communication network and other communication devices through electromagnetic signals, and the radio frequency circuit 340 is a communication circuit of the electronic device 30. The rf circuit 340 converts an electrical signal into an electromagnetic signal for transmission, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 340 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuit 340 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: the world wide web, metropolitan area networks, intranets, generations of mobile communication networks (2G, 3G, 4G, and 5G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, rf circuit 340 may further include NFC (Near Field Communication) related circuits, which are not limited in this application.
The display screen 350 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 350 is a touch display screen, the display screen 350 also has the ability to capture touch signals on or over the surface of the display screen 350. The touch signal may be input to the processor 310 as a control signal for processing. At this point, the display screen 350 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the display 350 may be one, disposed on the front panel of the electronic device 30; in other embodiments, the display screens 350 may be at least two, respectively disposed on different surfaces of the electronic device 30 or in a folded design; in other embodiments, the display 350 may be a flexible display disposed on a curved surface or a folded surface of the electronic device 30. Even further, the display screen 350 may be arranged in a non-rectangular irregular pattern, i.e., a shaped screen. The Display 350 can be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), and the like.
The audio circuit 360 may include a microphone and a speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 310 for processing or inputting the electric signals to the radio frequency circuit 340 for realizing voice communication. For stereo capture or noise reduction purposes, the microphones may be multiple and disposed at different locations of the electronic device 30. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is used to convert electrical signals from the processor 310 or the radio frequency circuit 340 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, audio circuitry 360 may also include a headphone jack.
The power supply 370 is used to power various components in the electronic device 30. Power source 370 may be alternating current, direct current, disposable or rechargeable batteries. When power source 370 comprises a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. The wired rechargeable battery is a battery charged through a wired line, and the wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery may also be used to support fast charge technology.
For detailed description of functions and execution processes of each functional module or component in the embodiment of the present application, reference may be made to the descriptions in the first embodiment, the second embodiment, and the third embodiment of the template generation method of the data warehouse of the present application, and details are not described here again.
In the several embodiments provided in the present application, it should be understood that the disclosed electronic device and template generation method may be implemented in other ways. For example, the above-described embodiments of the electronic device are merely illustrative, and for example, a module or a unit may be divided into only one logic function, and may be implemented in other ways, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
Referring to fig. 6, the above-described integrated unit, if implemented in the form of a software functional unit and sold or used as a separate product, may be stored in a computer-readable storage medium 400. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes several instructions/computer programs for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method of the embodiments of the present application. And the aforementioned storage medium includes: various media such as a usb disk, a portable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and electronic devices such as a computer, a mobile phone, a notebook computer, a tablet computer, and a camera having the storage medium.
The description of the implementation process of the program data in the computer-readable storage medium can refer to the description of the embodiment of the template generation method in the present application, and will not be described herein again.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings, or which are directly or indirectly applied to other related technical fields, are intended to be included within the scope of the present application.

Claims (13)

1. A template generation method of a data warehouse is characterized by comprising the following steps:
acquiring a research feedback document;
performing data detail layer processing on the investigation feedback document to obtain a corresponding detailed design document of the data warehouse;
the process is coded for query engine debugging.
2. The method of claim 1, wherein said performing data detail layer processing on said research feedback document to obtain a corresponding data warehouse design details document comprises:
generating a database aided design software import document by using the detailed design document of the data warehouse;
and synchronizing the imported document of the database aided design software to a data asset management platform so as to inquire the logical mapping relation.
3. The method of claim 1, wherein the performing data detail layer processing on the research feedback document to obtain a corresponding data warehouse detailed design document comprises:
generating a scheduling job deployment package by using the detailed design document of the data warehouse;
and deploying the scheduling job deployment package to a deployment scheduling platform to complete the data warehousing operation of the data warehouse.
4. The method of claim 1, wherein the performing data detail layer processing on the research feedback document to obtain a corresponding data warehouse design-in-detail document comprises:
defining a topic classification in the data detail layer;
standardizing the Chinese names in the fields of the investigation feedback document;
defining Chinese names of forms processed in the data detail layer;
defining field use criteria in the data detail layer;
performing Chinese name standardized English name escaping on the investigation feedback document;
other information in the refinement data detail layer includes, but is not limited to, protocol encoding, event numbering, and source layer table names.
5. The method of claim 1, wherein the obtaining a survey feedback document comprises:
and obtaining the warehousing template document to carry out table structure information investigation to obtain an investigation feedback document.
6. The method of claim 5, wherein obtaining the binned template document for performing a table structure information investigation to obtain an investigation feedback document comprises:
confirming whether the template of the investigation feedback document is the latest or not;
in response to the template of the research feedback document not being up-to-date, updating the template of the research feedback document to up-to-date.
7. The method of claim 5, wherein obtaining the binned template document for performing the table structure information investigation to obtain the investigation feedback document comprises:
checking the investigation feedback document;
and responding to the examination passing, and performing data detail layer processing on the investigation feedback document to obtain a corresponding data warehouse detailed design document.
8. The method of claim 7, wherein said examining the survey feedback document comprises:
checking whether field names and field descriptions in the research feedback document are available or not;
checking whether the field description in the investigation feedback document is detailed or not and whether the code value is full or not;
it is checked whether the investigation feedback document requires an encrypted field flag.
9. The method of claim 1, wherein the coding the process for query engine debugging comprises:
receiving a first instruction generated by a code automation button of a trigger template generation interface;
automatically codifying the process in response to the first instruction.
10. The method of claim 1, wherein generating a database aided design software import document using the data warehouse detailed design document comprises:
receiving a second instruction generated by importing a document generation button into database aided design software of a trigger template generation interface;
and automatically generating a database aided design software import document by using the data warehouse detailed design document in response to the second instruction.
11. The method of claim 1, wherein generating a scheduled job deployment package using the data warehouse detail design document comprises:
receiving a third instruction generated by a scheduling job deployment package generation button of a trigger template generation interface;
and automatically generating a scheduling job deployment package by utilizing the data warehouse detailed design document in response to the third instruction.
12. A computer device, comprising:
a processor;
a memory coupled to the processor for storing a computer program operable on the processor;
wherein the processor, when executing the computer program, implements the method of any of claims 1 to 11.
13. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method of any one of claims 1 to 11.
CN202210732230.1A 2022-06-23 2022-06-23 Template generation method of data warehouse, computer equipment and storage medium Withdrawn CN115081421A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210732230.1A CN115081421A (en) 2022-06-23 2022-06-23 Template generation method of data warehouse, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210732230.1A CN115081421A (en) 2022-06-23 2022-06-23 Template generation method of data warehouse, computer equipment and storage medium

Publications (1)

Publication Number Publication Date
CN115081421A true CN115081421A (en) 2022-09-20

Family

ID=83255759

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210732230.1A Withdrawn CN115081421A (en) 2022-06-23 2022-06-23 Template generation method of data warehouse, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN115081421A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070174308A1 (en) * 2006-01-10 2007-07-26 Sas Institute Inc. Data warehousing systems and methods having reusable user transforms
US20220091825A1 (en) * 2020-09-22 2022-03-24 Jpmorgan Chase Bank, N.A. Method and apparatus for automatically generating an application code and framework
CN114443905A (en) * 2022-01-27 2022-05-06 厦门雅基软件有限公司 Interface document updating method and device, electronic equipment and readable storage medium

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070174308A1 (en) * 2006-01-10 2007-07-26 Sas Institute Inc. Data warehousing systems and methods having reusable user transforms
US20220091825A1 (en) * 2020-09-22 2022-03-24 Jpmorgan Chase Bank, N.A. Method and apparatus for automatically generating an application code and framework
CN114443905A (en) * 2022-01-27 2022-05-06 厦门雅基软件有限公司 Interface document updating method and device, electronic equipment and readable storage medium

Similar Documents

Publication Publication Date Title
CN110598879B (en) Garbage collection method, device, equipment and storage medium based on block chain
CN111192005B (en) Government affair service processing method and device, computer equipment and readable storage medium
CN111104980B (en) Method, device, equipment and storage medium for determining classification result
CN113190362B (en) Service calling method and device, computer equipment and storage medium
CN111399819B (en) Data generation method, device, electronic equipment and storage medium
CN110769050B (en) Data processing method, data processing system, computer device, and storage medium
CN113138771A (en) Data processing method, device, equipment and storage medium
CN114936199B (en) Data processing method for system reconstruction, computer equipment and storage medium
CN115081421A (en) Template generation method of data warehouse, computer equipment and storage medium
CN110196745A (en) Data sharing method and terminal
CN111709843B (en) Customer portrait generation method and device and electronic equipment
CN115562529A (en) Visual point burying method and device, terminal and storage medium
CN114661811A (en) Data display method and device, electronic equipment and storage medium
CN111294320B (en) Data conversion method and device
CN111652432A (en) Method and device for determining user attribute information, electronic equipment and storage medium
CN113238948B (en) Buried point detection method, buried point detection device, electronic equipment and storage medium
CN113673427B (en) Video identification method, device, electronic equipment and storage medium
CN111064782B (en) Method and device for transmitting data, electronic equipment and storage medium
CN115222659A (en) Part size evaluation method and device, terminal and storage medium
CN115600161A (en) RPA and working method of management system thereof, computer equipment and storage medium
CN114116817A (en) Processing information storage method, processing information query device and server
CN117010165A (en) Method and device for writing CAE simulation file of strength of engine valve chamber cover
CN117034681A (en) Method, device, terminal and storage medium for analyzing dent resistance of automobile body outer panel
CN116187916A (en) Automatic coding method, device, terminal and medium for automobile part numbers
CN114925444A (en) Wiring harness configuration condition design method, terminal and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20220920