CN117726178A - MPP-based method and system for inquiring service indexes of air control data marts - Google Patents

MPP-based method and system for inquiring service indexes of air control data marts Download PDF

Info

Publication number
CN117726178A
CN117726178A CN202311836723.0A CN202311836723A CN117726178A CN 117726178 A CN117726178 A CN 117726178A CN 202311836723 A CN202311836723 A CN 202311836723A CN 117726178 A CN117726178 A CN 117726178A
Authority
CN
China
Prior art keywords
interface
data
developing
early warning
report
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311836723.0A
Other languages
Chinese (zh)
Inventor
田羽
汪大磊
吴金林
彭一凡
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan Zhongbang Bank Co Ltd
Original Assignee
Wuhan Zhongbang Bank Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan Zhongbang Bank Co Ltd filed Critical Wuhan Zhongbang Bank Co Ltd
Priority to CN202311836723.0A priority Critical patent/CN117726178A/en
Publication of CN117726178A publication Critical patent/CN117726178A/en
Pending legal-status Critical Current

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a MPP-based wind control data mart business index query method and a system, wherein the method comprises the following steps: step 1, developing a data source connection type interface and a relational database to acquire metadata and a data source; step 2, reading source data based on the provided interface, designing and developing a report data set relation layer back end interface, creating an add-delete-change function, and providing a data back end interface and a report relation layer front end visual interface for the visual interface; and 3, developing the layout, style and mode of the visual interface, and developing the back-end interface through enterprise WeChat sending based on the back-end interface development of the report data set, report making editing, early warning conditions and timing conditions. The invention is used for providing a query function of a quick service index and a function of monitoring and early warning of the service index for a policy analyst of wind control. Therefore, the method can help enterprise policy analysts to quickly generate index data and discover abnormal indexes in time, so that time cost is saved, and service risk points are discovered in time.

Description

MPP-based method and system for inquiring service indexes of air control data marts
Technical Field
The invention relates to the technical field of data warehouse and data quality, in particular to a MPP-based wind control data mart business index query method and system.
Background
MPP (Massively Parallel Processing ) is a computing technology that uses a large number of processors (or compute nodes) to perform multiple tasks simultaneously to increase processing speed and efficiency, and MPP technology is widely used in the fields of big data processing, scientific computing, artificial intelligence, and the like. For example, many large data processing platforms (e.g., hadoop and Spark) and database systems (e.g., greenplus and teraadata) employ MPP architecture.
Index metadata is data about service indexes, which describes the definition, calculation method, data source, data quality, related service rules and other information of the indexes, and by managing and using the index metadata, the organization can better understand the service performance, make decisions more accurately and improve the service efficiency. Meanwhile, index metadata is also an important component of data management, and is beneficial to improving the quality and consistency of data.
Disclosure of Invention
Aiming at the problems of the research, the invention provides a method and a system for inquiring the business indexes of an MPP-based air control data mart, and aims to solve the problems of low efficiency and high cost of communication between demand personnel such as strategy analysis and report development tasks and index early warning development in the prior air control data mart report development process.
The invention provides an MPP-based wind control data mart business index query method, which comprises the following steps:
step 1, developing a data source connection type interface and a relational database to acquire metadata and a data source;
step 2, reading source data based on the provided interface, designing and developing a report data set relation layer back end interface, creating an add-delete-change function, and providing a data back end interface and a report relation layer front end visual interface for the visual interface;
developing the layout, style and mode of the visual interface, including report making editing, early warning conditions and timing conditions; based on report data set back end interface development, report making editing, early warning conditions and timing conditions, early warning data are sent to enterprise WeChat through the back end interface, and relevant strategies and business personnel are notified.
On the basis of the technical scheme, the invention can also make the following improvements.
Optionally, the step 1 includes the following steps:
step 1.1, creating a Maven or Gradle project by using an integrated development environment developed by java language, and developing a database connection interface;
step 1.2, creating a Maven or Gradle project by using an integrated development environment developed by java language, and developing an EXCEL file data source interface; in Java, excel data is parsed using the Apache POI library.
Optionally, the step 2 includes the following steps:
step 2.1. Develop metadata module, read the data source through step 1, obtain the metadata information, according to the data source connection in step 1 to obtain the metadata information of form and column of the database:
step 2.2, designing and developing a front-end management page of the relation layer, wherein the front-end management page comprises functions of creating a relation object, deleting, editing and copying and pasting: the responsive data binding and event processing functions of the Vue are used, so that the operations of adding, deleting, modifying, searching, copying and pasting the object list are realized;
step 2.3, designing, developing and determining a relational layer data structure and a back-end interface;
step 2.4, designing a front-end display page of a development relation layer and a relation layer editing interface, realizing a physical model design function in Vue, and using join js to realize help drawing and operating a physical model diagram;
step 2.5, realizing the processing and storage of the relational layer object data;
and 2.6, developing the import and export functions to facilitate the transplantation.
Optionally, the step 2.3 includes the steps of:
step 2.3.1, defining a Json data structure by using Json format storage, and managing relationship layer object management metadata and relationship layer object metadata;
and 2.3.2, creating a back-end API interface by using Java and Spring Boot frames to perform deletion, examination and management, and correspondingly implementing other interface methods in detail according to the interface method for acquiring the object information by id.
Optionally, the step 2.5 includes the steps of:
step 2.5.1, editing the relation layer object to realize the association between different bottom tables of different fields or indexes;
step 2.5.2, dynamically acquiring index calculation sentences through the well-carded wind control index flow metadata table, and obtaining complete paths and levels of data through depth, wherein a bottom table uses a well-carded index bottom table; if the multiple index data paths are different, the relationship association is set through the step 2.4, and different indexes of the same path are logically combined;
step 2.5.3. Storing BI relational layer objects is accomplished through the use of a database or other persistent store.
Optionally, the step 2.5.3 includes the steps of:
step 2.5.3.1, creating a database table, and creating a table structure for storing BI relation layer objects in the database;
2.5.3.2, writing Java codes to connect databases and realize the storage and query functions of BI relational layer objects;
step 2.5.3.3 where the BI relational layer object needs to be stored, the corresponding operations are performed using the created class.
Optionally, the step 3 includes the following steps:
step 3.1, determining the elements of a table, a chart and an instrument panel to be contained;
step 3.2, in the Vue, creating a custom component to construct each part of the report;
step 3.3. Using the Flexbox layout, controlling the position, size and order of items in the container by setting the display: flex attribute of the container and the flex attribute of the items;
step 3.4, dynamically generating Flex items by using data binding and circulating instructions of the Vue;
step 3.5, reading the metadata of the relation layer in the step 2 and displaying the function implementation;
step 3.6, designing a data screening function in report editing;
step 3.7, applying the relation layer object in the step 2 as data source configuration to obtain indexes and fields; if the data are required to be screened, the dimension can be dragged to be screened, and a screening condition value is added, so that an index table can be generated;
step 3.8, designing the front end of the development index custom timing early warning function;
and 3.9. The index self-defining timing early warning function back end.
Optionally, the step 3.8 includes the steps of:
3.8.1, designing and developing an early warning rule setting interface, and creating a Vue component which contains monitoring data and triggers early warning logic;
3.8.2 developing a timing sending rule front-end interface, creating, editing and deleting functions by using vue development timing rules;
3.8.3, developing an enterprise WeChat and mail sending interface, creating a Vue component named SendMessage, and displaying a button for sending enterprise WeChat information and sending electronic mail in a page; in the sendWechatMessage method, a back-end interface is called to send enterprise WeChatMessage information, and a successful or failed response is processed; in the sendEmail method, a back-end interface is called to send an email, and a successful or failed response is processed as well;
when the threshold in step 3.8.1 is met and the timing rule in step 3.8.2 is met, an early warning message is sent via the enterprise WeChat id or mailbox address configured in 3.8.3.
Optionally, the step 3.9 includes the steps of:
3.9.1, realizing a self-defined threshold early warning function in Java, monitoring data by using a timing task or an event monitor, and triggering early warning when a specific threshold is reached;
3.9.2 develop early warning timing rule interface, in Java development, use Spring frame to realize adding, deleting, modifying and checking rule interface;
and 3.9.3, developing an enterprise WeChat mailbox to send the mail, and using the enterprise WeChat mailbox to send the mail in Java by using a Java MailAPI in combination with an SMTP server of the enterprise WeChat.
According to a second aspect of the present invention, there is provided an MPP-based system for querying business indexes of a wind-controlled data mart, including:
the first development module is used for designing and developing a data source connection type interface and a relational database to acquire metadata and a data source;
the second development module is used for reading the source data based on the provided interface, designing and developing a report data set relation layer back end interface, creating an add-delete-change function, and providing a data back end interface and a report relation layer front end visual interface for the visual interface;
the third development module is used for designing and developing the layout, style and mode of the visual interface, including report making and editing, early warning conditions and timing conditions; based on report data set back end interface development, report making editing, early warning conditions and timing conditions, early warning data are sent to enterprise WeChat through the back end interface, and relevant strategies and business personnel are notified.
The invention has the technical effects and advantages that:
the invention provides an MPP-based method and an MPP-based system for inquiring business indexes of a wind control data mart, and aims to solve the problems of low efficiency and high cost of communication between demand personnel and report development tasks and index early warning development in the conventional wind control data mart report development process. The invention provides a query function of a quick service index and a service index monitoring and early warning function for a wind-controlled strategy analyst. Therefore, the method can help enterprise policy analysts to quickly generate index data and discover abnormal indexes in time, so that time cost is saved, and service risk points are discovered in time.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It can be appreciated that based on the defects in the background technology, the embodiment of the invention provides an MPP-based wind control data mart business index query method, which comprises the following steps:
step 1, developing a data source connection type interface and a relational database to acquire metadata and a data source;
in the above technical solution, the step 1 specifically includes the following steps:
step 1.1, creating a Maven or Gradle project by using an integrated development environment developed by java language, such as Eclipse, intelliJIDEA, and developing a database connection interface:
in a JDBC connection database, a database driver is loaded through a class.forname ("org.postgresql.driver"), a database connection object is created using java.sql.connection for establishing a connection with the database, a java.sql.driver manager object is created for loading a database driver and assisting in establishing a connection with the database, a java.sql.state object is created for executing SQL statements, and a result is returned, and a java.sql.resultat set of object query results is created for traversing and processing the query results.
Step 1.2, creating a Maven or Gradle project by using an integrated development environment developed by java language, such as Eclipse, intelliJIDEA, and developing an EXCEL file data source interface:
in Java, excel data can be parsed using the apache poi library. POI is an open source Java library, providing a set of APIs for reading and writing Microsoft office formatted documents, including Excel, word and PowerPoint, etc., reading the file stream specifying the Execel file via the file stream, then creating a Workbook object (for the file in the xlsx format) accessing each Row and each column via the getSheett (x represents the sheet index, 0 represents the first sheet), obtaining Cell data via judging the Cell data type, as follows:
the Excel file path (excelFilePath) in the code is modified according to the specific Excel file used. In addition, the type and format of cell values need to be processed according to the actual situation.
Step 2, reading source data based on the provided interface, designing and developing a report data set relation layer back end interface, creating an add-delete-change function, and providing a data back end interface and a report relation layer front end visual interface for the visual interface;
in the above technical solution, the step 2 specifically includes the following steps:
step 2.1, developing a metadata module, reading a data source through the step 1, obtaining metadata information, and obtaining metadata information of a table and a column of a database according to the connection of the data source in the step 1:
the jdbappi is used to connect to the Postgresql-based MPP database and the database metadata information for database name, version, table and column is obtained using the DatabaseMetaData object.
Step 2.2, designing and developing a front-end management page of the relation layer, wherein the front-end management page comprises functions of creating a relation object, deleting, editing, copying, pasting and the like; creating a corresponding front-end visual interface through vue, triggering a corresponding function showAddModal, showEditObj, deleteObj and copyObj by using click events, and realizing interaction of a relation layer;
the functions of the Vue, such as responsive data binding and event processing, are used, and operations of adding, deleting, modifying, searching, copying, pasting and the like of the object list are realized.
Wherein:
the v-for instruction is used for circularly displaying the object list;
the @ click event monitor is used for responding to the click event of the button;
the v-model instruction is used for binding the values of the input boxes with the bidirectional data;
the v-if instruction is used for controlling the display and hidden state of the modal frame;
the @ submit event listener is for blocking default commit events for the form;
the slice method is used for deleting the object information;
the navigator clipboard method is used to copy object information into a clipboard.
Step 2.3 determining the relational layer data structure and back end interface development
Step 2.3.1, using Json format storage to manage relationship layer object management metadata and relationship layer object metadata;
step 2.3.2, developing methods of getObj, addObj, updateObj, deleteObj and the like by using Java and SpringBoot frameworks, so as to realize the management of checking, adding, modifying and deleting:
the creation object class Obj is used to store the relational layer object information, defining the following attributes:
privateLongid;
privateStringname;
privateStringinfo;
creating corresponding constructors, getter and setter methods;
an interface method for acquiring object information according to id is added on the basis of the previous method, and other interface methods are realized in detail. The concrete explanation is as follows:
the newly added getObj method can acquire the information of the finger object according to the id;
in the addObj method, a self-increment id is allocated for each object, and the objects are added into a list;
the updateObj method searches the object according to the input id and updates the information thereof;
the deleteObj method deletes the corresponding object according to the entered id.
Step 2.4, designing and developing a relationship layer front end display page and a relationship layer editing interface, realizing a physical model design function in Vue, and using join js to realize help drawing and operating a physical model diagram:
first, join js and its related dependencies need to be installed. npm install jointjs
JointJS is a JavaScript-based graphics framework that can be used to draw a physical model view. To render the physical model view using JointJS, the following steps are followed:
introduce JointJS library: the JointJS library file is imported in an HTML page, either by downloading and adding it to your project, or using an online CDN.
<script src="https://cdnjs.cloudflare.com/ajax/libs/jointjs/3.4.0/joint.js"></script>
<linkrel="stylesheet"href="https://cdnjs.cloudflare.com/ajax/libs/jointjs/3.4.0/joint.css"/>
Creating a canvas: a canvas, which is a container for exposing a physical model, is created using the join. Dia. Paper class provided by JointJS.
In the above code, 'paper' is an ID of an HTML element, indicating that a canvas is to be inserted into the element.
Defining nodes and connecting lines: the join. Shapes namespace provided by JointJS is used to define patterns, behaviors, etc. of nodes and joins.
In the above code, we create a rectangular node rect and a link. The position, the size, the style and other attributes of the nodes and the connecting lines can be set according to actual requirements.
Adding nodes and links to the canvas: the method of the paper model is used to add nodes and wires to the model of the canvas.
paper.model.addCell(rect);
paper.model.addCell(link);
Rendering canvas: the paper render () method is called to render the canvas, exposing the physical model view.
paper.render();
Step 2.5 realizing the processing and storage of relational layer object data
Step 2.5.1, the edited relation layer object can realize the association between different bottom tables of different fields or indexes;
step 2.5.2 dynamically acquiring index calculation sentences through the well-carded wind control index flow metadata table, and acquiring complete data complete paths and levels through depth, wherein the bottom table uses a summarized good index bottom table:
if the multiple index data paths are different, the relationship association is set through the step 2.4, and different indexes of the same path are logically combined;
step 2.5.3 storing BI (business intelligence) relational layer objects may be implemented using a database or other persistent store.
The class of the anti object represents a BI relational layer object, including id, name, and description fields. We will use JDBC and relational databases for store operations.
Step 2.5.3.1 creating a database table
First, a table structure is created in a database for storing BI relational layer objects. For example, a table named bi_secmanticjobject may be created for storing information of BI relational layer objects.
A table named bi_management_object is created, including id, name and description fields, for storing information of the BI relational layer object, respectively.
Step 2.5.3.2 next, java code is written to connect the databases and implement the storage and query functions of the BI relational layer objects.
A class named BISemanticObjectDatabase is created that includes methods for saving and retrieving BI relational layer objects:
step 2.5.3.3 where a BI relational layer object needs to be stored, the corresponding operation may be performed using the created BISemanticObjectDatabase class.
In the above example, we created a Main class and used the method of the BISemanticObjectDatabase class in Main method to save the BI relational layer object and used the search method to search and print out the information of the BI relational layer object from the database.
The use of MyBatis to query database data is very simple and convenient. I would give you a simple example here to demonstrate how to use MyBatis for database query operations.
First, you need to introduce MyBatis's dependencies in the project, if Maven is used, the following dependencies can be added to the pon.xml file:
suppose you have already a Java class named Obj, corresponding to the user table in the database. Next you need to create a Mapper XML file where the query statement and corresponding mapping relations are defined.
Then you need to create an interface to define the method of database operation and reference the query statement in the Mapper XML file created above in the interface.
Finally, a test class is written to call MyBatis for database query operations.
And constructing SqlSessionFactoy of MyBatis, acquiring an instance of the ObjMapper through the SqlSession, and finally calling a getObjByName method to query a database and output a result.
Step 2.6 developing import export functionality to facilitate migration
Step 2.6.1 exporting the relationship layer object file persisted in step 2.5 to a specified location (persisted object file copy function)
Here, a FileCopyExample class is created, and in the main method, fileInputStream and FileOutputStream are used to open source and destination files, and buffers are used to read and write data. After the InputStream and OutputStream are used, these resources are automatically turned off using try-with-resources statements to ensure that system resources are released in time.
At the same time, please ensure that sourceFile and targetFile are replaced with the path and name of the actual source and destination files. The buffer size can be adjusted if you need to copy large files or consider performance issues. In addition, if a folder or multiple files need to be replicated, a recursive approach may be used.
A recursive function copyFolder is used herein to replicate all files and subfolders in the source folder. Java I/O libraries are used to implement copy operations for files and folders.
Step 2.6.2 importing the relationship layer object file and recovering the relationship layer object in the platform
In Java, if a persistent object file is to be imported, it is necessary to use serialization and deserialization techniques. By serialization, java objects can be converted into byte arrays and saved to a file. Conversely, by deserializing, a byte sequence can be read from a file and restored to a Java object.
The following is a simple example demonstrating how Java objects are serialized and written to a file, and how byte sequences are read from a file and de-serialized into Java objects:
/>
a MyObject class is first created and a serizable interface is implemented to allow objects of the class to be serialized and deserialized. Then, a persistent object myObject is created and serialized and saved to a file using ObjectOutputStream.
Next, byte sequences are read from the file using ObjectInputStream and are inverse-sequenced into Java objects. Finally, the message of the restored object is printed.
When Java objects are serialized into a file, the included objects also realize a serizable interface. Furthermore, if multiple objects need to be written to the same file, they can be stored in a collection and the collection serialized and de-serialized.
And finally, adding corresponding functions such as error processing, log recording and the like to improve the robustness and maintainability of the program.
Developing the layout, style and mode of the visual interface, including report making editing, early warning conditions and timing conditions; based on report data set back end interface development, report making editing, early warning conditions and timing conditions, early warning data are sent to enterprise WeChat through the back end interface, and relevant strategies and business personnel are notified.
In the above technical solution, the step 3 specifically includes:
and 3.1, determining elements such as a table, a chart, a dashboard and the like which need to be contained. Pay attention to readability and understandability of the report, and easiness and convenience of use;
using Vue development to implement visualization, you can use various layout and style techniques to create the layout and style of the report; using the CSS layout library: popular CSS layout libraries, such as Bootstrap, tailwindCSS or elementUI, etc., can be used that provide a large number of predefined styles and components, making layout and style development more convenient;
setting a background picture, background color, font style, font size, font color, component size and color;
step 3.2 in Vue, custom components are created to build the various parts of the report. One < table-report > component is used to display table data, one < chart-report > component is used to display charts, and one < report-filters > component is used for the report data screening function.
/>
Step 3.3 uses Flexbox layout: flexbox is a powerful CSS layout technique that can help you create a flexible, responsive layout. By setting the display: flex attribute of the container and the flex attribute of the items, the position, size, and order of the items in the container can be easily controlled.
The following steps may be used in connection with Flexbox in Vue:
a container element, e.g., a < div > tag, containing a Flex layout is defined in the template of the Vue component. The properties and styles of flexboxes, such as display: flex and flex-direction, are applied on container elements. Sub-elements requiring layout, such as < div > tags, are added inside the container element as Flex items.
Flex entries are dynamically generated using the data binding and loop instructions of Vue.
/>
Here, the loop instruction v-for of Vue is used to traverse the items array and generate one Flex item for each array item. By using the properties and styles of the Flexbox, a Flex layout in a horizontal direction can be achieved with 10px spacing between subelements, and Flex entries can be automatically filled with blanks according to size.
The properties and style of the Flex layout may be adjusted as desired, such as changing direction, alignment, spacing, etc. Flex entries may be dynamically generated and updated using the data binding and loop instructions of Vue, making layout more flexible and responsive.
Using Grid layout: CSSGrid is a technique for creating complex layouts. It allows the grid to be divided into rows and columns and creates a flexible layout by setting the position and size of the grid items.
Step 3.5 combining CSS Grid in Vue, the following steps can be used:
a container element, such as a < div > tag, containing a grid layout is defined in the template of the Vue component.
Attributes and styles of CSSGrid, such as display: grid and grid-template-columns, are applied on container elements.
Sub-elements requiring layout, such as < div > tags, are added inside the container element as grid items.
Grid items are dynamically generated using data binding and loop instructions of Vue.
The following is a simple example:
/>
step 3.5 reading the relational layer metadata in step 2 and exposing the function implementation
To invoke the backend interface in the Vue and expose the data, you can send HTTP requests using the HTTP library of Vue (e.g., axios) and bind the returned data into the Vue component for exposure.
The following is one example of invoking a backend interface and exposing data using Vue and axios:
/>
the axios library was first led. Then, fields arrays are defined in the Vue component to hold the relational layer object field index data obtained from the backend interfaces.
In the fetchData method, we send GET requests to the backend/api/fields interface using axios. After the data is successfully acquired, the returned data is assigned to the fields array, then the array is traversed in the template by using a v-for instruction, and the name and data source information and metadata of each relation layer object are displayed.
Step 3.6 development of data screening function in report editing
And realizing a draggable report screening box function in the Vue, and using a third party library Vue-dragable-resettable. The library provides components which can be dragged and adjusted in size, and is very suitable for realizing the layout and interaction effect of the report screening frame,
First, you need to install vue-dragable-resettable libraries in the project, which can be installed through npm:
npm install vue-draggable-resizable–save
then, the DraggbleResponsable component of the Vue-Draggable-resettable library is used in the components of Vue:
/>
/>
here, the DraggbleResizable component of the vue-Draggable-resettable library is used to wrap the contents of the report filter box, bind and encapsulate the dimension data, traverse the filters array through the v-for instruction, and create a plurality of dragable and resizable filter boxes.
Filters arrays are defined in the data attribute, and each filter box has a unique id, position information x and y, width w and height h, and the content label of the filter box. The minimum size of the filter box is limited by setting the min-width and min-height attributes.
And 3.7, the user can use the relation layer object in the step 2 as a data source to configure, acquire the index and the field, only need to drag the field or the index and the dimension, drag the dimension to the screening if the data is required to be screened, and add the screening condition value to generate the index table.
Step 3.8 index self-defining timing early warning function front end development
Step 3.8.1 early warning rule setting interface development
First, a Vue component named alert monitor is created, which contains the logic to monitor the data and trigger the pre-alarm:
/>
step 3.8.2, developing a timing sending rule front-end interface;
developing timing rule creation, editing, deletion functions using vue
Step 3.8.3 enterprise WeChat and mail sending interface development
First, a component named SendMessage is created in the Vue component, which contains logic to send enterprise WeChat messages and send mail:
a Vue component named SendMessage is created, and buttons for sending enterprise WeChat messages and sending e-mails are shown in the page. In the sendWeChatMessage method, a back-end interface is called to send enterprise WeChatMessage messages, and a successful or failed response is processed. In the sendEmail method, a back-end interface is invoked to send an email and also to process a successful or failed response.
When the threshold in step 3.8.1 is met and the timing rules in step 3.8.2 are met, an early warning message may be sent via the enterprise WeChat id or mailbox address configured in 3.8.3.
Step 3.9 index self-defining timing early-warning function back end
Step 3.9.1 first implements a custom threshold early warning function in Java, and may use a timed task or event listener to monitor data and trigger early warning when a specific threshold is reached.
First, a service class named Threshold alert service is created, which contains the logic to monitor data and trigger pre-warning: a Threshold alert service class is created and the @ Scheduled annotation tag checkThreshold method is used to set the alert delivery rules, here set to dynamic settings. In the checkThreshold method, current data are acquired and whether a preset threshold is exceeded or not is checked, and if yes, early warning is triggered.
In the fetchdatafrom source method, logic is written to obtain the actual data, such as obtaining the current data from a database, interface, or file.
In triggerAlert methods, logic may be written that triggers the alert, such as invoking a mail sending interface, a short message sending interface, or a message pushing interface to send the alert information.
Finally, it is ensured that the @ enabling scheduling annotation is used in the startup class of the Spring Boot application to enable the timed task scheduling function, as illustrated in the previous example.
Step 3.9.2 develop early warning timing rules interface
In Java development, a Spring framework may be used to implement a rule interface for add-drop-Check (CRUD). The following is a simple example demonstrating how to create a rule interface with basic pruning and checking functions using Spring Boot:
creating an entity class named Rule, which represents a Rule object:
creating an interface named Rule repositionist, inheriting from the jpa repositionist, for operating database operations of Rule entities:
creating a service class named RuleService for processing business logic:
creating a controller class named RuleController for processing HTTP requests and returning responses:
in the code, a Spring Boot, JPA and Spring MVC are used to create a rule interface with a basic addition, deletion and check function. By accessing the corresponding HTTP endpoint, an add-drop-check operation on the rule data may be performed.
Step 3.9.3 develop enterprise WeChat mailbox send mail
The mail is sent by using an enterprise WeChat mailbox in Java, and can be realized by using a Java mail API and an SMTP server of enterprise WeChat.
First, ensure you have added dependencies of the JavaMail API. You can add the corresponding dependencies in Maven or Gradle profiles:
/>
a WxEmailSender class is created in which the sendEmail method can be used to send enterprise WeChat mail. Wherein the following variables:
email_host, SMTP server address of enterprise WeChat mailbox.
Email_port, SMTP server PORT number for enterprise WeChat mailbox.
Email_username: user name of enterprise micro mailbox (full mailbox address).
Email_password, the PASSWORD of the enterprise WeChat mailbox.
Through the steps, the device for inquiring and early warning the monitored index based on the MPP wind control data mart index is completed, and for strategies and analysts which do not develop experience, the tool is used for focusing on the index condition, monitoring the concerned index data, early warning is carried out on indexes which do not accord with expectations, and the service condition and strategy model adjustment are followed timely.
According to a second aspect of the present invention, an embodiment of the present invention provides an MPP-based system for querying service indexes of a wind-controlled data mart, including:
the first development module is used for designing and developing a data source connection type interface and a relational database to acquire metadata and a data source;
the second development module is used for reading the source data based on the provided interface, designing and developing a report data set relation layer back end interface, creating an add-delete-change function, and providing a data back end interface and a report relation layer front end visual interface for the visual interface;
the third development module is used for designing and developing the layout, style and mode of the visual interface, including report making and editing, early warning conditions and timing conditions; based on report data set back end interface development, report making editing, early warning conditions and timing conditions, early warning data are sent to enterprise WeChat through the back end interface, and relevant strategies and business personnel are notified.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. The MPP-based air control data mart business index query method is characterized by comprising the following steps of:
step 1, developing a data source connection type interface and a relational database to acquire metadata and a data source;
step 2, reading source data based on the provided interface, designing and developing a report data set relation layer back end interface, creating an add-delete-change function, and providing a data back end interface and a report relation layer front end visual interface for the visual interface;
developing the layout, style and mode of the visual interface, including report making editing, early warning conditions and timing conditions; based on report data set back end interface development, report making editing, early warning conditions and timing conditions, early warning data are sent to enterprise WeChat through the back end interface, and relevant strategies and business personnel are notified.
2. The MPP-based business index query method of the air control data mart of claim 1, wherein said step 1 comprises the steps of:
step 1.1, creating a Maven or Gradle project by using an integrated development environment developed by java language, and developing a database connection interface;
step 1.2, creating a Maven or Gradle project by using an integrated development environment developed by java language, and developing an EXCEL file data source interface; in Java, excel data is parsed using the Apache POI library.
3. The MPP-based business index query method of the air control data mart of claim 1, wherein said step 2 comprises the steps of:
step 2.1, developing a metadata module, namely reading a data source through the step 1, acquiring metadata information, and acquiring metadata information of a table and a column of a database according to the connection of the data source in the step 1;
step 2.2, designing and developing a front-end management page of the relation layer, wherein the front-end management page comprises functions of creating a relation object, deleting, editing and copying and pasting: the responsive data binding and event processing functions of the Vue are used, so that the operations of adding, deleting, modifying, searching, copying and pasting the object list are realized;
step 2.3, designing, developing and determining a relational layer data structure and a back-end interface;
step 2.4, designing a front-end display page of a development relation layer and a relation layer editing interface, realizing a physical model design function in Vue, and using join js to realize help drawing and operating a physical model diagram;
step 2.5, realizing the processing and storage of the relational layer object data;
and 2.6, developing the import and export functions to facilitate the transplantation.
4. The MPP-based business index query method of the air control data mart of claim 3, wherein said step 2.3 comprises the steps of:
step 2.3.1, defining a Json data structure by using Json format storage, and managing relationship layer object management metadata and relationship layer object metadata;
and 2.3.2, creating a back-end API interface by using Java and Spring Boot frames to perform deletion, examination and management, and correspondingly implementing other interface methods in detail according to the interface method for acquiring the object information by id.
5. The MPP-based business index query method of the air control data mart of claim 3, wherein said step 2.5 comprises the steps of:
step 2.5.1, editing the relation layer object to realize the association between different bottom tables of different fields or indexes;
step 2.5.2, dynamically acquiring index calculation sentences through the well-carded wind control index flow metadata table, and obtaining complete paths and levels of data through depth, wherein a bottom table uses a well-carded index bottom table; if the multiple index data paths are different, the relationship association is set through the step 2.4, and different indexes of the same path are logically combined;
step 2.5.3. Storing BI relational layer objects is accomplished through the use of a database or other persistent store.
6. The MPP-based business index query method of a pneumatic control data mart of claim 5, wherein said step 2.5.3 comprises the steps of:
step 2.5.3.1, creating a database table, and creating a table structure for storing BI relation layer objects in the database;
2.5.3.2, writing Java codes to connect databases and realize the storage and query functions of BI relational layer objects;
step 2.5.3.3 where the BI relational layer object needs to be stored, the corresponding operations are performed using the created class.
7. The MPP-based business index query method of the air control data mart of claim 1, wherein said step 3 comprises the steps of:
step 3.1, determining the elements of a table, a chart and an instrument panel to be contained;
step 3.2, in the Vue, creating a custom component to construct each part of the report;
step 3.3. Using the Flexbox layout, controlling the position, size and order of items in the container by setting the display: flex attribute of the container and the flex attribute of the items;
step 3.4, dynamically generating Flex items by using data binding and circulating instructions of the Vue;
step 3.5, reading the metadata of the relation layer in the step 2 and displaying the function implementation;
step 3.6, designing a data screening function in report editing;
step 3.7, applying the relation layer object in the step 2 as data source configuration to obtain indexes and fields; if the data are required to be screened, the dimension can be dragged to be screened, and a screening condition value is added, so that an index table can be generated;
step 3.8, designing the front end of the development index custom timing early warning function;
and 3.9. The index self-defining timing early warning function back end.
8. The MPP-based business index query method of the air control data mart of claim 7, wherein said step 3.8 comprises the steps of:
step 3.8.1, designing and developing an early warning rule setting interface, and creating a Vue component which contains monitoring data and logic for triggering early warning:
3.8.2 developing a timing sending rule front-end interface, creating, editing and deleting functions by using vue development timing rules;
3.8.3, developing an enterprise WeChat and mail sending interface, creating a Vue component named SendMessage, and displaying a button for sending enterprise WeChat information and sending electronic mail in a page; in the sendWechatMessage method, a back-end interface is called to send enterprise WeChatMessage information, and a successful or failed response is processed; in the sendEmail method, a back-end interface is called to send an email, and a successful or failed response is processed as well;
when the threshold in step 3.8.1 is met and the timing rule in step 3.8.2 is met, an early warning message is sent via the enterprise WeChat id or mailbox address configured in 3.8.3.
9. The MPP-based business index query method of the air control data mart of claim 7, wherein said step 3.9 comprises the steps of:
3.9.1, realizing a self-defined threshold early warning function in Java, monitoring data by using a timing task or an event monitor, and triggering early warning when a specific threshold is reached;
3.9.2 develop early warning timing rule interface, in Java development, use Spring frame to realize adding, deleting, modifying and checking rule interface;
and 3.9.3, developing an enterprise WeChat mailbox to send the mail, and using the enterprise WeChat mailbox to send the mail in Java by using a Java mail API in combination with an SMTP server of the enterprise WeChat.
10. An MPP-based air control data mart business index query system, comprising:
the first development module is used for designing and developing a data source connection type interface and a relational database to acquire metadata and a data source;
the second development module is used for reading the source data based on the provided interface, designing and developing a report data set relation layer back end interface, creating an add-delete-change function, and providing a data back end interface and a report relation layer front end visual interface for the visual interface;
the third development module is used for designing and developing the layout, style and mode of the visual interface, including report making and editing, early warning conditions and timing conditions; based on report data set back end interface development, report making editing, early warning conditions and timing conditions, early warning data are sent to enterprise WeChat through the back end interface, and relevant strategies and business personnel are notified.
CN202311836723.0A 2023-12-28 2023-12-28 MPP-based method and system for inquiring service indexes of air control data marts Pending CN117726178A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311836723.0A CN117726178A (en) 2023-12-28 2023-12-28 MPP-based method and system for inquiring service indexes of air control data marts

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311836723.0A CN117726178A (en) 2023-12-28 2023-12-28 MPP-based method and system for inquiring service indexes of air control data marts

Publications (1)

Publication Number Publication Date
CN117726178A true CN117726178A (en) 2024-03-19

Family

ID=90210679

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311836723.0A Pending CN117726178A (en) 2023-12-28 2023-12-28 MPP-based method and system for inquiring service indexes of air control data marts

Country Status (1)

Country Link
CN (1) CN117726178A (en)

Similar Documents

Publication Publication Date Title
US11526656B2 (en) Logical, recursive definition of data transformations
US11194793B1 (en) Dynamically materialized views for sheets based data
US11755606B2 (en) Dynamically updated data sheets using row links
US9483257B2 (en) Universal and adaptive software development platform for data-driven applications
US20130166550A1 (en) Integration of Tags and Object Data
JP7316349B2 (en) Customizable enterprise automation test framework
US7007266B1 (en) Method and software system for modularizing software components for business transaction applications
US20050114479A1 (en) System and method for hierarchically representing configuration items
AU2020298056B2 (en) Autolayout of visualizations based on graph data
KR20150063409A (en) Graphically representing programming attributes
US9015608B2 (en) Regenerating a user interface area
US20220269702A1 (en) Intelligent annotation of entity-relationship data models
US20230102947A1 (en) Providing operations in accordance with worksheet relationships and data object relationships
US20230418680A1 (en) Selective landscape element grouping facilitating landscape element consolidation or content installation
US20230418808A1 (en) Maintaining data separation for data consolidated from multiple data artifact instances
US11644949B2 (en) Autotagging a template of a reporting workbook
EP4290393A1 (en) Consolidation spaces providing access to multiple instances of application content
US11010140B2 (en) Integration of workflow and logical data objects using visual programming
US11977473B2 (en) Providing a pseudo language for manipulating complex variables of an orchestration flow
US20230418803A1 (en) Techniques for integrating data for multple instances of a data artifact
CN117726178A (en) MPP-based method and system for inquiring service indexes of air control data marts
US11222033B2 (en) Dynamic data retrieval and analytical chart rendering for data sets
US11074231B1 (en) Validating modifications to mapping statements for processing hierarchical data structures
US11899912B2 (en) Smart filtering in an overview page
Bara Oracle APEX Reporting Tips & Tricks

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination