CN114611044A - Data development system and method based on data warehouse - Google Patents

Data development system and method based on data warehouse Download PDF

Info

Publication number
CN114611044A
CN114611044A CN202210267858.9A CN202210267858A CN114611044A CN 114611044 A CN114611044 A CN 114611044A CN 202210267858 A CN202210267858 A CN 202210267858A CN 114611044 A CN114611044 A CN 114611044A
Authority
CN
China
Prior art keywords
development
data
color
unit
setting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210267858.9A
Other languages
Chinese (zh)
Other versions
CN114611044B (en
Inventor
陈军
张灿彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Red Net Technology Co ltd
Original Assignee
Jiangsu Red Net Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Red Net Technology Co ltd filed Critical Jiangsu Red Net Technology Co ltd
Priority to CN202210267858.9A priority Critical patent/CN114611044B/en
Publication of CN114611044A publication Critical patent/CN114611044A/en
Application granted granted Critical
Publication of CN114611044B publication Critical patent/CN114611044B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/958Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/957Browsing optimisation, e.g. caching or content distillation
    • G06F16/9577Optimising the visualization of content, e.g. distillation of HTML documents

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention discloses a data development system and a method based on a data warehouse, which comprises the data warehouse, a system development platform, a scheduling management system and an application platform, wherein the system development platform is used for designing and releasing project programs through a preset data model, the data warehouse and a development process by research personnel, and comprises a receiving module, a generating module, a designing module, an analyzing module and a function module; through each module in the system development platform, research and development personnel can intelligently, comprehensively, stably and conveniently process data and carry out reliable design project programs, the processing and design efficiency of the research and development personnel is improved, the operation process of the administrator and the research and development personnel based on the system development platform is improved, and the use effect, the good user experience and the human-computer interaction effect of the user of the system development platform are facilitated.

Description

Data development system and method based on data warehouse
Technical Field
The invention relates to the technical field of data processing, in particular to a data development system and a data development method based on a data warehouse.
Background
The data of the data warehouse is mainly used for enterprise decision analysis, and the data operation is mainly data query and is created for the purposes of analytic reporting and decision support. And providing guidance for business process improvement, monitoring time, cost, quality and control for enterprises needing business intelligence.
Data warehouses are structured data environments for decision support systems (dss) and online analytical application data sources. How to provide a comprehensive, intelligent, convenient, fast and stable data scheduling function for research and development personnel becomes an important problem existing in the using process of the research and development personnel. Generally, the development system in the current stage has fewer functions, is inconvenient for the operation of administrators and research and development personnel, affects the development efficiency of programmers, and is relatively complicated to manage by the administrators.
Disclosure of Invention
This section is for the purpose of summarizing some aspects of embodiments of the invention and to briefly introduce some preferred embodiments. In this section, as well as in the abstract and the title of the invention of this application, simplifications or omissions may be made to avoid obscuring the purpose of the section, the abstract and the title, and such simplifications or omissions are not intended to limit the scope of the invention.
The present invention has been made in view of the above-mentioned problems occurring in the conventional data processing.
Therefore, an object of the present invention is to provide a data development system and method based on a data warehouse, which utilize a system development platform to request a data warehouse to obtain data, so that a developer can intelligently, comprehensively, stably and conveniently process data through each module in the system development platform, perform a reliable design project, and improve the operation flow of a manager and the developer based on the system development platform, so as to facilitate the use of the system.
In order to solve the technical problems, the invention provides the following technical scheme: the method comprises the following steps:
the data warehouse is used for extracting the data of each data source system according to the selected data model to integrate and store and integrate;
the system development platform is used for setting a data model, a data warehouse and a development flow by an administrator, simultaneously used for designing and releasing a project program by research personnel through a preset data model, a preset data warehouse and a preset development flow, and comprises a receiving module, a generating module, a design module, an analysis module and a function module;
the scheduling management system is used for scheduling batch processing tasks related to a data warehouse of the system development platform;
the application platform is used for popularizing the service application of the design project program to a terminal user;
further, the receiving module is used for receiving a request sent by a research and development personnel, scheduling batch processing tasks to be scheduled by the management system and receiving data corresponding to each data source system in the data warehouse;
the generation module is used for generating data when the system development platform works;
the design module is used for designing and operating the project program according to the current project program requirement by research personnel, and comprises an attribute setting unit, a display unit and a display unit, wherein the attribute setting unit is used for adjusting the design basic program, appearance, font, other information data and position information data of the current project program;
the analysis module is used for setting window handles, webpage titles, tags, identifiers, names, indexes, types, class names, element coordinates, frame indexes, characters, values and indexes in the Web webpage and automatically acquiring information of the webpage;
the function module is used for color, image, mouse window handle, quick transparent drawing making, hot key, function using, project backup and source code color setting operation, comprises a color taking function unit, a color setting unit, a mouse window handle control unit, a mouse feature code unit, a transparent drawing making unit, a hot key management unit, a function calling unit, a project backup unit and an editor setting unit, and is started through a preset window handle of a graphical interface in the system development platform.
As a preferred embodiment of the data development system based on the data warehouse, the data development system comprises: the functional module also comprises a user management unit and an interface viewing unit;
the user management unit is used for logging in and editing accounts of research and development personnel and administrators, and specifically, server information, login date information, account set name information, research and development personnel name information and research and development personnel password information of logging in are edited or logged in;
and when the interface checking unit inquires the plug-in interface, the inquired plug-in path is selected, and the ID of the plug-in interface is input according to the plug-in path to carry out inquiry operation.
As a preferred embodiment of the data development system based on the data warehouse, the data development system comprises: the color taking function unit is used for controlling remarks, coordinates, color values, pre-colors and color cast of the hot keys;
the color setting unit is used for setting an x coordinate and a y coordinate and setting RGB generation colors and 16 system/10 system of colors;
the mouse window handle control unit is used for controlling the current mouse window information, and research personnel can check the window handle, the type and the window title of the current mouse, check the size of a window client area, copy, paste or move the handle class name or the handle title to an edit bar;
the mouse feature code unit is used for starting the hot key and setting the shape of the mouse and the shape feature code of the mouse;
the transparent drawing making unit is used for carrying out control operation on the ground color, the color value, the primary color, the color value and the color cast of an image on an original drawing to be processed;
the hot key management unit is used for selecting and setting the positions of a color taking hot key, a color cast hot key, a multi-point color grabbing hot key, a screen capture and color taking hot key, a mouse window grabbing hot key and a magnifier;
the function calling unit is used for calling a function by a command required by the current project program, specifically, editing character searching is carried out according to the command, and function prototype, function description, parameter description, return value description and calling example information of the command are checked;
the project backup unit is used for backing up the current project program information;
and the editor setting unit comprises an editor comprehensive setting unit, a source code color setting unit, an editor background color setting unit, an APK environment generation unit and other settings.
As a preferred embodiment of the data development system based on the data warehouse, the data development system comprises: the editor is comprehensively set for setting font style, size and bold and setting the number of empty lattices occupied by the TAB key;
setting source code colors, which are used for setting keyword colors, number colors, character string colors, TCAPL colors, annotation contents and text contents;
the background color setting of the editor is used for setting the background color of the editor, the background color of the folding and unfolding column, the color of the unfolding line, the line number, the power-off background color, the line number color, the breakpoint color, the current input line color, the selected text background color and the selected text color;
generating an APK environment for setting a Java path and automatically acquiring the path;
other settings comprise coding typesetting setting, and when research personnel select typesetting, remove blank lines and start typesetting, the typesetting format setting is intelligently optimized.
As a preferred embodiment of the data development system based on the data warehouse, the data development system comprises: the system development platform also comprises an engineering path setting unit and a page style setting unit;
the engineering path setting unit is used for setting a source file path, an output path and a resource path of a user in the engineering path;
when the page style setting unit sets the style of the page, the number of the field columns and the number of records displayed in each row can be set after selecting a page template.
As a preferred embodiment of the data development system based on the data warehouse, the data development system comprises: database types within the database repository include MySQL, Oracle, PostgreSQL, SQL server, VERTICA, ADS, Greenplus, Dameng, and Sybase;
data source types include unstructured data sources including HIVE, ES, KAFKA, FTP, HBASE, or SFTP.
As a preferable solution of the data development system based on the data warehouse of the present invention, wherein: the generation module comprises a generation unit, a compiling unit, a cleaning unit and an opening unit and is used for generating, compiling, cleaning and opening the system information.
A method for a data development system based on a data warehouse specifically comprises the following steps:
s1, the administrator and the research personnel correspondingly set and edit the login account through the user management unit, verify and log in, and establish connection with the system development platform;
s2, after the administrator and the research and development personnel log in the system development platform, the administrator sets and debugs the system information, and the research and development personnel design and develop the project program through the preset information;
s3, when a research and development staff carries out design based on a data model, a data warehouse and a development flow of the system development platform, the research and development staff sends a current required data warehouse information request to a scheduling management system, the scheduling management system schedules batch processing tasks related to the data warehouse, a receiving module of the system development platform receives data corresponding to each data source system in the data warehouse for the research and development staff to carry out design project program operation, the research and development staff analyzes unclear information through an analysis module and edits and sets information corresponding to the system development platform through a function module; the system development platform centralizes and regularly carries out maintenance operation on the system.
As a preferred embodiment of the method of the data warehouse-based data development system of the present invention, wherein: step S2 is specifically as follows:
s201, setting a development process by an administrator;
s202, setting a data model by an administrator;
s203, the data model is used for checking the development process and feeding back the check to be in line with the pass;
s204, designing a project program and issuing the design and development of the project program by a research and development staff through a preset data model, a data warehouse and a development flow;
and S205, sending the program code and the data model of the project after the completion, and executing the request issue.
The invention has the beneficial effects that: the data development system based on the data warehouse realizes development and editing of the application program, can improve the development efficiency of programmers, has rich system functions, can more quickly complete development and design, has the characteristics of accurate acquisition of system data requests, more intelligent operation, stable and reliable operation of the whole system, strong anti-interference capability, stable operation and the like, improves the operation process of managers and research and development personnel based on the system development platform, is convenient for the use of the system, and solves the problems of less functions and inconvenient use of the development system at the present stage;
in conclusion, the system development platform requests the data warehouse to acquire data, and research and development personnel can intelligently, comprehensively, stably and conveniently process the data through each module in the system development platform, perform reliable design project programs, improve the processing and design efficiency of the research and development personnel, improve the operation flow of the administrator and the research and development personnel based on the system development platform, and facilitate the user use effect, good user experience and human-computer interaction effect of the system development platform.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise. Wherein:
FIG. 1 is a block diagram of a system development platform according to an embodiment of the present invention;
FIG. 2 is a flowchart of a method for a developer and an administrator to use a system development platform according to an embodiment of the present invention;
FIG. 3 is a block diagram of functional modules in an embodiment of the invention;
FIG. 4 is a flowchart of a method for using a data development system according to an embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, but the present invention may be practiced in other ways than those specifically described and will be readily apparent to those of ordinary skill in the art without departing from the spirit of the present invention, and therefore the present invention is not limited to the specific embodiments disclosed below.
Furthermore, reference herein to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one implementation of the invention. The appearances of the phrase "in one embodiment" in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments.
Referring to FIG. 1, an embodiment of the present invention provides a data warehouse-based data development system. The data warehouse is used for extracting data of each data source system according to the selected data model to integrate and store and integrate;
the system development platform is used for setting a data model, a data warehouse and a development flow by an administrator, simultaneously used for designing and releasing a project program by research personnel through a preset data model, a preset data warehouse and a preset development flow, and comprises a receiving module, a generating module, a design module, an analysis module and a function module;
the scheduling management system is used for scheduling batch processing tasks related to a data warehouse of the system development platform;
the application platform is used for popularizing the service application of the design project program to a terminal user;
further, the receiving module is used for receiving a request sent by a research and development personnel, scheduling batch processing tasks to be scheduled by the management system and receiving data corresponding to each data source system in the data warehouse;
the generation module is used for generating data when the system development platform works; furthermore, the generating module comprises a generating unit, a compiling unit, a cleaning unit and an opening unit, and is used for generating, compiling, cleaning and opening the system information;
the design module is used for designing and operating the project program according to the current project program requirement by research personnel, and comprises an attribute setting unit, a display unit and a display unit, wherein the attribute setting unit is used for adjusting the design basic program, appearance, font, other information data and position information data of the current project program;
the analysis module is used for setting window handles, webpage titles, tags, identifiers, names, indexes, types, class names, element coordinates, frame indexes, characters, values and indexes in the Web webpage and automatically acquiring information of the webpage;
the function module is used for color, image, mouse window handle, quick transparent drawing making, hot key, function using, project backup and source code color setting operation, comprises a color taking function unit, a color setting unit, a mouse window handle control unit, a mouse feature code unit, a transparent drawing making unit, a hot key management unit, a function calling unit, a project backup unit and an editor setting unit, and is started through a preset window handle of a graphical interface in the system development platform.
Preferably, in this embodiment, the function module further includes a user management unit and an interface viewing unit; the user management unit is used for logging in and editing accounts of research and development personnel and administrators, and specifically, server information, login date information, account set name information, research and development personnel name information and research and development personnel password information of logging in are edited or logged in; and when the interface checking unit inquires the plug-in interface, the inquired plug-in path is selected, and the ID of the plug-in interface is input according to the plug-in path to carry out inquiry operation.
Referring to fig. 3, the following is a description of functional modules, as follows:
the color taking function unit is used for controlling remarks, coordinates, color values, pre-colors and color cast of the hot keys;
the color setting unit is used for setting an x coordinate and a y coordinate and setting RGB generation colors and 16 system/10 system of colors;
the mouse window handle control unit is used for controlling the current mouse window information, and research personnel can check the window handle, the type and the window title of the current mouse, check the size of a window client area, copy, paste or move the handle class name or the handle title to an edit bar;
the mouse feature code unit is used for starting the hot key and setting the shape of the mouse and the shape feature code of the mouse;
the transparent drawing making unit is used for carrying out control operation on the ground color, the color value, the primary color, the color value and the color cast of the image on the original drawing to be processed;
the hot key management unit is used for selecting and setting the positions of a color taking hot key, a color cast hot key, a multi-point color grabbing hot key, a screen capture and color taking hot key, a mouse window grabbing hot key and a magnifier;
the function calling unit is used for calling a function by a command required by the current project program, specifically, editing character searching is carried out according to the command, and function prototype, function description, parameter description, return value description and calling example information of the command are checked;
the project backup unit is used for backing up the current project program information;
and the editor setting unit comprises an editor comprehensive setting unit, a source code color setting unit, an editor background color setting unit, an APK environment generation unit and other settings.
In this embodiment, based on the above description, the editor comprehensively sets the font style, size, and bold size, and sets the number of empty spaces occupied by TAB keys;
setting source code color, which is used for setting keyword color, number color, character string color, TCAPL color, annotation content and text content;
the background color setting of the editor is used for setting the background color of the editor, the background color of the folding and unfolding column, the color of the unfolding line, the line number, the power-off background color, the line number color, the breakpoint color, the current input line color, the selected text background color and the selected text color;
generating an APK environment for setting a Java path and automatically acquiring the path;
other settings comprise coding typesetting setting, and when a research and development personnel selects typesetting, removes blank lines and opens typesetting, the typesetting format setting is intelligently optimized.
Meanwhile, the system development platform of the embodiment also comprises an engineering path setting unit and a page style setting unit; the engineering path setting unit is used for setting a source file path, an output path and a resource path of a user in the engineering path; when the page style setting unit sets the style of the page, the number of the field columns and the number of records displayed in each row can be set after selecting a page template.
The database types in the database of this embodiment include MySQL, Oracle, PostgreSQL, SQL server, VERTICA, ADS, greenplus, Dameng, and Sybase; data source types include unstructured data sources including HIVE, ES, KAFKA, FTP, HBASE, or SFTP.
Based on the above, the system development platform requests the data warehouse to acquire data, and research and development personnel can intelligently, comprehensively, stably and conveniently process data through each module in the system development platform, perform reliable design project procedures, and improve the processing and design efficiency of the research and development personnel.
The embodiment provides a method for a data development system based on a data warehouse based on the data development system based on the data warehouse, which specifically includes the following steps:
s1, the administrator and the research personnel correspondingly set and edit the login account through the user management unit, verify and log in, and establish connection with the system development platform;
s2, after the administrator and the research and development personnel log in the system development platform, the administrator sets and debugs the system information, and the research and development personnel design and develop the project program through the preset information;
s3, when a research and development staff carries out design based on a data model, a data warehouse and a development flow of the system development platform, the research and development staff sends a current required data warehouse information request to a scheduling management system, the scheduling management system schedules batch processing tasks related to the data warehouse, a receiving module of the system development platform receives data corresponding to each data source system in the data warehouse for the research and development staff to carry out design project program operation, the research and development staff analyzes unclear information through an analysis module and edits and sets information corresponding to the system development platform through a function module; the system development platform centralizes and regularly carries out maintenance operation on the system.
Further, step S2 is specifically as follows:
s201, setting a development process by an administrator;
s202, setting a data model by an administrator;
s203, the data model is used for checking the development process and feeding back the check to be in line with the pass;
s204, designing a project program and issuing the design and development of the project program by a research and development staff through a preset data model, a data warehouse and a development flow;
and S205, sending the program code and the data model of the project after the completion, and executing the request issue.
The data development system based on the data warehouse realizes development and editing of the application program, can improve the development efficiency of programmers, has rich system functions, can more quickly complete development and design, has the characteristics of accurate acquisition of system data requests, more intelligent operation, stable and reliable operation of the whole system, strong anti-interference capability, stable operation and the like, improves the operation process of managers and research and development personnel based on the system development platform so as to facilitate the use of the system, solves the problems of less functions and inconvenient use of the development system at the current stage, improves the operation process of the managers and the research and development personnel based on the system development platform, and is favorable for the user use effect, good user experience and human-computer interaction effect of the system development platform.
It should be noted that the above-mentioned embodiments are only for illustrating the technical solutions of the present invention and not for limiting, and although the present invention has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions may be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, which should be covered by the claims of the present invention.

Claims (9)

1. A data warehouse-based data development system, comprising:
the data warehouse is used for extracting the data of each data source system according to the selected data model to integrate and store and integrate;
the system development platform is used for setting a data model, a data warehouse and a development flow by an administrator, simultaneously used for designing and releasing a project program by research personnel through a preset data model, a preset data warehouse and a preset development flow, and comprises a receiving module, a generating module, a design module, an analysis module and a function module;
the scheduling management system is used for scheduling batch processing tasks related to a data warehouse of the system development platform;
the application platform is used for popularizing the service application of the design project program to a terminal user;
further, the receiving module is used for receiving a request sent by a research and development personnel, scheduling batch processing tasks to be scheduled by the management system and receiving data corresponding to each data source system in the data warehouse;
the generation module is used for generating data when the system development platform works;
the design module is used for designing and operating the project program according to the current project program requirement by research personnel, and comprises an attribute setting unit, a display unit and a display unit, wherein the attribute setting unit is used for adjusting the design basic program, appearance, font, other information data and position information data of the current project program;
the analysis module is used for setting window handles, webpage titles, tags, identifiers, names, indexes, types, class names, element coordinates, frame indexes, characters, values and indexes in the Web webpage and automatically acquiring information of the webpage;
the function module is used for color, image, mouse window handle, quick transparent drawing making, hot key, function using, project backup and source code color setting operation, comprises a color taking function unit, a color setting unit, a mouse window handle control unit, a mouse feature code unit, a transparent drawing making unit, a hot key management unit, a function calling unit, a project backup unit and an editor setting unit, and is started through a preset window handle of a graphical interface in the system development platform.
2. The data warehouse-based data development system of claim 1, wherein the function modules further include a user management unit and an interface viewing unit;
the user management unit is used for logging in and editing accounts of research and development personnel and administrators, and specifically, server information, login date information, account set name information, research and development personnel name information and research and development personnel password information of logging in are edited or logged in;
and when the interface checking unit inquires the plug-in interface, the inquired plug-in path is selected, and the ID of the plug-in interface is input according to the plug-in path to carry out inquiry operation.
3. The data warehouse-based data development system of claim 1,
the color taking function unit is used for controlling remarks, coordinates, color values, pre-colors and color cast of the hot keys;
the color setting unit is used for setting an x coordinate and a y coordinate and setting RGB generation colors and 16 system/10 system of colors;
the mouse window handle control unit is used for controlling the current mouse window information, and research personnel can check the window handle, the type and the window title of the current mouse, check the size of a window client area, copy, paste or move the handle class name or the handle title to an edit bar;
the mouse feature code unit is used for starting the hot key and setting the shape of the mouse and the shape feature code of the mouse;
the transparent drawing making unit is used for carrying out control operation on the ground color, the color value, the primary color, the color value and the color cast of the image on the original drawing to be processed;
the hot key management unit is used for selecting and setting the positions of a color taking hot key, a color cast hot key, a multi-point color grabbing hot key, a screen capture and color taking hot key, a mouse window grabbing hot key and a magnifier;
the function calling unit is used for calling a function by a command required by the current project program, specifically, performing character editing search according to the command, and checking a function prototype, function description, parameter description, return value description and calling example information of the command;
the project backup unit is used for backing up the current project program information;
and the editor setting unit comprises an editor comprehensive setting unit, a source code color setting unit, an editor background color setting unit, an APK environment generation unit and other settings.
4. The data warehouse-based data development system of claim 3, wherein the editor integrates settings for font style, size and bold settings, and TAB key occupancy space number settings;
setting source code color, which is used for setting keyword color, number color, character string color, TCAPL color, annotation content and text content;
the background color setting of the editor is used for setting the background color of the editor, the background color of the folded and unfolded columns, the color of the unfolded lines, the line number, the power-off background color, the line number color, the breakpoint color, the color of the current input line, the background color of the selected text and the color of the selected text;
generating an APK environment for setting a Java path and automatically acquiring the path;
other settings comprise coding typesetting setting, and when research personnel select typesetting, remove blank lines and start typesetting, the typesetting format setting is intelligently optimized.
5. The data warehouse-based data development system of claim 1, wherein the system development platform further comprises an engineering path setting unit and a page style setting unit;
the engineering path setting unit is used for setting a source file path, an output path and a resource path of a user in the engineering path;
when the page style setting unit sets the style of the page, the number of the field columns and the number of records displayed in each row can be set after selecting a page template.
6. The data warehouse-based data development system of claim 1, wherein the database types within the data warehouse include MySQL, Oracle, PostgreSQL, SQL server, VERTICA, ADS, greenplus, Dameng, and Sybase;
data source types include unstructured data sources including HIVE, ES, KAFKA, FTP, HBASE, or SFTP.
7. The data warehouse-based data development system of claim 1, wherein the generation module includes a generation unit, a compilation unit, a cleaning unit, and an opening unit for generation, compilation, cleaning, and opening of the system information.
8. The method for the data warehouse-based data development system according to any one of claims 1 to 7, characterized by comprising the following steps:
s1, the administrator and the research personnel correspondingly set and edit the login account through the user management unit, verify and log in, and establish connection with the system development platform;
s2, after the administrator and the research and development personnel log in the system development platform, the administrator sets and debugs the system information, and the research and development personnel design and develop the project program through the preset information;
s3, when a research and development staff carries out design based on a data model, a data warehouse and a development flow of the system development platform, the research and development staff sends a current required data warehouse information request to a scheduling management system, the scheduling management system schedules batch processing tasks related to the data warehouse, a receiving module of the system development platform receives data corresponding to each data source system in the data warehouse for the research and development staff to carry out design project program operation, the research and development staff analyzes unclear information through an analysis module and edits and sets information corresponding to the system development platform through a function module; the system development platform centralizes and regularly carries out maintenance operation on the system.
9. The data warehouse-based data development system and method as claimed in claim 8, wherein step S2 is as follows:
s201, setting a development process by an administrator;
s202, setting a data model by an administrator;
s203, the data model is checked in the development process and is fed back to be in accordance with the pass;
s204, designing a project program and issuing the design and development of the project program by a research and development staff through a preset data model, a data warehouse and a development flow;
and S205, sending the program code and the data model of the project after the completion, and executing the request issue.
CN202210267858.9A 2022-03-18 2022-03-18 Data development system and method based on data warehouse Active CN114611044B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210267858.9A CN114611044B (en) 2022-03-18 2022-03-18 Data development system and method based on data warehouse

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210267858.9A CN114611044B (en) 2022-03-18 2022-03-18 Data development system and method based on data warehouse

Publications (2)

Publication Number Publication Date
CN114611044A true CN114611044A (en) 2022-06-10
CN114611044B CN114611044B (en) 2022-12-27

Family

ID=81864692

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210267858.9A Active CN114611044B (en) 2022-03-18 2022-03-18 Data development system and method based on data warehouse

Country Status (1)

Country Link
CN (1) CN114611044B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103425778A (en) * 2013-08-16 2013-12-04 国家电网公司 Intelligent development platform for database application system
CN105608254A (en) * 2015-12-15 2016-05-25 宁波力芯科信息科技有限公司 Automated design method and platform oriented to intelligent hardware system development
CN105867892A (en) * 2015-11-18 2016-08-17 乐视致新电子科技(天津)有限公司 Centralized management method and system of multi-platform development
CN108229825A (en) * 2018-01-04 2018-06-29 焦点科技股份有限公司 A kind of BI management systems based on development process closed loop
CN110188149A (en) * 2019-06-04 2019-08-30 宁波银行股份有限公司 A kind of data warehouse
CN111078766A (en) * 2019-11-18 2020-04-28 江苏艾佳家居用品有限公司 Data warehouse model construction system and method based on multidimensional theory
CN111259068A (en) * 2020-04-28 2020-06-09 成都四方伟业软件股份有限公司 Data development method and system based on data warehouse
WO2021076363A1 (en) * 2019-10-19 2021-04-22 Microsoft Technology Licensing, Llc Data model transformation

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103425778A (en) * 2013-08-16 2013-12-04 国家电网公司 Intelligent development platform for database application system
CN105867892A (en) * 2015-11-18 2016-08-17 乐视致新电子科技(天津)有限公司 Centralized management method and system of multi-platform development
CN105608254A (en) * 2015-12-15 2016-05-25 宁波力芯科信息科技有限公司 Automated design method and platform oriented to intelligent hardware system development
CN108229825A (en) * 2018-01-04 2018-06-29 焦点科技股份有限公司 A kind of BI management systems based on development process closed loop
CN110188149A (en) * 2019-06-04 2019-08-30 宁波银行股份有限公司 A kind of data warehouse
WO2021076363A1 (en) * 2019-10-19 2021-04-22 Microsoft Technology Licensing, Llc Data model transformation
CN111078766A (en) * 2019-11-18 2020-04-28 江苏艾佳家居用品有限公司 Data warehouse model construction system and method based on multidimensional theory
CN111259068A (en) * 2020-04-28 2020-06-09 成都四方伟业软件股份有限公司 Data development method and system based on data warehouse

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
孙洪喜等: "智能化报表开发平台的研发及应用", 《橡塑技术与装备》 *
张译等: "基于数据仓库的电网数据分析系统的设计与开发", 《电子测量技术》 *

Also Published As

Publication number Publication date
CN114611044B (en) 2022-12-27

Similar Documents

Publication Publication Date Title
JP7093387B2 (en) Spreadsheet-based software application development
JP2021028828A6 (en) Spreadsheet-based software application development
US9678719B1 (en) System and software for creation and modification of software
US20050154993A1 (en) Automatic reference note generator
CN106445536B (en) Automatic business design management system
US20220335023A1 (en) Database validation and repair tool
CN111240648B (en) Intelligent management system and method for variables
CN105956087A (en) Data and code version management system and method
CN111080263B (en) Visual collaborative analysis system based on thought-guide graph
US9244707B2 (en) Transforming user interface actions to script commands
Edwards et al. RECAST: Reverse engineering from COBOL to SSADM specification
JP7055064B2 (en) Database migration support system and program
CN112817964B (en) Index billboard design and development system based on process robot
CN114611044B (en) Data development system and method based on data warehouse
CN114647735A (en) Relation graph display method, medium and display device
Wu The application and management system of scientific research projects based on PHP and MySQL
CN108766513B (en) Intelligent health medical data structured processing system
CN115510361A (en) Data chart page generation method based on visual configuration and related equipment
WO2023045053A1 (en) File comparison method and apparatus based on rpa and ai, device, and storage medium
EP1744271A1 (en) Document processing device
Grahl et al. The new W7-X logbook–A software for effective experiment documentation and collaborative research at Wendelstein 7-X
KR20130068633A (en) Apparatus and method for visualizing data
US11507728B2 (en) Click to document
CN114935996B (en) Method, computer device and storage medium for online processing of documents
US11113322B2 (en) Dynamically generating strategic planning datasets based on collecting, aggregating, and filtering distributed data collections

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant