CN114611044B - Data development system and method based on data warehouse - Google Patents

Data development system and method based on data warehouse Download PDF

Info

Publication number
CN114611044B
CN114611044B CN202210267858.9A CN202210267858A CN114611044B CN 114611044 B CN114611044 B CN 114611044B CN 202210267858 A CN202210267858 A CN 202210267858A CN 114611044 B CN114611044 B CN 114611044B
Authority
CN
China
Prior art keywords
development
data
unit
color
setting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210267858.9A
Other languages
Chinese (zh)
Other versions
CN114611044A (en
Inventor
陈军
张灿彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Red Net Technology Co ltd
Original Assignee
Jiangsu Red Net Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Red Net Technology Co ltd filed Critical Jiangsu Red Net Technology Co ltd
Priority to CN202210267858.9A priority Critical patent/CN114611044B/en
Publication of CN114611044A publication Critical patent/CN114611044A/en
Application granted granted Critical
Publication of CN114611044B publication Critical patent/CN114611044B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/958Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/957Browsing optimisation, e.g. caching or content distillation
    • G06F16/9577Optimising the visualization of content, e.g. distillation of HTML documents

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention discloses a data development system and a method based on a data warehouse, which comprises the data warehouse, a system development platform, a scheduling management system and an application platform, wherein the system development platform is used for designing and releasing project programs through a preset data model, the data warehouse and a development process by research personnel, and comprises a receiving module, a generating module, a designing module, an analyzing module and a function module; through each module in the system development platform, research and development personnel can intelligently, comprehensively, stably and conveniently process data to carry out reliable design project programs, processing and design efficiency of the research and development personnel is improved, operation procedures of managers and the research and development personnel based on the system development platform are improved, and the system development platform is beneficial to user use effect, good user experience and human-computer interaction effect.

Description

Data development system and method based on data warehouse
Technical Field
The invention relates to the technical field of data processing, in particular to a data development system and a data development method based on a data warehouse.
Background
The data of the data warehouse is mainly used for enterprise decision analysis, and the data operation is mainly data query and is created for the purposes of analytic reporting and decision support. And providing guidance for business process improvement, monitoring time, cost, quality and control for enterprises needing business intelligence.
Data warehouses are structured data environments for decision support systems (dss) and online analytical application data sources. How to provide a comprehensive, intelligent, convenient, fast and stable data scheduling function for research and development personnel becomes an important problem existing in the using process of the research and development personnel. Generally, the development system in the current stage has fewer functions, is inconvenient for the operation of administrators and research and development personnel, affects the development efficiency of programmers, and is relatively complicated to manage by the administrators.
Disclosure of Invention
This section is for the purpose of summarizing some aspects of embodiments of the invention and to briefly introduce some preferred embodiments. In this section, as well as in the abstract and the title of the invention of this application, simplifications or omissions may be made to avoid obscuring the purpose of the section, the abstract and the title, and such simplifications or omissions are not intended to limit the scope of the invention.
The present invention has been made in view of the above-mentioned problems in the conventional data processing.
Therefore, an object of the present invention is to provide a data development system and method based on a data warehouse, which utilize a system development platform to request a data warehouse to obtain data, so that a developer can intelligently, comprehensively, stably and conveniently process data through each module in the system development platform, perform a reliable design project, and improve the operation flow of a manager and the developer based on the system development platform, so as to facilitate the use of the system.
In order to solve the technical problems, the invention provides the following technical scheme: the method comprises the following steps:
the data warehouse is used for extracting the data of each data source system according to the selected data model to integrate and store and integrate;
the system development platform is used for setting a data model, a data warehouse and a development flow by an administrator, simultaneously used for designing and releasing a project program through a preset data model, a preset data warehouse and a preset development flow by research personnel, and comprises a receiving module, a generating module, a design module, an analysis module and a function module;
the scheduling management system is used for scheduling batch processing tasks related to a data warehouse of the system development platform;
the application platform is used for popularizing the service application of the design project program to a terminal user;
further, the receiving module is used for receiving a request sent by a research and development personnel, scheduling batch processing tasks to be scheduled by the management system, and receiving data corresponding to each data source system in the data warehouse;
the generation module is used for generating data when the system development platform works;
the design module is used for a research and development worker to design and operate a project program according to the current project program requirement, and comprises an attribute setting unit, a display unit and a display unit, wherein the attribute setting unit is used for adjusting the design basic program, appearance, font, other information and position information data of the current project program;
the analysis module is used for setting window handles, webpage titles, tags, identifiers, names, indexes, types, class names, element coordinates, frame indexes, characters, values and indexes in the Web webpage and automatically acquiring information of the webpage;
the function module is used for color, image, mouse window handle, quick transparent graph making, hot key, function using, project backup and source code color setting operation, comprises a color taking function unit, a color setting unit, a mouse window handle control unit, a mouse feature code unit, a transparent graph making unit, a hot key management unit, a function calling unit, a project backup unit and an editor setting unit, and is started through a preset window handle of a graphical interface in the system development platform.
As a preferred embodiment of the data development system based on the data warehouse, the data development system comprises: the functional module also comprises a user management unit and an interface viewing unit;
the user management unit is used for editing the logged-in server information, the logged-in date information, the logged-in account name information, the logged-in name information of the research and development personnel and the password information of the research and development personnel after logging in;
and when the interface checking unit inquires the plug-in interface, the inquired plug-in path is selected, and the ID of the plug-in interface is input according to the plug-in path to carry out inquiry operation.
As a preferable solution of the data development system based on the data warehouse of the present invention, wherein: the color taking function unit is used for controlling remarks, coordinates, color values, pre-colors and color cast of the hot keys;
the color setting unit is used for setting an x coordinate and a y coordinate and setting RGB generation colors and 16 system/10 system of colors;
the mouse window handle control unit is used for controlling the current mouse window information, and research personnel can check the window handle, the type and the window title of the current mouse, check the size of a window client area, copy, paste or move the handle class name or the handle title to an edit bar;
the mouse feature code unit is used for starting the hot key and setting the shape of the mouse and the shape feature code of the mouse;
the transparent drawing making unit is used for controlling the ground color, the color value, the primary color and the color cast of the image of the original drawing to be processed;
the hot key management unit is used for selecting and setting the positions of a color taking hot key, a color cast hot key, a multi-point color grabbing hot key, a screen capture and color taking hot key, a mouse window grabbing hot key and a magnifier;
the function calling unit is used for calling a function by a command required by the current project program, specifically, editing character searching is carried out according to the command, and function prototype, function description, parameter description, return value description and calling example information of the command are checked;
the project backup unit is used for backing up the program information of the current project;
and the editor setting unit comprises an editor comprehensive setting unit, a source code color setting unit, an editor background color setting unit, an APK environment generation unit and other settings.
As a preferable solution of the data development system based on the data warehouse of the present invention, wherein: the editor is comprehensively set for setting font style, size and bold and setting the number of empty lattices occupied by the TAB key;
setting source code color, which is used for setting keyword color, number color, character string color, TCAPL color, annotation content and text content;
the background color setting of the editor is used for setting the background color of the editor, the background color of the folded and unfolded columns, the color of the unfolded lines, the line number, the power-off background color, the line number color, the breakpoint color, the color of the current input line, the background color of the selected text and the color of the selected text;
generating an APK environment for setting a Java path and automatically acquiring the path;
other settings comprise coding typesetting setting, and when research personnel select typesetting, remove blank lines and start typesetting, the typesetting format setting is intelligently optimized.
As a preferred embodiment of the data development system based on the data warehouse, the data development system comprises: the system development platform also comprises an engineering path setting unit and a page style setting unit;
the engineering path setting unit is used for setting a source file path, an output path and a resource path in the engineering path;
when the page style setting unit sets the style of the page, the number of the field columns and the number of the records displayed in each row can be set after the page template is selected.
As a preferable solution of the data development system based on the data warehouse of the present invention, wherein: database types within the database warehouse include MySQL, oracle, postgreSQL, SQL server, VERTICA, ADS, greenplus, dameng, and Sybase;
data source types include unstructured data sources including HIVE, ES, KAFKA, FTP, HBASE, or SFTP.
As a preferred embodiment of the data development system based on the data warehouse, the data development system comprises: the generation module comprises a generation unit, a compiling unit, a cleaning unit and an opening unit and is used for generating, compiling, cleaning and opening the system information.
A method for a data development system based on a data warehouse specifically comprises the following steps:
s1, correspondingly setting and editing a login account by an administrator and research personnel through a user management unit, verifying and logging in, and establishing connection with a system development platform;
s2, after a manager and a research and development worker log in a system development platform, the manager sets and debugs system information, and the research and development worker designs and develops a project program through preset information;
s3, using and maintaining a system development platform, wherein when a research and development staff designs based on a data model, a data warehouse and a development flow of the system development platform, the research and development staff sends a current required data warehouse information request to a scheduling management system, the scheduling management system schedules batch processing tasks related to the data warehouse, a receiving module of the system development platform receives data corresponding to each data source system in the data warehouse for the research and development staff to carry out design project program operation, and the research and development staff analyzes unclear information through an analysis module and edits and sets information corresponding to the system development platform through a function module; the system development platform centralizes and regularly carries out maintenance operation on the system.
As a preferable aspect of the method for a data warehouse based data development system according to the present invention, wherein: step S2 is specifically as follows:
s201, setting a development flow by an administrator;
s202, setting a data model by an administrator;
s203, the data model is used for checking the development process and feeding back the check to be in line with the pass;
s204, designing a project program and issuing the design and development of the project program by research personnel based on a preset data model, a data warehouse and a development flow;
and S205, sending the program code and the data model of the project after the completion, and executing the request issue.
The invention has the beneficial effects that: the data development system based on the data warehouse realizes development and editing of the application program, can improve the development efficiency of programmers, has rich system functions, can more quickly complete development and design, has the characteristics of accurate acquisition of system data requests, more intelligent operation, stable and reliable operation of the whole system, strong anti-interference capability, stable operation and the like, improves the operation process of managers and research and development personnel based on the system development platform, is convenient for the use of the system, and solves the problems of less functions and inconvenient use of the development system at the present stage;
in conclusion, the system development platform requests the data warehouse to acquire data, and research and development personnel can intelligently, comprehensively, stably and conveniently process the data through each module in the system development platform, perform reliable design project programs, improve the processing and design efficiency of the research and development personnel, improve the operation flow of the administrator and the research and development personnel based on the system development platform, and facilitate the user use effect, good user experience and human-computer interaction effect of the system development platform.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise. Wherein:
FIG. 1 is a block diagram of a modular architecture of a system development platform according to an embodiment of the present invention;
FIG. 2 is a flowchart of a method for a developer and an administrator to use a system development platform according to an embodiment of the present invention;
FIG. 3 is a block diagram of functional modules in an embodiment of the invention;
FIG. 4 is a flowchart of a method for using a data development system according to an embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, but the present invention may be practiced in other ways than those specifically described and will be readily apparent to those of ordinary skill in the art without departing from the spirit of the present invention, and therefore the present invention is not limited to the specific embodiments disclosed below.
Furthermore, reference herein to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one implementation of the invention. The appearances of the phrase "in one embodiment" in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments.
Referring to FIG. 1, an embodiment of the present invention provides a data warehouse-based data development system. The data warehouse is used for extracting data of each data source system according to the selected data model to integrate and store and integrate;
the system development platform is used for setting a data model, a data warehouse and a development flow by an administrator, simultaneously used for designing and releasing a project program by research personnel through a preset data model, a preset data warehouse and a preset development flow, and comprises a receiving module, a generating module, a design module, an analysis module and a function module;
the scheduling management system is used for scheduling batch processing tasks related to a data warehouse of the system development platform;
the application platform is used for popularizing the service application of the design project program to a terminal user;
furthermore, the receiving module is used for receiving a request sent by a research and development personnel, scheduling batch processing tasks to be scheduled by the management system, and receiving data corresponding to each data source system in the data warehouse;
the generation module is used for generating data when the system development platform works; furthermore, the generating module comprises a generating unit, a compiling unit, a cleaning unit and an opening unit, and is used for generating, compiling, cleaning and opening the system information;
the design module is used for a research and development worker to design and operate a project program according to the current project program requirement, and comprises an attribute setting unit, a display unit and a display unit, wherein the attribute setting unit is used for adjusting the design basic program, appearance, font, other information and position information data of the current project program;
the analysis module is used for setting window handles, webpage titles, tags, identifiers, names, indexes, types, class names, element coordinates, frame indexes, characters, values and indexes in the Web webpage and automatically acquiring information of the webpage;
the function module is used for color, image, mouse window handle, quick transparent graph making, hot key, function using, project backup and source code color setting operation, comprises a color taking function unit, a color setting unit, a mouse window handle control unit, a mouse feature code unit, a transparent graph making unit, a hot key management unit, a function calling unit, a project backup unit and an editor setting unit, and is started through a preset window handle of a graphical interface in the system development platform.
Preferably, in this embodiment, the function module further includes a user management unit and an interface viewing unit; the user management unit is used for editing the logged-in server information, the logged-in date information, the logged-in account name information, the logged-in name information of the research and development personnel and the password information of the research and development personnel after logging in; and when the interface checking unit inquires the plug-in interface, the inquired plug-in path is selected, and the ID of the plug-in interface is input according to the plug-in path to carry out inquiry operation.
Referring to fig. 3, the following is a description of the functional modules as follows:
the color taking function unit is used for controlling remarks, coordinates, color values, pre-colors and color cast of the hot keys;
the color setting unit is used for setting an x coordinate and a y coordinate and setting RGB generation colors and 16 system/10 system of colors;
the mouse window handle control unit is used for controlling the current mouse window information, and research personnel can check the window handle, the type and the window title of the current mouse, check the size of a window client area, copy, paste or move the handle class name or the handle title to an edit bar;
the mouse feature code unit is used for starting the hot key and setting the shape of the mouse and the shape feature code of the mouse;
the transparent drawing making unit is used for completing control operation of ground color, color value, primary color and color cast of the image on the original drawing to be processed;
the hot key management unit is used for selecting and setting the positions of a color taking hot key, a color cast hot key, a multi-point color grabbing hot key, a screen capture and color taking hot key, a mouse window grabbing hot key and a magnifier;
the function calling unit is used for calling a function by a command required by the current project program, specifically, editing character searching is carried out according to the command, and function prototype, function description, parameter description, return value description and calling example information of the command are checked;
the project backup unit is used for backing up the program information of the current project;
and the editor setting unit comprises an editor comprehensive setting unit, a source code color setting unit, an editor background color setting unit, an APK environment generation unit and other settings.
In this embodiment, based on the above requirement, the editor is comprehensively configured for font style, size, bold font and TAB key occupation space number;
setting source code color, which is used for setting keyword color, number color, character string color, TCAPL color, annotation content and text content;
the background color setting of the editor is used for setting the background color of the editor, the background color of the folded and unfolded columns, the color of the unfolded lines, the line number, the power-off background color, the line number color, the breakpoint color, the color of the current input line, the background color of the selected text and the color of the selected text;
generating an APK environment for setting a Java path and automatically acquiring the path;
other settings comprise coding typesetting setting, and when research personnel select typesetting, remove blank lines and start typesetting, the typesetting format setting is intelligently optimized.
Meanwhile, the system development platform of the embodiment also comprises an engineering path setting unit and a page style setting unit; the engineering path setting unit is used for setting a source file path, an output path and a resource path in the engineering path; when the page style setting unit sets the style of the page, the number of the field columns and the number of the records displayed in each row can be set after the page template is selected.
The database types in the database of this embodiment include MySQL, oracle, postgreSQL, SQL server, VERTICA, ADS, greenplus, dameng, and Sybase; the data source types include unstructured data sources, including HIVE, ES, KAFKA, FTP, HBASE, or SFTP.
Based on the above, the system development platform requests the data warehouse to acquire data, and research and development personnel can intelligently, comprehensively, stably and conveniently process data through each module in the system development platform, perform reliable design project procedures, and improve the processing and design efficiency of the research and development personnel.
The embodiment provides a method for a data development system based on a data warehouse based on the data development system based on the data warehouse, which specifically includes the following steps:
s1, correspondingly setting and editing a login account by an administrator and research personnel through a user management unit, verifying and logging in, and establishing connection with a system development platform;
s2, after a manager and a research and development worker log in a system development platform, the manager sets and debugs system information, and the research and development worker designs and develops a project program through preset information;
s3, using and maintaining a system development platform, wherein when a research and development person designs based on a data model, a data warehouse and a development flow of the system development platform, the research and development person sends a current required data warehouse information request to a scheduling management system, the scheduling management system schedules batch processing tasks related to the data warehouse, a receiving module of the system development platform receives data corresponding to each data source system in the data warehouse for the research and development person to carry out design project program operation, and the research and development person analyzes unclear information through an analysis module and edits and sets information corresponding to the system development platform through a function module; the system development platform centralizes and regularly carries out maintenance operation on the system.
Further, step S2 is specifically as follows:
s201, setting a development process by an administrator;
s202, setting a data model by an administrator;
s203, the data model is used for checking the development process and feeding back the check to be in line with the pass;
s204, designing a project program and issuing the design and development of the project program by research personnel based on a preset data model, a data warehouse and a development flow;
and S205, sending the program codes and the data models of the project after the completion, and executing the request issuing.
The data development system based on the data warehouse realizes development and editing of application programs, can improve development efficiency of programmers, is rich in system functions, can complete development and design more quickly, has the characteristics of accurate acquisition of system data requests, more intelligent operation, stable and reliable operation of the whole system, strong anti-interference capability, stable operation and the like, improves the operation process of managers and research and development personnel based on the system development platform so as to facilitate the use of the system, solves the problems of less functions and inconvenient use of the development system at the present stage, improves the operation process of the managers and the research and development personnel based on the system development platform, and is beneficial to the use effect of users of the system development platform, good user experience and human-computer interaction effect.
It should be noted that the above-mentioned embodiments are only for illustrating the technical solutions of the present invention and not for limiting, and although the present invention is described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, which should be covered by the claims of the present invention.

Claims (9)

1. A data warehouse-based data development system, comprising:
the data warehouse is used for extracting the data of each data source system according to the selected data model to integrate and store and integrate;
the system development platform is used for setting a data model, a data warehouse and a development flow by an administrator, simultaneously used for designing and releasing a project program through a preset data model, a preset data warehouse and a preset development flow by research personnel, and comprises a receiving module, a generating module, a design module, an analysis module and a function module;
the scheduling management system is used for scheduling batch processing tasks related to a data warehouse of the system development platform;
the application platform is used for popularizing the service application of the design project program to a terminal user;
further, the receiving module is used for receiving a request sent by a research and development personnel, scheduling batch processing tasks to be scheduled by the management system and receiving data corresponding to each data source system in the data warehouse;
the generation module is used for generating data when the system development platform works;
the design module is used for designing and operating the project program according to the current project program requirement by research personnel, and comprises an attribute setting unit, a display unit and a display unit, wherein the attribute setting unit is used for adjusting the design basic program, appearance, font, other information data and position information data of the current project program;
the analysis module is used for setting window handles, webpage titles, tags, identifiers, names, indexes, types, class names, element coordinates, frame indexes, characters, values and indexes in the Web webpage and automatically acquiring information of the webpage;
the function module is used for color, image, mouse window handle, quick transparent graph making, hot key, function using, project backup and source code color setting operation, comprises a color taking function unit, a color setting unit, a mouse window handle control unit, a mouse feature code unit, a transparent graph making unit, a hot key management unit, a function calling unit, a project backup unit and an editor setting unit, and is started through a preset window handle of a graphical interface in the system development platform.
2. The data warehouse-based data development system of claim 1, wherein the functional modules further include a user management unit and an interface viewing unit;
the user management unit is used for editing the logged-in server information, the logged-in date information, the logged-in account name information, the logged-in name information of the research and development personnel and the password information of the research and development personnel after logging in;
when the interface checking unit inquires the plug-in interface, the inquired plug-in path is selected, and the inquiry operation is carried out according to the plug-in path input plug-in interface ID.
3. The data warehouse-based data development system of claim 1, wherein the color extraction function unit controls remarks, coordinates and color values, pre-colors, and color cast of the hot keys;
a color setting unit for setting an x coordinate and a y coordinate, and setting an RGB generation color and a 16 system/10 system of colors;
the mouse window handle control unit is used for controlling the current mouse window information, and research personnel can check the window handle, the type and the window title of the current mouse, check the size of a window client area, copy, paste or move the handle class name or the handle title to an edit bar;
the mouse feature code unit is used for starting the hot key and setting the shape of the mouse and the shape feature code of the mouse;
the transparent drawing making unit is used for controlling the ground color, the color value, the primary color and the color cast of an image of an original drawing to be processed;
the hot key management unit is used for selecting and setting positions of a color taking hot key, a color cast hot key, a multi-point color grabbing hot key, a screen capturing and color taking hot key, a mouse window grabbing hot key and a magnifier;
the function calling unit is used for calling a function by a command required by the current project program, specifically, editing character searching is carried out according to the command, and function prototype, function description, parameter description, return value description and calling example information of the command are checked;
the project backup unit is used for backing up the current project program information;
and the editor setting unit comprises an editor comprehensive setting unit, a source code color setting unit, an editor background color setting unit, an APK environment generation unit and other settings.
4. The data warehouse-based data development system of claim 3, wherein the editor integrates settings for font style, size and bold settings, and TAB key occupancy space number settings;
setting source code colors, which are used for setting keyword colors, number colors, character string colors, TCAPL colors, annotation contents and text contents;
the background color setting of the editor is used for setting the background color of the editor, the background color of the folding and unfolding column, the color of the unfolding line, the line number, the power-off background color, the line number color, the breakpoint color, the current input line color, the selected text background color and the selected text color;
generating an APK environment for setting a Java path and automatically acquiring the path;
other settings comprise coding typesetting setting, and when a research and development personnel selects typesetting, removes blank lines and opens typesetting, the typesetting format setting is intelligently optimized.
5. The data warehouse-based data development system of claim 1, wherein the system development platform further comprises an engineering path setting unit and a page style setting unit;
the engineering path setting unit is used for setting a source file path, an output path and a resource path in the engineering path;
when the page style setting unit sets the style of the page, the number of the field columns and the number of the records displayed in each row can be set after the page template is selected.
6. The data warehouse-based data development system of claim 1, wherein the database types within the data warehouse include MySQL, oracle, postgreSQL, SQL server, VERTICA, ADS, greenplus, dameng, and Sybase;
data source types include unstructured data sources including HIVE, ES, KAFKA, FTP, HBASE, or SFTP.
7. The data warehouse-based data development system of claim 1, wherein the generation module includes a generation unit, a compilation unit, a cleaning unit, and an opening unit for generation, compilation, cleaning, and opening of the system information.
8. The method for the data warehouse-based data development system according to any one of claims 1 to 7, comprising the following steps:
s1, correspondingly setting and editing a login account by an administrator and research personnel through a user management unit, verifying and logging in, and establishing connection with a system development platform;
s2, after a manager and a research and development worker log in a system development platform, the manager sets and debugs system information, and the research and development worker designs and develops a project program through preset information;
s3, using and maintaining a system development platform, wherein when a research and development staff designs based on a data model, a data warehouse and a development flow of the system development platform, the research and development staff sends a current required data warehouse information request to a scheduling management system, the scheduling management system schedules batch processing tasks related to the data warehouse, a receiving module of the system development platform receives data corresponding to each data source system in the data warehouse for the research and development staff to carry out design project program operation, and the research and development staff analyzes unclear information through an analysis module and edits and sets information corresponding to the system development platform through a function module; the system development platform centralizes and regularly carries out maintenance operation on the system.
9. The method of a data warehouse-based data development system according to claim 8, wherein the step S2 is as follows:
s201, setting a development process by an administrator;
s202, setting a data model by an administrator;
s203, the data model is used for checking the development process and feeding back the check to be in line with the pass;
s204, designing a project program and issuing the design and development of the project program by research personnel based on a preset data model, a data warehouse and a development flow;
and S205, sending the program codes and the data models of the project after the completion, and executing the request issuing.
CN202210267858.9A 2022-03-18 2022-03-18 Data development system and method based on data warehouse Active CN114611044B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210267858.9A CN114611044B (en) 2022-03-18 2022-03-18 Data development system and method based on data warehouse

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210267858.9A CN114611044B (en) 2022-03-18 2022-03-18 Data development system and method based on data warehouse

Publications (2)

Publication Number Publication Date
CN114611044A CN114611044A (en) 2022-06-10
CN114611044B true CN114611044B (en) 2022-12-27

Family

ID=81864692

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210267858.9A Active CN114611044B (en) 2022-03-18 2022-03-18 Data development system and method based on data warehouse

Country Status (1)

Country Link
CN (1) CN114611044B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103425778A (en) * 2013-08-16 2013-12-04 国家电网公司 Intelligent development platform for database application system
CN108229825A (en) * 2018-01-04 2018-06-29 焦点科技股份有限公司 A kind of BI management systems based on development process closed loop

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105867892A (en) * 2015-11-18 2016-08-17 乐视致新电子科技(天津)有限公司 Centralized management method and system of multi-platform development
CN105608254B (en) * 2015-12-15 2018-08-17 宁波力芯科信息科技有限公司 A kind of the Automation Design method and platform towards Intelligent hardware system development
CN110188149A (en) * 2019-06-04 2019-08-30 宁波银行股份有限公司 A kind of data warehouse
US11334594B2 (en) * 2019-10-19 2022-05-17 Microsoft Technology Licensing, Llc Data model transformation
CN111078766A (en) * 2019-11-18 2020-04-28 江苏艾佳家居用品有限公司 Data warehouse model construction system and method based on multidimensional theory
CN111259068A (en) * 2020-04-28 2020-06-09 成都四方伟业软件股份有限公司 Data development method and system based on data warehouse

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103425778A (en) * 2013-08-16 2013-12-04 国家电网公司 Intelligent development platform for database application system
CN108229825A (en) * 2018-01-04 2018-06-29 焦点科技股份有限公司 A kind of BI management systems based on development process closed loop

Also Published As

Publication number Publication date
CN114611044A (en) 2022-06-10

Similar Documents

Publication Publication Date Title
JP7093387B2 (en) Spreadsheet-based software application development
JP2021028828A6 (en) Spreadsheet-based software application development
US8468492B1 (en) System and method for creation and modification of software applications
CN107807954B (en) Visual modeling multidimensional analysis system and method thereof
CN106445536B (en) Automatic business design management system
CN103425778A (en) Intelligent development platform for database application system
CN111767563A (en) Method, device, terminal and storage medium for setting authority of online document
US20220335023A1 (en) Database validation and repair tool
CN110086665A (en) A kind of network topological diagram methods of exhibiting based on jTopo
CN113886362A (en) Data storage system and storage method based on workflow engine and low-code platform
CN111563200A (en) Information display method, device, equipment and medium
US20120192069A1 (en) Transforming user interface actions to script commands
JP7055064B2 (en) Database migration support system and program
CN114611044B (en) Data development system and method based on data warehouse
CN114416516A (en) Test case and test script generation method, system and medium based on screenshot
CN114647735A (en) Relation graph display method, medium and display device
CN111709218A (en) Intelligent reporting platform and intelligent reporting method based on dynamic multiple data sources
JP4927895B2 (en) Form creation processing system, form creation processing method, and form creation processing program
WO2023045053A1 (en) File comparison method and apparatus based on rpa and ai, device, and storage medium
CN115510361A (en) Data chart page generation method based on visual configuration and related equipment
CN111596883B (en) Data visualization system supporting voice recognition and somatosensory operation remote control
EP1744271A1 (en) Document processing device
Grahl et al. The new W7-X logbook–A software for effective experiment documentation and collaborative research at Wendelstein 7-X
Kong et al. Legacy Interface Migration: A Task-Centered Approach.
KR20130068633A (en) Apparatus and method for visualizing data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant