CN111177671B - Data management platform, method and electronic equipment - Google Patents
Data management platform, method and electronic equipment Download PDFInfo
- Publication number
- CN111177671B CN111177671B CN201911324719.XA CN201911324719A CN111177671B CN 111177671 B CN111177671 B CN 111177671B CN 201911324719 A CN201911324719 A CN 201911324719A CN 111177671 B CN111177671 B CN 111177671B
- Authority
- CN
- China
- Prior art keywords
- data
- user
- module
- data table
- query
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000013523 data management Methods 0.000 title claims abstract description 19
- 238000012544 monitoring process Methods 0.000 claims abstract description 22
- 238000007726 management method Methods 0.000 claims abstract description 16
- 238000012795 verification Methods 0.000 claims description 27
- 230000002159 abnormal effect Effects 0.000 claims description 16
- 238000004458 analytical method Methods 0.000 claims description 6
- 239000008280 blood Substances 0.000 claims description 6
- 210000004369 blood Anatomy 0.000 claims description 6
- 230000008569 process Effects 0.000 claims description 6
- 238000012545 processing Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 11
- 230000000694 effects Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 238000004422 calculation algorithm Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000012827 research and development Methods 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/41—User authentication where a single sign-on provides access to a plurality of computers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/0815—Network architectures or network communication protocols for network security for authentication of entities providing single-sign-on or federations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/083—Network architectures or network communication protocols for network security for authentication of entities using passwords
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/12—Applying verification of the received information
- H04L63/126—Applying verification of the received information the source of the received data
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Storage Device Security (AREA)
Abstract
The invention discloses a data management platform, a method and electronic equipment, wherein the platform comprises the following components: the authority approval management module is connected with the database interface and is used for approving and managing the access authorities of different users to the data table in the database through the database interface; the display module is used for displaying the data table information with the access right of the user; the impromptu query module is used for receiving a user query task, sending the query task through a message queue and acquiring a query result; and the application module is used for completing data synchronization according to the configuration information of the data table. The invention aims to provide unified management for the data platform, improve the convenience of data use, provide data authority approval management, display configuration of a data table, data online inquiry, data synchronization and data monitoring alarm, and provide the entrance of each large data platform in a single sign-on mode, thereby greatly facilitating the operation of users on data and improving the user experience.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a data management platform, a data management method, an electronic device, and a computer readable medium.
Background
With the development of the internet and digital technology, more and more data is filling people's lives. The basic processing of data mainly involves three aspects of data query, data authority and data display, and the data platforms derived from the three aspects are increased continuously, but the query modes, authority control and other management of each data platform are different, so that the data management is disordered, and the data can be obtained by a user through complex operation. Taking the data of the query privacy cluster as an example, the user needs to examine and approve on the fort removing machine layer by layer, examination and approval is not recorded, examination and approval transparency and tracking cannot be achieved, and the existing examination and approval process is inconvenient mainly by transmitting mails back and forth.
Disclosure of Invention
The invention aims to solve the technical problems that in the prior art, each platform is not uniform in data management and complicated in data use.
In order to solve the above technical problem, a first aspect of the present invention provides a data management platform, the platform includes:
the authority approval management module is connected with the database interface and is used for approving and managing the access authorities of different users to the data table in the database through the database interface;
the display module is used for displaying the data table information with the access right of the user;
The impromptu query module is used for receiving a user query task, sending the query task through a message queue and acquiring a query result;
And the application module is used for completing data synchronization according to the configuration information of the data table.
According to a preferred embodiment of the present invention, the data table information includes meaning of each data table, meaning of each field, and the presentation module includes:
the receiving module is used for receiving the selection operation of the user on the data table and/or the field;
and the display module is used for displaying the meaning of the data table and/or the field with the access right of the user and displaying the data of the data table and/or the field selected by the user.
According to a preferred embodiment of the invention, the application module comprises:
The configuration information storage module is used for storing configuration information corresponding to the script information one by one;
The monitoring module is used for monitoring whether newly stored configuration information exists;
And the synchronization module is used for synchronously executing script information corresponding to the newly stored configuration information when the newly stored configuration information is monitored.
According to a preferred embodiment of the invention, the platform further comprises:
And the single sign-on module is used for receiving the unified login account number and the password of the user to finish login of different data platforms.
According to a preferred embodiment of the present invention, the single sign-on module includes:
The receiving module is used for receiving the unified login account and password of the user;
The verification module is used for sending the unified login account and the password to the unified server, receiving a verification code returned by the unified server, and verifying whether the unified login account and the password are correct or not according to the verification code;
And the login module is used for completing login of different data platforms when the unified login account and the password are correct.
According to a preferred embodiment of the invention, the platform further comprises:
The storage module is used for storing the query task and the query result of the impromptu query module and the preset query time of the query task, and sending the corresponding query task to the impromptu query module when the preset query time is reached;
The display module is also used for analyzing the query result and displaying the analysis result.
According to a preferred embodiment of the invention, the platform further comprises:
And the monitoring alarm module is used for monitoring whether the data of each data table is abnormal or not, and sending alarm information when the data is abnormal.
According to a preferred embodiment of the invention, the platform further comprises:
And the searching module is used for configuring workflow or blood margin map to search data sources.
In order to solve the above technical problem, a second aspect of the present invention provides a data management method, including:
approving and managing access rights of different users to the data table in the database through a database interface;
displaying data table information with access rights of a user;
receiving a user query task, sending the query task through a message queue and acquiring a query result;
and finishing data synchronization according to the configuration information of the data table.
According to a preferred embodiment of the present invention, the data table information includes meaning of each data table, meaning of each field, and the data table information showing that the user has access rights includes:
receiving a selection operation of a user on a data table and/or a field;
The method is used for displaying the meaning of the data table and/or the field which the user has access rights and displaying the data of the data table and/or the field selected by the user.
According to a preferred embodiment of the present invention, the data synchronization according to the configuration information of the data table includes:
Storing configuration information corresponding to script information one by one;
monitoring whether newly stored configuration information exists;
And when the newly stored configuration information is monitored, synchronously executing script information corresponding to the newly stored configuration information.
According to a preferred embodiment of the invention, the method further comprises:
And receiving the unified login account and password of the user to finish login of different data platforms.
According to a preferred embodiment of the present invention, the receiving the user uniform login account and password to complete login to different data platforms includes:
receiving a unified login account and a password of a user;
the unified login account and the password are sent to a unified server, a verification code returned by the unified server is received, and whether the unified login account and the password are correct or not is verified according to the verification code;
And when the unified login account and the password are correct, completing login of different data platforms.
According to a preferred embodiment of the invention, the method further comprises:
storing the query task and the query result of the impromptu query module and the preset query time of the query task, and sending the corresponding query task to the impromptu query module when the preset query time is reached;
analyzing the query result and displaying the analysis result.
According to a preferred embodiment of the invention, the method further comprises:
And monitoring whether the data of each data table is abnormal, and sending out alarm information when the data is abnormal.
According to a preferred embodiment of the invention, the method further comprises:
the workflow or the blood-related map is configured to search the data sources.
In order to solve the above technical problem, a third aspect of the present invention provides an electronic device, including:
A processor; and
A memory storing computer executable instructions that, when executed, cause the processor to perform the method described above.
In order to solve the above technical problem, a fourth aspect of the present invention proposes a computer-readable storage medium storing one or more programs that when executed by a processor, implement the above method.
The authority approval management module is connected with the database interface, and the authority approval and management of the access authorities of the data table and the field in the database are realized through the database interface, so that the complicated approval process of continuously sending mails is avoided, and the authority approval is trace-found. The display module is used for directly displaying the data table information with the access right of the user, so that the defect that the user logs in the fort machine to see the black window of the terminal is avoided, and the user experience is greatly optimized; the impromptu query module realizes real-time communication and message transmission of query results through a message queue, avoids a plurality of intermediate processes, and greatly reduces the operation time of data personnel; data synchronization is supported by the application module. The invention aims to provide unified management for data platforms, improve the convenience of data use, provide data authority approval management, display configuration of a data table, data online inquiry, data synchronization and data monitoring alarm, provide the entry of each large data platform in a single sign-on mode, support the functions of configuring timing tasks and exploring the source of data, greatly facilitate the operation of users on the data and improve the user experience.
Drawings
In order to make the technical problems solved by the present invention, the technical means adopted and the technical effects achieved more clear, specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted, however, that the drawings described below are merely illustrative of exemplary embodiments of the present invention and that other embodiments of the drawings may be derived from these drawings by those skilled in the art without undue effort.
FIG. 1 is a schematic diagram of a data management platform according to the present invention;
FIGS. 2 a-2 b are schematic diagrams showing the data table information by the display module according to the present invention;
FIGS. 3 a-3 b are schematic diagrams showing the data table information by the display module according to the present invention;
FIG. 4 is a flow chart of a method of data management of the present invention;
FIG. 5 is a block diagram of an exemplary embodiment of an electronic device in accordance with the present invention;
FIG. 6 is a schematic diagram of one embodiment of a computer readable medium of the present invention.
Detailed Description
Exemplary embodiments of the present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments are shown, although the exemplary embodiments may be practiced in various specific ways. Rather, these exemplary embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the invention to those skilled in the art.
The structures, capabilities, effects, or other features described in a particular embodiment may be incorporated in one or more other embodiments in any suitable manner without departing from the spirit of the present invention.
In describing particular embodiments, specific details of construction, performance, effects, or other features are set forth in order to provide a thorough understanding of the embodiments by those skilled in the art. It is not excluded that one skilled in the art may implement the present invention in a particular case in a solution that does not include the structures, properties, effects, or other characteristics described above.
The flow diagrams in the figures are merely exemplary flow illustrations and do not represent that all of the elements, operations, and steps in the flow diagrams must be included in the aspects of the invention, nor that the steps must be performed in the order shown in the figures. For example, some operations/steps in the flowcharts may be decomposed, some operations/steps may be combined or partially combined, etc., and the order of execution shown in the flowcharts may be changed according to actual situations without departing from the gist of the present invention.
The block diagrams in the figures generally represent functional entities and do not necessarily correspond to physically separate entities. That is, the functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
The same reference numerals in the drawings denote the same or similar elements, components or portions, and thus repeated descriptions of the same or similar elements, components or portions may be omitted hereinafter. It will be further understood that, although the terms first, second, third, etc. may be used herein to describe various devices, elements, components or portions, these devices, elements, components or portions should not be limited by these terms. That is, these phrases are merely intended to distinguish one from the other. For example, a first device may also be referred to as a second device without departing from the spirit of the invention. Furthermore, the term "and/or," "and/or" is meant to include all combinations of any one or more of the items listed.
Fig. 1 is a schematic structural frame diagram of a data management platform according to the present invention, as shown in fig. 1, where the platform includes: rights approval management module 11, presentation module 12, impromptu query module 13 and application module 14, wherein:
The authority approval management module 11 is connected with a database interface and is used for approving and managing the access authorities of different users to the data table in the database through the database interface;
The database may be a database in a financial cluster such as a cloud chart, a intelligent, and the like, a database interface capable of operating the database is reserved in the database, and the authority approval management module 11 can control the database of the financial cluster through the database interface, and the related authority from a data table to a field enables the authority approval to be trace-found.
Specifically, the authority approval management module 11 can approve the access authorities of different users to the data table and the field in the database according to approval information issued by an administrator; and configuring and managing access rights of different users to the data tables and fields in the database according to user attribute information of the users, such as department role information (such as market department, research and development department and the like). Furthermore, the permission approval management module 11 can store the access permission as authentication information for authenticating access to the data table and the field, and only when the data table and the field are included for displaying or inquiring the authentication information, the data table can be displayed or inquired, so that different personnel can realize different permission of displaying and inquiring the data table, and data privacy is protected.
A display module 12, configured to display data table information that the user has access rights to;
In the present invention, the data table information is unified information of all data tables in the database, including meaning of each data table, meaning of each field, which may specifically be a data dictionary, and the display module 12 includes:
The receiving module is used for receiving the selection operation of the user on the data table and/or the field; the selection operation may be a click operation of a user on the header and/or the field of the data table, or a click operation of a "one-click generation" button in the display module.
And the display module is used for displaying the meaning of the data table and/or the field with the access right of the user and displaying the data of the data table and/or the field selected by the user.
In one display manner, as shown in fig. 2a, the data table with access rights for the user in the database includes table 1 and table 2, the field 1 and the field 3 of table 1 have access rights, the field 2 and the field 3 of table 2 have access rights, the meaning of table 1 is "9 months newly added loan user statistics table", the meaning of field 1 of table 1 is "user name", the meaning of field 3 of table 1 is "sex", the meaning of table 2 is "9 months newly added investment user statistics table", the meaning of field 2 of table 2 is "user name", the meaning of field 3 of table 2 is "contact manner", as shown in fig. 2b, when the user clicks the field 1 and the field 2 of table 2, the field 1 and the field 2 of table 1 are generated into a new data table 3, and the data of the new data table 3 is displayed in the display module 10. In another display manner, as shown in fig. 3a, the data table in which the user has access rights in the database includes table 1 and table 2, the table 1 and the table 3 have access rights in table 1, the table 2 and the table 3 have access rights in table 2, the table 1 is displayed in the display module 10 as "9 months newly added loan user statistics table", the table 1 is displayed as "user name", the table 1 is displayed as "sex", the table 2 is displayed as "9 months newly added investment user statistics table", the table 2 is displayed as "user name", the table 2 is displayed as "contact address", and the table 2 is displayed as "one-key generation" button in the display module 10, and when the user clicks the "one-key generation" button, the display module 10 displays the data of all the fields in which the user has access rights, namely, the table 1 as "user name" and the table 3 "sex", the table 2 as well as the table 2 "user name" and the table 3 "contact address".
The display module 12 of the invention can display the data of the corresponding fields according to the selection of the user, also support one-key generation of the data of all fields with access rights of the user, avoid the defect of logging in the fort machine and looking at the black window of the terminal, and greatly optimize the experience.
The impromptu query module 13 is used for receiving a user query task, sending the query task through a message queue and acquiring a query result; real-time communication and message transmission of the impromptu query result are realized through a message queue technology, so that a plurality of intermediate processes are avoided, and the operation time of data personnel is greatly reduced.
And the application module 14 is used for completing data synchronization according to the configuration information of the data table.
Illustratively, the application module 14 includes:
the configuration information storage module is used for storing configuration information corresponding to the script information one by one; specifically, when executing a piece of script information in the database, a piece of configuration information corresponding to the script information one by one is automatically generated and stored in the configuration information storage module.
The monitoring module is used for monitoring whether newly stored configuration information exists;
And the synchronization module is used for synchronously executing script information corresponding to the newly stored configuration information when the newly stored configuration information is monitored.
Furthermore, the data management platform of the present invention further provides unified login entries of different platforms, and supports a single sign-on function, and the platform further includes:
And the single sign-on module is used for receiving the unified login account number and the password of the user to finish login of different data platforms.
Illustratively, the single sign-on module includes:
The receiving module is used for receiving the unified login account and password of the user;
the verification module is used for sending the unified login account and the password to the unified server, receiving a verification code returned by the unified server, and verifying whether the unified login account and the password are correct or not according to the verification code; specifically, a set of verification algorithm is arranged between the verification module and the unified server, the unified server converts the login account and the password into verification codes through the verification algorithm, and the verification module verifies the verification codes to determine whether the login account and the password are correct or not.
And the login module is used for completing login of different data platforms when the unified login account and the password are correct.
In addition, the data management platform of the present invention also has the functions of timing inquiry and displaying inquiry results, and then the platform further comprises:
The storage module is used for storing the query task and the query result of the impromptu query module and the preset query time of the query task, and sending the corresponding query task to the impromptu query module when the preset query time is reached; the storage inquiry task and the inquiry result can be conveniently checked by a user in the later period, and the preset inquiry time of the storage inquiry task can realize the function of timing inquiry.
The display module is also used for analyzing the query result and displaying the analysis result.
In the invention, after the query result is obtained by the impromptu query module, the query result is returned to the display module, and the display module can analyze the query result first and display the query result in a data result display mode such as a pie chart, a line chart and the like, so that a user can clearly see the data result and the data change trend at a glance, and the effect of visualizing the data result is achieved.
In addition, the data management platform of the present invention also supports the functions of data monitoring and data source searching, and then the platform further comprises:
The monitoring alarm module is used for monitoring whether the data of each data table is abnormal, and sending alarm information when the data is abnormal, specifically, the data format and the data range of each field in the data table can be preset, and after the data format is different from the preset data format or the data exceeds the preset data range, a user is prompted that a certain data is abnormal in a highlight text form for modification by the user.
And the searching module is used for configuring workflow or blood margin map to search data sources.
It will be appreciated by those skilled in the art that the modules in the embodiments of the apparatus described above may be distributed in an apparatus as described, or may be distributed in one or more apparatuses different from the embodiments described above with corresponding changes. The modules of the above embodiments may be combined into one module, or may be further split into a plurality of sub-modules.
FIG. 4 is a flow chart of a method of data management of the present invention, the method comprising:
S1, approving and managing access rights of different users to a data table in a database through a database interface;
the database can be a database in a financial cluster such as a cloud chart, a intelligent, and the like, a database interface capable of operating the database is reserved in the database, the database of the financial cluster can be controlled through the database interface, and the relative authority of a data table to a field can be tracked and found.
Specifically, the access rights of different users to the data tables and fields in the database can be approved according to approval information issued by an administrator; and configuring and managing access rights of different users to the data tables and fields in the database according to user attribute information of the users, such as department role information (such as market department, research and development department and the like). Furthermore, the access authority can be stored as authentication information for authenticating the access of the data table and the field, and the data table can be displayed or queried only when the data table and the field are included for displaying or querying the authentication information, so that different personnel can display and query the data table with different authorities, and the data privacy is protected.
S2, displaying data table information with access rights of the user;
In the present invention, the data table information is unified information of all data tables in the database, including meaning of each data table, meaning of each field, which may be specifically a data dictionary, and the data table information for displaying the access right of the user includes:
s21, receiving a selection operation of a user on a data table and/or a field;
The selection operation may be a click operation of a user on the header and/or the field of the data table, or a click operation of a "one-click generation" button in the display module.
S22, displaying the meaning of the data table and/or the field with the access right of the user, and displaying the data of the data table and/or the field selected by the user.
Reference is made specifically to fig. 2 and 3 and the related description, and no further description is given here.
S3, receiving a user query task, sending the query task through a message queue and acquiring a query result;
real-time communication and message transmission of the impromptu query result are realized through a message queue technology, so that a plurality of intermediate processes are avoided, and the operation time of data personnel is greatly reduced.
Further, the present step may further perform the following steps:
S31, storing the query task and the query result of the impromptu query module and the preset query time of the query task, and sending the corresponding query task to the impromptu query module when the preset query time is reached;
S32, analyzing the query result and displaying the analysis result.
In the invention, the query result can be analyzed first and displayed in the data result display modes such as pie charts, line charts and the like, so that a user can see the data result and the data change trend at a glance, and the effect of visualizing the data result is achieved.
And S4, completing data synchronization according to the configuration information of the data table.
Specifically, the method comprises the following steps:
s41, storing configuration information corresponding to script information one by one;
specifically, when executing a piece of script information in the database, a piece of configuration information corresponding to the script information one by one is automatically generated and stored in the configuration information storage module.
S42, monitoring whether newly stored configuration information exists;
S43, when the newly stored configuration information is monitored, script information corresponding to the newly stored configuration information is synchronously executed.
In addition, the data management method of the invention provides unified login entries of different platforms and supports single sign-on, data monitoring and data source searching, and the method further comprises the following steps:
S5, receiving a unified login account and password of the user to complete login of different data platforms.
Illustratively, the step includes:
s51, receiving a unified login account and password of a user;
s52, sending the unified login account and the password to a unified server, receiving a verification code returned by the unified server, and verifying whether the unified login account and the password are correct or not according to the verification code;
Specifically, a set of verification algorithm is arranged between the verification module and the unified server, the unified server converts the login account and the password into verification codes through the verification algorithm, and the verification module verifies the verification codes to determine whether the login account and the password are correct or not.
And S53, finishing the login of different data platforms when the unified login account and the password are correct.
And S6, monitoring whether the data of each data table is abnormal, and sending out alarm information when the data is abnormal.
Specifically, the data format and the data range of each field in the data table can be preset, and after the data format is different from the preset data format or the data exceeds the preset data range, a user is prompted that a certain data is abnormal in a highlighted text form for modification by the user.
S7, configuring workflow or blood-related map to search data sources.
The following describes an embodiment of an electronic device of the present invention, which may be regarded as a physical form of implementation for the above-described embodiment of the method and apparatus of the present invention. Details described in relation to the embodiments of the electronic device of the present invention should be considered as additions to the embodiments of the method or apparatus described above; for details not disclosed in the embodiments of the electronic device of the present invention, reference may be made to the above-described method or apparatus embodiments.
Fig. 5 is a block diagram of an exemplary embodiment of an electronic device according to the present invention. The electronic device shown in fig. 5 is only an example and should not be construed as limiting the functionality and scope of use of the embodiments of the present invention.
As shown in fig. 5, the electronic device 500 of the exemplary embodiment is embodied in the form of a general-purpose data processing device. The components of electronic device 500 may include, but are not limited to: at least one processing unit 510, at least one memory unit 520, a bus 530 connecting the different electronic device components (including the memory unit 520 and the processing unit 510), a display unit 540, etc.
The storage unit 520 stores a computer readable program, which may be a source program or code of a read only program. The program may be executed by the processing unit 510 such that the processing unit 510 performs the steps of various embodiments of the present invention. For example, the processing unit 510 may perform the steps shown in fig. 4.
The memory unit 520 may include readable media in the form of volatile memory units, such as Random Access Memory (RAM) 5201 and/or cache memory unit 5202, and may further include Read Only Memory (ROM) 5203. The storage unit 520 may also include a program/utility 5204 having a set (at least one) of program modules 5205, such program modules 5205 including, but not limited to: an operating electronic device, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment.
Bus 530 may be one or more of several types of bus structures including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
The electronic device 500 may also communicate with one or more external devices 300 (e.g., keyboard, display, network device, bluetooth device, etc.), such that a user can interact with the electronic device 500 via the external devices 500, and/or such that the electronic device 500 can communicate with one or more other data processing devices (e.g., routers, modems, etc.). Such communication may occur through an input/output (I/O) interface 550, and may also occur through a network adapter 560 to one or more networks, such as a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet. The network adapter 560 may communicate with other modules of the electronic device 500 via the bus 530. It should be appreciated that although not shown in fig. 5, other hardware and/or software modules may be used in electronic device 500, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID electronics, tape drives, data backup storage electronics, and the like.
FIG. 6 is a schematic diagram of one embodiment of a computer readable medium of the present invention. As shown in fig. 6, the computer program may be stored on one or more computer readable media. The computer readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electronic device, apparatus, or means of electronic, magnetic, optical, electromagnetic, infrared, or semiconductor, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. The computer program, when executed by one or more data processing devices, enables the computer readable medium to carry out the above-described method of the present invention, namely: approving and managing access rights of different users to the data table in the database through a database interface; displaying data table information with access rights of a user; receiving a user query task, sending the query task through a message queue and acquiring a query result; and finishing data synchronization according to the configuration information of the data table.
From the above description of embodiments, those skilled in the art will readily appreciate that the exemplary embodiments described herein may be implemented in software, or may be implemented in software in combination with necessary hardware. Thus, the technical solution according to the embodiments of the present invention may be embodied in the form of a software product, which may be stored in a computer readable storage medium (may be a CD-ROM, a usb disk, a mobile hard disk, etc.) or on a network, comprising several instructions to cause a data processing device (may be a personal computer, a server, or a network device, etc.) to perform the above-described method according to the present invention.
The computer readable storage medium may include a data signal propagated in baseband or as part of a carrier wave, with readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A readable storage medium may also be any readable medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution electronic device, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).
In summary, the present invention may be implemented in a method, apparatus, electronic device, or computer readable medium that executes a computer program. Some or all of the functions of the present invention may be implemented in practice using a general purpose data processing device such as a microprocessor or Digital Signal Processor (DSP).
The above-described specific embodiments further describe the objects, technical solutions and advantageous effects of the present invention in detail, and it should be understood that the present invention is not inherently related to any particular computer, virtual device or electronic apparatus, and various general-purpose devices may also implement the present invention. The foregoing description of the embodiments of the invention is not intended to be limiting, but rather is intended to cover all modifications, equivalents, alternatives, and improvements that fall within the spirit and scope of the invention.
Claims (8)
1. A data management platform, the platform comprising:
The authority approval management module is connected with the database interface and is used for approving and managing the access authorities of different users to the data table in the database through the database interface; the authority approval management module stores the access authority as authentication information for authenticating access to the data table and the field, and only when the data table and the field are included for displaying or inquiring the authentication information during the data displaying and inquiring process, the data table can be displayed or inquired; the database is a database in a cluster, and the database interface for operating the database is reserved;
The display module is used for displaying the data table information with the access right of the user; the data table information comprises the meaning of each data table and the meaning of each field, and the display module comprises:
the receiving module is used for receiving the selection operation of a user on the data table and/or the field or receiving the one-key generation operation of the user;
The display module is used for displaying the meaning of the data table and/or the field with the access right of the user, generating and displaying the fields in different data tables with the access right selected by the user when receiving the selection operation of the user on the data table and/or the field, or displaying the data of all the fields with the access right of the user when receiving the operation of 'one-key generation' of the user;
The impromptu query module is used for receiving a user query task, sending the query task through a message queue and acquiring a query result;
the application module is used for completing data synchronization according to the configuration information of the data table;
The single sign-on module is used for receiving a unified login account number and a password of a user to finish login of different data platforms, and comprises the following steps:
The receiving module is used for receiving the unified login account and password of the user;
The verification module is used for sending the unified login account and the password to the unified server, receiving a verification code returned by the unified server, and verifying whether the unified login account and the password are correct or not according to the verification code;
The login module is used for completing login of different data platforms when the unified login account and the password are correct;
the application module comprises:
The configuration information storage module is used for storing configuration information corresponding to the script information one by one; when executing a script information in the database, automatically generating configuration information corresponding to the script information one by one and storing the configuration information in a configuration information storage module;
The monitoring module is used for monitoring whether newly stored configuration information exists;
The synchronization module is used for synchronously executing script information corresponding to the newly stored configuration information when the newly stored configuration information is monitored;
the platform further comprises:
the monitoring alarm module is used for monitoring whether the data of each data table is abnormal or not, and sending alarm information when the data is abnormal; specifically, the data format and the data range of each field in the data table are preset, and after the data format is different from the preset data format or the data exceeds the preset data range, a user is prompted that a certain data is abnormal in a highlighted text form.
2. The platform of claim 1, further comprising:
The storage module is used for storing the query task and the query result of the impromptu query module and the preset query time of the query task, and sending the corresponding query task to the impromptu query module when the preset query time is reached;
The display module is also used for analyzing the query result and displaying the analysis result.
3. The platform of claim 1, further comprising:
And the searching module is used for configuring workflow or blood margin map to search data sources.
4. A method of data management, the method comprising:
Approving and managing access rights of different users to the data table in the database through a database interface; specifically, the access authority is stored as authentication information for authenticating access to the data table and the field, and only when the data table and the field are included in the display or query task of the authentication information, the data table can be displayed or queried; the database is a database in a cluster, and the database interface for operating the database is reserved;
Displaying data table information with access rights of a user; the data table information comprises the meaning of each data table and the meaning of each field, and the data table information for displaying the access right of the user comprises the following steps:
Receiving a user selection operation on a data table and/or a field, or receiving a one-key generation operation of the user;
displaying the meaning of the data table and/or the field with the access right of the user, and generating and displaying the fields in different data tables with the access right selected by the user when receiving the selection operation of the user on the data table and/or the field, or displaying the data of all the fields with the access right of the user when receiving the 'one-key generation' operation of the user;
receiving a user query task, sending the query task through a message queue and acquiring a query result;
completing data synchronization according to configuration information of a data table;
Receiving a unified login account number and password of a user to complete login of different data platforms, and specifically comprises the following steps:
receiving a unified login account and a password of a user;
the unified login account and the password are sent to a unified server, a verification code returned by the unified server is received, and whether the unified login account and the password are correct or not is verified according to the verification code;
When the unified login account and the password are correct, the login of different data platforms is completed;
the step of completing data synchronization according to the configuration information of the data table comprises the following steps:
Storing configuration information corresponding to script information one by one; when executing a script information, automatically generating a configuration information storage corresponding to the script information one by one;
monitoring whether newly stored configuration information exists;
when the newly stored configuration information is monitored, script information corresponding to the newly stored configuration information is synchronously executed;
The method further comprises the steps of:
Monitoring whether the data of each data table is abnormal, and sending alarm information when the data is abnormal; specifically, the data format and the data range of each field in the data table are preset, and after the data format is different from the preset data format or the data exceeds the preset data range, a user is prompted that a certain data is abnormal in a highlighted text form.
5. The method according to claim 4, wherein the method further comprises:
storing the query task and the query result of the impromptu query module and the preset query time of the query task, and sending the corresponding query task to the impromptu query module when the preset query time is reached;
analyzing the query result and displaying the analysis result.
6. The method according to claim 4, wherein the method further comprises:
the workflow or the blood-related map is configured to search the data sources.
7. An electronic device, comprising:
A processor; and
A memory storing computer-executable instructions that, when executed, cause the processor to perform the method of any of claims 4-6.
8. A computer readable storage medium storing one or more programs, which when executed by a processor, implement the method of any of claims 4-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911324719.XA CN111177671B (en) | 2019-12-16 | 2019-12-16 | Data management platform, method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911324719.XA CN111177671B (en) | 2019-12-16 | 2019-12-16 | Data management platform, method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111177671A CN111177671A (en) | 2020-05-19 |
| CN111177671B true CN111177671B (en) | 2024-05-17 |
Family
ID=70655527
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911324719.XA Active CN111177671B (en) | 2019-12-16 | 2019-12-16 | Data management platform, method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111177671B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111737291B (en) * | 2020-06-11 | 2023-07-21 | 青岛海尔科技有限公司 | Method, device and database for inquiring equipment information |
| CN112348562B (en) * | 2020-09-27 | 2024-03-26 | 北京淇瑀信息科技有限公司 | Computer-aided resource release management method and platform based on route cost consumption |
| CN112348554A (en) * | 2020-09-27 | 2021-02-09 | 北京淇瑀信息科技有限公司 | Computer-aided resource delivery management method and platform based on material maintenance |
| CN112511352B (en) * | 2020-12-01 | 2023-01-24 | 深圳市鹰硕技术有限公司 | User management method and system |
| CN112989781B (en) * | 2021-03-11 | 2023-11-24 | 携程旅游网络技术（上海）有限公司 | Form data automatic execution method, device, electronic equipment and storage medium |
| CN114997828A (en) * | 2021-11-02 | 2022-09-02 | 杭州以诺行汽车科技股份有限公司 | Formula management system for ERP in automobile maintenance industry and control method thereof |
| CN116521776B (en) * | 2023-07-03 | 2023-09-05 | 陕西省君凯电子科技有限公司 | Quick information query system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105868202A (en) * | 2015-01-21 | 2016-08-17 | 镇江雅迅软件有限责任公司 | Multi-platform access data management system |
| CN106357724A (en) * | 2016-08-18 | 2017-01-25 | 广州市利迪网络科技有限公司 | Uniformly integrated information management platform system |
| CN107634951A (en) * | 2017-09-22 | 2018-01-26 | 携程旅游网络技术（上海）有限公司 | Docker vessel safeties management method, system, equipment and storage medium |
| CN107895123A (en) * | 2017-11-13 | 2018-04-10 | 医渡云（北京）技术有限公司 | Data access authority control method and device, method for managing user right |
| CN109344185A (en) * | 2018-08-21 | 2019-02-15 | 广州飞硕信息科技股份有限公司 | A kind of data capture method and device |
| CN110009314A (en) * | 2019-04-18 | 2019-07-12 | 武汉鼠标科技有限公司 | A kind of educational system and teaching platform of the behavioural analysis based on big data |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090327131A1 (en) * | 2008-04-29 | 2009-12-31 | American Express Travel Related Services Company, Inc. | Dynamic account authentication using a mobile device |
-
2019
- 2019-12-16 CN CN201911324719.XA patent/CN111177671B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105868202A (en) * | 2015-01-21 | 2016-08-17 | 镇江雅迅软件有限责任公司 | Multi-platform access data management system |
| CN106357724A (en) * | 2016-08-18 | 2017-01-25 | 广州市利迪网络科技有限公司 | Uniformly integrated information management platform system |
| CN107634951A (en) * | 2017-09-22 | 2018-01-26 | 携程旅游网络技术（上海）有限公司 | Docker vessel safeties management method, system, equipment and storage medium |
| CN107895123A (en) * | 2017-11-13 | 2018-04-10 | 医渡云（北京）技术有限公司 | Data access authority control method and device, method for managing user right |
| CN109344185A (en) * | 2018-08-21 | 2019-02-15 | 广州飞硕信息科技股份有限公司 | A kind of data capture method and device |
| CN110009314A (en) * | 2019-04-18 | 2019-07-12 | 武汉鼠标科技有限公司 | A kind of educational system and teaching platform of the behavioural analysis based on big data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111177671A (en) | 2020-05-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111177671B (en) | Data management platform, method and electronic equipment | |
| CN111177213B (en) | Privacy cluster self-service query platform, method and electronic equipment | |
| CN111242462B (en) | Data processing method and device, computer storage medium and electronic equipment | |
| CN111680313B (en) | Data processing method, device, equipment and storage medium | |
| US11354221B2 (en) | Contextual drill back to source code and other resources from log data | |
| US20200314159A1 (en) | Anomaly detection for streaming data | |
| CN106372844B (en) | Schedule creating method and device | |
| CN109559239A (en) | Generation method, device, electronic equipment, storage medium are suggested in complaint handling | |
| CN110569266A (en) | Data query method, device, equipment and storage medium | |
| CN111209184A (en) | Automatic testing method and device and electronic equipment | |
| CN112130781A (en) | Log printing method and device, electronic equipment and storage medium | |
| CN110765090B (en) | Log data management method and device, storage medium and electronic equipment | |
| CN109460363B (en) | Automatic testing method and device, electronic equipment and computer readable medium | |
| CN113792138A (en) | Report generation method and device, electronic equipment and storage medium | |
| CN113392439A (en) | Flow chart generation device, method thereof, control device, medium, and program product | |
| CN112579632A (en) | Data verification method, device, equipment and medium | |
| CN110555732B (en) | Marketing strategy pushing method and device and marketing strategy operation platform | |
| CN112416713A (en) | Operation auditing system and method, computer readable storage medium and electronic equipment | |
| CN110928801A (en) | Role authority test method and device, computer medium and electronic equipment | |
| US9208046B2 (en) | Method and system for optimizing testing efforts in system of systems testing | |
| US10171486B2 (en) | Security and authentication daisy chain analysis and warning system | |
| CN114090514A (en) | Log retrieval method and device for distributed system | |
| CN111191166B (en) | Business page display method and device and electronic equipment | |
| CN113342667A (en) | Data processing method, data processing device, electronic equipment and computer readable storage medium | |
| CN107609871B (en) | Payment track reproduction method, device, system, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |