CN116049254A - Data asset statistics method based on database - Google Patents
Data asset statistics method based on database Download PDFInfo
- Publication number
- CN116049254A CN116049254A CN202211669550.3A CN202211669550A CN116049254A CN 116049254 A CN116049254 A CN 116049254A CN 202211669550 A CN202211669550 A CN 202211669550A CN 116049254 A CN116049254 A CN 116049254A
- Authority
- CN
- China
- Prior art keywords
- data
- asset
- database
- assets
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2462—Approximate or statistical queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
- G06F16/24578—Query processing with adaptation to user needs using ranking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Probability & Statistics with Applications (AREA)
- Mathematical Physics (AREA)
- Fuzzy Systems (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a data asset statistical method based on a database, which relates to the technical field of big data and comprises the following steps of S1, inputting data source connection information: aiming at the data assets including an asset configuration system and an asset display platform, on the basis of the prior art, big data is adopted for real-time calculation, and real-time statistics is carried out on newly added data assets and assets; s2, detecting whether the connection is available; s3, selecting a table needing statistics; s4, selecting a field to be displayed. The system queries the data source to obtain all tables in the database, and the user selects the tables needing statistics; and then, inquiring and displaying a field information list of a table selected by a user, solving the problem that development work of a plurality of data assets is repeated, solving the problem that a plurality of data assets are difficult to collect and count, and simultaneously solving the problem that a plurality of statistic platforms are difficult to maintain.
Description
Technical Field
The invention relates to the technical field of big data, in particular to a data asset statistics method based on a database.
Background
With the rapid development of modern network technology, many internet companies are created, and meanwhile, various companies access and produce a large amount of data for own business, and the data have a value which is difficult to measure, so that the access condition and the production condition of the data need to be counted. Many platforms also provide separate statistical systems for their own data, but the pen-holder finds that some problems still exist during actual use. The following problems exist in the prior art:
1. most of traditional data statistics platforms are arranged on the system itself and need to be checked by a background management system of the platform, but often a unit or a company has a plurality of systems at the same time, and the statistics of the data needs to be checked by a plurality of background management systems;
2. in the existing database-based data asset statistics method, if a business is newly added to a company or a unit, new data is accessed or generated correspondingly, when the business is important, the data conditions are often monitored, and developers are required to develop monitoring statistics functions for the data, although similar functions exist.
Disclosure of Invention
In order to solve the technical problems, the invention adopts the following technical scheme:
a database-based data asset statistics method includes the steps of,
s1, inputting data source connection information: aiming at the data assets including an asset configuration system and an asset display platform, on the basis of the prior art, big data is adopted for real-time calculation, and real-time statistics is carried out on newly added data assets and assets;
s2, detecting whether the connection is possible: firstly, an administrator inputs data source link information of a storage system used for data to be counted, such as information of a used database type, IP, a port, an account number and a password, and after inputting is completed, the system firstly detects whether the data can be communicated or not, and if not, the data can be input again, and then the next step can be carried out;
s3, selecting a table needing statistics: the system queries the data source to obtain all tables in the database, and the user selects the tables to be counted; then inquiring and displaying a field information list of a table selected by a user, supporting operations of displaying the fields, displaying sequence ordering, formatting, adding the fields as screening fields, selecting matching types during screening, wherein the matching types during screening have equal, comparing, blurring and the like, and then configuring to complete a data asset;
s4, selecting a field to be displayed: firstly, a user enters a home page of the system to check all data asset profiles in the system, such as statistical information of data total quantity, daily increment, month increment and the like of each asset, the user clicks a screenable condition field, a converted data value and an ordered display field of a current asset, the user can screen and check the current asset data on the detail page, and then the flow of the asset display platform is ended.
The technical scheme of the invention is further improved as follows: s1, acquiring asset data corresponding to a target object, wherein the asset data is data corresponding to digital assets owned by the target object on a current platform, the total digital assets owned by the target object are arranged on a plurality of platforms, and each platform corresponds to a node in a blockchain.
The technical scheme of the invention is further improved as follows: performing slicing processing on the asset data to obtain a plurality of sliced asset data; and distributing the plurality of fragmented asset data to the current node and at least one participating node, and acquiring target fragmented asset data sent by the at least one participating node, wherein the target fragmented asset data is obtained by performing fragmentation processing on the target asset data by the participating node, and the target asset data is data on a platform corresponding to the participating node.
The technical scheme of the invention is further improved as follows: based on the sharded asset data in the current node and the target sharded asset data, total asset data is determined, wherein the total asset data is used to characterize a sum of digital assets owned by the target object in the current platform and a platform corresponding to the at least one participating node.
The technical scheme of the invention is further improved as follows: s4, calculating corresponding information of statistical data and the cabinet from two-dimensional and three-dimensional angles by combining big data spark through a spring closed architecture, and displaying through PC end UI display or mobile end APPVR display, wherein the display comprises a module display area, a device display area and a machine room scene display area, and the module display area is used for displaying assets with relatively infrequent change and larger space occupation; the equipment display area is used for displaying assets with frequent change and small space occupation; the module display area and the equipment display area are displayed through a PC end UI.
The technical scheme of the invention is further improved as follows: the machine room scene display area displays asset information for real-scene display of the machine room through the mobile terminal APP VR, and the machine room scene display area further comprises a query module for querying all other corresponding information according to the equipment information.
By adopting the technical scheme, compared with the prior art, the invention has the following technical progress:
1. the invention provides a data asset statistical method based on a database, which comprises the steps that under the action of selecting a table to be counted, a system inquires a data source to obtain all tables under the database, and a user selects the table to be counted; and then, inquiring and displaying a field information list of a table selected by a user, solving the problem that development work of a plurality of data assets is repeated, solving the problem that a plurality of data assets are difficult to collect and count, and simultaneously solving the problem that a plurality of statistic platforms are difficult to maintain.
2. The invention provides a data asset statistics method based on a database, which is characterized in that under the action of detecting whether the data asset statistics method can be connected, firstly, an administrator inputs the data source link information of a storage system used by data to be counted, such as the type of the used database, IP, port, account password and the like, so that the transparency of the data processing and statistics process is ensured, and compared with the mode of summarizing the data of all participating platforms to a third party when asset data combined statistics is carried out in the prior art, the data privacy of a user is ensured, and the safety of the data statistics is improved.
3. The invention provides a data asset statistics method based on a database, which is characterized in that under the action of selecting a field to be displayed, a user firstly enters a system home page to check all data asset profiles in the system, so that the purposes of transparent data statistics disclosure and non-falsification are achieved, the technical effects of improving the safety of data statistics and guaranteeing the privacy of the user are realized, and the technical problem of low safety caused by the statistics of the digital assets of the user in a multiparty mechanism based on a unilateral mechanism in the prior art is solved.
4. The invention provides a data asset statistical method based on a database, which can realize the classification real-time statistics of complex information of a data center under the action of display by a visual means and naturally present the complex information in a manner conforming to human intuition such as a two-dimensional background image, a three-dimensional real scene and the like, thereby greatly improving the efficiency of information interaction, reducing the information loss and the time loss, ensuring the accuracy and timeliness of information transmission, reducing the difficulty of information inquiry and browsing, greatly improving the control efficiency by operation and maintenance managers, accelerating the response speed and shortening the processing time.
Drawings
FIG. 1 is a schematic flow diagram of a database-based data asset statistics method of the present invention;
FIG. 2 is a schematic diagram of a flow structure for detecting unconnectable according to the present invention.
Detailed Description
The invention is further illustrated by the following examples:
example 1
As shown in fig. 1-2, the present invention provides a database-based data asset statistics method, comprising the steps of,
s1, inputting data source connection information: aiming at the data assets including an asset configuration system and an asset display platform, on the basis of the prior art, big data is adopted for real-time calculation, and real-time statistics is carried out on newly added data assets and assets;
s2, detecting whether the connection is possible: firstly, an administrator inputs data source link information of a storage system used for data to be counted, such as information of a used database type, IP, a port, an account number and a password, and after inputting is completed, the system firstly detects whether the data can be communicated or not, and if not, the data can be input again, and then the next step can be carried out;
s3, selecting a table needing statistics: the system queries the data source to obtain all tables in the database, and the user selects the tables to be counted; then inquiring and displaying a field information list of a table selected by a user, supporting operations of displaying the fields, displaying sequence ordering, formatting, adding the fields as screening fields, selecting matching types during screening, wherein the matching types during screening have equal, comparing, blurring and the like, and then configuring to complete a data asset;
s4, selecting a field to be displayed: firstly, a user enters a home page of the system to check all data asset profiles in the system, such as statistical information of data total quantity, daily increment, month increment and the like of each asset, the user clicks a screenable condition field, a converted data value and an ordered display field of a current asset, the user can screen and check the current asset data on the detail page, and then the flow of the asset display platform is ended.
In the embodiment, the field information list of the table selected by the user is queried and displayed, so that the problem that development work of a plurality of data assets is repeated, the problem that statistics of a plurality of data assets is difficult to collect is solved, and the problem that a plurality of statistical platforms are difficult to maintain is solved, the transparency of the data processing and statistics process is ensured, and compared with the mode that data of all participating platforms are collected to a third party when asset data joint statistics is carried out in the prior art, the data privacy of the user is ensured, and the safety of the data statistics is improved.
Example 2
As shown in fig. 1-2, on the basis of embodiment 1, the present invention provides a technical solution: preferably, S1, acquiring asset data corresponding to a target object, wherein the asset data is data corresponding to digital assets owned by the target object on a current platform, the total digital assets owned by the target object are arranged on a plurality of platforms, each platform corresponds to a node in a block chain, and performing fragmentation processing on the asset data to obtain a plurality of fragmented asset data; distributing a plurality of fragmented asset data to a current node and at least one participating node, and acquiring target fragmented asset data sent by the at least one participating node, wherein the target fragmented asset data is obtained by fragmenting the target asset data by the participating node, the target asset data is data on a platform corresponding to the participating node, and total asset data is determined based on the fragmented asset data in the current node and the target fragmented asset data, wherein the total asset data is used for representing the sum of digital assets owned by a target object in the current platform and the platform corresponding to the at least one participating node, and an S4 data display unit is used for calculating the corresponding information of the statistic data and a cabinet by combining the big data from two-dimensional and three-dimensional angles through a spring closed architecture, and displaying the corresponding information through a PC end UI display or a mobile end APPVR display, wherein the module display area is used for displaying the assets with less frequent relative change and larger space occupation; the equipment display area is used for displaying assets with frequent change and small space occupation; the module display area and the equipment display area are both displayed through a PC end UI, and the machine room scene display area displays asset information for displaying a machine room in real scenery through a mobile end APP VR.
In this embodiment, the technical effects of improving the security of data statistics and ensuring the privacy of users are achieved, and further the technical problem of low security caused by statistics of digital assets of users in multiparty institutions based on unilateral institutions in the prior art is solved, the efficiency of information interaction is greatly improved, the information loss and the time loss are reduced, the accuracy and timeliness of information transmission are ensured, the difficulty of information inquiry and browsing is reduced, operation and maintenance management staff can greatly improve the control efficiency, speed of response is accelerated, and the processing time is shortened.
The working principle of the database-based data asset statistics method is described in detail below.
1-2, aiming at the fact that the data asset comprises an asset configuration system and an asset display platform, on the basis of the prior art, big data is adopted for real-time calculation, asset data corresponding to a target object is obtained for newly-added data asset and real-time statistics of the asset, wherein the asset data is data corresponding to the digital asset owned by the target object on a current platform, the total digital asset owned by the target object is arranged on a plurality of platforms, each platform corresponds to a node in a blockchain, firstly, a manager inputs data source link information of a storage system for the data to be counted, such as information of a database type, IP (Internet protocol), port, account number password and the like, after inputting is completed, the system firstly detects whether the data can be communicated or not, and if not, the data can be re-input, the next step can be carried out, the system inquires all tables under the data source, and a table needing to be counted is selected by a user; then inquiring and displaying a field information list of a table selected by a user, supporting operations of displaying the fields, displaying sequence ordering, formatting, adding the fields into screening fields, selecting matching types during screening and the like, wherein the matching types during screening have equal, comparing, blurring and the like, configuring and completing a data asset, and inquiring all the tables under a database by a data source by a system, and selecting the tables needing to be counted by the user; and then, inquiring and displaying a field information list of a table selected by a user, solving the problem that development work of a plurality of data assets is repeated, solving the problem that statistics is difficult to collect of a plurality of data assets, and solving the problem that maintenance is difficult to be carried out on a plurality of statistics platforms, ensuring that data processing and statistics are open and transparent, compared with the mode that data of all participating platforms are collected to a third party when the asset data is combined and counted in the prior art, ensuring the data privacy of the user, improving the safety of data statistics, firstly, entering a system first page by the user, viewing all data asset profiles in the system, such as statistic information of the total data amount, daily increment, month increment and the like of each asset, clicking a certain asset to view system details by the user, screening condition fields of the current asset, converted data values and ordered display fields, finishing the flow of the asset display platform, and realizing the real-time statistics of complex information of a data center in a classification mode under the effect of displaying by a visual means, and the like, thereby greatly improving the efficiency, greatly improving the efficiency of information interaction and the information, greatly improving the accuracy and the operation and control time, shortening the operation and control time, and shortening the response time.
The foregoing invention has been generally described in great detail, but it will be apparent to those skilled in the art that modifications and improvements can be made thereto. Accordingly, it is intended to cover modifications or improvements within the spirit of the inventive concepts.
Claims (6)
1. A database-based data asset statistics method comprising the steps of:
s1, inputting data source connection information: aiming at the data assets including an asset configuration system and an asset display platform, on the basis of the prior art, big data is adopted for real-time calculation, and real-time statistics is carried out on newly added data assets and assets;
s2, detecting whether the connection is possible: firstly, an administrator inputs data source link information of a storage system used for data to be counted, such as information of a used database type, IP, a port, an account number and a password, and after inputting is completed, the system firstly detects whether the data can be communicated or not, and if not, the data can be input again, and then the next step can be carried out;
s3, selecting a table needing statistics: the system queries the data source to obtain all tables in the database, and the user selects the tables to be counted; then inquiring and displaying a field information list of a table selected by a user, supporting operations of displaying the fields, displaying sequence ordering, formatting, adding the fields as screening fields, selecting matching types during screening, wherein the matching types during screening have equal, comparing, blurring and the like, and then configuring to complete a data asset;
s4, selecting a field to be displayed: firstly, a user enters a home page of the system to check all data asset profiles in the system, such as statistical information of data total quantity, daily increment, month increment and the like of each asset, the user clicks a screenable condition field, a converted data value and an ordered display field of a current asset, the user can screen and check the current asset data on the detail page, and then the flow of the asset display platform is ended.
2. A database-based data asset statistics method as claimed in claim 1, wherein: s1, acquiring asset data corresponding to a target object, wherein the asset data is data corresponding to digital assets owned by the target object on a current platform, the total digital assets owned by the target object are arranged on a plurality of platforms, and each platform corresponds to a node in a blockchain.
3. A database-based data asset statistics method as claimed in claim 2, wherein: performing slicing processing on the asset data to obtain a plurality of sliced asset data; and distributing the plurality of fragmented asset data to the current node and at least one participating node, and acquiring target fragmented asset data sent by the at least one participating node, wherein the target fragmented asset data is obtained by performing fragmentation processing on the target asset data by the participating node, and the target asset data is data on a platform corresponding to the participating node.
4. A database-based data asset statistics method as claimed in claim 3, wherein: based on the sharded asset data in the current node and the target sharded asset data, total asset data is determined, wherein the total asset data is used to characterize a sum of digital assets owned by the target object in the current platform and a platform corresponding to the at least one participating node.
5. A database-based data asset statistics method as claimed in claim 1, wherein: s4, calculating corresponding information of statistical data and the cabinet from two-dimensional and three-dimensional angles by combining big data spark through a spring closed architecture, and displaying through PC end UI display or mobile end APPVR display, wherein the display comprises a module display area, a device display area and a machine room scene display area, and the module display area is used for displaying assets with relatively infrequent change and larger space occupation; the equipment display area is used for displaying assets with frequent change and small space occupation; the module display area and the equipment display area are displayed through a PC end UI.
6. A database-based data asset statistics method as claimed in claim 1, wherein: the machine room scene display area displays asset information for real-scene display of the machine room through the mobile terminal APP VR, and the machine room scene display area further comprises a query module for querying all other corresponding information according to the equipment information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211669550.3A CN116049254A (en) | 2022-12-24 | 2022-12-24 | Data asset statistics method based on database |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211669550.3A CN116049254A (en) | 2022-12-24 | 2022-12-24 | Data asset statistics method based on database |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116049254A true CN116049254A (en) | 2023-05-02 |
Family
ID=86130448
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211669550.3A Pending CN116049254A (en) | 2022-12-24 | 2022-12-24 | Data asset statistics method based on database |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116049254A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117150570A (en) * | 2023-11-01 | 2023-12-01 | 国网浙江省电力有限公司 | Asset information process safety monitoring method and system based on data resource elements |
-
2022
- 2022-12-24 CN CN202211669550.3A patent/CN116049254A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117150570A (en) * | 2023-11-01 | 2023-12-01 | 国网浙江省电力有限公司 | Asset information process safety monitoring method and system based on data resource elements |
| CN117150570B (en) * | 2023-11-01 | 2024-01-26 | 国网浙江省电力有限公司 | Asset information process safety monitoring method and system based on data resource elements |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11258693B2 (en) | Collaborative incident management for networked computing systems | |
| US11836148B1 (en) | Data source correlation user interface | |
| US10985970B1 (en) | Automatic actionable event responder for operational clusters | |
| US11803548B1 (en) | Automated generation of metrics from log data | |
| US11023511B1 (en) | Mobile device composite interface for dual-sourced incident management and monitoring system | |
| US11303503B1 (en) | Multi-source incident management and monitoring system | |
| US20190098106A1 (en) | Proxying hypertext transfer protocol (http) requests for microservices | |
| US8997000B2 (en) | Integrated view of network management data | |
| US10091358B1 (en) | Graphical user interface for call center analysis | |
| US11172065B1 (en) | Monitoring framework | |
| CN110647522B (en) | Data mining method, device and system | |
| US20070038641A1 (en) | Systems and methods for automated application updating | |
| CN109254901B (en) | A kind of Monitoring Indexes method and system | |
| US20020070971A1 (en) | System and methods for tracking central office equipment and inventory records | |
| US11316749B1 (en) | Generating three-dimensional representation of one or more cloud computing systems | |
| US20230123539A1 (en) | Stitching event data using identity mappings | |
| CN116049254A (en) | Data asset statistics method based on database | |
| US9054969B2 (en) | System and method for situation-aware IP-based communication interception and intelligence extraction | |
| CN112052134A (en) | Service data monitoring method and device | |
| CN107909458A (en) | A kind of common function list generation method and system for online service system | |
| CN109213782A (en) | Configuration, display methods, device and the communication equipment of search interface | |
| CN108540302B (en) | Big data processing method and equipment | |
| CN111353671B (en) | Supply chain management method, device and system | |
| CN107608979A (en) | Identify the method and device of the potential knowledge point sought help of user | |
| CN116089490A (en) | Data analysis method, device, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |