CN115618080A - Data management implementation method based on data management platform and data management platform - Google Patents
Data management implementation method based on data management platform and data management platform Download PDFInfo
- Publication number
- CN115618080A CN115618080A CN202211245439.1A CN202211245439A CN115618080A CN 115618080 A CN115618080 A CN 115618080A CN 202211245439 A CN202211245439 A CN 202211245439A CN 115618080 A CN115618080 A CN 115618080A
- Authority
- CN
- China
- Prior art keywords
- subsystem
- data
- database
- management platform
- data management
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/904—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/906—Clustering; Classification
Abstract
The invention relates to the technical field of data processing, in particular to a data management implementation method based on a data management platform and the data management platform, which comprises an acquisition system, a preprocessing system, a storage system, an inquiry system and a visualization system, wherein firstly, the acquisition system acquires information data; then, the preprocessing system preprocesses the information data to obtain preprocessed data; then, the storage system constructs a database, classifies the preprocessed data and stores the preprocessed data in the database; additionally, the target data may be retrieved from the database based on the query request by the query system; and finally, the visualization system visualizes the target data and displays the target data. The invention uniformly acquires and then classifies the information data, realizes uniform management and is convenient for inquiring the information, and solves the problem that the existing data management platform is difficult to uniformly manage the data and causes difficult searching and sharing.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a data management implementation method based on a data management platform and the data management platform.
Background
Huge and complicated informationized data can be roughly classified into picture data, character data, audio data, video data and the like. The sources of the informationized data are very diverse, and some data are generated from daily office, some data are generated from conferences, some data are generated from court trial systems, and some data are arranged for publicity recording. The formats of the data are also various, most of data information is centrally stored through a central machine room, but some scattered data are still located in a personal notebook computer, a mobile hard disk or other storage devices, especially some external pictures and audio and video data recorded by a handheld device are often directly stored in an operator computer after being generated, so that the resource sharing performance is poor, and the problems of repeated resource storage, idling and the like exist. The data is difficult to manage uniformly, information islands are caused, and searching and sharing are difficult.
Disclosure of Invention
The invention aims to provide a data management implementation method based on a data management platform and the data management platform, and aims to solve the problem that the existing data management platform is difficult to uniformly manage data and search and share the data.
In order to achieve the above object, in a first aspect, the present invention provides a data management platform, including an acquisition system, a preprocessing system, a storage system, an inquiry system, and a visualization system, where the acquisition system, the preprocessing system, the storage system, the inquiry system, and the visualization system are connected in sequence;
the acquisition system is used for acquiring information data;
the preprocessing system is used for preprocessing the information data to obtain preprocessed data;
the storage system is used for constructing a database, classifying the preprocessed data and storing the preprocessed data into the database;
the query system retrieves target data from the database based on a query request;
and the visualization system is used for displaying the target data after visualization.
The pretreatment system comprises a filtration subsystem and a format conversion subsystem, wherein the filtration subsystem is connected with the format conversion subsystem;
the filtering subsystem is used for filtering the information data to obtain filtered data;
and the format conversion subsystem performs format conversion on the filtered data based on a target format to obtain preprocessed data.
The storage subsystem comprises a classification subsystem, a database construction subsystem and a storage subsystem, wherein the classification subsystem, the database construction subsystem and the storage subsystem are sequentially connected;
the classification subsystem is used for classifying the preprocessed data according to data types to obtain a classification data set;
the database construction subsystem is used for constructing a database;
the storage subsystem is used for storing the classification data set into the database.
The query system comprises a key extraction subsystem, a matching subsystem and a calling subsystem, wherein the key extraction subsystem, the matching subsystem and the calling subsystem are sequentially connected;
the key extraction subsystem is used for extracting key words in the query request;
the matching subsystem is used for matching from the database by using the keywords to obtain target data;
and the calling subsystem is used for extracting the target data.
The visualization system comprises a generation subsystem, a display subsystem, an angle adjustment subsystem and a brightness adjustment subsystem, wherein the generation subsystem, the angle adjustment subsystem and the brightness adjustment subsystem are respectively connected with the display subsystem;
the generation subsystem generates a visualization model based on the target data;
the display subsystem is used for displaying the visualization model;
the angle adjusting subsystem adjusts the angle of the display subsystem based on the crowd density;
the brightness adjusting subsystem adjusts the brightness of the display subsystem based on the current illumination intensity.
The angle adjusting subsystem comprises a shooting module, a feature extraction module and an angle adjusting module, and the shooting module, the feature extraction module and the angle adjusting module are sequentially connected;
the shooting module is used for shooting a current scene image;
the feature extraction module is used for extracting features of the current scene image to obtain crowd density;
the angle adjusting module adjusts the angle of the display subsystem based on the crowd density.
In a second aspect, the present invention provides a data management implementation method based on a data management platform, including the following steps:
collecting information data through a collection system;
preprocessing the information data through a preprocessing system to obtain preprocessed data;
constructing a database through a storage system, classifying the preprocessed data and storing the preprocessed data into the database;
retrieving, by the query system, the target data from the database based on the query request;
and visualizing the target data through a visualization system and then displaying the target data.
Firstly, the acquisition system acquires information data; then, the preprocessing system preprocesses the information data to obtain preprocessed data; then, the storage system builds a database, classifies the preprocessed data and stores the preprocessed data in the database; additionally, target data may be retrieved from the database based on a query request by the query system; and finally, the visualization system visualizes and displays the target data. The information data are uniformly acquired and then classified and stored, so that the information is conveniently inquired while uniform management is realized, and the problem that the data are difficult to uniformly manage and the searching and sharing are difficult due to the fact that the conventional data management platform is difficult to uniformly manage the data is solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a data management platform according to the present invention.
FIG. 2 is a schematic diagram of the pretreatment system.
Fig. 3 is a schematic diagram of the structure of the memory system.
Fig. 4 is a schematic diagram of the structure of the query system.
Fig. 5 is a schematic structural diagram of a visualization system.
Fig. 6 is a schematic structural diagram of the angle adjustment subsystem.
Fig. 7 is a schematic diagram of the structure of the brightness adjustment subsystem.
Fig. 8 is a schematic structural diagram of the feature extraction module.
Fig. 9 is a schematic diagram of the structure of the training submodule.
Fig. 10 is a flowchart of a data management implementation method of a data management platform according to the present invention.
1-acquisition system, 2-preprocessing system, 3-storage system, 4-query system, 5-visualization system, 6-filtering subsystem, 7-format conversion subsystem, 8-classification subsystem, 9-database construction subsystem, 10-storage subsystem, 11-key extraction subsystem, 12-matching subsystem, 13-calling subsystem, 14-generation subsystem, 15-display subsystem, 16-angle adjustment subsystem, 17-brightness adjustment subsystem, 18-shooting module, 19-feature extraction module, 20-angle adjustment module, 21-construction sub-module, 22-training sub-module, 23-input sub-module, 24-acquisition unit, 25-filtering unit, 26-labeling unit, 27-training unit, 28-photometry module, 29-comparison module and 30-brightness adjustment module.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative and intended to explain the present invention and should not be construed as limiting the present invention.
Referring to fig. 1 to 5, the present invention provides a data management platform, including an acquisition system 1, a preprocessing system 2, a storage system 3, an inquiry system 4 and a visualization system 5, where the acquisition system 1, the preprocessing system 2, the storage system 3, the inquiry system 4 and the visualization system 5 are connected in sequence;
the acquisition system 1 is used for acquiring information data;
the preprocessing system 2 is configured to preprocess the information data to obtain preprocessed data;
the storage system 3 is used for constructing a database, classifying the preprocessed data and storing the preprocessed data into the database;
the query system 4 retrieves target data from the database based on a query request;
and the visualization system 5 is used for displaying the target data after visualization.
Specifically, first, the acquisition system 1 acquires information data; then, the preprocessing system 2 preprocesses the information data to obtain preprocessed data; then, the storage system 3 builds a database, classifies the preprocessed data and stores the preprocessed data in the database; additionally, target data may be retrieved from the database based on a query request by the query system 4; finally, the visualization system 5 visualizes and displays the target data. The information data are uniformly acquired and then classified and stored, so that the information is conveniently inquired while uniform management is realized, and the problem that the data are difficult to uniformly manage and the searching and sharing are difficult due to the fact that the conventional data management platform is difficult to uniformly manage the data is solved.
Further, the pretreatment system 2 comprises a filtration subsystem 6 and a format conversion subsystem 7, wherein the filtration subsystem 6 is connected with the format conversion subsystem 7;
the filtering subsystem 6 is used for filtering the information data to obtain filtered data;
and the format conversion subsystem 7 is used for carrying out format conversion on the filtered data based on the target format to obtain preprocessed data.
Specifically, firstly, the filtering subsystem 6 filters the information data to obtain filtered data, and deletes repeated data and redundant data in the information data to improve the validity of the data; then, the format conversion subsystem 7 performs format conversion on the filtered data based on the target format to obtain preprocessed data, so that the uniformity of the data is improved, and the subsequent query is facilitated.
Further, the storage subsystem 10 includes a classification subsystem 8, a database construction subsystem 9 and a storage subsystem 10, and the classification subsystem 8, the database construction subsystem 9 and the storage subsystem 10 are connected in sequence;
the classification subsystem 8 is configured to classify the preprocessed data according to data types to obtain a classification dataset;
the database construction subsystem 9 is used for constructing a database;
the storage subsystem 10 is configured to store the classification data set in the database.
Specifically, firstly, the classification subsystem 8 classifies the preprocessed data according to data types to obtain a classification data set, where the data types include pictures, characters, audio, and video; then, the database construction subsystem 9 constructs a database; finally, the storage subsystem 10 stores the classified data sets in the database.
Further, the query system 4 includes a key extraction subsystem 11, a matching subsystem 12 and a calling subsystem 13, and the key extraction subsystem 11, the matching subsystem 12 and the calling subsystem 13 are connected in sequence;
the key extraction subsystem 11 is used for extracting key words in the query request;
the matching subsystem 12 is configured to match the database with the keyword to obtain target data;
the calling subsystem 13 is configured to extract the target data.
Specifically, first, the key extraction subsystem 11 extracts a keyword in the query request; then, the matching subsystem 12 matches the data stored in the database one by using the keywords to obtain target data; finally, the calling subsystem 13 extracts the target data.
Further, the visualization system 5 includes a generation subsystem 14, a display subsystem 15, an angle adjustment subsystem 16 and a brightness adjustment subsystem 17, where the generation subsystem 14, the angle adjustment subsystem 16 and the brightness adjustment subsystem 17 are respectively connected to the display subsystem 15;
the generation subsystem 14, generating a visualization model based on the target data;
the display subsystem 15 is used for displaying the visualization model;
the angle adjusting subsystem 16 adjusts the angle of the display subsystem 15 based on the crowd density;
the brightness adjustment subsystem 17 adjusts the brightness of the display subsystem 15 based on the current illumination intensity.
The angle adjustment subsystem 16 comprises a shooting module 18, a feature extraction module 19 and an angle adjustment module 20, wherein the shooting module 18, the feature extraction module 19 and the angle adjustment module 20 are sequentially connected;
the shooting module 18 is used for shooting a current scene image;
the feature extraction module 19 is configured to perform feature extraction on the current scene image to obtain crowd density;
the angle adjusting module 20 adjusts the angle of the display subsystem 15 based on the crowd density.
Specifically, first, the generation subsystem 14 generates a visualization model based on the target data; the display subsystem 15 then displays the visualization model; meanwhile, the shooting module 18 shoots the current scene image; the feature extraction module 19 performs feature extraction on the current scene image to obtain crowd density; finally, the angle adjustment module 20 adjusts the angle of the display subsystem 15 based on the crowd density; after the angle adjustment is completed, the brightness of the display subsystem 15 is adjusted based on the current illumination intensity by the brightness adjustment subsystem 17.
Further, the feature extraction module 19 includes a construction sub-module 21, a training sub-module 22 and an input sub-module 23, and the construction sub-module 21, the training sub-module 22 and the input sub-module 23 are connected in sequence;
the construction submodule 21 is configured to construct a neural network model;
the training submodule 22 is configured to train the neural network model by using a public data set, so as to obtain a feature extraction model;
the input sub-module 23 is configured to input the current scene image into the feature extraction model, so as to obtain crowd density.
Specifically, the construction submodule 21 constructs a neural network model; the training submodule 22 trains the neural network model using a public data set to obtain a feature extraction model; the input submodule 23 inputs the current scene image into the feature extraction model to obtain the crowd density.
Further, the training submodule 22 includes an obtaining unit 24, a filtering unit 25, a labeling unit 26 and a training unit 27, where the obtaining unit 24, the filtering unit 25, the labeling unit 26 and the training unit 27 are connected in sequence;
the acquiring unit 24 is configured to acquire a public data set;
the filtering unit 25 is configured to filter the public data set to obtain a filtered data set;
the labeling unit 26 is configured to label the filtered data set to obtain a labeled data set;
the training unit 27 is configured to train the neural network model by using the labeled data set to obtain a feature extraction model.
Specifically, the acquiring unit 24 acquires a public data set; the filtering unit 25 filters the public data set to obtain a filtered data set; the labeling unit 26 labels the filtered data set to obtain a labeled data set; the training unit 27 trains the neural network model using the labeled data set to obtain a feature extraction model.
Further, the brightness adjustment subsystem 17 includes a light metering module 28, a contrast module 29 and a brightness adjustment module 30, and the light metering module 28, the contrast module 29 and the brightness adjustment module 30 are connected in sequence;
the photometric module 28 is configured to measure a current illumination intensity;
the comparison module 29 is configured to compare the current illumination intensity with a target illumination intensity to obtain a comparison result;
the brightness adjusting module 30 adjusts the brightness of the display subsystem 15 based on the contrast result.
Specifically, the photometric module 28 measures the current illumination intensity; the comparison module 29 compares the current illumination intensity with the target illumination intensity to obtain a comparison result; the brightness adjustment module 30 adjusts the brightness of the display subsystem 15 based on the contrast result.
Referring to fig. 10, in a second aspect, the present invention provides a data management implementation method based on a data management platform, including the following steps:
s1, collecting information data through a collection system 1;
s2, preprocessing the information data through the preprocessing system 2 to obtain preprocessed data;
specifically, firstly, the filtering subsystem 6 filters the information data to obtain filtered data, and deletes repeated data and redundant data in the information data to improve the validity of the data; then, the format conversion subsystem 7 performs format conversion on the filtered data based on the target format to obtain preprocessed data, so that the uniformity of the data is improved, and the subsequent query is facilitated.
S3, a database is built through the storage system 3, and the preprocessed data are classified and stored in the database;
specifically, firstly, the classification subsystem 8 classifies the preprocessed data according to data types to obtain a classification data set, where the data types include pictures, texts, audios, and videos; then, the database construction subsystem 9 constructs a database; finally, the storage subsystem 10 stores the classified data sets in the database.
S4, retrieving target data from a database through the query system 4 based on the query request;
specifically, first, the key extraction subsystem 11 extracts a keyword in a query request; then, the matching subsystem 12 matches the data stored in the database one by using the keywords to obtain target data; finally, the calling subsystem 13 extracts the target data.
And S5, visualizing the target data through the visualization system 5 and then displaying the visualized target data.
Specifically, first, the generation subsystem 14 generates a visualization model based on the target data; the display subsystem 15 then displays the visualization model; meanwhile, the shooting module 18 shoots the current scene image; the feature extraction module 19 performs feature extraction on the current scene image to obtain crowd density; finally, the angle adjustment module 20 adjusts the angle of the display subsystem 15 based on the crowd density; after the angle adjustment is completed, the brightness of the display subsystem 15 is adjusted based on the current illumination intensity by the brightness adjustment subsystem 17.
Although the present invention has been described with reference to specific embodiments, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (7)
1. A data management platform is characterized in that,
the system comprises an acquisition system, a preprocessing system, a storage system, an inquiry system and a visualization system, wherein the acquisition system, the preprocessing system, the storage system, the inquiry system and the visualization system are sequentially connected;
the acquisition system is used for acquiring information data;
the preprocessing system is used for preprocessing the information data to obtain preprocessed data;
the storage system is used for constructing a database, classifying the preprocessed data and storing the preprocessed data into the database;
the query system retrieves target data from the database based on a query request;
and the visualization system is used for displaying the target data after visualization.
2. The data management platform of claim 1,
the pretreatment system comprises a filtration subsystem and a format conversion subsystem, and the filtration subsystem is connected with the format conversion subsystem;
the filtering subsystem is used for filtering the information data to obtain filtered data;
and the format conversion subsystem performs format conversion on the filtered data based on a target format to obtain preprocessed data.
3. The data management platform of claim 2,
the storage subsystem comprises a classification subsystem, a database construction subsystem and a storage subsystem, and the classification subsystem, the database construction subsystem and the storage subsystem are sequentially connected;
the classification subsystem is used for classifying the preprocessed data according to data types to obtain a classification data set;
the database construction subsystem is used for constructing a database;
the storage subsystem is used for storing the classification data set into the database.
4. The data management platform of claim 3,
the query system comprises a key extraction subsystem, a matching subsystem and a calling subsystem, wherein the key extraction subsystem, the matching subsystem and the calling subsystem are sequentially connected;
the key extraction subsystem is used for extracting key words in the query request;
the matching subsystem is used for matching from the database by using the keywords to obtain target data;
and the calling subsystem is used for extracting the target data.
5. The data management platform of claim 4,
the visualization system comprises a generating subsystem, a display subsystem, an angle adjusting subsystem and a brightness adjusting subsystem, wherein the generating subsystem, the angle adjusting subsystem and the brightness adjusting subsystem are respectively connected with the display subsystem;
the generation subsystem generates a visualization model based on the target data;
the display subsystem is used for displaying the visualization model;
the angle adjusting subsystem adjusts the angle of the display subsystem based on the crowd density;
the brightness adjusting subsystem adjusts the brightness of the display subsystem based on the current illumination intensity.
6. The data management platform of claim 5,
the angle adjusting subsystem comprises a shooting module, a feature extraction module and an angle adjusting module, and the shooting module, the feature extraction module and the angle adjusting module are sequentially connected;
the shooting module is used for shooting a current scene image;
the feature extraction module is used for extracting features of the current scene image to obtain crowd density;
the angle adjusting module adjusts the angle of the display subsystem based on the crowd density.
7. A data management implementation method based on a data management platform, applied to the data management platform of claim 6, characterized by comprising the following steps:
collecting information data through a collection system;
preprocessing the information data through a preprocessing system to obtain preprocessed data;
constructing a database through a storage system, classifying the preprocessed data and storing the preprocessed data into the database;
retrieving, by the query system, the target data from the database based on the query request;
and visualizing the target data through a visualization system and then displaying the target data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211245439.1A CN115618080A (en) | 2022-10-12 | 2022-10-12 | Data management implementation method based on data management platform and data management platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211245439.1A CN115618080A (en) | 2022-10-12 | 2022-10-12 | Data management implementation method based on data management platform and data management platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115618080A true CN115618080A (en) | 2023-01-17 |
Family
ID=84862964
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211245439.1A Withdrawn CN115618080A (en) | 2022-10-12 | 2022-10-12 | Data management implementation method based on data management platform and data management platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115618080A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116451338A (en) * | 2023-02-10 | 2023-07-18 | 重庆蓝鲸智联科技有限公司 | MCU-based integrated architecture design method |
-
2022
- 2022-10-12 CN CN202211245439.1A patent/CN115618080A/en not_active Withdrawn
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116451338A (en) * | 2023-02-10 | 2023-07-18 | 重庆蓝鲸智联科技有限公司 | MCU-based integrated architecture design method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11483621B2 (en) | Big data acquisition and analysis system using intelligent image recognition, and application method thereof | |
| WO2022116888A1 (en) | Method and device for video data processing, equipment, and medium | |
| CN102819578B (en) | Suspected target analyzing system and method by video investigation | |
| US20080162561A1 (en) | Method and apparatus for semantic super-resolution of audio-visual data | |
| Mühling et al. | Content-based video retrieval in historical collections of the German broadcasting archive | |
| US20130159311A1 (en) | System and methods for generation of a concept based database | |
| KR100771574B1 (en) | A method for indexing a plurality of digital information signals | |
| WO2009061420A1 (en) | Object recognition and database population | |
| CN101369281A (en) | Retrieval method based on video abstract metadata | |
| US20140040232A1 (en) | System and method for tagging multimedia content elements | |
| CN113010703A (en) | Information recommendation method and device, electronic equipment and storage medium | |
| CN112884005A (en) | Image retrieval method and device based on SPTAG and convolutional neural network | |
| CN111860523B (en) | Intelligent recording system and method for sound image files | |
| CN101470730B (en) | Image repetition detection method based on spectrum characteristics analysis | |
| CN113360599A (en) | Multi-source heterogeneous information convergence cooperative processing platform based on content identification | |
| CN108491543A (en) | Image search method, image storage method and image indexing system | |
| CN114625918A (en) | Video recommendation method, device, equipment, storage medium and program product | |
| CN115618080A (en) | Data management implementation method based on data management platform and data management platform | |
| Chand et al. | Content-based search in lecture video: a systematic literature review | |
| CN112115281A (en) | Data retrieval method, device and storage medium | |
| Oliveira-Barra et al. | Leveraging activity indexing for egocentric image retrieval | |
| Chenot et al. | A large-scale audio and video fingerprints-generated database of tv repeated contents | |
| Chen | Multimedia databases and data management: a survey | |
| CN114385859A (en) | Multi-modal retrieval method for video content | |
| CN112580696A (en) | Advertisement label classification method, system and equipment based on video understanding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20230117 |