CN112559670A - Data management system - Google Patents
Data management system Download PDFInfo
- Publication number
- CN112559670A CN112559670A CN202011530350.0A CN202011530350A CN112559670A CN 112559670 A CN112559670 A CN 112559670A CN 202011530350 A CN202011530350 A CN 202011530350A CN 112559670 A CN112559670 A CN 112559670A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- intelligent
- unit
- account
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/31—Indexing; Data structures therefor; Storage structures
- G06F16/316—Indexing structures
- G06F16/328—Management therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/35—Clustering; Classification
- G06F16/353—Clustering; Classification into predefined classes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/35—Clustering; Classification
- G06F16/355—Class or cluster creation or modification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/604—Tools and structures for managing or administering access control systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Computer Security & Cryptography (AREA)
- Databases & Information Systems (AREA)
- Computer Hardware Design (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- Mathematical Physics (AREA)
- Computing Systems (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Automation & Control Theory (AREA)
- Medical Informatics (AREA)
- General Business, Economics & Management (AREA)
- Business, Economics & Management (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Molecular Biology (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to the technical field of data management, and discloses a data management system, which comprises a password modification module, a registration login module, an identity verification module, a real-time updating module, a manual entry module, an internet module, a data auditing module, a data preprocessing module, an intelligent sorting module, an index generation module, a data storage module, a data uploading module, a cloud storage module, a data calling module, an index retrieval module, a data list module, a data browsing module and a data exporting module; the manual entry module comprises a manual entry unit and a data editing unit; the intelligent sorting module comprises a data classification unit and a data clustering unit; when the invention faces the text data which grows exponentially, the text data can be automatically and systematically summarized, sorted and classified, which is beneficial to reducing the labor cost.
Description
Technical Field
The invention relates to the technical field of data management, in particular to a data management system.
Background
Chinese invention patent CN110717046A discloses a data management system based on text data, which comprises a computer, wherein the computer is respectively provided with a data input module, a data classification module, a data processing module, a data storage module, a data query module and a data output module, although the invention calls information quickly and conveniently and saves operation time, the invention has simple structure, cannot automatically update and intelligently classify data in real time, and has poor safety of the whole system; with the continuous development of internet technology and the arrival of the digital era, the number of electronic documents based on text data has been exponentially increased in the past decades, and all industries accumulate a large number of document materials and manuscripts in daily business work, and because documents with the same type and the same theme in the current period need to be frequently inquired or retrieved as references in the work, the document management system is large in number, various in theme, different in format, and dispersed in different hands of different personnel, and difficult to perform unified retrieval, and the existing document management system on the market at present only has simple storage function and display, cannot automatically and systematically arrange text materials, cannot uniformly store historical data and new data materials, and needs to consume a large amount of labor cost to conclude and arrange; therefore, it is particularly important to invent a data management system;
the existing data management system only performs simple storage function and display when the text data which grows exponentially faces, cannot automatically and systematically summarize and arrange the text materials, and needs to consume a large amount of labor cost, so that the data management system is provided.
Disclosure of Invention
The present invention provides a data management system to solve the problem that the existing data management system proposed in the above background art only performs simple storage function and display when text data is exponentially increased, and cannot perform automatic systematic summarization and arrangement on text materials, which requires a large amount of labor cost.
The purpose of the invention can be realized by the following technical scheme:
a data management system comprises a password modification module, a registration login module, an identity verification module, a real-time updating module, a manual entry module, an internet module, a data auditing module, a data preprocessing module, an intelligent sorting module, an index generation module, a data storage module, a data uploading module, a cloud storage module, a data retrieval module, an index retrieval module, a data list module, a data browsing module and a data export module;
the manual entry module comprises a manual entry unit and a data editing unit; the intelligent sorting module comprises a data classification unit and a data clustering unit; the real-time updating module is in communication connection with the internet module; the data uploading module is in communication connection with the cloud storage module, and the data calling module is in communication connection with the data editing unit.
Further, the registration login module is used for registering an account in a mode of uploading personal basic information, and generating account information and an account password; the identity authentication module is used for verifying and authenticating account information and passwords; the verification process is specifically as follows:
s1: the user continuously inputs the password for X times on the login module, wherein X is a preset value, and X is 3;
s2: when X is smaller than the preset value, the user can normally log in the system;
s3: when X is larger than a preset value, the user can normally log in after short message verification is carried out through the smart phone;
the password modification module is used for modifying the account password in a mode of checking the account password and the personal basic information to generate a new account password.
Further, the cloud storage module is used for storing data through a cloud server; the data calling module is used for calling the data stored in the cloud storage module and sending the data to the data editing unit.
Furthermore, the manual entry unit is used for manually entering new data, and the data editing unit is used for calling and editing the data stored in the cloud storage module through the data calling module; the internet module is used for collecting data of various platforms; the real-time updating module is used for extracting the data collected by the internet module and updating the data in real time according to the data in the existing cloud storage module; the real-time updating module and the manual entry module are in communication connection with the data auditing module, and the data auditing module is used for performing content auditing on manually entered new data and data of various platforms, removing useless data and extracting available data.
Furthermore, the data preprocessing module is used for performing word segmentation processing and stop word removal processing on the audited available data; the data classification unit is used for intelligently classifying the available data subjected to word segmentation processing and stop word removal processing by using a machine learning method to obtain an intelligent classification result; the intelligent classification steps are as follows:
SS 1: extracting word segmentation processing results and removing stop word processing results to obtain feature words;
SS 2: reducing the dimension for the feature words to generate a training set and a test set;
SS 3: putting the training set into a classifier for machine learning;
SS 4: verifying the learning effect by using the test set to obtain a classification model;
the data clustering unit is used for intelligently clustering the available data subjected to word segmentation processing and stop word removal processing by using a deep learning method to obtain an intelligent clustering result; the index generation module is used for generating indexes from intelligent classification results and intelligent clustering results by using an index generator according to the feature words in the intelligent classification and intelligent clustering; the data storage module is used for storing the intelligent classification result and the intelligent clustering result; and the data uploading module is used for uploading the intelligent classification result and the intelligent clustering result to the cloud server for secondary storage.
Furthermore, the index retrieval module is used for searching data according to the characteristic words; the data list module is used for generating a data result list according to the relevance of the searched characteristic words; the data export module is used for downloading data according to the data result list.
Further, the account numbers comprise an administrator account number and a personal account number; the personal information comprises personal name, identification card number, mobile phone number picture content and birth year and month.
The invention has the beneficial effects that: (1) the password modification device is provided with a password modification module, an identity verification module and a cloud storage module, wherein the password modification module is used for modifying an account password in a mode of checking the account password and personal basic information to generate a new account password, so that a user can change the password at any time, and the account is prevented from being stolen; the identity authentication module is used for checking and authenticating account information and passwords, and when the number of times of mistake input of the user password is greater than a preset value, the mobile phone short message authentication is required, so that the account security of the user is further guaranteed; the cloud storage module is used for storing data through a cloud server, so that data loss caused by artificial or natural disasters of the system is prevented; thereby being beneficial to ensuring the integrity of the data;
(2) the intelligent management system is provided with a data preprocessing module and an intelligent sorting module, wherein the data preprocessing module is used for performing word segmentation processing and stop word removal processing on approved available data, so that the workload is reduced for subsequent operation; the intelligent sorting module comprises a data sorting unit and a data clustering unit, wherein the data sorting unit is used for intelligently sorting the available data subjected to word segmentation processing and stop word removal processing by using a machine learning method to obtain an intelligent sorting result, and the data clustering unit is used for intelligently clustering the available data subjected to word segmentation processing and stop word removal processing by using a deep learning method to obtain an intelligent clustering result; the data classification unit and the data clustering unit respectively finish data sorting work by machine learning and deep learning, so that the labor cost is reduced, the data is more vivid, and a user can conveniently and accurately find the data.
Drawings
In order to facilitate understanding for those skilled in the art, the present invention will be further described with reference to the accompanying drawings.
FIG. 1 is a block diagram of the system of the present invention.
Detailed Description
In order to make the technical means, the creation characteristics, the achievement purposes and the effects of the invention easy to understand, the invention is further described with the specific embodiments.
As shown in fig. 1, a data management system includes a password modification module, a registration login module, an authentication module, a real-time update module, a manual entry module, an internet module, a data audit module, a data preprocessing module, an intelligent sorting module, an index generation module, a data storage module, a data uploading module, a cloud storage module, a data retrieval module, an index retrieval module, a data list module, a data browsing module, and a data export module;
the manual entry module comprises a manual entry unit and a data editing unit; the intelligent sorting module comprises a data classification unit and a data clustering unit; the real-time updating module is in communication connection with the internet module; the data uploading module is in communication connection with the cloud storage module, and the data calling module is in communication connection with the data editing unit.
The registration login module is used for registering an account in a mode of uploading personal basic information and generating account information and an account password; the identity authentication module is used for verifying and authenticating the account information and the password; the verification process is as follows:
s1: the user continuously inputs the password for X times on the login module, wherein X is a preset value, and X is 3;
s2: when X is smaller than the preset value, the user can normally log in the system;
s3: when X is larger than a preset value, the user can normally log in after short message verification is carried out through the smart phone;
and the password modification module is used for modifying the account password in a mode of checking the account password and the personal basic information to generate a new account password.
The cloud storage module is used for storing data through a cloud server; the data calling module is used for calling the data stored in the cloud storage module and sending the data to the data editing unit.
The data editing unit is used for calling and editing the data stored in the cloud storage module through the data calling module; the internet module is used for collecting data of various platforms; the real-time updating module is used for extracting the data collected by the internet module and updating the data in real time according to the data in the existing cloud storage module; the real-time updating module and the manual entry module are in communication connection with the data auditing module, and the data auditing module is used for content auditing of manually entered new data and data of various platforms, removing useless data and extracting available data.
The data preprocessing module is used for performing word segmentation processing and stop word removal processing on the audited available data; the data classification unit is used for intelligently classifying the available data subjected to word segmentation processing and stop word removal processing by using a machine learning method to obtain an intelligent classification result; the intelligent classification steps are as follows:
SS 1: extracting word segmentation processing results and removing stop word processing results to obtain feature words;
SS 2: reducing the dimension for the feature words to generate a training set and a test set;
SS 3: putting the training set into a classifier for machine learning;
SS 4: verifying the learning effect by using the test set to obtain a classification model;
the data clustering unit is used for intelligently clustering the available data subjected to word segmentation processing and stop word removal processing by using a deep learning method to obtain an intelligent clustering result; the index generation module is used for generating indexes from the intelligent classification result and the intelligent clustering result by using the index generator according to the intelligent classification and the characteristic words in the intelligent clustering; the data storage module is used for storing the intelligent classification result and the intelligent clustering result; and the data uploading module is used for uploading the intelligent classification result and the intelligent clustering result to the cloud server for secondary storage.
The index retrieval module is used for searching data according to the characteristic words; the data list module is used for generating a data result list according to the relevance of the searched characteristic words; the data export module is used for downloading data according to the data result list.
The account number comprises an administrator account number and a personal account number; the personal information comprises personal name, identification card number, mobile phone number picture content and birth year and month.
Before the data management system is used, an administrator and an individual need to register an account in a mode of uploading personal basic information to generate account information and an account password; then, entering an identity verification module to verify and verify the account information and the password; after the verification is successful, the administrator can choose to enter the manual entry module, manually enter new data through the manual entry unit, and also can call and edit the data stored in the cloud storage module through the data editing unit; meanwhile, the internet module collects data of various platforms and sends the data to the real-time updating module, and the real-time updating module extracts the data and updates the data in real time according to the data in the existing cloud storage module; all manually input new data and data of various platforms can be subjected to content verification through the data verification module, useless data are removed, and available data are extracted; then the data preprocessing module can perform word segmentation processing and stop word removal processing on the audited available data; then the data classification unit intelligently classifies the available data which is subjected to word segmentation processing and stop word removal processing by using a machine learning method to obtain an intelligent classification result; the data clustering unit intelligently clusters the available data subjected to word segmentation processing and stop word removal processing by using a deep learning method to obtain an intelligent clustering result; next, the index generating module generates indexes from the intelligent classification results and the intelligent clustering results by using the index generator according to the feature words in the intelligent classification and the intelligent clustering; then the intelligent classification result and the intelligent clustering result are stored by the data storage module; the data uploading module is used for uploading the intelligent classification result and the intelligent clustering result to a cloud server for secondary storage; therefore, data loss caused by downtime or server breakdown can be prevented; the individuals who are successfully verified can search the data through the index retrieval module; then the data list module generates a data result list according to the relevance of the searched characteristic words, and finally, an individual can download data in the data result list through the data export module; the invention is directed to the administrator and the individual user, so that the whole system is more comprehensive, and when the invention is directed to the exponentially increased text data, the text material can be automatically and systematically summarized, sorted and intelligently classified, thereby being beneficial to reducing the labor cost.
The foregoing is merely exemplary and illustrative of the present invention and various modifications, additions and substitutions may be made by those skilled in the art to the specific embodiments described without departing from the scope of the invention as defined in the following claims.
Claims (7)
1. A data management system is characterized by comprising a password modification module, a registration login module, an identity verification module, a real-time updating module, a manual entry module, an internet module, a data auditing module, a data preprocessing module, an intelligent sorting module, an index generation module, a data storage module, a data uploading module, a cloud storage module, a data calling module, an index retrieval module, a data list module, a data browsing module and a data exporting module;
the manual entry module comprises a manual entry unit and a data editing unit; the intelligent sorting module comprises a data classification unit and a data clustering unit; the real-time updating module is in communication connection with the internet module; the data uploading module is in communication connection with the cloud storage module, and the data calling module is in communication connection with the data editing unit.
2. The data management system of claim 1, wherein the registration login module is configured to register an account by uploading basic personal information, and generate account information and an account password; the identity authentication module is used for verifying and authenticating account information and passwords; the verification process is specifically as follows:
s1: the user continuously inputs the password for X times on the login module, wherein X is a preset value, and X is 3;
s2: when X is smaller than the preset value, the user can normally log in the system;
s3: when X is larger than a preset value, the user can normally log in after short message verification is carried out through the smart phone;
the password modification module is used for modifying the account password in a mode of checking the account password and the personal basic information to generate a new account password.
3. The system according to claim 1, wherein the cloud storage module is configured to store data via a cloud server; the data calling module is used for calling the data stored in the cloud storage module and sending the data to the data editing unit.
4. The data management system of claim 1, wherein the manual entry unit is configured to manually enter new data, and the data editing unit is configured to retrieve and edit data stored in the cloud storage module through the data retrieval module; the internet module is used for collecting data of various platforms; the real-time updating module is used for extracting the data collected by the internet module and updating the data in real time according to the data in the existing cloud storage module; the real-time updating module and the manual entry module are in communication connection with the data auditing module, and the data auditing module is used for performing content auditing on manually entered new data and data of various platforms, removing useless data and extracting available data.
5. The data management system of claim 1, wherein the data preprocessing module is configured to perform word segmentation and stop word removal on the available data after the review; the data classification unit is used for intelligently classifying the available data subjected to word segmentation processing and stop word removal processing by using a machine learning method to obtain an intelligent classification result; the intelligent classification steps are as follows:
SS 1: extracting word segmentation processing results and removing stop word processing results to obtain feature words;
SS 2: reducing the dimension for the feature words to generate a training set and a test set;
SS 3: putting the training set into a classifier for machine learning;
SS 4: verifying the learning effect by using the test set to obtain a classification model;
the data clustering unit is used for intelligently clustering the available data subjected to word segmentation processing and stop word removal processing by using a deep learning method to obtain an intelligent clustering result; the index generation module is used for generating indexes from intelligent classification results and intelligent clustering results by using an index generator according to the feature words in the intelligent classification and intelligent clustering; the data storage module is used for storing the intelligent classification result and the intelligent clustering result; and the data uploading module is used for uploading the intelligent classification result and the intelligent clustering result to the cloud server for secondary storage.
6. The system of claim 1, wherein the index retrieval module is configured to search for the document according to the feature words; the data list module is used for generating a data result list according to the relevance of the searched characteristic words; the data export module is used for downloading data according to the data result list.
7. A material management system as claimed in claim 2, wherein the account numbers include an administrator account number and a personal account number; the personal information comprises personal name, identification card number, mobile phone number picture content and birth year and month.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011530350.0A CN112559670A (en) | 2020-12-22 | 2020-12-22 | Data management system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011530350.0A CN112559670A (en) | 2020-12-22 | 2020-12-22 | Data management system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112559670A true CN112559670A (en) | 2021-03-26 |
Family
ID=75031444
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011530350.0A Pending CN112559670A (en) | 2020-12-22 | 2020-12-22 | Data management system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112559670A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104348817A (en) * | 2013-08-07 | 2015-02-11 | 深圳市腾讯计算机系统有限公司 | User account protection method and user account protection device |
| CN109992645A (en) * | 2019-03-29 | 2019-07-09 | 国家计算机网络与信息安全管理中心 | A kind of data supervision system and method based on text data |
| CN110399339A (en) * | 2019-06-18 | 2019-11-01 | 平安科技（深圳）有限公司 | File classifying method, device, equipment and the storage medium of knowledge base management system |
-
2020
- 2020-12-22 CN CN202011530350.0A patent/CN112559670A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104348817A (en) * | 2013-08-07 | 2015-02-11 | 深圳市腾讯计算机系统有限公司 | User account protection method and user account protection device |
| CN109992645A (en) * | 2019-03-29 | 2019-07-09 | 国家计算机网络与信息安全管理中心 | A kind of data supervision system and method based on text data |
| CN110399339A (en) * | 2019-06-18 | 2019-11-01 | 平安科技（深圳）有限公司 | File classifying method, device, equipment and the storage medium of knowledge base management system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110209764B (en) | Corpus annotation set generation method and device, electronic equipment and storage medium | |
| CN112613501A (en) | Information auditing classification model construction method and information auditing method | |
| CN108776671A (en) | A kind of network public sentiment monitoring system and method | |
| CN110297988A (en) | Hot topic detection method based on weighting LDA and improvement Single-Pass clustering algorithm | |
| CN110263009A (en) | Generation method, device, equipment and the readable storage medium storing program for executing of log classifying rules | |
| CN111460162B (en) | Text classification method and device, terminal equipment and computer readable storage medium | |
| CN110909542A (en) | Intelligent semantic series-parallel analysis method and system | |
| CN114297140A (en) | Archive management system based on artificial intelligence | |
| CN109101487A (en) | Conversational character differentiating method, device, terminal device and storage medium | |
| CN117520503A (en) | Financial customer service dialogue generation method, device, equipment and medium based on LLM model | |
| CN116562304B (en) | File intelligent open identification method based on artificial intelligence and multidimensional semantic understanding | |
| CN117436440A (en) | Log identification method, system, terminal equipment and storage medium | |
| CN109063063B (en) | Data processing method and device based on multi-source data | |
| CN112559670A (en) | Data management system | |
| CN116226108A (en) | Data management method and system capable of realizing different management degrees | |
| CN106446696A (en) | Information processing method and electronic device | |
| CN112579747B (en) | Identity information extraction method and device | |
| CN112988972A (en) | Administrative penalty file evaluation and checking method and system based on data model | |
| CN112991131A (en) | Government affair data processing method suitable for electronic government affair platform | |
| CN111210373A (en) | Comprehensive management system for students | |
| CN115114495B (en) | Airworthiness data management auxiliary method and system based on deep learning | |
| LU504881B1 (en) | Intelligent collection method and system for engineering archives based on enabling thinking | |
| CN117112809B (en) | Knowledge tracking method and system | |
| CN111324711B (en) | Post timeliness judging method and device and storage medium | |
| CN117453982B (en) | File management file classification system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210326 |