CN116055325B - Data information management system for interconnection communication - Google Patents
Data information management system for interconnection communication Download PDFInfo
- Publication number
- CN116055325B CN116055325B CN202211652234.5A CN202211652234A CN116055325B CN 116055325 B CN116055325 B CN 116055325B CN 202211652234 A CN202211652234 A CN 202211652234A CN 116055325 B CN116055325 B CN 116055325B
- Authority
- CN
- China
- Prior art keywords
- data
- module
- unit
- database
- management
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004891 communication Methods 0.000 title claims abstract description 22
- 238000012545 processing Methods 0.000 claims abstract description 55
- 238000000034 method Methods 0.000 claims abstract description 47
- 230000008569 process Effects 0.000 claims abstract description 47
- 238000004458 analytical method Methods 0.000 claims abstract description 15
- 230000003993 interaction Effects 0.000 claims abstract description 14
- 230000005540 biological transmission Effects 0.000 claims description 17
- 238000012423 maintenance Methods 0.000 claims description 7
- 238000011084 recovery Methods 0.000 claims description 7
- 238000005457 optimization Methods 0.000 claims description 5
- 238000004140 cleaning Methods 0.000 claims description 2
- 238000007726 management method Methods 0.000 abstract description 83
- 238000013500 data storage Methods 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 7
- 238000013523 data management Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
- G06F16/2433—Query languages
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/084—Configuration by using pre-existing information, e.g. using templates or copying from other elements
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data information management system for interconnection communication, which comprises: the system comprises a client connection management module, a process management module, an analysis execution module, a data engine module, a memory management module, a database and an interconnection interaction module, wherein information interaction is carried out among the client connection management module, the process management module, the analysis execution module, the data engine module, the database and the memory management module through the interconnection interaction module; the client connection management module is used for managing the connection of the user and recording the connection state of the client; the process management module is used for managing and distributing service processes of each client when a plurality of clients are connected; the analysis execution module is used for analyzing the operation of the client into a form understood by the data storage module and executing the operation of the client; the data engine module is used for controlling the reading and writing of data and the transaction processing; the memory management module is used for managing the data memory and guaranteeing the stable operation of the database; the database is used for storing data information.
Description
Technical Field
The invention relates to the technical field of data control, in particular to a data information management system for interconnection communication.
Background
Data management is the process of efficiently collecting, storing, processing and applying data using computer hardware and software technology. The purpose is to fully and effectively play the role of data. The key for realizing effective management of data is data organization, along with development of computer technology, the data management goes through three development stages of manual management, file system and database system, and the built data structure in the database system more fully describes internal connection among data, is convenient for data modification, updating and expansion, simultaneously ensures independence, reliability, safety and integrity of the data, reduces data redundancy, and improves data sharing degree and data management efficiency, and the interconnection communication is a technology for communication by taking a computer as a basic carrier of communication and taking a network as a channel through the Internet. The interconnection communication technology breaks the traditional region and space limitation, so that the information can be quickly transmitted to a destination.
The prior data information management system for interconnection communication can not carry out backup cache on the transmitted data in the process of carrying out data information transmission, so that the transmitted data is lost in the process of interconnection communication.
Disclosure of Invention
In order to solve the defects in the prior art, on the basis of realizing data information transmission, data are backed up and cached at the same time, and the aim of improving the data transmission efficiency is fulfilled, the invention adopts the following technical scheme:
a data information management system for interconnection communication, comprising: the system comprises a client connection management module, a process management module, an analysis execution module, a data engine module, a memory management module, a database and an interconnection interaction module, wherein the client connection management module, the process management module, the analysis execution module, the data engine module, the database and the memory management module are used for carrying out information interaction through the interconnection interaction module, the client connection management module is used for managing connection of users and recording connection states of the clients, the process management module is used for managing and distributing service processes of the clients when the clients are connected, the analysis execution module is used for analyzing operation of the clients into a form understood by the data storage module and executing operation of the clients, the data engine module is used for controlling reading and writing of data and transaction processing, the memory management module is used for managing stable operation of the data memory to guarantee stable operation of the database, and the database is used for storing data information.
As a preferred solution of the present invention, the client connection management module includes a remote connection management unit and a local connection management unit, where the remote connection management unit is used for remotely connecting to a data terminal, the remote connection management unit is applicable to a 3G internet, 4G, 5G, WIFI and a local area network, the local connection management unit is used for physical network connection, and the local connection management unit is applicable to USB, broadband and network cards.
As a preferred scheme of the invention, the process management module comprises an access control unit, a process thread management unit and a process input unit, wherein the access control unit is used for managing access rights of data when the data are transmitted, establishing a transmission relation between the data passing through the management and the system, the process thread management unit is used for executing and scheduling when a program runs, limiting the access rights management process, and the process input unit is used for inputting the data after establishing the data transmission relation.
As a preferred scheme of the invention, the analysis execution module comprises a permission control unit, an optimization unit, a processing unit and an execution unit, wherein the permission control unit is used for managing the operation permission range when the client operates, the optimization unit is used for decomposing and optimizing the operation command of the client into a control language which can be identified by a database, the processing unit is used for analyzing and processing the command of the client operation, and the execution unit is used for generating an execution plan and transmitting the execution plan to the data engine module for processing data.
As a preferred scheme of the invention, the data engine module comprises a data index unit, a transaction processing unit, a cache management unit, a concurrent processing unit and a log management unit, wherein the index unit is used for classifying, summarizing and sequencing data information in a database, the transaction processing unit is used for performing serial execution on each item of data operation to be executed, the cache management unit is used for storing a series of data modified by the transaction processing unit, the concurrent processing unit is used for simultaneously operating a plurality of data processing operations, and the log management unit is used for recording the update of the database by the transaction processing unit.
As a preferable scheme of the invention, the memory management module comprises a memory processing unit, a copying backup unit and a recovery unit, wherein the memory processing unit is used for cleaning data garbage or/and the data garbage cached by the cache management unit, the copying backup unit is used for copying backup data, and the recovery unit is used for recovering the data rewritten by the transaction processing unit.
As a preferable scheme of the invention, a data definition module, a data operation module, a data protection module and a data maintenance module are arranged in the database, wherein the data definition module is used for defining the operation form of data, the data operation module is used for creating, deleting and modifying the data, the data protection module is used for protecting the integrity and the safety of the data, and the data maintenance module is used for maintaining the table structure and the data in the database.
As a preferred scheme of the invention, the database is a relational database, the stored format can intuitively reflect the relation among entities, the relational database is used for structuring data, the query language of the relational database is SQL (structured query language), the relational database conforms to SQL standards, SQL refers to shorthand of Structured Query Language, the structured query language is structured, and the common operations of SQL are as follows: query, add, update, delete, sum, and sort.
The invention has the advantages that:
the invention can carry out backup storage on the data in the process of data transmission by interconnection communication, reduces the probability of data loss, can store different data information in a classified way through the arrangement of the database, increases the compatibility and the applicability of the system, simultaneously can observe the progress of data storage or transmission in real time, carries out secondary backup on the data in the process of transmission, reduces the probability of data transmission loss, and compresses, transmits and backs up the data with high efficiency when the system transmits the data through the cooperation of the interconnection interaction module and the remote connection management unit.
Drawings
FIG. 1 is a schematic diagram of a system structure according to an embodiment of the present invention.
Fig. 2 is a schematic structural diagram of a client connection management module according to an embodiment of the present invention.
FIG. 3 is a schematic diagram of a process management module according to an embodiment of the present invention.
Fig. 4 is a schematic diagram of a parsing execution module according to an embodiment of the invention.
Fig. 5 is a schematic diagram of a data engine module structure in an embodiment of the present invention.
Fig. 6 is a schematic diagram of a memory management module according to an embodiment of the invention.
FIG. 7 is a schematic diagram of a database structure in an embodiment of the invention.
Detailed Description
The following describes specific embodiments of the present invention in detail with reference to the drawings. It should be understood that the detailed description and specific examples, while indicating and illustrating the invention, are not intended to limit the invention.
As shown in fig. 1, a data information management system for interconnection communication includes: the system comprises a client connection management module, a process management module, an analysis execution module, a data engine module, a memory management module, a database and an interconnection interaction module, wherein the client connection management module, the process management module, the analysis execution module, the data engine module, the database and the memory management module are used for carrying out information interaction through the interconnection interaction module, the client connection management module is used for managing connection of users and recording connection states of the clients, the process management module is used for managing and distributing service processes of the clients when the clients are connected, the analysis execution module is used for analyzing operation of the clients into a form understood by the data storage module and executing operation of the clients, the data engine module is used for controlling reading and writing of data and transaction processing, the memory management module is used for managing stable operation of the data memory to guarantee stable operation of the database, and the database is used for storing data information.
In the specific embodiment of the invention, the data can be backed up and stored in the process of transmitting the data through interconnection communication, the probability of data loss is reduced, different data information can be stored in a classified mode through the arrangement of the database, the compatibility and the applicability of the system are improved, meanwhile, the progress of data storage or transmission can be observed in real time, the data can be backed up for the second time in the process of transmitting, the probability of data transmission loss is reduced, and the data is compressed, transmitted and backed up in a high quick-acting rate when the system transmits the data through the interconnection interaction module.
Specifically, as shown in fig. 2, the client connection management module includes a remote connection management unit and a local connection management unit, where the remote connection management unit is used for remotely connecting to a data terminal, the remote connection management unit is applicable to a 3G internet, 4G, 5G, WIFI and a local area network, the local connection management unit is used for physical network connection, and the local connection management unit is applicable to USB, broadband and network cards.
In a specific embodiment of the invention, the data terminal is remotely connected through a remote connection management unit, and is physically connected through a local connection management unit.
Specifically, as shown in fig. 3, the process management module includes an admission control unit, a process thread management unit and a process entry unit, where the admission control unit is used to manage access rights of data when transmitting the data, and establish a transmission relationship between the data passing through the management and the system, the process thread management unit is used to execute scheduling when running a program, and limit the access rights management process, and the process entry unit is used to enter the data after establishing the data transmission relationship.
In the specific embodiment of the invention, the access authority of the data is managed when the data is transmitted through the access control unit, the transmission relation between the data passing through the management and the system is established, the execution scheduling is performed when the program is operated through the process thread management unit, the access authority management process is limited, and the data is recorded after the data transmission relation is established through the process recording unit.
Specifically, as shown in fig. 4, the analysis execution module includes a permission control unit, an optimization unit, a processing unit and an execution unit, where the permission control unit is used to manage an operation permission range when the client operates, the optimization unit is used to decompose and optimize an operation command of the client into a control language that can be identified by a database, the processing unit is used to analyze and process the command operated by the client, and the execution unit is used to generate an execution plan and transmit the execution plan to the data engine module to process data.
In a specific embodiment of the invention, the authority control unit is used for managing the operation authority range of the client during operation, the optimizing unit is used for decomposing and optimizing the operation command of the client into a control language which can be identified by the database, the processing unit is used for analyzing and processing the command of the client operation, and the executing unit is used for generating an execution plan and delivering the execution plan to the data engine module for processing data.
Specifically, as shown in fig. 5, the data engine module includes a data index unit, a transaction processing unit, a cache management unit, a concurrency processing unit and a log management unit, where the index unit is used to classify, generalize and sort data information in a database, the transaction processing unit is used to perform serial execution on each item of data operation to be executed, the cache management unit is used to store a series of data modified by the transaction processing unit, the concurrency processing unit is used to operate multiple data processing operations at the same time, and the log management unit is used to record updates made by the transaction processing unit on the database.
In the specific embodiment of the invention, the data information in the database is classified, generalized and ordered through the index unit, each data operation to be executed is executed in series through the transaction processing unit, a series of data modified by the transaction processing unit is stored through the cache management unit, a plurality of data processing operations are operated simultaneously through the concurrent processing unit, and the update of the transaction processing unit to the database is recorded through the log management unit.
Specifically, as shown in fig. 6, the memory management module includes a memory processing unit, a copy backup unit, and a recovery unit, where the memory processing unit is configured to clean data garbage or/and data garbage cached by the cache management unit, the copy backup unit is configured to copy backup data, and the recovery unit is configured to recover data rewritten by the transaction processing unit.
In a specific embodiment of the present invention, the memory processing unit cleans up the data garbage or/and the data garbage cached by the cache management unit, the copy backup unit copies the backup data, and the recovery unit recovers the data rewritten by the transaction processing unit.
Specifically, as shown in fig. 7, a data definition module, a data operation module, a data protection module and a data maintenance module are disposed in the database, the data definition module is used for defining an operation form of data, the data operation module is used for creating, deleting and modifying the data, the data protection module is used for protecting the integrity and the security of the data, and the data maintenance module is used for maintaining a table structure and the data in the database.
In a specific embodiment of the invention, the data definition module is used for defining the operation form of the data, the data operation module is used for creating, deleting and modifying the data, the data protection module is used for protecting the integrity and the safety of the data, and the data maintenance module is used for maintaining the table structure and the data in the database.
Specifically, the database is a relational database, the stored format can intuitively reflect the relationship between entities, the relational database is used for structuring data, the query language of the relational database is an SQL (structured query language), the relational database conforms to the SQL standard, the SQL refers to the shorthand of Structured Query Language, the structured query language is the SQL common operation: query, add, update, delete, sum, and sort.
In the specific embodiment of the invention, the applicability of the data storage of the system is improved by adopting a relational database and SQL language as query languages of the database.
The above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced with equivalents; such modifications and substitutions do not depart from the spirit of the technical solutions according to the embodiments of the present invention.
Claims (8)
1. A data information management system for interconnection communication, comprising: the system comprises a client connection management module, a process management module, an analysis execution module, a data engine module, a memory management module, a database and an interconnection interaction module, and is characterized in that: the client side connection management module, the process management module, the analysis execution module, the data engine module, the database and the memory management module are subjected to information interaction through the interconnection interaction module;
the client connection management module is used for managing the connection of the user and recording the connection state of the client;
the process management module is used for managing and distributing service processes of the clients when the clients are connected;
the analysis execution module is used for analyzing the operation of the client into a form understood by the data engine module and executing the operation of the client;
the data engine module is used for controlling the reading and writing of data and the transaction processing;
the memory management module is used for managing the data memory and guaranteeing the stable operation of the database; the memory management module comprises a memory processing unit, a copy backup unit and a recovery unit;
the memory processing unit is used for cleaning the data garbage or/and caching the data garbage cached by the cache management unit;
the copy backup unit is used for copying the backup data;
the recovery unit is used for recovering the data rewritten by the transaction processing unit;
the database is used for storing data information; the database is internally provided with a data definition module, a data operation module, a data protection module and a data maintenance module;
the data definition module is used for defining the operation form of the data;
the data operation module is used for creating, deleting and modifying data;
the data protection module is used for protecting the integrity and the safety of data;
the data maintenance module is used for maintaining the table structure and the data in the database.
2. The data information management system for interconnection communication according to claim 1, wherein: the client connection management module comprises a remote connection management unit and a local connection management unit;
the remote connection management unit is used for remotely connecting the data terminal;
the local connection management unit is used for entity network connection.
3. The data information management system for interconnection communication according to claim 2, wherein: the remote connection suitable for the remote connection management unit comprises a 3G interconnection network, 4G, 5G, WIFI and a local area network; the physical network connection suitable for the local connection management unit comprises USB, broadband and network card.
4. The data information management system for interconnection communication according to claim 1, wherein: the process management module comprises an admission control unit, a process thread management unit and a process input unit;
the access control unit is used for managing the access authority of the data when the data is transmitted, and establishing a transmission relation between the data passing the management and the system;
the process thread management unit is used for performing execution scheduling when the program runs and limiting the access right management process;
the process input unit is used for inputting data after establishing a data transmission relation.
5. The data information management system for interconnection communication according to claim 1, wherein: the analysis execution module comprises a permission control unit, an optimization unit, a processing unit and an execution unit;
the authority control unit is used for managing the operation authority range of the client during operation;
the optimizing unit is used for decomposing and optimizing the operation command of the client into a control language which can be identified by the database;
the processing unit is used for analyzing and processing the command of the client operation;
and the execution unit is used for generating an execution plan and transmitting the execution plan to the data engine module for processing data.
6. The data information management system for interconnection communication according to claim 1, wherein: the data engine module comprises a data index unit, a transaction processing unit, a cache management unit, a concurrency processing unit and a log management unit;
the index unit is used for classifying, summarizing and sorting the data information in the database;
the transaction processing unit is used for performing serial execution on each item of data operation to be executed;
the cache management unit is used for storing a series of data modified by the transaction processing unit;
the concurrent processing unit is used for simultaneously operating a plurality of data processing operations;
the log management unit is used for recording the update of the transaction processing unit to the database.
7. The data information management system for interconnection communication according to claim 1, wherein: the database is a relational database, the stored format can intuitively reflect the relationship between the entities, and the relational database is used for structuring data.
8. The data information management system for interconnection communication according to claim 7, wherein: the query language of the relational database is SQL language, the relational database conforms to SQL standard, namely structured query language, and the SQL comprises the following operations: query, add, update, delete, sum, and sort.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211652234.5A CN116055325B (en) | 2022-12-22 | 2022-12-22 | Data information management system for interconnection communication |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211652234.5A CN116055325B (en) | 2022-12-22 | 2022-12-22 | Data information management system for interconnection communication |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116055325A CN116055325A (en) | 2023-05-02 |
| CN116055325B true CN116055325B (en) | 2024-04-09 |
Family
ID=86115527
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211652234.5A Active CN116055325B (en) | 2022-12-22 | 2022-12-22 | Data information management system for interconnection communication |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116055325B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112182082A (en) * | 2020-09-24 | 2021-01-05 | 广州巨杉软件开发有限公司 | System and method for realizing strong consistency of transactions across different database engines |
| CN112579363A (en) * | 2020-12-30 | 2021-03-30 | 上海爱数信息技术股份有限公司 | MySQL data protection system and backup and recovery method thereof |
| CN114756610A (en) * | 2022-03-15 | 2022-07-15 | 云粒智慧科技有限公司 | Full-function hybrid data engine management system and method |
-
2022
- 2022-12-22 CN CN202211652234.5A patent/CN116055325B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112182082A (en) * | 2020-09-24 | 2021-01-05 | 广州巨杉软件开发有限公司 | System and method for realizing strong consistency of transactions across different database engines |
| CN112579363A (en) * | 2020-12-30 | 2021-03-30 | 上海爱数信息技术股份有限公司 | MySQL data protection system and backup and recovery method thereof |
| CN114756610A (en) * | 2022-03-15 | 2022-07-15 | 云粒智慧科技有限公司 | Full-function hybrid data engine management system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116055325A (en) | 2023-05-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109034993B (en) | Account checking method, account checking equipment, account checking system and computer readable storage medium | |
| CN103548003B (en) | Method and system for improving the client-side fingerprint cache of deduplication system backup performance | |
| US7801852B2 (en) | Checkpoint-free in log mining for distributed information sharing | |
| CN104301360B (en) | A kind of method of logdata record, log server and system | |
| CN112445863B (en) | Data real-time synchronization method and system | |
| CN102880663A (en) | Optimization of a partially deduplicated file | |
| US20170185621A1 (en) | Reconstructing distributed cached data for retrieval | |
| US10853157B2 (en) | Compact binary event log generation | |
| US11314719B2 (en) | Method for implementing change data capture in database management system | |
| CN109213752A (en) | A kind of data cleansing conversion method based on CIM | |
| CN102012933A (en) | Distributed file system and method for storing data and providing services by utilizing same | |
| CN103500120A (en) | Distributed cache high-availability processing method and system based on multithreading asynchronous double writing | |
| CN113590556A (en) | Database-based log processing method, device and equipment | |
| CN102340537B (en) | Distributed business processing method and device | |
| KR20200056357A (en) | Technique for implementing change data capture in database management system | |
| CN105718572B (en) | A kind of transaction consistency of isomeric data composite object reaches method and system | |
| CN113791586A (en) | Novel industrial APP and identification registration analysis integration method | |
| CN109308290A (en) | A kind of efficient data cleaning conversion method based on CIM | |
| US20140040191A1 (en) | Inventorying and copying file system folders and files | |
| CN116055325B (en) | Data information management system for interconnection communication | |
| CN117370314A (en) | Distributed database system collaborative optimization and data processing system and method | |
| CN106919566A (en) | A kind of query statistic method and system based on mass data | |
| CN107577809A (en) | Offline small documents processing method and processing device | |
| CN102419758A (en) | Data processing system and method | |
| CN111813607B (en) | Database cluster recovery log processing system based on memory fusion |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |