CN106559427B - Data storage and data transmission system - Google Patents
Data storage and data transmission system Download PDFInfo
- Publication number
- CN106559427B CN106559427B CN201611047437.6A CN201611047437A CN106559427B CN 106559427 B CN106559427 B CN 106559427B CN 201611047437 A CN201611047437 A CN 201611047437A CN 106559427 B CN106559427 B CN 106559427B
- Authority
- CN
- China
- Prior art keywords
- data
- data file
- server
- file
- user client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 20
- 238000013500 data storage Methods 0.000 title claims abstract description 16
- 238000000034 method Methods 0.000 claims description 7
- 230000006835 compression Effects 0.000 claims description 5
- 238000007906 compression Methods 0.000 claims description 5
- 230000009286 beneficial effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
- H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/14—Details of searching files based on file metadata
- G06F16/148—File search processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
- G06F16/164—File meta data generation
- G06F16/166—File name conversion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/602—Providing cryptographic facilities or services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/565—Conversion or adaptation of application format or content
- H04L67/5651—Reducing the amount or size of exchanged application data
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Computer Hardware Design (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Library & Information Science (AREA)
- Human Computer Interaction (AREA)
- Computing Systems (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Software Systems (AREA)
- Storage Device Security (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention relates to a data storage system and a data transmission system.A data file is identified, encrypted and compressed to generate a data stream and uploaded to a server, the server decompresses and decrypts the received data stream, renames the data file, stores the data file to the server after encryption, and establishes a data table for marking data and storing the data in the server in a database of the server; the user client sends a data file query instruction to the server to query whether a data table of the server has a marked data file, and if the data file is stored in the server, the user client sends a data file downloading instruction set; the server analyzes the received downloading instruction set, searches a data file to be downloaded, compresses and encrypts the data file and sends the data file to the user client; the invention greatly improves the data operation efficiency, improves the system fluency and simultaneously ensures that the data transmission and storage are safer.
Description
Technical Field
The invention relates to the technical field of information security, in particular to a data storage and data transmission system.
Background
At present, in the process of processing various business processes by an Enterprise Resource Planning (ERP) system, there are a considerable amount of CAD format image-text files and product photo data, which are collectively referred to as drawing files. As the business operation time increases, the volume and the number of the drawing files are increased. The traditional method is to store the paper data directly in the database or open up a server sharing directory.
Directly storing the paper data in the database results in an unlimited increase in the volume of the database, thereby affecting the operating efficiency of the database. For example, the average increase of the volume of a database per year exceeds 5GB in certain well-known ERP brand software in China, so that the input efficiency of each item of retrieval of the ERP is reduced year by year, and the system is more and more clamped.
The development of a server shared directory also has a certain amount of security risks, and the shared path of the local area network is easily detected, so that the data is illegally accessed. For example, some enterprises store drawing materials in a hard disk directory of a server and then set the drawing materials to be shared in a local area network, although the access of users is facilitated, shared resources are easily stolen and downloaded by non-target authorized users.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a data storage and data transmission system, which can greatly improve the operation efficiency of a database and can safely transmit and download data.
The technical scheme for solving the technical problems is as follows:
a data storage system, characterized by the steps of:
step 1: respectively marking each data file, and encrypting and compressing after marking to generate a data stream;
step 2: uploading the encrypted and compressed data stream to a server;
and step 3: the server decompresses and decrypts the received data stream, and decompresses the identifier and the data file of the data stream;
and 4, step 4: renaming each decompressed data file in a naming mode of: identifier _ data name suffix name; encrypting the decompressed data and storing the encrypted data in a server;
and 5: and establishing a data table for marking data to be stored in the server in a database of the server, and marking each data file to be stored in the data table.
Has the advantages that: after the data file is encrypted and compressed, a data stream is generated and transmitted, the data file is decompressed and decrypted in the server, renamed and stored, and the stored data file is marked and recorded, so that the data file can be conveniently searched. By adopting the scheme, the data file transmission efficiency is high, the data transmission is safe, the retrieval and input efficiency of the database can be greatly improved, and the system smoothness is improved.
Further, the specific method for identifying each data file in step 1 is as follows: material number + data name + data file + command code.
The beneficial effects of the further technical scheme are that: the data files are identified by the mode of material number + data name + data file + command code, so that the data files can be retrieved quickly.
Further, after the data file is completely identified in step 1, encryption and compression are performed, and finally, the generated data stream is a binary data stream.
The beneficial effects of the further technical scheme are that: the binary data stream is adopted, so that the data can be efficiently transmitted, and the encryption and decryption efficiency of the data file can be improved.
Further, the method for marking the data storage in step 5 is as follows: after the data is stored, writing a Boolean value 1 in the corresponding data file of the data sheet, which represents that the material record is uploaded to the server.
The beneficial effects of the further technical scheme are that: and setting a data table for marking a specific list of the stored data files, facilitating retrieval and searching and confirming whether the files are stored or not.
A data transmission system is characterized in that based on a data storage system, the data transmission system is carried out according to the following steps:
step 1, a user client sends a data file query instruction to a server;
step 2, the server receives an inquiry instruction of the user client and inquires whether a data table of the server has a marked data file or not;
if the data file is not stored in the server, sending prompt information that the data file is not inquired to the user client;
if the data file is stored in the server through inquiry, the user client sends a data file downloading instruction set to the server;
step 3, the server analyzes the received downloading instruction set;
step 4, according to the analysis result, the server searches the corresponding data file to be downloaded from the corresponding folder;
step 5, the server reads the data file for encryption and compression, and sends the data file to the user client;
and 6, receiving the data file by the user client, decompressing and decrypting the data file, and storing or displaying the data file.
Has the advantages that: the data transmission system based on the data storage system is adopted, the data transmission safety problem is solved, and the reliability of data transmission is greatly improved.
Further, in step 2 of the data transmission system, the user client sends a data file downloading instruction set to the server, where the downloading instruction set includes a downloading instruction and an identifier-data name of a specific data file to be downloaded.
The beneficial effects of the further technical scheme are that: the downloading instruction set of the data file comprises the identifier and the data name of the data file, so that the data file in the server database can be inquired quickly and accurately, and the data inquiry efficiency is greatly improved.
Further, the identifier is a material number of the data file.
The beneficial effects of the further technical scheme are that: and a material number is adopted, wherein the material number is 7 bytes of a data head and is enough for naming data files.
Further, the specific steps of the server analyzing the received downloading instruction set in step 3 of the data transmission system are as follows: and splitting the downloading instruction set, splitting the material number, the data name and the suffix name of the data file, and sequentially splicing to form a complete data file name.
The beneficial effects of the further technical scheme are that: the downloading instruction set is divided into complete data names, so that the data files can be conveniently inquired, and the data can be quickly inquired.
Drawings
FIG. 1 is a flow diagram of a data storage system;
fig. 2 is a flow chart of a data transmission system.
Detailed Description
The principles and features of this invention are described below in conjunction with the following drawings, which are set forth by way of illustration only and are not intended to limit the scope of the invention.
As shown in fig. 1, a data storage system, comprises the following steps:
step 1: respectively identifying each data file, wherein the specific method for identifying comprises the following steps: material number + data name + data file + command code; and after the identification is finished, carrying out encryption compression to generate a binary data stream.
Step 2: uploading the encrypted and compressed data stream to a server;
and step 3: the server decompresses and decrypts the received data stream, and decompresses the identifier and the data file of the data stream;
and 4, step 4: renaming each decompressed data file in a naming mode of: identifier _ data name suffix name; encrypting the decompressed data and storing the encrypted data in a server;
and 5: and establishing a data table for storing the mark data into the server in a database of the server, and writing a Boolean value 1 in corresponding data information of the data table after the data is stored, wherein the Boolean value represents that the material record is uploaded to the server.
As shown in fig. 2, a data transmission system is based on a data storage system and is performed according to the following steps:
step 1, a user client sends a data file query instruction to a server;
step 2, the server receives an inquiry instruction of the user client and inquires whether a data table of the server has a marked data file or not;
if the data file is not stored in the server, sending prompt information that the data file is not inquired to the user client;
if the data file is inquired to be stored in the server, the user client sends a data file downloading instruction set to the server, wherein the downloading instruction set comprises a downloading instruction and an identifier-data name of the specific data file to be downloaded;
step 3, the server analyzes the received downloading instruction set;
step 4, according to the analysis result, the server searches the corresponding data file to be downloaded from the corresponding folder;
step 5, the server reads the data file for encryption and compression, and sends the data file to the user client;
and 6, receiving the data file by the user client, decompressing and decrypting the data file, and storing or displaying the data file.
The identifier is the material number of the data file.
The specific steps of analyzing the received downloading instruction set by the server in the step 3 are as follows: and splitting the downloading instruction set, splitting the material number, the data name and the suffix name of the data file, and sequentially splicing to form a complete data file name.
In the 2 embodiments, the data file may be a picture file, a CAD drawing file, or another data file.
In addition, the above description is only a preferred embodiment of the present invention, and should not be taken as limiting the scope of the present invention, and any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (5)
1. A data storage system, characterized by the steps of:
step 1: respectively marking each data file, and encrypting and compressing after marking to generate a data stream;
step 2: uploading the encrypted and compressed data stream to a server;
and step 3: the server decompresses and decrypts the received data stream, and decompresses the identifier and the data file of the data stream;
and 4, step 4: renaming each decompressed data file in a naming mode of: identifier _ data name suffix name; encrypting the decompressed data and storing the encrypted data in a server;
and 5: establishing a data table for marking data to be stored in the server in a database of the server, and marking each data file to be stored in the data table;
the specific method for identifying each data file in step 1 is as follows: material number + data name + data file + command code;
the identifier is a material number of the data file.
2. The data storage system of claim 1, wherein the data file is encrypted and compressed after being identified in step 1, and the finally generated data stream is a binary data stream.
3. The data storage system of claim 1, wherein the means for marking the data store in step 5 is: after the data is stored, writing a Boolean value 1 in the corresponding data file of the data sheet, which represents that the material record is uploaded to the server.
4. A data transmission system is characterized in that based on a data storage system, the data transmission system is carried out according to the following steps:
step 1, a user client sends a data file query instruction to a server;
step 2, the server receives an inquiry instruction of the user client and inquires whether a data table of the server has a marked data file or not;
if the data file is not stored in the server, sending prompt information that the data file is not inquired to the user client;
if the data file is stored in the server through inquiry, the user client sends a data file downloading instruction set to the server;
step 3, the server analyzes the received downloading instruction set;
step 4, according to the analysis result, the server searches the corresponding data file to be downloaded from the corresponding folder;
step 5, the server reads the data file for encryption and compression, and sends the data file to the user client;
step 6, the user client receives the data file, decompresses and decrypts the data file, and then stores or displays the data file;
in step 2, a user client sends a data file downloading instruction set to a server, wherein the downloading instruction set comprises a downloading instruction and an identifier-data name of a specific data file to be downloaded;
the identifier is a material number of the data file.
5. The data transmission system of claim 4, wherein the step 3 of the server parsing the received download instruction set specifically comprises the steps of: and splitting the downloading instruction set, splitting the material number, the data name and the suffix name of the data file, and sequentially splicing to form a complete data file name.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611047437.6A CN106559427B (en) | 2016-11-22 | 2016-11-22 | Data storage and data transmission system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611047437.6A CN106559427B (en) | 2016-11-22 | 2016-11-22 | Data storage and data transmission system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106559427A CN106559427A (en) | 2017-04-05 |
| CN106559427B true CN106559427B (en) | 2020-04-28 |
Family
ID=58445009
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611047437.6A Expired - Fee Related CN106559427B (en) | 2016-11-22 | 2016-11-22 | Data storage and data transmission system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106559427B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107612982B (en) * | 2017-08-31 | 2019-06-18 | 武汉斗鱼网络科技有限公司 | A kind of method, storage medium, equipment and system reducing function pages request number of times |
| CN110568992A (en) * | 2018-06-06 | 2019-12-13 | 华为技术有限公司 | data processing device and method |
| CN110572422B (en) * | 2018-06-06 | 2024-07-19 | 北京京东尚科信息技术有限公司 | Data downloading method, device, equipment and medium |
| CN112491832B (en) * | 2020-11-16 | 2023-12-05 | 中国银联股份有限公司 | File transmission method and device |
| CN112929444B (en) * | 2021-02-19 | 2022-09-23 | 广东云智安信科技有限公司 | Data security protection method, system, device and medium based on compressed file |
| CN113411316A (en) * | 2021-06-04 | 2021-09-17 | 深圳市华磊迅拓科技有限公司 | MES system data communication method and system based on WCF protocol |
| CN114117494B (en) * | 2021-11-30 | 2024-06-14 | 国网重庆市电力公司电力科学研究院 | Encryption type data labeling system and application method thereof |
| CN115277206B (en) * | 2022-07-28 | 2023-09-05 | 通号智慧城市研究设计院有限公司 | Data processing method and server |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101211287A (en) * | 2006-12-29 | 2008-07-02 | 佛山市顺德区顺达电脑厂有限公司 | Data backup device, system and its method |
| CN102185920A (en) * | 2011-05-10 | 2011-09-14 | 奇智软件（北京）有限公司 | Network-based downloading method and system, and terminal |
| CN103473913A (en) * | 2013-09-22 | 2013-12-25 | 北京工业大学 | Wireless data transmission method used for intelligent oil production system |
| CN104331345A (en) * | 2014-11-21 | 2015-02-04 | 四川神琥科技有限公司 | Data recovery method |
| CN105472035A (en) * | 2016-01-04 | 2016-04-06 | 百度在线网络技术（北京）有限公司 | File transmission method and device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060247952A1 (en) * | 2005-04-28 | 2006-11-02 | Visual Telecommunications Network, Inc. | Method and apparatus of transmitting patient medical data between a client computer and a server using electronic mail |
| US7912986B2 (en) * | 2008-02-25 | 2011-03-22 | Simdesk Technologies | Secure block read and write protocol for remotely stored files |
-
2016
- 2016-11-22 CN CN201611047437.6A patent/CN106559427B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101211287A (en) * | 2006-12-29 | 2008-07-02 | 佛山市顺德区顺达电脑厂有限公司 | Data backup device, system and its method |
| CN102185920A (en) * | 2011-05-10 | 2011-09-14 | 奇智软件（北京）有限公司 | Network-based downloading method and system, and terminal |
| CN103473913A (en) * | 2013-09-22 | 2013-12-25 | 北京工业大学 | Wireless data transmission method used for intelligent oil production system |
| CN104331345A (en) * | 2014-11-21 | 2015-02-04 | 四川神琥科技有限公司 | Data recovery method |
| CN105472035A (en) * | 2016-01-04 | 2016-04-06 | 百度在线网络技术（北京）有限公司 | File transmission method and device |
Non-Patent Citations (1)
| Title |
|---|
| "云计算ERP带来信息化大餐";刘有涛;《中国制造业信息化》;20100515(第10期);65-66 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106559427A (en) | 2017-04-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106559427B (en) | Data storage and data transmission system | |
| US11042653B2 (en) | Systems and methods for cryptographic-chain-based group membership content sharing | |
| CN105678189B (en) | Data file encryption storage and retrieval system and method | |
| US9262643B2 (en) | Encrypting files within a cloud computing environment | |
| CN107908632B (en) | Website file processing method and device, website file processing platform and storage medium | |
| CN108628867A (en) | Multi-key word cipher text retrieval method towards cloud storage and system | |
| CN103931156A (en) | Cloud file system with server-side deduplication of user-agnostic encrypted files | |
| CN107545048B (en) | Processing method and device for encrypted compressed file | |
| US20120311318A1 (en) | Information processing system, information processing device, information processing method and program | |
| CN112685436B (en) | Tracing information processing method and device | |
| JP2008542865A (en) | Digital proof bag | |
| CN105138924A (en) | Method and device for storing application operation information without login | |
| KR20080005571A (en) | Apparatus, method and system for restoring files | |
| US7702632B2 (en) | Information processing apparatus, information processing method, and computer program | |
| CN104992124A (en) | Document safety access method for cloud storage environment | |
| EP2778953A1 (en) | Encoded-search database device, method for adding and deleting data for encoded search, and addition/deletion program | |
| US10037370B2 (en) | Method, a server, a system and a computer program product for copying data from a source server to a target server | |
| CN101814096B (en) | Information processing device and information processing method | |
| CN102281141A (en) | Document permission management method, apparatus and system | |
| US20220277098A1 (en) | Method and system for securely storing and programmatically searching data | |
| JP2005284915A5 (en) | ||
| CN117235400A (en) | Unified multi-platform portal system based on Kafka technology | |
| AU2015281798B2 (en) | System of shared secure data storage and management | |
| CN114817754B (en) | VR learning system | |
| CN115250467A (en) | Data processing method and device, electronic equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200428 |