CN113935068A - Data desensitization method for mass file transmission system - Google Patents

Data desensitization method for mass file transmission system Download PDF

Info

Publication number
CN113935068A
CN113935068A CN202111227583.8A CN202111227583A CN113935068A CN 113935068 A CN113935068 A CN 113935068A CN 202111227583 A CN202111227583 A CN 202111227583A CN 113935068 A CN113935068 A CN 113935068A
Authority
CN
China
Prior art keywords
file
desensitization
client
server
client computer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111227583.8A
Other languages
Chinese (zh)
Inventor
周双全
邹琼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Yunyu Technology Co ltd
Shenzhen Rayvision Technology Co ltd
Original Assignee
Shenzhen Yunyu Technology Co ltd
Shenzhen Rayvision Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Yunyu Technology Co ltd, Shenzhen Rayvision Technology Co ltd filed Critical Shenzhen Yunyu Technology Co ltd
Priority to CN202111227583.8A priority Critical patent/CN113935068A/en
Publication of CN113935068A publication Critical patent/CN113935068A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/62Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
    • G06F21/6245Protecting personal data, e.g. for financial or medical purposes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Bioethics (AREA)
  • Medical Informatics (AREA)
  • Computer Hardware Design (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computer And Data Communications (AREA)

Abstract

The invention discloses a data desensitization method of a mass file transmission system, which comprises the following steps: s1: after the file is transmitted to the client, detecting whether the GPU of the client computer is the Yingweida GPU; s2: if the detection result of the step S1 is yes, determining whether the model of the GPU of the client computer is not less than the model threshold; s3: if the judgment result in the step S1 or the step S2 is negative, detecting the core number of the CPU of the client computer, and judging whether the core number is not less than the core number threshold value; s4: if the determination result in the step S3 is yes, detecting the memory of the client computer, and determining whether the memory is not less than the memory threshold; s5: if the judgment result in the step S2 or the step S4 is yes, the client performs scanning matching on the content of the file and performs desensitization operation when transmitting the file. The invention can reduce time delay, improve the file data processing efficiency, improve the file transmission efficiency and reduce the processing cost of the server.

Description

Data desensitization method for mass file transmission system
Technical Field
The invention relates to the field of file transmission, in particular to a data desensitization method for a mass file transmission system.
Background
In order to protect personal privacy, laws related to data desensitization are issued by countries all over the world, when personal privacy data are contained in a user file, the user file is transmitted to an enterprise, and the enterprise needs to perform data desensitization operation before receiving and applying the personal privacy data.
In the prior art, data desensitization is completed after user data is transmitted to a cloud terminal and a large number of server clusters are used for rescanning files. However, desensitizing the file using the server cluster has the following problems: 1. the server cluster scans the files again, so that the processing time delay is increased, and the file transmission efficiency is reduced; 2. the processing cost of the server is increased.
Accordingly, the prior art is deficient and needs improvement.
Disclosure of Invention
The invention aims to overcome the defects of the prior art, provides a data desensitization method for a mass file transmission system, and solves the problems that in the prior art, desensitization operation of sensitive data in files is carried out through a server cluster, and the files need to be rescanned, so that processing time delay is increased, and file transmission efficiency is reduced; meanwhile, the problem that processing cost of a server is increased due to desensitization operation of sensitive data in a file through a server cluster is solved.
The technical scheme of the invention is as follows: a data desensitization method for a mass file transmission system comprises the following steps:
s1: and after the file is transmitted to the client, detecting whether the GPU of the client computer is the Yingwei GPU or not.
S2: if the detection result in step S1 is yes, it is further determined whether the model of the GPU of the client computer is not less than the model threshold.
S3: if the determination result in step S1 or step S2 is no, the core number of the CPU of the client computer is detected, and it is determined whether the core number of the CPU of the client computer is not less than the core number threshold.
S4: if the determination result in step S3 is yes, the memory of the client computer is detected, and it is determined whether the memory of the client computer is not less than the memory threshold.
S5: if the judgment result in the step S2 or the step S4 is yes, the client performs scanning and matching on the content of the file when transmitting the file, and if the content of the file is matched with the sensitive data information, performs desensitization operation on the sensitive data information according to a preset first desensitization method.
S6: and after desensitization operation is completed, marking the file after desensitization of the sensitive data information as a client desensitization file, and transmitting the client desensitization file to the server.
S7: and if the judgment result in the step S3 or the step S4 is no, the client marks the file as a server desensitization file, transmits the server desensitization file to the server, and the server scans and matches the content of the server desensitization file and performs desensitization operation on the server desensitization file according to a preset second desensitization method.
Preferably, the first desensitization method and the second desensitization method are both: data replacement or mask masking or data occlusion.
Preferably, the model threshold in step S2 is GTX 960.
Preferably, the core number threshold is 4.
Preferably, the memory threshold is 8 GB.
Preferably, the sensitive data information is: personal identification number, personal year and month of birth, personal telephone number.
By adopting the scheme, the invention provides a data desensitization method for a mass file transmission system, which has the following beneficial effects: the GPU model, the CPU core number and the memory size of the client computer are judged, whether the client computer meets the requirement of the computing capacity required by the desensitization operation of the sensitive data information in the file is judged, if the requirement is not met, the desensitization operation of the sensitive data information in the file is carried out at the server, and if the requirement is met, the desensitization operation of the sensitive data information in the file can be preferentially carried out at the client, so that the problem that the processing delay is increased due to the fact that the file needs to be rescanned when the desensitization operation is directly carried out at the server is solved, the file data processing efficiency is improved, the file transmission efficiency is improved, and meanwhile, the processing cost of the server can be reduced.
Drawings
FIG. 1 is a block flow diagram of the present invention.
Detailed Description
The invention is described in detail below with reference to the figures and the specific embodiments.
Referring to fig. 1, the present invention provides a data desensitization method for a mass file transmission system, including the following steps:
s1: and after the file is transmitted to the client, detecting whether the GPU of the client computer is the Yingwei GPU or not.
S2: if the detection result in step S1 is yes, it is further determined whether the model of the GPU of the client computer is not less than the model threshold. Specifically, in this embodiment, the model threshold is GTX960, and the GPU model of the client computer needs to be greater than or equal to GTX 960.
S3: if the determination result in step S1 or step S2 is no, the core number of the CPU of the client computer is detected, and it is determined whether the core number of the CPU of the client computer is not less than the core number threshold. Specifically, in this embodiment, the core number threshold is 4; if the determination result in step S1 or S2 is no, it cannot be determined whether the computing capability of the client computer meets the requirement; if the determination result in step S2 is yes, it may be determined that the GPU of the client computer satisfies the computation capability, and the desensitization operation of the file may be performed directly on the client without further determining the performance of the CPU of the client computer.
S4: if the determination result in step S3 is yes, the memory of the client computer is detected, and it is determined whether the memory of the client computer is not less than the memory threshold. Specifically, in this embodiment, the memory threshold is 8GB, and if the memory of the client computer is greater than or equal to 8GB, it can be determined that the memory meets the requirement.
S5: if the judgment result in the step S2 or the step S4 is yes, the client performs scanning and matching on the content of the file when transmitting the file, and if the content of the file is matched with the sensitive data information, performs desensitization operation on the sensitive data information according to a preset first desensitization method. Specifically, in this embodiment, the first desensitization method is data replacement, that is, the related real sensitive data is replaced with a fictive value, and the desensitization method can be set according to specific requirements to meet different requirements; if the judgment result in step S2 or step S4 is yes, it may be indicated that the computing power of the client computer meets the requirement of the computing power required by the desensitization operation of the sensitive data information in the file, and the client computer may perform the desensitization operation.
S6: and after desensitization operation is completed, marking the file after desensitization of the sensitive data information as a client desensitization file, and transmitting the client desensitization file to the server. After marking, when receiving the desensitization completed file, the server side directly stores the desensitization completed file without performing desensitization operation.
The invention provides a data desensitization method of a mass file transmission system, which comprises the steps of judging whether a client computer has an great GPU (graphics processing Unit), if so, further judging whether the model of the great GPU meets the requirement, if not, directly indicating that the client computer has good computing capacity, directly judging that desensitization operation can be carried out on sensitive data information of a file at the client, carrying out desensitization operation on the client according to a preset first desensitization method, marking the file which finishes the desensitization operation, indicating that the file carries out the desensitization operation at the client, and quickly finishing the judgment process; if the client computer does not have the great GPU or the number of the great GPU cannot meet the requirement, detecting and judging the CPU core number and the internal memory of the client computer, when the CPU core number is more than 4 and the internal memory of the client computer is more than 8GB, even if the GPU does not meet the requirement, still indicating that the computing capacity of the client computer meets the requirement of desensitization operation, desensitization operation can be carried out at the client, the client carries out desensitization operation according to a preset first desensitization method, marks the file which finishes the desensitization operation, sends the file to the server after the marking is finished, and the server stores the file, so that the client can carry out desensitization operation preferentially at the client under the condition that the client meets the desensitization requirement, thereby avoiding the increase of processing delay caused by the need of rescanning the file when the server carries out the desensitization operation, the file data processing efficiency is improved, the file transmission efficiency is improved, and meanwhile the processing cost of the server side can be reduced.
Specifically, in this embodiment, after the step S6, the method further includes:
s7: and if the judgment result in the step S3 or the step S4 is no, the client marks the file as a server desensitization file, transmits the server desensitization file to the server, and the server scans and matches the content of the server desensitization file and performs desensitization operation on the server desensitization file according to a preset second desensitization method. In step S7, the client needs to mark before sending the file, so that the server performs desensitization operation on the sensitive data on the file after receiving the file, specifically, in this embodiment, the second desensitization method is data replacement. If the judgment result in the step S3 or the step S4 is negative, it indicates that the computing capability of the client computer does not meet the requirement of the computing capability required by the desensitization operation of the sensitive data information in the file, and the client computer cannot perform the desensitization operation, so that the desensitization operation of the sensitive data information in the file needs to be performed at the server.
Specifically, in this embodiment, the sensitive data information is: personal identification number, personal year and month of birth, personal telephone number.
In summary, the present invention provides a data desensitization method for a mass file transmission system, which has the following beneficial effects: the GPU model, the CPU core number and the memory size of the client computer are judged, whether the client computer meets the requirement of the computing capacity required by the desensitization operation of the sensitive data information in the file is judged, if the requirement is not met, the desensitization operation of the sensitive data information in the file is carried out at the server, and if the requirement is met, the desensitization operation of the sensitive data information in the file can be preferentially carried out at the client, so that the problem that the processing delay is increased due to the fact that the file needs to be rescanned when the desensitization operation is directly carried out at the server is solved, the file data processing efficiency is improved, the file transmission efficiency is improved, and meanwhile, the processing cost of the server can be reduced.
The present invention is not limited to the above preferred embodiments, and any modifications, equivalent substitutions and improvements made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (7)

1. A data desensitization method for a mass file transmission system is characterized by comprising the following steps:
s1: after the file is transmitted to the client, detecting whether the GPU of the client computer is the Yingweida GPU;
s2: if the detection result of the step S1 is yes, further determining whether the model of the GPU of the client computer is not less than the model threshold;
s3: if the judgment result in the step S1 or the step S2 is no, detecting the core number of the CPU of the client computer, and judging whether the core number of the CPU of the client computer is not less than the core number threshold;
s4: if the determination result in the step S3 is yes, detecting the memory of the client computer, and determining whether the memory of the client computer is not less than the memory threshold;
s5: if the judgment result in the step S2 or the step S4 is yes, the client scans and matches the content of the file when transmitting the file, and if the sensitive data information is matched, desensitizes the sensitive data information according to a preset first desensitizing method;
s6: and after desensitization operation is completed, marking the file after desensitization of the sensitive data information as a client desensitization file, and transmitting the client desensitization file to the server.
2. The method for desensitizing data of mass file transfer system according to claim 1, wherein said step S6 is followed by the step of:
s7: and if the judgment result in the step S3 or the step S4 is no, the client marks the file as a server desensitization file, transmits the server desensitization file to the server, and the server scans and matches the content of the server desensitization file and performs desensitization operation on the server desensitization file according to a preset second desensitization method.
3. The data desensitization method for mass file transmission system according to claim 2, wherein the first desensitization method and the second desensitization method are both: data replacement or mask masking or data occlusion.
4. The method for desensitizing data of mass file transmission system according to claim 1, wherein said model threshold in step S2 is GTX 960.
5. The method for desensitizing data of a mass file transfer system according to claim 1, wherein said core number threshold is 4.
6. The method for desensitizing data of mass file transfer system according to claim 1, wherein said memory threshold is 8 GB.
7. The method for desensitizing data of mass file transfer system according to claim 1, wherein said sensitive data information is: personal identification number, personal year and month of birth, personal telephone number.
CN202111227583.8A 2021-10-21 2021-10-21 Data desensitization method for mass file transmission system Pending CN113935068A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111227583.8A CN113935068A (en) 2021-10-21 2021-10-21 Data desensitization method for mass file transmission system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111227583.8A CN113935068A (en) 2021-10-21 2021-10-21 Data desensitization method for mass file transmission system

Publications (1)

Publication Number Publication Date
CN113935068A true CN113935068A (en) 2022-01-14

Family

ID=79280936

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111227583.8A Pending CN113935068A (en) 2021-10-21 2021-10-21 Data desensitization method for mass file transmission system

Country Status (1)

Country Link
CN (1) CN113935068A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115150189A (en) * 2022-07-28 2022-10-04 深圳市瑞云科技有限公司 Method for automatically intercepting outgoing files based on enterprise private cloud disk

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115150189A (en) * 2022-07-28 2022-10-04 深圳市瑞云科技有限公司 Method for automatically intercepting outgoing files based on enterprise private cloud disk
CN115150189B (en) * 2022-07-28 2023-11-07 深圳市瑞云科技有限公司 Method for automatically intercepting file outgoing based on enterprise private cloud disk

Similar Documents

Publication Publication Date Title
WO2019136990A1 (en) Network data detection method, apparatus, computer device and storage medium
WO2017076210A1 (en) Method and device for use in risk management of application information
KR20190022431A (en) Training Method of Random Forest Model, Electronic Apparatus and Storage Medium
CN110570652B (en) Vehicle fake plate detection reminding method and related product
CN106845323B (en) Marking data collection method and device and certificate identification system
CN109597805A (en) A kind of data processing method, electronic equipment and storage medium
CN113935068A (en) Data desensitization method for mass file transmission system
CN110012075B (en) Data transmission method and related equipment
CN108667828A (en) Risk control method and device and storage medium
CN111968625A (en) Sensitive audio recognition model training method and recognition method fusing text information
WO2021218063A1 (en) Method and apparatus for assigning parameter with value on the basis of name mapping, and computer device
CN113949526A (en) Access control method and device, storage medium and electronic equipment
CN108076012A (en) Abnormal login determination methods and device
CN112231735A (en) Data transmission method and system
CN114826946A (en) Unauthorized access interface detection method, device, equipment and storage medium
CN111160157A (en) Text extraction method based on DWG drawing and related product
CN114356846A (en) Image data sending method and device, electronic equipment and storage medium
CN103684823A (en) Weblog recording method, network access path determining method and related devices
CN102387255B (en) Method and device for utilizing intelligent card to process third-party expanded service data
CN108519863B (en) IO management method and device of storage system
CN103780592A (en) Method and apparatus for determining being stolen of user account
CN106101117B (en) A kind of fishing website blocking-up method, device and system
CN116151965B (en) Risk feature extraction method and device, electronic equipment and storage medium
CN110503549B (en) Data processing method, device, system, electronic equipment and medium
WO2023115968A1 (en) Method and device for identifying violation data at user end, medium, and program product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination