CN108959397A - Data de-duplication method and terminal - Google Patents
Data de-duplication method and terminal Download PDFInfo
- Publication number
- CN108959397A CN108959397A CN201810563381.2A CN201810563381A CN108959397A CN 108959397 A CN108959397 A CN 108959397A CN 201810563381 A CN201810563381 A CN 201810563381A CN 108959397 A CN108959397 A CN 108959397A
- Authority
- CN
- China
- Prior art keywords
- terminal
- data
- mark
- priority
- data received
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/064—Management of blocks
- G06F3/0641—De-duplication techniques
Abstract
This application involves a kind of data de-duplication method and terminals, comprising: terminal of each terminal into affiliated local area network sends the mark of the data of this terminal storage；Each terminal receives the mark for the data that the terminal in local area network is sent；The priority for determining this terminal terminal corresponding with the mark of data received judges whether that the data that the mark for the data that will be received is identified are deleted from the data of this terminal storage according to determining priority result.In this way, without adding third party device, data reduce the transmission path of data, improve the efficiency of the deletion for duplicate data without being transmitted to third party device during the deletion of duplicate data.Meanwhile each terminal need to can only determine the corresponding data of mark according to mark, and the deletion for identifying corresponding data is completed.Only transmission identifies during transmission, reduces the amount of the data of transmission, further improves the efficiency of the deletion for duplicate data.
Description
Technical field
This application involves data deletion technology field more particularly to a kind of data de-duplication method and terminals.
Background technique
With the gradually development of science and technology, various terminals have come into people's lives.Various terminals can be same
It is in communication with each other in local area network.Terminal in same local area network is often stored with identical data, the identical data wave in this part
The memory space of terminal is taken.In the related technology, people receive the data in each terminal usually using third party device, carry out
Compare, and result is returned into source terminal, after source terminal receives result, duplicate data are deleted.But it is this
Mode needs additionally to increase third party device, and all data are needed to be transferred on third party device and are compared, efficiency
Lowly.
Summary of the invention
To be overcome the problems, such as present in the relevant technologies at least to a certain extent, the application provides a kind of data de-duplication
Method and terminal.
According to the embodiment of the present application in a first aspect, providing a kind of data de-duplication method, comprising:
Terminal of each terminal into affiliated local area network sends the mark of the data of this terminal storage；
Each terminal receives the mark of the data of the transmission of the terminal in the local area network；The number for determining this terminal and receiving
According to the priority of the corresponding terminal of mark the mark for the data that will be received is judged whether according to determining priority result
The data identified are deleted from the data of this terminal storage.
Optionally, terminal of each terminal into affiliated local area network sends the mark of the data of this terminal storage, packet
It includes:
Based on udp protocol, terminal of each terminal into affiliated local area network sends the mark of the data of this terminal storage.
Optionally, the method also includes:
The IP of this terminal is obtained, and is based on udp protocol, the corresponding terminal of mark of the data received described in acquisition
IP；
The priority of described this terminal of determination terminal corresponding with the mark of data received, comprising:
According to the IP of the IP of this terminal terminal corresponding with the mark of the data received, determines this terminal and receive
The priority of the corresponding terminal of mark of the data arrived.
Optionally, the IP of the IP according to this terminal terminal corresponding with the mark of the data received is determined
The priority of this terminal terminal corresponding with the mark of data received, comprising:
The size of the IP of the IP for comparing this terminal terminal corresponding with the mark of the data received；
According to comparison result, the priority of this terminal terminal corresponding with the mark of data received is determined.
Optionally, described according to comparison result, determine the excellent of this terminal terminal corresponding with the mark of data received
First grade, comprising:
If the IP that comparison result is this terminal is greater than the IP of the corresponding terminal of mark of the data received, really
The priority of this fixed terminal is higher than the priority of the corresponding terminal of mark of the data received, if comparison result is this terminal
IP be less than or equal to the data received the corresponding terminal of mark IP, it is determined that the priority of this terminal is lower than
Or the priority of the corresponding terminal of mark equal to the data received；
Alternatively, if the IP that comparison result is this terminal is less than the corresponding terminal of mark of the data received
IP, it is determined that the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if comparison result
For this terminal IP be more than or equal to the data received the corresponding terminal of mark IP, it is determined that this terminal it is excellent
First grade is below or equal to the priority of the corresponding terminal of mark of the data received.
Optionally, described according to determining priority result, judge whether what the mark for the data that will be received was identified
Data are deleted from the data of this terminal storage, comprising:
Judge whether the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if
It is, it is determined that delete the data that the mark of the data received is identified from the data of this terminal storage；
Alternatively, judge whether the priority of this terminal is lower than the priority of the corresponding terminal of mark of the data received,
If it is, determination deletes the data that the mark of the data received is identified from the data of this terminal storage.
Optionally, the method also includes:
Generate the mark of data.
Optionally, the mark for generating data, comprising:
The mark of data is generated by hash algorithm.
According to the second aspect of the embodiment of the present application, a kind of terminal is provided, comprising:
Sending module sends the mark of the data of this terminal storage for the terminal into affiliated local area network；
Receiving module, the mark of the data for receiving the transmission of the terminal in the local area network；
Removing module, for determining the priority of this terminal terminal corresponding with the mark of data received, according to true
Fixed priority result judges whether that the data that the mark for the data that will be received is identified are deleted from the data of this terminal storage
It removes.
Optionally, the sending module is specifically used for:
Based on udp protocol, the terminal into affiliated local area network sends the mark of the data of this terminal storage.
Optionally, the terminal further include:
Module is obtained, for obtaining the IP of this terminal, and is based on udp protocol, the mark of the data received described in acquisition
Know the IP of corresponding terminal；
When the priority of described this terminal of determination terminal corresponding with the mark of data received, the removing module tool
Body is used for:
According to the IP of the IP of this terminal terminal corresponding with the mark of the data received, determines this terminal and receive
The priority of the corresponding terminal of mark of the data arrived.
Optionally, according to the IP of the IP of this terminal terminal corresponding with the mark of the data received, this end is determined
When holding the priority of terminal corresponding with the mark of data received, the removing module is specifically used for:
The size of the IP of the IP for comparing this terminal terminal corresponding with the mark of the data received；
According to comparison result, the priority of this terminal terminal corresponding with the mark of data received is determined.
Optionally, according to comparison result, the priority of this terminal terminal corresponding with the mark of data received is determined
When, the removing module is specifically used for:
If the IP that comparison result is this terminal is greater than the IP of the corresponding terminal of mark of the data received, really
The priority of this fixed terminal is higher than the priority of the corresponding terminal of mark of the data received, if comparison result is this terminal
IP be less than or equal to the data received the corresponding terminal of mark IP, it is determined that the priority of this terminal is lower than
Or the priority of the corresponding terminal of mark equal to the data received；
Alternatively, if the IP that comparison result is this terminal is less than the corresponding terminal of mark of the data received
IP, it is determined that the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if comparison result
For this terminal IP be more than or equal to the data received the corresponding terminal of mark IP, it is determined that this terminal it is excellent
First grade is below or equal to the priority of the corresponding terminal of mark of the data received.
Optionally, according to determining priority result, judge whether the data that the mark for the data that will be received is identified
When deleting from the data of this terminal storage, the removing module is specifically used for:
Judge whether the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if
It is, it is determined that delete the data that the mark of the data received is identified from the data of this terminal storage；
Alternatively, judge whether the priority of this terminal is lower than the priority of the corresponding terminal of mark of the data received,
If it is, determination deletes the data that the mark of the data received is identified from the data of this terminal storage.
Optionally, the terminal further include:
Generation module, for generating the mark of data.
Optionally, the generation module is specifically used for:
The mark of data is generated by hash algorithm.
According to the third aspect of the embodiment of the present application, a kind of non-transitorycomputer readable storage medium is provided, when described
When instruction in storage medium is executed by the processor of terminal, enable the terminal to execute a kind of data de-duplication method, institute
The method of stating includes:
Terminal into affiliated local area network sends the mark of the data of this terminal storage；
Receive the mark for the data that the terminal in the local area network is sent；Determine the mark of this terminal with the data received
The priority of corresponding terminal judges whether what the mark for the data that will be received was identified according to determining priority result
Data are deleted from the data of this terminal storage.
Optionally, the terminal into affiliated local area network sends the mark of the data of this terminal storage, comprising:
Based on udp protocol, the terminal into affiliated local area network sends the mark of the data of this terminal storage.
Optionally, the method also includes:
The IP of this terminal is obtained, and is based on udp protocol, the corresponding terminal of mark of the data received described in acquisition
IP；
The priority of described this terminal of determination terminal corresponding with the mark of data received, comprising:
According to the IP of the IP of this terminal terminal corresponding with the mark of the data received, determines this terminal and receive
The priority of the corresponding terminal of mark of the data arrived.
Optionally, the IP of the IP according to this terminal terminal corresponding with the mark of the data received is determined
The priority of this terminal terminal corresponding with the mark of data received, comprising:
The size of the IP of the IP for comparing this terminal terminal corresponding with the mark of the data received；
According to comparison result, the priority of this terminal terminal corresponding with the mark of data received is determined.
Optionally, described according to comparison result, determine the excellent of this terminal terminal corresponding with the mark of data received
First grade, comprising:
If the IP that comparison result is this terminal is greater than the IP of the corresponding terminal of mark of the data received, really
The priority of this fixed terminal is higher than the priority of the corresponding terminal of mark of the data received, if comparison result is this terminal
IP be less than or equal to the data received the corresponding terminal of mark IP, it is determined that the priority of this terminal is lower than
Or the priority of the corresponding terminal of mark equal to the data received；
Alternatively, if the IP that comparison result is this terminal is less than the corresponding terminal of mark of the data received
IP, it is determined that the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if comparison result
For this terminal IP be more than or equal to the data received the corresponding terminal of mark IP, it is determined that this terminal it is excellent
First grade is below or equal to the priority of the corresponding terminal of mark of the data received.
Optionally, described according to determining priority result, judge whether what the mark for the data that will be received was identified
Data are deleted from the data of this terminal storage, comprising:
Judge whether the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if
It is, it is determined that delete the data that the mark of the data received is identified from the data of this terminal storage；
Alternatively, judge whether the priority of this terminal is lower than the priority of the corresponding terminal of mark of the data received,
If it is, determination deletes the data that the mark of the data received is identified from the data of this terminal storage.
Optionally, the method also includes:
Generate the mark of data.
Optionally, the mark for generating data, comprising:
The mark of data is generated by hash algorithm.
According to the fourth aspect of the embodiment of the present application, a kind of terminal is provided, comprising: processor；It can for storage processor
The memory executed instruction；Wherein, the processor is configured to:
Terminal into affiliated local area network sends the mark of the data of this terminal storage；
Receive the mark for the data that the terminal in the local area network is sent；Determine the mark of this terminal with the data received
The priority of corresponding terminal judges whether what the mark for the data that will be received was identified according to determining priority result
Data are deleted from the data of this terminal storage.
Optionally, when the terminal into affiliated local area network sends the mark of the data of this terminal storage, the processing utensil
Body is configured as:
Based on udp protocol, the terminal into affiliated local area network sends the mark of the data of this terminal storage.
Optionally, the processor is also configured to obtain the IP of this terminal, and is based on udp protocol, connects described in acquisition
The IP of the corresponding terminal of mark of the data received；
When determining the priority of this terminal terminal corresponding with the mark of data received, the processing implement body is matched
It is set to:
According to the IP of the IP of this terminal terminal corresponding with the mark of the data received, determines this terminal and receive
The priority of the corresponding terminal of mark of the data arrived.
Optionally, according to the IP of the IP of this terminal terminal corresponding with the mark of the data received, this end is determined
When holding the priority of terminal corresponding with the mark of data received, the processor is specifically configured to:
The size of the IP of the IP for comparing this terminal terminal corresponding with the mark of the data received；
According to comparison result, the priority of this terminal terminal corresponding with the mark of data received is determined.
Optionally, according to comparison result, the priority of this terminal terminal corresponding with the mark of data received is determined
When, the processor is specifically configured to:
If the IP that comparison result is this terminal is greater than the IP of the corresponding terminal of mark of the data received, really
The priority of this fixed terminal is higher than the priority of the corresponding terminal of mark of the data received, if comparison result is this terminal
IP be less than or equal to the data received the corresponding terminal of mark IP, it is determined that the priority of this terminal is lower than
Or the priority of the corresponding terminal of mark equal to the data received；
Alternatively, if the IP that comparison result is this terminal is less than the corresponding terminal of mark of the data received
IP, it is determined that the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if comparison result
For this terminal IP be more than or equal to the data received the corresponding terminal of mark IP, it is determined that this terminal it is excellent
First grade is below or equal to the priority of the corresponding terminal of mark of the data received.
Optionally, according to determining priority result, judge whether the data that the mark for the data that will be received is identified
When deleting from the data of this terminal storage, the processor is specifically configured to:
Judge whether the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if
It is, it is determined that delete the data that the mark of the data received is identified from the data of this terminal storage；
Alternatively, judge whether the priority of this terminal is lower than the priority of the corresponding terminal of mark of the data received,
If it is, determination deletes the data that the mark of the data received is identified from the data of this terminal storage.
Optionally, the processor is also configured to
Generate the mark of data.
Optionally, when generating the mark of data, the processor is specifically configured to:
The mark of data is generated by hash algorithm.
The technical solution that embodiments herein provides can include the following benefits:
Since terminal of each terminal into affiliated local area network sends the mark of the data of this terminal storage and receives local
The mark for the data that terminal in net is sent, determines the priority of this terminal terminal corresponding with the mark of data received,
And according to determining priority result, judge whether data that the mark for the data that will be received is identified from this terminal storage
It is deleted in data, to complete the deletion for the duplicate data in the terminal in same local area network.In this way, in duplicate data
Deletion during, without adding third party device, data reduce the transmission road of data without being transmitted to third party device
Diameter improves the efficiency of the deletion for duplicate data.Meanwhile each terminal only need to can determine mark pair according to mark
The deletion for identifying corresponding data is completed in the data answered.Only transmission identifies during transmission, reduces transmission
Data amount, further improve the efficiency of the deletion for duplicate data.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the application
Example, and together with specification it is used to explain the principle of the application.
Fig. 1 is a kind of flow diagram for data de-duplication method that the application one embodiment provides.
Fig. 2 is a kind of flow diagram for data de-duplication method that another embodiment of the application provides.
Fig. 3 is a kind of structural schematic diagram for terminal that the application one embodiment provides.
Fig. 4 is a kind of structural schematic diagram for terminal that another embodiment of the application provides.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to
When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistent with the application.On the contrary, they be only with it is such as appended
The example of some aspects be described in detail in claims, the application consistent data de-duplication method and terminal.
Fig. 1 is a kind of flow diagram for data de-duplication method that the application one embodiment provides.Referring to Fig. 1,
Data de-duplication method provided in this embodiment may include:
The terminal of step 120, each terminal into affiliated local area network sends the mark of the data of this terminal storage；
Step 120, each terminal receive the mark for the data that the terminal in local area network is sent；It determines this terminal and receives
The priority of the corresponding terminal of mark of data the data that will be received are judged whether according to determining priority result
Identified data are identified to delete from the data of this terminal storage.
In the present embodiment, since terminal of each terminal into affiliated local area network sends the mark of the data of this terminal storage
And the mark for the data that the terminal in local area network is sent is received, determine this terminal terminal corresponding with the mark of the data received
Priority, and according to determining priority result, judge whether data that the mark for the data that will be received is identified from this
It is deleted in the data of terminal storage, to complete the deletion for the duplicate data in the terminal in same local area network.In this way,
During the deletion of duplicate data, without adding third party device, data reduce data without being transmitted to third party device
Transmission path, improve the efficiency of the deletion for duplicate data.Meanwhile each terminal only need to according to mark can be true
Corresponding data are known in calibration, and the deletion for identifying corresponding data is completed.Only transmission identifies during transmission, subtracts
The amount for having lacked the data of transmission, further improves the efficiency of the deletion for duplicate data.
In addition, in the present embodiment, when terminal of each terminal into affiliated local area network sends the data of this terminal storage
When mark, it is based on User Data Protocol (User Datagram Protocol, UDP), each terminal is into affiliated local area network
Terminal sends the mark of the data of this terminal storage.
It certainly, can also be with when the mark for the data that terminal of each terminal into affiliated local area network sends this terminal storage
It is sent based on other agreements.
In practical application, the data de-duplication method of the present embodiment further include: obtain the IP of this terminal, and be based on
Udp protocol obtains the IP of the corresponding terminal of mark of the data received；Based on this, in step 120, when determine this terminal with
When the priority of the corresponding terminal of mark of the data received, the IP according to this terminal and the number received specifically may is that
According to the corresponding terminal of mark IP, determine the priority of this terminal terminal corresponding with the mark of data received.
Wherein, udp protocol is a kind of a kind of communication protocol based on IP agreement, is based on udp protocol, available to receive
Data the corresponding terminal of mark IP.
Specifically, working as the IP of the IP terminal corresponding with the mark of data received according to this terminal, this terminal is determined
When the priority of terminal corresponding with the mark of data received, referring to Fig. 2, steps are as follows:
The size of the IP of step 210, the IP for comparing this terminal terminal corresponding with the mark of data received；
Step 220, according to comparison result, determine the preferential of this terminal terminal corresponding with the mark of data received
Grade.
In step 210, the mode for comparing the size of IP specifically be may is that the mark of the IP of this terminal and the data received
The IP for knowing corresponding terminal is converted into 32 bits, compares 32 bits of the IP conversion of this terminal and receives
The size of 32 bits of the IP conversion of the corresponding terminal of mark of data: if 32 that the IP of one, this terminal is converted
Binary number is greater than 32 bits of the IP conversion of the corresponding terminal of mark of the data received, then comparison result is this
The IP of terminal is greater than the IP of the corresponding terminal of mark of the data received；If two, this terminal IP conversion 32 two into
Number processed is equal to 32 bits of the IP conversion of the corresponding terminal of mark of the data received, then comparison result is this terminal
IP be equal to the data received the corresponding terminal of mark IP；If three, 32 bits of the IP conversion of this terminal
Less than 32 bits of the IP conversion of the corresponding terminal of mark of the data received, then comparison result is the IP of this terminal
Less than the IP of the corresponding terminal of mark of the data received.
It is illustrated herein for converting 32 bits for IP address: if IP address is
167.111.17.15 then corresponding 32 bit is 10100111011011110001000100001111.
There are many specific implementations of above-mentioned steps 220.For example, a kind of specific implementation of step 220 can be with are as follows:
When the IP of this terminal is greater than the IP of the corresponding terminal of mark of the data received, determines that the priority of this terminal is higher than and receive
The corresponding terminal of the mark of the data arrived；When the IP of this terminal is equal to the IP of the corresponding terminal of mark of the data received,
This terminal is the corresponding terminal of mark of the data received, determines that the priority of this terminal is equal to the mark of the data received
Corresponding terminal；When the IP of this terminal is less than the IP of the corresponding terminal of mark of the data received, the excellent of this terminal is determined
First grade is lower than the corresponding terminal of mark of the data received.Another specific implementation of step 220 can be with are as follows: when this end
When the IP at end is greater than the IP of the corresponding terminal of mark of the data received, determine that the priority of this terminal is lower than the number received
According to the corresponding terminal of mark；When the IP of this terminal is equal to the IP of the corresponding terminal of mark of the data received, this is determined
Terminal is the corresponding terminal of mark of the data received, and the mark that the priority of this terminal is equal to the data received is corresponding
Terminal；When the IP of this terminal is less than the IP of the corresponding terminal of mark of the data received, determine that the priority of this terminal is high
In the corresponding terminal of the mark of the data received.
In above-mentioned steps 130, according to determining priority result, judge whether that the mark for the data that will be received is identified
Data deleted from the data of this terminal storage, there are many specific implementations.For example, one of concrete implementation mode
It can be with are as follows: judge whether the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if so,
Then determination deletes the data that the mark of the data received is identified from the data of this terminal storage；If it is not, then losing
Abandon the mark.Alternatively, another concrete implementation mode can be with are as follows: judge whether the priority of this terminal is lower than the number received
According to the corresponding terminal of mark priority, if it is, determine the data that are identified the mark of the data received from this
It is deleted in the data of terminal storage；If it is not, then abandoning the mark.
The mark of above-mentioned data is needed pre-generated and is stored.Therefore, further, it is based on above-mentioned related embodiment, this
The data de-duplication method that application provides can also include: the mark for generating data.The method of the specific mark for generating data
There are many kinds of.For example, the mark of data can be generated by hash algorithm.
Fig. 3 is the structural schematic diagram for the terminal that another embodiment of the application provides.It is provided in this embodiment referring to Fig. 3
Terminal includes: sending module 301, receiving module 302 and removing module 303.
Sending module sends the mark of the data of this terminal storage for the terminal into affiliated local area network；
Receiving module, the mark of the data for receiving the transmission of the terminal in local area network；
Removing module, for determining the priority of this terminal terminal corresponding with the mark of data received, according to true
Fixed priority result judges whether that the data that the mark for the data that will be received is identified are deleted from the data of this terminal storage
It removes.
Optionally, sending module is specifically used for:
Based on udp protocol, the terminal into affiliated local area network sends the mark of the data of this terminal storage.
Optionally, terminal further include:
Module is obtained, for obtaining the IP of this terminal, and udp protocol is based on, obtains the mark pair of the data received
The IP for the terminal answered；
When determining the priority of this terminal terminal corresponding with the mark of data received, removing module is specifically used for:
According to the IP of the IP of this terminal terminal corresponding with the mark of data received, determines this terminal and receive
The priority of the corresponding terminal of mark of data.
Optionally, according to the IP of the IP of this terminal terminal corresponding with the mark of data received, determine this terminal with
When the priority of the corresponding terminal of mark of the data received, removing module is specifically used for:
The size of the IP of the IP for comparing this terminal terminal corresponding with the mark of the data received；
According to comparison result, the priority of this terminal terminal corresponding with the mark of data received is determined.
According to comparison result, when determining the priority of this terminal terminal corresponding with the mark of data received, delete
Module is specifically used for:
If comparison result is the IP for the corresponding terminal of mark that the IP of this terminal is greater than the data received, it is determined that this
The priority of terminal is higher than the priority of the corresponding terminal of mark of the data received, if comparison result is the IP of this terminal
Less than or equal to the IP of the corresponding terminal of mark of the data received, it is determined that the priority of this terminal is below or equal to
The priority of the corresponding terminal of mark of the data received；
Alternatively, if comparison result is the IP for the corresponding terminal of mark that the IP of this terminal is less than the data received,
Determine that the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if comparison result is this end
The IP at end is more than or equal to the IP of the corresponding terminal of mark of the data received, it is determined that the priority of this terminal be lower than or
Person is equal to the priority of the corresponding terminal of mark of the data received.
Optionally, according to determining priority result, judge whether the data that the mark for the data that will be received is identified
When deleting from the data of this terminal storage, removing module is specifically used for:
Judge whether the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if
It is, it is determined that delete the data that the mark of the data received is identified from the data of this terminal storage；
Alternatively, judge whether the priority of this terminal is lower than the priority of the corresponding terminal of mark of the data received,
If it is, determination deletes the data that the mark of the data received is identified from the data of this terminal storage.
Optionally, terminal further include:
Generation module, for generating the mark of data.
Optionally, generation module is specifically used for:
The mark of data is generated by hash algorithm.
The application one embodiment provides a kind of non-transitorycomputer readable storage medium, when the instruction in storage medium
When being executed by the processor of terminal, enable a processor to execute a kind of data de-duplication method, the method packet of the present embodiment
It includes:
Terminal into affiliated local area network sends the mark of the data of this terminal storage；
Receive the mark for the data that the terminal in local area network is sent；Determine that this terminal is corresponding with the mark of the data received
The priority of terminal the data that the mark for the data that will be received is identified are judged whether according to determining priority result
It is deleted from the data of this terminal storage.
Optionally, the terminal into affiliated local area network sends the mark of the data of this terminal storage, comprising:
Based on udp protocol, the terminal into affiliated local area network sends the mark of the data of this terminal storage.
Optionally, the method for the present embodiment further include:
The IP of this terminal is obtained, and is based on udp protocol, obtains the IP of the corresponding terminal of mark of the data received；
Determine the priority of this terminal terminal corresponding with the mark of data received, comprising:
According to the IP of the IP of this terminal terminal corresponding with the mark of data received, determines this terminal and receive
The priority of the corresponding terminal of mark of data.
Optionally, according to the IP of the IP of this terminal terminal corresponding with the mark of data received, determine this terminal with
The priority of the corresponding terminal of mark of the data received, comprising:
The size of the IP of the IP for comparing this terminal terminal corresponding with the mark of the data received；
According to comparison result, the priority of this terminal terminal corresponding with the mark of data received is determined.
Optionally, according to comparison result, the priority of this terminal terminal corresponding with the mark of data received is determined,
Include:
If comparison result is the IP for the corresponding terminal of mark that the IP of this terminal is greater than the data received, it is determined that this
The priority of terminal is higher than the priority of the corresponding terminal of mark of the data received, if comparison result is the IP of this terminal
Less than or equal to the IP of the corresponding terminal of mark of the data received, it is determined that the priority of this terminal is below or equal to
The priority of the corresponding terminal of mark of the data received；
Alternatively, if comparison result is the IP for the corresponding terminal of mark that the IP of this terminal is less than the data received,
Determine that the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if comparison result is this end
The IP at end is more than or equal to the IP of the corresponding terminal of mark of the data received, it is determined that the priority of this terminal be lower than or
Person is equal to the priority of the corresponding terminal of mark of the data received.
Optionally, according to determining priority result, judge whether the data that the mark for the data that will be received is identified
It is deleted from the data of this terminal storage, comprising:
Judge whether the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if
It is, it is determined that delete the data that the mark of the data received is identified from the data of this terminal storage；
Alternatively, judge whether the priority of this terminal is lower than the priority of the corresponding terminal of mark of the data received,
If it is, determination deletes the data that the mark of the data received is identified from the data of this terminal storage.
Optionally, the method for the present embodiment further include:
Generate the mark of data.
Optionally, the mark of data is generated, comprising:
The mark of data is generated by hash algorithm.
Fig. 4 is a kind of structural schematic diagram for terminal that another embodiment of the application provides.Referring to fig. 4, the present embodiment
Device includes: processor 401；Memory 402 for storage processor executable instruction；Wherein, processor 401 is configured
Are as follows:
Terminal into affiliated local area network sends the mark of the data of this terminal storage；
Receive the mark for the data that the terminal in local area network is sent；Determine that this terminal is corresponding with the mark of the data received
The priority of terminal the data that the mark for the data that will be received is identified are judged whether according to determining priority result
It is deleted from the data of this terminal storage.
Optionally, processor is specifically configured to:
Based on udp protocol, the terminal into affiliated local area network sends the mark of the data of this terminal storage.
Optionally, processor 401 is also configured to obtain the IP of this terminal, and is based on udp protocol, and acquisition receives
Data the corresponding terminal of mark IP；
When determining the priority of this terminal terminal corresponding with the mark of data received, processor is also configured to
According to the IP of the IP of this terminal terminal corresponding with the mark of data received, determines this terminal and receive
The priority of the corresponding terminal of mark of data.
Optionally, according to the IP of the IP of this terminal terminal corresponding with the mark of data received, determine this terminal with
When the priority of the corresponding terminal of mark of the data received, 401 concrete configuration of processor are as follows:
The size of the IP of the IP for comparing this terminal terminal corresponding with the mark of the data received；
According to comparison result, the priority of this terminal terminal corresponding with the mark of data received is determined.
Optionally, according to comparison result, the priority of this terminal terminal corresponding with the mark of data received is determined
When, processor 401 is specifically configured to:
If comparison result is the IP for the corresponding terminal of mark that the IP of this terminal is greater than the data received, it is determined that this
The priority of terminal is higher than the priority of the corresponding terminal of mark of the data received, if comparison result is the IP of this terminal
Less than or equal to the IP of the corresponding terminal of mark of the data received, it is determined that the priority of this terminal is below or equal to
The priority of the corresponding terminal of mark of the data received；
Alternatively, if comparison result is the IP for the corresponding terminal of mark that the IP of this terminal is less than the data received,
Determine that the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if comparison result is this end
The IP at end is more than or equal to the IP of the corresponding terminal of mark of the data received, it is determined that the priority of this terminal be lower than or
Person is equal to the priority of the corresponding terminal of mark of the data received.
Optionally, according to determining priority result, judge whether the data that the mark for the data that will be received is identified
When deleting from the data of this terminal storage, processor 401 is specifically configured to:
Judge whether the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if
It is, it is determined that delete the data that the mark of the data received is identified from the data of this terminal storage；
Alternatively, judge whether the priority of this terminal is lower than the priority of the corresponding terminal of mark of the data received,
If it is, determination deletes the data that the mark of the data received is identified from the data of this terminal storage.
Optionally, processor 401 is also configured to
Generate the mark of data.
Optionally, when generating the mark of data, processor 401 is specifically configured to:
The mark of data is generated by hash algorithm.
About the device in above-described embodiment, wherein modules execute the concrete mode of operation in related this method
Embodiment in be described in detail, no detailed explanation will be given here.
It is understood that same or similar part can mutually refer in the various embodiments described above, in some embodiments
Unspecified content may refer to the same or similar content in other embodiments.
It should be noted that term " first ", " second " etc. are used for description purposes only in the description of the present application, without
It can be interpreted as indication or suggestion relative importance.In addition, in the description of the present application, unless otherwise indicated, the meaning of " multiple "
Refer at least two.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing specific logical function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the application includes other realization, wherein can not press shown or discussed suitable
Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, to execute function, this should be by the application
Embodiment person of ordinary skill in the field understood.
It should be appreciated that each section of the application can be realized with hardware, software, firmware or their combination.Above-mentioned
In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage
Or firmware is realized.It, and in another embodiment, can be under well known in the art for example, if realized with hardware
Any one of column technology or their combination are realized: having a logic gates for realizing logic function to data-signal
Discrete logic, with suitable combinational logic gate circuit specific integrated circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries
It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium
In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.
It, can also be in addition, can integrate in a processing module in each functional unit in each embodiment of the application
It is that each unit physically exists alone, can also be integrated in two or more units in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized and when sold or used as an independent product in the form of software function module, also can store in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example
Point is contained at least one embodiment or example of the application.In the present specification, schematic expression of the above terms are not
Centainly refer to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be any
One or more embodiment or examples in can be combined in any suitable manner.
Although embodiments herein has been shown and described above, it is to be understood that above-described embodiment is example
Property, it should not be understood as the limitation to the application, those skilled in the art within the scope of application can be to above-mentioned
Embodiment is changed, modifies, replacement and variant.
Claims (10)
1. a kind of data de-duplication method characterized by comprising
Terminal of each terminal into affiliated local area network sends the mark of the data of this terminal storage；
Each terminal receives the mark of the data of the transmission of the terminal in the local area network；Determine this terminal and the data that receive
The priority for identifying corresponding terminal judges whether that the mark for the data that will be received is marked according to determining priority result
The data of knowledge are deleted from the data of this terminal storage.
2. the method according to claim 1, wherein terminal of each terminal into affiliated local area network is sent
The mark of the data of this terminal storage, comprising:
Based on udp protocol, terminal of each terminal into affiliated local area network sends the mark of the data of this terminal storage.
3. according to the method described in claim 2, it is characterized in that, the method also includes:
The IP of this terminal is obtained, and is based on udp protocol, the IP of the corresponding terminal of mark of the data received described in acquisition；
The priority of described this terminal of determination terminal corresponding with the mark of data received, comprising:
According to the IP of the IP of this terminal terminal corresponding with the mark of the data received, determines this terminal and receive
The priority of the corresponding terminal of mark of data.
4. according to the method described in claim 3, it is characterized in that, the IP according to this terminal and the data received
The corresponding terminal of mark IP, determine the priority of this terminal terminal corresponding with the mark of data received, comprising:
The size of the IP of the IP for comparing this terminal terminal corresponding with the mark of the data received；
According to comparison result, the priority of this terminal terminal corresponding with the mark of data received is determined.
5. according to the method described in claim 4, determining this terminal and receiving it is characterized in that, described according to comparison result
Data the corresponding terminal of mark priority, comprising:
If the IP that comparison result is this terminal is greater than the IP of the corresponding terminal of mark of the data received, it is determined that this
The priority of terminal is higher than the priority of the corresponding terminal of mark of the data received, if comparison result is the IP of this terminal
Less than or equal to the IP of the corresponding terminal of mark of the data received, it is determined that the priority of this terminal be lower than or
Equal to the priority of the corresponding terminal of mark of the data received；
Alternatively, if the IP that comparison result is this terminal is less than the IP of the corresponding terminal of mark of the data received,
Determine that the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if comparison result is this end
The IP at end is more than or equal to the IP of the corresponding terminal of mark of the data received, it is determined that the priority of this terminal is low
In or equal to the priority of the corresponding terminals of mark of data that receives.
6. the method according to claim 1, wherein described according to determining priority result, judge whether by
The data that the mark of the data received is identified are deleted from the data of this terminal storage, comprising:
Judge whether the priority of this terminal is higher than the priority of the corresponding terminal of mark of the data received, if it is,
Determination deletes the data that the mark of the data received is identified from the data of this terminal storage；
Alternatively, judge whether the priority of this terminal is lower than the priority of the corresponding terminal of mark of the data received, if
It is, it is determined that delete the data that the mark of the data received is identified from the data of this terminal storage.
7. the method according to claim 1, wherein the method also includes:
Generate the mark of data.
8. the method according to the description of claim 7 is characterized in that the mark for generating data, comprising:
The mark of data is generated by hash algorithm.
9. a kind of terminal characterized by comprising
Sending module sends the mark of the data of this terminal storage for the terminal into affiliated local area network；
Receiving module, the mark of the data for receiving the transmission of the terminal in the local area network；
Removing module, for determining the priority of this terminal terminal corresponding with the mark of data received, according to determining
Priority result judges whether that the data that the mark for the data that will be received is identified are deleted from the data of this terminal storage.
10. terminal according to claim 9, which is characterized in that the sending module is specifically used for:
Based on udp protocol, the terminal into affiliated local area network sends the mark of the data of this terminal storage.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810563381.2A CN108959397A (en) | 2018-06-04 | 2018-06-04 | Data de-duplication method and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810563381.2A CN108959397A (en) | 2018-06-04 | 2018-06-04 | Data de-duplication method and terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108959397A true CN108959397A (en) | 2018-12-07 |
Family
ID=64493207
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810563381.2A Pending CN108959397A (en) | 2018-06-04 | 2018-06-04 | Data de-duplication method and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108959397A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102801591A (en) * | 2012-07-02 | 2012-11-28 | 耿直 | Real-time data transmission method based on local area network |
| CN103559282A (en) * | 2013-11-07 | 2014-02-05 | 北京国双科技有限公司 | Real-time system data reduplication removing method and device |
| CN104158712A (en) * | 2014-08-28 | 2014-11-19 | 耿直 | Time division working method for local area network |
| CN104243214A (en) * | 2014-09-28 | 2014-12-24 | 北京奇虎科技有限公司 | Data processing method, device and system |
| US9602674B1 (en) * | 2015-07-29 | 2017-03-21 | Mark43, Inc. | De-duping identities using network analysis and behavioral comparisons |
| EP3249889A1 (en) * | 2016-05-23 | 2017-11-29 | Velostrata Ltd. | Workload migration across a hybrid network |
-
2018
- 2018-06-04 CN CN201810563381.2A patent/CN108959397A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102801591A (en) * | 2012-07-02 | 2012-11-28 | 耿直 | Real-time data transmission method based on local area network |
| CN103559282A (en) * | 2013-11-07 | 2014-02-05 | 北京国双科技有限公司 | Real-time system data reduplication removing method and device |
| CN104158712A (en) * | 2014-08-28 | 2014-11-19 | 耿直 | Time division working method for local area network |
| CN104243214A (en) * | 2014-09-28 | 2014-12-24 | 北京奇虎科技有限公司 | Data processing method, device and system |
| US9602674B1 (en) * | 2015-07-29 | 2017-03-21 | Mark43, Inc. | De-duping identities using network analysis and behavioral comparisons |
| EP3249889A1 (en) * | 2016-05-23 | 2017-11-29 | Velostrata Ltd. | Workload migration across a hybrid network |
Non-Patent Citations (1)
| Title |
|---|
| SRINIVAS VEGESNA: "《IP服务质量》", 31 August 2001, 人民邮电出版社 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6654701B2 (en) | Method and apparatus for measuring protocol performance in a data communication network | |
| US9727574B2 (en) | System and method for applying an efficient data compression scheme to URL parameters | |
| JP4456554B2 (en) | Data compression method and compressed data transmission method | |
| US20100146143A1 (en) | System and Method for Analyzing Data Traffic | |
| BR122020003960B1 (en) | POLAR CODE ENCODING METHOD AND APPARATUS, WIRELESS DEVICE AND COMPUTER-READABLE MEDIA | |
| JP6389280B2 (en) | Protocol stack conforming method and apparatus | |
| JP2013513261A (en) | Random data stream sampling | |
| KR20110081851A (en) | Methods and apparatus for obtaining content with reduced access times | |
| US11303617B2 (en) | Methods and apparatuses for oblivious transfer using trusted environment | |
| CN107172886A (en) | A kind of method of server and server compresses data | |
| CN110928483A (en) | Data storage method, data acquisition method and equipment | |
| CN104954431A (en) | Network selection method, device and system | |
| CN104038507A (en) | Protocol conversion wireless gateway with content as center and communication method thereof | |
| CN105681380A (en) | Client offline method and system thereof | |
| JP2022518932A (en) | Techniques for updating files | |
| CN105814843A (en) | Method and apparatus for generating flow table | |
| US20080120428A1 (en) | Unique compressed call identifiers | |
| CN109274720B (en) | Method and system for transmitting data | |
| CN109788050B (en) | Method, system, electronic device and medium for acquiring IP address of source station | |
| CN103298148A (en) | Method for connecting mobile terminal to multiple PDNs (public data networks) through fixed network and related device | |
| JP6762911B2 (en) | Packet identification device and packet identification method | |
| CN108959397A (en) | Data de-duplication method and terminal | |
| CN103746768A (en) | Data packet identification method and equipment thereof | |
| CN111225077B (en) | Network distribution method, device and system for Internet of things equipment | |
| JP6196729B2 (en) | Apparatus and method for augmenting messages to facilitate spam identification |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: No. 803 and 804, 8 / F, building 7, No. 599, shijicheng South Road, Chengdu hi tech Zone, China (Sichuan) pilot Free Trade Zone, Chengdu 610000, Sichuan Province Applicant after: Chengdu yunstare Technology Co.,Ltd. Address before: 610000 Chengdu, Sichuan, China (Sichuan) free trade pilot area, Chengdu high tech Zone, 10 Tianhua two road 219, 6 level 601. Applicant before: Chengdu Huina Intelligent Technology Co.,Ltd. Address after: 610000 Chengdu, Sichuan, China (Sichuan) free trade pilot area, Chengdu high tech Zone, 10 Tianhua two road 219, 6 level 601. Applicant after: Chengdu Huina Intelligent Technology Co.,Ltd. Address before: 610000 Chengdu, Sichuan, China (Sichuan) free trade pilot area, Chengdu high tech Zone, 10 Tianhua two road 219, 6 level 601. Applicant before: CHENGDU DINGDING TECHNOLOGY Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181207 |