CN116821076A - A file search method and device based on electronic equipment - Google Patents

Abstract

The embodiment of the application provides a file searching method and device based on electronic equipment, which can improve the searching speed of repeated files and the file duplication removing efficiency. Specifically, the method comprises the following steps: the electronic equipment determines the load degree of the electronic equipment; when the load is determined to be heavy, the electronic equipment acquires a first hash value of the current read/write file and an inode number of the current read/write file; when the load is determined to be light, the electronic equipment acquires a second hash value of at least one file stored in the electronic equipment and an inode number of the at least one file; the first hash value is the hash value of a first information block of the current read/write file, and is used for searching a repeated file with the same first hash value by the electronic equipment; the second hash value is a hash value of a first information block of the at least one file and is used for the electronic device to find duplicate files having the same second hash value.

Description

A file search method and device based on electronic equipment

Technical field

The embodiments of the present application relate to the field of electronic technology, and more specifically, to a file search method and device based on electronic equipment.

Background technique

A large number of files are stored inside devices such as mobile phones, and there are some identical files in a large number of files. As a result, the same files repeatedly occupy the storage space of the electronic device. Therefore, it is necessary to remove files that repeatedly occupy the storage space, which can be referred to as file deduplication. Usually, when deduplicating files, you need to calculate hash values of multiple files, and the deduplication speed is slow.

Contents of the invention

Embodiments of the present application provide a file search method and device based on electronic equipment, which can improve the search speed of duplicate files and improve the efficiency of file deduplication.

In a first aspect, a file search method based on an electronic device is provided, including: the electronic device determines the load level of the electronic device; when it is determined that the load level of the electronic device is a heavy load, the electronic device obtains the current read /write the first hash value of the file and the index node inode number of the current read/write file; when it is determined that the load level of the electronic device is light load, the electronic device obtains at least one stored in the electronic device The second hash value of the file and the inode number of the at least one file; wherein the first hash value is the hash value of the first information block of the currently read/write file, and is used for the electronic device to find Duplicate files with the same first hash value; the second hash value is the hash value of the first information block of the at least one file, and is used for the electronic device to search for files with the same second hash value of duplicate files. Through this method, the hash value of the first information block of the file and the inode number of the file are obtained, and used to find duplicate files, which improves the efficiency of finding duplicate files, and further uses the obtained data for electronic When deduplicating the device, the efficiency of file deduplication is improved. At the same time, the load condition of the electronic device is taken into consideration when searching for files, which avoids the jamming of the electronic device caused by deduplication when the load is heavy, and improves the efficiency of file deduplication. user experience.

With reference to the first aspect, in some implementations of the first aspect, the electronic device determines the load level of the electronic device, including: within the first time window, the electronic device calculates the amount of information read/written in the file. , determine the load level of the electronic device. This method takes into account the load level of the electronic device within the first time window, allowing the electronic device to search for files at the appropriate search node, avoiding the jamming of the electronic device caused by deduplication, and improving the user experience.

With reference to the first aspect, in some implementations of the first aspect, when it is determined that the load level of the electronic device is heavy load, the electronic device obtains the first hash value of the current read/write file and the The inode number of the currently read/write file includes: the electronic device obtains the inode number of the currently read/write file based on the file name of the currently read/write file; the electronic device obtains the inode number of the currently read/write file based on the current read/write file name. The inode number of the file, read or calculate the first hash value of the currently read/write file; the electronic device saves the inode number of the currently read/write file and the first hash value of the currently read/write file corresponding relationship. Under heavy load, the electronic device obtains the corresponding relationship between the inode number of the current read/write file and the first hash value, so that the corresponding file inode number can be found based on the first hash value, thereby finding the specific data information of the file. Files with the same first hash value are more likely to be duplicated, which improves the efficiency of finding duplicate files and facilitates the next step of deduplicating duplicate files. And under heavy load, taking into account the operating conditions of electronic devices, statistics are collected on the relevant information of the current read/write files, which reduces the possibility of jamming of electronic devices and improves user experience.

In conjunction with the first aspect, in some implementations of the first aspect, when it is determined that the load level of the electronic device is light load, the electronic device obtains a second hash value of at least one file stored in the electronic device. and the inode number of the at least one file, including: the electronic device reads or calculates the inode number of the at least one file and the second hash value of the at least one file; the electronic device saves the at least one file The corresponding relationship between the inode number and the second hash value of the at least one file. When the electronic device is under light load, the corresponding relationship between the inode number and the second hash value of one or more files stored in the electronic device is obtained, so that the corresponding file inode number can be found based on the second hash value, thereby finding the specific data information of the file. , because files with the same second hash value are more likely to be duplicated, which improves the efficiency of finding duplicate files and facilitates the next step of deduplication of duplicate files. And when the load is light, the storage space of the electronic device is traversed, which avoids large-scale search operations under heavy load, reduces the possibility of the electronic device getting stuck, and improves the user experience.

With reference to the first aspect, in some implementations of the first aspect, the electronic device saves the corresponding relationship between the inode number of the currently read/write file and the first hash value of the currently read/write file, including: The electronic device saves the corresponding relationship between the inode number of the currently read/write file and the first hash value of the currently read/write file into a key value table. The above corresponding relationship is saved through the key-value table, and the corresponding relationship is clearly expressed, which facilitates subsequent search of the electronic device.

With reference to the first aspect, in some implementations of the first aspect, the electronic device saves the corresponding relationship between the inode number of the at least one file and the second hash value of the at least one file, including: the electronic device The corresponding relationship between the inode number of the at least one file and the second hash value of the at least one file is saved in the key value table. The above corresponding relationship is saved through the key-value table, and the corresponding relationship is clearly expressed, which facilitates subsequent search of the electronic device.

With reference to the first aspect, in some implementations of the first aspect, the first time window is determined by the electronic device according to a global variable. By defining the first time window based on global variables, the overall performance of the electronic device is taken into consideration, making it easier for the electronic device to select a suitable node to search for duplicate files, and improving the efficiency of finding duplicate files.

In connection with the first aspect, in some implementations of the first aspect, when there are at least two files with the same first hash value, the electronic device determines that the at least two files with the same first hash value are duplicate files. ; When there are at least two files with the same second hash value, the electronic device determines that the at least two files with the same second hash value are duplicate files.

In conjunction with the first aspect, in some implementations of the first aspect, the first hash value and/or the second hash value are used by the electronic device to deduplicate the duplicate files.

In a second aspect, a file search device based on electronic equipment is provided. The device includes: a first processing unit for determining the load level of the electronic equipment; and a second processing unit for determining the load level of the electronic equipment. When the load level is heavy load, obtain the first hash value of the current read/write file and the inode number of the current read/write file; the third processing unit is used to when it is determined that the load level of the electronic device is light load, Obtain the second hash value of at least one file stored in the electronic device and the inode number of the at least one file; wherein the first hash value is the hash value of the first information block of the currently read/write file, And used for the electronic device to search for duplicate files with the same first hash value; the second hash value is the hash value of the first information block of the at least one file, and is used for the electronic device to search for duplicate files with the same first hash value. The device looks for duplicate files with the same second hash value.

With reference to the second aspect, in some implementations of the second aspect, the first processing unit is used to determine the load level of the electronic device, and the first processing unit is specifically configured to: within the first time window, the The electronic device calculates the amount of information read/written in the file and determines the load level of the electronic device.

In connection with the second aspect, in some implementations of the second aspect, the second processing unit is configured to obtain the first hash value of the current read/write file when it is determined that the load level of the electronic device is heavy load and The inode number of the currently read/write file, the second processing unit is specifically configured to: obtain the inode number of the currently read/write file according to the file name of the currently read/write file; /Write the inode number of the file, read or calculate the first hash value of the currently read/write file; save the correspondence between the inode number of the current read/write file and the first hash value of the current read/write file relation.

In conjunction with the second aspect, in some implementations of the second aspect, the third processing unit is configured to obtain the data of at least one file stored in the electronic device when it is determined that the load level of the electronic device is light load. The second hash value and the inode number of the at least one file, the third processing unit is specifically configured to: read or calculate the inode number of the at least one file and the second hash value of the at least one file; save the The corresponding relationship between the inode number of the at least one file and the second hash value of the at least one file.

In connection with the second aspect, in some implementations of the second aspect, the second processing unit is configured to save the correspondence between the inode number of the currently read/write file and the first hash value of the currently read/write file. The second processing unit is specifically configured to: save the corresponding relationship between the inode number of the currently read/write file and the first hash value of the currently read/write file into a key value table.

With reference to the second aspect, in some implementations of the second aspect, the third processing unit is configured to save the correspondence between the inode number of the at least one file and the second hash value of the at least one file, and the The third processing unit is specifically configured to: save the corresponding relationship between the inode number of the at least one file and the second hash value of the at least one file into a key value table.

Combined with the second aspect, in some implementations of the second aspect, the first time window is determined based on a global variable.

In connection with the second aspect, in some implementations of the second aspect, when at least two files have the same first hash value, it is determined that at least two files with the same first hash value are duplicate files; when there are at least two files with the same first hash value, If the second hash values of the two files are the same, it is determined that at least two files with the same second hash value are duplicate files.

In conjunction with the second aspect, in some implementations of the second aspect, the first hash value and/or the second hash value is used by the electronic device to deduplicate the duplicate files.

In a third aspect, a file search device based on an electronic device is provided, including at least one processor, the at least one processor being coupled to at least one memory, and the at least one processor being configured to execute a file stored in the at least one memory. Computer programs or instructions to cause the device to execute the method described in the above first aspect or any implementation of the first aspect.

In a fourth aspect, a chip is provided, including a processor and a communication interface. The communication interface is used to receive data and/or information and transmit the received data and/or information to the processor. The processing The processor processes the data and/or information according to the method described in the above first aspect or any implementation of the first aspect.

In a fifth aspect, a computer-readable medium is provided. The computer-readable medium stores program code. When the computer program code is run on a computer, it causes the computer to execute the above-mentioned first aspect or any one of the first possible aspects. method of execution. These computer-readable storages include but are not limited to one or more of the following: read-only memory (ROM), programmable ROM (PROM), erasable PROM (erasablePROM, EPROM), Flash Memory, electrical EPROM (electrically EPROM, EEPROM) and hard drive (harddrive).

In a sixth aspect, a computer program product is provided. The computer program product includes: computer program code. When the computer program code is run on a computer, it causes the computer to execute the above-mentioned first aspect or any possible execution of the first aspect. Methods.

Description of the drawings

FIG. 1 is a schematic structural diagram of the system architecture of an electronic device according to an embodiment of the present application.

Figure 2 is a schematic flow chart of a file search method based on electronic devices provided by an embodiment of the present application.

Figure 3 is a schematic flow chart of a file search method based on electronic devices provided by an embodiment of the present application.

FIG. 4 is a schematic diagram of a module architecture of electronic device-based file search provided by an embodiment of the present application.

FIG. 5 is a schematic structural diagram of an electronic device-based file search device provided by an embodiment of the present application.

Figure 6 is a schematic diagram of the hardware structure of a file search device based on electronic equipment provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

FIG. 1 shows a schematic structural diagram of the system architecture of an electronic device suitable for embodiments of the present application. As shown in FIG. 1 , the system architecture 100 of the electronic device includes an application program 101 in user space and a file system 102 and disk 103 in kernel space. Among them, the application program 101 can be used to interact with the user and has a visual user interface; the file system 102 is used to manage and access the data required by the user, so the file system and the application program can interact; the disk 103 is used to record user-related data. Through the interaction between the file system and the disk, the disk can record user-related data. Users can directly interact with applications, while file systems and disks can indirectly manage and access user-related data.

It should be understood that the electronic device having the above system architecture may be a user device. Specifically, the user equipment may be a handheld device with a wireless communication function, a computing device, a vehicle-mounted device, a wearable device, or the like. For example, it could be a mobile phone, tablet, laptop or other device. This application does not limit this.

To facilitate understanding, the relevant terms involved in the embodiments of the present application are explained and described below. It should be understood that the following content is also included in the scope of protection required by the embodiments of the present application.

File system: It is the software organization in the operating system responsible for managing and storing file information. Specifically, the file system is responsible for creating files for users, storing, reading, modifying, and dumping files, controlling file access, and revoking files when users no longer use them. In other words, file systems are mainly used to manage and store file data and metadata. Most file system files or directories allocate storage space in the memory using the index node (inode) + data block (datablock) method. . The metadata of the file or directory and the data block number of the file are stored in the index node, and the specific content of the file or directory is stored in the corresponding data block. Each file or directory has an index node, which determines how many data blocks are needed based on the size of the file.

Index node (inode): A data structure in many Unix-like file systems that saves the metainformation data of a file system object in the file system, but does not include the data content. Among them, metainformation data can also be called metadata, which is mainly information used to describe data attributes and is used to support functions such as indicating storage location, historical data, resource search, file recording, etc. For example, metadata can include a hash of the data.

Inode number: An inode number corresponds to a file. Even if the file name changes, the inode number remains unchanged. Because the system searches for data internally through the inode number, it can also retrieve data when the file name changes. Find the data correctly.

Inode table: records the storage location of the file's inode on the disk. For example, the index node table includes the corresponding relationship between the index node number and the inode of the file, so that the inode of the file can be found through the index node number of the file.

Hash value: A hash value corresponding to a data can be calculated through the hash algorithm, similar to the ID card of the data. When the hash value of two data is the same, the two data are likely to be the same, so , Different from the existing technology, in the method and device provided by the embodiment of the present application, the hash value can be used to determine whether two data are the same, so as to facilitate the search for duplicate files.

Daemon thread: A thread is the smallest unit that the operating system can perform calculation scheduling. It is included in the process and is the actual operating unit in the process. A thread refers to a single sequence of control flow in a process. A process can have multiple threads concurrently, and each thread performs different tasks. Daemon threads are special threads that are generally used to provide services for other threads in the background.

When searching for file data in the disk through the file system, first the file system finds the inode number corresponding to the file name; then obtains the inode information of the file through the inode number and inode table; finally, based on the inode information, the location of the file is found data block, read the data.

There will be a large number of files inside devices such as mobile phones. Some of the files are the same, but occupy the storage space of the device. In this case, the files stored on the device need to be deduplicated. For example, deduplication can be done through the file system. However, when deduplicating through the file system, it is usually necessary to calculate the hash value of the entire file. The deduplication speed is slow, and the load of the device is not considered. Duplicate data searches are performed on critical I/O paths, which affects the user experience.

Therefore, the embodiment of the present application proposes a file search method based on electronic devices, which searches for duplicate files by obtaining the hash value of the first information block of the file, thereby removing duplicate files and improving the speed of duplicate file search. At the same time, the load condition of the electronic device is taken into account when searching, which avoids device freezes caused by deduplication when the load is heavy, and improves the user experience.

Figure 2 shows a schematic flow chart of an electronic device-based file search method provided by an embodiment of the present application. Specifically, the method 200 includes:

S201, the electronic device determines the load level of the electronic device.

In a possible implementation manner, the electronic device may be a user device that manages files through a file system. For example, the electronic device may be a mobile phone or a tablet computer.

In this embodiment of the present application, the first module in the electronic device may be used to determine whether the load level of the electronic device is light load or heavy load.

It should be understood that the first module may be a software module in the electronic device. For example, the first module is a software module in a file system in an electronic device. For example, the first module is a software module in an external plug-in component of a file system in an electronic device.

In this embodiment of the present application, the first module may be called a load sensing module, or the first module may have another name, which is not limited in this application.

In one possible implementation, the electronic device may determine the load level of the electronic device by calculating the amount of information read/written by the electronic device within the first time window to determine the load level of the electronic device.

In this embodiment of the present application, the electronic device may: determine that the load level is light load when both the information amount of reading files and the amount of information writing files of the electronic device are less than the first threshold value.

In the embodiment of the present application, the electronic device may: determine the load level to be a write heavy load when the information amount of the electronic device reading the file is less than the first threshold value and the information amount writing the file is greater than or equal to the first threshold value, and vice versa. It is a read-heavy load; when the amount of information for reading files and writing files is greater than or equal to the first threshold, the load level is determined to be a read/write heavy load.

In one possible implementation, when the information amount of the electronic device reading the file is greater than or equal to the first threshold value, the load level is determined to be a heavy reading load; when the information amount of the electronic device writing the file is greater than or equal to the second threshold value When , the load level is determined to be write-heavy load. Wherein, the first threshold value and the second threshold value are different.

In another possible implementation, when the sum of the information amount of reading files and the amount of information writing files of the electronic device is greater than or equal to the first threshold value, the load level can be determined to be heavy load, and vice versa. For example, when the sum of the number of times the file is read and the number of times the file is written is greater than or equal to 100 times, the load level of the electronic device can be determined to be heavy load.

It should be understood that write heavy load, read heavy load, and read/write heavy load may all be referred to as heavy load.

In the embodiment of the present application, the amount of information required to read/write files by the electronic device can be determined based on the number and size of the files read/written.

In this embodiment of the present application, the first time window may be determined by the electronic device based on global variables. For example, it can be 5 seconds or 10 seconds, etc.

S202, when it is determined that the load level of the electronic device is heavy load, the electronic device obtains the first hash value of the currently read/write file and the inode number of the current read/write file, and the first hash value is the first hash value of the currently read/write file. A hash value of a block of information, and is used by the electronic device to find duplicate files with the same first hash value.

In the embodiment of the present application, when it is determined that the load level of the electronic device is heavy load, the second module of the electronic device can be used to obtain the first hash value of the currently read/write file and the inode number of the currently read/write file, and then The second module saves the above-mentioned first hash value to the inode of the electronic device, and sends the first hash value and the inode number of the current read/write file to the fourth module. The fourth module saves the inode number of the current read/write file. A hash value and the inode number of the current read/write file.

In this embodiment of the present application, the second module and the fourth module may be software modules in the electronic device. For example, the second module and the fourth module are software modules in the file system in the electronic device, and for example, the second module and the fourth module are software modules in the external plug-in component of the file system in the electronic device. In the embodiment of this application, the second module may be called the front-end duplicate file search module, and the fourth module may be a deduplication information recording module, or the second module and the fourth module may also have other names, which this application does not limited.

In one possible implementation, the electronic device can obtain the inode number of the current read/write file based on the file name of the current read/write file. According to the inode number of the currently read/write file, the first hash value of the currently read/write file is read or calculated. Finally, the electronic device saves the corresponding relationship between the inode number of the currently read/write file and the first hash value.

In the embodiment of the present application, the method for the electronic device to read or calculate the first hash value of the currently read/write file based on the inode number of the currently read/write file may be: for reading the file, the second module of the electronic device determines the current Read whether the first hash value of the file exists. When it exists, the second module of the electronic device reads the first hash value; when it does not exist, the second module of the electronic device calculates the first hash value. For writing files, the second module of the electronic device can calculate the first hash value. In this embodiment of the present application, after the electronic device calculates the first hash value, the first hash value can be saved in the inode.

In another possible implementation, the electronic device may not calculate the first hash value of the current read/write file. For the case where the first hash value of the currently read file does not exist, or for the current write file, the electronic device does not calculate the corresponding first hash value.

It should be understood that the first hash value of the currently read/written file may be stored in the inode of the electronic device. The method of determining whether the first hash value exists may be that the electronic device determines whether the first hash value is stored in the inode.

S203. When it is determined that the load level of the electronic device is light load, the electronic device obtains the second hash value of at least one file stored in the electronic device and the inode number of the at least one file. The second hash value is the first hash value of the at least one file. The hash value of the information block is used by the electronic device to find duplicate files with the same second hash value.

It should be understood that the "at least one file" in step S203 is a file stored in the electronic device, and the "current read/write file" in step S202 is a file currently being read or written by the electronic device. is different. And in this embodiment of the present application, "at least one file" in S203 and "currently reading/writing the file" in S202 may respectively correspond to different parts of the file system of the electronic device.

In the embodiment of the present application, when it is determined that the load level of the electronic device is light load, the third module of the electronic device obtains the second hash value of at least one file stored in the electronic device and the inode number of the at least one file. The electronic device The fourth module saves the second hash value of the at least one file and the inode number of the at least one file.

It should be understood that the second hash value can be the hash value of the first information block of at least one file. It can be understood that at least one file corresponds to at least one second hash value, and any one of the at least one file corresponds to a second hash value. hash value. It should also be understood that the above-mentioned at least one file is a file stored in an electronic device, such as a file stored in a disk of the electronic device, so that the electronic device can traverse the files in the disk and obtain the corresponding second hash value and inode number.

In this embodiment of the present application, the third module may be a software module in the electronic device. For example, the third module is a software module in a file system in an electronic device, or for example, the third module is a software module in an external plug-in component of a file system in an electronic device. In the embodiment of this application, the third module may be called a background duplicate file search module, or the third module may also have other names, which is not limited in this application.

In a possible implementation, the electronic device can read or calculate the inode number of the at least one file and the second hash value of the at least one file, and then save the inode number of the at least one file and the second hash value of the at least one file. corresponding relationship.

In another possible implementation, the electronic device stores the inode number of the currently read/write file and the first hash value of the currently read/write file, and the inode number of the above-mentioned at least one file and the second hash value of the at least one file. value, which can be used to deduplicate electronic devices. For example, the electronic device stores a key-value table that records the correspondence between the file inode number and the hash value of the first information block. In the key-value table, the hash value of any first information block corresponds to one or more inode number, so that when corresponding to multiple inode numbers, the electronic device can perform deduplication operations on the files corresponding to the multiple inode numbers.

It should be understood that in this embodiment of the present application, a file may be stored in one or more data blocks, and an information block corresponding to the file may include at least one data block. For example, the first information block corresponding to the file may include the first data block of the file, or may include the first and second data blocks of the file, etc. This application does not limit this.

It should also be understood that in the embodiment of the present application, when the file in the electronic device is large, the above-mentioned "first hash value" may be the hash value of the Nth information block of the current read/write file, where N is a positive integer, For example, N is two.

In the embodiment of the present application, when the file in the electronic device is large, the above-mentioned "second hash value" may be the hash value of the Mth information block of the currently read/write file, M is a positive integer, for example, M is two .

Therefore, by searching and obtaining information such as the hash value of the information block of the file, the search efficiency of duplicate files is improved. Furthermore, when the obtained results are used for deduplication, the removal efficiency of duplicate files is improved.

Hereinafter, by way of example, with reference to FIG. 3 and FIG. 4 , taking the method in which the above method is executed by the first module, the second module, the third module and the fourth module in the electronic device as an example, a method provided by the embodiment of the present application will be described. File search methods based on electronic devices are introduced.

It should be noted that some steps of the method shown in Figures 3 and 4 are the same as some of the steps in Figure 2 above, and will not be described again here.

Figure 3 shows a schematic flow chart of an electronic device-based file search method provided by an embodiment of the present application. Specifically, the method 300 may include but is not limited to:

S301. The first module determines whether the load level of the electronic device within the first time window is light load or heavy load.

In this embodiment of the present application, the first module is a module in an electronic device.

For a detailed introduction to the above step S301, please refer to the relevant description in S201 in the above method 200, which will not be described again here.

S302. When the first module determines that the load level of the electronic device is heavy load, trigger the first operation of the second module. The first operation includes obtaining the inode number and the first hash value of the currently read/write file, and then converting the current read/write file into /The first hash value of the written file is recorded in the inode, and the inode number of the currently read/written file and the first hash value of the currently read/written file are sent to the fourth module.

In this embodiment of the present application, the second module and the fourth module are modules in an electronic device. The method for the first module to trigger the first operation of the second module may be that when the first module determines that the current load level is a heavy load, Send first information to the second module, where the first information is used to indicate that the current load level is heavy load.

Regarding the specific method of obtaining the first hash value of the currently read/write file and the inode number of the currently read/write file in the first operation of the above-mentioned step S302, please refer to the relevant introduction of step S202 in the above-mentioned method 200, and will not be repeated here. .

S303. When the first module determines that the load level of the electronic device is light load, trigger a second operation of the third module. The second operation includes obtaining the inode number of at least one file stored in the first device and the inode number of the at least one file. the second hash value, and sends the inode number of the at least one file and the second hash value of the at least one file to the fourth module.

In the embodiment of the present application, the third module and the fourth module are modules in an electronic device. The first module triggers the second operation of the third module by: when the first module determines that the current load level is light load, The third module sends second information, and the second information is used to indicate that the current load level is light load.

Regarding the specific method of obtaining the inode number of at least one file and the second hash value of the at least one file in the second operation of step S303, please refer to the relevant introduction of step S203 in method S200, which will not be described again here.

In one possible implementation, when the electronic device system is initialized, the electronic device creates a first daemon thread. The first daemon thread can be used by the third module to traverse the inode table of the file system when the device is idle, and obtain the inode table of at least one file. The inode number and the hash value of the first information block stored in the inode of the at least one file.

In this embodiment of the present application, the time when the device is idle may be a certain time period in the middle of the night; for example, the time period when the electronic device confirms that the user is sleeping through the wearable device, which is not limited in this application. In other embodiments, the time when the device is idle may be a period when the electronic device is charging and the screen is off.

S304. The fourth module receives and saves the inode number of the file sent by the second module and/or the third module, and the hash value of the first information block of the file.

It should be understood that the file in the above method S304 may be a current read/write file in the electronic device, or may be at least one file stored in the electronic device.

In this embodiment of the present application, the fourth module can record the inode number of the file and the hash value of the first information block of the file into a key-value table. This key-value table can also be called deduplication. table(deduptable). The fourth module records the correlation information between the hash value and the inode number from the second module and the third module. In the key-value table, for the same hash value, there may be multiple inode numbers, so that the electronic device can further deduplicate files with multiple inode numbers corresponding to the same hash value.

In a possible implementation, the key-value table can be as shown in Table 1 below. The key-value table includes two columns. The first column represents the hash value of the first information block, such as key1, key2, key3¨¨¨keyn Respectively represent the hash value of the first information block of the file; the second column represents the list of inode numbers. For example, i-list1 can include inode1-inode3, indicating the first of three files with inode numbers inode1-inode3. The hash value of each information block is the same, which is key1; i-list2 includes inode4, which means that the hash value of the first information block of the file with inode number inode4 is key2; i-list3 can include inode5-inode6, which means that the inode number is inode5. The hash value of the first information block of the two files of -inode6 is the same, which is key3; i-listm can be understood by analogy and will not be described again here. Therefore, the electronic device can deduplicate multiple files with the same hash value of the first information block. For example, the fifth module in the electronic device deduplicates multiple files whose first information block has the same hash value. In this embodiment of the present application, the fifth module may be a deduplication module, or the fifth module may have another name, which is not limited in this application.

Table 1

The hash value of the first information block inode number list key1 i-list1 key2 i-list2 key3 i-list3 … … keyn i-listm

FIG. 4 shows a schematic module architecture diagram of electronic device-based file search provided by an embodiment of the present application. The module architecture 400 can be used for deduplication of electronic devices. Specifically, the module architecture includes a load sensing module 401, a foreground duplicate file search module 402, a background duplicate file search module 403, a deduplication information recording module 404, and a deduplication module. 405.

The modules (401, 402, 403, 404, 405) can all be software modules: the load sensing module 401 can obtain the running status of the application program, and can determine the load level of the current device based on the running status of the application program; when the load sensing module 401 determines When the device is currently under heavy load, the foreground duplicate file search module 402 can calculate, record and other operations on the relevant information of the currently read/written data; when the load sensing module 401 determines that the current device is under light load, the background duplicate file search module 403 The relevant information of the stored data in the device can be scanned, calculated, recorded and other operations; the foreground duplicate file search module 402 and the background duplicate file search module 403 send the relevant information of the acquired data to the deduplication information recording module 404 , the deduplication information recording module 404 will save the relevant information; the deduplication module 405 performs deduplication according to the information saved in the deduplication information recording module 404 .

It should be understood that the modules (401, 402, 403, 404, 405) may be modules of the file system, or the modules (401, 402, 403, 404, 405) may also be external plug-ins of the file system to provide services for the file system.

Regarding the specific methods that can be implemented by the above modules (401, 402, 403, 404, 405) and the specific functions that can be performed, please refer to the relevant introductions in the above methods 200 and 300, which will not be described again here.

The file search method based on electronic devices provided by the embodiment of the present application is introduced in detail above with reference to FIGS. 2 to 4 . Next, the device provided by the embodiment of the present application will be described in detail with reference to FIG. 5 and FIG. 6 . It should be understood that the description of the device embodiments corresponds to the description of the method embodiments. Therefore, content that is not described in detail can be referred to the above method embodiments. For the sake of brevity, they will not be described again here.

Figure 5 shows a schematic structural diagram of an electronic device-based file search device provided by an embodiment of the present application. The device 500 shown in Figure 5 can perform corresponding steps performed by the electronic device in the above method embodiment.

As shown in FIG. 5 , the device 500 may include: a first processing unit 501 , a second processing unit 502 and a third processing unit 503 . Among them, the first processing unit 501 can be used to determine the load level of the electronic device; the second processing unit 502 can be used to obtain the first hash value of the current read/write file when it is determined that the load level of the electronic device is heavy load. and the inode number of the currently read/write file; the third processing unit 503 may be configured to obtain a second hash value of at least one file stored in the electronic device when it is determined that the load level of the electronic device is light load. and the inode number of the at least one file; wherein the first hash value is the hash value of the first information block of the currently read/write file, and is used for the electronic device to find the first hash value with the same The second hash value is the hash value of the first information block of the at least one file, and is used for the electronic device to find duplicate files with the same second hash value.

Regarding the specific functions of the first processing unit, the second processing unit and the third processing unit, reference may be made to the relevant descriptions in the above method embodiments and will not be described in detail here.

It should be understood that the device 500 provided in the embodiment of the present application can be implemented by a central processing unit (CPU), an application-specific integrated circuit (ASIC), or a programmable logic device (programmable logic). device, PLD), the above PLD can be a complex programmable logical device (CPLD), a field-programmable gate array (FPGA), a general array logic (genericarray logic, GAL) or any of them combination. When the methods shown in Figures 2 to 4 are implemented through software, the device 500 and its respective modules can also be software modules.

FIG. 6 is a schematic diagram of the hardware structure of an electronic device-based file search device 1000 provided by an embodiment of the present application.

As shown in Figure 6, the device 1000 includes a processor 1001, a memory 1002, an interface 1003 and a bus 1004. The interface 1003 can be implemented in a wireless or wired manner, specifically, it can be a network card. The above-mentioned processor 1001, memory 1002 and interface 1003 are connected through a bus 1004. The interface 1003 may specifically include a transmitter and a receiver, for the device to implement the above-mentioned sending and receiving. The processor 1001 is used to perform the processing performed by the device in the above embodiment. The memory 1002 includes an operating system 10021 and an application program 10022, which is used to store programs, codes or instructions. When the processor or hardware device executes these programs, codes or instructions, the processing in the method embodiment can be completed. In this embodiment of the present application, the memory 1002 may include read-only memory (ROM) and random access memory (RAM). Wherein, the ROM includes a basic input/output system (BIOS) or an embedded system; the RAM includes an application program and an operating system. When it is necessary to run the device 1000, the system is started through the BIOS solidified in the ROM or the bootloader in the embedded system, and the device 1000 is booted into a normal operating state. After the device 1000 enters the normal operating state, the application program and operating system in the RAM are run, thereby completing the processing procedures involving the device 1000 in the method embodiment. Figure 6 shows only a simplified design of device 1000. In practical applications, the device may contain any number of interfaces, processors or memories.

In some implementations, the device 1000 may be a schematic diagram of the hardware structure of the device 500 described above. At this time, the processor 1001 has the same function as the first to third processing units 501 to 503 described above.

Embodiments of the present application also provide a computer-readable medium. The computer-readable medium stores program code. When the computer program code is run on a computer, it causes the computer to perform the method performed by the electronic device in the above method embodiment. These computer-readable storage include but are not limited to one or more of the following: read-only memory (ROM), programmable ROM (PROM), erasable PROM (erasable PROM, EPROM), Flash memory, electrical EPROM (electrically EPROM, EEPROM) and hard drive (hard drive).

Embodiments of the present application also provide a chip system. The chip system includes: at least one processor, at least one memory, and an interface circuit. The interface circuit is responsible for information interaction between the chip system and the outside world. The at least one memory, The interface circuit and the at least one processor are interconnected through lines, and instructions are stored in the at least one memory; the instructions are executed by the at least one processor to perform the electronic equipment in the methods of the above aspects. operation. In the specific implementation process, the chip system can be based on a central processing unit (CPU), a microcontroller unit (MCU), a microprocessor (micro processing unit, MPU), a digital signal processor (digital signal processor) processing (DSP), system on chip (SoC), application-specific integrated circuit (ASIC), field programmable gate array (FPGA) or programmable logic device (programmable logic device, PLD).

Embodiments of the present application also provide a computer program product for use in electronic equipment. The computer program product includes a series of instructions. When the instructions are executed, the methods described in the above aspects are performed. Operation of electronic equipment.

The terms "component", "module", "system", etc. used in this specification are used to refer to computer-related entities, hardware, firmware, a combination of hardware and software, software, or software in execution. For example, a component may be, but is not limited to, a process, a processor, an object, an executable file, a thread of execution, a program and/or a computer running on a processor. Through the illustrations, both applications running on the computing device and the computing device may be components. One or more components can reside in a process and/or thread of execution and a component can be localized on one computer and/or distributed between 2 or more computers. Additionally, these components can execute from various computer-readable media having various data structures stored thereon. A component may, for example, be based on a signal having one or more data packets (eg, data from two components interacting with another component, such as a local system, a distributed system, and/or a network, such as the Internet, which interacts with other systems via signals) Communicate through local and/or remote processes.

Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered beyond the scope of this application.

Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be described again here.

In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit.

If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of this application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program code. .

The above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application. should be covered by the protection scope of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims (21)

1. A method for searching a file based on an electronic device, the method comprising:

the electronic equipment determines the load degree of the electronic equipment;

when the load degree of the electronic equipment is determined to be heavy, the electronic equipment acquires a first hash value of a current read/write file and an inode number of the current read/write file;

when the load degree of the electronic equipment is determined to be light load, the electronic equipment acquires a second hash value of at least one file stored in the electronic equipment and an inode number of the at least one file;

the first hash value is the hash value of a first information block of the current read/write file and is used for the electronic equipment to search for repeated files with the same first hash value;

the second hash value is a hash value of a first information block of the at least one file and is used for the electronic device to find duplicate files having the same second hash value.

2. The method of claim 1, wherein the electronic device determining a load level of the electronic device comprises:

and in the first time window, the electronic equipment calculates the information quantity of the read/write file and determines the load degree of the electronic equipment.

3. The method according to claim 1 or 2, wherein when the electronic device is determined to be heavily loaded, the electronic device obtains a first hash value of a current read/write file and an inode number of the current read/write file, including:

the electronic equipment obtains an inode number of the current read/write file according to the file name of the current read/write file;

the electronic equipment reads or calculates a first hash value of the current read/write file according to the inode number of the current read/write file;

and the electronic equipment stores the corresponding relation between the inode number of the current read/write file and the first hash value of the current read/write file.

4. A method according to any of claims 1-3, wherein when the electronic device is determined to be lightly loaded, the electronic device obtains a second hash value of at least one file stored in the electronic device and an inode number of the at least one file, comprising:

The electronic equipment reads or calculates an inode number of the at least one file and a second hash value of the at least one file;

and the electronic equipment stores the corresponding relation between the inode number of the at least one file and the second hash value of the at least one file.

5. The method of claim 3, wherein the electronic device storing a correspondence between an inode number of the current read/write file and a first hash value of the current read/write file comprises:

and the electronic equipment stores the corresponding relation between the inode number of the current read/write file and the first hash value of the current read/write file into a key value table.

6. The method of claim 4, wherein the electronic device storing the correspondence between the inode number of the at least one file and the second hash value of the at least one file comprises:

and the electronic equipment stores the corresponding relation between the inode number of the at least one file and the second hash value of the at least one file into a key value table.

7. The method of any of claims 2-6, wherein the first time window is determined by the electronic device from a global variable.

8. The method according to any one of claims 1-7, wherein when first hash values of at least two files are identical, the electronic device determines that at least two files having the same first hash value are duplicate files;

and when the second hash values of at least two files are the same, the electronic equipment determines that at least two files with the same second hash values are repeated files.

9. The method according to any of claims 1-8, wherein the first hash value and/or the second hash value is used for deduplication of the duplicate file by the electronic device.

10. A file finding apparatus based on an electronic device, the apparatus comprising:

the first processing unit is used for determining the load degree of the electronic equipment;

the second processing unit is used for acquiring a first hash value of a current read/write file and an inode number of the current read/write file when the load degree of the electronic equipment is determined to be heavy;

the third processing unit is used for acquiring a second hash value of at least one file stored in the electronic equipment and an inode number of the at least one file when the load degree of the electronic equipment is determined to be light load;

The first hash value is the hash value of a first information block of the current read/write file and is used for the electronic equipment to search for repeated files with the same first hash value;

the second hash value is a hash value of a first information block of the at least one file and is used for the electronic device to find duplicate files having the same second hash value.

11. The apparatus of claim 10, wherein the first processing unit is configured to determine a load level of the electronic device, and wherein the first processing unit is specifically configured to:

and in the first time window, the electronic equipment calculates the information quantity of the read/write file and determines the load degree of the electronic equipment.

12. The apparatus of claim 10 or 11, wherein the second processing unit is configured to, when determining that the load degree of the electronic device is heavy, obtain a first hash value of a current read/write file and an inode number of the current read/write file, where the second processing unit is specifically configured to:

acquiring an inode number of the current read/write file according to the file name of the current read/write file;

reading or calculating a first hash value of the current read/write file according to the inode number of the current read/write file;

And storing the corresponding relation between the inode number of the current read/write file and the first hash value of the current read/write file.

13. The apparatus according to any one of claims 10-12, wherein the third processing unit is configured to, when determining that the load level of the electronic device is light, obtain a second hash value of at least one file stored in the electronic device and an inode number of the at least one file, where the third processing unit is specifically configured to:

reading or calculating an inode number of the at least one file and a second hash value of the at least one file;

and storing the corresponding relation between the inode number of the at least one file and the second hash value of the at least one file.

14. The apparatus of claim 12, wherein the second processing unit is configured to store a correspondence between an inode number of the current read/write file and a first hash value of the current read/write file, and the second processing unit is specifically configured to:

and storing the corresponding relation between the inode number of the current read/write file and the first hash value of the current read/write file into a key value table.

15. The apparatus of claim 13, wherein the third processing unit is configured to store a correspondence between an inode number of the at least one file and a second hash value of the at least one file, and the third processing unit is specifically configured to:

And storing the corresponding relation between the inode number of the at least one file and the second hash value of the at least one file into a key value table.

16. The apparatus of any of claims 11-15, wherein the first time window is determined from a global variable.

17. The apparatus according to any one of claims 10-16, wherein when first hash values of at least two files are identical, it is determined that at least two files having the same first hash value are duplicate files;

and when the second hash values of at least two files are the same, determining that at least two files with the same second hash values are repeated files.

18. The apparatus according to any of claims 10-17, wherein the first hash value and/or the second hash value is used for deduplication of the duplicate file by the electronic device.

19. An electronic device based file finding apparatus comprising at least one processor coupled to at least one memory, the at least one processor configured to execute a computer program or instructions stored in the at least one memory to cause the apparatus to perform the method of any one of claims 1-9.

20. A chip comprising a processor and a communication interface for receiving data and/or information and transmitting the received data and/or information to the processor, the processor processing the data and/or information according to the method of any of claims 1-9.

21. A computer readable storage medium having stored therein computer instructions which, when run on a computer, cause the method of any of claims 1-9 to be implemented.