CN109740004B - Filing method and device - Google Patents
Filing method and device Download PDFInfo
- Publication number
- CN109740004B CN109740004B CN201811624049.9A CN201811624049A CN109740004B CN 109740004 B CN109740004 B CN 109740004B CN 201811624049 A CN201811624049 A CN 201811624049A CN 109740004 B CN109740004 B CN 109740004B
- Authority
- CN
- China
- Prior art keywords
- archive
- file
- offline
- files
- archived
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Processing Or Creating Images (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Image Analysis (AREA)
Abstract
The embodiment of the application provides an archiving method and device, and relates to the technical field of image processing, wherein the method comprises the following steps: when archiving a plurality of face images to be archived, which are acquired in a preset period, clustering the face images to be archived to generate a first pre-archiving archive, and determining the same-row archive in the first pre-archiving archive according to the space information of the face images to be archived in the first pre-archiving archive. Because the peer files are likely to be files of the same person, the peer files are compared, the peer files with the second similarity larger than the second threshold value among the peer files are combined to generate a second pre-archiving file, and then the second pre-archiving file is compared with the offline files in the face image library and then archived, so that the offline archiving efficiency can be effectively improved.
Description
Technical Field
The embodiment of the invention relates to the technical field of image processing, in particular to an archiving method and device.
Background
In the current society, the surveillance cameras are distributed in various public places such as streets, communities and buildings due to the requirement of security management. When an alarm condition occurs, police officers search suspects by using the monitoring camera.
However, as the scale of the monitoring network increases, the video data grows in mass. When the police appear, based on the image of suspicion obtain useful information or intelligence from the massive image more and more difficult, not only inefficiency, the human cost is high simultaneously.
Disclosure of Invention
In the prior art, when an alarm occurs, the image based on the suspects is more and more difficult to acquire useful information or intelligence from a mass of images, so that the method and the device for archiving are low in efficiency and high in labor cost.
In one aspect, an embodiment of the present application provides an archiving method, including:
acquiring a plurality of face images to be archived and space-time information of the face images to be archived in a preset period, wherein the space-time information comprises time information and space information;
clustering the face images to be archived to generate first pre-archived files, wherein the similarity between any face image in any first pre-archived file and any face image in other first pre-archived files is smaller than a first threshold value;
determining the same-row files in each first pre-archive file according to the space-time information of the face images to be archived in each first pre-archive file;
when the second similarity between the peer files is determined to be greater than a second threshold, merging the peer files to generate a second pre-archive file;
and aiming at any one second pre-archiving file, when determining that an offline file matched with the second pre-archiving file exists in the face image library, classifying the second pre-archiving file into the matched offline file, wherein the face image library comprises at least one offline file, and the offline file is the file archived before the preset period.
Optionally, the determining the peer file in each first pre-archive file according to the space-time information of the face image to be archived in each first pre-archive file includes:
determining the same-line times of any two first pre-archive files according to the space-time information of face images to be archived in the two first pre-archive files;
and determining the two first pre-archive files as the same-line files when the same-line times of the two first pre-archive files are determined to be larger than a third threshold value.
Optionally, when the second similarity between the peer files is determined to be greater than a second threshold, merging the peer files to generate a second pre-archive file, including:
for a first synchronous file in a plurality of synchronous files, the first synchronous file is any synchronous file in the plurality of synchronous files, and according to the similarity between the class center of the first synchronous file and the class center of a second synchronous file, the second similarity between the first synchronous file and the second synchronous file is determined, wherein the second synchronous file is any synchronous file in the plurality of synchronous files except the first synchronous file;
and if the second similarity of the first and second parallel files is greater than a second threshold, merging the first and second parallel files to generate a second pre-archive file.
Optionally, the determining that the offline archive matching the second pre-archive exists in the offline archive in the face image library includes:
for any offline archive, determining the similarity of the offline archive and the second pre-archive according to the third similarity of the class center of the offline archive and the class center of the second pre-archive;
and if the similarity between the offline archive and the second pre-archive is greater than or equal to a fourth threshold value, determining that the offline archive matched with the second pre-archive exists in the offline archive in the face image library.
An embodiment of the present application provides an archiving device, including:
the acquisition module is used for acquiring a plurality of face images to be archived and space-time information of the face images to be archived in a preset period, wherein the space-time information comprises time information and space information;
the clustering module is used for clustering the face images to be archived to generate first pre-archiving files, wherein the similarity between any face image in any first pre-archiving file and any face image in other first pre-archiving files is smaller than a first threshold value;
the analysis module is used for determining the same-row files in each first pre-archive file according to the space-time information of the face images to be archived in each first pre-archive file;
the merging module is used for merging the same-row files to generate a second pre-archive file when the second similarity between the same-row files is determined to be larger than a second threshold value;
the archiving module is used for classifying the second pre-archived file into the matched offline file when determining that the offline file matched with the second pre-archived file exists in the face image library, wherein the face image library comprises at least one offline file, and the offline file is the file archived before the preset period.
Optionally, the analysis module is specifically configured to:
determining the same-line times of any two first pre-archive files according to the space-time information of face images to be archived in the two first pre-archive files;
and determining the two first pre-archive files as the same-line files when the same-line times of the two first pre-archive files are determined to be larger than a third threshold value.
Optionally, the merging module is specifically configured to:
for a first synchronous file in a plurality of synchronous files, the first synchronous file is any synchronous file in the plurality of synchronous files, and according to the similarity between the class center of the first synchronous file and the class center of a second synchronous file, the second similarity between the first synchronous file and the second synchronous file is determined, wherein the second synchronous file is any synchronous file in the plurality of synchronous files except the first synchronous file;
and if the second similarity of the first and second parallel files is greater than a second threshold, merging the first and second parallel files to generate a second pre-archive file.
Optionally, the archiving module is specifically configured to:
for any offline archive, determining the similarity of the offline archive and the second pre-archive according to the third similarity of the class center of the offline archive and the class center of the second pre-archive;
and if the similarity between the offline archive and the second pre-archive is greater than or equal to a fourth threshold value, determining that the offline archive matched with the second pre-archive exists in the offline archive in the face image library.
In one aspect, an embodiment of the present application provides an archiving apparatus, including at least one processing unit, and at least one storage unit, where the storage unit stores a computer program, and when the program is executed by the processing unit, causes the processing unit to perform steps of an archiving method.
In one aspect, embodiments of the present application provide a computer-readable medium storing a computer program executable by an archiving device, which when run on the archiving device causes the archiving device to perform the steps of an archiving method.
In the embodiment of the application, when archiving a plurality of face images to be archived, which are acquired in a preset period, the face images to be archived are clustered to generate a first pre-archiving archive, and then the same-row archive in the first pre-archiving archive is determined according to the space information of the face images to be archived in the first pre-archiving. Because the peer files are likely to be files of the same person, the peer files are compared, the peer files with the second similarity larger than the second threshold value among the peer files are combined to generate a second pre-archiving file, and then the second pre-archiving file is compared with the offline files in the face image library and then archived, so that the offline archiving efficiency can be effectively improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments will be briefly described below, it will be apparent that the drawings in the following description are only some embodiments of the present invention, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a diagram of a system architecture suitable for use in embodiments of the present application;
FIG. 2 is a schematic flow chart of an archiving method according to an embodiment of the present application;
FIG. 3 is a schematic view of an archival device according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of an archiving device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantageous effects of the present invention more apparent, the present invention will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
The archiving method in the embodiment of the application can be applied to security protection, a face image library is established based on face images collected by monitoring equipment, the face image library comprises a plurality of face files, one file corresponds to one person, and the archiving method of the face files can be divided into online archiving and offline archiving according to the archiving method. The online archiving is a method for archiving face images acquired by monitoring equipment in real time, and the offline archiving is a method for archiving face images acquired in a set time period. For convenience of description, the face file in the embodiment of the present application is referred to as an online file in the online archiving process, and the face file in the embodiment of the present application is referred to as an offline file in the offline archiving process. Offline archival may be used to update online archival. The online file comprises a real-name file and a non-real-name file, and the offline file also comprises a real-name file and a non-real-name file, wherein the real-name file comprises personal identification information, and the real-name file comprises identity documents.
When an alarm occurs, police staff can search face files in a face image library through images of the suspects, obtain face files corresponding to the suspects from the face files, and analyze information such as movement tracks, areas with frequent movements, positions which are newly appeared and the like of the suspects according to the face images in the face files corresponding to the suspects, so that police staff can catch the suspects conveniently.
Fig. 1 illustrates a system architecture applicable to an embodiment of the present application, in which a monitoring device 101 and a server 102 are included. The monitoring device 101 collects video streams in real time, then sends the collected video streams to the server 102, the server 102 comprises an archiving device, the server 102 obtains face images to be archived from the video streams, and then classifies the face images to be archived into corresponding face files. The monitoring device 101 is connected to the server 102 through a wireless network, and is an electronic device having a function of capturing images, such as a camera, a video recorder, and the like. Server 102 is a server cluster or cloud computing center composed of one server or several servers.
Based on the system architecture shown in fig. 1, the embodiment of the present application provides a process of an archiving method, which may be performed by an archiving device, which may be the server 102 shown in fig. 1, as shown in fig. 2, and includes the following steps:
The preset period may be set according to actual conditions, for example, the preset period is one day. The face image to be archived is a face image collected by the monitoring equipment in a working state. The space-time information comprises time information and space information, and each face image to be archived carries the space information and the time information, wherein the space information is the identification and the position of monitoring equipment for capturing the face image to be archived. The time information is the time when the monitoring equipment captures the face image to be archived.
Illustratively, the spatial information and the temporal information of the face image a to be archived are as follows:
spatial information: the camera mark is: CAMERA_A, CAMERA position: a Shanghai city creep district.
Time information: 2018-10-20 10:07:21.
The similarity between any face image in any first pre-archive file and any face image in other first pre-archive files is smaller than a first threshold value.
Specifically, for a plurality of face images to be archived, clustering is performed on the face images to be archived in the category by adopting a clustering algorithm, wherein the clustering algorithm comprises but is not limited to a K-Means (K-Means) clustering algorithm, a mean shift clustering algorithm and a density-based clustering algorithm.
For example, setting up to divide 100 face images to be archived into three types by adopting a K-Means clustering algorithm, wherein the first type comprises 50 face images to be archived, the second type comprises 20 face images to be archived, the third type comprises 30 face images to be archived, and then a first pre-archiving file is established for the 50 face images to be archived in the first type, a first pre-archiving file is established for the 20 face images to be archived in the second type, and a first pre-archiving file is established for the 30 face images to be archived in the third type.
Optionally, for any two first pre-archive files in each first pre-archive file, determining the same-row times of the two first pre-archive files according to the space-time information of the face images to be archived in the two first pre-archive files. And determining the two first pre-archive files as the same-line files when the same-line times of the two first pre-archive files are determined to be larger than a third threshold value.
In specific implementation, two face images to be archived are captured by one camera in the same line at a time, and the capturing time interval is within a preset duration. For example, the preset duration is set to be 5 seconds, the first pre-archiving archive A comprises a face image a to be archived, the identification of a CAMERA for capturing the face image a to be archived is CAMERA_A, and the capturing time is 2018-10-20:10:07:21. The first pre-archive B includes a face image B to be archived, the identification of a CAMERA for capturing the face image B to be archived is CAMERA_A, the capturing time is 2018-10-2010:07:22, and since the identification of the CAMERA for capturing the face image a to be archived and the CAMERA for capturing the face image B to be archived are CAMERA_A and the capturing time interval is 1 second, it can be determined that the first pre-archive a and the first pre-archive B exist in the same line once. By adopting the same method, each face image to be archived in the first preset archive A can be compared with each face image to be archived in the first preset archive B, and the same-line times of the first preset archive A and the first preset archive B are determined.
The third threshold may be preset, for example, set to 3, and when the number of the same lines of the first pre-archive file a and the first pre-archive file B is greater than 3, the number of the same lines of the first pre-archive file a and the first pre-archive file B is determined to be the same line file.
Specifically, when a first pre-archive file has only one peer file, the first pre-archive file is compared with the peer file, and when the similarity is greater than a second threshold, the first pre-archive file is combined with the corresponding peer file to generate a second pre-archive file.
For example, a peer file of the first pre-archive file a is set as a first pre-archive file B, and when a second similarity between the first pre-archive file a and the first pre-archive file B is greater than a second threshold, the first pre-archive file a and the first pre-archive file B are combined to generate a second pre-archive file.
When a first pre-archive file comprises a plurality of peer files, the first pre-archive file is compared with the peer files respectively, and the first pre-archive file is combined with the peer files meeting the second similarity greater than a second threshold value to generate a second pre-archive file.
Illustratively, the peer archive of the first pre-archive a is set as a first pre-archive B and a first pre-archive C, the first pre-archive a is compared with the first pre-archive B, and the first pre-archive a is compared with the first pre-archive C. And when the second similarity of the first pre-archive file A and the first pre-archive file B is greater than a second threshold value and the second similarity of the first pre-archive file A and the first pre-archive file C is greater than a second threshold value, merging the first pre-archive file A, the first pre-archive file B and the first pre-archive file C to generate a second pre-archive file.
The face image library comprises at least one offline file, and the offline file is a file filed before a preset period.
When archiving a plurality of face images to be archived, which are acquired in a preset period, clustering the face images to be archived to generate a first pre-archiving archive, and determining the same-row archive in the first pre-archiving archive according to the space information of the face images to be archived in the first pre-archiving archive. Because the peer files are likely to be files of the same person, the peer files are compared, the peer files with the second similarity larger than the second threshold value among the peer files are combined to generate a second pre-archiving file, and then the second pre-archiving file is compared with the offline files in the face image library and then archived, so that the offline archiving efficiency can be effectively improved. Further, when an alarm occurs, police staff can directly acquire files of the suspects from the face image library according to images of the suspects, and acquire useful information or intelligence from the files of the suspects, so that efficiency of acquiring the intelligence by the police staff is improved, and labor cost is saved.
Optionally, in the step S204, for a first peer file of the plurality of peer files, the first peer file is any peer file of the plurality of peer files, and according to the similarity between the class center of the first peer file and the class center of a second peer file, a second similarity between the first peer file and the second peer file is determined, and the second peer file is any peer file of the plurality of peer files except the first peer file; if the second similarity between the first and second parallel files is greater than the second threshold, merging the first and second parallel files to generate a second pre-archive file.
The class center of the offline files of the first synchronous file can be one, and the class center is the face image to be archived with the highest image quality in the first synchronous file. The offline files of the first synchronous file can also have a plurality of class centers, and the plurality of class centers can be determined according to the image quality and the image characteristics of the face images to be archived in the first synchronous file.
Similarly, the class center of the offline archive of the second peer archive may be one, and the class center is the face image to be archived with the highest image quality in the second peer archive. The offline files of the second peer file may also have a plurality of class centers, and the plurality of class centers may be determined according to the image quality and the image characteristics of the face images to be archived in the second peer file.
Optionally, in the step S205, the following method is specifically adopted to determine that an offline archive matching the second pre-archive exists in the offline archive in the face image library:
for any offline archive, determining the similarity of the offline archive and the second pre-archive according to the third similarity of the class center of the offline archive and the class center of the second pre-archive;
if the similarity between the offline file and the second pre-archive file is greater than or equal to a fourth threshold value, determining that the offline file matched with the second pre-archive file exists in the offline files in the face image library.
In one possible implementation, the class center of the offline archive is one, and the class center is the face image with the highest image quality in the offline archive. The class center of the second pre-archive file is one, and the class center is the face image to be archived with the highest image quality in the second pre-archive file. And determining the third similarity between the class center of the offline archive and the class center of the second pre-archive as the similarity between the offline archive and the second pre-archive.
In a specific implementation, when determining the similarity between the class center of the offline archive and the class center of the second pre-archive, a first feature vector corresponding to the class center of the offline archive and a second feature vector corresponding to the class center of the second pre-archive may be first determined, then a distance between the first feature vector and the second feature vector is calculated, and a third similarity between the class center of the offline archive and the class center of the second pre-archive is determined according to the distance between the first feature vector and the second feature vector.
In another possible implementation, the class centers of the offline archive are multiple, and the multiple class centers of the offline archive may be determined according to the image quality and the image characteristics of the face images in the offline archive. The class center of the second pre-archive file is one, and the class center is the face image to be archived with the highest image quality in the second pre-archive file. And determining the similarity between the class center of the second pre-archive file and the various centers of the offline archive file, and then determining the similarity between the offline archive file and the second pre-archive file according to the third similarity between the class center of the second pre-archive file and the various centers of the offline archive file.
When the similarity between the class center of the second pre-archive file and the class centers of the offline archive file is determined, the similarity between the class center of the second pre-archive file and each class center of the offline archive file can be determined, then the similarity between the class center of the second pre-archive file and each class center of the offline archive file is fused according to the weight of each class center of the offline archive file, the similarity between the offline archive file and the second pre-archive file is determined, and the weight of each class center of the offline archive file can be distributed according to image quality or image characteristics.
In another possible implementation manner, the plurality of class centers of the second pre-archive file may be determined according to the image quality and the image characteristics of the face image to be archived in the second pre-archive file. The class center of the offline archive is one, and the class center is the face image with the highest image quality in the offline archive. And determining the third similarity between the class center of the offline archive and the various centers of the second pre-archive, and then determining the similarity between the offline archive and the second pre-archive according to the third similarity between the class center of the offline archive and the various centers of the second pre-archive.
When the similarity between the class center of the offline archive and the class centers of the second pre-archive is determined, the similarity between the class center of the offline archive and each class center of the second pre-archive can be determined, then the class center of the offline archive and the third similarity between the class center of the second pre-archive are fused according to the weight of each class center of the second pre-archive, the similarity between the offline archive and the second pre-archive is determined, and the weight of each class center of the second pre-archive can be distributed according to the image quality or according to the image characteristics.
In another possible implementation, the class centers of the offline archive are multiple, and the multiple class centers of the offline archive may be determined according to the image quality and the image characteristics of the face images in the offline archive. The plurality of class centers of the second pre-archive file may be determined according to the image quality and the image characteristics of the face image to be archived in the second pre-archive file. And determining the third similarity between each center of the offline archive and each center of the second pre-archive, and then determining the similarity between the offline archive and the second pre-archive according to the third similarity between each center of the offline archive and each center of the second pre-archive.
Since the offline archive and the second pre-archive are both represented by the class center, when the second pre-archive is archived offline, the class center of the second pre-archive is only compared with the class center of the offline archive, an offline archive matching the second pre-archive is determined without comparing the second pre-archive with each of the face images in the offline archive, thereby improving offline archiving efficiency.
Optionally, for the first pre-archive that is not merged with other first pre-archive archives, the first pre-archive is directly compared with the offline archives in the face image library, and when it is determined that there is an offline archive in the face image library that matches the first pre-archive, the first pre-archive is classified as the matching offline archive.
In the embodiment of the application, when archiving a plurality of face images to be archived, which are acquired in a preset period, the face images to be archived are clustered to generate a first pre-archiving archive, and then the same-row archive in the first pre-archiving archive is determined according to the space information of the face images to be archived in the first pre-archiving. Because the peer files are likely to be files of the same person, the peer files are compared, the peer files with the second similarity larger than the second threshold value among the peer files are combined to generate a second pre-archiving file, and then the second pre-archiving file is compared with the offline files in the face image library and then archived, so that the offline archiving efficiency can be effectively improved.
Based on the same technical concept, an embodiment of the present invention provides an archiving device, as shown in fig. 3, the device 300 includes:
an obtaining module 301, configured to obtain a plurality of face images to be archived in a preset period and space-time information of the plurality of face images to be archived, where the space-time information includes time information and space information;
the clustering module 302 is configured to cluster the plurality of face images to be archived to generate a first pre-archiving archive, where a similarity between any face image in any first pre-archiving archive and any face image in other first pre-archiving archives is smaller than a first threshold;
an analysis module 303, configured to determine a peer file in each first pre-archive file according to the spatial-temporal information of the face image to be archived in each first pre-archive file;
a merging module 304, configured to, when determining that the second similarity between the peer files is greater than a second threshold, merge the peer files to generate a second pre-archive file;
the archiving module 305 is configured to, for any one of the second pre-archiving files, assign the second pre-archiving file to the matched offline file when determining that the offline file matching the second pre-archiving file exists in the face image library, where the face image library includes at least one offline file, and the offline file is the file archived before the preset period.
Optionally, the analysis module 303 is specifically configured to:
determining the same-line times of any two first pre-archive files according to the space-time information of face images to be archived in the two first pre-archive files;
and determining the two first pre-archive files as the same-line files when the same-line times of the two first pre-archive files are determined to be larger than a third threshold value.
Optionally, the merging module 304 is specifically configured to:
for a first synchronous file in a plurality of synchronous files, the first synchronous file is any synchronous file in the plurality of synchronous files, and according to the similarity between the class center of the first synchronous file and the class center of a second synchronous file, the second similarity between the first synchronous file and the second synchronous file is determined, wherein the second synchronous file is any synchronous file in the plurality of synchronous files except the first synchronous file;
and if the second similarity of the first and second parallel files is greater than a second threshold, merging the first and second parallel files to generate a second pre-archive file.
Optionally, the archiving module 305 is specifically configured to:
for any offline archive, determining the similarity of the offline archive and the second pre-archive according to the third similarity of the class center of the offline archive and the class center of the second pre-archive;
and if the similarity between the offline archive and the second pre-archive is greater than or equal to a fourth threshold value, determining that the offline archive matched with the second pre-archive exists in the offline archive in the face image library.
Based on the same technical concept, the embodiment of the present application provides an archiving device, as shown in fig. 4, including at least one processor 401 and a memory 402 connected to the at least one processor, where a specific connection medium between the processor 401 and the memory 402 is not limited in the embodiment of the present application, and in fig. 4, the processor 401 and the memory 402 are connected by a bus, for example. The buses may be divided into address buses, data buses, control buses, etc.
In the embodiment of the present application, the memory 402 stores instructions executable by the at least one processor 401, and the at least one processor 401 may perform the steps included in the aforementioned archiving method by executing the instructions stored in the memory 402.
Where the processor 401 is a control center of the archiving device, various interfaces and lines may be utilized to connect the various portions of the archiving device to effect archiving by executing or executing instructions stored in the memory 402 and invoking data stored in the memory 402. Alternatively, the processor 401 may include one or more processing units, and the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, an application program, etc., and the modem processor mainly processes wireless communication. It will be appreciated that the modem processor described above may not be integrated into the processor 401. In some embodiments, processor 401 and memory 402 may be implemented on the same chip, and in some embodiments they may be implemented separately on separate chips.
The processor 401 may be a general purpose processor such as a Central Processing Unit (CPU), digital signal processor, application specific integrated circuit (Application Specific Integrated Circuit, ASIC), field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components, which may implement or perform the methods, steps, and logic blocks disclosed in the embodiments of the present application. The general purpose processor may be a microprocessor or any conventional processor or the like. The steps of a method disclosed in connection with the embodiments of the present application may be embodied directly in a hardware processor for execution, or in a combination of hardware and software modules in the processor for execution.
Based on the same inventive concept, embodiments of the present application provide a computer readable medium storing a computer program executable by an archiving device, which when run on the archiving device causes the archiving device to perform the steps of an archiving method.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, or as a computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (8)
1. A method of archiving, comprising:
acquiring a plurality of face images to be archived and space-time information of the face images to be archived in a preset period, wherein the space-time information comprises time information and space information;
clustering the face images to be archived to generate first pre-archived files, wherein the similarity between any face image in any first pre-archived file and any face image in other first pre-archived files is smaller than a first threshold value;
determining the same-row files in each first pre-archive file according to the space-time information of the face images to be archived in each first pre-archive file;
when the second similarity between the peer files is determined to be greater than a second threshold, merging the peer files to generate a second pre-archive file;
for any one second pre-archive file, when determining that an offline archive matched with the second pre-archive file exists in the face image library, classifying the second pre-archive file into the matched offline archive, wherein the face image library comprises at least one offline archive, and the offline archive is an archive archived before the preset period;
and when the second similarity between the peer files is greater than a second threshold, merging the peer files to generate a second pre-archive file, including:
for a first synchronous file in a plurality of synchronous files, the first synchronous file is any synchronous file in the plurality of synchronous files, and according to the similarity between the class center of the first synchronous file and the class center of a second synchronous file, the second similarity between the first synchronous file and the second synchronous file is determined, wherein the second synchronous file is any synchronous file in the plurality of synchronous files except the first synchronous file;
if the second similarity of the first and second parallel files is greater than a second threshold, merging the first and second parallel files to generate a second pre-archive file;
upon determining that there is an offline archive in the face image library that matches the second pre-archive:
the class center of the offline file is one, and the class center is a face image with highest image quality in the offline file; the class center of the second pre-archive file is one, and the class center is the face image to be archived with the highest image quality in the second pre-archive file;
the off-line archives comprise a plurality of class centers, and the class centers of the off-line archives are determined according to the image quality and the image characteristics of the face images in the off-line archives; the class centers of the second pre-archive file are multiple, and the class centers of the second pre-archive file are determined according to the image quality and the image characteristics of the face images to be archived in the second pre-archive file; and determining the third similarity between each center of the offline archive and each center of the second pre-archive, and then determining the similarity between the offline archive and the second pre-archive according to the third similarity between each center of the offline archive and each center of the second pre-archive.
2. The method of claim 1, wherein the determining the peer profile in each first pre-archive based on the spatio-temporal information of the face image to be archived in each first pre-archive comprises:
determining the same-line times of any two first pre-archive files according to the space-time information of face images to be archived in the two first pre-archive files;
and determining the two first pre-archive files as the same-line files when the same-line times of the two first pre-archive files are determined to be larger than a third threshold value.
3. The method of claim 1, wherein the determining that an offline archive that matches the second pre-archive exists in the offline archive in the face image library comprises:
for any offline archive, determining the similarity of the offline archive and the second pre-archive according to the third similarity of the class center of the offline archive and the class center of the second pre-archive;
and if the similarity between the offline archive and the second pre-archive is greater than or equal to a fourth threshold value, determining that the offline archive matched with the second pre-archive exists in the offline archive in the face image library.
4. An archival device, comprising:
the acquisition module is used for acquiring a plurality of face images to be archived and space-time information of the face images to be archived in a preset period, wherein the space-time information comprises time information and space information;
the clustering module is used for clustering the face images to be archived to generate first pre-archiving files, wherein the similarity between any face image in any first pre-archiving file and any face image in other first pre-archiving files is smaller than a first threshold value;
the analysis module is used for determining the same-row files in each first pre-archive file according to the space-time information of the face images to be archived in each first pre-archive file;
the merging module is used for merging the same-row files to generate a second pre-archive file when the second similarity between the same-row files is determined to be larger than a second threshold value;
the archiving module is used for classifying the second pre-archived file into the matched offline file when determining that the offline file matched with the second pre-archived file exists in the face image library, wherein the face image library comprises at least one offline file, and the offline file is the file archived before the preset period;
the merging module is specifically configured to:
for a first synchronous file in a plurality of synchronous files, the first synchronous file is any synchronous file in the plurality of synchronous files, and according to the similarity between the class center of the first synchronous file and the class center of a second synchronous file, the second similarity between the first synchronous file and the second synchronous file is determined, wherein the second synchronous file is any synchronous file in the plurality of synchronous files except the first synchronous file;
if the second similarity of the first and second parallel files is greater than a second threshold, merging the first and second parallel files to generate a second pre-archive file;
the archiving module is used for, when determining that the offline archive matched with the second pre-archived archive exists in the face image library:
the class center of the offline file is one, and the class center is a face image with highest image quality in the offline file; the class center of the second pre-archive file is one, and the class center is the face image to be archived with the highest image quality in the second pre-archive file;
the off-line archives comprise a plurality of class centers, and the class centers of the off-line archives are determined according to the image quality and the image characteristics of the face images in the off-line archives; the class centers of the second pre-archive file are multiple, and the class centers of the second pre-archive file are determined according to the image quality and the image characteristics of the face images to be archived in the second pre-archive file; and determining the third similarity between each center of the offline archive and each center of the second pre-archive, and then determining the similarity between the offline archive and the second pre-archive according to the third similarity between each center of the offline archive and each center of the second pre-archive.
5. The apparatus of claim 4, wherein the analysis module is specifically configured to:
determining the same-line times of any two first pre-archive files according to the space-time information of face images to be archived in the two first pre-archive files;
and determining the two first pre-archive files as the same-line files when the same-line times of the two first pre-archive files are determined to be larger than a third threshold value.
6. The apparatus of claim 4, wherein the archiving module is specifically configured to:
for any offline archive, determining the similarity of the offline archive and the second pre-archive according to the third similarity of the class center of the offline archive and the class center of the second pre-archive;
and if the similarity between the offline archive and the second pre-archive is greater than or equal to a fourth threshold value, determining that the offline archive matched with the second pre-archive exists in the offline archive in the face image library.
7. An archiving device comprising at least one processing unit, and at least one storage unit, wherein,
the storage unit stores a computer program which, when executed by the processing unit, causes the processing unit to perform the steps of the method of any of claims 1 to 3.
8. A computer readable medium, characterized in that it stores a computer program executable by an archiving device, which program, when run on the archiving device, causes the archiving device to perform the steps of the method of any one of claims 1-3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811624049.9A CN109740004B (en) | 2018-12-28 | 2018-12-28 | Filing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811624049.9A CN109740004B (en) | 2018-12-28 | 2018-12-28 | Filing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109740004A CN109740004A (en) | 2019-05-10 |
| CN109740004B true CN109740004B (en) | 2023-07-11 |
Family
ID=66361853
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811624049.9A Active CN109740004B (en) | 2018-12-28 | 2018-12-28 | Filing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109740004B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111368867B (en) * | 2019-06-26 | 2023-09-05 | 杭州海康威视系统技术有限公司 | File classifying method and system and computer readable storage medium |
| CN110348347A (en) * | 2019-06-28 | 2019-10-18 | 深圳市商汤科技有限公司 | A kind of information processing method and device, storage medium |
| CN110413811A (en) * | 2019-08-05 | 2019-11-05 | 北京深醒科技有限公司 | A kind of across channel polymerization in passerby library based on recognition of face |
| CN110750670B (en) * | 2019-09-05 | 2022-04-19 | 北京旷视科技有限公司 | Stranger monitoring method, device and system and storage medium |
| CN111026920A (en) * | 2019-12-17 | 2020-04-17 | 深圳云天励飞技术有限公司 | File merging method and device, electronic equipment and storage medium |
| CN111309946B (en) * | 2020-02-10 | 2023-04-07 | 浙江大华技术股份有限公司 | Established file optimization method and device |
| CN113127572B (en) * | 2019-12-31 | 2023-03-03 | 深圳云天励飞技术有限公司 | Archive merging method, device, equipment and computer readable storage medium |
| CN113127712B (en) * | 2019-12-31 | 2024-06-07 | 深圳云天励飞技术有限公司 | Filing method and device |
| CN112487221A (en) * | 2020-11-04 | 2021-03-12 | 北京澎思科技有限公司 | Image filing method and device, electronic device and storage medium |
| CN115017359A (en) * | 2022-05-27 | 2022-09-06 | 浙江大华技术股份有限公司 | Method and device for searching picture and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140074790A1 (en) * | 2012-09-12 | 2014-03-13 | International Business Machines Corporation | Using a metadata image of a file system and archive instance to restore data objects in the file system |
| CN106791708A (en) * | 2017-02-07 | 2017-05-31 | 深圳云天励飞技术有限公司 | A kind of method for processing video frequency and device |
| CN108664920A (en) * | 2018-05-10 | 2018-10-16 | 深圳市深网视界科技有限公司 | A kind of cascade face cluster method and apparatus extensive in real time |
| CN108897777A (en) * | 2018-06-01 | 2018-11-27 | 深圳市商汤科技有限公司 | Target object method for tracing and device, electronic equipment and storage medium |
-
2018
- 2018-12-28 CN CN201811624049.9A patent/CN109740004B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140074790A1 (en) * | 2012-09-12 | 2014-03-13 | International Business Machines Corporation | Using a metadata image of a file system and archive instance to restore data objects in the file system |
| CN106791708A (en) * | 2017-02-07 | 2017-05-31 | 深圳云天励飞技术有限公司 | A kind of method for processing video frequency and device |
| CN108664920A (en) * | 2018-05-10 | 2018-10-16 | 深圳市深网视界科技有限公司 | A kind of cascade face cluster method and apparatus extensive in real time |
| CN108897777A (en) * | 2018-06-01 | 2018-11-27 | 深圳市商汤科技有限公司 | Target object method for tracing and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109740004A (en) | 2019-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109740004B (en) | Filing method and device | |
| CN109783685B (en) | Query method and device | |
| CN109710780B (en) | Archiving method and device | |
| US11301690B2 (en) | Multi-temporal scale analytics | |
| CN109800664B (en) | Method and device for determining passersby track | |
| TWI740537B (en) | Information processing method, device and storage medium thereof | |
| CN109740003B (en) | Filing method and device | |
| CN109800318B (en) | Filing method and device | |
| US20210382933A1 (en) | Method and device for archive application, and storage medium | |
| CN109784220B (en) | Method and device for determining passerby track | |
| CN109800329B (en) | Monitoring method and device | |
| CN109857891A (en) | A kind of querying method and device | |
| JP2022518469A (en) | Information processing methods and devices, storage media | |
| CN109815370A (en) | A kind of archiving method and device | |
| CN110659391A (en) | Video detection method and device | |
| KR102028930B1 (en) | method of providing categorized video processing for moving objects based on AI learning using moving information of objects | |
| CN110930434A (en) | Target object tracking method and device, storage medium and computer equipment | |
| US20210319226A1 (en) | Face clustering in video streams | |
| CN111177469A (en) | Face retrieval method and face retrieval device | |
| Khan et al. | Blockchain-enabled deep semantic video-to-video summarization for IoT devices | |
| CN109783663B (en) | Archiving method and device | |
| CN112163503A (en) | Method, system, storage medium and equipment for generating insensitive track of personnel in case handling area | |
| CN109815369B (en) | Filing method and device | |
| US9275140B2 (en) | Method of optimizing the search for a scene on the basis of a stream of images archived in a video database | |
| CN105320704B (en) | Trans-regional similar vehicle search method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |