WO2024022450A1 - Scene adaptability improvement method and apparatus for object detection, and object detection system - Google Patents

Scene adaptability improvement method and apparatus for object detection, and object detection system Download PDF

Info

Publication number
WO2024022450A1
WO2024022450A1 PCT/CN2023/109613 CN2023109613W WO2024022450A1 WO 2024022450 A1 WO2024022450 A1 WO 2024022450A1 CN 2023109613 W CN2023109613 W CN 2023109613W WO 2024022450 A1 WO2024022450 A1 WO 2024022450A1
Authority
WO
WIPO (PCT)
Prior art keywords
feature
similarity
target
detection
target data
Prior art date
Application number
PCT/CN2023/109613
Other languages
French (fr)
Chinese (zh)
Inventor
赵鑫
Original Assignee
杭州海康威视数字技术股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 杭州海康威视数字技术股份有限公司 filed Critical 杭州海康威视数字技术股份有限公司
Publication of WO2024022450A1 publication Critical patent/WO2024022450A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G06V20/53Recognition of crowd images, e.g. recognition of crowd congestion
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/761Proximity, similarity or dissimilarity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/103Static body considered as a whole, e.g. static pedestrian or occupant recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07Target detection

Definitions

  • the present invention relates to the field of target detection in security, and in particular, to a method, device, and target detection system for improving scene adaptability of target detection.
  • image-based target detection technology is used in more and more application scenarios, such as security, industrial environment monitoring, etc.
  • the monitored status is usually reflected based on the detection results of the target data.
  • the detection results meet the preset conditions, such as when the category and confidence level of the detected target meet the preset conditions, then Trigger alarms and other prompts.
  • the present invention provides a method, a device, and a target detection system for improving the scene adaptability of target detection to improve the adaptability of target detection to application scenarios and reduce false negatives and/or false positives.
  • a first aspect of the present invention provides a method for improving scene adaptability of target detection, which method includes:
  • the feature library is a feature set of target data calibrated according to whether the detection result is a false positive or a false negative;
  • the detection threshold bound to each matched feature is adjusted according to the matching degree between the matched feature and the target feature of the target data within the preset range.
  • a second aspect of the present invention provides a device for improving scene adaptability of target detection.
  • the device includes:
  • the target detection module is used to obtain the detection results of the current target data and extract target features from the current target data
  • a feature matching module used to match each target feature with each feature in the feature library, where the feature library is a feature set of target data calibrated according to whether the detection result is a false positive or a false negative;
  • a comparison module used to compare the detection results with the detection threshold bound to the matching feature in the feature library
  • a determination module used to determine the processing of the detection result according to the comparison result
  • a threshold adjustment module is configured to adjust the detection threshold bound to each matched feature according to the matching degree between the matched feature and the target feature of the target data within the preset range.
  • a third aspect of the present invention provides a target detection system, including the device for improving scene adaptability of target detection.
  • This application provides a method for improving the scene adaptability of target detection.
  • the detection result is determined by comparing the matching degree between the target feature and each feature in a specific feature library and the detection threshold bound to each feature in the feature library. This allows the feature data in the feature database to be fully utilized, and the granularity of the detection threshold is more delicate.
  • the detection threshold can be adjusted adaptively to the target data, which is conducive to improving the adaptability of the detection threshold to the scene, thereby improving the target detection scene. Adaptability helps reduce false negatives and false positives.
  • Figure 1 is a flow chart of a method for improving scene adaptability of target detection
  • Figure 2 is another schematic flowchart of a method for improving scene adaptability of target detection according to an embodiment of the present application
  • Figure 3a is a schematic diagram of the first similarity matrix and the first similarity threshold
  • Figure 3b is a schematic diagram of the second similarity matrix and the second similarity threshold
  • Figure 4 is a schematic flow chart of similarity threshold update for feature binding
  • Figure 5 is another flow diagram of a method for improving scene adaptability of target detection
  • Figure 6 is another schematic flow chart of similarity threshold update for feature binding
  • Figure 7 is a schematic diagram of a device for improving scene adaptability of target detection
  • Figure 8 is another schematic diagram of a device for improving scene adaptability of target detection.
  • the applicant's research found that false positives and false negatives in target detection results are particularly related to detection thresholds.
  • the existing detection thresholds are generated by setting false positive rates, for example, based on false positive rates of 1/100000, 1/1000000, etc. Generate detection threshold.
  • the resulting false positive rate is often based on the vendor's own test set, which has test target data in many different scenarios, but does not produce a separate false positive rate value for each usage scenario.
  • this application provides a method for improving scene adaptability of target detection, screening out targets with high frequency of false positives and/or false negatives, and adaptively generating and matching images for each feature in the false positive feature library and false negative feature library.
  • the target data matches the detection threshold, thereby utilizing the feature library at a smaller granularity and improving the scene adaptability of target detection.
  • FIG. 1 is a schematic flow chart of a method for improving scene adaptability of target detection.
  • the method includes: on the target detection device side,
  • Step S101 Obtain the detection result of the current target data.
  • Step S102 Extract target features from the current target data.
  • Step S103 Determine the matching degree between each target feature and each feature in the feature database.
  • the matching degree can be determined by similarity or Euclidean distance.
  • Step S104 Compare each matching degree with the detection threshold bound by the matching feature in the feature library used to determine the matching degree.
  • Step S105 Determine the processing of the detection result according to the comparison result.
  • the feature library is a feature set of target data calibrated according to whether the detection result is a false positive or a false negative.
  • the detection threshold bound to each matched feature is adjusted according to the matching degree between the matched feature and the target feature of the target data within the preset range.
  • the matching degree can be measured by similarity, or by parameters such as Euclidean distance.
  • the detection threshold in this application can also be regarded as a match. degree threshold.
  • the detection threshold may refer to the similarity threshold; when the matching degree is measured by Euclidean distance, the detection threshold may refer to the distance threshold.
  • the embodiments of the present application use false positives and/or missed target data to establish a feature database, and set a detection threshold for each feature in the feature database. In this way, each feature is bound to a different detection threshold, thereby improving detection efficiency.
  • the adaptability of the threshold to the scene thereby improves the scene adaptability of the detection results obtained based on the detection threshold.
  • the matching degree of each target feature and each feature in the feature database can be determined by calculating the similarity between each target feature and each feature in the feature database.
  • comparing each matching degree with the detection threshold bound by the matching feature in the feature library used to determine the matching degree may include: for each calculated similarity, Compare with the similarity threshold; where the similarity threshold is the similarity threshold bound to the feature used for the similarity calculation in the feature library. Determining the processing of the detection result according to the comparison result may include: correcting the detection result according to the comparison result.
  • the feature library may include features used to characterize the first target data whose detection result is a false positive.
  • the first feature library of the collection set may also include: a second feature library used to characterize the feature set of the second target data whose detection result is false negative. The correction of detection results under different circumstances will be described in detail below.
  • FIG. 2 is a schematic flow chart of a method for improving scene adaptability of target detection according to an embodiment of the present application.
  • the method includes:
  • Step S201 Obtain the first feature database and the second feature database.
  • the first feature database includes a false positive feature set, which is used to characterize the first target data whose detection result is a false positive
  • the second feature database includes a false negative feature set, which is used to characterize the second target data whose detection result is a false negative.
  • the first feature database and the second feature database can be established as follows:
  • feature extraction is performed respectively. For example, a deep learning model is used for feature extraction, and the extracted false positive features are used as features in the first feature library, and the extracted false negatives are used as features in the first feature library. Features as features in the second feature library.
  • the missed human body For example, if a human body is missed multiple times in a scene, and the missed human body has obvious and similar characteristics, such as a human body wearing the same uniform, such as an oil worker's uniform, and always in the same special posture, such as walking half-bent, then Features are extracted from the missed human body data.
  • the extracted missed features include clothing features, posture features and other features. These features can be stored in the second feature library.
  • the security system can use the perimeter algorithm to filter out high-frequency false positives and false negatives detection results to obtain target data for establishing a feature database.
  • the above-mentioned first feature database and second feature database can be updated according to at least one of time and quantity as an update trigger condition.
  • the first feature database and second feature database are updated regularly.
  • the cleanliness of the feature data in the feature database is improved.
  • Step S202 obtain the current detection result of the current target data, and determine whether the detection result of the target data that triggers the alarm rule in the security system is determined to be a positive alarm or a false alarm;
  • steps S205 to S206 are executed.
  • Step S203 Calculate the first similarity between each target feature of the current target data and each first feature in the first feature database to obtain each first similarity.
  • feature extraction is performed on the target data corresponding to the positive alarm.
  • a deep learning algorithm is used for feature extraction, so as to obtain at least For more than one target feature, calculate the similarity between each target feature and each first feature in the first feature library to obtain each first similarity, so as to compare each target feature with each first feature in the first feature library. The first feature is matched.
  • Step S204 For each first similarity, determine whether the first similarity is greater than the first similarity threshold bound to the first feature used for the first similarity calculation.
  • the detection result is determined to be a false alarm, the detection result is corrected to a false alarm, and the alarm is no longer triggered to reduce false alarms.
  • the detection result is determined to be positive and an alarm prompt is triggered.
  • Step S205 Calculate the second similarity between each target feature of the current target data and each second feature in the second feature database to obtain each second similarity. In order to match each target feature with each second feature in the second feature library.
  • Step S206 For each second similarity, determine whether the second similarity is greater than the second similarity threshold bound to the second feature used for the second similarity calculation.
  • the detection result is corrected to a positive report and an alarm prompt is triggered. Otherwise, the detection result is determined to be a false alarm, and the alarm will no longer be triggered to reduce false alarms.
  • the matching degree can be compared with the detection threshold bound to the matching feature in the feature library used to determine the matching degree, and the processing logic of the detection result can be determined based on the comparison result.
  • the alarm process of these target data can be terminated to reduce false positives; when the extracted target features are highly similar to the false negative database, the alarm process can be These target data are re-alarmed to increase the detection rate, which is beneficial to improving the scene adaptability of target detection.
  • the target features extracted from the target feature data 1 include: target feature 1, target feature 2,..., target feature n; the first feature library includes: first feature 1, first feature 2,..., first feature i; the second feature library includes: second feature 1, second feature 2,..., second feature j; the first feature Feature 1 is bound to the similarity threshold 1, the first feature 2 is bound to the similarity threshold 2,..., the first feature i is bound to the similarity threshold i; the second feature 2 is bound to the similarity threshold 1, and the second feature 2 is bound Similarity threshold 2,..., the second feature j is bound to similarity threshold j.
  • a human body image is used as target data 1.
  • the target features extracted from the target data 1 include eye features, facial features, and body features.
  • the first feature in the first feature library includes eye features, facial features, and body features. etc. Among them, the eye features are bound with an eye similarity threshold of 1, the facial features are bound with a facial similarity threshold of 2, and the body features are bound with a body similarity threshold of 3.
  • the second feature in the second feature library Features include eye features, facial features, and body features. Among them, eye features are bound with an eye similarity threshold of 1', facial features are bound with a facial similarity threshold of 2', and body features are bound with a body similarity threshold of 3. '.
  • FIG. 3a is a schematic diagram of the first similarity matrix and the first similarity threshold.
  • the matrix Cin in row i and column n is the first similarity matrix
  • the matrix Cin in row i and column n is the first similarity matrix.
  • the element is the first similarity between the first feature i and the target feature n.
  • Each row in the matrix Cin is bound to a first similarity threshold, indicating the first similarity threshold bound to each first feature.
  • row 1 is bound to the first similarity threshold 1, that is, the first feature 1 is bound to the first similarity threshold 1
  • row 2 is bound to the first similarity threshold 2, that is, the first feature 2 is bound to the first Similarity threshold 2
  • the i-th row is bound to the first similarity threshold i, that is, the first feature i is bound to the first similarity threshold i.
  • the target feature corresponding to the element is the same as the first similarity result corresponding to the element.
  • the feature similarity is high and the matching degree is large, so the detection result is a false positive; if there is no first similarity result in the row element that is greater than the first similarity threshold bound to the row, that is, the row If the elements are all smaller than the first similarity threshold bound to the row, it means that the target feature corresponding to the element has a low similarity with the first feature, so the detection result is not a false positive.
  • target feature 1 has j second similarity results, then there are j ⁇ n second similarity results for the n target features, It can be represented by a matrix Cjn with j rows and n columns, where the elements in the j-th row and n-th column in the matrix are the second similarity between the second feature j and the target feature n; each row in the matrix is bound to the second similarity threshold.
  • Figure 3b is a schematic diagram of the second similarity matrix and the second similarity threshold.
  • the matrix Cjn in the jth row and nth column is the second similarity matrix.
  • the jth row and nth column in the matrix Cjn The element is the second similarity between the second feature j and the target feature n.
  • Each row in the matrix Cjn is bound to a second similarity threshold, indicating the second similarity threshold bound to each second feature.
  • row 1 is bound to the second similarity threshold 1, that is, the second feature 1 is bound to the second similarity threshold 1
  • row 2 is bound to the second similarity threshold 2, that is, the second feature 2 is bound to the second
  • the similarity threshold is 2
  • the j-th row is bound to the second similarity threshold j, that is, the second feature j is bound to the second similarity threshold j.
  • the target feature corresponding to the element is the same as the second similarity result corresponding to the element.
  • the feature similarity is high and the matching degree is large, so the detection result is a false negative; if there is no second similarity result in the row element that is greater than the second similarity threshold bound to the row, that is, the row If the elements are all smaller than the second similarity threshold bound to the row, it means that the target feature corresponding to the element has a low similarity with the second feature, so the detection result is not a false negative.
  • the similarity thresholds bound to the features in the above feature database are generated through an adaptive method.
  • the similarity thresholds bound to each feature in these feature databases are different, and each similarity threshold changes with the matched feature. It is adjusted based on the degree of matching with the target characteristics of the target data within the preset range, wherein the target data within the preset range includes target data within a set second time period and/or a set second quantity. Considering that the target data in the scenario changes with time, business characteristics and other factors, the similarity threshold bound to the feature in the feature library will be updated when the update triggering conditions are met.
  • FIG 4 is a schematic diagram of updating the similarity threshold of feature binding.
  • the update conditions include: meeting at least one of the set update time, the set update frequency, and the feature database being updated.
  • the update process includes: for any feature in the feature database,
  • Step S401 Calculate the similarity between the feature and each target feature of all target data within the preset range.
  • all target data are target data within a set time threshold and/or within a set quantity threshold.
  • the target features of the target data can also be used to calibrate the detection results, so as to obtain a feature library.
  • Step S402 Select the maximum similarity from all similarity results of the feature.
  • Step S403 Adjust the similarity threshold of the feature binding based on the maximum similarity. For example, update the similarity threshold of the feature binding to be greater than or equal to the sum of the maximum similarity and the amount of redundancy.
  • the first similarity threshold bound to the first feature is obtained by calculating the similarity between the first feature and the target feature of the third target data, where the third target data is within the first preset range
  • the first preset range is the set third time period and/or the set third quantity.
  • the first similarity threshold floats around the maximum similarity sim1_max between the first feature and the target feature, and the floating value depends on the specific correction strategy adopted.
  • the first similarity threshold needs to satisfy thr1 ⁇ sim1_max+gap1, where thr1 is the first similarity threshold and gap1 is the first redundancy amount, which is used to represent the floating maximum similarity based on the first feature. value.
  • the second similarity threshold bound to the second feature is obtained by calculating the similarity between the second feature and the target feature of the fourth target data, where the fourth target data is within the second preset range and the detection result is For false alarm data, the second preset range is the set fourth time period and/or the set fourth quantity.
  • the second similarity threshold floats around the maximum similarity sim2_max between the target feature and the second feature, and the floating value depends on the specific correction strategy adopted. As an example, the second similarity threshold needs to satisfy thr2 ⁇ sim2_max+gap2, where thr2 is the second similarity threshold and gap2 is the second redundancy amount, used to characterize the maximum similarity based on the second feature correspondence. Floating value.
  • This embodiment helps improve the scene adaptability of the detection results by adaptively adjusting the detection threshold bound to each feature in the feature library, and can solve the problem of missed negatives and false positives in the existing security system, especially For repetitive omissions and false positives, the detection results can be corrected by using the matching degree of the target features of the target data and the feature library and the detection threshold comparison results, which will help improve the accuracy and reliability of the detection results and reduce the risk of False negatives and false positives.
  • the method for improving scene adaptability of target detection provided by the embodiment of the present application can be shown in Figure 5: judging whether the current target data needs to alarm based on the inherent method, where the inherent method refers to: based on the detection result of the target data It reflects the monitored status.
  • the detection results meet the preset conditions, for example, when the category and confidence level of the detected target reach the preset conditions, an alarm or other prompts will be triggered.
  • the target features of the current target data are extracted, and the target features are compared with the typical false alarm feature library (i.e. Perform feature similarity calculation on each feature in the aforementioned first feature database) to obtain each first similarity, that is, execute the aforementioned step S203.
  • the typical false alarm feature library i.e. Perform feature similarity calculation on each feature in the aforementioned first feature database
  • step S204 For each first similarity, compare the first similarity with the first similarity threshold bound to the first feature used for the first similarity calculation, and determine whether the first similarity is greater than the first similarity used for the first similarity calculation.
  • the first similarity threshold bound to the first feature calculated by the first similarity If yes, then no alarm will be issued; if not, then alarm will be issued. That is, the aforementioned step S204 is executed.
  • the target features of the current target data are extracted, and the target features are compared with those in the typical false alarm feature library (i.e., the aforementioned first feature library) Feature similarity calculation is performed on each first feature to obtain each first similarity. And for each first similarity, compare the first similarity with the first similarity threshold bound to the first feature used for the first similarity calculation, and determine whether the first similarity is greater than the first similarity used for the first similarity calculation.
  • the target features of the current target data are extracted, and the target features are compared with those in the typical false negative feature library (i.e., the aforementioned second feature library) Feature similarity calculation is performed on each second feature to obtain each second similarity. And for each second similarity, compare the second similarity with the second similarity threshold bound to the second feature used for the second similarity calculation, and determine whether the second similarity is greater than the second similarity used for the second similarity calculation.
  • the second similarity threshold bound to the second feature calculated by the second similarity; if yes, an alarm will be issued; if not, no alarm will be issued. That is, the aforementioned steps S205 to S206 are executed.
  • the update method of the similarity threshold of the feature binding in the feature library can be shown in Figure 6: when the update condition is met, the update of the similarity threshold of the feature binding in the feature library is triggered, where the update condition includes: satisfying the setting At least one of the update time, the set update frequency, and the feature database being updated.
  • the update process includes: for any feature in the typical feature library T, calculate the similarity between the feature and each target feature of all typical positive or false positive target data in the time period P (i.e., P time length), and calculate from Select the maximum similarity among all similarity results to implement the maximum similarity (MaxSim) calculation.
  • the typical feature library is a typical false positive feature library (i.e., the aforementioned first feature library)
  • calculate the similarity between the feature and each target feature of all typical positive target data within the time period P i.e., P time length
  • the typical feature library is a typical false negative feature library (i.e., the aforementioned second feature library)
  • calculate this feature and each target feature of all typical false positive target data within the time period P i.e., P time length
  • the similarity threshold THRt1 of the feature binding in the typical feature library T is adjusted to THRt2.
  • THRt2 should satisfy THRt2 ⁇ MaxSim+Gap to realize the adjustment of the similarity threshold.
  • THRt2 is the similarity threshold of feature binding in the adjusted typical feature library T
  • MaxSim is the maximum similarity corresponding to the features in the typical feature library
  • Gap is used to represent the floating value based on the maximum similarity corresponding to the features in the typical feature library. value.
  • the above update process is the aforementioned steps S401 to S403.
  • FIG. 7 is a schematic diagram of a device for improving scene adaptability of target detection.
  • the device includes:
  • the target detection module is used to extract target features from the current target data and obtain the detection results of the current target data
  • Feature matching module used to match each target feature with each feature in the feature library
  • a comparison module used to compare the detection results with the detection threshold bound to the matching feature in the feature library
  • a determination module used to determine the processing of the detection result according to the comparison result
  • a threshold adjustment module configured to adjust the detection threshold bound to each matched feature according to the matching degree between the matched feature and the target feature of the target data within the preset range;
  • the feature library is a feature set of target data calibrated according to whether the detection result is a false positive or a false negative;
  • the threshold adjustment module is also configured to adjust the similarity threshold bound to each feature according to the maximum similarity corresponding to each feature, and the maximum similarity corresponding to each feature is: The maximum value of similarity between the feature and the target feature of the target data within the preset range.
  • the feature matching module includes:
  • the first feature matching submodule is used to calculate the similarity between each target feature and each first feature in the first feature library to obtain each first similarity when the detection result is positive. ;
  • the second feature matching submodule calculates the similarity between each target feature and each second feature in the second feature library to obtain each second similarity when the detection result is a false positive.
  • the comparison module includes:
  • the first comparison sub-module is used to compare each calculated first similarity with the first similarity Compare the first similarity threshold bound to the calculated first feature;
  • the second comparison sub-module is configured to compare each calculated second similarity with a second similarity threshold bound to the second feature used for the second similarity calculation.
  • the determination module includes:
  • a first determination sub-module configured to correct the detection result as an error when any calculated first similarity is greater than the first similarity threshold bound to the first feature used for the first similarity calculation. reported, otherwise, the detection result remains positive;
  • the second determination sub-module is used to correct the detection result to positive when any calculated second similarity is greater than the second similarity threshold bound to the second feature used for the second similarity calculation. Otherwise, the detection result remains a false positive.
  • the threshold adjustment module includes:
  • the first similarity threshold adjustment sub-module is used to adjust the first similarity threshold bound to each first feature according to the maximum similarity corresponding to the first feature, and the first similarity threshold corresponding to the first feature is
  • the maximum similarity is: the maximum value of the similarity between the first feature and the target feature of the third target data whose detection result is positive within the first preset range;
  • the second similarity threshold adjustment sub-module is used to adjust the second similarity threshold bound to each second feature according to the maximum second similarity corresponding to the second feature.
  • the corresponding maximum similarity is: the maximum value of similarities between the second feature and the target feature of the fourth target data whose detection result is a false alarm within the second preset range.
  • the device also includes:
  • the feature database management module is used to collect target data within a set first time period and/or set a first quantity, and calibrate the collected target data;
  • feature extraction is performed, and the extracted false positive features are used as features in the first feature library, and the extracted false negative features are used as features in the second feature library.
  • FIG. 8 is another schematic diagram of a device for improving scene adaptability of target detection.
  • the device includes a memory and a processor, the memory stores a computer program, and the processor is configured to execute the steps of the computer program to implement the method of improving scene adaptability of target detection in the present application.
  • the memory may include random access memory (Random Access Memory, RAM) or non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk memory.
  • RAM Random Access Memory
  • NVM Non-Volatile Memory
  • the memory may also be at least one storage device located far away from the aforementioned processor.
  • the above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (Network Processor, NP), etc.; it can also be a digital signal processor (Digital Signal Processing, DSP), special integrated Circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
  • CPU central processing unit
  • NP Network Processor
  • DSP Digital Signal Processing
  • ASIC Application Specific Integrated Circuit
  • FPGA Field-Programmable Gate Array
  • Embodiments of the present invention also provide a computer-readable storage medium.
  • a computer program is stored in the storage medium.
  • the steps of the method for improving scene adaptability of target detection are implemented.
  • the description is relatively simple. For relevant details, please refer to the partial description of the method embodiment.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Image Analysis (AREA)

Abstract

Disclosed in the present application are a scene adaptability improvement method and apparatus for object detection, and an object detection system. The method comprises: obtaining a detection result of current object data; performing object feature extraction on the current object data; determining a degree of matching between each object feature and each feature in a feature library; comparing each degree of matching with a detection threshold bound with a matched feature, in the feature library, used for determining the degree of matching; and determining processing of the detection result according to the comparison result, wherein the feature library is a feature set of object data calibrated according to the detection result which indicates a false alarm or a missing alarm; and the detection threshold bound with each matched feature is adjusted along with a degree of matching between the matched feature and the object feature of the object data within a preset range. The present application facilitates the reduction of missing alarms and false alarms, and has high scene adaptability.

Description

目标检测的场景适应性提高方法、装置、目标检测系统Method, device, and target detection system for improving scene adaptability of target detection
本申请要求于2022年7月27日提交中国专利局、申请号为202210889349.X发明名称为“目标检测的场景适应性提高方法、装置、目标检测系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application submitted to the China Patent Office on July 27, 2022, with the application number 202210889349. The contents are incorporated into this application by reference.
技术领域Technical field
本发明涉及安防的目标检测领域,特别地,涉及一种目标检测的场景适应性提高方法、装置、目标检测系统。The present invention relates to the field of target detection in security, and in particular, to a method, device, and target detection system for improving scene adaptability of target detection.
背景技术Background technique
随着基于图像的目标检测技术的发展,越来越多的应用场景中采用了基于图像的目标检测的技术手段,例如,安防、工业环境监测等。例如,在实际应用中,通常根据目标数据的检测结果所来反映被监测状况,当检测结果满足预设的条件时,比如被检测出的目标的类别、置信度达到预设的条件时,则触发报警等提示。With the development of image-based target detection technology, image-based target detection technology is used in more and more application scenarios, such as security, industrial environment monitoring, etc. For example, in practical applications, the monitored status is usually reflected based on the detection results of the target data. When the detection results meet the preset conditions, such as when the category and confidence level of the detected target meet the preset conditions, then Trigger alarms and other prompts.
为提高报警触发的准确性和可靠性,避免漏报和误报,目标检测对应用场景具有更佳的适应性成为迫切需要解决的问题。In order to improve the accuracy and reliability of alarm triggering and avoid missed and false alarms, it has become an urgent problem to solve the problem of better adaptability of target detection to application scenarios.
发明内容Contents of the invention
本发明提供了一种目标检测的场景适应性提高方法、装置、目标检测系统,以提高目标检测对应用场景的适应性,降低漏报和/或误报。The present invention provides a method, a device, and a target detection system for improving the scene adaptability of target detection to improve the adaptability of target detection to application scenarios and reduce false negatives and/or false positives.
本发明第一方面提供了一种目标检测的场景适应性提高方法,该方法包括:A first aspect of the present invention provides a method for improving scene adaptability of target detection, which method includes:
获取当前目标数据的检测结果;Get the detection results of the current target data;
对当前目标数据进行目标特征提取;Extract target features from the current target data;
确定每个目标特征与特征库中每个特征的匹配度;Determine the matching degree of each target feature with each feature in the feature library;
将每个匹配度与特征库中用于确定该匹配度的被匹配特征所绑定的检测阈值进行比较;Compare each matching degree with the detection threshold bound to the matched feature in the feature library used to determine the matching degree;
根据比较结果确定对所述检测结果的处理;Determine the processing of the detection results based on the comparison results;
其中, in,
所述特征库为按照检测结果为误报或漏报而标定的目标数据的特征集合;The feature library is a feature set of target data calibrated according to whether the detection result is a false positive or a false negative;
每个所述被匹配特征所绑定的检测阈值,随着该被匹配特征与预设范围内目标数据的目标特征之间匹配度而调整。The detection threshold bound to each matched feature is adjusted according to the matching degree between the matched feature and the target feature of the target data within the preset range.
本发明第二方面提供了一种用于提高目标检测的场景适应性的装置,该装置包括:A second aspect of the present invention provides a device for improving scene adaptability of target detection. The device includes:
目标检测模块,用于获取当前目标数据的检测结果,并对当前目标数据进行目标特征提取;The target detection module is used to obtain the detection results of the current target data and extract target features from the current target data;
特征匹配模块,用于将每个目标特征与特征库中每个特征进行匹配,其中,所述特征库为按照检测结果为误报或漏报而标定的目标数据的特征集合;A feature matching module, used to match each target feature with each feature in the feature library, where the feature library is a feature set of target data calibrated according to whether the detection result is a false positive or a false negative;
比较模块,用于将所述检测结果与特征库中被匹配特征所绑定的检测阈值进行比较;A comparison module, used to compare the detection results with the detection threshold bound to the matching feature in the feature library;
确定模块,用于根据比较结果确定对所述检测结果的处理;A determination module, used to determine the processing of the detection result according to the comparison result;
阈值调整模块,用于对每个所述被匹配特征所绑定的检测阈值,随着该被匹配特征与预设范围内目标数据的目标特征之间匹配度而调整。A threshold adjustment module is configured to adjust the detection threshold bound to each matched feature according to the matching degree between the matched feature and the target feature of the target data within the preset range.
本发明第三方面提供了一种目标检测系统,包括所述的用于提高目标检测的场景适应性的装置。A third aspect of the present invention provides a target detection system, including the device for improving scene adaptability of target detection.
本申请提供的一种目标检测的场景适应性提高方法,通过目标特征与特定特征库中每个特征的匹配度,与特征库中每个特征绑定的检测阈值的比较结果来确定检测结果,使得特征库中的特征数据被充分利用,检测阈值的粒度更为细腻,并且,可自适应于目标数据而调整的检测阈值,有利于提高检测阈值对场景适应性,从而提高了目标检测的场景适应性,有利于降低漏报和误报。This application provides a method for improving the scene adaptability of target detection. The detection result is determined by comparing the matching degree between the target feature and each feature in a specific feature library and the detection threshold bound to each feature in the feature library. This allows the feature data in the feature database to be fully utilized, and the granularity of the detection threshold is more delicate. Moreover, the detection threshold can be adjusted adaptively to the target data, which is conducive to improving the adaptability of the detection threshold to the scene, thereby improving the target detection scene. Adaptability helps reduce false negatives and false positives.
附图说明Description of drawings
此处所说明的附图用来提供对本申请的进一步理解,构成本申请的一部分,本申请的示意性实施例及其说明用于解释本申请,并不构成对本申请的不当限定。The drawings described here are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation of the present application.
图1为目标检测的场景适应性提高方法的一种流程示意图;Figure 1 is a flow chart of a method for improving scene adaptability of target detection;
图2为本申请实施例目标检测的场景适应性提高方法的另一种流程示意图; Figure 2 is another schematic flowchart of a method for improving scene adaptability of target detection according to an embodiment of the present application;
图3a为第一相似度矩阵以及第一相似度阈值的一种示意图;Figure 3a is a schematic diagram of the first similarity matrix and the first similarity threshold;
图3b为第二相似度矩阵以及第二相似度阈值的一种示意图;Figure 3b is a schematic diagram of the second similarity matrix and the second similarity threshold;
图4为特征绑定的相似度阈值更新的一种流程示意图;Figure 4 is a schematic flow chart of similarity threshold update for feature binding;
图5为目标检测的场景适应性提高方法的又一种流程示意图;;Figure 5 is another flow diagram of a method for improving scene adaptability of target detection;;
图6为特征绑定的相似度阈值更新的另一种流程示意图;Figure 6 is another schematic flow chart of similarity threshold update for feature binding;
图7为用于提高目标检测的场景适应性的装置的一种示意图;Figure 7 is a schematic diagram of a device for improving scene adaptability of target detection;
图8为用于提高目标检测的场景适应性的装置的另一种示意图。Figure 8 is another schematic diagram of a device for improving scene adaptability of target detection.
具体实施方式Detailed ways
为使本发明的目的、技术方案、及优点更加清楚明白,以下参照附图并举实施例,对本发明进一步详细说明。显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员所获得的所有其他实施例,都属于本发明保护的范围。In order to make the purpose, technical solution, and advantages of the present invention more clear, the present invention will be further described in detail below with reference to the accompanying drawings and examples. Obviously, the described embodiments are only some of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art fall within the scope of protection of the present invention.
为了使本申请的目的、技术手段和优点更加清楚明白,以下结合附图对本申请做进一步详细说明。In order to make the purpose, technical means and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings.
申请人研究发现,目标检测结果的误报、漏报与检测阈值特别相关,现有的检测阈值通过设定的误报率来产生,例如,按照1/100000,1/1000000等误报率来产生检测阈值。所产生的误报率往往基于供应商的自有测试集,该测试集拥有众多不同场景中的测试目标数据,但并非针对每个使用场景而产生单独的误报率值。在现实使用中,固定的单一使用场景与厂商的自测环境往往存在比较大的差距,仅仅根据预设的误报率进行检测阈值的产生,可能会存在检测阈值与实际的检测结果偏差较大的问题。The applicant's research found that false positives and false negatives in target detection results are particularly related to detection thresholds. The existing detection thresholds are generated by setting false positive rates, for example, based on false positive rates of 1/100000, 1/1000000, etc. Generate detection threshold. The resulting false positive rate is often based on the vendor's own test set, which has test target data in many different scenarios, but does not produce a separate false positive rate value for each usage scenario. In actual use, there is often a large gap between a fixed single usage scenario and the manufacturer's self-test environment. If the detection threshold is generated based only on the preset false alarm rate, there may be a large deviation between the detection threshold and the actual detection result. The problem.
有鉴于此,本申请提供目标检测的场景适应性提高方法,筛选出高频误报和/或漏报的目标,为误报特征库、漏报特征库中的每一个特征自适应地生成与目标数据匹配的检测阈值,从而更小粒度地利用特征库,提高目标检测的场景适应性。In view of this, this application provides a method for improving scene adaptability of target detection, screening out targets with high frequency of false positives and/or false negatives, and adaptively generating and matching images for each feature in the false positive feature library and false negative feature library. The target data matches the detection threshold, thereby utilizing the feature library at a smaller granularity and improving the scene adaptability of target detection.
参见图1所示,图1为目标检测的场景适应性提高方法的一种流程示意图。该方法包括:在目标检测设备侧,Refer to Figure 1, which is a schematic flow chart of a method for improving scene adaptability of target detection. The method includes: on the target detection device side,
步骤S101,获取当前目标数据的检测结果。Step S101: Obtain the detection result of the current target data.
步骤S102,对当前目标数据进行目标特征提取。 Step S102: Extract target features from the current target data.
步骤S103,确定每个目标特征与特征库中每个特征的匹配度。Step S103: Determine the matching degree between each target feature and each feature in the feature database.
其中,匹配度可以通过相似度,也可以通过欧式距离等来确定。Among them, the matching degree can be determined by similarity or Euclidean distance.
步骤S104,将每个匹配度与特征库中用于确定该匹配度的被匹配特征所绑定的检测阈值进行比较。Step S104: Compare each matching degree with the detection threshold bound by the matching feature in the feature library used to determine the matching degree.
步骤S105,根据比较结果确定对所述检测结果的处理。Step S105: Determine the processing of the detection result according to the comparison result.
其中,in,
所述特征库为按照检测结果为误报或漏报而标定的目标数据的特征集合。The feature library is a feature set of target data calibrated according to whether the detection result is a false positive or a false negative.
每个所述被匹配特征所绑定的检测阈值,随着该被匹配特征与预设范围内目标数据的目标特征之间匹配度而调整。The detection threshold bound to each matched feature is adjusted according to the matching degree between the matched feature and the target feature of the target data within the preset range.
具体的,匹配度可以通过相似度来衡量,也可以通过欧式距离等参数来衡量。且由于是将匹配度与确定该匹配度的被匹配特征所绑定的检测阈值比较,因此,检测阈值的形式应当与匹配度是相同的,因此,本申请中的检测阈值也可以视为匹配度阈值。示例性的,在匹配度是通过相似度进行衡量时,检测阈值可以指的是相似度阈值;在匹配度是通过欧氏距离进行衡量时,检测阈值可以指的是距离阈值。Specifically, the matching degree can be measured by similarity, or by parameters such as Euclidean distance. And since the matching degree is compared with the detection threshold bound to the matched feature that determines the matching degree, the form of the detection threshold should be the same as the matching degree. Therefore, the detection threshold in this application can also be regarded as a match. degree threshold. For example, when the matching degree is measured by similarity, the detection threshold may refer to the similarity threshold; when the matching degree is measured by Euclidean distance, the detection threshold may refer to the distance threshold.
本申请实施例利用误报和/或漏报的目标数据,建立特征库,对特征库的每一个特征分别设置一个检测阈值,这样,每个特征绑定有不同的检测阈值,从而提高了检测阈值对场景的自适应性,进而提高了基于检测阈值所得到的检测结果的场景适应性。The embodiments of the present application use false positives and/or missed target data to establish a feature database, and set a detection threshold for each feature in the feature database. In this way, each feature is bound to a different detection threshold, thereby improving detection efficiency. The adaptability of the threshold to the scene thereby improves the scene adaptability of the detection results obtained based on the detection threshold.
为便于理解本申请,以下以安防系统为例在进行说明,所应理解的是,本申请不仅仅适用于安防系统,对于工业应用中的利用目标检测的任何监测系统等也同样适用。In order to facilitate understanding of this application, the following description takes a security system as an example. It should be understood that this application is not only applicable to security systems, but is also applicable to any monitoring system that utilizes target detection in industrial applications.
在一种可能的实施例中,可以通过计算每个目标特征与特征库中每个特征的相似度来确定每个目标特征与特征库中每个特征的匹配度。在本实施例中,将每个匹配度与特征库中用于确定该匹配度的被匹配特征所绑定的检测阈值进行比较,可以包括:对于所计算的每个相似度,将该相似度与相似度阈值进行比较;其中,相似度阈值为特征库中用于该相似度计算的特征所绑定的相似度阈值。根据比较结果确定对所述检测结果的处理,可以包括:根据比较结果对检测结果进行修正。In a possible embodiment, the matching degree of each target feature and each feature in the feature database can be determined by calculating the similarity between each target feature and each feature in the feature database. In this embodiment, comparing each matching degree with the detection threshold bound by the matching feature in the feature library used to determine the matching degree may include: for each calculated similarity, Compare with the similarity threshold; where the similarity threshold is the similarity threshold bound to the feature used for the similarity calculation in the feature library. Determining the processing of the detection result according to the comparison result may include: correcting the detection result according to the comparison result.
具体的,特征库可以包括用于表征检测结果为误报的第一目标数据的特 征集合的第一特征库,也可以包括:用于表征检测结果为漏报的第二目标数据的特征集合的第二特征库。下面将对不同情况下对检测结果的修正进行详细说明。Specifically, the feature library may include features used to characterize the first target data whose detection result is a false positive. The first feature library of the collection set may also include: a second feature library used to characterize the feature set of the second target data whose detection result is false negative. The correction of detection results under different circumstances will be described in detail below.
参见图2所示,图2为本申请实施例目标检测的场景适应性提高方法的一种流程示意图。该方法包括:Refer to Figure 2, which is a schematic flow chart of a method for improving scene adaptability of target detection according to an embodiment of the present application. The method includes:
步骤S201,获取第一特征库和第二特征库。Step S201: Obtain the first feature database and the second feature database.
其中,第一特征库包括误报特征集合,用于表征检测结果为误报的第一目标数据的特征集合,第二特征库包括漏报特征集合,用于表征检测结果为漏报的第二目标数据的特征集合。The first feature database includes a false positive feature set, which is used to characterize the first target data whose detection result is a false positive, and the second feature database includes a false negative feature set, which is used to characterize the second target data whose detection result is a false negative. Feature collection of target data.
作为一种示例,第一特征数据库和第二特征数据库可以按照如下方式建立:As an example, the first feature database and the second feature database can be established as follows:
搜集设定第一时间段内和/或设定第一数量的目标数据,对所搜集的目标数据进行标定,例如,遍历所搜集的目标数据,判断目标数据的检测结果是否存在误报、或漏报,在目标数据中标定出存在误报、漏报的目标,并将存在误报、漏报的目标数据予以记录,Collect target data within a set first time period and/or set a first amount, and calibrate the collected target data. For example, traverse the collected target data to determine whether the detection result of the target data contains false positives, or False negatives: identify the targets with false positives and false negatives in the target data, and record the target data with false positives and false negatives.
基于所记录的误报、漏报的目标数据,分别进行特征提取,例如,采用深度学习模型进行特征提取,将所提取的误报特征作为第一特征库中的特征,将所提取的漏报特征作为第二特征库中的特征。Based on the recorded target data of false positives and false negatives, feature extraction is performed respectively. For example, a deep learning model is used for feature extraction, and the extracted false positive features are used as features in the first feature library, and the extracted false negatives are used as features in the first feature library. Features as features in the second feature library.
例如,一个场景下多次出现人体漏报,且漏报的人体拥有明显且相似的特征,比如穿着同一种制服如石油工人制服,总是处于一致特殊姿态的人体如半弯着腰行进,则将该漏报的人体数据进行特征提取,所提取的漏报特征包括服饰特征、姿态特征等特征,这些特征可存储于第二特征库中。For example, if a human body is missed multiple times in a scene, and the missed human body has obvious and similar characteristics, such as a human body wearing the same uniform, such as an oil worker's uniform, and always in the same special posture, such as walking half-bent, then Features are extracted from the missed human body data. The extracted missed features include clothing features, posture features and other features. These features can be stored in the second feature library.
本实施例中,安防系统可以利用周界算法将高频误报、漏报的检测结果过滤出来,以得到用于建立特征库的目标数据。In this embodiment, the security system can use the perimeter algorithm to filter out high-frequency false positives and false negatives detection results to obtain target data for establishing a feature database.
上述第一特征库、第二特征库可根据时间、数量中的至少之一作为更新触发条件来进行更新,例如,定期地更新第一特征库、第二特征库。The above-mentioned first feature database and second feature database can be updated according to at least one of time and quantity as an update trigger condition. For example, the first feature database and second feature database are updated regularly.
由于特征库是标定的结果,提高了特征库中特征数据的清洁度。Since the feature database is the result of calibration, the cleanliness of the feature data in the feature database is improved.
步骤S202,获取当前目标数据的当前检测结果,判断安防系统中触发报警规则的目标数据的检测结果被判定为正报还是误报;Step S202, obtain the current detection result of the current target data, and determine whether the detection result of the target data that triggers the alarm rule in the security system is determined to be a positive alarm or a false alarm;
如果是正报,则执行步骤S203~S204; If it is a positive report, execute steps S203 to S204;
如果是误报,则执行步骤S205~S206。If it is a false alarm, steps S205 to S206 are executed.
步骤S203,计算当前目标数据的每个目标特征与第一特征库中每个第一特征的第一相似度,得到每个第一相似度。Step S203: Calculate the first similarity between each target feature of the current target data and each first feature in the first feature database to obtain each first similarity.
作为一种示例,当触发安防系统中报警规则的目标数据的检测结果被判定为正报时,则对该正报对应的目标数据进行特征提取,例如,采用深度学习算法进行特征提取,以便得到至少一个以上目标特征,将每个目标特征与第一特征库中每个第一特征的相似度进行相似度计算,得到每个第一相似度,以便将每个目标特征与第一特征库中每个第一特征进行匹配。As an example, when the detection result of the target data that triggers the alarm rule in the security system is determined to be a positive alarm, feature extraction is performed on the target data corresponding to the positive alarm. For example, a deep learning algorithm is used for feature extraction, so as to obtain at least For more than one target feature, calculate the similarity between each target feature and each first feature in the first feature library to obtain each first similarity, so as to compare each target feature with each first feature in the first feature library. The first feature is matched.
步骤S204,对于每个第一相似度,判断该第一相似度是否大于用于该第一相似度计算的第一特征所绑定的第一相似度阈值。Step S204: For each first similarity, determine whether the first similarity is greater than the first similarity threshold bound to the first feature used for the first similarity calculation.
如果存在任一第一相似度大于其第一相似度阈值的情形,则判定该检测结果为误报,将该检测结果更正为误报,并不再触发报警,以减少误报。If any first similarity is greater than its first similarity threshold, the detection result is determined to be a false alarm, the detection result is corrected to a false alarm, and the alarm is no longer triggered to reduce false alarms.
否则,则判定该检测结果为正报,触发报警提示。Otherwise, the detection result is determined to be positive and an alarm prompt is triggered.
步骤S205,计算当前目标数据的每个目标特征与第二特征库中每个第二特征的第二相似度,得到每个第二相似度。以便将每个目标特征与第二特征库中每个第二特征进行匹配。Step S205: Calculate the second similarity between each target feature of the current target data and each second feature in the second feature database to obtain each second similarity. In order to match each target feature with each second feature in the second feature library.
步骤S206,对于每个第二相似度,判断该第二相似度是否大于用于该第二相似度计算的第二特征所绑定的第二相似度阈值。Step S206: For each second similarity, determine whether the second similarity is greater than the second similarity threshold bound to the second feature used for the second similarity calculation.
如果存在任一第二相似度大于其第二相似度阈值的情形,则将该检测结果更正为正报,触发报警提示。否则,则判定该检测结果为误报,并不再触发报警,以减少误报。If any second similarity is greater than its second similarity threshold, the detection result is corrected to a positive report and an alarm prompt is triggered. Otherwise, the detection result is determined to be a false alarm, and the alarm will no longer be triggered to reduce false alarms.
通过上述步骤S204、S206,得以将所述匹配度与特征库中用于确定该匹配度的被匹配特征所绑定的检测阈值进行比较,并根据比较结果确定所述检测结果的处理逻辑,这样,在所提取的目标特征与误报数据库相似度较高时,可以终止这些目标数据的报警流程,以减少误报;在所提取的目标特征与漏报数据库相似度较高时,可以将对这些目标数据重新进行报警,以提高检出率,从而有利于提高目标检测的场景适应性。Through the above steps S204 and S206, the matching degree can be compared with the detection threshold bound to the matching feature in the feature library used to determine the matching degree, and the processing logic of the detection result can be determined based on the comparison result. In this way , when the extracted target features are highly similar to the false positive database, the alarm process of these target data can be terminated to reduce false positives; when the extracted target features are highly similar to the false negative database, the alarm process can be These target data are re-alarmed to increase the detection rate, which is beneficial to improving the scene adaptability of target detection.
示例性的,目标特征数据1所提取的目标特征包括:目标特征1、目标特征2,…,目标特征n;第一特征库包括:第一特征1、第一特征2,…,第一特征i;第二特征库包括:第二特征1、第二特征2,…,第二特征j;第一特 征1绑定相似度阈值1,第一特征2绑定相似度阈值2,…,第一特征i绑定相似度阈值i;第二特征2绑定相似度阈值1,第二特征2绑定相似度阈值2,…,第二特征j绑定相似度阈值j。例如,某人体图像作为目标数据1,对该目标数据1提取的目标特征包括,眼部特征、面部特征、体态特征,第一特征库中的第一特征包括眼部特征、面部特征、体态特征等,其中,眼部特征绑定有眼部相似度阈值1,面部特征绑定有面部相似度阈值2,体态特征绑定有体态相似度阈值3,同样地,第二特征库中的第二特征包括眼部特征、面部特征、体态特征,其中,眼部特征绑定有眼部相似度阈值1’,面部特征绑定有面部相似度阈值2’,体态特征绑定有体态相似度阈值3’。Exemplarily, the target features extracted from the target feature data 1 include: target feature 1, target feature 2,..., target feature n; the first feature library includes: first feature 1, first feature 2,..., first feature i; the second feature library includes: second feature 1, second feature 2,..., second feature j; the first feature Feature 1 is bound to the similarity threshold 1, the first feature 2 is bound to the similarity threshold 2,..., the first feature i is bound to the similarity threshold i; the second feature 2 is bound to the similarity threshold 1, and the second feature 2 is bound Similarity threshold 2,..., the second feature j is bound to similarity threshold j. For example, a human body image is used as target data 1. The target features extracted from the target data 1 include eye features, facial features, and body features. The first feature in the first feature library includes eye features, facial features, and body features. etc. Among them, the eye features are bound with an eye similarity threshold of 1, the facial features are bound with a facial similarity threshold of 2, and the body features are bound with a body similarity threshold of 3. Similarly, the second feature in the second feature library Features include eye features, facial features, and body features. Among them, eye features are bound with an eye similarity threshold of 1', facial features are bound with a facial similarity threshold of 2', and body features are bound with a body similarity threshold of 3. '.
若目标特征数据1的检测结果为正报,则计算目标特征1与每个第一特征的相似度,得到每个第一相似度,作为第一相似度结果,则目标特征1有i个第一相似度结果,则n个目标特征共有i×n个第一相似度结果,可用i行n列的矩阵Cin表示,其中,矩阵中第i行、第n列的元素为第一特征i与目标特征n的第一相似度;矩阵中的每一行绑定有第一相似度阈值。如图3a所示,图3a为第一相似度矩阵以及第一相似度阈值的一种示意图,i行n列的矩阵Cin为第一相似度矩阵,矩阵Cin中第i行、第n列的元素为第一特征i与目标特征n的第一相似度。矩阵Cin中的每一行绑定有第一相似度阈值,表示每个第一特征所绑定的第一相似度阈值。例如第1行绑定有第一相似度阈值1,即第一特征1绑定第一相似度阈值1;第2行绑定有第一相似度阈值2,即第一特征2绑定第一相似度阈值2;第i行绑定有第一相似度阈值i,即第一特征i绑定第一相似度阈值i。If the detection result of target feature data 1 is positive, then calculate the similarity between target feature 1 and each first feature, and obtain each first similarity. As the first similarity result, then target feature 1 has the i-th A similarity result, then there are i×n first similarity results for n target features, which can be represented by a matrix Cin with i rows and n columns, where the elements in the i-th row and n-th column of the matrix are the first features i and The first similarity of target feature n; each row in the matrix is bound to the first similarity threshold. As shown in Figure 3a, Figure 3a is a schematic diagram of the first similarity matrix and the first similarity threshold. The matrix Cin in row i and column n is the first similarity matrix, and the matrix Cin in row i and column n is the first similarity matrix. The element is the first similarity between the first feature i and the target feature n. Each row in the matrix Cin is bound to a first similarity threshold, indicating the first similarity threshold bound to each first feature. For example, row 1 is bound to the first similarity threshold 1, that is, the first feature 1 is bound to the first similarity threshold 1; row 2 is bound to the first similarity threshold 2, that is, the first feature 2 is bound to the first Similarity threshold 2; the i-th row is bound to the first similarity threshold i, that is, the first feature i is bound to the first similarity threshold i.
对于矩阵Cin中的每一行元素,一旦该行元素中存在任一第一相似度结果大于该行所绑定的第一相似度阈值,则说明该元素对应的目标特征与该元素对应的第一特征相似性较高,匹配度大,故而说明该检测结果属于误报;若该行元素中不存在任一第一相似度结果大于该行所绑定的第一相似度阈值,即,该行元素均小于该行所绑定的第一相似度阈值,则说明该元素对应的目标特征与第一特征相似性较低,故而说明该检测结果不属于误报。For each row of elements in the matrix Cin, once there is any first similarity result in the row element that is greater than the first similarity threshold bound to the row, it means that the target feature corresponding to the element is the same as the first similarity result corresponding to the element. The feature similarity is high and the matching degree is large, so the detection result is a false positive; if there is no first similarity result in the row element that is greater than the first similarity threshold bound to the row, that is, the row If the elements are all smaller than the first similarity threshold bound to the row, it means that the target feature corresponding to the element has a low similarity with the first feature, so the detection result is not a false positive.
同样地,若目标特征数据1的检测结果为误报,则计算目标特征1与每个第二特征的相似度,得到每个第二相似度,作为第二相似度结果,则目标特征1有j个第二相似度结果,则n个目标特征共有j×n个第二相似度结果, 可用j行n列的矩阵Cjn表示,其中,矩阵中第j行、第n列的元素为第二特征j与目标特征n的第二相似度;矩阵中的每一行绑定有第二相似度阈值。如图3b所示,图3b为第二相似度矩阵以及第二相似度阈值的一种示意图,j行n列的矩阵Cjn为第二相似度矩阵,矩阵Cjn中第j行、第n列的元素为第二特征j与目标特征n的第二相似度。矩阵Cjn中的每一行绑定有第二相似度阈值,表示每个第二特征所绑定的第二相似度阈值。例如第1行绑定有第二相似度阈值1,即第二特征1绑定第二相似度阈值1;第2行绑定有第二相似度阈值2,即第二特征2绑定第二相似度阈值2;第j行绑定有第二相似度阈值j,即第二特征j绑定第二相似度阈值j。Similarly, if the detection result of target feature data 1 is a false alarm, calculate the similarity between target feature 1 and each second feature to obtain each second similarity. As the second similarity result, then target feature 1 has j second similarity results, then there are j×n second similarity results for the n target features, It can be represented by a matrix Cjn with j rows and n columns, where the elements in the j-th row and n-th column in the matrix are the second similarity between the second feature j and the target feature n; each row in the matrix is bound to the second similarity threshold. As shown in Figure 3b, Figure 3b is a schematic diagram of the second similarity matrix and the second similarity threshold. The matrix Cjn in the jth row and nth column is the second similarity matrix. The jth row and nth column in the matrix Cjn The element is the second similarity between the second feature j and the target feature n. Each row in the matrix Cjn is bound to a second similarity threshold, indicating the second similarity threshold bound to each second feature. For example, row 1 is bound to the second similarity threshold 1, that is, the second feature 1 is bound to the second similarity threshold 1; row 2 is bound to the second similarity threshold 2, that is, the second feature 2 is bound to the second The similarity threshold is 2; the j-th row is bound to the second similarity threshold j, that is, the second feature j is bound to the second similarity threshold j.
对于矩阵Cjn中的每一行元素,一旦该行元素中存在任一第二相似度结果大于该行所绑定的第二相似度阈值,则说明该元素对应的目标特征与该元素对应的第二特征相似性较高,匹配度大,故而说明该检测结果属于漏报;若该行元素中不存在任一第二相似度结果大于该行所绑定的第二相似度阈值,即,该行元素均小于其该行所绑定的第二相似度阈值,则说明该元素对应的目标特征与第二特征相似性较低,故而说明该检测结果不属于漏报。For each row element in the matrix Cjn, once there is any second similarity result in the row element that is greater than the second similarity threshold bound to the row, it means that the target feature corresponding to the element is the same as the second similarity result corresponding to the element. The feature similarity is high and the matching degree is large, so the detection result is a false negative; if there is no second similarity result in the row element that is greater than the second similarity threshold bound to the row, that is, the row If the elements are all smaller than the second similarity threshold bound to the row, it means that the target feature corresponding to the element has a low similarity with the second feature, so the detection result is not a false negative.
上述特征库中特征所绑定的相似度阈值通过自适应的方法产生,这些特征库中每个特征所绑定的相似度阈值不尽相同,并且,每个相似度阈值随着该被匹配特征与预设范围内目标数据的目标特征之间匹配度而调整,其中,预设范围内目标数据包括设定第二时间段内和/或设定第二数量的目标数据。考虑到场景中目标数据随着时间、业务特点等因素而变化,特征库中与特征绑定的相似度阈值将在满足更新触发条件时进行更新。The similarity thresholds bound to the features in the above feature database are generated through an adaptive method. The similarity thresholds bound to each feature in these feature databases are different, and each similarity threshold changes with the matched feature. It is adjusted based on the degree of matching with the target characteristics of the target data within the preset range, wherein the target data within the preset range includes target data within a set second time period and/or a set second quantity. Considering that the target data in the scenario changes with time, business characteristics and other factors, the similarity threshold bound to the feature in the feature library will be updated when the update triggering conditions are met.
下面对相似度阈值的产生进行说明。The generation of the similarity threshold is explained below.
参见图4所示,图4为特征绑定的相似度阈值更新的一种示意图。当更新条件满足时,触发特征库中特征绑定的相似度阈值的更新,其中,更新条件包括:满足设定的更新时间、设定的更新频次、特征库被更新中的至少之一。更新过程包括:对于特征库中的任一特征,Refer to Figure 4, which is a schematic diagram of updating the similarity threshold of feature binding. When the update conditions are met, the update of the similarity threshold of feature binding in the feature database is triggered, where the update conditions include: meeting at least one of the set update time, the set update frequency, and the feature database being updated. The update process includes: for any feature in the feature database,
步骤S401,计算该特征与预设范围内所有目标数据的每个目标特征的相似度。其中,所有目标数据为设定时间阈值内、和/或设定数量阈值内的目标数据,该目标数据的目标特征还可以用于进行检测结果的标定,以便于获得特征库。 Step S401: Calculate the similarity between the feature and each target feature of all target data within the preset range. Among them, all target data are target data within a set time threshold and/or within a set quantity threshold. The target features of the target data can also be used to calibrate the detection results, so as to obtain a feature library.
步骤S402,从该特征的所有相似度结果中选择出最大相似度。Step S402: Select the maximum similarity from all similarity results of the feature.
步骤S403,基于最大相似度,调整该特征绑定的相似度阈值。例如,将该特征绑定的相似度阈值更新为大于等于最大相似度与冗余量之和。Step S403: Adjust the similarity threshold of the feature binding based on the maximum similarity. For example, update the similarity threshold of the feature binding to be greater than or equal to the sum of the maximum similarity and the amount of redundancy.
作为一种示例,与第一特征绑定的第一相似度阈值通过计算第一特征与第三目标数据的目标特征之间的相似度得到,其中,第三目标数据为在第一预设范围内且检测结果为正报的数据,第一预设范围为设定的第三时间段、和/或设定第三数量。具体地,第一相似度阈值在第一特征与目标特征之间的最大相似度sim1_max附近浮动,浮动值取决于具体采取的修正策略。作为一种示例,第一相似度阈值需要满足thr1≥sim1_max+gap1,其中,thr1为第一相似度阈值,gap1为第一冗余量,用于表征基于第一特征对应的最大相似度的浮动值。As an example, the first similarity threshold bound to the first feature is obtained by calculating the similarity between the first feature and the target feature of the third target data, where the third target data is within the first preset range For data within which the detection result is positive, the first preset range is the set third time period and/or the set third quantity. Specifically, the first similarity threshold floats around the maximum similarity sim1_max between the first feature and the target feature, and the floating value depends on the specific correction strategy adopted. As an example, the first similarity threshold needs to satisfy thr1≥sim1_max+gap1, where thr1 is the first similarity threshold and gap1 is the first redundancy amount, which is used to represent the floating maximum similarity based on the first feature. value.
与第二特征绑定的第二相似度阈值通过计算第二特征与第四目标数据的目标特征之间的相似度得到,其中,第四目标数据为在第二预设范围内且检测结果为误报的数据,第二预设范围为设定的第四时间时段、和/或设定第四数量。具体地,第二相似度阈值在目标特征与第二特征最大相似度sim2_max附近浮动,浮动值取决于具体采取的修正策略。作为一种示例,第二相似度阈值需要满足thr2≥sim2_max+gap2,,其中,thr2为第二相似度阈值,gap2为第二冗余量,用于表征基于第二特征对应的最大相似度的浮动值。The second similarity threshold bound to the second feature is obtained by calculating the similarity between the second feature and the target feature of the fourth target data, where the fourth target data is within the second preset range and the detection result is For false alarm data, the second preset range is the set fourth time period and/or the set fourth quantity. Specifically, the second similarity threshold floats around the maximum similarity sim2_max between the target feature and the second feature, and the floating value depends on the specific correction strategy adopted. As an example, the second similarity threshold needs to satisfy thr2≥sim2_max+gap2, where thr2 is the second similarity threshold and gap2 is the second redundancy amount, used to characterize the maximum similarity based on the second feature correspondence. Floating value.
本实施例通过对与特征库中每个特征绑定的检测阈值的自适应调整,有利于提高所述检测结果的场景适应性,能够解决既有安防系统中的漏报与误报,特别是针对重复性漏报和误报,能够利用目标数据的目标特征与特征库的匹配度和检测阈值的比较结果,来对检测结果进行修正,从而有利于提高检测结果的准确性和可靠性,降低漏报和误报。This embodiment helps improve the scene adaptability of the detection results by adaptively adjusting the detection threshold bound to each feature in the feature library, and can solve the problem of missed negatives and false positives in the existing security system, especially For repetitive omissions and false positives, the detection results can be corrected by using the matching degree of the target features of the target data and the feature library and the detection threshold comparison results, which will help improve the accuracy and reliability of the detection results and reduce the risk of False negatives and false positives.
在具体应用中,本申请实施例提供的目标检测的场景适应性提高方法可以如图5所示:根据固有方法判断当前目标数据是否需要报警,其中固有方法指的是:根据目标数据的检测结果所来反映被监测状况,当检测结果满足预设的条件时,比如被检测出的目标的类别、置信度达到预设的条件时,则触发报警等提示。In specific applications, the method for improving scene adaptability of target detection provided by the embodiment of the present application can be shown in Figure 5: judging whether the current target data needs to alarm based on the inherent method, where the inherent method refers to: based on the detection result of the target data It reflects the monitored status. When the detection results meet the preset conditions, for example, when the category and confidence level of the detected target reach the preset conditions, an alarm or other prompts will be triggered.
如果是,即对当前目标数据进行报警,说明当前目标数据的检测结果为正报,则提取当前目标数据的目标特征,将目标特征与典型误报特征库(即 前述第一特征库)中的每个特征进行特征相似度计算,得到每个第一相似度,即执行前述步骤S203。If it is, an alarm is issued for the current target data, indicating that the detection result of the current target data is a positive report, then the target features of the current target data are extracted, and the target features are compared with the typical false alarm feature library (i.e. Perform feature similarity calculation on each feature in the aforementioned first feature database) to obtain each first similarity, that is, execute the aforementioned step S203.
并针对每个第一相似度,将第一相似度与用于该第一相似度计算的第一特征所绑定的第一相似度阈值进行比较,判断该第一相似度是否大于用于该第一相似度计算的第一特征所绑定的第一相似度阈值。若是,则不报警,若否,则报警。即执行前述步骤S204。And for each first similarity, compare the first similarity with the first similarity threshold bound to the first feature used for the first similarity calculation, and determine whether the first similarity is greater than the first similarity used for the first similarity calculation. The first similarity threshold bound to the first feature calculated by the first similarity. If yes, then no alarm will be issued; if not, then alarm will be issued. That is, the aforementioned step S204 is executed.
如果是,即对当前目标数据进行报警,说明当前目标数据的检测结果为正报,则提取当前目标数据的目标特征,将目标特征与典型误报特征库(即前述第一特征库)中的每个第一特征进行特征相似度计算,得到每个第一相似度。并针对每个第一相似度,将第一相似度与用于该第一相似度计算的第一特征所绑定的第一相似度阈值进行比较,判断该第一相似度是否大于用于该第一相似度计算的第一特征所绑定的第一相似度阈值;若是,则不报警,若否,则报警。即执行前述步骤S203~S204。If yes, that is, an alarm is issued for the current target data, indicating that the detection result of the current target data is a positive report, then the target features of the current target data are extracted, and the target features are compared with those in the typical false alarm feature library (i.e., the aforementioned first feature library) Feature similarity calculation is performed on each first feature to obtain each first similarity. And for each first similarity, compare the first similarity with the first similarity threshold bound to the first feature used for the first similarity calculation, and determine whether the first similarity is greater than the first similarity used for the first similarity calculation. The first similarity threshold bound to the first feature calculated by the first similarity; if yes, no alarm will be issued; if no, then an alarm will be issued. That is, the aforementioned steps S203 to S204 are executed.
如果否,即不对当前目标数据进行报警,说明当前目标数据的检测结果为误报,则提取当前目标数据的目标特征,将目标特征与典型漏报特征库(即前述第二特征库)中的每个第二特征进行特征相似度计算,得到每个第二相似度。并针对每个第二相似度,将第二相似度与用于该第二相似度计算的第二特征所绑定的第二相似度阈值进行比较,判断该第二相似度是否大于用于该第二相似度计算的第二特征所绑定的第二相似度阈值;若是,则报警,若否,则不报警。即执行前述步骤S205~S206。If not, that is, no alarm is issued for the current target data, indicating that the detection result of the current target data is a false alarm, then the target features of the current target data are extracted, and the target features are compared with those in the typical false negative feature library (i.e., the aforementioned second feature library) Feature similarity calculation is performed on each second feature to obtain each second similarity. And for each second similarity, compare the second similarity with the second similarity threshold bound to the second feature used for the second similarity calculation, and determine whether the second similarity is greater than the second similarity used for the second similarity calculation. The second similarity threshold bound to the second feature calculated by the second similarity; if yes, an alarm will be issued; if not, no alarm will be issued. That is, the aforementioned steps S205 to S206 are executed.
特征库中的特征绑定的相似度阈值的更新方法可以如图6所示:当更新条件满足时,触发特征库中特征绑定的相似度阈值的更新,其中,更新条件包括:满足设定的更新时间、设定的更新频次、特征库被更新中的至少之一。The update method of the similarity threshold of the feature binding in the feature library can be shown in Figure 6: when the update condition is met, the update of the similarity threshold of the feature binding in the feature library is triggered, where the update condition includes: satisfying the setting At least one of the update time, the set update frequency, and the feature database being updated.
更新过程包括:对于典型特征库T中的任一特征,计算该特征与时间段P(即P时间长度)内所有的典型正报或误报目标数据的每个目标特征的相似度,并从所有的相似度结果中选择出最大相似度,实现最大相似度(MaxSim)计算。当典型特征库为典型误报特征库(即前述第一特征库)时,计算该特征与时间段P(即P时间长度)内所有的典型正报目标数据的每个目标特征的相似度;当典型特征库为典型漏报特征库(即前述第二特征库)时,计算该特征与时间段P(即P时间长度)内所有的典型误报目标数据的每个目标特征 的相似度。The update process includes: for any feature in the typical feature library T, calculate the similarity between the feature and each target feature of all typical positive or false positive target data in the time period P (i.e., P time length), and calculate from Select the maximum similarity among all similarity results to implement the maximum similarity (MaxSim) calculation. When the typical feature library is a typical false positive feature library (i.e., the aforementioned first feature library), calculate the similarity between the feature and each target feature of all typical positive target data within the time period P (i.e., P time length); When the typical feature library is a typical false negative feature library (i.e., the aforementioned second feature library), calculate this feature and each target feature of all typical false positive target data within the time period P (i.e., P time length) similarity.
通过计算得到的最大相似度,对典型特征库T中特征绑定的相似度阈值THRt1进行调整,将其调整为THRt2,此时,THRt2应当满足THRt2≥MaxSim+Gap,实现相似度阈值的调整。其中,THRt2为调整后的典型特征库T中特征绑定的相似度阈值,MaxSim为典型特征库中特征对应的最大相似度,Gap用于表征基于典型特征库中特征对应的最大相似度的浮动值。Through the calculated maximum similarity, the similarity threshold THRt1 of the feature binding in the typical feature library T is adjusted to THRt2. At this time, THRt2 should satisfy THRt2≥MaxSim+Gap to realize the adjustment of the similarity threshold. Among them, THRt2 is the similarity threshold of feature binding in the adjusted typical feature library T, MaxSim is the maximum similarity corresponding to the features in the typical feature library, and Gap is used to represent the floating value based on the maximum similarity corresponding to the features in the typical feature library. value.
上述更新过程即为前述步骤S401~S403。The above update process is the aforementioned steps S401 to S403.
参见图7所示,图7为用于提高目标检测的场景适应性的装置的一种示意图。该装置包括:Refer to FIG. 7 , which is a schematic diagram of a device for improving scene adaptability of target detection. The device includes:
目标检测模块,用于对当前目标数据进行目标特征提取,并获取当前目标数据的检测结果;The target detection module is used to extract target features from the current target data and obtain the detection results of the current target data;
特征匹配模块,用于将每个目标特征与特征库中每个特征进行匹配;Feature matching module, used to match each target feature with each feature in the feature library;
比较模块,用于将所述检测结果与特征库中被匹配特征所绑定的检测阈值进行比较;A comparison module, used to compare the detection results with the detection threshold bound to the matching feature in the feature library;
确定模块,用于根据比较结果确定对所述检测结果的处理;A determination module, used to determine the processing of the detection result according to the comparison result;
阈值调整模块,用于对每个所述被匹配特征所绑定的检测阈值,随着该被匹配特征与预设范围内目标数据的目标特征之间匹配度而调整;A threshold adjustment module, configured to adjust the detection threshold bound to each matched feature according to the matching degree between the matched feature and the target feature of the target data within the preset range;
其中,in,
所述特征库为按照检测结果为误报或漏报而标定的目标数据的特征集合;The feature library is a feature set of target data calibrated according to whether the detection result is a false positive or a false negative;
所述阈值调整模块还被配置为:将每个所述特征所绑定的相似度阈值随着该每个特征对应的最大相似度而调整,每个特征对应的最大相似度为:该每个特征与预设范围内目标数据的目标特征之间的相似度中的最大值。The threshold adjustment module is also configured to adjust the similarity threshold bound to each feature according to the maximum similarity corresponding to each feature, and the maximum similarity corresponding to each feature is: The maximum value of similarity between the feature and the target feature of the target data within the preset range.
所述特征匹配模块包括:The feature matching module includes:
第一特征匹配子模块,用于在所述检测结果为正报的情形下,将每个目标特征与第一特征库中的每个第一特征进行相似度计算,得到每个第一相似度;The first feature matching submodule is used to calculate the similarity between each target feature and each first feature in the first feature library to obtain each first similarity when the detection result is positive. ;
第二特征匹配子模块,在所述检测结果为误报的情形下,将每个目标特征与第二特征库中的每个第二特征进行相似度计算,得到每个第二相似度。The second feature matching submodule calculates the similarity between each target feature and each second feature in the second feature library to obtain each second similarity when the detection result is a false positive.
所述比较模块包括:The comparison module includes:
第一比较子模块,用于将所计算的每个第一相似度与用于该第一相似度 计算的第一特征所绑定的第一相似度阈值进行比较;The first comparison sub-module is used to compare each calculated first similarity with the first similarity Compare the first similarity threshold bound to the calculated first feature;
第二比较子模块,用于将所计算的每个第二相似度与用于该第二相似度计算的第二特征所绑定的第二相似度阈值进行比较。The second comparison sub-module is configured to compare each calculated second similarity with a second similarity threshold bound to the second feature used for the second similarity calculation.
所述确定模块包括:The determination module includes:
第一确定子模块,用于当所计算的任一第一相似度大于用于该第一相似度计算的第一特征所绑定的第一相似度阈值时,则将所述检测结果更正为误报,否则,所述检测结果保持为正报;A first determination sub-module, configured to correct the detection result as an error when any calculated first similarity is greater than the first similarity threshold bound to the first feature used for the first similarity calculation. reported, otherwise, the detection result remains positive;
第二确定子模块,用于当所计算的任一第二相似度大于用于该第二相似度计算的第二特征所绑定的第二相似度阈值时,则将所述检测结果更正为正报,否则,所述检测结果保持为误报。The second determination sub-module is used to correct the detection result to positive when any calculated second similarity is greater than the second similarity threshold bound to the second feature used for the second similarity calculation. Otherwise, the detection result remains a false positive.
所述阈值调整模块包括:The threshold adjustment module includes:
第一相似度阈值调整子模块,用于将每个所述第一特征所绑定的第一相似度阈值随着该第一特征对应的最大相似度而调整,所述该第一特征对应的最大相似度为:该第一特征与第一预设范围内检测结果为正报的第三目标数据的目标特征之间的相似度中的最大值;The first similarity threshold adjustment sub-module is used to adjust the first similarity threshold bound to each first feature according to the maximum similarity corresponding to the first feature, and the first similarity threshold corresponding to the first feature is The maximum similarity is: the maximum value of the similarity between the first feature and the target feature of the third target data whose detection result is positive within the first preset range;
第二相似度阈值调整子模块,用于将每个所述第二特征所绑定的第二相似度阈值随着该第二特征对应的最大第二相似度而调整,所述该第二特征对应的最大相似度为:该第二特征与第二预设范围内检测结果为误报的第四目标数据的目标特征之间的相似度中的最大值。The second similarity threshold adjustment sub-module is used to adjust the second similarity threshold bound to each second feature according to the maximum second similarity corresponding to the second feature. The corresponding maximum similarity is: the maximum value of similarities between the second feature and the target feature of the fourth target data whose detection result is a false alarm within the second preset range.
该装置还包括:The device also includes:
特征库管理模块,用于搜集设定第一时间段内和/或设定第一数量的目标数据,对所搜集的目标数据进行标定;The feature database management module is used to collect target data within a set first time period and/or set a first quantity, and calibrate the collected target data;
基于标定的目标数据,判断所搜集的目标数据的检测结果是否存在误报或漏报,将存在误报或漏报的目标数据予以记录;Based on the calibrated target data, determine whether the detection results of the collected target data contain false positives or false negatives, and record the target data with false positives or false negatives;
基于所记录的目标数据,进行特征提取,将所提取的误报特征作为第一特征库中的特征,将所提取的漏报特征作为第二特征库中的特征。Based on the recorded target data, feature extraction is performed, and the extracted false positive features are used as features in the first feature library, and the extracted false negative features are used as features in the second feature library.
参见图8所示,图8为用于提高目标检测的场景适应性的装置的另一种示意图。该装置包括存储器和处理器,所述存储器存储有计算机程序,所述处理器被配置为执行所述计算机程序实现本申请提高目标检测的场景适应性的方法的步骤。 Refer to FIG. 8 , which is another schematic diagram of a device for improving scene adaptability of target detection. The device includes a memory and a processor, the memory stores a computer program, and the processor is configured to execute the steps of the computer program to implement the method of improving scene adaptability of target detection in the present application.
存储器可以包括随机存取存储器(Random Access Memory,RAM),也可以包括非易失性存储器(Non-Volatile Memory,NVM),例如至少一个磁盘存储器。可选的,存储器还可以是至少一个位于远离前述处理器的存储装置。The memory may include random access memory (Random Access Memory, RAM) or non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk memory. Optionally, the memory may also be at least one storage device located far away from the aforementioned processor.
上述的处理器可以是通用处理器,包括中央处理器(Central Processing Unit,CPU)、网络处理器(Network Processor,NP)等;还可以是数字信号处理器(Digital Signal Processing,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (Network Processor, NP), etc.; it can also be a digital signal processor (Digital Signal Processing, DSP), special integrated Circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
本发明实施例还提供了一种计算机可读存储介质,所述存储介质内存储有计算机程序,所述计算机程序被处理器执行时实现目标检测的场景适应性提高方法的步骤。Embodiments of the present invention also provide a computer-readable storage medium. A computer program is stored in the storage medium. When the computer program is executed by a processor, the steps of the method for improving scene adaptability of target detection are implemented.
对于装置/网络侧设备/存储介质实施例而言,由于其基本相似于方法实施例,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。As for the device/network-side device/storage medium embodiment, since it is basically similar to the method embodiment, the description is relatively simple. For relevant details, please refer to the partial description of the method embodiment.
在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。In this document, relational terms such as first, second, etc. are used only to distinguish one entity or operation from another entity or operation and do not necessarily require or imply the existence of any such entity or operation between these entities or operations. Actual relationship or sequence. Furthermore, the terms "comprises," "comprises," or any other variation thereof are intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus that includes a list of elements includes not only those elements, but also those not expressly listed other elements, or elements inherent to the process, method, article or equipment. Without further limitation, an element defined by the statement "comprises a..." does not exclude the presence of additional identical elements in a process, method, article, or apparatus that includes the stated element.
以上所述仅为本发明的较佳实施例,并不用以限制本发明,凡在本发明的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本发明保护的范围之内。 The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention shall be included in the protection of the present invention. within the range.

Claims (10)

  1. 一种目标检测的场景适应性提高方法,其特征在于,该方法包括:A method for improving scene adaptability of target detection, which is characterized in that the method includes:
    获取当前目标数据的检测结果;Get the detection results of the current target data;
    对当前目标数据进行目标特征提取;Extract target features from the current target data;
    确定每个目标特征与特征库中每个特征的匹配度;Determine the matching degree of each target feature with each feature in the feature library;
    将每个匹配度与特征库中用于确定该匹配度的被匹配特征所绑定的检测阈值进行比较;Compare each matching degree with the detection threshold bound to the matched feature in the feature library used to determine the matching degree;
    根据比较结果确定对所述检测结果的处理;Determine the processing of the detection results based on the comparison results;
    其中,in,
    所述特征库为按照检测结果为误报或漏报而标定的目标数据的特征集合;The feature library is a feature set of target data calibrated according to whether the detection result is a false positive or a false negative;
    每个所述被匹配特征所绑定的检测阈值,随着该被匹配特征与预设范围内目标数据的目标特征之间匹配度而调整。The detection threshold bound to each matched feature is adjusted according to the matching degree between the matched feature and the target feature of the target data within the preset range.
  2. 如权利要求1所述的场景适应性提高方法,其特征在于,所述确定每个目标特征与特征库中每个特征的匹配度,包括:The method for improving scene adaptability according to claim 1, wherein determining the matching degree between each target feature and each feature in the feature library includes:
    计算每个目标特征与特征库中每个特征的相似度;Calculate the similarity between each target feature and each feature in the feature library;
    所述将每个匹配度与特征库中用于确定该匹配度的被匹配特征所绑定的检测阈值进行比较,包括:Comparing each matching degree with the detection threshold bound to the matching feature in the feature library used to determine the matching degree includes:
    对于所计算的每个相似度;For each similarity calculated;
    将该相似度与相似度阈值进行比较;Compare this similarity to a similarity threshold;
    其中,in,
    相似度阈值为特征库中用于该相似度计算的特征所绑定的相似度阈值。The similarity threshold is the similarity threshold bound to the features used for the similarity calculation in the feature library.
  3. 如权利要求2所述的场景适应性提高方法,其特征在于,每个所述特征所绑定的相似度阈值,随着该每个特征对应的最大相似度而调整,其中,每个特征对应的最大相似度为:该每个特征与预设范围内目标数据的目标特征之间的相似度中的最大值;The method for improving scene adaptability according to claim 2, characterized in that the similarity threshold bound to each feature is adjusted according to the maximum similarity corresponding to each feature, wherein each feature corresponds to The maximum similarity is: the maximum value of the similarity between each feature and the target feature of the target data within the preset range;
    所述根据比较结果确定对所述检测结果的处理,包括:Determining the processing of the detection result based on the comparison result includes:
    根据比较结果对所述检测结果进行修正。The detection results are corrected based on the comparison results.
  4. 如权利要求3所述的场景适应性提高方法,其特征在于,所述检测结果包括正报,所述特征库包括:第一特征库,用于表征检测结果为误报的第一目标数据的特征集合; The method for improving scene adaptability according to claim 3, characterized in that the detection results include positive reports, and the feature library includes: a first feature library used to characterize the first target data whose detection results are false positives. feature set;
    所述计算每个目标特征与特征库中每个特征的相似度,包括:The calculation of the similarity between each target feature and each feature in the feature library includes:
    在所述检测结果为正报的情形下,将每个目标特征与第一特征库中的每个第一特征进行相似度计算,得到每个第一相似度;In the case where the detection result is a positive report, calculate the similarity between each target feature and each first feature in the first feature library to obtain each first similarity;
    所述根据比较结果对所述检测结果进行修正,包括:The correction of the detection results according to the comparison results includes:
    若所计算的任一第一相似度大于用于该第一相似度计算的第一特征所绑定的第一相似度阈值,则将所述检测结果更正为误报;If any calculated first similarity is greater than the first similarity threshold bound to the first feature used for the first similarity calculation, the detection result is corrected as a false positive;
    其中,in,
    每个所述第一特征所绑定的第一相似度阈值随着该第一特征对应的最大相似度而调整,所述该第一特征对应的最大相似度为:该第一特征与第一预设范围内检测结果为正报的第三目标数据的目标特征之间的相似度中的最大值。The first similarity threshold bound to each first feature is adjusted according to the maximum similarity corresponding to the first feature. The maximum similarity corresponding to the first feature is: the first feature and the first The maximum value of the similarity between the target features of the third target data whose detection result is a positive report within the preset range.
  5. 如权利要求4所述的场景适应性提高方法,其特征在于,所述每个所述第一特征所绑定的第一相似度阈值随着该第一特征对应的最大相似度而调整,包括:The method for improving scene adaptability according to claim 4, wherein the first similarity threshold bound to each first feature is adjusted according to the maximum similarity corresponding to the first feature, including :
    确定所述第一相似度阈值大于所述第一特征对应的最大相似度与第一冗余量之和,其中,第一冗余量用于表征基于所述第一特征对应的最大相似度的浮动值。It is determined that the first similarity threshold is greater than the sum of the maximum similarity corresponding to the first feature and a first redundancy amount, where the first redundancy amount is used to characterize the maximum similarity based on the first feature correspondence. Floating value.
  6. 如权利要求3所述的场景适应性提高方法,其特征在于,所述检测结果包括误报,The method for improving scene adaptability according to claim 3, characterized in that the detection results include false alarms,
    所述特征库包括:第二特征库,用于表征检测结果为漏报的第二目标数据的特征集合;The feature library includes: a second feature library, a feature set used to characterize the second target data whose detection results are missed;
    所述计算每个目标特征与特征库中每个特征的相似度,包括:The calculation of the similarity between each target feature and each feature in the feature library includes:
    在所述检测结果为误报的情形下,将每个目标特征与第二特征库中的每个第二特征进行相似度计算,得到每个第二相似度;In the case where the detection result is a false positive, calculate the similarity between each target feature and each second feature in the second feature library to obtain each second similarity;
    所述根据比较结果对所述检测结果进行修正,包括:The correction of the detection results according to the comparison results includes:
    若所计算的任一第二相似度大于用于该第二相似度计算的第二特征所绑定的第二相似度阈值,则将所述检测结果更正为正报;If any calculated second similarity is greater than the second similarity threshold bound to the second feature used for the second similarity calculation, then the detection result is corrected to a positive report;
    其中,in,
    每个所述第二特征所绑定的第二相似度阈值随着该第二特征对应的最大第二相似度而调整,所述该第二特征对应的最大相似度为:该第二特征与第 二预设范围内检测结果为误报的第四目标数据的目标特征之间的相似度中的最大值。The second similarity threshold bound to each second feature is adjusted according to the maximum second similarity corresponding to the second feature. The maximum similarity corresponding to the second feature is: the second feature and No. The maximum value among the similarities between the target features of the fourth target data whose detection result is a false alarm within the two preset ranges.
  7. 如权利要求6所述的场景适应性提高方法,其特征在于,所述每个所述第二特征所绑定的第二相似度阈值随着该第二特征对应的最大第二相似度而调整,包括:The method for improving scene adaptability according to claim 6, wherein the second similarity threshold bound to each second feature is adjusted according to the maximum second similarity corresponding to the second feature. ,include:
    确定所述第二相似度阈值大于所述第二特征对应的最大相似度与第二冗余量之和,其中,第二冗余量用于表征基于所述第二特征对应的最大相似度的浮动值。It is determined that the second similarity threshold is greater than the sum of the maximum similarity corresponding to the second feature and a second redundancy amount, wherein the second redundancy amount is used to characterize the maximum similarity based on the second feature correspondence. Floating value.
  8. 如权利要求1所述的场景适应性提高方法,其特征在于,所述特征库按照如下方式建立:The method for improving scene adaptability according to claim 1, characterized in that the feature library is established as follows:
    搜集设定第一时间段内和/或设定第一数量的目标数据,对所搜集的目标数据进行标定;Collect target data within a set first time period and/or set a first quantity, and calibrate the collected target data;
    基于标定的目标数据,判断所搜集的目标数据的检测结果是否存在误报或漏报,将存在误报或漏报的目标数据予以记录;Based on the calibrated target data, determine whether the detection results of the collected target data contain false positives or false negatives, and record the target data with false positives or false negatives;
    基于所记录的目标数据,进行特征提取,将所提取的误报特征作为第一特征库中的特征,将所提取的漏报特征作为第二特征库中的特征;Based on the recorded target data, perform feature extraction, use the extracted false positive features as features in the first feature library, and use the extracted false negative features as features in the second feature library;
    所述对当前目标数据进行目标特征提取,包括:对所述检测结果不符合设定条件的目标数据,进行目标特征提取;Extracting target features from the current target data includes: extracting target features from the target data whose detection results do not meet the set conditions;
    所述相似度阈值按照设定的更新条件被触发更新;The similarity threshold is triggered to be updated according to the set update conditions;
    所述预设范围内包括设定的第二时间段内和/或设定的第二数量;The preset range includes a set second time period and/or a set second number;
    所述场景为安防系统所监控的场景。The scene described is the scene monitored by the security system.
  9. 一种用于提高目标检测的场景适应性的装置,其特征在于,A device for improving scene adaptability of target detection, characterized by:
    目标检测模块,用于获取当前目标数据的检测结果,并对当前目标数据进行目标特征提取;The target detection module is used to obtain the detection results of the current target data and extract target features from the current target data;
    特征匹配模块,用于将每个目标特征与特征库中每个特征进行匹配,其中,所述特征库为按照检测结果为误报或漏报而标定的目标数据的特征集合;A feature matching module, used to match each target feature with each feature in the feature library, where the feature library is a feature set of target data calibrated according to whether the detection result is a false positive or a false negative;
    比较模块,用于将所述检测结果与特征库中被匹配特征所绑定的检测阈值进行比较;A comparison module, used to compare the detection results with the detection threshold bound to the matching feature in the feature library;
    确定模块,用于根据比较结果确定对所述检测结果的处理;A determination module, used to determine the processing of the detection result according to the comparison result;
    阈值调整模块,用于对每个所述被匹配特征所绑定的检测阈值,随着该 被匹配特征与预设范围内目标数据的目标特征之间匹配度而调整。The threshold adjustment module is used to adjust the detection threshold bound to each of the matched features. Adjusted based on the matching degree between the matched feature and the target feature of the target data within the preset range.
  10. 一种目标检测系统,其特征在于,包括如权利要求9所述的用于提高目标检测的场景适应性的装置。 A target detection system, characterized by comprising the device for improving the scene adaptability of target detection as claimed in claim 9.
PCT/CN2023/109613 2022-07-27 2023-07-27 Scene adaptability improvement method and apparatus for object detection, and object detection system WO2024022450A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210889349.X 2022-07-27
CN202210889349.XA CN117523466A (en) 2022-07-27 2022-07-27 Scene adaptability improving method and device for target detection and target detection system

Publications (1)

Publication Number Publication Date
WO2024022450A1 true WO2024022450A1 (en) 2024-02-01

Family

ID=89705465

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/109613 WO2024022450A1 (en) 2022-07-27 2023-07-27 Scene adaptability improvement method and apparatus for object detection, and object detection system

Country Status (2)

Country Link
CN (1) CN117523466A (en)
WO (1) WO2024022450A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130113999A1 (en) * 2011-11-03 2013-05-09 Infosys Technologies, Ltd. Methods, systems, and computer-readable media for detecting scene changes in a video
CN111667501A (en) * 2020-06-10 2020-09-15 杭州海康威视数字技术股份有限公司 Target tracking method and device, computing equipment and storage medium
CN112560787A (en) * 2020-12-28 2021-03-26 深研人工智能技术(深圳)有限公司 Pedestrian re-identification matching boundary threshold setting method and device and related components
CN112637194A (en) * 2020-12-18 2021-04-09 北京天融信网络安全技术有限公司 Security event detection method and device, electronic equipment and storage medium
CN112861673A (en) * 2021-01-27 2021-05-28 长扬科技(北京)有限公司 False alarm removal early warning method and system for multi-target detection of surveillance video
CN112927258A (en) * 2019-11-21 2021-06-08 株式会社日立制作所 Target tracking method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130113999A1 (en) * 2011-11-03 2013-05-09 Infosys Technologies, Ltd. Methods, systems, and computer-readable media for detecting scene changes in a video
CN112927258A (en) * 2019-11-21 2021-06-08 株式会社日立制作所 Target tracking method and device
CN111667501A (en) * 2020-06-10 2020-09-15 杭州海康威视数字技术股份有限公司 Target tracking method and device, computing equipment and storage medium
CN112637194A (en) * 2020-12-18 2021-04-09 北京天融信网络安全技术有限公司 Security event detection method and device, electronic equipment and storage medium
CN112560787A (en) * 2020-12-28 2021-03-26 深研人工智能技术(深圳)有限公司 Pedestrian re-identification matching boundary threshold setting method and device and related components
CN112861673A (en) * 2021-01-27 2021-05-28 长扬科技(北京)有限公司 False alarm removal early warning method and system for multi-target detection of surveillance video

Also Published As

Publication number Publication date
CN117523466A (en) 2024-02-06

Similar Documents

Publication Publication Date Title
US10762117B2 (en) Aggregating results from named entity recognition services
US11216816B1 (en) Identification of anomalous transaction attributes in real-time with adaptive threshold tuning
CN112188531B (en) Abnormality detection method, abnormality detection device, electronic apparatus, and computer storage medium
CN111950329A (en) Target detection and model training method and device, computer equipment and storage medium
US9037518B2 (en) Classifying unclassified samples
CN110083475B (en) Abnormal data detection method and device
CN112560957B (en) Neural network training and detecting method, device and equipment
CN115081969B (en) Abnormal data determination method and related device
US20200293945A1 (en) Apparatus and method of high dimensional data analysis in real-time
CN113554526A (en) Fault early warning method and device for power equipment, storage medium and processor
CN106611151A (en) A human face identification method and apparatus
CN112732690B (en) Stabilizing system and method for chronic disease detection and risk assessment
CN115793990B (en) Memory health state determining method and device, electronic equipment and storage medium
CN107819606A (en) Network attack alarm method and device
WO2024022450A1 (en) Scene adaptability improvement method and apparatus for object detection, and object detection system
US9865158B2 (en) Method for detecting false alarm
CN118133059A (en) Intelligent security risk detection method and system based on digital twinning
CN117196394A (en) Evaluation index processing method, device, computer equipment and storage medium
CN108229585B (en) Log classification method and system
CN112685416A (en) Data missing item filling method and device, computer equipment and storage medium
CN112565227B (en) Abnormal task detection method and device
CN108229689B (en) Deviation classification in semiconductor processing equipment using radial basis function networks and hypercubes
CN110874469A (en) Database high-risk operation detection method and device, computer equipment and storage medium
CN112580700B (en) Data correction method, system and storage medium of electric power Internet of things meter
CN116611267B (en) All-constraint configuration method for priori boundary structure in geophysical prospecting data regularized inversion

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23845657

Country of ref document: EP

Kind code of ref document: A1