WO2023045185A1 - 对象检测方法及装置、电子设备和存储介质 - Google Patents
对象检测方法及装置、电子设备和存储介质 Download PDFInfo
- Publication number
- WO2023045185A1 WO2023045185A1 PCT/CN2022/071050 CN2022071050W WO2023045185A1 WO 2023045185 A1 WO2023045185 A1 WO 2023045185A1 CN 2022071050 W CN2022071050 W CN 2022071050W WO 2023045185 A1 WO2023045185 A1 WO 2023045185A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- detection
- image
- area
- attribute
- object detection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Definitions
- the present disclosure relates to the field of computer technology, and in particular to an object detection method and device, electronic equipment, and a storage medium.
- the disclosure proposes an object detection method and device, electronic equipment, and a storage medium, which can timely and effectively correct the detection result without correcting the algorithm, and improve the accuracy of the detection result.
- an object detection method comprising:
- the false detection region attribute being used to characterize the location and size of the false detection region
- At least one object detection result includes detection area attributes representing the position and size of the detection object;
- the object detection result is screened according to the false detection area attribute and the detection area attribute to obtain an intrusion detection result.
- the determining at least one false detection region attribute includes:
- At least one attribute of the false detection region is determined.
- the false detection region generated in response to the human-computer interaction operation is implemented in the following manner:
- the pre-detection result including at least one preliminary detection frame
- the false detection region generated in response to the human-computer interaction operation is implemented in the following manner:
- determining that the selected area is a falsely detected area includes:
- the determining at least one image frame corresponding to the image to be edited includes:
- the object detection result includes a detection frame coordinate and a corresponding probability value, and the probability value is used to represent the possibility that the target object exists in the image to be detected within the corresponding detection frame coordinate,
- the detection frame coordinates are the attributes of the detection area characterized by coordinates.
- the filtering the object detection result according to the false detection area attribute and the detection area attribute, and obtaining the intrusion detection result includes:
- the intrusion detection result is determined according to the object detection results obtained after the first screening and the second screening.
- the first screening of the object detection result according to the corresponding relationship between the attribute of the false detection area and the attribute of the detection area includes;
- the detection area attribute corresponding to the object in the object detection result is deleted.
- the responding to the fact that the object in the object detection result is located inside the false detection region represented by the false detection region attribute is implemented in the following manner:
- performing the second screening according to the probability value in the object detection result includes:
- the object detection result is deleted.
- the method further includes:
- an object detection device comprising:
- An attribute determination module configured to determine at least one attribute of a false detection region, where the attribute of the false detection region is used to characterize the position and size of the false detection region;
- An image detection module configured to perform object detection on the image to be detected to obtain at least one object detection result, wherein the at least one object detection result includes detection area attributes representing the position and size of the detection object;
- the result screening module is configured to screen the object detection result according to the false detection area attribute and the detection area attribute to obtain an intrusion detection result.
- the attribute determination module includes:
- the human-computer interaction sub-module is configured to determine at least one false detection area attribute in response to the false detection area generated by the human-computer interaction operation.
- the human-computer interaction submodule includes:
- a pre-detection unit configured to perform object detection on the image to be detected and display a pre-detection result of the object detection, the pre-detection result including at least one preliminary detection frame;
- the first area determining unit is configured to, in response to receiving at least one preliminary detection frame selected by the user through human-computer interaction, determine the area represented by the preliminary detection frame as a false detection area.
- the human-computer interaction submodule includes:
- the edit control display unit is used to display the edit control on the scene display interface
- An editing image display unit configured to display an image to be edited corresponding to the image to be detected in response to the editing control being triggered;
- the second area determination unit is configured to, in response to at least one area in the image to be edited being selected, determine that the selected area is a falsely detected area.
- the second area determination unit includes:
- an image frame determining subunit configured to determine at least one image frame corresponding to the image to be edited
- the false detection area determination subunit is configured to determine the area within the at least one image frame as the selected false detection area.
- the image frame determining subunit includes:
- a coordinate receiving subunit configured to, in response to receiving at least one image frame coordinate, determine an image frame corresponding to the at least one image frame coordinate on the image to be edited;
- the gesture determining subunit is configured to, in response to receiving at least one preset gesture corresponding to the image to be edited, project at least one region determined on the image to be edited according to the at least one preset gesture as an image frame.
- the object detection result includes a detection frame coordinate and a corresponding probability value, and the probability value is used to represent the possibility that the target object exists in the image to be detected within the corresponding detection frame coordinate,
- the detection frame coordinates are the attributes of the detection area characterized by coordinates.
- the result screening module includes:
- the first screening submodule is configured to perform a first screening on the object detection result according to the corresponding relationship between the attribute of the false detection area and the attribute of the detection area;
- the second screening submodule is used to perform a second screening on the object detection result according to the probability value in the object detection result;
- the result determination submodule is configured to determine the intrusion detection result according to the object detection results obtained after the first screening and the second screening.
- the first screening submodule includes;
- the position screening unit is configured to delete the detection area attribute corresponding to the object in the object detection result in response to the object in the object detection result being located inside the false detection area represented by the false detection area attribute.
- the location screening unit includes:
- a key point determining subunit configured to determine the key point position of the object in the object detection result
- the positional relationship determination subunit is configured to determine that the detection area represented by the attribute of the detection area is inside the false detection area in response to the position of the key point being inside a false detection area represented by a false detection area attribute.
- the second screening submodule includes:
- a threshold screening unit configured to delete the object detection result in response to a probability value in the object detection result being less than a preset threshold.
- the device further includes:
- An image tagging module configured to tag the image to be detected by the intrusion detection result
- the information display module is used to output the labeled image to be detected and corresponding prompt information.
- an electronic device including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to call the instructions stored in the memory to execute the above method.
- a computer-readable storage medium on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the above method is implemented.
- a computer program product including computer readable codes, or a non-volatile computer readable storage medium bearing computer readable codes, when the computer readable codes are stored in an electronic device
- the processor in the electronic device is used to implement the above method.
- the object detection method defines a false detection area in a specific scene, and filters the detection results obtained based on the false detection area during object detection to improve the accuracy of the detection result. Furthermore, in scenarios such as product demonstrations, this method can also be used to detect and identify false positive results and correct errors in time.
- FIG. 1 shows a flowchart of an object detection method according to an embodiment of the present disclosure
- Fig. 2 shows a flow chart of the process of determining the attribute of a false detection area according to an embodiment of the present disclosure
- Fig. 3 shows a schematic diagram of a scene display interface according to an embodiment of the present disclosure
- Fig. 4 shows a schematic diagram of determining an object detection result according to an embodiment of the present disclosure
- Fig. 5 shows a schematic diagram of a detection result of a screening object according to an embodiment of the present disclosure
- Fig. 6 shows a schematic diagram of judging the correspondence between false detection area attributes and detection area attributes according to an embodiment of the present disclosure
- Fig. 7 shows a schematic diagram of an object detection device according to an embodiment of the present disclosure
- Fig. 8 is a block diagram of an electronic device according to an exemplary embodiment
- Fig. 9 is a block diagram of another electronic device according to an exemplary embodiment.
- Fig. 1 shows a flowchart of an object detection method according to an embodiment of the present disclosure.
- the object detection method may be executed by electronic equipment such as a terminal device or a server, and the terminal device may be user equipment (User Equipment, UE), mobile device, user terminal, terminal, cellular phone, cordless phone , personal digital assistant (Personal Digital Assistant, PDA), handheld device, computing device, vehicle-mounted device, wearable device, etc.
- the subject of execution of the steps of the method can be executed by hardware, or executed by a processor running computer-executable code .
- it may be implemented by a processor calling computer-readable instructions stored in a memory.
- the method may be performed by a server.
- the server may be a single server, or a server cluster composed of multiple servers.
- a terminal device or other processing device can be used to execute the object detection method of the embodiment of the present disclosure to correct the error in the object detection process, thereby improving the object detection process. the accuracy of the results.
- the object detection method of the embodiment of the present disclosure includes the following steps:
- Step S10 determining at least one false detection area attribute.
- the attribute of the false detection area is used to characterize the position and size of the false detection area, for example, may include coordinates of an image frame used to define the false detection area, and the area within the image frame is the false detection area.
- the false detection area is an area where it is more likely that an object will be falsely detected when there is no object during the detection process.
- the false detection area may be determined based on historical object detection results or preliminary detection results of the image to be detected.
- the object detection method in the embodiment of the present disclosure is used for object detection in a fixed scene. That is to say, in the case that false detections often occur in a specific area in the same scene, this area is determined as a false detection area, so that in the subsequent object detection process, the detection results can be filtered through the false detection area attribute of the false detection area, and in Improve the accuracy of detection results without modifying the underlying algorithm.
- the object detection method in the embodiment of the present disclosure is used to correct the detection result of a specific image to be detected. That is to say, before performing formal object detection on the image to be detected, a preliminary object detection is performed first. In the case of a false detection in the result of the preliminary object detection, the false detection area is determined as a false detection area, so that the detection result can be screened by the false detection area attribute of the false detection area in the formal object detection process, and the formal detection can be improved. the accuracy of the results.
- the manner of determining the attribute of the false detection area may be to determine at least one attribute of the false detection area in response to the false detection area generated by the human-computer interaction operation. That is to say, the user can directly interact with the electronic device through the human-computer interaction module of the mouse, keyboard, touch screen and other electronic devices, so as to select at least one false detection according to the historical object detection or the preliminary detection results of the image to be detected.
- the region gets the corresponding false detection region attribute.
- the process of generating a false detection area in response to human-computer interaction in this embodiment of the present disclosure may further include: performing object detection on the image to be detected and displaying a pre-detection result of the object detection, the pre-detection result including at least A preliminary detection box.
- determine the region represented by the preliminary detection frame as a false detection region In response to receiving at least one preliminary detection frame selected by the user through human-computer interaction, determine the region represented by the preliminary detection frame as a false detection region. That is to say, before performing formal object detection on the image to be detected, a preliminary object detection may be performed to obtain a pre-detection result, and the pre-detection result includes at least one preliminary detection frame.
- the electronic device displays the image to be detected with the preliminary detection frame through the display device, and the user can directly identify whether there is an object in each preliminary detection frame, and directly select the preliminary detection frame if it does not exist, so that the area in the preliminary detection frame as the false detection area.
- Fig. 2 shows a flowchart of a process of determining attributes of false detection regions according to an embodiment of the present disclosure. As shown in FIG. 2, the process of determining the attribute of the false detection area in the embodiment of the present disclosure through human-computer interaction includes the following steps:
- Step S11 displaying an editing control on the scene display interface.
- the scene display interface is used to display editing controls.
- the edit control is used to enter the edit mode when triggered, so as to select the false detection area by editing.
- the scene display interface is also used to display the image to be edited corresponding to the image to be detected, and the image information corresponding to the image to be edited.
- the image to be edited corresponds to the image to be detected in this object detection process, and the user can select a false detection area based on the image to be edited after triggering the editing control.
- the scene display interface may also display content such as image modification controls for replacing, adding, and deleting images to be edited.
- Step S12 in response to the editing control being triggered, displaying an image to be edited corresponding to the image to be detected.
- the user may click on the touch screen of the electronic device through a preset gesture, and trigger the editing control through a mouse click or double click.
- the editing control When the editing control is triggered, the editing mode is entered, that is, the image to be edited is displayed on the scene display interface.
- the image to be edited is not redisplayed, and the image to be edited is directly converted from a non-editable state to an editable state.
- the image to be edited is not displayed in the scene display interface, the image to be edited corresponding to the image to be detected is loaded and displayed, and the state of the image to be edited is set as an editable state.
- the image to be edited may be the same image as the scene where the image to be detected needs to be detected, and may be selected according to different application scenarios. For example, in an application scenario where formal object detection is performed on an image that has undergone preliminary object detection, the image to be detected may be directly determined as the image to be edited. In the application scenario where the object detection result of the image to be detected is corrected according to the detection result of the historical image, the image collected in the same acquisition scene and for which the object detection has been completed can be obtained as the image to be edited.
- the collection scene may be scenes such as stairwells, streets, corridors, and residential areas.
- the image to be edited also displays the location of the object detected after historical object detection or preliminary object detection, and the location can be marked by a corresponding detection frame.
- Step S13 in response to at least one area in the image to be edited being selected, determining that the selected area is a falsely detected area.
- the incorrectly detected area is determined by selecting a partial area in the image to be edited.
- a partial area in the image to be edited is selected by adding an image frame on the image to be edited. That is to say, at least one image frame corresponding to the image to be edited is determined, and an area within the at least one image frame is determined as a selected false detection area.
- the image frame corresponding to the image to be edited can be added in different ways.
- an image frame corresponding to at least one image frame coordinate may be determined on the image to be edited. That is, the user can input the coordinates of the image frame representing the position of the image frame to be edited through peripheral devices such as a keyboard and a mouse, and the electronic device directly determines the corresponding image frame when receiving the coordinates of the image frame.
- a corresponding image frame may be determined according to a position of the at least one preset gesture on the image to be edited. That is to say, the user can also directly draw a corresponding image frame on the image to be edited by dragging with a mouse or dragging with a gesture.
- the user can add image frames according to each detection frame.
- the user can also directly select some of the detection frames as image frames.
- the attribute of the false detection area may be the coordinates of each image frame representing the false detection area.
- FIG. 3 shows a schematic diagram of a scene display interface 30 according to an embodiment of the present disclosure.
- the scene display interface 30 can be used to display an edit control 31 , and the edit control 31 is used to enter an edit mode when triggered.
- the scene display interface 30 can also be used to display the image to be edited 32 and the image information 34 corresponding to the image to be edited 32 .
- the image to be edited 32 is in an uneditable state, and after the edit control 32 is triggered, the image to be edited 32 enters an editable state.
- the image to be edited 32 also has a corresponding detection frame 33 , and the detection frame 33 represents an area where an object is detected in the image to be edited 32 after preliminary object detection or historical object detection.
- the user can select at least one corresponding false detection area based on the marked detection frame 33 in the image 32 to be edited.
- the electronic device may also directly receive the attributes of false detection areas transmitted by other devices.
- Step S20 perform object detection on the image to be detected, and obtain at least one object detection result.
- At least one object detection result is obtained by performing object detection on a predetermined image to be detected.
- the detection method may be to input the image to be detected into the trained object detection model to perform object detection, and output at least one object detection result.
- at least one object detection result includes the coordinates of the detection frame and the corresponding probability value, the probability value is used to represent the possibility of the target object in the corresponding detection frame coordinates of the image to be detected, and the detection frame coordinates can be the detection represented by coordinates Region properties.
- the object detection model will detect the detection area that may be a human face in the image to be detected, and output the coordinates of the detection frame surrounding each detection area, and each detection area includes human faces. The probability value of the face.
- Fig. 4 shows a schematic diagram of determining an object detection result according to an embodiment of the present disclosure.
- the image to be detected 40 is input into a pre-trained object detection model 41 , and a corresponding object detection result 42 is output.
- the content included in the object detection result 42 is determined according to the output format of the object detection model 41 .
- the detection method may also be inputting the image to be detected into the trained object detection model, and the object detection model extracts image features for object detection, and only determines the obtained multiple The detection frame coordinates of possible objects are used as the object detection results, and the detection results of each object are screened based on the position, and then the probability value detection is further performed to obtain the intrusion detection results.
- Step S30 Filter the object detection result according to the attribute of the false detection area and the attribute of the detection area to obtain an intrusion detection result.
- the detection area attribute is used to represent the position and size of the detection area corresponding to the object detection result, and the detection area is the detected area where the object may exist in the image to be detected.
- the area surrounded by the detection frame is the detection area, and the position and size of the corresponding area can be directly determined according to the coordinates of the detection frame to obtain the attributes of the detection area.
- the object detection result includes detection frame coordinates and corresponding probability values.
- the way to determine the intrusion detection result can be to first screen the object detection result according to the corresponding relationship between the false detection area attribute and the detection area attribute, and then according to the probability value in the object detection result, the object detection As a result, the second screening is performed, and the intrusion detection result is determined according to the detection results of each object obtained after the first screening and the second screening.
- the first screening process may be to delete the detection area attribute corresponding to the object in the object detection result in response to the fact that the detection area corresponding to the detection area attribute is inside a false detection area represented by a false detection area attribute. That is to say, when there is a false detection region attribute corresponding to the positional relationship of the detection region attribute, it is considered that the probability of the current object detection result being a false detection result is high, and the object detection result is deleted.
- the corresponding positional relationship means that the corresponding detection area is inside or overlaps with the false detection area.
- the manner of judging whether the detection area is inside the false detection area may be determined by determining the positions of key points in the detection area. For example, the key point position of the object in the object detection result is determined, and in response to the key point position being inside a false detection area represented by a false detection area attribute, the detection area represented by the detection area attribute is determined to be inside the false detection area.
- the center position of the detection area or the center position of the bottom edge may be set as the key point, and when the key point is inside a false detection area, it is determined that the detection area is inside the false detection area.
- the second screening process may be to delete the object detection result in response to the probability value in the object detection result being less than a preset threshold. That is to say, when the probability value included in the object detection result is less than the preset threshold, it is considered that the object detection result corresponds to a low probability of an object existing in the detection area, and the object detection result is deleted. For example, when there are three object detection result 1, object detection result 2 and object detection result 3 with probability values of 0.68, 0.59 and 0.81 respectively, and the preset threshold value is 0.6, delete object detection result 2 and keep object detection result Result 1 and object detection result 3.
- FIG. 5 shows a schematic diagram of a screening object detection result 50 according to an embodiment of the present disclosure.
- the object detection result 50 includes detection frame coordinates and probability values.
- the detection area attribute 51 representing the position and size of the detection area is first determined according to the detection frame coordinates in the object detection result. Further, the first screening is performed by comparing whether there is a corresponding relationship between the detection area attribute 51 and each false detection area attribute 52, and the corresponding relationship is whether the represented detection area coincides with the false detection area or is inside the false detection area. If there is a corresponding false detection area attribute 52, the object detection result 50 is directly deleted.
- the probability value 53 in the detection region attribute is further obtained for the second screening, that is, the magnitude of the probability value 53 and the preset threshold 54 is compared. If the probability value 53 is less than the preset threshold 54, the object detection result 50 is deleted. If the probability value 53 is not less than the preset threshold 54 , an intrusion detection result 55 is further determined according to the object detection result 50 .
- the execution order of the first screening process and the second screening process can be set randomly, which is not limited here.
- Fig. 6 shows a schematic diagram of judging the corresponding relationship between false detection area attributes and detection area attributes according to an embodiment of the present disclosure. As shown in FIG. 6 , in the embodiment of the present disclosure, it may be determined whether the attribute of the false detection area corresponds to the attribute of the detection area according to the positional relationship.
- the embodiment of the present disclosure predetermines two false detection region attributes, and each false detection region attribute corresponds to the first false detection region 62 and the second false detection region 63 as an example for illustration.
- the detection area attributes corresponding to each object detection result represent the first detection area 60 and the second detection area 61 respectively, by judging the first detection area 60 and the second detection area 61 respectively.
- the positional relationship between the first false detection area 62 and the second false detection area 63 filters the object detection results.
- the feature point of the detection area when the feature point of the detection area is within the false detection area, it is judged that the detection area corresponds to the false detection area, and the object detection result corresponding to the detection area is deleted.
- the feature point can be any point in the detection area, for example, it can be a center point, a vertex of the detection area, and the like.
- the second detection area 61 in FIG. 6 corresponds to the first false detection area 62 , that is, the object detection result corresponding to the second detection area 61 is deleted.
- the screening process may also be directly completed in the object detection model of the input image to be detected.
- the object detection model first extracts image features for object detection, and only determines the obtained detection frame coordinates of multiple possible objects as the object detection result. Further, the object detection model performs screening according to the correspondence between the coordinates of the detection frame in each object detection result and the attributes of each false detection area, and deletes the object detection results with corresponding false detection area attributes. The object detection model further detects the probability values of the objects in the multiple detection frame coordinates obtained after screening, and adds the coordinates and corresponding probability values of the detection frames whose probability values are greater than the preset threshold to the intrusion detection results. Finally, according to the screening results and Each probability value output does not include an object detection result, or an intrusion detection result that includes at least one detection result.
- the image to be detected is marked according to the intrusion detection result, and the marked image to be detected and corresponding prompt information are output.
- This method can remind the user of the detection result of this time, and can also be used as an image to be edited in the next detection process to correct the next detection result.
- the embodiments of the present disclosure can delineate corresponding false detection regions through detected images in specific acquisition scenarios, and filter detection results obtained based on false detection regions during object detection to improve the accuracy of detection results. Furthermore, in scenarios such as product demonstrations, this method can also be used to detect and identify false positive results and correct errors in time.
- the present disclosure also provides object detection devices, electronic equipment, computer-readable storage media, and programs, all of which can be used to implement any object detection method provided in the present disclosure.
- object detection devices electronic equipment, computer-readable storage media, and programs, all of which can be used to implement any object detection method provided in the present disclosure.
- FIG. 7 shows a schematic diagram of an object detection device according to an embodiment of the present disclosure.
- the object detection device of the embodiment of the present disclosure includes:
- An attribute determining module 70 configured to determine at least one attribute of the false detection region, the attribute of the false detection region is used to characterize the position and size of the false detection region;
- the image detection module 71 is configured to perform object detection on the image to be detected to obtain at least one object detection result, wherein the at least one object detection result includes detection area attributes representing the position and size of the detection object;
- the result screening module 72 is configured to screen the object detection result according to the false detection area attribute and the detection area attribute to obtain an intrusion detection result.
- the attribute determination module includes:
- the human-computer interaction sub-module is configured to determine at least one false detection area attribute in response to the false detection area generated by the human-computer interaction operation.
- the human-computer interaction submodule includes:
- a pre-detection unit configured to perform object detection on the image to be detected and display a pre-detection result of the object detection, the pre-detection result including at least one preliminary detection frame;
- the first area determining unit is configured to, in response to receiving at least one preliminary detection frame selected by the user through human-computer interaction, determine the area represented by the preliminary detection frame as a false detection area.
- the human-computer interaction submodule includes:
- the edit control display unit is used to display the edit control on the scene display interface
- An editing image display unit configured to display an image to be edited corresponding to the image to be detected in response to the editing control being triggered;
- the second area determination unit is configured to, in response to at least one area in the image to be edited being selected, determine that the selected area is a falsely detected area.
- the second area determination unit includes:
- an image frame determining subunit configured to determine at least one image frame corresponding to the image to be edited
- the false detection area determination subunit is configured to determine the area within the at least one image frame as the selected false detection area.
- the image frame determining subunit includes:
- a coordinate receiving subunit configured to, in response to receiving at least one image frame coordinate, determine an image frame corresponding to the at least one image frame coordinate on the image to be edited;
- the gesture determining subunit is configured to, in response to receiving at least one preset gesture corresponding to the image to be edited, project at least one region determined on the image to be edited according to the at least one preset gesture as an image frame.
- the object detection result includes a detection frame coordinate and a corresponding probability value, and the probability value is used to represent the possibility that the target object exists in the image to be detected within the corresponding detection frame coordinate,
- the detection frame coordinates are the attributes of the detection area characterized by coordinates.
- the result screening module includes:
- the first screening submodule is configured to perform a first screening on the object detection result according to the corresponding relationship between the attribute of the false detection area and the attribute of the detection area;
- the second screening submodule is used to perform a second screening on the object detection result according to the probability value in the object detection result;
- the result determination submodule is configured to determine the intrusion detection result according to the object detection results obtained after the first screening and the second screening.
- the first screening submodule includes;
- the position screening unit is configured to delete the detection area attribute corresponding to the object in the object detection result in response to the object in the object detection result being located inside the false detection area represented by the false detection area attribute.
- the location screening unit includes:
- a key point determining subunit configured to determine the key point position of the object in the object detection result
- the positional relationship determination subunit is configured to determine that the detection area represented by the attribute of the detection area is inside the false detection area in response to the position of the key point being inside a false detection area represented by a false detection area attribute.
- the second screening submodule includes:
- a threshold screening unit configured to delete the object detection result in response to a probability value in the object detection result being less than a preset threshold.
- the device further includes:
- An image tagging module configured to tag the image to be detected by the intrusion detection result
- the information display module is used to output the labeled image to be detected and corresponding prompt information.
- the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the methods described in the method embodiments above, and its specific implementation can refer to the description of the method embodiments above. For brevity, here No longer.
- Embodiments of the present disclosure also provide a computer-readable storage medium, on which computer program instructions are stored, and the above-mentioned method is implemented when the computer program instructions are executed by a processor.
- Computer readable storage media may be volatile or nonvolatile computer readable storage media.
- An embodiment of the present disclosure also proposes an electronic device, including: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to invoke the instructions stored in the memory to execute the above method.
- An embodiment of the present disclosure also provides a computer program product, including computer-readable codes, or a non-volatile computer-readable storage medium carrying computer-readable codes, when the computer-readable codes are stored in a processor of an electronic device When running in the electronic device, the processor in the electronic device executes the above method.
- Electronic devices may be provided as terminals, servers, or other forms of devices.
- Fig. 8 is a block diagram of an electronic device 800 according to an exemplary embodiment.
- the electronic device 800 may be a terminal such as a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, or a personal digital assistant.
- electronic device 800 may include one or more of the following components: processing component 802, memory 804, power supply component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814 , and the communication component 816.
- the processing component 802 generally controls the overall operations of the electronic device 800, such as those associated with display, telephone calls, data communications, camera operations, and recording operations.
- the processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above method. Additionally, processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802 .
- the memory 804 is configured to store various types of data to support operations at the electronic device 800 . Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phonebook data, messages, pictures, videos, and the like.
- the memory 804 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.
- SRAM static random access memory
- EEPROM electrically erasable programmable read-only memory
- EPROM erasable Programmable Read Only Memory
- PROM Programmable Read Only Memory
- ROM Read Only Memory
- Magnetic Memory Flash Memory
- Magnetic or Optical Disk Magnetic Disk
- the power supply component 806 provides power to various components of the electronic device 800 .
- Power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for electronic device 800 .
- the multimedia component 808 includes a screen providing an output interface between the electronic device 800 and the user.
- the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user.
- the touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense a boundary of a touch or swipe action, but also detect duration and pressure associated with the touch or swipe action.
- the multimedia component 808 includes a front camera and/or a rear camera. When the electronic device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capability.
- the audio component 810 is configured to output and/or input audio signals.
- the audio component 810 includes a microphone (MIC), which is configured to receive external audio signals when the electronic device 800 is in operation modes, such as call mode, recording mode and voice recognition mode. Received audio signals may be further stored in memory 804 or sent via communication component 816 .
- the audio component 810 also includes a speaker for outputting audio signals.
- the I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, and the like. These buttons may include, but are not limited to: a home button, volume buttons, start button, and lock button.
- Sensor assembly 814 includes one or more sensors for providing status assessments of various aspects of electronic device 800 .
- the sensor component 814 can detect the open/closed state of the electronic device 800, the relative positioning of components, such as the display and the keypad of the electronic device 800, the sensor component 814 can also detect the electronic device 800 or a Changes in position of components, presence or absence of user contact with electronic device 800 , electronic device 800 orientation or acceleration/deceleration and temperature changes in electronic device 800 .
- Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact.
- Sensor assembly 814 may also include an optical sensor, such as a complementary metal-oxide-semiconductor (CMOS) or charge-coupled device (CCD) image sensor, for use in imaging applications.
- CMOS complementary metal-oxide-semiconductor
- CCD charge-coupled device
- the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.
- the communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices.
- the electronic device 800 can access a wireless network based on a communication standard, such as a wireless network (WiFi), a second generation mobile communication technology (2G) or a third generation mobile communication technology (3G), or a combination thereof.
- the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel.
- the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication.
- the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wide Band (UWB) technology, Bluetooth (BT) technology and other technologies.
- RFID Radio Frequency Identification
- IrDA Infrared Data Association
- UWB Ultra Wide Band
- Bluetooth Bluetooth
- electronic device 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation for performing the methods described above.
- ASICs application specific integrated circuits
- DSPs digital signal processors
- DSPDs digital signal processing devices
- PLDs programmable logic devices
- FPGA field programmable A programmable gate array
- controller microcontroller, microprocessor or other electronic component implementation for performing the methods described above.
- a non-volatile computer-readable storage medium such as the memory 804 including computer program instructions, which can be executed by the processor 820 of the electronic device 800 to implement the above method.
- Fig. 9 is a block diagram of an electronic device 900 according to an exemplary embodiment.
- the electronic device 900 may be provided as a server.
- electronic device 900 includes processing component 922 , which further includes one or more processors, and a memory resource represented by memory 932 for storing instructions executable by processing component 922 , such as application programs.
- the application program stored in memory 932 may include one or more modules each corresponding to a set of instructions.
- the processing component 922 is configured to execute instructions to perform the above method.
- Electronic device 900 may also include a power supply component 926 configured to perform power management of electronic device 900, a wired or wireless network interface 950 configured to connect electronic device 900 to a network, and an input-output (I/O) interface 958 .
- the electronic device 900 can operate based on the operating system stored in the memory 932, such as the Microsoft server operating system (Windows Server TM ), the operating system based on the graphical user interface (Mac OS X TM ) introduced by Apple Inc., and the multi-user and multi-process computer operating system (Unix TM ), a free and open-source Unix-like operating system (Linux TM ), an open-source Unix-like operating system (FreeBSD TM ), or the like.
- Microsoft server operating system Windows Server TM
- Mac OS X TM graphical user interface
- Uniix TM multi-user and multi-process computer operating system
- FreeBSD TM open-source Unix-like operating system
- a non-transitory computer-readable storage medium such as the memory 932 including computer program instructions, which can be executed by the processing component 922 of the electronic device 900 to implement the above method.
- the present disclosure can be a system, method and/or computer program product.
- a computer program product may include a computer readable storage medium having computer readable program instructions thereon for causing a processor to implement various aspects of the present disclosure.
- a computer readable storage medium may be a tangible device that can retain and store instructions for use by an instruction execution device.
- a computer readable storage medium may be, for example, but is not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing.
- Computer-readable storage media include: portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or flash memory), static random access memory (SRAM), compact disc read only memory (CD-ROM), digital versatile disc (DVD), memory stick, floppy disk, mechanically encoded device, such as a printer with instructions stored thereon A hole card or a raised structure in a groove, and any suitable combination of the above.
- RAM random access memory
- ROM read-only memory
- EPROM erasable programmable read-only memory
- flash memory static random access memory
- SRAM static random access memory
- CD-ROM compact disc read only memory
- DVD digital versatile disc
- memory stick floppy disk
- mechanically encoded device such as a printer with instructions stored thereon
- a hole card or a raised structure in a groove and any suitable combination of the above.
- computer-readable storage media are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., pulses of light through fiber optic cables), or transmitted electrical signals.
- the computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or downloaded to an external computer or external storage device over a network, such as the Internet, local area network, wide area network, and/or wireless network.
- the network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers.
- a network adapter card or a network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .
- Computer program instructions for performing the operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or Source or object code written in any combination, including object-oriented programming languages—such as Smalltalk, C++, etc., and conventional procedural programming languages—such as the “C” language or similar programming languages.
- Computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement.
- the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as via the Internet using an Internet service provider). connect).
- LAN local area network
- WAN wide area network
- an electronic circuit such as a programmable logic circuit, field programmable gate array (FPGA), or programmable logic array (PLA)
- FPGA field programmable gate array
- PDA programmable logic array
- These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine such that when executed by the processor of the computer or other programmable data processing apparatus , producing an apparatus for realizing the functions/actions specified in one or more blocks in the flowchart and/or block diagram.
- These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause computers, programmable data processing devices and/or other devices to work in a specific way, so that the computer-readable medium storing instructions includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks in flowcharts and/or block diagrams.
- each block in a flowchart or block diagram may represent a module, a portion of a program segment, or an instruction that includes one or more Executable instructions.
- the functions noted in the block may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved.
- each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented by a dedicated hardware-based system that performs the specified function or action , or may be implemented by a combination of dedicated hardware and computer instructions.
- the computer program product can be specifically realized by means of hardware, software or a combination thereof.
- the computer program product is embodied as a computer storage medium, and in another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK) etc. wait.
- a software development kit Software Development Kit, SDK
Landscapes
- Image Analysis (AREA)
Abstract
Description
Claims (16)
- 一种对象检测方法,其特征在于,所述方法包括:确定至少一个误检区域属性,所述误检区域属性用于表征误检测区域的位置和尺寸;对待检测图像进行对象检测,得到至少一个对象检测结果,其中,所述至少一个对象检测结果包括表征检测对象的位置和尺寸的检测区域属性;根据所述误检区域属性和所述检测区域属性对所述对象检测结果进行筛选,得到入侵检测结果。
- 根据权利要求1所述的方法,其特征在于,所述确定至少一个误检区域属性包括:响应于人机交互操作生成的误检测区域,确定至少一个误检测区域属性。
- 根据权利要求2所述的方法,其特征在于,所述响应于人机交互操作生成的误检测区域,通过以下方式实现:对所述待检测图像进行对象检测并显示所述对象检测的预检测结果,所述预检测结果中包括至少一个初步检测框;响应于接收到用户通过人机交互操作选中的至少一个初步检测框,确定所述初步检测框表征的区域为误检测区域。
- 根据权利要求2所述的方法,其特征在于,所述响应于人机交互操作生成的误检测区域,通过以下方式实现:在场景显示界面显示编辑控件;响应于所述编辑控件被触发,显示与所述待检测图像对应的待编辑图像;响应于所述待编辑图像中的至少一个区域被选中,确定被选中所述区域为误检测区域。
- 根据权利要求4所述的方法,其特征在于,所述响应于所述待编辑图像中的至少一个区域被选中,确定被选中所述区域为误检测区域包括:确定所述待编辑图像对应的至少一个图像框;确定所述至少一个图像框内的区域为被选中的误检测区域。
- 根据权利要求5所述的方法,其特征在于,所述确定所述待编辑图像对应的至少一个图像框包括:响应于接收到至少一个图像框坐标,在所述待编辑图像上确定所述至少一个图像框坐标对应的图像框;或者响应于接收到对应于所述待编辑图像的至少一个预设手势,根据所述至少一个预设手势投影在所述待编辑图像上确定的至少一个区域作为图像框。
- 根据权利要求1-6中任意一项所述的方法,其特征在于,所述对象检测结果中包括检测框坐标和对应的概率值,所述概率值用于表征所述待检测图像在对应检测框坐标内存在目标对象的可能性,所述检测框坐标为通过坐标方式表征的检测区域属性。
- 根据权利要求7所述的方法,其特征在于,所述根据所述误检区域属性和所述检测区域属性对所述对象检测结果进行筛选,得到入侵检测结果包括:根据所述误检区域属性与所述检测区域属性的对应关系,对所述对象检测结果进行第一次筛选;根据所述对象检测结果中的概率值,对所述对象检测结果进行第二次筛选;根据第一次筛选和第二次筛选后得到的对象检测结果确定入侵检测结果。
- 根据权利要求8所述的方法,其特征在于,所述根据所述误检区域属性与所述检测区域属性的对应关系,对所述对象检测结果进行第一次筛选包括;响应于所述对象检测结果中的对象位于所述误检区域属性表征的误检测区域内部,删除所述对象检测结果中的所述对象对应的检测区域属性。
- 根据权利要求9所述的方法,其特征在于,所述响应于所述对象检测结果中的对象位于所述误检区域属性表征的误检测区域内部,通过以下方式实现:确定所述对象检测结果中的对象的关键点位置;响应于所述关键点位置在一个误检区域属性表征的误检区域内部,确定所述检测区域属性表征得到检测区域在所述误检区域内部。
- 根据权利要求8-10中任意一项所述的方法,其特征在于,所述根据所述对象检测结果中的概率值进行第二次筛选包括:响应于对象检测结果中的概率值小于预设阈值,删除所述对象检测结果。
- 根据权利要求1-11中任意一项所述的方法,其特征在于,所述方法还包括:通过所述入侵检测结果标注所述待检测图像;输出标注后的待检测图像和对应的提示信息。
- 一种对象检测装置,其特征在于,所述装置包括:属性确定模块,用于确定至少一个误检区域属性,所述误检区域属性用于表征误检测区域的位置和尺寸;图像检测模块,用于对待检测图像进行对象检测,得到至少一个对象检测结果,其中,所述至少一个对象检测结果包括表征检测对象的位置和尺寸的检测区域属性;结果筛选模块,用于根据所述误检区域属性和所述检测区域属性对所述对象检测结果进行筛选,得到入侵检测结果。
- 一种电子设备,其特征在于,包括:处理器;用于存储处理器可执行指令的存储器;其中,所述处理器被配置为调用所述存储器存储的指令,以执行权利要求1至12中任意一项所述的方法。
- 一种计算机可读存储介质,其上存储有计算机程序指令,其特征在于,所述计算机程序指令被处理器执行时实现权利要求1至12中任意一项所述的方法。
- 一种计算机程序产品,包括计算机可读代码,或者承载有计算机可读代码的非易失性计算机可读存储介质,其特征在于,当所述计算机可读代码在电子设备的处理器中运行时,所述电子设备中的处理器执行用于实现权利要求1-12中的任意一项所述的方法。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111135692.7A CN113869295B (zh) | 2021-09-27 | 2021-09-27 | 对象检测方法及装置、电子设备和存储介质 |
| CN202111135692.7 | 2021-09-27 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023045185A1 true WO2023045185A1 (zh) | 2023-03-30 |
Family
ID=78991101
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2022/071050 Ceased WO2023045185A1 (zh) | 2021-09-27 | 2022-01-10 | 对象检测方法及装置、电子设备和存储介质 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113869295B (zh) |
| WO (1) | WO2023045185A1 (zh) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113869295B (zh) * | 2021-09-27 | 2025-09-16 | 上海商汤智能科技有限公司 | 对象检测方法及装置、电子设备和存储介质 |
| CN116245857A (zh) * | 2023-03-07 | 2023-06-09 | 深圳绿米联创科技有限公司 | 目标检测方法、装置、电子设备及存储介质 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090180670A1 (en) * | 2006-05-09 | 2009-07-16 | Hiroshi Iwamura | Blocker image identification apparatus and method |
| CN109859177A (zh) * | 2019-01-17 | 2019-06-07 | 航天新长征大道科技有限公司 | 基于深度学习的工业射线影像评定方法及装置 |
| CN112115913A (zh) * | 2020-09-28 | 2020-12-22 | 杭州海康威视数字技术股份有限公司 | 图像处理方法、装置及设备、存储介质 |
| CN113869295A (zh) * | 2021-09-27 | 2021-12-31 | 上海商汤智能科技有限公司 | 对象检测方法及装置、电子设备和存储介质 |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007325170A (ja) * | 2006-06-05 | 2007-12-13 | Oki Electric Ind Co Ltd | 映像監視装置及び方法 |
| CN102411703A (zh) * | 2010-09-21 | 2012-04-11 | 索尼公司 | 检测图像序列中的特定对象的装置、方法和视频摄像设备 |
| KR102348593B1 (ko) * | 2017-10-26 | 2022-01-06 | 삼성에스디에스 주식회사 | 기계 학습 기반의 객체 검출 방법 및 그 장치 |
| CN110781821B (zh) * | 2019-10-25 | 2022-11-01 | 上海商汤智能科技有限公司 | 基于无人机的目标检测方法及装置、电子设备和存储介质 |
| CN112700657B (zh) * | 2020-12-21 | 2023-04-28 | 阿波罗智联(北京)科技有限公司 | 用于生成检测信息的方法、装置、路侧设备和云控平台 |
| CN112926510A (zh) * | 2021-03-25 | 2021-06-08 | 深圳市商汤科技有限公司 | 异常驾驶行为识别方法及装置、电子设备和存储介质 |
-
2021
- 2021-09-27 CN CN202111135692.7A patent/CN113869295B/zh active Active
-
2022
- 2022-01-10 WO PCT/CN2022/071050 patent/WO2023045185A1/zh not_active Ceased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090180670A1 (en) * | 2006-05-09 | 2009-07-16 | Hiroshi Iwamura | Blocker image identification apparatus and method |
| CN109859177A (zh) * | 2019-01-17 | 2019-06-07 | 航天新长征大道科技有限公司 | 基于深度学习的工业射线影像评定方法及装置 |
| CN112115913A (zh) * | 2020-09-28 | 2020-12-22 | 杭州海康威视数字技术股份有限公司 | 图像处理方法、装置及设备、存储介质 |
| CN113869295A (zh) * | 2021-09-27 | 2021-12-31 | 上海商汤智能科技有限公司 | 对象检测方法及装置、电子设备和存储介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113869295A (zh) | 2021-12-31 |
| CN113869295B (zh) | 2025-09-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11288531B2 (en) | Image processing method and apparatus, electronic device, and storage medium | |
| CN106970754B (zh) | 截屏处理的方法及装置 | |
| CN114078118A (zh) | 缺陷检测方法及装置、电子设备和存储介质 | |
| CN110287874A (zh) | 目标追踪方法及装置、电子设备和存储介质 | |
| EP3301557A1 (en) | Method, apparatus and computer program product for sharing content | |
| CN110647834A (zh) | 人脸和人手关联检测方法及装置、电子设备和存储介质 | |
| WO2022134382A1 (zh) | 图像分割方法及装置、电子设备和存储介质、计算机程序 | |
| CN108509232A (zh) | 屏幕录制方法、装置及计算机可读存储介质 | |
| EP3147802B1 (en) | Method and apparatus for processing information | |
| WO2016192325A1 (zh) | 视频文件的标识处理方法及装置 | |
| WO2022134390A1 (zh) | 标注方法及装置、电子设备和存储介质 | |
| CN110990801A (zh) | 信息校验方法及装置、电子设备和存储介质 | |
| WO2023040202A1 (zh) | 人脸识别方法及装置、电子设备和存储介质 | |
| CN106354504B (zh) | 消息显示方法及装置 | |
| CN108829473A (zh) | 事件响应方法、装置及存储介质 | |
| CN106331328B (zh) | 信息提示的方法及装置 | |
| CN105353938A (zh) | 悬浮短信显示方法及装置 | |
| CN110807393A (zh) | 基于视频分析的预警方法及装置、电子设备和存储介质 | |
| CN113869295B (zh) | 对象检测方法及装置、电子设备和存储介质 | |
| CN106650569B (zh) | 指纹录入方法及装置 | |
| CN112381223A (zh) | 神经网络训练与图像处理方法及装置 | |
| CN111832455A (zh) | 获取内容图像的方法、装置、存储介质和电子设备 | |
| CN107580142B (zh) | 一种执行处理的方法和装置 | |
| CN107977127B (zh) | 更新页面的方法、装置及终端 | |
| CN112083841B (zh) | 信息输入方法、装置和存储介质 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 22871253 Country of ref document: EP Kind code of ref document: A1 |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 22871253 Country of ref document: EP Kind code of ref document: A1 |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 03/12/2024) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 22871253 Country of ref document: EP Kind code of ref document: A1 |