WO2022227764A1 - Event detection method and apparatus, electronic device, and readable storage medium - Google Patents
Event detection method and apparatus, electronic device, and readable storage medium Download PDFInfo
- Publication number
- WO2022227764A1 WO2022227764A1 PCT/CN2022/075019 CN2022075019W WO2022227764A1 WO 2022227764 A1 WO2022227764 A1 WO 2022227764A1 CN 2022075019 W CN2022075019 W CN 2022075019W WO 2022227764 A1 WO2022227764 A1 WO 2022227764A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- event
- detected
- image data
- detection
- detection result
- Prior art date
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 133
- 238000000034 method Methods 0.000 claims description 34
- 230000002159 abnormal effect Effects 0.000 claims description 25
- 238000012545 processing Methods 0.000 claims description 20
- 238000004590 computer program Methods 0.000 claims description 10
- 238000012790 confirmation Methods 0.000 claims description 10
- 238000013473 artificial intelligence Methods 0.000 abstract description 3
- 238000013135 deep learning Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 11
- 238000004891 communication Methods 0.000 description 8
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 8
- 238000004458 analytical method Methods 0.000 description 6
- 230000010365 information processing Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 4
- 238000012549 training Methods 0.000 description 4
- 238000007726 management method Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 201000004569 Blindness Diseases 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/44—Event detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/35—Categorising the entire scene, e.g. birthday party or wedding scene
- G06V20/38—Outdoor scenes
- G06V20/39—Urban scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/46—Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/07—Target detection
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A30/00—Adapting or protecting infrastructure or their operation
- Y02A30/60—Planning or developing urban green infrastructure
Definitions
- the present disclosure relates to the technical field of artificial intelligence, in particular to the technical field of computer vision and deep learning, and can be applied to smart city scenarios.
- a method, apparatus, electronic device, and readable storage medium for event detection are provided.
- the present disclosure provides an event detection method, apparatus, electronic device, and readable storage medium, which are used to improve the accuracy and efficiency of event detection.
- a method for event detection comprising: acquiring image data, identifying an urban scene of the image data; determining a target to be detected and an event to be detected corresponding to the urban scene; The object to be detected in the image data is detected to obtain the detection state of the event to be detected; and the event detection result of the image data is obtained according to the detection state of the event to be detected.
- an apparatus for event detection comprising: an acquisition unit for acquiring image data and identifying an urban scene of the image data; a determining unit for determining an image corresponding to the urban scene A target to be detected and an event to be detected; a detection unit, used for detecting the target to be detected in the image data, to obtain a detection state of the event to be detected; a processing unit, used to detect the state of the event to be detected according to the detection state to obtain the event detection result of the image data.
- an electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores information that can be used by the at least one processor Instructions that are executed, the instructions being executed by the at least one processor to enable the at least one processor to perform the method as described above.
- a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to perform the method as described above.
- a computer program product comprising a computer program which, when executed by a processor, implements the method as described above.
- the present disclosure first identifies the urban scene of the acquired image data, then determines the to-be-detected target and the to-be-detected event corresponding to the urban scene, and finally detects the to-be-detected target in the image data, thereby The event detection result of the image data is obtained according to the obtained detection state of the event to be detected. Since different urban scenes, different targets to be detected and the event to be detected are corresponding to the event to be detected, the present disclosure can improve the accuracy and efficiency of event detection .
- FIG. 1 is a schematic diagram according to a first embodiment of the present disclosure
- FIG. 2 is a schematic diagram according to a second embodiment of the present disclosure.
- FIG. 3 is a schematic diagram according to a third embodiment of the present disclosure.
- FIG. 4 is a schematic diagram according to a fourth embodiment of the present disclosure.
- FIG. 5 is a block diagram of an electronic device used to implement the method of event detection according to an embodiment of the present disclosure.
- FIG. 1 is a schematic diagram according to a first embodiment of the present disclosure. As shown in FIG. 1 , the method for event detection in this embodiment may specifically include the following steps:
- the event detection method of this embodiment firstly identifies the urban scene of the acquired image data, then determines the to-be-detected target and the to-be-detected event corresponding to the urban scene, and finally detects the to-be-detected target in the image data.
- the event detection result of the image data is obtained by obtaining the detection state of the to-be-detected event. Since different urban scenes, different to-be-detected targets and to-be-detected events are corresponding, this embodiment can improve the accuracy and efficiency of event detection.
- the image data obtained by executing S101 in this embodiment may be extracted from video stream data captured in real time by a camera device in a certain monitoring area of the city; the obtained image data includes at least one image of the city, so The included urban images may correspond to at least one of urban scenes such as roads, squares, and schools.
- an optional implementation method that may be adopted is: acquiring video stream data of a city, where different video stream data correspond to different urban scenes; extracting at least one image from the acquired video stream data key frame images as image data.
- the city scene of the acquired image data is identified.
- the city scene recognized in this embodiment is only one of a road, a square, a school, etc., but there are cases where multiple city scenes are obtained by recognizing image data.
- an optional implementation method that may be adopted is: inputting the acquired image data into the first recognition model, and obtaining the urban scene of the image data according to the output result of the first recognition model,
- the first recognition model in this embodiment is obtained by pre-training, and can recognize the urban scene corresponding to the image data.
- the urban scene corresponding to the standard image most similar to the image data can also be calculated by calculating the similarity between the image data and different standard images, City scene as acquired image data.
- S102 is executed to determine the target to be detected and the event to be detected corresponding to the identified urban scene.
- the target to be detected determined by executing S102 in this embodiment may be one or multiple; the determined event to be detected may be one or multiple.
- different urban scenes correspond to different objects to be detected and different events to be detected.
- the purpose is to effectively avoid the blindness of detection and improve the efficiency of event detection.
- the targets to be detected corresponding to the market may include people, booths, tables and chairs, billboards, garbage, and standing water, etc.
- the events to be detected corresponding to the market may include illegal business events, water accumulation events, etc.
- the targets to be detected corresponding to the road can include vehicles, motorcycles, rickshaws, street signs, green space, water, etc.
- the events to be detected corresponding to the road can include illegal parking events, road occupation events, water events, etc. .
- the determination may be based on a preset corresponding relationship, and the preset corresponding relationship includes each urban scene and the to-be-detected event corresponding to each urban scene. Detection targets and events to be detected.
- S103 is performed to detect the object to be detected in the image data to obtain the detection status of the event to be detected.
- the detection state of the to-be-detected event obtained by executing S103 in this embodiment is one of a normal state and an abnormal state.
- the detection status corresponding to each event to be detected can be obtained respectively by executing S103 in this embodiment.
- an optional implementation manner that may be adopted is: combining the acquired image data with the determined to-be-detected event
- the target is input into the second recognition model, and the detection state of the event to be detected is obtained according to the output result of the second recognition model.
- the second recognition model in this embodiment is obtained by pre-training, and can be obtained according to the image data and the target to be detected. The detection status of each to-be-detected event corresponding to the image data.
- the detection of the event to be detected may also be obtained according to the detection result of whether the object to be detected exists in the image data. If there is stagnant water in the image data corresponding to the road, it is determined that the stagnant water event is in an abnormal state.
- S104 is executed to obtain the event detection result of the image data according to the obtained detection state of the event to be detected.
- the obtained detection state of the event to be detected may be directly used as the event detection result of the image data.
- this embodiment executes S104 to obtain an image according to the detection state of the to-be-detected event
- an optional implementation method that can be adopted is: sending the obtained image data and the obtained event state of the event to be detected to the user, so that the user can confirm the event state of the event to be detected; The confirmation result returned by the user obtains the event detection result of the image data.
- the user can also check the obtained event state of the event to be detected, so as to remove the wrong event state of the event to be detected as much as possible, and further improve the accuracy of the obtained event detection result.
- the confirmation result returned by the user can also be used to optimize the second recognition model, that is, the image data, the target to be detected and the confirmation result of the image data are used as training data, and the second recognition model is continued to be updated, so that the second recognition model is updated.
- the recognition model can output a more accurate detection state of the event to be detected.
- the present embodiment may further include the following content: determine whether there is an event to be detected in an abnormal state in the obtained event detection result; in determining the event detection result
- an alarm message is issued, and the issued alarm message includes the abnormal state of the event to be detected and the location information of the event to be detected in an abnormal state, thereby improving the accuracy of the alarm and the abnormal event. disposal efficiency.
- alarm information can be sent to relevant department personnel, so that the relevant department personnel can quickly deal with abnormal events that occur in the city.
- FIG. 2 is a schematic diagram of a second embodiment according to the present disclosure.
- Figure 2 shows an event detection system 200, which includes a basic configuration module, a video playback storage module, a video analysis module, an alarm information storage module, and an information processing module.
- the basic configuration module is used to flexibly configure the processing rules of different video data streams according to user needs, so that the video data streams can be processed in a time-sharing manner or in batches;
- the video playback storage module is used to complete the real-time playback and processing of video data streams.
- the video analysis module is used to complete the event detection of the above-mentioned embodiment and the alarm of abnormal events
- the alarm information storage module is used to realize the classified retrieval and query display of the alarm information
- the information processing module Used to implement the handling of abnormal events.
- FIG. 3 is a schematic diagram of a third embodiment according to the present disclosure.
- Fig. 3 shows the processing flow chart of the information processing unit: after the video data stream is input into the video analysis module, the video analysis module performs event detection; after the video analysis module detects an abnormal event, alarm information is generated and reported to the information processing unit; The information processing unit sends the alarm information to the relevant personnel for confirmation. If the abnormal event is detected incorrectly, the confirmation result will be returned to the video analysis module; if the abnormal event does not need to be processed, the process will end; if the abnormal event needs to be processed, it will be issued Disposal, and if it is determined that the disposal has been completed, check to determine whether the abnormal event has been processed.
- FIG. 4 is a schematic diagram of a fourth embodiment according to the present disclosure.
- the device 400 for event detection in this embodiment includes:
- Obtaining unit 401 configured to obtain image data, and identify the urban scene of the image data
- a determination unit 402 configured to determine a target to be detected and an event to be detected corresponding to the urban scene
- a detection unit 403, configured to detect the to-be-detected target in the image data to obtain the detection state of the to-be-detected event
- the processing unit 404 is configured to obtain an event detection result of the image data according to the detection state of the to-be-detected event.
- the image data acquired by the acquiring unit 401 may be extracted from video stream data captured in real time by a camera in a certain monitoring area of the city; the acquired image data includes at least one city image, and the The city image may correspond to at least one of city scenes such as roads, squares, schools, and the like.
- the acquiring unit 401 may adopt an optional implementation manner as follows: acquiring the video stream data of the city; extracting at least one key frame image from the acquired video stream data as the image data.
- the acquiring unit 401 After acquiring the image data, the acquiring unit 401 identifies the urban scene of the acquired image data. Under normal circumstances, the urban scene identified by the acquiring unit 401 is only one of a road, a square, a school, etc., but there are cases where multiple urban scenes can be obtained by identifying image data.
- the obtaining unit 401 may adopt an optional implementation manner as follows: input the acquired image data into the first recognition model, and obtain the urban scene of the image data according to the output result of the first recognition model.
- the obtaining unit 401 may also use the urban scene corresponding to the standard image most similar to the image data as the all the urban scenes by calculating the similarity between the image data and different standard images. Acquire the image data of the city scene.
- the determination unit 402 determines the target to be detected and the event to be detected corresponding to the identified city scene.
- the target to be detected determined by the determining unit 402 may be one or multiple; the determined event to be detected may be one or multiple.
- the determining unit 402 may determine it according to a preset corresponding relationship, and the preset corresponding relationship includes each urban scene and the target to be detected corresponding to each urban scene. and the event to be detected.
- the detection unit 403 detects the object to be detected in the image data to obtain the detection state of the event to be detected.
- the detection state of the to-be-detected event obtained by the detection unit 403 is one of a normal state and an abnormal state.
- the detection unit 403 can obtain the detection status corresponding to each event to be detected, respectively.
- an optional implementation method that can be adopted is: inputting the acquired image data and the determined object to be detected
- the second recognition model obtains the detection state of the to-be-detected event according to the output result of the second recognition model.
- the detection unit 403 detects the object to be detected in the image data and obtains the detection state of the event to be detected, it can also obtain the detection state of the event to be detected according to whether there is a detection result of the object to be detected in the image data, For example, if there is stagnant water in the image data of the corresponding road, it is determined that the stagnant water event is in an abnormal state.
- the processing unit 404 obtains the event detection result of the image data according to the obtained detection state of the event to be detected.
- the processing unit 404 may directly use the detection state of the event to be detected obtained by the detection unit 403 as the event detection result of the image data.
- the processing unit 404 obtains the event detection result of the image data according to the detection state of the event to be detected.
- the optional implementation method that can be adopted is: sending the obtained image data and the obtained event status of the event to be detected to the user, so that the user can confirm the event status of the event to be detected; according to the confirmation result returned by the user , to get the event detection result of the image data.
- the processing unit 404 can also check the obtained event state of the event to be detected by the user, so as to remove the wrong event state of the event to be detected as much as possible, and further improve the accuracy of the obtained event detection result.
- the processing unit 404 can also use the confirmation result returned by the user to optimize the second recognition model, that is, the image data, the target to be detected and the confirmation result of the image data are used as training data, and continue to update the second recognition model, so that the second recognition model is updated.
- the recognition model can output a more accurate detection state of the event to be detected.
- the device 400 for event detection in this embodiment may further include an alarm unit 405, configured to perform: after obtaining the event detection result of the acquired image data, determine whether there is an abnormal state in the obtained event detection result When it is determined that there is an event to be detected in an abnormal state in the event detection result, an alarm message is sent, and the sent alarm message includes the abnormal state of the event to be detected and the location of the event to be detected in an abnormal state information.
- an alarm unit 405 configured to perform: after obtaining the event detection result of the acquired image data, determine whether there is an abnormal state in the obtained event detection result When it is determined that there is an event to be detected in an abnormal state in the event detection result, an alarm message is sent, and the sent alarm message includes the abnormal state of the event to be detected and the location of the event to be detected in an abnormal state information.
- the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.
- FIG. 5 it is a block diagram of an electronic device of the method for event detection according to an embodiment of the present disclosure.
- Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers.
- Electronic devices may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smart phones, wearable devices, and other similar computing devices.
- the components shown herein, their connections and relationships, and their functions are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.
- the device 500 includes a computing unit 501 that can be executed according to a computer program stored in a read only memory (ROM) 502 or loaded from a storage unit 508 into a random access memory (RAM) 503 Various appropriate actions and handling. In the RAM 503, various programs and data required for the operation of the device 500 can also be stored.
- the computing unit 501 , the ROM 502 and the RAM 503 are connected to each other through a bus 504 .
- An input/output (I/O) interface 505 is also connected to bus 504 .
- Various components in the device 500 are connected to the I/O interface 505, including: an input unit 506, such as a keyboard, mouse, etc.; an output unit 505, such as various types of displays, speakers, etc.; a storage unit 508, such as a magnetic disk, an optical disk, etc. ; and a communication unit 509, such as a network card, a modem, a wireless communication transceiver, and the like.
- the communication unit 509 allows the device 500 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.
- Computing unit 501 may be various general-purpose and/or special-purpose processing components with processing and computing capabilities. Some examples of computing units 501 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various specialized artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processing processor (DSP), and any suitable processor, controller, microcontroller, etc.
- the computing unit 501 performs the various methods and processes described above, such as the method of event detection.
- the method of event detection may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 508 .
- part or all of the computer program may be loaded and/or installed on device 500 via ROM 502 and/or communication unit 509 .
- ROM 502 and/or communication unit 509 When a computer program is loaded into RAM 503 and executed by computing unit 501, one or more steps of the method of event detection described above may be performed.
- the computing unit 501 may be configured to perform the method of event detection by any other suitable means (eg, by means of firmware).
- Various implementations of the systems and techniques described herein may be implemented in digital electronic circuitry, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip System (SOC), Load Programmable Logic Device (CPLD), computer hardware, firmware, software, and/or combinations thereof.
- FPGAs field programmable gate arrays
- ASICs application specific integrated circuits
- ASSPs application specific standard products
- SOC system on a chip System
- CPLD Load Programmable Logic Device
- computer hardware firmware, software, and/or combinations thereof.
- These various embodiments may include being implemented in one or more computer programs executable and/or interpretable on a programmable system including at least one programmable processor that
- the processor which may be a special purpose or general-purpose programmable processor, may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device an output device.
- Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer or other programmable data processing apparatus, such that the program code, when executed by the processor or controller, performs the functions/functions specified in the flowcharts and/or block diagrams. Action is implemented.
- the program code may execute entirely on the machine, partly on the machine, partly on the machine and partly on a remote machine as a stand-alone software package or entirely on the remote machine or server.
- a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with the instruction execution system, apparatus or device.
- the machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
- Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or devices, or any suitable combination of the foregoing.
- machine-readable storage media would include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), fiber optics, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.
- RAM random access memory
- ROM read only memory
- EPROM or flash memory erasable programmable read only memory
- CD-ROM compact disk read only memory
- magnetic storage or any suitable combination of the foregoing.
- the systems and techniques described herein may be implemented on a computer having a display device (eg, a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user ); and a keyboard and pointing device (eg, a mouse or trackball) through which a user can provide input to the computer.
- a display device eg, a CRT (cathode ray tube) or LCD (liquid crystal display) monitor
- a keyboard and pointing device eg, a mouse or trackball
- Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (eg, visual feedback, auditory feedback, or tactile feedback); and can be in any form (including acoustic input, voice input, or tactile input) to receive input from the user.
- the systems and techniques described herein may be implemented on a computing system that includes back-end components (eg, as a data server), or a computing system that includes middleware components (eg, an application server), or a computing system that includes front-end components (eg, a user's computer having a graphical user interface or web browser through which a user may interact with implementations of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system.
- the components of the system may be interconnected by any form or medium of digital data communication (eg, a communication network). Examples of communication networks include: Local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
- a computer system can include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other.
- the server can be a cloud server, also known as a cloud computing server or a cloud host. It is a host product in the cloud computing service system to solve the traditional physical host and VPS service ("Virtual Private Server", or "VPS" for short) , there are the defects of difficult management and weak business expansion.
- the server can also be a server of a distributed system, or a server combined with a blockchain.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Image Analysis (AREA)
Abstract
The present disclosure relates to the technical field of artificial intelligence, and specifically to the technical fields of computer vision and deep learning, and can be applied to a smart city scenario. Disclosed is an event detection method. The event detection method comprises: obtaining image data, and identifying a city scenario for the image data; determining target and event, which are to be detected, corresponding to the city scenario; detecting said target in the image data to obtain a detection state of said event; and obtaining an event detection result of the image data according to the detection state of said event. According to the present disclosure, the accuracy and efficiency of event detection can be improved.
Description
本申请要求了申请日为2021年04月28日,申请号为202110466781.3发明名称为“事件检测的方法、装置、电子设备以及可读存储介质”的中国专利申请的优先权。This application claims the priority of a Chinese patent application with an application date of April 28, 2021 and an application number of 202110466781.3 with the invention title of "Event Detection Method, Device, Electronic Device, and Readable Storage Medium".
本公开涉及人工智能技术领域,具体涉及计算机视觉和深度学习技术领域,可应用于智慧城市场景下。提供了一种事件检测的方法、装置、电子设备以及可读存储介质。The present disclosure relates to the technical field of artificial intelligence, in particular to the technical field of computer vision and deep learning, and can be applied to smart city scenarios. A method, apparatus, electronic device, and readable storage medium for event detection are provided.
按照目前城市管理的规划布局,在城市的各个位置安装了大量的视频装置进行监控。通过使用这些海量的数据,对城市管理规范化,城市网格智能化都将起到积极的作用。但是现有技术在使用监控视频流数据进行事件检测时,存在稳定性差、检测结果的准确性较低的技术问题。According to the current planning and layout of urban management, a large number of video devices are installed in various locations of the city for monitoring. By using these massive amounts of data, it will play a positive role in the standardization of urban management and the intelligentization of urban grids. However, when using monitoring video stream data for event detection in the prior art, there are technical problems of poor stability and low accuracy of detection results.
发明内容SUMMARY OF THE INVENTION
本公开提供了一种事件检测的方法、装置、电子设备以及可读存储介质,用于提升事件检测的准确性与效率。The present disclosure provides an event detection method, apparatus, electronic device, and readable storage medium, which are used to improve the accuracy and efficiency of event detection.
根据本公开的第一方面,提供了一种事件检测的方法,包括:获取图像数据,识别所述图像数据的城市场景;确定与所述城市场景对应的待检测目标与待检测事件;对所述图像数据中的待检测目标进行检测,得到所述待检测事件的检测状态;根据所述待检测事件的检测状态,得到所述图像数据的事件检测结果。According to a first aspect of the present disclosure, a method for event detection is provided, comprising: acquiring image data, identifying an urban scene of the image data; determining a target to be detected and an event to be detected corresponding to the urban scene; The object to be detected in the image data is detected to obtain the detection state of the event to be detected; and the event detection result of the image data is obtained according to the detection state of the event to be detected.
根据本公开的第二方面,提供了一种事件检测的装置,包括:获取单元,用于获取图像数据,识别所述图像数据的城市场景;确定单元,用于确定与所述城市场景对应的待检测目标与待检测事件;检测单元,用于对所述图像数据中的待检测目标进行检测,得到所述待检测事件的检测状态;处理单元,用于根据所述待检测事件的检测状态,得到所述图像数据的事件检测结果。According to a second aspect of the present disclosure, there is provided an apparatus for event detection, comprising: an acquisition unit for acquiring image data and identifying an urban scene of the image data; a determining unit for determining an image corresponding to the urban scene A target to be detected and an event to be detected; a detection unit, used for detecting the target to be detected in the image data, to obtain a detection state of the event to be detected; a processing unit, used to detect the state of the event to be detected according to the detection state to obtain the event detection result of the image data.
根据本公开的第三方面,提供了一种电子设备,包括:至少一个处理器;以及与所述至少一个处理器通信连接的存储器;其中,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行如上所述的方法。According to a third aspect of the present disclosure, there is provided an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores information that can be used by the at least one processor Instructions that are executed, the instructions being executed by the at least one processor to enable the at least one processor to perform the method as described above.
根据本公开的第四方面,提供了一种存储有计算机指令的非瞬时计算机可读存储介质,其中,所述计算机指令用于使所述计算机执行如上所述的方法。According to a fourth aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to perform the method as described above.
根据本公开的第五方面,提供了一种计算机程序产品,包括计算机程序,所述计算机程序在被处理器执行时实现如上所述的方法。According to a fifth aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the method as described above.
由以上技术方案可以看出,本公开首先识别所获取的图像数据的城市场景,然后确定与城市场景对应的待检测目标与待检测事件,最后再对图像数据中的待检测目标进行检测,从而根据所得到的待检测事件的检测状态来得到图像数据的事件检测结果,由于将不同的城市场景与不同的待检测目标与待检测事件进行对应,因此本公开能够提升事件检测的准确性与效率。It can be seen from the above technical solutions that the present disclosure first identifies the urban scene of the acquired image data, then determines the to-be-detected target and the to-be-detected event corresponding to the urban scene, and finally detects the to-be-detected target in the image data, thereby The event detection result of the image data is obtained according to the obtained detection state of the event to be detected. Since different urban scenes, different targets to be detected and the event to be detected are corresponding to the event to be detected, the present disclosure can improve the accuracy and efficiency of event detection .
应当理解,本部分所描述的内容并非旨在标识本公开的实施例的关键或重要特征,也不用于限制本公开的范围。本公开的其它特征将通过以下的说明书而变得容易理解。It should be understood that what is described in this section is not intended to identify key or critical features of embodiments of the disclosure, nor is it intended to limit the scope of the disclosure. Other features of the present disclosure will become readily understood from the following description.
附图用于更好地理解本方案,不构成对本公开的限定。其中:The accompanying drawings are used for better understanding of the present solution, and do not constitute a limitation to the present disclosure. in:
图1是根据本公开第一实施例的示意图;1 is a schematic diagram according to a first embodiment of the present disclosure;
图2是根据本公开第二实施例的示意图;2 is a schematic diagram according to a second embodiment of the present disclosure;
图3是根据本公开第三实施例的示意图;3 is a schematic diagram according to a third embodiment of the present disclosure;
图4是根据本公开第四实施例的示意图;4 is a schematic diagram according to a fourth embodiment of the present disclosure;
图5是用来实现本公开实施例的事件检测的方法的电子设备的框图。FIG. 5 is a block diagram of an electronic device used to implement the method of event detection according to an embodiment of the present disclosure.
以下结合附图对本公开的示范性实施例做出说明,其中包括本公开实施例的各种细节以助于理解,应当将它们认为仅仅是示范性的。因此,本领域普通技术人员应当认识到,可以对这里描述的实施例做出各种改 变和修改,而不会背离本公开的范围和精神。同样,为了清楚和简明,以下的描述中省略了对公知功能和机构的描述。Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding and should be considered as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and mechanisms are omitted from the following description for clarity and conciseness.
图1是根据本公开第一实施例的示意图。如图1所示,本实施例的事件检测的方法,具体可以包括如下步骤:FIG. 1 is a schematic diagram according to a first embodiment of the present disclosure. As shown in FIG. 1 , the method for event detection in this embodiment may specifically include the following steps:
S101、获取图像数据,识别所述图像数据的城市场景;S101, acquiring image data, and identifying the urban scene of the image data;
S102、确定与所述城市场景对应的待检测目标与待检测事件;S102, determining the target to be detected and the event to be detected corresponding to the urban scene;
S103、对所述图像数据中的待检测目标进行检测,得到所述待检测事件的检测状态;S103. Detect the target to be detected in the image data to obtain the detection state of the event to be detected;
S104、根据所述待检测事件的检测状态,得到所述图像数据的事件检测结果。S104. Obtain an event detection result of the image data according to the detection state of the to-be-detected event.
本实施例的事件检测方法,首先识别所获取的图像数据的城市场景,然后确定与城市场景对应的待检测目标与待检测事件,最后再对图像数据中的待检测目标进行检测,从而根据所得到的待检测事件的检测状态来得到图像数据的事件检测结果,由于将不同的城市场景与不同的待检测目标与待检测事件进行对应,因此本实施例能够提升事件检测的准确性与效率。The event detection method of this embodiment firstly identifies the urban scene of the acquired image data, then determines the to-be-detected target and the to-be-detected event corresponding to the urban scene, and finally detects the to-be-detected target in the image data. The event detection result of the image data is obtained by obtaining the detection state of the to-be-detected event. Since different urban scenes, different to-be-detected targets and to-be-detected events are corresponding, this embodiment can improve the accuracy and efficiency of event detection.
本实施例执行S101所获取的图像数据,可以是从由城市的某一监控区域的摄像装置实时拍摄的视频流数据中所提取得到的;所获取的图像数据中包含至少一张城市图像,所包含的城市图像可以对应于道路、广场、学校等城市场景中的至少一种。The image data obtained by executing S101 in this embodiment may be extracted from video stream data captured in real time by a camera device in a certain monitoring area of the city; the obtained image data includes at least one image of the city, so The included urban images may correspond to at least one of urban scenes such as roads, squares, and schools.
本实施例在执行S101获取图像数据时,可以采用的可选实现方式为:获取城市的视频流数据,不同的视频流数据对应于不同的城市场景;从所获取的视频流数据中提取至少一张关键帧图像,作为图像数据。When performing S101 to acquire image data in this embodiment, an optional implementation method that may be adopted is: acquiring video stream data of a city, where different video stream data correspond to different urban scenes; extracting at least one image from the acquired video stream data key frame images as image data.
本实施例在执行S101获取图像数据之后,识别所获取的图像数据的城市场景。在通常情况下,本实施例识别得到的城市场景仅为道路、广场、学校等中的一个,但也存在通过识别图像数据会得到多个城市场景的情况。In this embodiment, after performing S101 to acquire the image data, the city scene of the acquired image data is identified. Under normal circumstances, the city scene recognized in this embodiment is only one of a road, a square, a school, etc., but there are cases where multiple city scenes are obtained by recognizing image data.
本实施例在执行S101识别图像数据的城市场景时,可以采用的可选实现方式为:将所获取的图像数据输入第一识别模型,根据第一识别模型的输出结果得到图像数据的城市场景,本实施例中的第一识别模型是预先训练得到的,其能够对图像数据所对应的城市场景进行识别。When performing S101 to identify the urban scene of the image data in this embodiment, an optional implementation method that may be adopted is: inputting the acquired image data into the first recognition model, and obtaining the urban scene of the image data according to the output result of the first recognition model, The first recognition model in this embodiment is obtained by pre-training, and can recognize the urban scene corresponding to the image data.
另外,本实施例在执行S101识别图像数据的城市场景时,也可以通过计算图像数据与不同的标准图像之间的相似度的方式,将与图像数据最相似的标准图像所对应的城市场景,作为所获取的图像数据的城市场景。In addition, when S101 is performed to identify the urban scene of the image data in this embodiment, the urban scene corresponding to the standard image most similar to the image data can also be calculated by calculating the similarity between the image data and different standard images, City scene as acquired image data.
本实施例在执行S101识别所获取的图像数据的城市场景之后,执行S102确定与识别得到的城市场景对应的待检测目标与待检测事件。其中,本实施例执行S102所确定的待检测目标可以为一个,也可以为多个;所确定的待检测事件可以为一个,也可以为多个。In this embodiment, after S101 is executed to identify the urban scene of the acquired image data, S102 is executed to determine the target to be detected and the event to be detected corresponding to the identified urban scene. Wherein, the target to be detected determined by executing S102 in this embodiment may be one or multiple; the determined event to be detected may be one or multiple.
本实施例中不同的城市场景对应于不同的待检测目标与不同的待检测事件,通过区分城市场景所对应的待检测对象的方式,从而实现仅对图像数据中特定的待检测对象进行检测的目的,能够有效地避免检测的盲目性,提升事件检测的效率。In this embodiment, different urban scenes correspond to different objects to be detected and different events to be detected. By distinguishing the objects to be detected corresponding to the urban scenes, only specific objects to be detected in the image data are detected. The purpose is to effectively avoid the blindness of detection and improve the efficiency of event detection.
举例来说,若城市场景为市场,对应市场的待检测目标可以包含人、摊位、桌椅、广告牌、垃圾、积水等,对应市场的待检测事件可以包含违规经营事件、积水事件等;若城市场景为道路,对应道路的待检测目标可以包含车辆、摩托车、人力车、路牌、绿地、积水等,对应道路的待检测事件可以包含违章停车事件、占道事件、积水事件等。For example, if the urban scene is a market, the targets to be detected corresponding to the market may include people, booths, tables and chairs, billboards, garbage, and standing water, etc., and the events to be detected corresponding to the market may include illegal business events, water accumulation events, etc. ;If the urban scene is a road, the targets to be detected corresponding to the road can include vehicles, motorcycles, rickshaws, street signs, green space, water, etc., and the events to be detected corresponding to the road can include illegal parking events, road occupation events, water events, etc. .
本实施例在执行S102确定与城市场景对应的待检测目标与待检测事件时,可以根据预设的对应关系来确定,该预设的对应关系中包含各城市场景,以及各城市场景对应的待检测目标与待检测事件。In this embodiment, when the target to be detected and the event to be detected corresponding to the urban scene are determined in S102, the determination may be based on a preset corresponding relationship, and the preset corresponding relationship includes each urban scene and the to-be-detected event corresponding to each urban scene. Detection targets and events to be detected.
本实施例在执行S102确定城市场景对应的待检测目标与待检测事件之后,执行S103对图像数据中的待检测目标进行检测,得到待检测事件的检测状态。其中,本实施例执行S103所得到的待检测事件的检测状态为正常状态与异常状态中的一种。In this embodiment, after S102 is performed to determine the object to be detected and the event to be detected corresponding to the urban scene, S103 is performed to detect the object to be detected in the image data to obtain the detection status of the event to be detected. The detection state of the to-be-detected event obtained by executing S103 in this embodiment is one of a normal state and an abnormal state.
可以理解的是,若本实施例执行S102确定了多个待检测事件,则本实施例执行S103可分别得到每个待检测事件所对应的检测状态。It can be understood that, if multiple events to be detected are determined by executing S102 in this embodiment, the detection status corresponding to each event to be detected can be obtained respectively by executing S103 in this embodiment.
具体地,本实施例在执行S103对图像数据中的待检测目标进行检测,得到待检测事件的检测状态时,可以采用的可选实现方式为:将所获取的图像数据与所确定的待检测目标输入第二识别模型,根据第二识别模型的输出结果得到待检测事件的检测状态,本实施例中的第二识别模型是预先训练得到的,其能够根据图像数据与待检测目标,来得到与图像 数据对应的每个待检测事件的检测状态。Specifically, in this embodiment, when S103 is executed to detect the object to be detected in the image data, and the detection state of the event to be detected is obtained, an optional implementation manner that may be adopted is: combining the acquired image data with the determined to-be-detected event The target is input into the second recognition model, and the detection state of the event to be detected is obtained according to the output result of the second recognition model. The second recognition model in this embodiment is obtained by pre-training, and can be obtained according to the image data and the target to be detected. The detection status of each to-be-detected event corresponding to the image data.
另外,本实施例在执行S103对图像数据中的待检测目标进行检测,得到待检测事件的检测状态时,也可以根据图像数据中是否存在待检测目标的检测结果,来得到待检测事件的检测状态,例如对应道路的图像数据中存在积水,则确定积水事件处于异常状态。In addition, in this embodiment, when S103 is executed to detect the object to be detected in the image data to obtain the detection state of the event to be detected, the detection of the event to be detected may also be obtained according to the detection result of whether the object to be detected exists in the image data. If there is stagnant water in the image data corresponding to the road, it is determined that the stagnant water event is in an abnormal state.
本实施例在执行S103得到待检测事件的检测状态之后,执行S104根据所得到的待检测事件的检测状态,得到图像数据的事件检测结果。In this embodiment, after S103 is executed to obtain the detection state of the event to be detected, S104 is executed to obtain the event detection result of the image data according to the obtained detection state of the event to be detected.
本实施例在执行S104时,可以直接将所得到的待检测事件的检测状态作为图像数据的事件检测结果。In this embodiment, when S104 is executed, the obtained detection state of the event to be detected may be directly used as the event detection result of the image data.
由于本实施例在执行S103时所获取的待检测事件的检测状态可能存在错误,因此为了提升所得到的事件检测结果的准确性,本实施例在执行S104根据待检测事件的检测状态,得到图像数据的事件检测结果时,可以采用的可选实现方式为:将所获取的图像数据与所得到的待检测事件的事件状态发送至用户,以用于用户对待检测事件的事件状态进行确认;根据用户所返回的确认结果,得到图像数据的事件检测结果。Since there may be errors in the detection state of the to-be-detected event obtained when this embodiment executes S103, in order to improve the accuracy of the obtained event detection result, this embodiment executes S104 to obtain an image according to the detection state of the to-be-detected event When the event detection result of the data is used, an optional implementation method that can be adopted is: sending the obtained image data and the obtained event state of the event to be detected to the user, so that the user can confirm the event state of the event to be detected; The confirmation result returned by the user obtains the event detection result of the image data.
也就是说,本实施例还可以通过用户对所得到的待检测事件的事件状态进行核查,从而尽可能地去除待检测事件的错误的事件状态,进一步提升所得到的事件检测结果的准确性。本实施例还能使用用户所返回的确认结果来对第二识别模型进行优化,即将图像数据、图像数据的待检测目标与确认结果作为训练数据,继续对第二识别模型进行更新,使得第二识别模型能够输出更为准确的待检测事件的检测状态。That is, in this embodiment, the user can also check the obtained event state of the event to be detected, so as to remove the wrong event state of the event to be detected as much as possible, and further improve the accuracy of the obtained event detection result. In this embodiment, the confirmation result returned by the user can also be used to optimize the second recognition model, that is, the image data, the target to be detected and the confirmation result of the image data are used as training data, and the second recognition model is continued to be updated, so that the second recognition model is updated. The recognition model can output a more accurate detection state of the event to be detected.
另外,本实施例在执行S104得到所获取的图像数据的事件检测结果之后,还可以包含以下内容:确定所得到的事件检测结果中是否存在处于异常状态的待检测事件;在确定事件检测结果中存在处于异常状态的待检测事件的情况下,发出报警信息,所发出的报警信息中包含待检测事件的异常状态与处于异常状态的待检测事件的位置信息,从而提升报警的准确性以及异常事件的处置效率。In addition, after executing S104 to obtain the event detection result of the acquired image data, the present embodiment may further include the following content: determine whether there is an event to be detected in an abnormal state in the obtained event detection result; in determining the event detection result When there is an event to be detected in an abnormal state, an alarm message is issued, and the issued alarm message includes the abnormal state of the event to be detected and the location information of the event to be detected in an abnormal state, thereby improving the accuracy of the alarm and the abnormal event. disposal efficiency.
可以理解的是,本实施例可以向相关部门人员来发出报警信息,以使得相关部门人员能够快速地处置城市中出现的异常事件。It can be understood that, in this embodiment, alarm information can be sent to relevant department personnel, so that the relevant department personnel can quickly deal with abnormal events that occur in the city.
图2是根据本公开第二实施例的示意图。图2示出了事件检测系统200,其包含基础配置模块、视频播放存储模块、视频分析模块、报警信 息存储模块与信息处置模块。其中,基础配置模块用于按照用户需求来灵活地配置不同视频数据流的处理规则,使得视频数据流可以分时处理,也可以批量处理;视频播放存储模块用于完成视频数据流的实时播放和存储,并且支持视频数据流的调取与浏览;视频分析模块用于完成上述实施例的事件检测以及异常事件的报警;报警信息存储模块用于实现报警信息的分类检索与查询展示;信息处置模块用于实现对于异常事件的处置。FIG. 2 is a schematic diagram of a second embodiment according to the present disclosure. Figure 2 shows an event detection system 200, which includes a basic configuration module, a video playback storage module, a video analysis module, an alarm information storage module, and an information processing module. Among them, the basic configuration module is used to flexibly configure the processing rules of different video data streams according to user needs, so that the video data streams can be processed in a time-sharing manner or in batches; the video playback storage module is used to complete the real-time playback and processing of video data streams. storage, and supports the retrieval and browsing of video data streams; the video analysis module is used to complete the event detection of the above-mentioned embodiment and the alarm of abnormal events; the alarm information storage module is used to realize the classified retrieval and query display of the alarm information; the information processing module Used to implement the handling of abnormal events.
图3是根据本公开第三实施例的示意图。图3示出了信息处置单元的处理流程图:将视频数据流输入视频分析模块之后,视频分析模块进行事件检测;在视频分析模块检测出异常事件之后,生成报警信息并上报至信息处置单元;信息处置单元将报警信息发送至相关部分人员进行确认,若异常事件检测错误,则将确认结果返回视频分析模块;若异常事件无需进行处理,则结束流程;若异常事件需要进行处理,则下发处置,并在确定处置已完成的情况下,进行核查以确定异常事件是否已完成处理,若未进行核查则转至执行下发处置。FIG. 3 is a schematic diagram of a third embodiment according to the present disclosure. Fig. 3 shows the processing flow chart of the information processing unit: after the video data stream is input into the video analysis module, the video analysis module performs event detection; after the video analysis module detects an abnormal event, alarm information is generated and reported to the information processing unit; The information processing unit sends the alarm information to the relevant personnel for confirmation. If the abnormal event is detected incorrectly, the confirmation result will be returned to the video analysis module; if the abnormal event does not need to be processed, the process will end; if the abnormal event needs to be processed, it will be issued Disposal, and if it is determined that the disposal has been completed, check to determine whether the abnormal event has been processed.
图4是根据本公开第四实施例的示意图。如图4所示,本实施例的事件检测的装置400,包括:FIG. 4 is a schematic diagram of a fourth embodiment according to the present disclosure. As shown in FIG. 4 , the device 400 for event detection in this embodiment includes:
获取单元401、用于获取图像数据,识别所述图像数据的城市场景;Obtaining unit 401, configured to obtain image data, and identify the urban scene of the image data;
确定单元402、用于确定与所述城市场景对应的待检测目标与待检测事件;A determination unit 402, configured to determine a target to be detected and an event to be detected corresponding to the urban scene;
检测单元403、用于对所述图像数据中的待检测目标进行检测,得到所述待检测事件的检测状态;A detection unit 403, configured to detect the to-be-detected target in the image data to obtain the detection state of the to-be-detected event;
处理单元404、用于根据所述待检测事件的检测状态,得到所述图像数据的事件检测结果。The processing unit 404 is configured to obtain an event detection result of the image data according to the detection state of the to-be-detected event.
获取单元401所获取的图像数据,可以是从由城市的某一监控区域的摄像装置实时拍摄的视频流数据中所提取得到的;所获取的图像数据中包含至少一张城市图像,所包含的城市图像可以对应于道路、广场、学校等城市场景中的至少一种。The image data acquired by the acquiring unit 401 may be extracted from video stream data captured in real time by a camera in a certain monitoring area of the city; the acquired image data includes at least one city image, and the The city image may correspond to at least one of city scenes such as roads, squares, schools, and the like.
获取单元401在获取图像数据时,可以采用的可选实现方式为:获取城市的视频流数据;从所获取的视频流数据中提取至少一张关键帧图像,作为图像数据。When acquiring the image data, the acquiring unit 401 may adopt an optional implementation manner as follows: acquiring the video stream data of the city; extracting at least one key frame image from the acquired video stream data as the image data.
获取单元401在获取图像数据之后,识别所获取的图像数据的城市场景。在通常情况下,获取单元401识别得到的城市场景仅为道路、广场、学校等中的一个,但也存在通过识别图像数据会得到多个城市场景的情况。After acquiring the image data, the acquiring unit 401 identifies the urban scene of the acquired image data. Under normal circumstances, the urban scene identified by the acquiring unit 401 is only one of a road, a square, a school, etc., but there are cases where multiple urban scenes can be obtained by identifying image data.
获取单元401在识别图像数据的城市场景时,可以采用的可选实现方式为:将所获取的图像数据输入第一识别模型,根据第一识别模型的输出结果得到图像数据的城市场景。When recognizing the urban scene of the image data, the obtaining unit 401 may adopt an optional implementation manner as follows: input the acquired image data into the first recognition model, and obtain the urban scene of the image data according to the output result of the first recognition model.
另外,获取单元401在识别图像数据的城市场景时,也可以通过计算图像数据与不同的标准图像之间的相似度的方式,将与图像数据最相似的标准图像所对应的城市场景,作为所获取的图像数据的城市场景。In addition, when recognizing the urban scene of the image data, the obtaining unit 401 may also use the urban scene corresponding to the standard image most similar to the image data as the all the urban scenes by calculating the similarity between the image data and different standard images. Acquire the image data of the city scene.
本实施例在由获取单元401识别所获取的图像数据的城市场景之后,由确定单元402确定与识别得到的城市场景对应的待检测目标与待检测事件。其中,确定单元402所确定的待检测目标可以为一个,也可以为多个;所确定的待检测事件可以为一个,也可以为多个。In this embodiment, after the acquisition unit 401 identifies the city scene of the acquired image data, the determination unit 402 determines the target to be detected and the event to be detected corresponding to the identified city scene. Wherein, the target to be detected determined by the determining unit 402 may be one or multiple; the determined event to be detected may be one or multiple.
确定单元402在确定与城市场景对应的待检测目标与待检测事件时,可以根据预设的对应关系来确定,该预设的对应关系中包含各城市场景,以及各城市场景对应的待检测目标与待检测事件。When determining the target to be detected and the event to be detected corresponding to the urban scene, the determining unit 402 may determine it according to a preset corresponding relationship, and the preset corresponding relationship includes each urban scene and the target to be detected corresponding to each urban scene. and the event to be detected.
本实施例在由确定单元402确定城市场景对应的待检测目标与待检测事件之后,由检测单元403对图像数据中的待检测目标进行检测,得到待检测事件的检测状态。其中,检测单元403所得到的待检测事件的检测状态为正常状态与异常状态中的一种。In this embodiment, after the determination unit 402 determines the object to be detected and the event to be detected corresponding to the urban scene, the detection unit 403 detects the object to be detected in the image data to obtain the detection state of the event to be detected. The detection state of the to-be-detected event obtained by the detection unit 403 is one of a normal state and an abnormal state.
可以理解的是,若确定单元402确定了多个待检测事件,则检测单元403可分别得到每个待检测事件所对应的检测状态。It can be understood that, if the determination unit 402 determines a plurality of events to be detected, the detection unit 403 can obtain the detection status corresponding to each event to be detected, respectively.
具体地,检测单元403在对图像数据中的待检测目标进行检测,得到待检测事件的检测状态时,可以采用的可选实现方式为:将所获取的图像数据与所确定的待检测目标输入第二识别模型,根据第二识别模型的输出结果得到待检测事件的检测状态。Specifically, when the detection unit 403 detects the object to be detected in the image data and obtains the detection state of the event to be detected, an optional implementation method that can be adopted is: inputting the acquired image data and the determined object to be detected The second recognition model obtains the detection state of the to-be-detected event according to the output result of the second recognition model.
另外,检测单元403在对图像数据中的待检测目标进行检测,得到待检测事件的检测状态时,也可以根据图像数据中是否存在待检测目标的检测结果,来得到待检测事件的检测状态,例如对应道路的图像数据中存在积水,则确定积水事件处于异常状态。In addition, when the detection unit 403 detects the object to be detected in the image data and obtains the detection state of the event to be detected, it can also obtain the detection state of the event to be detected according to whether there is a detection result of the object to be detected in the image data, For example, if there is stagnant water in the image data of the corresponding road, it is determined that the stagnant water event is in an abnormal state.
本实施例在由检测单元403得到待检测事件的检测状态之后,由处理单元404根据所得到的待检测事件的检测状态,得到图像数据的事件检测结果。In this embodiment, after the detection unit 403 obtains the detection state of the event to be detected, the processing unit 404 obtains the event detection result of the image data according to the obtained detection state of the event to be detected.
处理单元404可以直接将检测单元403所得到的待检测事件的检测状态作为图像数据的事件检测结果。The processing unit 404 may directly use the detection state of the event to be detected obtained by the detection unit 403 as the event detection result of the image data.
由于检测单元403所获取的待检测事件的检测状态可能存在错误,因此为了提升所得到的事件检测结果的准确性,处理单元404在根据待检测事件的检测状态,得到图像数据的事件检测结果时,可以采用的可选实现方式为:将所获取的图像数据与所得到的待检测事件的事件状态发送至用户,以用于用户对待检测事件的事件状态进行确认;根据用户所返回的确认结果,得到图像数据的事件检测结果。Since there may be errors in the detection state of the event to be detected acquired by the detection unit 403, in order to improve the accuracy of the obtained event detection result, the processing unit 404 obtains the event detection result of the image data according to the detection state of the event to be detected. , the optional implementation method that can be adopted is: sending the obtained image data and the obtained event status of the event to be detected to the user, so that the user can confirm the event status of the event to be detected; according to the confirmation result returned by the user , to get the event detection result of the image data.
也就是说,处理单元404还可以通过用户对所得到的待检测事件的事件状态进行核查,从而尽可能地去除待检测事件的错误的事件状态,进一步提升所得到的事件检测结果的准确性。处理单元404还能使用用户所返回的确认结果来对第二识别模型进行优化,即将图像数据、图像数据的待检测目标与确认结果作为训练数据,继续对第二识别模型进行更新,使得第二识别模型能够输出更为准确的待检测事件的检测状态。That is, the processing unit 404 can also check the obtained event state of the event to be detected by the user, so as to remove the wrong event state of the event to be detected as much as possible, and further improve the accuracy of the obtained event detection result. The processing unit 404 can also use the confirmation result returned by the user to optimize the second recognition model, that is, the image data, the target to be detected and the confirmation result of the image data are used as training data, and continue to update the second recognition model, so that the second recognition model is updated. The recognition model can output a more accurate detection state of the event to be detected.
另外,本实施例中的事件检测的装置400中还可以包含报警单元405,用于执行:在得到所获取的图像数据的事件检测结果之后,确定所得到的事件检测结果中是否存在处于异常状态的待检测事件;在确定事件检测结果中存在处于异常状态的待检测事件的情况下,发出报警信息,所发出的报警信息中包含待检测事件的异常状态与处于异常状态的待检测事件的位置信息。In addition, the device 400 for event detection in this embodiment may further include an alarm unit 405, configured to perform: after obtaining the event detection result of the acquired image data, determine whether there is an abnormal state in the obtained event detection result When it is determined that there is an event to be detected in an abnormal state in the event detection result, an alarm message is sent, and the sent alarm message includes the abnormal state of the event to be detected and the location of the event to be detected in an abnormal state information.
根据本公开的实施例,本公开还提供了一种电子设备、一种可读存储介质和一种计算机程序产品。According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.
如图5所示,是根据本公开实施例的事件检测的方法的电子设备的框图。电子设备旨在表示各种形式的数字计算机,诸如,膝上型计算机、台式计算机、工作台、个人数字助理、服务器、刀片式服务器、大型计算机、和其它适合的计算机。电子设备还可以表示各种形式的移动装置,诸如,个人数字处理、蜂窝电话、智能电话、可穿戴设备和其它类似的计算装置。本文所示的部件、它们的连接和关系、以及它们的功能仅仅 作为示例,并且不意在限制本文中描述的和/或者要求的本公开的实现。As shown in FIG. 5 , it is a block diagram of an electronic device of the method for event detection according to an embodiment of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.
如图5所示,设备500包括计算单元501,其可以根据存储在只读存储器(ROM)502中的计算机程序或者从存储单元508加载到随机访问存储器(RAM)503中的计算机程序,来执行各种适当的动作和处理。在RAM 503中,还可存储设备500操作所需的各种程序和数据。计算单元501、ROM502以及RAM503通过总线504彼此相连。输入/输出(I/O)接口505也连接至总线504。As shown in FIG. 5 , the device 500 includes a computing unit 501 that can be executed according to a computer program stored in a read only memory (ROM) 502 or loaded from a storage unit 508 into a random access memory (RAM) 503 Various appropriate actions and handling. In the RAM 503, various programs and data required for the operation of the device 500 can also be stored. The computing unit 501 , the ROM 502 and the RAM 503 are connected to each other through a bus 504 . An input/output (I/O) interface 505 is also connected to bus 504 .
设备500中的多个部件连接至I/O接口505,包括:输入单元506,例如键盘、鼠标等;输出单元505,例如各种类型的显示器、扬声器等;存储单元508,例如磁盘、光盘等;以及通信单元509,例如网卡、调制解调器、无线通信收发机等。通信单元509允许设备500通过诸如因特网的计算机网络和/或各种电信网络与其他设备交换信息/数据。Various components in the device 500 are connected to the I/O interface 505, including: an input unit 506, such as a keyboard, mouse, etc.; an output unit 505, such as various types of displays, speakers, etc.; a storage unit 508, such as a magnetic disk, an optical disk, etc. ; and a communication unit 509, such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 509 allows the device 500 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.
计算单元501可以是各种具有处理和计算能力的通用和/或专用处理组件。计算单元501的一些示例包括但不限于中央处理单元(CPU)、图形处理单元(GPU)、各种专用的人工智能(AI)计算芯片、各种运行机器学习模型算法的计算单元、数字信号处理器(DSP)、以及任何适当的处理器、控制器、微控制器等。计算单元501执行上文所描述的各个方法和处理,例如事件检测的方法。例如,在一些实施例中,事件检测的方法可被实现为计算机软件程序,其被有形地包含于机器可读介质,例如存储单元508。 Computing unit 501 may be various general-purpose and/or special-purpose processing components with processing and computing capabilities. Some examples of computing units 501 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various specialized artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processing processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 501 performs the various methods and processes described above, such as the method of event detection. For example, in some embodiments, the method of event detection may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 508 .
在一些实施例中,计算机程序的部分或者全部可以经由ROM502和/或通信单元509而被载入和/或安装到设备500上。当计算机程序加载到RAM 503并由计算单元501执行时,可以执行上文描述的事件检测的方法的一个或多个步骤。备选地,在其他实施例中,计算单元501可以通过其他任何适当的方式(例如,借助于固件)而被配置为执行事件检测的方法。In some embodiments, part or all of the computer program may be loaded and/or installed on device 500 via ROM 502 and/or communication unit 509 . When a computer program is loaded into RAM 503 and executed by computing unit 501, one or more steps of the method of event detection described above may be performed. Alternatively, in other embodiments, the computing unit 501 may be configured to perform the method of event detection by any other suitable means (eg, by means of firmware).
此处描述的系统和技术的各种实施方式可以在数字电子电路系统、集成电路系统、场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、芯片上系统的系统(SOC)、负载可编程逻辑设备(CPLD)、计算机硬件、固件、软件、和/或它们的组合中实现。这些各种实施方式可以包括:实施在一个或者多个计算机程序中,该一 个或者多个计算机程序可在包括至少一个可编程处理器的可编程系统上执行和/或解释,该可编程处理器可以是专用或者通用可编程处理器,可以从存储系统、至少一个输入装置、和至少一个输出装置接收数据和指令,并且将数据和指令传输至该存储系统、该至少一个输入装置、和该至少一个输出装置。Various implementations of the systems and techniques described herein may be implemented in digital electronic circuitry, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip System (SOC), Load Programmable Logic Device (CPLD), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include being implemented in one or more computer programs executable and/or interpretable on a programmable system including at least one programmable processor that The processor, which may be a special purpose or general-purpose programmable processor, may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device an output device.
用于实施本公开的方法的程序代码可以采用一个或多个编程语言的任何组合来编写。这些程序代码可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理器或控制器,使得程序代码当由处理器或控制器执行时使流程图和/或框图中所规定的功能/操作被实施。程序代码可完全在机器上执行、部分地在机器上执行,作为独立软件包部分地在机器上执行且部分地在远程机器上执行或完全在远程机器或服务器上执行。Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer or other programmable data processing apparatus, such that the program code, when executed by the processor or controller, performs the functions/functions specified in the flowcharts and/or block diagrams. Action is implemented. The program code may execute entirely on the machine, partly on the machine, partly on the machine and partly on a remote machine as a stand-alone software package or entirely on the remote machine or server.
在本公开的上下文中,机器可读介质可以是有形的介质,其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备,或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with the instruction execution system, apparatus or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), fiber optics, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.
为了提供与用户的交互,可以在计算机上实施此处描述的系统和技术,该计算机具有:用于向用户显示信息的显示装置(例如,CRT(阴极射线管)或者LCD(液晶显示器)监视器);以及键盘和指向装置(例如,鼠标或者轨迹球),用户可以通过该键盘和该指向装置来将输入提供给计算机。其它种类的装置还可以用于提供与用户的交互;例如,提供给用户的反馈可以是任何形式的传感反馈(例如,视觉反馈、听觉反馈、或者触觉反馈);并且可以用任何形式(包括声输入、语音输入或者、触觉输入)来接收来自用户的输入。To provide interaction with a user, the systems and techniques described herein may be implemented on a computer having a display device (eg, a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user ); and a keyboard and pointing device (eg, a mouse or trackball) through which a user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (eg, visual feedback, auditory feedback, or tactile feedback); and can be in any form (including acoustic input, voice input, or tactile input) to receive input from the user.
可以将此处描述的系统和技术实施在包括后台部件的计算系统(例 如,作为数据服务器)、或者包括中间件部件的计算系统(例如,应用服务器)、或者包括前端部件的计算系统(例如,具有图形用户界面或者网络浏览器的用户计算机,用户可以通过该图形用户界面或者该网络浏览器来与此处描述的系统和技术的实施方式交互)、或者包括这种后台部件、中间件部件、或者前端部件的任何组合的计算系统中。可以通过任何形式或者介质的数字数据通信(例如,通信网络)来将系统的部件相互连接。通信网络的示例包括:局域网(LAN)、广域网(WAN)和互联网。The systems and techniques described herein may be implemented on a computing system that includes back-end components (eg, as a data server), or a computing system that includes middleware components (eg, an application server), or a computing system that includes front-end components (eg, a user's computer having a graphical user interface or web browser through which a user may interact with implementations of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system may be interconnected by any form or medium of digital data communication (eg, a communication network). Examples of communication networks include: Local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
计算机系统可以包括客户端和服务器。客户端和服务器一般远离彼此并且通常通过通信网络进行交互。通过在相应的计算机上运行并且彼此具有客户端-服务器关系的计算机程序来产生客户端和服务器的关系。服务器可以是云服务器,又称为云计算服务器或云主机,是云计算服务体系中的一项主机产品,以解决了传统物理主机与VPS服务(“Virtual Private Server”,或简称“VPS”)中,存在的管理难度大,业务扩展性弱的缺陷。服务器也可以为分布式系统的服务器,或者是结合了区块链的服务器。A computer system can include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also known as a cloud computing server or a cloud host. It is a host product in the cloud computing service system to solve the traditional physical host and VPS service ("Virtual Private Server", or "VPS" for short) , there are the defects of difficult management and weak business expansion. The server can also be a server of a distributed system, or a server combined with a blockchain.
应该理解,可以使用上面所示的各种形式的流程,重新排序、增加或删除步骤。例如,本公开中记载的各步骤可以并行地执行也可以顺序地执行也可以不同的次序执行,只要能够实现本公开公开的技术方案所期望的结果,本文在此不进行限制。It should be understood that steps may be reordered, added or deleted using the various forms of flow shown above. For example, the steps described in the present disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, no limitation is imposed herein.
上述具体实施方式,并不构成对本公开保护范围的限制。本领域技术人员应该明白的是,根据设计要求和其他因素,可以进行各种修改、组合、子组合和替代。任何在本公开的精神和原则之内所作的修改、等同替换和改进等,均应包含在本公开保护范围之内。The above-mentioned specific embodiments do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present disclosure should be included within the protection scope of the present disclosure.
Claims (15)
- 一种事件检测的方法,包括:A method of event detection, comprising:获取图像数据,识别所述图像数据的城市场景;acquiring image data, and identifying the urban scene of the image data;确定与所述城市场景对应的待检测目标与待检测事件;determining the target to be detected and the event to be detected corresponding to the urban scene;对所述图像数据中的待检测目标进行检测,得到所述待检测事件的检测状态;Detecting the object to be detected in the image data to obtain the detection state of the event to be detected;根据所述待检测事件的检测状态,得到所述图像数据的事件检测结果。According to the detection state of the to-be-detected event, an event detection result of the image data is obtained.
- 根据权利要求1所述的方法,其中,所述获取图像数据包括:The method of claim 1, wherein said acquiring image data comprises:获取城市的视频流数据;Get the video stream data of the city;从所述视频流数据中提取至少一张关键帧图像,作为所述图像数据。Extract at least one key frame image from the video stream data as the image data.
- 根据权利要求1所述的方法,其中,所述确定与所述城市场景对应的待检测目标与待检测事件包括:The method according to claim 1, wherein the determining the target to be detected and the event to be detected corresponding to the urban scene comprises:根据预设的对应关系,确定与所述城市场景对应的待检测目标与待检测事件。According to the preset correspondence, the target to be detected and the event to be detected corresponding to the urban scene are determined.
- 根据权利要求1所述的方法,其中,所述对所述图像数据中的待检测目标进行检测,得到所述待检测事件的检测状态包括:The method according to claim 1, wherein the detecting the object to be detected in the image data to obtain the detection state of the event to be detected comprises:将所述图像数据与所述待检测目标输入第二识别模型,根据所述第二识别模型的输出结果得到所述待检测事件的检测状态。The image data and the target to be detected are input into a second recognition model, and the detection state of the event to be detected is obtained according to the output result of the second recognition model.
- 根据权利要求1所述的方法,其中,所述根据所述待检测事件的检测状态,得到所述图像数据的事件检测结果包括:The method according to claim 1, wherein the obtaining the event detection result of the image data according to the detection state of the to-be-detected event comprises:将所述图像数据与所述待检测事件的事件状态发送至用户;sending the image data and the event status of the to-be-detected event to the user;根据用户所返回的确认结果,得到所述图像数据的事件检测结果。According to the confirmation result returned by the user, the event detection result of the image data is obtained.
- 根据权利要求1所述的方法,还包括:The method of claim 1, further comprising:在得到所述图像数据的事件检测结果之后,确定所述事件检测结果中是否存在处于异常状态的待检测事件;After obtaining the event detection result of the image data, determine whether there is an event to be detected in an abnormal state in the event detection result;在确定所述事件检测结果中存在处于异常状态的待检测事件的情况下,发出报警信息。When it is determined that there is an event to be detected in an abnormal state in the event detection result, alarm information is issued.
- 一种事件检测的装置,包括:A device for event detection, comprising:获取单元,用于获取图像数据,识别所述图像数据的城市场景;an acquisition unit for acquiring image data and identifying the urban scene of the image data;确定单元,用于确定与所述城市场景对应的待检测目标与待检测事件;a determining unit, configured to determine the target to be detected and the event to be detected corresponding to the urban scene;检测单元,用于对所述图像数据中的待检测目标进行检测,得到所述待检测事件的检测状态;a detection unit, configured to detect the to-be-detected object in the image data to obtain the detection state of the to-be-detected event;处理单元,用于根据所述待检测事件的检测状态,得到所述图像数据的事件检测结果。A processing unit, configured to obtain an event detection result of the image data according to the detection state of the to-be-detected event.
- 根据权利要求7所述的装置,其中,所述获取单元在获取图像数据时,具体执行:The device according to claim 7, wherein, when the acquiring unit acquires the image data, specifically:获取城市的视频流数据;Get the video stream data of the city;从所述视频流数据中提取至少一张关键帧图像,作为所述图像数据。Extract at least one key frame image from the video stream data as the image data.
- 根据权利要求7所述的装置,其中,所述确定单元在确定与所述城市场景对应的待检测目标与待检测事件时,具体执行:The device according to claim 7, wherein, when the determining unit determines the target to be detected and the event to be detected corresponding to the urban scene, specifically:根据预设的对应关系,确定与所述城市场景对应的待检测目标与待检测事件。According to the preset correspondence, the target to be detected and the event to be detected corresponding to the urban scene are determined.
- 根据权利要求7所述的装置,其中,所述检测单元在对所述图像数据中的待检测目标进行检测,得到所述待检测事件的检测状态时,具体执行:The device according to claim 7, wherein, when the detection unit detects the to-be-detected object in the image data and obtains the detection state of the to-be-detected event, the detection unit specifically executes:将所述图像数据与所述待检测目标输入第二识别模型,根据所述第二识别模型的输出结果得到所述待检测事件的检测状态。The image data and the target to be detected are input into a second recognition model, and the detection state of the event to be detected is obtained according to the output result of the second recognition model.
- 根据权利要求7所述的装置,其中,所述处理单元在根据所述待检测事件的检测状态,得到所述图像数据的事件检测结果时,具体执行:The device according to claim 7, wherein, when the processing unit obtains the event detection result of the image data according to the detection state of the to-be-detected event, the processing unit specifically executes:将所述图像数据与所述待检测事件的事件状态发送至用户;sending the image data and the event status of the to-be-detected event to the user;根据用户所返回的确认结果,得到所述图像数据的事件检测结果。According to the confirmation result returned by the user, the event detection result of the image data is obtained.
- 根据权利要求7所述的装置,还包括报警单元,用于执行:The apparatus of claim 7, further comprising an alarm unit for performing:在所述处理单元得到所述图像数据的事件检测结果之后,确定所述事件检测结果中是否存在处于异常状态的待检测事件;After the processing unit obtains the event detection result of the image data, determine whether there is an event to be detected in an abnormal state in the event detection result;在确定所述事件检测结果中存在处于异常状态的待检测事件的情况下,发出报警信息。When it is determined that there is an event to be detected in an abnormal state in the event detection result, alarm information is issued.
- 一种电子设备,包括:An electronic device comprising:至少一个处理器;以及at least one processor; and与所述至少一个处理器通信连接的存储器;其中,a memory communicatively coupled to the at least one processor; wherein,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行权利要求1至6中任一项所述的方法。The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the execution of any one of claims 1 to 6 Methods.
- 一种存储有计算机指令的非瞬时计算机可读存储介质,其中,所述计算机指令用于使所述计算机执行权利要求1至6中任一项所述的方法。A non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-6.
- 一种计算机程序产品,包括计算机程序,所述计算机程序在被处理器执行时实现根据权利要求1至6中任一项所述的方法。A computer program product comprising a computer program which, when executed by a processor, implements the method of any one of claims 1 to 6.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020227024754A KR20220149508A (en) | 2021-04-28 | 2022-01-29 | Event detection method, apparatus, electronic device and readable recording medium |
JP2022543087A JP2023527100A (en) | 2021-04-28 | 2022-01-29 | Event detection method, device, electronic device, readable storage medium, and computer program |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110466781.3A CN113205037B (en) | 2021-04-28 | 2021-04-28 | Event detection method, event detection device, electronic equipment and readable storage medium |
CN202110466781.3 | 2021-04-28 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022227764A1 true WO2022227764A1 (en) | 2022-11-03 |
Family
ID=77029196
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/075019 WO2022227764A1 (en) | 2021-04-28 | 2022-01-29 | Event detection method and apparatus, electronic device, and readable storage medium |
Country Status (4)
Country | Link |
---|---|
JP (1) | JP2023527100A (en) |
KR (1) | KR20220149508A (en) |
CN (1) | CN113205037B (en) |
WO (1) | WO2022227764A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116035564A (en) * | 2022-12-06 | 2023-05-02 | 北京顺源辰辰科技发展有限公司 | Dysphagia and aspiration intelligent detection method and device and electronic equipment |
CN117407507A (en) * | 2023-10-27 | 2024-01-16 | 北京百度网讯科技有限公司 | Event processing method, device, equipment and medium based on large language model |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113205037B (en) * | 2021-04-28 | 2024-01-26 | 北京百度网讯科技有限公司 | Event detection method, event detection device, electronic equipment and readable storage medium |
CN114118933A (en) * | 2021-08-24 | 2022-03-01 | 泰华智慧产业集团股份有限公司 | Recording method and system for city management event |
CN114332731A (en) * | 2021-12-24 | 2022-04-12 | 阿波罗智联(北京)科技有限公司 | City event identification method and device, automatic driving vehicle and cloud server |
CN114445711B (en) * | 2022-01-29 | 2023-04-07 | 北京百度网讯科技有限公司 | Image detection method, image detection device, electronic equipment and storage medium |
CN114943510A (en) * | 2022-05-09 | 2022-08-26 | 上海商汤科技开发有限公司 | City management case processing method, system, device, equipment and storage medium |
CN115334250B (en) * | 2022-08-09 | 2024-03-08 | 阿波罗智能技术(北京)有限公司 | Image processing method and device and electronic equipment |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103679189A (en) * | 2012-09-14 | 2014-03-26 | 华为技术有限公司 | Method and device for recognizing scene |
US20200388150A1 (en) * | 2019-06-06 | 2020-12-10 | Verizon Patent And Licensing Inc. | Monitoring a scene to analyze an event using a plurality of image streams |
CN112507813A (en) * | 2020-11-23 | 2021-03-16 | 北京旷视科技有限公司 | Event detection method and device, electronic equipment and storage medium |
CN113205037A (en) * | 2021-04-28 | 2021-08-03 | 北京百度网讯科技有限公司 | Event detection method and device, electronic equipment and readable storage medium |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105678267A (en) * | 2016-01-08 | 2016-06-15 | 浙江宇视科技有限公司 | Scene recognition method and device |
CN110443969B (en) * | 2018-05-03 | 2021-06-04 | 中移(苏州)软件技术有限公司 | Fire detection method and device, electronic equipment and storage medium |
JP7176573B2 (en) * | 2018-11-13 | 2022-11-22 | 日本電気株式会社 | Dangerous Scene Prediction Apparatus, Dangerous Scene Prediction Method, and Dangerous Scene Prediction Program |
CN109815852A (en) * | 2019-01-03 | 2019-05-28 | 深圳壹账通智能科技有限公司 | Smart city event management method, device, computer equipment and storage medium |
CN111753634B (en) * | 2020-03-30 | 2024-07-26 | 上海高德威智能交通系统有限公司 | Traffic event detection method and equipment |
-
2021
- 2021-04-28 CN CN202110466781.3A patent/CN113205037B/en active Active
-
2022
- 2022-01-29 JP JP2022543087A patent/JP2023527100A/en active Pending
- 2022-01-29 KR KR1020227024754A patent/KR20220149508A/en not_active Application Discontinuation
- 2022-01-29 WO PCT/CN2022/075019 patent/WO2022227764A1/en active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103679189A (en) * | 2012-09-14 | 2014-03-26 | 华为技术有限公司 | Method and device for recognizing scene |
US20200388150A1 (en) * | 2019-06-06 | 2020-12-10 | Verizon Patent And Licensing Inc. | Monitoring a scene to analyze an event using a plurality of image streams |
CN112507813A (en) * | 2020-11-23 | 2021-03-16 | 北京旷视科技有限公司 | Event detection method and device, electronic equipment and storage medium |
CN113205037A (en) * | 2021-04-28 | 2021-08-03 | 北京百度网讯科技有限公司 | Event detection method and device, electronic equipment and readable storage medium |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116035564A (en) * | 2022-12-06 | 2023-05-02 | 北京顺源辰辰科技发展有限公司 | Dysphagia and aspiration intelligent detection method and device and electronic equipment |
CN117407507A (en) * | 2023-10-27 | 2024-01-16 | 北京百度网讯科技有限公司 | Event processing method, device, equipment and medium based on large language model |
Also Published As
Publication number | Publication date |
---|---|
CN113205037A (en) | 2021-08-03 |
JP2023527100A (en) | 2023-06-27 |
CN113205037B (en) | 2024-01-26 |
KR20220149508A (en) | 2022-11-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2022227764A1 (en) | Event detection method and apparatus, electronic device, and readable storage medium | |
US11810319B2 (en) | Image detection method, device, storage medium and computer program product | |
CN113360580B (en) | Abnormal event detection method, device, equipment and medium based on knowledge graph | |
CN111275011B (en) | Mobile traffic light detection method and device, electronic equipment and storage medium | |
WO2023273344A1 (en) | Vehicle line crossing recognition method and apparatus, electronic device, and storage medium | |
WO2023065798A1 (en) | Dynamic road event processing method and apparatus, device, and medium | |
US20230096921A1 (en) | Image recognition method and apparatus, electronic device and readable storage medium | |
CN113780098A (en) | Character recognition method, character recognition device, electronic equipment and storage medium | |
CN114205216B (en) | Root cause positioning method and device for micro service fault, electronic equipment and medium | |
CN111814633A (en) | Method, device, equipment and storage medium for detecting display scene | |
CN111985457A (en) | Traffic facility damage identification method, device, equipment and storage medium | |
JP2022185143A (en) | Text detection method, and text recognition method and device | |
KR20220027000A (en) | Method and device for extracting spatial relationship of geographic location points | |
CN116824455A (en) | Event detection method, device, equipment and storage medium | |
US20220335316A1 (en) | Data annotation method and apparatus, electronic device and readable storage medium | |
CN115965648A (en) | Off-duty detection method and device, electronic equipment and storage medium | |
CN112507957B (en) | Vehicle association method and device, road side equipment and cloud control platform | |
CN114973333A (en) | Human interaction detection method, human interaction detection device, human interaction detection equipment and storage medium | |
CN108009233B (en) | Image restoration method and device, computer equipment and storage medium | |
CN112801078A (en) | Point of interest (POI) matching method and device, electronic equipment and storage medium | |
CN113536031A (en) | Video searching method and device, electronic equipment and storage medium | |
CN114490909B (en) | Object association method and device and electronic equipment | |
US20220375118A1 (en) | Method and apparatus for identifying vehicle cross-line, electronic device and storage medium | |
CN113360688B (en) | Method, device and system for constructing information base | |
US20230036501A1 (en) | Vehicle positioning method and apparatus, and non-transitory computer-readable storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2022543087 Country of ref document: JP Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22794245 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22794245 Country of ref document: EP Kind code of ref document: A1 |