WO2020061766A1 - Vehicle event detection apparatus and method, and computer program product and computer-readable medium - Google Patents

Vehicle event detection apparatus and method, and computer program product and computer-readable medium Download PDF

Info

Publication number
WO2020061766A1
WO2020061766A1 PCT/CN2018/107405 CN2018107405W WO2020061766A1 WO 2020061766 A1 WO2020061766 A1 WO 2020061766A1 CN 2018107405 W CN2018107405 W CN 2018107405W WO 2020061766 A1 WO2020061766 A1 WO 2020061766A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
shape
pictures
change
time
Prior art date
Application number
PCT/CN2018/107405
Other languages
French (fr)
Chinese (zh)
Inventor
孙芃
Original Assignee
西门子股份公司
孙芃
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 西门子股份公司, 孙芃 filed Critical 西门子股份公司
Priority to PCT/CN2018/107405 priority Critical patent/WO2020061766A1/en
Publication of WO2020061766A1 publication Critical patent/WO2020061766A1/en

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/017Detecting movement of traffic to be counted or controlled identifying vehicles

Abstract

A vehicle event detection apparatus and method, and a computer program product and a computer-readable medium. The detection method comprises the following steps: acquiring a group of pictures, arranged in chronological order, of a vehicle within a time period (S101); identifying, from the group of pictures, a change over time in the shape of the vehicle within the time period (S102); determining whether the identified change is the same as a predefined mode of a change over time in one vehicle shape (S103); and if the two are the same, determining that a mode-defined event has occurred to the vehicle (S104).

Description

一种车辆事件的检测装置、方法、计算机程序产品和计算机可读介质Vehicle event detection device, method, computer program product and computer-readable medium 技术领域Technical field
本发明涉及交通管理技术领域,尤其涉及一种车辆事件的检测装置、方法、计算机程序产品和计算机可读介质。The present invention relates to the technical field of traffic management, and in particular, to a device, a method, a computer program product, and a computer-readable medium for detecting a vehicle event.
背景技术Background technique
在交通管理技术领域,有许多与车辆事件的检测相关的应用场景。比如:检测一个车辆是否违规停在了一个只供装货和卸货的停车位,或者两个车辆撞车等。In the field of traffic management technology, there are many application scenarios related to the detection of vehicle events. For example: detecting whether a vehicle has stopped illegally in a parking space for loading and unloading, or two vehicles collided.
目前,绝大多数的城市还采用人工的方式进行车辆事件的检测。每天均需要投入大量的人力对摄像头采集的录像进行监视,当发现异常情况时人工上报。At present, most cities also use manual methods to detect vehicle incidents. Every day, a large amount of manpower is required to monitor the video captured by the camera, and manually report when an abnormal situation is found.
发明内容Summary of the Invention
有鉴于此,本发明实施例提供一种车辆事件的检测装置、方法、计算机程序产品和计算机可读介质,用于实现车辆事件的自动检测,可节省大量的人力,且具有检测准确、及时的优点。In view of this, embodiments of the present invention provide a device, a method, a computer program product, and a computer-readable medium for detecting a vehicle event, which are used to realize automatic detection of a vehicle event, which can save a lot of manpower, and have accurate and timely detection advantage.
第一方面,提供一种车辆事件的检测方法,包括:获取一个车辆在一个时间段内的按时间排序的一组图片;从所述一组图片中识别所述车辆在所述时间段内的形状随时间的变化;判断识别出的所述变化是否与预先定义的一个车辆形状随时间变化的模式相同;若相同,则确定所述车辆发生了所述模式所定义的事件。In a first aspect, a method for detecting a vehicle event is provided, including: acquiring a set of pictures sorted by time of a vehicle within a time period; and identifying, from the set of pictures, a vehicle's Changes in shape over time; determining whether the identified change is the same as a pattern of a vehicle shape that changes over time that is defined in advance; if the pattern is the same, it is determined that the vehicle has an event defined by the pattern.
通过识别车容量的形状随时间的变化,将变化的情况和预先定义的车辆形状随时间变化的模式进行比较,由于车辆形状随时间变化的模式于车辆事件相对应,因此可以根据车辆形状随时间的变化判断发生了何种车辆事件。By identifying the change of the shape of the vehicle capacity over time, the change is compared with a predefined pattern of the vehicle shape changing over time. Since the pattern of the vehicle shape changing over time corresponds to a vehicle event, it can be based on the vehicle shape over time Changes determine what kind of vehicle incident has occurred.
在交通领域,车辆事件的种类繁多,场景复杂,本发明的实施例中,通过发现车辆事件发生时的车辆形状的变化规律,以及车辆与车辆相关的乘客或货物等的位置关系,来预先定义多个车辆形状随时间变化的模式,当识别出的车辆形状随时间的变化与某一种模式匹配时,则可容易地确定发生了该模式所定义的车辆事件。In the field of transportation, there are many types of vehicle events and complex scenes. In the embodiment of the present invention, the change of the shape of the vehicle when the vehicle event occurs and the positional relationship between the vehicle and the passengers or goods related to the vehicle are defined in advance. Multiple vehicle shape changes over time. When the identified change in vehicle shape over time matches a certain pattern, it can be easily determined that a vehicle event defined by the pattern has occurred.
由于方案简单易行,无需大量的存储空间用于存储图片或视频,也无需复杂的算法,因此本发明的实施例可在交通现场处部署的车辆事件的检测装置上实现,进一步保证了事件检测的实时性,并且通过边缘计算和处理,也降低了中心节点的处理负荷。Since the solution is simple and easy, does not require a large amount of storage space for storing pictures or videos, and does not require complicated algorithms, the embodiments of the present invention can be implemented on a vehicle event detection device deployed at a traffic scene, further ensuring event detection. Real-time performance, and through edge computing and processing, also reduces the processing load of the central node.
可选地,在从所述一组图片中识别所述车辆在所述时间段内的形状随时间的变化时,可对所述一组图片中的每一个,识别所述车辆形状可变化的至少一个部分;确定各张图片中识别出的形状可变化的每一个部分的形状在所述时间段内随时间的变化。具体地,可对所述一组图片中的每一个,识别所述车辆的乘坐者,确定各张图片中识别出所述车辆的乘坐者与所述车辆的可变化的至少一个部分的位置关系;以及对所述一组图片中的每一个,识别所述车辆的货物;确定各张图片中识别出所述车辆的货物与所述车辆的可变化的至少一个部分的位置关系。Optionally, when the change of the shape of the vehicle in the time period from the set of pictures is recognized over time, for each of the set of pictures, the changeable shape of the vehicle may be identified. At least one part; determining a change in shape of each part identified in each picture that is changeable over time within the time period. Specifically, the occupant of the vehicle may be identified for each of the group of pictures, and the positional relationship between the occupant of the vehicle and at least one part of the vehicle that can be changed is identified in each picture And, for each of the set of pictures, identifying the cargo of the vehicle; determining a positional relationship between the cargo of the vehicle identified in each of the pictures and at least one part of the vehicle that can be changed.
通过车辆的每个形状可变化的部分的识别以及他们之间位置关系的识别,可更容易、准确地确定车辆形状变化的规律,与预定义的模式匹配的结果更准确。By identifying the changeable parts of each shape of the vehicle and the positional relationship between them, it is easier and more accurate to determine the law of the shape change of the vehicle, and the result of matching the predefined pattern is more accurate.
可选地,在判断识别出的所述变化是否与预先定义的一个车辆形状随时间变化的模式相同之前,还包括:从所述一组图片中识别所述车辆的类型;判断识别出的所述变化是否与预先定义的一个车辆形状随时间变化的模式相同,包括:将识别出的所述变化与识别出的所述车辆的类型所对应的至少一种车辆形状随时间变化的模式进行比较。Optionally, before judging whether the identified change is the same as a predefined pattern of a vehicle shape changing with time, it further includes: identifying the type of the vehicle from the set of pictures; judging the identified all Whether the change is the same as a pre-defined mode of vehicle shape changing with time, and includes: comparing the identified change with at least one mode of vehicle shape changing over time corresponding to the identified type of the vehicle .
这样,可进一步减少模式匹配的运算量,且通过首先识别出车辆的类型,可进一步提高模式匹配的准确性。In this way, the calculation amount of the pattern matching can be further reduced, and the accuracy of the pattern matching can be further improved by first identifying the type of the vehicle.
第二方面,提供一种车辆事件的检测装置,包括:According to a second aspect, a vehicle event detection device is provided, including:
一个图片获取模块,用于获取一个车辆在一个时间段内的按时间排序的一组图片;A picture acquisition module for obtaining a set of pictures sorted by time of a vehicle within a time period;
一个形状变化检测模块,用于从所述一组图片中识别所述车辆在所述时间段内的形状随时间的变化;A shape change detection module, configured to identify, from the set of pictures, a change in shape of the vehicle over time in the time period;
一个模式匹配模块,用于判断识别出的所述变化是否与预先定义的一个车辆形状随时间变化的模式相同;A pattern matching module, configured to determine whether the identified change is the same as a predefined pattern of a vehicle shape changing with time;
一个事件判断模块,若所述变化与预先定义的一个车辆形状随时间变化的模式相同,则确定所述车辆发生了所述模式所定义的事件。An event judging module, if the change is the same as a predefined pattern of a vehicle shape changing with time, determining that the vehicle has an event defined by the pattern.
通过识别车容量的形状随时间的变化,将变化的情况和预先定义的车辆形状随时间变化的模式进行比较,由于车辆形状随时间变化的模式于车辆事件相对应,因此可以根据车辆形状随时间的变化判断发生了何种车辆事件。By identifying the change of the shape of the vehicle capacity over time, the change is compared with a predefined pattern of the shape of the vehicle over time. Since the pattern of the shape of the vehicle over time corresponds to a vehicle event, it can be based on the shape of the vehicle over time. Changes determine what kind of vehicle incident has occurred.
在交通领域,车辆事件的种类繁多,场景复杂,本发明的实施例中,通过发现车辆事件发生时的车辆形状的变化规律,以及车辆与车辆相关的乘客或货物等的位置关系,来预先定义多个车辆形状随时间变化的模式,当识别出的车辆形状随时间的变化与某一种模式匹配时,则可容易地确定发生了该模式所定义的车辆事件。In the field of transportation, there are many types of vehicle events and complex scenes. In the embodiment of the present invention, the change of the shape of the vehicle when the vehicle event occurs and the positional relationship between the vehicle and the passengers or goods related to the vehicle are defined in advance. Multiple vehicle shape changes over time. When the identified change in vehicle shape over time matches a certain pattern, it can be easily determined that a vehicle event defined by the pattern has occurred.
由于方案简单易行,无需大量的存储空间用于存储图片或视频,也无需复杂的算法,因此本发明的实施例可在交通现场处部署的车辆事件的检测装置上实现,进一步保证了事件检测的实时性,并且通过边缘计算和处理,也降低了中心节点的处理负荷。Since the solution is simple and easy, does not require a large amount of storage space for storing pictures or videos, and does not require complicated algorithms, the embodiments of the present invention can be implemented on a vehicle event detection device deployed at a traffic scene, further ensuring event detection. Real-time performance, and through edge computing and processing, also reduces the processing load of the central node.
可选地,所述形状变化检测模块,具体用于:对所述一组图片中的每一张,识别所述车辆形状可变化的至少一个部分;确定各张图片中识别出的形状可变化的每一个部分的形状在所述时间段内随时间的变化。具体地,所述形状变化检测模块可对所述一组图片中的每一张,识别所述车辆的乘坐者;确定各张图片中识别出所述车辆的乘坐者与所述车辆的可变化的至少一个部分的位置关系;以及对所述一组图片中的每一张,识别所述车辆的货物;确定各张图片中识别出所述车辆的货物与所述车辆的可变化的至少一个部分的位置关系。Optionally, the shape change detection module is specifically configured to: for each of the group of pictures, identify at least a part where the shape of the vehicle is changeable; determine that the shape recognized in each picture is changeable The shape of each of the parts changes over time during the time period. Specifically, the shape change detection module may identify the occupant of the vehicle for each of the set of pictures; and determine that the occupants of the vehicle and the changeable of the vehicle are identified in each of the pictures. Position relationship of at least one part of; and for each of the set of pictures, identifying the goods of the vehicle; determining at least one of the pictures identifying the goods of the vehicle and the changeable of the vehicle in each picture Partial positional relationship.
通过车辆的每个形状可变化的部分的识别以及他们之间位置关系的识别,可更容易、准确地确定车辆形状变化的规律,与预定义的模式匹配的结果更准确。By identifying the changeable parts of each shape of the vehicle and the positional relationship between them, it is easier and more accurate to determine the law of the shape change of the vehicle, and the result of matching the predefined pattern is more accurate.
可选地,所述装置还包括:一个车辆类型识别模块,用于在判断识别出的所述变化是否与预先定义的一个车辆形状随时间变化的模式相同之前,从所述一组图片中识别所述车辆的类型;所述模式匹配模块具体用于:将识别出的所述变化与识别出的所述车辆的类型所对应的至少一种车辆形状随时间变化的模式进行比较。Optionally, the device further includes: a vehicle type recognition module, configured to identify from the set of pictures before determining whether the identified change is the same as a predefined pattern of a vehicle shape changing with time. The type of the vehicle; the pattern matching module is specifically configured to compare the identified change with at least one pattern of vehicle shape changes over time corresponding to the identified type of the vehicle.
这样,可进一步减少模式匹配的运算量,且通过首先识别出车辆的类型,可进一步提高模式匹配的准确性。In this way, the calculation amount of the pattern matching can be further reduced, and the accuracy of the pattern matching can be further improved by first identifying the type of the vehicle.
第三方面,提供一种车辆事件的检测装置,包括:至少一个存储器,用于存储计算机可读代码;至少一个处理器,用于调用所述计算机可读代码,执行第一方面或第一方面的任一种可能的实现方式提供的方法。According to a third aspect, a vehicle event detection device is provided, including: at least one memory for storing computer-readable code; and at least one processor for calling the computer-readable code to execute the first aspect or the first aspect Method provided by any of the possible implementations.
其中,第二方面、第二方面的任一种可能的实现方式、第三方面或第三方面的任一种可能的实现方式所提供ERP系统装置可部署在交通现场,进行边缘运算。Among them, the ERP system device provided by the second aspect, any possible implementation manner of the second aspect, the third aspect, or any possible implementation manner of the third aspect may be deployed at a traffic site to perform edge computing.
第三方面,提供一种计算机程序产品,所述计算机程序产品被有形地存储在计算机可读介质上并且包括计算机可执行指令,所述计算机可执行指令在被执行时使至少一个处理器执行第一方面或第一方面的任一种可能的实现方式提供的方法。In a third aspect, a computer program product is provided that is tangibly stored on a computer-readable medium and includes computer-executable instructions that, when executed, cause at least one processor to execute a first The method provided by one aspect or any possible implementation manner of the first aspect.
第四方面,提供一种计算机可读介质,所述计算机可读介质上存储有计算机可读指令,所述计算机可读指令在被处理器执行时,使所述处理器执行第一方面,或第一方面的任一种 可能的实现方式提供的方法。According to a fourth aspect, a computer-readable medium is provided. The computer-readable medium stores computer-readable instructions, and the computer-readable instructions, when executed by a processor, cause the processor to execute the first aspect, or The method provided in any possible implementation of the first aspect.
上述任一方面或任一方面的任一种可能的实现方式中,所判断的事件包括下列类型中的一个:车辆侧门开启;车辆侧门关闭;车辆尾门开启;车辆尾门关闭;车辆乘坐者上车;车辆乘坐者下车;装货;卸货。In any of the above aspects or any possible implementation manner of any aspect, the judged event includes one of the following types: vehicle side door opened; vehicle side door closed; vehicle tail door opened; vehicle tail door closed; vehicle occupant Get on; get off the vehicle; load; unload.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本发明的实施例一提供的交通管理系统的结构示意图。FIG. 1 is a schematic structural diagram of a traffic management system according to a first embodiment of the present invention.
图2a为本发明的实施例二提供的一种车辆事件的检测方法的流程图。FIG. 2a is a flowchart of a method for detecting a vehicle event according to a second embodiment of the present invention.
图2b为本发明的实施例三提供的一种车辆事件的检测方法的流程图。FIG. 2b is a flowchart of a method for detecting a vehicle event according to a third embodiment of the present invention.
图3为本发明的实施例四提供的一种车辆事件的检测装置的结构示意图。FIG. 3 is a schematic structural diagram of a vehicle event detection device according to a fourth embodiment of the present invention.
图4为本发明的实施例五提供的一种车辆事件的检测装置的结构示意图。FIG. 4 is a schematic structural diagram of a vehicle event detection device according to a fifth embodiment of the present invention.
图5为本发明的实施例六提供的一种车辆事件的检测装置的结构示意图。FIG. 5 is a schematic structural diagram of a vehicle event detection device according to a sixth embodiment of the present invention.
图6~图8为本发明各实施例中检测车辆形状变化的示意图。6 to 8 are schematic diagrams of detecting a shape change of a vehicle in each embodiment of the present invention.
图9、图11为本发明实施例中检测车辆乘坐者下车事件的示意图。FIG. 9 and FIG. 11 are schematic diagrams of detecting a vehicle occupant getting off event according to an embodiment of the present invention.
图10为本发明实施例中检测车辆乘坐者上车事件的示意图。FIG. 10 is a schematic diagram of detecting a boarding event of a vehicle occupant according to an embodiment of the present invention.
图12为本发明实施例中检测卸货事件的示意图。FIG. 12 is a schematic diagram of detecting an unloading event in an embodiment of the present invention.
图13为本发明实施例中检测装货事件的示意图。FIG. 13 is a schematic diagram of detecting a loading event in an embodiment of the present invention.
附图标记列表:List of reference signs:
100:交通管理系统100: Traffic Management System 10:摄像头10: Camera 20:云20: Cloud
30:车辆事件的检测装置30: Vehicle event detection device 40:客户端40: Client  Zh
S101:获取图片序列S101: Obtain a picture sequence S102:识别车辆形状变化S102: Recognize changes in vehicle shape S103:车辆形状变化模式匹配S103: Vehicle shape change pattern matching
S104:确定发生的车辆事件S104: Determine the occurrence of a vehicle event  Zh  Zh
S201:获取图片序列S201: Obtaining a picture sequence S202:识别车辆形状变化S202: Identify vehicle shape changes S202’:识别车辆类型S202 ’: Identify the type of vehicle
S203:车辆形状变化模式匹配S203: Vehicle shape change pattern matching S204:确定发生的车辆事件S204: Determine the occurrence of a vehicle event  Zh
301:图片获取模块301: Picture acquisition module 302:形状变化检测模块302: Shape change detection module 303:模式匹配模块303: Pattern matching module
304:事件判断模块304: Event judgment module 302’:车辆类型识别模块302 ’: Vehicle type identification module  Zh
305:存储器305: Memory 306:处理器306: Processor 307:通信模块307: Communication module
具体实施方式detailed description
为了实现车辆事件的自动检测,本发明的实施例中,通过识别车容量的形状随时间的变化,将变化的情况和预先定义的车辆形状随时间变化的模式进行比较,由于车辆形状随时间变化的模式于车辆事件相对应,因此可以根据车辆形状随时间的变化判断发生了何种车辆事件。In order to realize the automatic detection of vehicle events, in the embodiment of the present invention, by identifying the change of the shape of the vehicle capacity with time, the change is compared with a predefined pattern of the shape of the vehicle with time. As the shape of the vehicle changes with time, The mode corresponds to vehicle events, so you can determine what kind of vehicle event has occurred based on changes in vehicle shape over time.
在交通领域,车辆事件的种类繁多,场景复杂,本发明的实施例中,通过发现车辆事件发生时的车辆形状的变化规律,以及车辆与车辆相关的乘客或货物等的位置关系,来预先定义多个车辆形状随时间变化的模式,当识别出的车辆形状随时间的变化与某一种模式匹配时,则可容易地确定发生了该模式所定义的车辆事件。In the field of transportation, there are many types of vehicle events and complex scenes. In the embodiment of the present invention, the change of the shape of the vehicle when the vehicle event occurs and the positional relationship between the vehicle and the passengers or goods related to the vehicle are defined in advance. Multiple vehicle shape changes over time. When the identified change in vehicle shape over time matches a certain pattern, it can be easily determined that a vehicle event defined by the pattern has occurred.
由于方案简单易行,无需大量的存储空间用于存储图片或视频,也无需复杂的算法,因此本发明的实施例可在交通现场处部署的车辆事件的检测装置上实现,进一步保证了事件检测的实时性,并且通过边缘计算和处理,也降低了中心节点的处理负荷。Since the solution is simple and easy, does not require a large amount of storage space for storing pictures or videos, and does not require complicated algorithms, the embodiments of the present invention can be implemented on a vehicle event detection device deployed at a traffic scene, further ensuring event detection. Real-time performance, and through edge computing and processing, also reduces the processing load of the central node.
【实施例一】[Example 1]
图1示出了本发明实施例提供的交通管理系统100。其中,摄像头10用于摄取图片或视频,车辆事件的检测装置30用于对摄像头10摄取的图片或视频进行图像处理,并根据图像处理的结果判断是否发生了车辆事件,以及发生了何种车辆事件。判断结果以及相关图片或视频可以存储在车辆事件的检测装置20中或云20端,客户端40(计算机或移动终端)可登陆云20端获取车辆事件的检测结果,并可根据需要获取相关的图片或视频,进一步地,还可根据车辆事件的检测结果实现客户端40上运行的各种应用等。FIG. 1 shows a traffic management system 100 according to an embodiment of the present invention. Among them, the camera 10 is used to capture pictures or videos, and the vehicle event detection device 30 is used to perform image processing on the pictures or videos captured by the camera 10, and determine whether a vehicle event has occurred and what kind of vehicle has occurred according to the results of the image processing. event. The judgment results and related pictures or videos can be stored in the vehicle event detection device 20 or the cloud 20 side, and the client 40 (computer or mobile terminal) can log in to the cloud 20 side to obtain the detection results of the vehicle event, and can obtain related Pictures or videos, and further, various applications and the like running on the client 40 can be implemented according to the detection result of the vehicle event.
其中,车辆事件的检测装置30可部署在交通现场,在硬件实现上可与摄像头10集成在同一个硬件设备上,或由单独的硬件设备实现。The vehicle event detection device 30 may be deployed at a traffic scene, and may be integrated with the camera 10 on the same hardware device in hardware implementation, or may be implemented by a separate hardware device.
其中,车辆事件的检测装置30所实现的车辆事件的检测流程可参考下述的实施例二和实施例三。The vehicle event detection process implemented by the vehicle event detection device 30 may refer to the second embodiment and the third embodiment described below.
【实施例二】[Example 2]
如图2a所示,实施例二提供的车辆事件的检测方法可包括如下步骤:As shown in FIG. 2a, the method for detecting a vehicle event provided in the second embodiment may include the following steps:
S101:获取图片序列。S101: Acquire a picture sequence.
在该步骤中,车辆事件的检测装置30可通过摄像头10摄取交通现场处的视频或图片,需要说明的是:若摄取的是视频,则可从视频中截取按时间排序的多张图片;若摄取的是图片,则需要为每一张图片标注摄取的时间,以保证获取的是按时间排序的一组图片。In this step, the vehicle event detection device 30 can capture the video or picture at the traffic scene through the camera 10. It should be noted that if the video is captured, multiple pictures ordered by time can be intercepted from the video; if If you are taking pictures, you need to mark the time of taking each picture to ensure that you get a set of pictures ordered by time.
S102:识别车辆形状变化。S102: Identify a change in the shape of the vehicle.
该步骤中,可对该组图片中的每一张,识别车辆形状可变化的至少一个部分,比如车辆的侧门、尾门、车辆的乘坐者、车辆的货物等;并确定各张图片中识别出的形状可变化的每一个部分的形状在时间段内随时间的变化。In this step, for each of the group of pictures, at least one part of the vehicle shape that can be changed, such as a side door, a tail door, a occupant of the vehicle, a cargo of the vehicle, and the like can be identified; The shape of each part can change over time during a period of time.
参见图8,摄像头10先后摄取了图8中左上和右上两张图片,通过目标识别,可用边界框(bounding box)分别在两张图片中框定目标汽车。如左下图片和右下图片所示,将该车辆的形状可变化的尾门也适用边界框框定,那么则可确定该车辆的尾门的形状发生的变化。Referring to FIG. 8, the camera 10 captures the upper left and upper right pictures in FIG. 8. Through target recognition, a bounding box can be used to frame the target car in the two pictures. As shown in the lower left picture and the lower right picture, the shape of the tail gate of the vehicle that can be changed is also bounded by the bounding box, then the change in the shape of the tail gate of the vehicle can be determined.
其中,若从该组图片中识别出车辆的乘坐者,还可进一步确定各张图片中识别出车辆的乘坐者与车辆的可变化的至少一个部分的位置关系。若从该组图片中识别车辆的货物,则还可进一步确定识别出的车辆的货物与车辆的可变化的至少一个部分的位置关系。Wherein, if the occupant of the vehicle is identified from the set of pictures, the positional relationship between the occupant of the vehicle and at least one part of the vehicle that can be changed in each of the pictures can be further determined. If the cargo of the vehicle is identified from the set of pictures, the positional relationship between the identified cargo of the vehicle and at least one part of the vehicle that can be changed can be further determined.
参见图9、图10和图11,摄像头10先后摄取了从左至右的三张图片,通过目标识别可识别出车辆的侧门和车辆的乘坐者这些形状可变化的部分,并且可以识别出车辆的乘坐者与车辆的侧门之间的位置关系。Referring to FIG. 9, FIG. 10, and FIG. 11, the camera 10 has taken three pictures from left to right, and can recognize the changeable shape of the side door of the vehicle and the occupant of the vehicle through target recognition, and can identify the vehicle Relationship between the occupants and the side doors of the vehicle.
参见图12和图13,摄像头先后摄取了从左至右的三张图片,通过目标识别可识别出车辆的尾门、车辆的乘坐者和车辆的货物这些形状可变化的部分,并且可以识别出车辆的乘坐者与车辆的尾门之间的位置关系,车辆的货物与车辆的尾门之间的位置关系,以及车辆的乘坐者与车辆的车辆的获取之间的位置关系。Referring to FIG. 12 and FIG. 13, the camera has taken three pictures from left to right, and can recognize the changeable shapes of the rear door of the vehicle, the occupant of the vehicle, and the cargo of the vehicle through target recognition, and can identify The positional relationship between the occupant of the vehicle and the tailgate of the vehicle, the positional relationship between the cargo of the vehicle and the tailgate of the vehicle, and the positional relationship between the occupant of the vehicle and the acquisition of the vehicle of the vehicle.
在识别出上述形状变化和位置关系后,则可通过下面的步骤S103进行模式匹配进而通过步骤S104确定发生的车辆事件。After the above-mentioned shape change and positional relationship are identified, the pattern matching can be performed through the following step S103 and then the vehicle event that has occurred can be determined through step S104.
S103:车辆形状变化模式匹配。S103: Match the vehicle shape change pattern.
该步骤中,判断步骤S102中识别出的变化是否与预先定义的一个车辆形状随时间变化的模式相同。In this step, it is determined whether the change identified in step S102 is the same as a pattern of a shape of a vehicle that changes over time in advance.
S104:若步骤S102中识别出的变化与预先定义的一个车辆形状随时间变化的模式相同,则确定车辆发生了该模式所定义的事件。S104: If the change identified in step S102 is the same as a predefined pattern of a vehicle shape changing with time, it is determined that the vehicle has an event defined by the pattern.
车辆形状随时间变化的模式,与该模式所定义的事件之间的对应关系可如下表所示。The pattern of the vehicle shape changing with time, and the correspondence between the events defined by the pattern can be shown in the following table.
Figure PCTCN2018107405-appb-000001
Figure PCTCN2018107405-appb-000001
Figure PCTCN2018107405-appb-000002
Figure PCTCN2018107405-appb-000002
可选地,可采用机器视觉(machine vision)算法通过识别出的车辆形状随时间的变化来触发事件,由于机器视觉算法对处理能力要求不高,因此,上述流程可由部署在交通现场的边缘设备,即车辆事件的检测装置30来实现。此外,可采用人工智能算法来执行上述步骤S103和S104,进行模式匹配和事件判断。Optionally, a machine vision algorithm can be used to trigger an event by identifying changes in the shape of the vehicle over time. Since the machine vision algorithm does not require high processing capabilities, the above process can be deployed by edge devices deployed at the traffic site That is, the vehicle event detection device 30 is implemented. In addition, an artificial intelligence algorithm may be used to perform the above steps S103 and S104 for pattern matching and event determination.
以图9所示的“车辆乘坐者下车”为例,人工智能算法可识别出如下步骤:Taking "vehicle occupants get off" shown in Figure 9 as an example, the artificial intelligence algorithm can identify the following steps:
1)如左图所示,车辆停在路边。1) As shown on the left, the vehicle is parked on the side of the road.
2)如中间的图所示,侧门开启(车辆的侧面的轮廓发生变化),可选地,虽未在图中示意,但还可以检测出车辆的乘坐者下车(车辆的乘坐者的边界框与车辆的边界框相邻或者部分重叠,即可以检测出车辆的乘坐者与车辆的形状可变化的部分之间的位置关系)。2) As shown in the middle figure, the side door is opened (the profile of the side of the vehicle changes). Optionally, although not shown in the figure, it is also possible to detect the vehicle occupant getting off (the boundary of the vehicle occupant) The frame is adjacent to or partially overlaps the bounding box of the vehicle, that is, the positional relationship between the occupant of the vehicle and the part where the shape of the vehicle can be changed).
3)如右图所示,侧门关闭。3) As shown on the right, the side door is closed.
此外,还可为有限状态机增加额外的步骤以提高运算精度。可定义各种不同的有限状态机以支持更多的应用场景。以图12所示的“卸货”事件为例,有限状态机可识别出如下步骤:In addition, additional steps can be added to the finite state machine to improve the calculation accuracy. Various different finite state machines can be defined to support more application scenarios. Taking the "unloading" event shown in Figure 12 as an example, the finite state machine can identify the following steps:
1)如左图所示,车辆停在路边。1) As shown on the left, the vehicle is parked on the side of the road.
2)如中间的图所示,尾门开启(车辆的侧面的轮廓发生变化),并检测到车辆中有货物(货物的边界框与车辆的边界框有重叠)。2) As shown in the middle figure, the tailgate is opened (the outline of the side of the vehicle changes), and a cargo is detected in the vehicle (the bounding box of the cargo overlaps with the bounding box of the vehicle).
3)如右图所示,尾门开启,检测到在车辆外面有车辆的乘客和货物。3) As shown in the figure on the right, the tailgate opens, and passengers and cargo are detected outside the vehicle.
【实施例三】[Example 3]
如图2b所示,实施例三提供的车辆事件的检测方法中包括的步骤S201、S202、S203和S204可分别参考前述的步骤S101、S102、S103和S104。与实施例二不同的是,在实施例三 中,在步骤S202和S203之间,在对该组图片进行目标识别时,可进一步识别车辆的类型。在步骤S203中,可将识别出的变化与识别出的车辆的类型所对应的至少一种车辆形状随时间变化的模式进行比较。这样可减少模式匹配的次数,降低运算量。As shown in FIG. 2b, steps S201, S202, S203, and S204 included in the method for detecting a vehicle event provided in the third embodiment may refer to the foregoing steps S101, S102, S103, and S104, respectively. Different from the second embodiment, in the third embodiment, between steps S202 and S203, when performing target recognition on the group of pictures, the type of the vehicle can be further identified. In step S203, the identified change may be compared with at least one pattern of vehicle shape changes over time corresponding to the identified type of vehicle. This can reduce the number of pattern matching and reduce the amount of calculation.
此外,在对图片进行目标识别时,可进一步识别出目标的类别,比如:车辆、车辆的侧门、车辆的尾门、货物、车辆的乘客等。在模式识别和预先定义模式时,可定义不同类型的目标之间的位置关系和时序,比如:当类型为车辆的侧门的目标的边界框与类型为车辆的乘客的目标的边界框部分重叠时,可确定车辆的乘客有上车或下车的事件发生。In addition, when the target is identified in the picture, the target type may be further identified, such as: a vehicle, a side door of the vehicle, a tail door of the vehicle, a cargo, a passenger of the vehicle, and the like. During pattern recognition and predefined patterns, you can define the positional relationship and timing between different types of targets, such as when the bounding box of a target of the type of the side door of the vehicle and the bounding box of the target of the type of passenger of the vehicle partially overlap , It can be determined that the passenger of the vehicle got on or off.
以上通过实施例二和实施例三介绍了车辆事件的检测方法流程。下面通过实施例四~实施例六介绍车辆事件的检测装置30。The process of detecting a vehicle event has been described above through the second and third embodiments. The following describes a vehicle event detection device 30 through Embodiments 4 to 6.
【实施例四】[Example 4]
如图3所示,实施例四提供的车辆事件的检测装置30可包括:As shown in FIG. 3, the vehicle event detection device 30 provided in the fourth embodiment may include:
一个图片获取模块301,用于获取一个车辆在一个时间段内的按时间排序的一组图片;A picture acquisition module 301, for obtaining a set of pictures sorted by time of a vehicle within a time period;
一个形状变化检测模块302,用于从一组图片中识别车辆在时间段内的形状随时间的变化;A shape change detection module 302, for identifying the change of the shape of the vehicle over time from a set of pictures;
一个模式匹配模块303,用于判断识别出的变化是否与预先定义的一个车辆形状随时间变化的模式相同;A pattern matching module 303, configured to determine whether the identified change is the same as a predefined pattern of a vehicle shape changing with time;
一个事件判断模块304,若变化与预先定义的一个车辆形状随时间变化的模式相同,则确定车辆发生了模式所定义的事件。An event judging module 304 determines that the vehicle has an event defined by the mode if the change is the same as a predefined pattern of a vehicle shape changing with time.
可选地,形状变化检测模块302,具体用于:Optionally, the shape change detection module 302 is specifically configured to:
对一组图片中的每一张,识别车辆形状可变化的至少一个部分;For each of a set of pictures, identifying at least one part of which the shape of the vehicle can vary;
确定各张图片中识别出的形状可变化的每一个部分的形状在时间段内随时间的变化。Determine the change in shape of each part of the shape that can be identified in each picture over time.
进一步地,形状变化检测模块302可具体用于:对一组图片中的每一张,识别车辆的乘坐者;确定各张图片中识别出车辆的乘坐者与车辆的可变化的至少一个部分的位置关系;以及对一组图片中的每一张,识别车辆的货物;确定各张图片中识别出车辆的货物与车辆的可变化的至少一个部分的位置关系。Further, the shape change detection module 302 may be specifically configured to: for each of a group of pictures, identify the occupant of the vehicle; determine the identities of the vehicle and the changeable at least one part of the vehicle in each of the pictures. Positional relationship; and for each of a set of pictures, identifying the cargo of the vehicle; determining the positional relationship of the cargo of the identified vehicle in each of the pictures and at least one part of the vehicle that can be changed.
可选地,事件判断模块304所判断的事件包括下列类型中的一个:车辆侧门开启、车辆侧门关闭、车辆尾门开启、车辆尾门关闭、车辆乘坐者上车、车辆乘坐者下车、装货、卸货。Optionally, the event determined by the event determination module 304 includes one of the following types: vehicle side door open, vehicle side door closed, vehicle tail door opened, vehicle tail door closed, vehicle occupant getting on, vehicle occupant getting off, loading Cargo, unloading.
该装置的其他可选实现方式可参考实施例二,其中,图片获取模块301可用于完成前述的步骤S101,形状变化检测模块302可用于完成前述的步骤S102,模式匹配模块303可用于 完成前述的步骤S103,事件判断模块304可用于完成前述的步骤S104。For other optional implementations of the device, reference may be made to the second embodiment. The picture acquisition module 301 may be used to complete the foregoing step S101, the shape change detection module 302 may be used to complete the foregoing step S102, and the pattern matching module 303 may be used to complete the foregoing In step S103, the event determination module 304 may be used to complete the foregoing step S104.
【实施例五】[Example 5]
与实施例四不同的是,实施例五所提供的车辆事件的检测装置30还可包括一个车辆类型识别模块302’,用于在判断识别出的变化是否与预先定义的一个车辆形状随时间变化的模式相同之前,从一组图片中识别车辆的类型;而模式匹配模块303具体用于:将识别出的变化与识别出的车辆的类型所对应的至少一种车辆形状随时间变化的模式进行比较。Different from the fourth embodiment, the vehicle event detection device 30 provided in the fifth embodiment may further include a vehicle type recognition module 302 'for determining whether the recognized change is different from a predefined shape of the vehicle over time. Before the patterns are the same, the type of the vehicle is identified from a set of pictures; and the pattern matching module 303 is specifically configured to compare the identified change with at least one pattern of the shape of the vehicle that changes over time corresponding to the identified type of vehicle. .
【实施例六】[Example 6]
图5为实施例八提供的车辆事件的检测装置30的结构示意图。如图5所示,该装置可包括:FIG. 5 is a schematic structural diagram of a vehicle event detection device 30 according to an eighth embodiment. As shown in FIG. 5, the device may include:
至少一个存储器305,用于存储计算机可读代码;At least one memory 305, configured to store computer-readable code;
至少一个处理器306,用于调用计算机可读代码,执行前述的各实施例提供的车辆事件的检测方法。At least one processor 306 is configured to call a computer-readable code to execute a method for detecting a vehicle event provided by the foregoing embodiments.
其中至少一个存储器305和至少一个处理器306之间可通过总线连接,此外,该装置分还可提供至少一个通信接口307,用于与摄像头10以及云20通信,传输图片以及图片信息等。通信接口307和存储器305以及处理器306之间也可通过总线通信。The at least one memory 305 and the at least one processor 306 may be connected through a bus. In addition, the device may further provide at least one communication interface 307 for communicating with the camera 10 and the cloud 20, and transmitting pictures and picture information. The communication interface 307 and the memory 305 and the processor 306 can also communicate through a bus.
需要说明的是,实施例五~实施例六中车辆事件的检测装置30所包括的各模块等可视为图5所示的至少一个存储器305中存储的计算机可读代码中的程序模块,由至少一个处理器306调用以执行本发明实施例提供的车辆事件的检测方法。其中,程序模块可以以操作系统、应用程序模块和其他程序模块的形式包含于计算设备中,并且还可以物理地存储在已知的若干存储器设备中。程序模块可以包括但是不限于:用于执行特定操作的例程、子例程、程序、对象、部件和数据结构或者一类将根据本发明描述的特定抽象数据。It should be noted that the modules and the like included in the vehicle event detection device 30 in Embodiments 5 to 6 can be regarded as program modules in computer-readable codes stored in at least one memory 305 shown in FIG. 5. At least one processor 306 calls to execute a method for detecting a vehicle event provided by an embodiment of the present invention. The program module may be included in the computing device in the form of an operating system, an application program module, and other program modules, and may also be physically stored in several known memory devices. The program module may include, but is not limited to, a routine, a subroutine, a program, an object, a component, and a data structure for performing a specific operation or a type of specific abstract data to be described in accordance with the present invention.
此外,上述各模块也可视为由硬件和软件组合而实现的各个功能模块,车辆事件的检测装置30在执行车辆事件的检测方法时涉及的各种功能。上述各模块还也可视为由硬件实现的各个功能模块,用于实现车辆事件的检测装置30在执行车辆事件的检测方法时涉及的各种功能,比如预先将车辆事件的检测方法中涉及的各流程的控制逻辑烧制到诸如现场可编程门阵列(Field-Programmable Gate Array,FPGA)芯片或复杂可编程逻辑器件(Complex Programmable Logic Device,CPLD)中,而由这些芯片或器件执行上述各模块的功能,具体实现方式可依工程实践而定。In addition, the above-mentioned modules can also be regarded as various functional modules implemented by a combination of hardware and software, and various functions involved in the vehicle event detection device 30 when executing the vehicle event detection method. The above-mentioned modules can also be regarded as various functional modules implemented by hardware, which are used to implement various functions involved in the vehicle event detection device 30 when performing the vehicle event detection method, such as the methods involved in the vehicle event detection method in advance. The control logic of each process is burned into, for example, a Field-Programmable Gate Array (FPGA) chip or a Complex Programmable Logic Device (CPLD), and these chips or devices execute the above modules The specific functions and implementation methods may depend on engineering practice.
此外,本发明实施例还提供一种计算机可读介质,该计算机可读介质上存储有计算机可读指令,计算机可读指令在被处理器执行时,使处理器车辆事件的检测方法。计算机可读介质的实施例包括软盘、硬盘、磁光盘、光盘(如CD-ROM、CD-R、CD-RW、DVD-ROM、DVD-RAM、DVD-RW、DVD+RW)、磁带、非易失性存储卡和ROM。可选地,可以由通信网络从服务器计算机上或云上下载计算机可读指令。In addition, an embodiment of the present invention further provides a computer-readable medium. The computer-readable medium stores computer-readable instructions. When the computer-readable instructions are executed by a processor, the method for detecting a processor vehicle event. Examples of computer-readable media include floppy disks, hard disks, magneto-optical disks, optical disks (such as CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD + RW), magnetic tape, non- Volatile memory card and ROM. Alternatively, the computer-readable instructions may be downloaded from a server computer or the cloud by a communication network.
综上,本发明实施例提供一种车辆事件的检测方法、装置、计算机可读介质、计算机程序产品以及交通管理系统。通过识别车容量的形状随时间的变化,将变化的情况和预先定义的车辆形状随时间变化的模式进行比较,由于车辆形状随时间变化的模式于车辆事件相对应,因此可以根据车辆形状随时间的变化自动判断发生了何种车辆事件。In summary, embodiments of the present invention provide a method, a device, a computer-readable medium, a computer program product, and a traffic management system for detecting a vehicle event. By identifying the change of the shape of the vehicle capacity over time, the change is compared with a predefined pattern of the shape of the vehicle over time. Since the pattern of the shape of the vehicle over time corresponds to a vehicle event, it can be based on the shape of the vehicle over time. Changes automatically determine what kind of vehicle event has occurred.
需要说明的是,上述各流程和各系统结构图中不是所有的步骤和模块都是必须的,可以根据实际的需要忽略某些步骤或模块。各步骤的执行顺序不是固定的,可以根据需要进行调整。上述各实施例中描述的系统结构可以是物理结构,也可以是逻辑结构,即,有些模块可能由同一物理实体实现,或者,有些模块可能分由多个物理实体实现,或者,可以由多个独立设备中的某些部件共同实现。It should be noted that not all steps and modules in the above processes and system structure diagrams are necessary, and some steps or modules can be ignored according to actual needs. The execution order of each step is not fixed and can be adjusted as needed. The system structure described in the above embodiments may be a physical structure or a logical structure, that is, some modules may be implemented by the same physical entity, or some modules may be implemented by multiple physical entities, or may be implemented by multiple Some components in separate devices are implemented together.

Claims (16)

  1. 车辆事件的检测方法,其特征在于,包括:A method for detecting a vehicle event, including:
    获取一个车辆在一个时间段内的按时间排序的一组图片;Get a set of pictures sorted by time of a vehicle in a time period;
    从所述一组图片中识别所述车辆在所述时间段内的形状随时间的变化;Identifying changes in the shape of the vehicle over the period of time from the set of pictures;
    判断识别出的所述变化是否与预先定义的一个车辆形状随时间变化的模式相同;Determining whether the identified change is the same as a predefined pattern of a vehicle shape changing with time;
    若相同,则确定所述车辆发生了所述模式所定义的事件。If they are the same, it is determined that the vehicle has an event defined by the mode.
  2. 如权利要求1所述的方法,其特征在于,从所述一组图片中识别所述车辆在所述时间段内的形状随时间的变化,包括:The method of claim 1, wherein identifying the change in shape of the vehicle over the time period from the set of pictures includes:
    对所述一组图片中的每一个,识别所述车辆形状可变化的至少一个部分;For each of the set of pictures, identifying at least a portion of which the shape of the vehicle is changeable;
    确定各张图片中识别出的形状可变化的每一个部分的形状在所述时间段内随时间的变化。It is determined that the shape of each part of the shape that can be changed in each picture is changed over time within the time period.
  3. 如权利要求2所述的方法,其特征在于,从所述一组图片中识别所述车辆在所述时间段内的形状随时间的变化,还包括:The method according to claim 2, wherein identifying the change of the shape of the vehicle in the time period from the set of pictures with time further comprises:
    对所述一组图片中的每一个,识别所述车辆的乘坐者;For each of the set of pictures, identifying a occupant of the vehicle;
    确定各张图片中识别出所述车辆的乘坐者与所述车辆的可变化的至少一个部分的位置关系。A positional relationship between an occupant of the vehicle and at least a changeable part of the vehicle is identified in each picture.
  4. 如权利要求2所述的方法,其特征在于,从所述一组图片中识别所述车辆在所述时间段内的形状随时间的变化,还包括:The method according to claim 2, wherein identifying the change of the shape of the vehicle in the time period from the set of pictures with time further comprises:
    对所述一组图片中的每一个,识别所述车辆的货物;For each of the set of pictures, identifying the cargo of the vehicle;
    确定各张图片中识别出所述车辆的货物与所述车辆的可变化的至少一个部分的位置关系。A positional relationship between the cargo of the vehicle and at least a changeable part of the vehicle is identified in each picture.
  5. 如权利要求1~4任一项所述的方法,其特征在于,The method according to any one of claims 1 to 4, wherein
    在判断识别出的所述变化是否与预先定义的一个车辆形状随时间变化的模式相同之前,还包括:从所述一组图片中识别所述车辆的类型;Before determining whether the identified change is the same as a predefined pattern of a vehicle shape changing with time, the method further includes: identifying the type of the vehicle from the set of pictures;
    判断识别出的所述变化是否与预先定义的一个车辆形状随时间变化的模式相同,包括:将识别出的所述变化与识别出的所述车辆的类型所对应的至少一种车辆形状随时间变化的模式进行比较。Judging whether the identified change is the same as a predefined pattern of a vehicle shape changing with time, including: comparing the identified change with at least one vehicle shape corresponding to the identified type of the vehicle over time Compare the patterns of change.
  6. 如权利要求1~5任一项所述的方法,其特征在于,所述事件包括下列类型中的一个:The method according to any one of claims 1 to 5, wherein the event comprises one of the following types:
    车辆侧门开启;Vehicle side doors open;
    车辆侧门关闭;Vehicle side door closed;
    车辆尾门开启;The tailgate of the vehicle is open;
    车辆尾门关闭;Vehicle tailgate closed;
    车辆乘坐者上车;Vehicle occupants board;
    车辆乘坐者下车;Vehicle occupants get off;
    装货;Loading
    卸货。discharge.
  7. 车辆事件的检测装置(30),其特征在于,包括:The vehicle event detection device (30) is characterized in that it comprises:
    一个图片获取模块(301),用于获取一个车辆在一个时间段内的按时间排序的一组图片;A picture acquisition module (301) for obtaining a set of pictures sorted by time of a vehicle within a time period;
    一个形状变化检测模块(302),用于从所述一组图片中识别所述车辆在所述时间段内的形状随时间的变化;A shape change detection module (302), configured to identify, from the set of pictures, a change in shape of the vehicle over time in the time period;
    一个模式匹配模块(303),用于判断识别出的所述变化是否与预先定义的一个车辆形状随时间变化的模式相同;A pattern matching module (303), configured to determine whether the identified change is the same as a predefined pattern of a vehicle shape changing with time;
    一个事件判断模块(304),若所述变化与预先定义的一个车辆形状随时间变化的模式相同,则确定所述车辆发生了所述模式所定义的事件。An event judging module (304), if the change is the same as a predefined pattern of a vehicle shape changing with time, determining that the vehicle has an event defined by the pattern.
  8. 如权利要求7所述的装置(30),其特征在于,所述形状变化检测模块(302),具体用于:The device (30) according to claim 7, wherein the shape change detection module (302) is specifically configured to:
    对所述一组图片中的每一张,识别所述车辆形状可变化的至少一个部分;For each of the set of pictures, identifying at least a portion of which the shape of the vehicle is changeable;
    确定各张图片中识别出的形状可变化的每一个部分的形状在所述时间段内随时间的变化。It is determined that the shape of each part of the shape that can be changed in each picture is changed over time within the time period.
  9. 如权利要求8所述的装置(30),其特征在于,所述形状变化检测模块(302),具体用于:The device (30) according to claim 8, wherein the shape change detection module (302) is specifically configured to:
    对所述一组图片中的每一张,识别所述车辆的乘坐者;Identify each occupant of the vehicle for each of the set of pictures;
    确定各张图片中识别出所述车辆的乘坐者与所述车辆的可变化的至少一个部分的位置关系。A positional relationship between an occupant of the vehicle and at least a changeable part of the vehicle is identified in each picture.
  10. 如权利要求8所述的装置(30),其特征在于,所述形状变化检测模块(302),具体 用于:The device (30) according to claim 8, wherein the shape change detection module (302) is specifically configured to:
    对所述一组图片中的每一张,识别所述车辆的货物;For each of the set of pictures, identifying the cargo of the vehicle;
    确定各张图片中识别出所述车辆的货物与所述车辆的可变化的至少一个部分的位置关系。A positional relationship between the cargo of the vehicle and at least a changeable part of the vehicle is identified in each picture.
  11. 如权利要求7~10任一项所述的装置(30),其特征在于,还包括:一个车辆类型识别模块(302’),用于在判断识别出的所述变化是否与预先定义的一个车辆形状随时间变化的模式相同之前,从所述一组图片中识别所述车辆的类型;The device (30) according to any one of claims 7 to 10, further comprising: a vehicle type identification module (302 ') for determining whether the identified change is different from a predefined one Before the vehicle shape changes in time with the same pattern, identifying the type of the vehicle from the set of pictures;
    所述模式匹配模块(303)具体用于:将识别出的所述变化与识别出的所述车辆的类型所对应的至少一种车辆形状随时间变化的模式进行比较。The pattern matching module (303) is specifically configured to compare the identified change with at least one pattern of vehicle shape changes over time corresponding to the identified type of the vehicle.
  12. 如权利要求7~11任一项所述的装置(30),其特征在于,所述事件判断模块(304)所判断的事件包括下列类型中的一个:The device (30) according to any one of claims 7 to 11, wherein the event judged by the event judgment module (304) includes one of the following types:
    车辆侧门开启;Vehicle side doors open;
    车辆侧门关闭;Vehicle side door closed;
    车辆尾门开启;The tailgate of the vehicle is open;
    车辆尾门关闭;Vehicle tailgate closed;
    车辆乘坐者上车;Vehicle occupants board;
    车辆乘坐者下车;Vehicle occupants get off;
    装货;Loading
    卸货。discharge.
  13. 车辆事件的检测装置(30),其特征在于,包括:The vehicle event detection device (30) is characterized in that it comprises:
    至少一个存储器(305),用于存储计算机可读代码;At least one memory (305) for storing computer-readable code;
    至少一个处理器(306),用于调用所述计算机可读代码,执行如权利要求1~6任一项所述的方法。At least one processor (306), configured to call the computer-readable code and execute the method according to any one of claims 1 to 6.
  14. 如权利要求7~13任一项所述的装置(30),所述装置部署在交通现场。The device (30) according to any one of claims 7 to 13, which is deployed at a traffic site.
  15. 计算机程序产品,所述计算机程序产品被有形地存储在计算机可读介质上并且包括计算机可执行指令,所述计算机可执行指令在被执行时使至少一个处理器执行权利要求1至 6中任一项所述的方法。A computer program product tangibly stored on a computer-readable medium and including computer-executable instructions that, when executed, cause at least one processor to perform any of claims 1 to 6 Item.
  16. 一种计算机可读介质,其特征在于,所述计算机可读介质上存储有计算机可读指令,所述计算机可读指令在被处理器执行时,使所述处理器执行权利要求1~6中任一项所述的方法。A computer-readable medium, wherein computer-readable instructions are stored on the computer-readable medium, and when the computer-readable instructions are executed by a processor, the processor causes the processor to execute claims 1 to 6. The method of any one.
PCT/CN2018/107405 2018-09-25 2018-09-25 Vehicle event detection apparatus and method, and computer program product and computer-readable medium WO2020061766A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/107405 WO2020061766A1 (en) 2018-09-25 2018-09-25 Vehicle event detection apparatus and method, and computer program product and computer-readable medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/107405 WO2020061766A1 (en) 2018-09-25 2018-09-25 Vehicle event detection apparatus and method, and computer program product and computer-readable medium

Publications (1)

Publication Number Publication Date
WO2020061766A1 true WO2020061766A1 (en) 2020-04-02

Family

ID=69952607

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/107405 WO2020061766A1 (en) 2018-09-25 2018-09-25 Vehicle event detection apparatus and method, and computer program product and computer-readable medium

Country Status (1)

Country Link
WO (1) WO2020061766A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102637257A (en) * 2012-03-22 2012-08-15 北京尚易德科技有限公司 Video-based detection and recognition system and method of vehicles
CN103258432A (en) * 2013-04-19 2013-08-21 西安交通大学 Traffic accident automatic identification processing method and system based on videos
KR20140117116A (en) * 2013-03-26 2014-10-07 한국도로공사 Detection apparatus and Method of axles tampering truck using image processing
CN106600977A (en) * 2017-02-13 2017-04-26 深圳英飞拓科技股份有限公司 Parking violation detection method and system based on multi-feature identification
CN206741700U (en) * 2017-05-18 2017-12-12 南京云计趟信息技术有限公司 A kind of video recognition system for the monitoring of slag-soil truck container
CN107545614A (en) * 2016-06-27 2018-01-05 福特全球技术公司 Vehicle with logout

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102637257A (en) * 2012-03-22 2012-08-15 北京尚易德科技有限公司 Video-based detection and recognition system and method of vehicles
KR20140117116A (en) * 2013-03-26 2014-10-07 한국도로공사 Detection apparatus and Method of axles tampering truck using image processing
CN103258432A (en) * 2013-04-19 2013-08-21 西安交通大学 Traffic accident automatic identification processing method and system based on videos
CN107545614A (en) * 2016-06-27 2018-01-05 福特全球技术公司 Vehicle with logout
CN106600977A (en) * 2017-02-13 2017-04-26 深圳英飞拓科技股份有限公司 Parking violation detection method and system based on multi-feature identification
CN206741700U (en) * 2017-05-18 2017-12-12 南京云计趟信息技术有限公司 A kind of video recognition system for the monitoring of slag-soil truck container

Similar Documents

Publication Publication Date Title
CN109816024B (en) Real-time vehicle logo detection method based on multi-scale feature fusion and DCNN
US11380104B2 (en) Method and device for detecting illegal parking, and electronic device
US20210192227A1 (en) Method and apparatus for detecting parking space usage condition, electronic device, and storage medium
CN106875697B (en) Radio frequency identification and video identification comparison method and system
US10657809B2 (en) Automatic learning for vehicle classification
US9460367B2 (en) Method and system for automating an image rejection process
US11302191B2 (en) Method and apparatus for calculating parking occupancy
CN113688805B (en) Unmanned aerial vehicle-based unlicensed muck vehicle identification method and system
CN105631418A (en) People counting method and device
CN107862072B (en) Method for analyzing vehicle urban-entering fake plate crime based on big data technology
CN107748882B (en) Lane line detection method and device
CN113515985B (en) Self-service weighing system, weighing detection method, weighing detection equipment and storage medium
CN109300127A (en) Defect inspection method, device, computer equipment and storage medium
JP2019192209A (en) Learning target image packaging device and method for artificial intelligence of video movie
CN108052921B (en) Lane line detection method, device and terminal
CN111709341A (en) Method and system for detecting operation state of passenger elevator car
CN113065425B (en) Method and system for reminding objects left in vehicle based on environmental information and storage medium
WO2020061766A1 (en) Vehicle event detection apparatus and method, and computer program product and computer-readable medium
CN116843887A (en) Vehicle-mounted cargo mobile identification system, method, equipment and storage medium
CN115880632A (en) Timeout stay detection method, monitoring device, computer-readable storage medium, and chip
CN110796099A (en) Vehicle overrun detection method and device
CN110717456A (en) Object monitoring method, device, system, electronic equipment and storage medium
CN114897801A (en) AOI defect detection method, device and equipment and computer medium
CN113095311A (en) License plate number recognition method and device and storage medium
CN113792796A (en) Method and device for matching approach vehicle information, server and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18935431

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18935431

Country of ref document: EP

Kind code of ref document: A1