CN114842653B - Highway violation auxiliary determination method and system, storage medium and monitoring system - Google Patents

Highway violation auxiliary determination method and system, storage medium and monitoring system Download PDF

Info

Publication number
CN114842653B
CN114842653B CN202210477576.1A CN202210477576A CN114842653B CN 114842653 B CN114842653 B CN 114842653B CN 202210477576 A CN202210477576 A CN 202210477576A CN 114842653 B CN114842653 B CN 114842653B
Authority
CN
China
Prior art keywords
thermal imaging
vehicle
video
visible light
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210477576.1A
Other languages
Chinese (zh)
Other versions
CN114842653A (en
Inventor
甘雨
杨世忠
贺云飞
孙国慧
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hunan Bds Micro Chipset Industry Development Co ltd
Original Assignee
Hunan Bds Micro Chipset Industry Development Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hunan Bds Micro Chipset Industry Development Co ltd filed Critical Hunan Bds Micro Chipset Industry Development Co ltd
Priority to CN202210477576.1A priority Critical patent/CN114842653B/en
Publication of CN114842653A publication Critical patent/CN114842653A/en
Application granted granted Critical
Publication of CN114842653B publication Critical patent/CN114842653B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/01—Detecting movement of traffic to be counted or controlled
    • G08G1/017—Detecting movement of traffic to be counted or controlled identifying vehicles
    • G08G1/0175—Detecting movement of traffic to be counted or controlled identifying vehicles by photographing vehicles, e.g. when violating traffic rules
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/0022—Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiation of moving bodies
    • G01J5/0025—Living bodies
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/48—Thermography; Techniques using wholly visual means

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Traffic Control Systems (AREA)

Abstract

A method, a system, a storage medium and a monitoring system for assisting determination of highway violation are provided, wherein the method for assisting determination of highway violation comprises the following steps: acquiring a first thermal imaging video, a first visible light video, a second thermal imaging video and a second visible light video; determining vehicle information of the vehicle to be detected in the first visible light video and the second visible light video; determining personnel information corresponding to each vehicle to be detected according to the first thermal imaging video, the second thermal imaging video and the vehicle information; and determining the behavior and action information of the person in the driving position according to the first thermal imaging video, the second thermal imaging video and the person information. The invention utilizes the thermal imaging video to quickly determine the information of the vehicle-mounted personnel, completes the effective identification of the state of the overtaking person of each vehicle, and also can complete the identification of the behavior of the driver so as to determine the driving behavior with potential danger, and effectively reduces the speed to consume the manpower of the traffic police.

Description

Highway violation auxiliary determination method and system, storage medium and monitoring system
Technical Field
The invention belongs to the field of traffic assistance, and particularly relates to an expressway violation assistance determination method, an expressway violation assistance determination system, a storage medium and a monitoring system.
Background
With the development of economy and science, the number of automobiles is increased dramatically, the number of traffic violations is increased, traffic accidents caused by traffic violations are frequent, and meanwhile, property and health damages caused by traffic violations to traffic participants are increased. In a plurality of traffic participation scenes, a scene of an expressway is easy to have violent traffic accidents, but at present, the determination of the violation behaviors of the expressway is mainly completed through a camera or a speed measuring device, and only the automatic processing of the simpler traffic accidents such as overspeed, illegal parking, retrograde motion and the like can be completed, and other investigation of the violation behaviors of the traffic can be basically only manually checked and found according to a traffic police. However, the manpower is limited, so that some traffic participants frequently risk to perform some traffic violations such as overload and smoking in the expressway, thereby bringing great potential safety hazards to the traffic safety of the whole expressway or directly influencing the traffic safety.
Disclosure of Invention
The present invention is directed to solving at least one of the problems of the prior art. Therefore, the invention provides an auxiliary determination method for highway violation, which solves the problem that traffic violation is difficult to effectively control due to limited manpower. The invention also provides an expressway violation auxiliary determination system, a storage medium for storing the computer executable instruction of the expressway violation auxiliary determination method and a monitoring system.
The method for assisting in determining the highway violation according to the embodiment of the first aspect of the invention is applied to a server and comprises the following steps:
acquiring a first thermal imaging video, a first visible light video, a second thermal imaging video and a second visible light video; the first thermal imaging video and the first visible light video are both collected by a first collecting device, and the second thermal imaging video and the second visible light video are both collected by a second collecting device; the first acquisition device and the second acquisition device are respectively arranged on two sides of a highway, the acquisition visual angles face the direction of a coming vehicle, the visual field for acquiring the first thermal imaging video is consistent with the visual field for acquiring the first visible light video, and the visual field for acquiring the second thermal imaging video is consistent with the visual field for acquiring the second visible light video; the first thermal imaging video, the first visible light video, the second thermal imaging video and the second visible light video are synchronously acquired;
determining vehicle information of a vehicle to be detected in the first visible light video and the second visible light video, wherein the vehicle information at least comprises vehicle identification information and vehicle position information corresponding to each vehicle to be detected;
determining personnel information corresponding to each vehicle to be detected according to the first thermal imaging video, the second thermal imaging video and the vehicle information, wherein the personnel information at least comprises the number of personnel, the position of each personnel and the temperature information corresponding to each personnel;
and determining behavior and action information of the person in the driving position according to the first thermal imaging video, the second thermal imaging video and the person information.
The method for assisting in determining the highway violation at least has the following technical effects: by setting the collection fields of the first collection device and the second collection device, thermal imaging videos and visible light videos with better corresponding degrees can be collected; therefore, the effective determination of the vehicle information can be completed by utilizing the visible light video, the vehicle-mounted personnel information can be rapidly determined by utilizing the thermal imaging video on the basis of determining the vehicle information, and the effective identification of the state of the overmaning vehicle of each vehicle is completed. Meanwhile, the behavior of the driver can be identified by utilizing the thermal video so as to determine whether the driving behaviors such as calling, smoking and the like with potential danger occur. In addition, under present new crown epidemic situation environment, utilize the thermal imaging video can accomplish basic temperature screening for when the abnormal personnel of body temperature appear, can let high-speed traffic police carry out effectual management and control. The method for assisting in determining the traffic violation of the highway can assist in finishing judging the driving condition of the highway, can effectively reduce the manpower consumption of the traffic police after speed reduction, improves the execution efficiency of the traffic police, and is suitable for popularization and application.
According to some embodiments of the invention, the determining the vehicle information of the vehicle to be detected in the first visible light video and the second visible light video comprises:
intercepting a first vehicle identification image group corresponding to a preset optimal view angle group in the first visible light video, wherein the optimal view angle group comprises a plurality of intercepting view angle points, and the first vehicle identification image group comprises a plurality of first visible light intercepting images corresponding to the intercepting view angle points one by one; each vehicle to be detected corresponds to one group of the first vehicle identification image group;
intercepting a second vehicle identification image group which is in the same time as the first vehicle identification image group in the second visible light video, wherein the second vehicle identification image group comprises a plurality of second visible light intercepted images which are in one-to-one correspondence with a plurality of first visible light intercepted images in the first vehicle identification image group;
determining the license plate number of the vehicle to be detected according to the first vehicle identification image group and the second vehicle identification image group;
and recording the license plate number as the vehicle identification information, and recording the corresponding positions of the plurality of interception visual angle points in the optimal visual angle group as vehicle position information.
According to some embodiments of the present invention, the determining the person information corresponding to each vehicle to be detected according to the first thermal imaging video, the second thermal imaging video and the vehicle information includes:
intercepting a first person identification image group from the first thermal imaging video and a second person identification image group from the second thermal imaging video according to the first vehicle identification image group, wherein the first person identification image group comprises a plurality of first thermal imaging intercepted images, and the second person identification image group comprises a plurality of second thermal imaging intercepted images;
and determining the personnel information in the vehicle to be detected according to the first personnel identification image group and the second personnel identification image group.
According to some embodiments of the invention, the determining the person information in the vehicle to be detected from the first group of person identification images and the second group of person identification images comprises:
identifying a first heat source area from the plurality of first thermal imaging intercepted images, and extracting first human body contour information corresponding to the first heat source area;
identifying a second heat source area from the plurality of second thermal imaging intercepted images, and extracting second human body contour information corresponding to the second heat source area;
and determining the personnel information corresponding to the vehicle to be detected according to the first heat source area, the second heat source area, the first human body contour information and the second human body contour information.
According to some embodiments of the invention, the first body contour information is obtained by:
extracting infant heat source information from a first heat source area according to a preset age temperature threshold;
determining the staff information according to the first heat source area and the infant staff information.
According to some embodiments of the invention, the determining the behavior action information of the person in the driving seat according to the first thermal imaging video, the second thermal imaging video and the person information comprises:
and matching each first thermal imaging intercepted image and each second thermal imaging intercepted image with a preset violation action judgment model, if the first thermal imaging intercepted image and each second thermal imaging intercepted image are consistent in matching, storing the corresponding first person identification image group, the corresponding second person identification image group, the corresponding first vehicle identification image group and the corresponding second vehicle identification image group, and recording corresponding vehicle information.
The highway violation auxiliary determination system according to the second aspect of the invention is applied to a server and comprises the following components:
the data acquisition module is used for acquiring a first thermal imaging video, a first visible light video, a second thermal imaging video and a second visible light video; the first thermal imaging video and the first visible light video are both collected by a first collecting device, and the second thermal imaging video and the second visible light video are both collected by a second collecting device; the first acquisition device and the second acquisition device are respectively arranged on two sides of a highway, the acquisition visual angles face the direction of a coming vehicle, the visual field for acquiring the first thermal imaging video is consistent with the visual field for acquiring the first visible light video, and the visual field for acquiring the second thermal imaging video is consistent with the visual field for acquiring the second visible light video; the first thermal imaging video, the first visible light video, the second thermal imaging video and the second visible light video are synchronously acquired;
the vehicle determining module is used for determining vehicle information of the vehicle to be detected in the first visible light video and the second visible light video, wherein the vehicle information at least comprises vehicle identification information and vehicle position information corresponding to each vehicle to be detected;
the personnel determining module is used for determining personnel information corresponding to each vehicle to be detected according to the first thermal imaging video, the second thermal imaging video and the vehicle information, wherein the personnel information at least comprises the number of personnel, the position of each personnel and the temperature information corresponding to each personnel;
and the violation judgment module is used for determining behavior and action information of the person at the driving position according to the first thermal imaging video, the second thermal imaging video and the person information.
The highway violation auxiliary determining system provided by the embodiment of the invention at least has the following technical effects: by setting the collection fields of the first collection device and the second collection device, thermal imaging videos and visible light videos with better corresponding degrees can be collected; therefore, the effective determination of the vehicle information can be completed by utilizing the visible light video, the vehicle-mounted personnel information can be rapidly determined by utilizing the thermal imaging video on the basis of determining the vehicle information, and the effective identification of the state of the overmaning vehicle of each vehicle is completed. Meanwhile, the behavior of the driver can be identified by utilizing the thermal video so as to determine whether potentially dangerous driving behaviors such as calling, smoking and the like occur. In addition, under present new crown epidemic situation environment, utilize the thermal imaging video can accomplish basic temperature screening for when the abnormal personnel of body temperature appear, can let high-speed traffic police carry out effectual management and control. The method for assisting in determining the traffic violation of the highway can assist in finishing judging the driving condition of the highway, can effectively reduce the manpower consumption of the traffic police after speed reduction, improves the execution efficiency of the traffic police, and is suitable for popularization and application.
According to a third aspect of the invention, the method comprises the steps of storing computer-executable instructions for causing a computer to execute the highway violation auxiliary determination method.
The computer-readable storage medium according to the embodiment of the invention has at least the following advantages: storage and transfer of computer-executable instructions may be facilitated by a storage medium.
A monitoring system according to an embodiment of the fourth aspect of the invention, comprising:
the first acquisition device is used for acquiring a first thermal imaging video and a first visible light video;
the second acquisition device is used for acquiring a second thermal imaging video and a second visible light video; the first acquisition device and the second acquisition device are respectively arranged on two sides of a highway, the acquisition visual angles face the direction of a coming vehicle, the visual field for acquiring the first thermal imaging video is consistent with the visual field for acquiring the first visible light video, and the visual field for acquiring the second thermal imaging video is consistent with the visual field for acquiring the second visible light video; the first thermal imaging video, the first visible light video, the second thermal imaging video and the second visible light video are synchronously acquired;
and the server is connected with the first acquisition device and the second acquisition device through a network and is used for executing the highway violation auxiliary determination method.
The monitoring system provided by the embodiment of the invention at least has the following technical effects: by setting the collection field of the first collection device and the collection field of the second collection device, thermal imaging videos and visible light videos with better corresponding degrees can be collected; therefore, the effective determination of the vehicle information can be completed by utilizing the visible light video, the vehicle-mounted personnel information can be rapidly determined by utilizing the thermal imaging video on the basis of determining the vehicle information, and the effective identification of the state of the overmaning vehicle of each vehicle is completed. Meanwhile, the behavior of the driver can be identified by utilizing the thermal video so as to determine whether the driving behaviors such as calling, smoking and the like with potential danger occur. In addition, under present new crown epidemic situation environment, utilize the thermal imaging video can accomplish basic temperature screening for when the abnormal personnel of body temperature appear, can let high-speed traffic police carry out effectual management and control. The method for assisting in determining the traffic violation of the highway can assist in finishing judging the driving condition of the highway, can effectively reduce the manpower consumption of the traffic police after speed reduction, improves the execution efficiency of the traffic police, and is suitable for popularization and application.
According to some embodiments of the invention, the first and second acquisition devices each comprise:
a thermal imaging acquisition device;
a visible light collection device;
the main controller is respectively connected with the thermal imaging acquisition device and the visible light acquisition device;
and the network connection module is connected with the master controller and is used for assisting the master controller to realize data interaction with the server.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a flow chart of a highway violation auxiliary determination method provided by an embodiment of the invention;
FIG. 2 is a flow chart of determining vehicle information as set forth in an embodiment of the present invention;
FIG. 3 is a flow chart of determining people information according to an embodiment of the present invention;
FIG. 4 is a system block diagram of a highway violation auxiliary determination system as contemplated by an embodiment of the present invention;
fig. 5 is an electrical system diagram of a first acquisition device or a second acquisition device according to an embodiment of the present invention;
fig. 6 is an electrical system diagram of a first acquisition device or a second acquisition device according to another embodiment of the present invention.
Reference numerals:
a thermal imaging acquisition device 100; a visible light collection device 200; a master controller 300; a network connection module 400; a radar speed measuring device 500; ETC charging system 600.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative only for the purpose of explaining the present invention, and are not to be construed as limiting the present invention.
In the description of the present invention, it is to be understood that the directional descriptions, such as the directions of upper, lower, front, rear, left, right, etc., are referred to only for convenience of describing the present invention and for simplicity of description, and are not intended to indicate or imply that the device or element so referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be considered as limiting the present invention.
In the description of the present invention, a plurality of means is one or more, a plurality of means is two or more, and greater than, less than, more than, etc. are understood as excluding the essential numbers, and greater than, less than, etc. are understood as including the essential numbers. If the first and second are described for the purpose of distinguishing technical features, they are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated or implicitly indicating the precedence of the technical features indicated.
In the description of the present invention, unless otherwise explicitly limited, terms such as arrangement, installation, connection and the like should be understood in a broad sense, and those skilled in the art can reasonably determine the specific meanings of the above terms in the present invention in combination with the specific contents of the technical solutions.
A method for highway violation auxiliary determination according to an embodiment of the first aspect of the present invention is described below with reference to fig. 1 to 6. The method for assisting in determining the violation of the highway comprises the following steps of:
acquiring a first thermal imaging video, a first visible light video, a second thermal imaging video and a second visible light video; the first thermal imaging video and the first visible light video are both collected by a first collecting device, and the second thermal imaging video and the second visible light video are both collected by a second collecting device; the first acquisition device and the second acquisition device are respectively arranged at two sides of the highway, the acquisition visual angles face the direction of a coming vehicle, the visual field for acquiring the first thermal imaging video is consistent with the visual field for acquiring the first visible light video, and the visual field for acquiring the second thermal imaging video is consistent with the visual field for acquiring the second visible light video; the first thermal imaging video, the first visible light video, the second thermal imaging video and the second visible light video are synchronously acquired;
determining vehicle information of the vehicles to be detected in the first visible light video and the second visible light video, wherein the vehicle information at least comprises vehicle identification information and vehicle position information corresponding to each vehicle to be detected;
determining personnel information corresponding to each vehicle to be detected according to the first thermal imaging video, the second thermal imaging video and the vehicle information, wherein the personnel information at least comprises the number of personnel, the position of each personnel and temperature information corresponding to each personnel;
and determining the behavior and action information of the person in the driving position according to the first thermal imaging video, the second thermal imaging video and the person information.
The first collecting device and the second collecting device are respectively arranged on two sides of a highway, and can be arranged through a portal frame or can be arranged through an independent supporting frame. Considering that the first collecting device and the second collecting device can complete network connection with the server, the cloud deck can be selected to be installed when the first collecting device and the second collecting device are installed, so that the cloud deck can be directly utilized to complete adjustment of the collecting visual angle in the later period. It should be noted that, after the first collecting device and the second collecting device are installed, an optimal collecting viewing angle is determined and recorded, so that the optimal collecting viewing angle can be quickly reset after the fields of view of the first collecting device and the second collecting device are subsequently adjusted.
When the first and second capturing devices are used to capture videos, in order to ensure that the corresponding degree of the captured images is as high as possible, it is necessary to ensure that the thermal imaging capturing device 100 and the visible light capturing device 200 in each capturing device have the same visual field, and the included angles between the sight lines of the first and second capturing devices and the middle line of the highway are as close as possible to the same.
The server side can acquire a first thermal imaging video, a first visible light video, a second thermal imaging video and a second visible light video which are acquired by the first acquisition device and the second acquisition device together, so that vehicle information can be acquired by the first visible light video and the second visible light video, and the vehicle information at least needs to include vehicle identification information (for example, the identified license plate information) and vehicle position information. The highway violation auxiliary determining method provided by the embodiment of the invention is characterized in that personnel information is quickly obtained from the thermal imaging video by utilizing the corresponding relation between the visible light video and the thermal imaging video; therefore, on the basis that the visual field of the acquisition device is fixed, the information of the time when the vehicle to be detected reaches the plurality of view-intercepting points is determined only by the visible light video, and the thermal imaging image at the corresponding time can be acquired in the thermal imaging video by directly utilizing the time information, so that the thermal imaging information for identifying the number of the personnel is acquired, and the identification of the personnel information is finally completed. It should be further noted that the selection of the plurality of intercepted viewpoint points is not randomly selected, and the selection may be manually performed by an engineer according to the road environment of the site and the view angle of the acquisition device, and usually at least one of the front, middle and rear regions of the acquired viewpoint is selected to prevent the existence of a blind area.
After the thermal imaging images at the corresponding moments of the plurality of interception visual points are obtained, heat source analysis can be performed on each thermal imaging image, a human body can be generally regarded as a heat source, the presence of a plurality of heat sources in a driving area of a vehicle can be judged by the presence of a plurality of people in the vehicle, and finally, the plurality of thermal imaging images are used as mutual certificates, so that the accuracy of judgment of the people is ensured. If the plurality of thermal imaging images have conflict, manual rechecking information can be automatically generated, and a traffic police finishes manual rechecking.
Meanwhile, the contour information of the driver can be effectively extracted by utilizing a plurality of thermal imaging images, so that the body action information extracted by utilizing the contour information can be utilized, and the body action information can be compared with a large number of judgment images preset in a database, so that whether violation occurs or not is judged, and the behavior action information is obtained. It should be noted that, during actual operation, a large number of thermal imaging images may be used to train a judgment model, and then a judgment module is used to quickly judge whether a violation occurs, in some embodiments, a judgment model is constructed for a conventional violation, for example: smoking, making a call, etc. For the matched violation behaviors, the violation behaviors can be made effective by a traffic police after being compounded, and it should be noted that for the convenience of rechecking, the thermal imaging image and the visible light image are synchronously stored.
In addition, compared with the mode of independently arranging the acquisition devices on one side, the mode of arranging the acquisition devices on two sides can better avoid the occurrence of blind spots and acquire more accurate images, so that the follow-up vehicle information acquisition, personnel information acquisition and violation behavior judgment can be conveniently carried out.
According to the method for assisting in determining the highway violation, the thermal imaging video and the visible light video with better corresponding degrees can be acquired by setting the acquisition fields of the first acquisition device and the second acquisition device; therefore, the effective determination of the vehicle information can be completed by utilizing the visible light video, the vehicle-mounted personnel information can be rapidly determined by utilizing the thermal imaging video on the basis of determining the vehicle information, and the effective identification of the state of the overmaning vehicle of each vehicle is completed. Meanwhile, the behavior of the driver can be identified by utilizing the thermal video so as to determine whether the driving behaviors such as calling, smoking and the like with potential danger occur. In addition, under present new crown epidemic situation environment, utilize the thermal imaging video can accomplish basic temperature screening for when the abnormal personnel of body temperature appear, can let high-speed traffic police carry out effectual management and control. The method for assisting in determining the traffic violation on the highway can assist in judging the driving condition of the highway, can effectively reduce the speed and then consume the manpower of the traffic police, improves the execution efficiency of the traffic police, and is suitable for popularization and application.
In some embodiments of the present invention, referring to fig. 2, determining vehicle information of a vehicle to be detected in a first visible light video and a second visible light video comprises the steps of:
intercepting a first vehicle identification image group corresponding to a preset optimal view angle group in a first visible light video, wherein the optimal view angle group comprises a plurality of intercepting view angle points, and the first vehicle identification image group comprises a plurality of first visible light intercepting images which are in one-to-one correspondence with the plurality of intercepting view angle points; each vehicle to be detected corresponds to a group of first vehicle identification image groups;
intercepting a second vehicle identification image group which is in the same time as the first vehicle identification image group in the second visible light video, wherein the second vehicle identification image group comprises a plurality of second visible light intercepted images which are in one-to-one correspondence with a plurality of first visible light intercepted images in the first vehicle identification image group;
determining the license plate number of the vehicle to be detected according to the first vehicle identification image group and the second vehicle identification image group;
and recording the license plate number as vehicle identification information, and recording the corresponding positions of the plurality of interception visual angle points in the optimal visual angle group as vehicle position information.
When the vehicle information is acquired from the first visible light video and the second visible light video, each frame of image in the videos does not need to be processed, and judgment can be completed only by selecting a plurality of representative images.
For the first visible light video, the extraction of the first vehicle identification image group can be directly completed by using the preset optimal viewing angle group. A plurality of capture viewpoint points in the optimal viewpoint group may be preset according to the field of view of the first acquisition device and the environment of the specific acquisition road section, and usually 3 capture viewpoint points are selected, and the 3 capture viewpoint points are respectively distributed in the front, middle, and rear three regions of the field of view acquired by the visible light acquisition device 200. Therefore, as long as the position of the vehicle to be detected in the first visible light video reaches the intercepting view point, a first visible light intercepting image can be directly extracted, and the arrival time is synchronously recorded, so that the position of the intercepting view point can be directly used as the position information of the vehicle. It should be noted that, because there is a sudden lane change during driving, the view point can be intercepted by directly selecting a virtual straight line perpendicular to the highway, and the image can be intercepted only when the vehicle to be detected in the video reaches the virtual straight line; meanwhile, in order to ensure the accuracy of screenshot, the vehicle running continuity can be utilized to complete the acquisition of the vehicle trajectory to be detected in the video, and the accurate screenshot is obtained by utilizing the vehicle trajectory.
After the first visible light intercepted image is acquired from the first visible light video, a plurality of second visible light intercepted images can be rapidly extracted from the second visible light video by utilizing the characteristics corresponding to the acquisition time of the first visible light video and the acquisition time of the second visible light video. And then, the license plate information can be extracted by utilizing the plurality of second visible light intercepting images and the plurality of first visible light intercepting images. It should be noted that, here, the extraction of the appearance information of the vehicle to be detected is completed through a plurality of viewing angles, so that the extraction of the license plate information can be guaranteed as far as possible.
In some embodiments of the present invention, determining the person information corresponding to each vehicle to be detected according to the first thermal imaging video, the second thermal imaging video and the vehicle information includes the following steps:
intercepting a first person identification image group from a first thermal imaging video and a second person identification image group from a second thermal imaging video according to the first vehicle identification image group, wherein the first person identification image group comprises a plurality of first thermal imaging intercepted images, and the second person identification image group comprises a plurality of second thermal imaging intercepted images;
and determining the information of the personnel in the vehicle to be detected according to the first personnel identification image group and the second personnel identification image group.
After the first vehicle identification image group is determined, the first thermal imaging video and the second thermal imaging video can be directly intercepted by continuously utilizing the optimal view angle group. The intercepted second person identification image group and the intercepted first person identification image group have enough temperature information. Meanwhile, considering that passengers are only in the middle area of the vehicle, the areas of the vehicle head and the parking space do not need to be judged, the heat source of a vehicle head engine is prevented from being wrongly calculated, and the calculation amount is reduced; after the number of heat sources is determined, the on-board personnel information is determined.
In some embodiments of the present invention, referring to fig. 3, determining the information of the person in the vehicle to be detected according to the first person identification image group and the second person identification image group comprises the following steps:
identifying a first heat source area from the plurality of first thermal imaging intercepted images, and extracting first human body contour information corresponding to the first heat source area;
identifying a second heat source area from the plurality of second thermal imaging intercepted images, and extracting second human body contour information corresponding to the second heat source area;
and determining personnel information corresponding to the vehicle to be detected according to the first heat source area, the second heat source area, the first human body contour information and the second human body contour information.
When the heat sources of the passengers of the vehicle are judged, if the passengers have a certain distance, the information of the passengers can be determined directly by judging the number of the heat sources; if the vehicle is compact and the members are close to each other, distinguishing the number of heat sources by taking the head characteristics, namely extracting the head outline of the region with higher temperature and judging the number of the head outlines; in order to further increase the determination speed, the front-row personnel may determine the number of heat sources directly, and the rear-row personnel may select one of the two determination methods according to the actual situation. It should be noted that, under the condition that the acquisition view angle is ideal, the judgment of the staff information can be completed only by one thermal imaging image, but in actual operation, considering the mobility of the staff and the possible defects of the acquisition view angle of the acquisition device, multiple first thermal imaging captured images and multiple second thermal imaging captured images need to be used for multiple judgments, and the judgment result with the largest number can be usually selected as the final result to determine the staff information, for example: the number of detected persons in the 6 thermal imaging images is 3, 4, 3 and 3 respectively, and 4 persons are selected as the final number of persons.
In some embodiments of the invention, the first body contour information is obtained by:
extracting infant heat source information from a first heat source area according to a preset age temperature threshold;
and determining personnel information according to the first heat source area and the infant personnel information.
In practical situations, the situation of holding an infant needs to be considered, and the judgment of the infant mainly depends on the fact that the body temperature of the infant is higher than that of an adult to perform judgment, that is, when an isotherm is drawn, an area obviously higher than the body temperature of the adult appears, and a position relation included in the isotherm of the body temperature of the adult exists, and in order to avoid the influence of smart devices such as a mobile phone, the body temperature range of the infant is also further considered, so that the interference caused by the devices such as the mobile phone, an electric warmer and the like (the general temperature of the devices is higher than the body temperature of a normal human body) is avoided, for example: the body temperature of the baby is 36-40 ℃, but the temperature of the electric warming device can exceed the range, and when the temperature exceeds 40 ℃, the electric warming device can be directly used as an interference item to treat.
In some embodiments of the present invention, determining the behavior action information of the person in the driving position according to the first thermal imaging video, the second thermal imaging video and the person information comprises the following steps:
and matching each first thermal imaging intercepted image and each second thermal imaging intercepted image with a preset violation action judgment model, if the matching is consistent, storing the corresponding first person identification image group, the second person identification image group, the first vehicle identification image group and the second vehicle identification image group, and recording the corresponding vehicle information.
The judgment of the motion information may be performed by a model judgment method. And (3) constructing a violation action judgment model based on a deep learning method, for example: the method comprises the steps of obtaining posture action thermal imaging images of various standards, obtaining different standard violation action data through image segmentation, marking the different standard violation action data of a human body to obtain marked standard violation action data, and finally obtaining a standard violation action recognition model through deep learning and training the marked standard violation action data. And then, whether the violation occurs can be determined only by inputting the thermal imaging image into a standard violation action recognition model. In the actual engineering, corresponding standard violation action recognition models are respectively established for different violation actions such as smoking, calling, separating two hands from a steering wheel and the like, so that the recognition of different violation works is completed quickly.
In some embodiments of the invention, after the violation behaviors occur, the thermal imaging intercepted image and the visible light intercepted image during violation are stored, so that the thermal imaging intercepted image and the visible light intercepted image can be used as a simple judgment basis when the violation deduction is eliminated by a driver.
The highway violation auxiliary determination system according to the second aspect of the invention is applied to a server and comprises the following components: the system comprises a data acquisition module, a vehicle determination module, a personnel determination module and an illegal determination module.
The data acquisition module is used for acquiring a first thermal imaging video, a first visible light video, a second thermal imaging video and a second visible light video; the first thermal imaging video and the first visible light video are both collected by a first collecting device, and the second thermal imaging video and the second visible light video are both collected by a second collecting device; the first acquisition device and the second acquisition device are respectively arranged at two sides of the highway, the acquisition visual angles face the direction of a coming vehicle, the visual field for acquiring the first thermal imaging video is consistent with the visual field for acquiring the first visible light video, and the visual field for acquiring the second thermal imaging video is consistent with the visual field for acquiring the second visible light video; the first thermal imaging video, the first visible light video, the second thermal imaging video and the second visible light video are synchronously acquired;
the vehicle determining module is used for determining vehicle information of the vehicles to be detected in the first visible light video and the second visible light video, wherein the vehicle information at least comprises vehicle identification information and vehicle position information corresponding to each vehicle to be detected;
the personnel determining module is used for determining personnel information corresponding to each vehicle to be detected according to the first thermal imaging video, the second thermal imaging video and the vehicle information, and the personnel information at least comprises the number of personnel, the position of each personnel and the temperature information corresponding to each personnel;
and the violation judging module is used for determining behavior and action information of the personnel at the driving position according to the first thermal imaging video, the second thermal imaging video and the personnel information.
Referring to fig. 1 to 4, the first collecting device and the second collecting device are respectively disposed at both sides of the highway, and may be disposed through a gantry or may be mounted through a separate support frame. Considering that the first collecting device and the second collecting device can complete network connection with the server, the cloud deck can be selected to be installed when the first collecting device and the second collecting device are installed, so that the cloud deck can be directly utilized to complete adjustment of the collecting visual angle in the later period. It should be noted that, after the first collecting device and the second collecting device are installed, an optimal collecting viewing angle is determined and recorded, so that the optimal collecting viewing angle can be quickly reset after the fields of view of the first collecting device and the second collecting device are subsequently adjusted.
When the first and second capturing devices are used to capture videos, in order to ensure that the corresponding degree of the captured images is as high as possible, it is necessary to ensure that the thermal imaging capturing device 100 and the visible light capturing device 200 in each capturing device have the same visual field, and the included angles between the sight lines of the first and second capturing devices and the middle line of the highway are as close as possible to the same.
The server side can acquire a first thermal imaging video, a first visible light video, a second thermal imaging video and a second visible light video which are acquired by the first acquisition device and the second acquisition device together, so that vehicle information can be acquired by the first visible light video and the second visible light video, and the vehicle information at least needs to include vehicle identification information (for example, the identified license plate information) and vehicle position information. The method for assisting in determining the violation of the highway in the embodiment of the invention is characterized in that personnel information is quickly acquired from a thermal imaging video by using the corresponding relationship between the visible light video and the thermal imaging video; therefore, on the basis that the visual field of the acquisition device is fixed, the information of the time when the vehicle to be detected reaches the plurality of view-intercepting points is determined only by the visible light video, and the thermal imaging image at the corresponding time can be acquired in the thermal imaging video by directly utilizing the time information, so that the thermal imaging information for identifying the number of the personnel is acquired, and the identification of the personnel information is finally completed. It should be further noted that the selection of the plurality of intercepted viewpoint points is not randomly selected, and the selection may be manually performed by an engineer according to the road environment of the site and the view angle of the acquisition device, and usually at least one of the front, middle and rear regions of the acquired viewpoint is selected to prevent the existence of a blind area.
After the thermal imaging images at the corresponding moments of the plurality of interception visual points are obtained, heat source analysis can be performed on each thermal imaging image, a human body can be generally regarded as a heat source, the presence of a plurality of heat sources in a driving area of a vehicle can be judged by the presence of a plurality of people in the vehicle, and finally, the plurality of thermal imaging images are used as mutual certificates, so that the accuracy of judgment of the people is ensured. If the plurality of thermal imaging images have conflict, manual rechecking information can be automatically generated, and a traffic police finishes manual rechecking.
Meanwhile, the contour information of the driver can be effectively extracted by utilizing a plurality of thermal imaging images, so that the body action information extracted by utilizing the contour information can be utilized, and the body action information can be compared with a large number of judgment images preset in a database, so that whether violation occurs or not is judged, and the behavior action information is obtained. It should be noted that, during actual operation, a large number of thermal imaging images may be used to train a judgment model, and then a judgment module is used to quickly judge whether a violation occurs, in some embodiments, a judgment model is constructed for a conventional violation, for example: smoking, making a call, etc. For the matched violation behaviors, the violation behaviors can be made effective by a traffic police after being compounded, and it should be noted that for the convenience of rechecking, the thermal imaging image and the visible light image are synchronously stored.
In addition, it should be noted that, compared with a mode of independently setting the acquisition devices on one side, the mode of setting the acquisition devices on two sides can better avoid the occurrence of blind spots, and can also acquire more accurate images, so that the follow-up vehicle information acquisition, personnel information acquisition and violation behavior judgment can be conveniently carried out.
According to the highway violation auxiliary determining system, the thermal imaging video and the visible light video with better corresponding degree can be acquired by setting the acquisition fields of the first acquisition device and the second acquisition device; therefore, the effective determination of the vehicle information can be completed by utilizing the visible light video, the vehicle-mounted personnel information can be rapidly determined by utilizing the thermal imaging video on the basis of determining the vehicle information, and the effective identification of the state of the overmaning vehicle of each vehicle is completed. Meanwhile, the behavior of the driver can be identified by utilizing the thermal video so as to determine whether the driving behaviors such as calling, smoking and the like with potential danger occur. In addition, under present new crown epidemic situation environment, utilize the thermal imaging video can accomplish basic temperature screening for when the abnormal personnel of body temperature appear, can let high-speed traffic police carry out effectual management and control. The method for assisting in determining the traffic violation of the highway can assist in finishing judging the driving condition of the highway, can effectively reduce the manpower consumption of the traffic police after speed reduction, improves the execution efficiency of the traffic police, and is suitable for popularization and application.
According to a third aspect of the invention, the method comprises the steps of storing computer executable instructions for causing a computer to execute the highway violation auxiliary determination method.
Computer-readable storage media according to embodiments of the present invention may facilitate storage and transfer of computer-executable instructions by the storage media.
A monitoring system according to an embodiment of the fourth aspect of the invention, comprising:
the first acquisition device is used for acquiring a first thermal imaging video and a first visible light video;
the second acquisition device is used for acquiring a second thermal imaging video and a second visible light video; the first acquisition device and the second acquisition device are respectively arranged at two sides of the highway, the acquisition visual angles face the direction of a coming vehicle, the visual field for acquiring the first thermal imaging video is consistent with the visual field for acquiring the first visible light video, and the visual field for acquiring the second thermal imaging video is consistent with the visual field for acquiring the second visible light video; the first thermal imaging video, the first visible light video, the second thermal imaging video and the second visible light video are synchronously acquired;
and the server is connected with the first acquisition device and the second acquisition device through a network and is used for executing the highway violation auxiliary determination method.
The first collecting device and the second collecting device are respectively arranged on two sides of a highway, and can be arranged through a portal frame or can be arranged through an independent supporting frame. Considering that the first collecting device and the second collecting device can complete network connection with the server, the cloud deck can be selected to be installed when the first collecting device and the second collecting device are installed, so that the cloud deck can be directly utilized to complete adjustment of the collecting visual angle in the later period. It should be noted that, after the first collecting device and the second collecting device are installed, an optimal collecting viewing angle is determined and recorded, so that the optimal collecting viewing angle can be quickly reset after the fields of view of the first collecting device and the second collecting device are subsequently adjusted.
When the first and second capturing devices are used to capture videos, in order to ensure that the corresponding degree of the captured images is as high as possible, it is necessary to ensure that the thermal imaging capturing device 100 and the visible light capturing device 200 in each capturing device have the same visual field, and the included angles between the sight lines of the first and second capturing devices and the middle line of the highway are as close as possible to the same.
According to the monitoring system provided by the embodiment of the invention, the thermal imaging video and the visible light video with better corresponding degree can be acquired by setting the acquisition fields of the first acquisition device and the second acquisition device; therefore, the effective determination of the vehicle information can be completed by utilizing the visible light video, the vehicle-mounted personnel information can be rapidly determined by utilizing the thermal imaging video on the basis of determining the vehicle information, and the effective identification of the overmaning state of each vehicle is completed. Meanwhile, the behavior of the driver can be identified by utilizing the thermal video so as to determine whether the driving behaviors such as calling, smoking and the like with potential danger occur. In addition, under present new crown epidemic situation environment, utilize the thermal imaging video can accomplish basic temperature screening for when the abnormal personnel of body temperature appear, can let high-speed traffic police carry out effectual management and control. The method for assisting in determining the traffic violation of the highway can assist in finishing judging the driving condition of the highway, can effectively reduce the manpower consumption of the traffic police after speed reduction, improves the execution efficiency of the traffic police, and is suitable for popularization and application.
In some embodiments of the invention, the first and second acquisition devices each comprise:
a thermal imaging acquisition device 100;
a visible light collection device 200;
the main controller 300 is respectively connected with the thermal imaging acquisition device 100 and the visible light acquisition device 200;
and the network connection module 400 is connected with the main controller 300 and is used for assisting the main controller 300 to realize data interaction with the server.
Referring to fig. 5, the thermal image acquisition apparatus 100 and the visible light acquisition apparatus 200 may be directly manufactured from commercially available products. The collected video data is further transmitted to the server through the master controller 300 by using the network connection module 400. The network connection module 400 may be a GPRS module or an internet of things module, and may be a WiFi module in case of conditional operation, so as to reduce communication cost.
In some embodiments of the present invention, the first collecting device and the second collecting device both use a waterproof and dustproof housing to reduce the invasion of rainwater and dust to the first collecting device and the second collecting device.
Referring to fig. 5, in some embodiments of the present invention, a radar speed measuring device 500 may be further integrated in the first collecting device and the second collecting device, and the radar speed measuring device 500 is electrically connected to the main controller 300, and speed measurement is rapidly performed by using the radar speed measuring device 500. It should be noted that the real-time speed measurement can be completed by directly using the videos acquired by the first acquisition device and the second acquisition device, but a certain calculation power of the server needs to be consumed. The interval speed measurement can also be completed by a plurality of first acquisition devices and second acquisition devices arranged along the highway.
Referring to fig. 5, in some embodiments of the present invention, the first and second collection devices further integrate the ETC charging system 600, and the ETC charging system 600 is electrically connected to the master 300, which can provide a certain physical basis for inter-zone charging.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an illustrative embodiment," "an example," "a specific example," or "some examples" or the like mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Although the embodiments of the present invention have been described in detail, the present invention is not limited to the embodiments, and those skilled in the art can understand that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.

Claims (6)

1. A highway violation auxiliary determination method is applied to a server and is characterized by comprising the following steps:
acquiring a first thermal imaging video, a first visible light video, a second thermal imaging video and a second visible light video; the first thermal imaging video and the first visible light video are both collected by a first collecting device, and the second thermal imaging video and the second visible light video are both collected by a second collecting device; the first acquisition device and the second acquisition device are respectively arranged on two sides of a highway, the acquisition visual angles face the direction of a coming vehicle, the visual field for acquiring the first thermal imaging video is consistent with the visual field for acquiring the first visible light video, and the visual field for acquiring the second thermal imaging video is consistent with the visual field for acquiring the second visible light video; the first thermal imaging video, the first visible light video, the second thermal imaging video and the second visible light video are synchronously acquired;
determining vehicle information of the vehicles to be detected in the first visible light video and the second visible light video, wherein the vehicle information comprises vehicle identification information and vehicle position information corresponding to each vehicle to be detected;
determining personnel information corresponding to each vehicle to be detected according to the first thermal imaging video, the second thermal imaging video and the vehicle information, wherein the personnel information comprises the number of personnel, the position of each personnel and the temperature information corresponding to each personnel;
determining behavior action information of the person in the driving position according to the first thermal imaging video, the second thermal imaging video and the person information;
the determining of the vehicle information of the vehicle to be detected in the first visible light video and the second visible light video includes the following steps:
intercepting a first vehicle identification image group corresponding to a preset optimal view angle group in the first visible light video, wherein the optimal view angle group comprises a plurality of intercepting view angle points, and the first vehicle identification image group comprises a plurality of first visible light intercepting images corresponding to the intercepting view angle points one by one; each vehicle to be detected corresponds to one group of the first vehicle identification image group;
intercepting a second vehicle identification image group which is in the same time as the first vehicle identification image group in the second visible light video, wherein the second vehicle identification image group comprises a plurality of second visible light intercepted images which are in one-to-one correspondence with a plurality of first visible light intercepted images in the first vehicle identification image group;
determining the license plate number of the vehicle to be detected according to the first vehicle identification image group and the second vehicle identification image group;
recording the license plate number as the vehicle identification information, and recording corresponding positions of the plurality of interception visual angle points in the optimal visual angle group as vehicle position information;
the determining of the personnel information corresponding to each vehicle to be detected according to the first thermal imaging video, the second thermal imaging video and the vehicle information comprises the following steps:
intercepting a first person identification image group from the first thermal imaging video and a second person identification image group from the second thermal imaging video according to the first vehicle identification image group, wherein the first person identification image group comprises a plurality of first thermal imaging intercepted images, and the second person identification image group comprises a plurality of second thermal imaging intercepted images;
determining the personnel information in the vehicle to be detected according to the first personnel identification image group and the second personnel identification image group;
the step of determining the personnel information in the vehicle to be detected according to the first personnel identification image group and the second personnel identification image group comprises the following steps:
identifying a first heat source area from a plurality of first thermal imaging intercepted images, and extracting first human body contour information corresponding to the first heat source area;
identifying a second heat source area from the plurality of second thermal imaging intercepted images, and extracting second human body contour information corresponding to the second heat source area;
determining the personnel information corresponding to the vehicle to be detected according to the first heat source area, the second heat source area, the first human body contour information and the second human body contour information;
the first body contour information is obtained by the following steps:
extracting infant heat source information from a first heat source area according to a preset age temperature threshold;
determining the staff information according to the first heat source area and the infant staff information.
2. The highway violation auxiliary determination method according to claim 1, wherein said determining behavioral action information of a person in a driving position according to said first thermal imaging video, said second thermal imaging video and said person information comprises the steps of:
and matching each first thermal imaging intercepted image and each second thermal imaging intercepted image with a preset violation action judgment model, if the first thermal imaging intercepted image and each second thermal imaging intercepted image are consistent in matching, storing the corresponding first person identification image group, the corresponding second person identification image group, the corresponding first vehicle identification image group and the corresponding second vehicle identification image group, and recording corresponding vehicle information.
3. An assistant determining system for highway violation, which is applied to a server and is characterized by comprising:
the data acquisition module is used for acquiring a first thermal imaging video, a first visible light video, a second thermal imaging video and a second visible light video; the first thermal imaging video and the first visible light video are both collected by a first collecting device, and the second thermal imaging video and the second visible light video are both collected by a second collecting device; the first acquisition device and the second acquisition device are respectively arranged on two sides of a highway, the acquisition visual angles face the direction of a coming vehicle, the visual field for acquiring the first thermal imaging video is consistent with the visual field for acquiring the first visible light video, and the visual field for acquiring the second thermal imaging video is consistent with the visual field for acquiring the second visible light video; the first thermal imaging video, the first visible light video, the second thermal imaging video and the second visible light video are synchronously acquired;
the vehicle determining module is used for determining vehicle information of the vehicle to be detected in the first visible light video and the second visible light video, wherein the vehicle information comprises vehicle identification information and vehicle position information corresponding to each vehicle to be detected;
the personnel determining module is used for determining personnel information corresponding to each vehicle to be detected according to the first thermal imaging video, the second thermal imaging video and the vehicle information, and the personnel information comprises the number of personnel, the position of each personnel and temperature information corresponding to each personnel;
the violation judgment module is used for determining behavior and action information of the person at the driving position according to the first thermal imaging video, the second thermal imaging video and the person information;
the determining of the vehicle information of the vehicle to be detected in the first visible light video and the second visible light video includes the following steps:
intercepting a first vehicle identification image group corresponding to a preset optimal view angle group in the first visible light video, wherein the optimal view angle group comprises a plurality of intercepting view angle points, and the first vehicle identification image group comprises a plurality of first visible light intercepting images corresponding to the intercepting view angle points one by one; each vehicle to be detected corresponds to one group of the first vehicle identification image group;
intercepting a second vehicle identification image group which is in the same time as the first vehicle identification image group in the second visible light video, wherein the second vehicle identification image group comprises a plurality of second visible light intercepted images which are in one-to-one correspondence with a plurality of first visible light intercepted images in the first vehicle identification image group;
determining the license plate number of the vehicle to be detected according to the first vehicle identification image group and the second vehicle identification image group;
recording the license plate number as the vehicle identification information, and recording corresponding positions of the plurality of interception visual angle points in the optimal visual angle group as vehicle position information;
the determining of the personnel information corresponding to each vehicle to be detected according to the first thermal imaging video, the second thermal imaging video and the vehicle information comprises the following steps:
intercepting a first person identification image group from the first thermal imaging video and a second person identification image group from the second thermal imaging video according to the first vehicle identification image group, wherein the first person identification image group comprises a plurality of first thermal imaging intercepted images, and the second person identification image group comprises a plurality of second thermal imaging intercepted images;
determining the personnel information in the vehicle to be detected according to the first personnel identification image group and the second personnel identification image group;
the step of determining the personnel information in the vehicle to be detected according to the first personnel identification image group and the second personnel identification image group comprises the following steps:
identifying a first heat source area from a plurality of first thermal imaging intercepted images, and extracting first human body contour information corresponding to the first heat source area;
identifying a second heat source area from the plurality of second thermal imaging intercepted images, and extracting second human body contour information corresponding to the second heat source area;
determining the personnel information corresponding to the vehicle to be detected according to the first heat source area, the second heat source area, the first human body contour information and the second human body contour information;
the first body contour information is obtained by the following steps:
extracting infant heat source information from a first heat source area according to a preset age temperature threshold;
and determining the personnel information according to the first heat source area and the infant personnel information.
4. A computer-readable storage medium characterized by: the computer-readable storage medium stores computer-executable instructions for causing a computer to perform the highway violation auxiliary determination method of any one of claims 1-2.
5. A monitoring system, comprising:
the first acquisition device is used for acquiring a first thermal imaging video and a first visible light video;
the second acquisition device is used for acquiring a second thermal imaging video and a second visible light video; the first acquisition device and the second acquisition device are respectively arranged on two sides of a highway, the acquisition visual angles face the direction of a coming vehicle, the visual field for acquiring the first thermal imaging video is consistent with the visual field for acquiring the first visible light video, and the visual field for acquiring the second thermal imaging video is consistent with the visual field for acquiring the second visible light video; the first thermal imaging video, the first visible light video, the second thermal imaging video and the second visible light video are synchronously acquired;
a server connected with the first acquisition device and the second acquisition device through a network and used for executing the method for assisting in determining the highway violation according to any one of claims 1 to 2.
6. The monitoring system of claim 5, wherein the first and second acquisition devices each comprise:
a thermal imaging acquisition device;
a visible light collection device;
the main controller is respectively connected with the thermal imaging acquisition device and the visible light acquisition device;
and the network connection module is connected with the master controller and is used for assisting the master controller to realize data interaction with the server.
CN202210477576.1A 2022-04-29 2022-04-29 Highway violation auxiliary determination method and system, storage medium and monitoring system Active CN114842653B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210477576.1A CN114842653B (en) 2022-04-29 2022-04-29 Highway violation auxiliary determination method and system, storage medium and monitoring system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210477576.1A CN114842653B (en) 2022-04-29 2022-04-29 Highway violation auxiliary determination method and system, storage medium and monitoring system

Publications (2)

Publication Number Publication Date
CN114842653A CN114842653A (en) 2022-08-02
CN114842653B true CN114842653B (en) 2023-03-24

Family

ID=82568413

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210477576.1A Active CN114842653B (en) 2022-04-29 2022-04-29 Highway violation auxiliary determination method and system, storage medium and monitoring system

Country Status (1)

Country Link
CN (1) CN114842653B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004086783A (en) * 2002-08-29 2004-03-18 Nobuhide Koga Traffic violation regulation system
CN110148299A (en) * 2019-03-11 2019-08-20 清华大学 A kind of overload of vehicle monitoring and managing method, device, system and storage medium

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2354744C (en) * 2001-08-03 2005-04-12 Laurence Gainsborough Apparatus and method of control of unruly persons
CN103337176B (en) * 2013-07-09 2015-04-08 辽宁天久信息科技产业有限公司 Traffic violation snapshotting method with traffic violation snapshotting system
CN106408950A (en) * 2016-11-18 2017-02-15 北京停简单信息技术有限公司 Parking lot entrance and exit license plate recognition system and method
CN107316463A (en) * 2017-07-07 2017-11-03 深圳市诺龙技术股份有限公司 A kind of method and apparatus of vehicle monitoring
CN109118788A (en) * 2018-10-21 2019-01-01 河南汇纳科技有限公司 A kind of high speed violation prompt system
CN209785252U (en) * 2019-03-26 2019-12-13 张靖 Automobile excess member monitoring system
CN110443901A (en) * 2019-06-26 2019-11-12 成都信息工程大学 In conjunction with the ticket checking method, device and storage medium of multiple view
CN112037451A (en) * 2020-08-19 2020-12-04 浙江大华技术股份有限公司 Early warning method and device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004086783A (en) * 2002-08-29 2004-03-18 Nobuhide Koga Traffic violation regulation system
CN110148299A (en) * 2019-03-11 2019-08-20 清华大学 A kind of overload of vehicle monitoring and managing method, device, system and storage medium

Also Published As

Publication number Publication date
CN114842653A (en) 2022-08-02

Similar Documents

Publication Publication Date Title
CN112965504A (en) Remote confirmation method, device and equipment based on automatic driving and storage medium
WO2018058958A1 (en) Road vehicle traffic alarm system and method therefor
WO2019223655A1 (en) Detection of non-motor vehicle carrying passenger
CN206164739U (en) Automation video recording that vehicle far -reaching headlamp used is in violation of rules and regulations collected evidence and enforcement system
CN110738150B (en) Camera linkage snapshot method and device and computer storage medium
US20210303883A1 (en) Deterioration diagnosis device, deterioration diagnosis system, deterioration diagnosis method, and storage medium for storing program
CN104786933A (en) Panoramic image driving auxiliary device and panoramic image driving auxiliary method
CN109636924A (en) Vehicle multi-mode formula augmented reality system based on real traffic information three-dimensional modeling
CN104875681A (en) Dynamic vehicle-mounted camera control method based on application scenarios
CN102663352A (en) Track identification method
CN110667475A (en) Auxiliary monitoring system and method for blind area of passenger car
CN109326180A (en) Intelligent road test system and method
CN113022441A (en) Vehicle blind area detection method and device, electronic equipment and storage medium
CN105894818A (en) Vehicle intersection traffic violation evidence obtaining system and method
CN112896159A (en) Driving safety early warning method and system
CN103854539A (en) Electronic road test monitoring system based on video analysis
CN106033506A (en) A driving license test driving practicing class hour monitoring system and a method thereof
CN106627463A (en) Unmanned bus visual perception system and work method for same
CN107097722B (en) Multi-screen linkage display method for vehicle and vehicle-mounted central control system
CN114842653B (en) Highway violation auxiliary determination method and system, storage medium and monitoring system
CN110706115A (en) Traffic accident fast claims settlement method, system and server
CN114425991A (en) Image processing method, medium, device and image processing system
CN114822058B (en) Driving specification driving prompting monitoring method and system based on signal lamp intersection, vehicle-mounted terminal and storage medium
CN114049794B (en) Vehicle-mounted safety auxiliary driving system based on smart phone
CN110727269A (en) Vehicle control method and related product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant