KR102358153B1 - An Apparatus for verifying driving speed, and system and method therefor - Google Patents

Abstract

According to the present invention, disclosed is an apparatus for verifying a driving speed of a vehicle. The apparatus may provide an interface, which plays at least one reference image together or simultaneously including a driving image of a target vehicle driving at a speed exceeding a pre-set speed, a reference speed of a reference vehicle, and elapsed time information.

Description

Image analysis apparatus, system, and method for verifying driving speed of a vehicle {An Apparatus for verifying driving speed, and system and method therefor}

The present invention relates to an image analysis apparatus, system, and method for verifying the driving speed of a vehicle, and more particularly, to determine the driving speed of a vehicle by playing a driving image and a reference image of a vehicle subject to enforcement at the same time or together. It relates to an image analysis apparatus, system, and method for the same.

If you drive over the speed limit, the driver's field of vision becomes narrow, making it difficult to quickly respond to unexpected variables that occur on the road, and the braking distance becomes longer, which increases the possibility and risk of an accident. There are guidelines to prevent speeding.

Nevertheless, the occurrence and damage of traffic accidents due to speeding did not decrease, and there were a lot of voices for strengthening the punishment of vehicle drivers, especially those who fall within the maximum speeding range punishable by speeding enforcement. Accordingly, the Road Traffic Act, which came into effect on December 10, 2020, has been amended to strengthen penalties for driving over the speed limit of 80 km/h. Previously, a driver at excessive speed received a fine of 120,000 to 130,000 won (based on a passenger car), but according to the revised law, he can receive a maximum prison sentence. Penalties are strengthened with criminal punishment such as imprisonment of up to 1 year or a fine of not more than 5 million won in case of fine detention, 80 demerit points, fine of not more than 1 million won if exceeding 100 km/h, 100 demerit points, if exceeding 100 km/h 3 times or more became If you exceed 100 km/h 3 times or more, your driver's license will be revoked. Since driving at excessive speed not only poses a threat to other drivers, but can also cause serious human casualties in the event of an accident, this type of stricter punishment was introduced.

In order to crack down on such speeding or overspeed driving vehicles, speed enforcement cameras are installed on general roads or highways. If you exceed the speed limit, you will be subject to speeding enforcement, and a notice or notice of imposition of a fine (or fine) with a photograph of the vehicle attached will be sent to the address of the vehicle owner. However, in this case, the vehicle owner may raise an opinion on the fact of speeding enforcement. Most vehicle owners who have been notified of the speeding enforcement end up paying fines or fines, but some vehicle owners have disputes, such as submitting disagreements.

Such disputes not only waste unnecessary resources of not only vehicle owners but also state agencies such as the National Police Agency, and if the matter escalates into a lawsuit, it may cause time and financial damage to the relevant parties, especially the manufacturers of speed cameras or systems, and suppliers. can

An object of the present invention is to propose an image analysis apparatus, system, and method therefor that can present evidence to prove the driving speed of the vehicle to the vehicle owner in the event of such a dispute. Through this, we aim to minimize subsequent disputes.

More specifically, an image analysis device and system capable of simultaneously or simultaneously reproducing a driving image of a vehicle subject to speeding enforcement and a reference image of a vehicle traveling at a prescribed speed of the road or several speeds having a predetermined interval therefrom And to propose a method for this.

The problems to be solved to be achieved in the present invention are not limited to the problems to be solved, and other problems not mentioned may be clearly understood by those of ordinary skill in the art to which the present invention belongs from the description below. There will be.

According to an embodiment of the present invention, a device for verifying the driving speed of a vehicle is proposed, wherein the device includes a driving image of a target vehicle traveling at a speed exceeding a preset speed, and reference speed and time lapse information of the reference vehicle It is possible to provide an interface for playing at least one reference image including the at the same time or together.

Additionally or alternatively, the interface may include: a manipulation unit that supports playback and pause of driving images and reference images; and an information display unit for displaying the vehicle number of the target vehicle and the shooting location of the driving image.

Additionally or alternatively, the interface may automatically call the reference image and the prescribed speed of the road when the driving image is called.

Additionally or alternatively, the reference image may be obtained by photographing a reference vehicle traveling at the reference speed using an object detection device on a road on which the driving image is obtained.

Additionally or alternatively, the reference image may be selected and reproduced according to the speed of the target vehicle from a plurality of pre-stored candidate reference images.

Additionally or alternatively, the reference speed may be displayed via an externally mounted certified speedometer of the reference vehicle.

Additionally or alternatively, the time-lapse information may be displayed on an external information display device of the reference vehicle.

Additionally or alternatively, the driving image may include time lapse information, and the time lapse information of the driving image may have a different value from the time lapse information of the reference image.

Additionally or alternatively, the time-lapse information may be in the form of numbers or figures.

Additionally or alternatively, each of the driving image and the reference image may include distance information between a photographing device of each image and the target vehicle and the reference vehicle.

Additionally or alternatively, the distance information may be calculated by an object detection device that detects the target vehicle or the reference vehicle.

Additionally or alternatively, the distance information may be calculated using the position of the license plate of the target vehicle or the reference vehicle on an image frame of the driving image or the reference image.

Additionally or alternatively, the interface is configured to reproduce an image frame having distance information of a preset first value among the image frames in which the distance information of the driving image and the reference image is the same as the start frame of the driving image and the reference image. can do.

Additionally or alternatively, the interface may play an image frame having distance information of a preset second value among image frames having the same distance information of the driving image and the reference image as the end frame of the driving image.

Additionally or alternatively, the interface may reproduce an image frame between a start frame and an end frame of the driving image and the reference image obtained according to the distance information.

Additionally or alternatively, the interface may reproduce the start frame or the end frame of the reference image and the driving image to match each other.

A method for verifying the driving speed of a vehicle according to another embodiment of the present invention is proposed, wherein the method includes a driving image of a target vehicle traveling at a speed exceeding a preset speed, and a reference speed and time of the reference vehicle The method may include providing an interface for simultaneously or together playing at least one reference image including progress information.

Additionally or alternatively, the method may include automatically calling the reference image and the prescribed speed of the road when the driving image is called.

As another embodiment of the present invention, a computer program stored in a computer-readable storage medium executed by a processor for performing the above-mentioned method for verifying the traveling speed of a vehicle is proposed.

In addition, as another embodiment of the present invention, a computer-readable storage medium storing a computer program executed by a processor for performing the above-mentioned method for verifying the driving speed of a vehicle is proposed.

The above problem solving methods are only some of the embodiments of the present invention, and various embodiments in which the technical features of the present invention are reflected are based on the detailed description of the present invention to be described below by those of ordinary skill in the art can be derived and understood as

According to the present invention, by simultaneously playing the driving image and the reference image, it is possible to visually check whether the vehicle is speeding or not.

In addition, it can be confirmed that the playback speed is the same by displaying time-lapse information of the driving image and the reference image.

In addition, by locating the vehicle positions in the start frame and the end frame of the driving image and the reference image at the same point, it is possible to facilitate comparison of the two images.

In addition, by automatically pausing the reproduction of the image in a specific frame between the start frame and the end frame of the driving image and the reference image, it is possible to facilitate comparison of vehicle speeds in the two images.

In addition, by providing a plurality of reference images according to a plurality of reference speeds, it is possible to easily grasp a relative difference in the driving speed of the vehicle in the driving image.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those of ordinary skill in the art to which the present invention belongs from the following description. will be.

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are included as a part of the detailed description for better understanding of the present invention, provide embodiments of the present invention, and together with the detailed description, explain the technical spirit of the present invention.
1 shows the overall configuration of an image analysis system related to the present invention.
2 is a block diagram of an image analysis apparatus for verifying the driving speed of a vehicle related to the present invention.
3 shows an example of a reference image according to the present invention.
4 shows a first example of the interface of the traveling speed verification unit according to the present invention.
5 shows a second example of the interface of the traveling speed verification unit according to the present invention.
6 is a flowchart of an image analysis method for verifying the driving speed of a vehicle related to the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are included as a part of the detailed description to help the understanding of the present invention, provide embodiments of the present invention, and together with the detailed description, explain the technical spirit of the present invention.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. However, the present invention is not limited to the embodiments described herein and may be implemented in various other forms. The terminology used herein is for the purpose of helping the understanding of the embodiments, and is not intended to limit the scope of the present invention. Also, singular forms used hereinafter include plural forms unless the phrases clearly indicate the opposite.

1 shows the overall configuration of an image analysis system according to an embodiment of the present invention. In the image analysis system, a photographing device 1 such as a camera for generating an image or detecting an object by photographing a traffic situation, an image analysis device 2 connected to the photographing device 1 by wire or wirelessly, and an image or image Includes operating devices (3) such as traffic control rooms operated by various local governments, the Road Corporation, the Korea National Police Agency, etc. can do. In addition, the image analysis system may further include various object detection devices (eg, at least one of an electromagnetic sensor, a radar sensor, and an image sensor). In this case, the image analysis device 2 operates in conjunction with the object detection device. can The image analysis apparatus 2 according to the present invention may be included in the photographing device 1 or the operating device 3 , or may exist as a separate device or system that communicates with the photographing device 1 and the operating device 3 . have.

2 is a block diagram of an image analysis apparatus 2 for verifying the driving speed of a vehicle according to the present invention. The image analysis device 2 includes a driving information collection unit 210 , a driving image acquisition unit 220 , a reference image acquisition unit 230 , a driving speed verification unit 240 , a control unit 250 , a communication unit 260 , and storage A portion 270 may be included. Some of the components 210 to 270 may be integrated into one to implement the present invention, or some of the above components may be divided to implement the present invention. In addition, some components of the image analysis apparatus 2 may be included in the photographing apparatus 1 or the operating apparatus 3 to perform an operation according to the present invention, which will be described later.

The driving information collection unit 210 may acquire driving information of a vehicle traveling on a road. The driving information collection unit 210 may store the acquired driving information in the storage unit 270 . Here, the driving information may include a driving speed of the vehicle, a vehicle image, and a driving image. In order to obtain a vehicle image or a driving image, the driving information collection unit 210 may interwork with the photographing device 1 such as a camera, and may interwork with an object detection device such as a radar sensor to detect driving speed. . In addition, the driving information may include information that can be obtained by analyzing the vehicle image, and the vehicle number, vehicle type, vehicle color, whether the occupant is wearing a seat belt, whether the driver uses a mobile phone, whether the signal is violated , load box status, and occupant analysis information may be included. In addition, the driving information may include location information of the vehicle and time information at which the vehicle image was captured. The driving information collection unit 210 can extract the vehicle number from the vehicle image through image analysis, match and manage various types of driving information based on the vehicle number in text form, and provide driving information if necessary later. have. The driving information collection unit 210 may identify a vehicle (hereinafter, referred to as a “target vehicle”) traveling at a driving speed exceeding or less than a preset speed among the acquired driving information. This is to compare the driving image of the target vehicle with a reference image to be described later.

The preset speed for identifying the target vehicle may include, for example, the following speed, and the preset speed in the present invention is not limited to this example. In addition, in the following description, a target vehicle traveling at a driving speed exceeding a preset speed, that is, a case subject to overspeed enforcement will be mainly described, but a target vehicle traveling at a driving speed lower than the preset speed, that is, a low speed The present invention can also be applied to cases subject to crackdown.

The upper limit of the speed at which the vehicle travels on general roads, and the upper and lower speed limits on expressways (hereinafter referred to as "regular speed") are determined. In general, the speed limit is set at 30 km/h in child protection zones and 50 km/h on roads in residential areas. In this case, the preset speed may refer to a prescribed speed set for each road. Here, the driving image is not an image of the target vehicle driving after violating the regulated speed, but an image of driving at the time of violating the regulated speed (eg, the image of the vehicle in the speed calculation section) driving video).

On the other hand, just because a vehicle exceeds the prescribed speed does not mean that it is directly determined as a target vehicle for speeding enforcement such as imposition of a fine. In general, a speed exceeding a certain speed value (eg, 10 km/h) from the prescribed speed is the target of the crackdown. In addition, in the case of the speed of the lower limit of the expressway, a speed less than a certain speed value (eg, 10 km/h) from the prescribed speed may be the target of the crackdown. This speed is referred to as a “critical speed”, and may be referred to as an overspeed critical speed in the case of overspeed and a low critical speed in the case of low speed. In this case, the preset speed may refer to a threshold speed.

The driving image of the target vehicle is for comparison with the reference image, so there may be a small difference (eg, difference in the angle of view) due to physical shaking of the photographing device 1, but the shooting conditions of the driving image and the reference image are all It is preferable to set the same. For example, a driving image and a reference image may be captured using the same camera installed at a specific point, height, angle of view, etc. conditions.

Likewise, it is preferable to obtain the start frame and the end frame of the driving image and the reference image so as to correspond to the scene of the vehicle at the same position on the road.

To this end, the driving information collection unit 210 may be configured such that the driving image includes distance information from the photographing device 1 of the target vehicle for each image frame. Accordingly, the driving image may include distance information (eg, 45m for frame 1, 44m for frame 2, ...) of the target vehicle for each frame. This distance information can be applied to the reference image and the reference vehicle in the same way, and accordingly, the driving information collecting unit 210 sets the distance information of the farthest distance among the image frames in which the distance information of the driving image and the reference image matches, or a preset system. An image frame corresponding to 1 distance may be set as a start frame of the driving image, and an image frame corresponding to the closest distance information or a preset second distance (shorter than the first distance) may be set as the end frame of the driving image. Accordingly, the driving image according to the present invention may include an image frame including distance information of the target vehicle.

In order to include distance information in the driving image, as one method of acquiring distance information, distance information from the photographing device 1 of a vehicle entering or driving a speed calculation section is calculated in real time by an object detection device that measures speed, etc. The driving image of the target vehicle may be captured and stored with a margin before and after the speed calculation section to include at least a scene of the target vehicle passing through the speed calculation section using this. Accordingly, the captured image may be set to include distance information of the target vehicle.

As another method of obtaining distance information of the driving image, distance information from the photographing device 1 of the target vehicle may be calculated by using the location of the license plate of the target vehicle in the captured image frame. The driving information collection unit 210 may store distance information according to the location of the license plate of the target vehicle in the image frame with respect to the driving image. Accordingly, the captured image may be set to include distance information of the target vehicle.

In addition, the driving information collection unit 210 may store all the driving images from the photographing device 1 in the storage unit 270 , and the driving image acquisition unit 220 reflects the distance information, that is, the start frame and the end frame. It allows the image frame between (including the start frame and the end frame) to be acquired as a driving image.

Then, the driving image acquisition unit 220 may acquire a driving image of the target vehicle from among the driving images collected by the driving information collection unit 210 .

Acquisition of a vehicle image of a target vehicle that violates a prescribed speed traveling on a road is generally achieved by recognizing the number of the target vehicle and finally acquiring one image frame to obtain an evidence image of the target vehicle. As such, there are generally two methods of acquiring vehicle images. First, vehicle images of all passing vehicles are acquired, the measured speed is compared, and the image is stored when the specified speed or critical speed is exceeded; Second, when the sensor that calculates the speed generates a trigger signal for the vehicle exceeding the prescribed speed or the threshold speed, there is a method of taking a picture and storing it.

The driving image acquisition unit 220, different from the vehicle image of one image frame described above, passes through a certain section, including at least the start point and the end point of the section for calculating the speed (hereinafter, the “speed calculation section”). It is required to acquire a driving image of the target vehicle, that is, a plurality of image frames. For this, the method of acquiring the driving image is not limited.

For example, as described above, when the start frame and the end frame of the driving image are set by the driving information collection unit 210 according to the distance information of the target vehicle and stored in the storage unit 270 , the driving image acquisition unit 220 may acquire the driving image as it is from the storage 270 .

Alternatively, as described above, when the entire driving image is stored in the storage unit 270 regardless of the distance information of the target vehicle by the driving information collection unit 210, the driving image acquisition unit 220 considers the distance information. Thus, the driving image may be acquired from the storage unit 270 .

The driving image includes, for example, an image frame having a length of about 5 to 10 seconds, and the driving image acquisition unit 220 stores the driving image with a size smaller or reduced than the vehicle image included in the driving information in the storage unit 270 ) can be stored in That is, the vehicle image is stored as an image frame of the first resolution, while the driving image acquisition unit 220 stores the driving image as an image frame of the first resolution or the second resolution (lower or smaller than the first resolution). (270) can be stored. In addition, the driving image acquisition unit 220 may store the driving image at a relatively high number of frames per second among supported frames per second. Alternatively, instead of the driving image acquisition unit 220 , the driving information collection unit 210 may adjust the resolution of the driving image or adjust the number of frames per second and store it in the storage unit 270 .

A photographing device for photographing a vehicle image and a photographing apparatus for photographing a driving image can be configured as the same photographing device, and the driving image acquisition unit 220 sets the resolution (ie, size) differently in the same photographing device to generate or It is preferable to obtain the recorded driving image from the storage unit 270 .

The driving image acquisition unit 220 generates time-lapse information of the driving image based on the time information (hereinafter, “shooting time information”) of the shooting time generated while shooting (or recording) the image in the shooting device 1 . can The driving image acquisition unit 220 may display or include time-lapse information of the generated driving image in the driving image, and store the driving image in which the time-lapse information is displayed or included in the storage unit 270 . In the present invention, the time-lapse information is information that expresses the passage of time in units of actual hours, minutes, seconds, etc., so that an observer of the driving image can identify the passage of time such as hours, minutes, and seconds. The time lapse information may be generated according to a preset time interval (eg, 1 second) based on the shooting time information of the driving image, and during the preset time interval, the time lapse information value maintains a predetermined value, It may be set to change (eg, increase by 1) the value of the time lapse information at every time interval. However, as will be described later, if time-lapse information is generated in each of the driving image and the reference image, it is preferable that at least the preset time interval of the two time-lapse information should be the same. In addition, the driving image acquisition unit 220 may separately store the shooting time information of the driving image in the storage unit 270 .

Also, according to an embodiment, the driving information collecting unit 210 and the driving image acquiring unit 220 may be integrated to perform their functions as one.

The reference image acquisition unit 230 may obtain a reference image, store it in a storage unit 270 such as a database, etc. . In addition, since the reference image is for comparison with the driving image, the reference vehicle driving at the reference speed on the road on which the driving image is obtained is photographed through the photographing device 1 or an object detection device such as a radar sensor, and the recorded image is can That is, for capturing the reference image, a photographing device 1 such as a camera or an object detecting apparatus such as a radar sensor may be used, and the captured reference image may be stored in the storage unit 270 .

As an embodiment, the reference image may refer to an image composed of a plurality of image frames of a reference vehicle traveling at a speed threshold speed (eg, a prescribed speed +10 km/h) in the speed calculation section. In this case, the overspeed threshold speed applied to the reference image may be referred to as a “reference speed”, and the speed of the target vehicle applied to the driving image may be referred to as a “driving speed”. According to this, as long as the "driving speed" of the driving image is faster than the "reference speed" of the reference image, the overspeed of the target vehicle can be identified.

As another embodiment, the reference image is an image for relative comparison with the driving image. As an image composed of a plurality of image frames of a reference vehicle traveling at a constant speed, if the reference speed can be objectively verified and presented, such an image All of them can be included in the reference image. In this case, a constant speed applied to the reference image may be referred to as a “reference speed”, and the speed of the target vehicle applied to the driving image may be referred to as a “driving speed”. For example, the reference image acquisition unit 230 may include a reference speed that is constantly lower than the specified speed (eg, a reference image generated at a reference speed of 25 km/h on a 30 km/h road with a specified speed) or a reference speed that is constantly higher than the specified speed It is possible to generate a reference image by driving with

Since the reference image may be provided as images of reference vehicles traveling at a plurality of reference speeds, it is possible to provide a plurality of reference images accordingly. Each of the plurality of reference images may be composed of an image or a plurality of image frames of a reference vehicle traveling at different reference speeds. In this case, the reference speeds of the plurality of reference images may be set to have a speed difference of a certain size from each other. Also, at least one of the reference speeds of the plurality of reference images may be an overspeed threshold speed, a low speed threshold speed, or a prescribed speed.

Of course, the present invention is also applied to the low critical speed, and in this case, the reference speed may be set similarly to that described above based on the low critical speed.

In generating the reference image, the driver of the reference vehicle detects the amount of rotation of the vehicle driving unit while driving and provides two types of vehicle speed including the speed provided to the instrument panel and the vehicle speed using a GPS sensor (eg, navigation, etc.) reference is possible. The speed of the vehicle dashboard is provided higher than the actual speed for safety in accordance with Article 11, Paragraph 2, Article 54, Paragraph 1, etc. of the Rules for Vehicle Safety Standards. Considering this, the actual speed is lower than the speed provided on the dashboard.

Therefore, when generating the reference image, the difference from the actual speed must be taken into account, or the speed calculated by the GPS sensor is adjusted and the constant speed driving function of the vehicle's ADAS (Advanced Driver Assistance System) (for example, , cruise function, etc.) will be possible to drive. In addition, it is required to reach the reference speed before entering the speed calculation section and constantly maintain the corresponding speed in the corresponding section.

That is, the reference speed of the reference image is preferably the same as the speed displayed on the instrument panel of the reference vehicle traveling at the reference speed or the speed obtained by the GPS sensor.

In addition, it is desirable to provide a reference image so that the driving scene of the reference vehicle is photographed through the photographing device 1 that generates the reference image, and the reference speed expressed through an authenticated speedometer mounted on the outside of the vehicle can be identified. do.

In addition, time-lapse information of the reference image may be displayed or included in the reference image. As an example, the reference image may display or include time-lapse information based on photographing time information of the reference image. The photographing time information means information about the time at which the reference image was captured, for example, information such as year, month, day, hour, minute, second, and the like. In this case, the reference image acquisition unit 230 may generate time-lapse information based on the shooting time information of the reference image, and display or include the time-lapse information of the generated reference image in the reference image, and A reference image on which information is displayed or included may be stored in the storage unit 270 . As another example, the time-lapse information displayed or included in the reference image may include time-lapse information displayed by an information display device (eg, a timer, etc.) mounted outside the reference vehicle when the reference image is captured. The time-lapse information may be generated according to a preset time interval (eg, 1 second) based on the shooting time information of the reference image, and the time-lapse information maintains a predetermined value during the preset time interval, and It may be set to change (eg, increase by 1) the value of the time lapse information at every time interval.

The time-lapse information is a means for verifying that the reference image or the driving image is reproduced at a normal speed (hereinafter referred to as "standard reproduction") in the driving speed verification unit 240 to be described later. This is because, if the reference image is reproduced slowly or the driving image is reproduced quickly, the driving speed of the target vehicle may be seen as exceeding the prescribed speed (ie, overspeeding). Therefore, "time-lapse information" is included in the image as a means for determining whether the reference image and the driving image are reproduced in the standard, and a means for verifying the standard reproduction can be provided using this.

On the other hand, since the preset time interval between the reference image and the driving image is to show that the playback speeds of the two images are the same, it is preferable to set them to be the same. In addition, since the reference speed and the running speed are relatively fast, the passage time of the speed calculation section may be short, so the time-lapse information may not change while passing the speed calculation section. . Accordingly, the preset time interval may be determined in association with the reference speed or the driving speed.

Also, the reference image may be configured to include distance information from the photographing device 1 of the reference vehicle of the reference image. That is, the reference image may be configured to include distance information from the photographing apparatus 1 of the reference vehicle for each image frame. In this case, in order to include the distance information in the reference image, the method of obtaining distance information may be the same as the method of obtaining distance information of the driving image. For details, refer to the method of obtaining distance information of the driving image described above. to do it

Accordingly, the reference image is set as the start frame of the reference image with the farthest distance information or the image frame corresponding to the preset first distance among the image frames in which the driving image and the distance information match, and the closest distance information or the preset first distance. It may be configured to set an image frame corresponding to the second distance (shorter than the first distance) as the end frame of the reference image.

The driving speed verifying unit 240 may provide an interface for reproducing the driving image and the reference image of the target vehicle simultaneously or together. The driving speed verification unit 240 collects the driving image and the reference image from the driving information collecting unit 210 , the driving image acquiring unit 220 or the reference image acquiring unit 230 , or the driving information collecting unit 210 , the driving image The acquisition unit 220 or the reference image acquisition unit 230 may call from the storage unit 270 storing the driving image and the reference image to play them simultaneously or together. In addition, the driving speed verification unit 240 may also provide a function of verifying that the reproduction of the driving image and the reference image is the standard reproduction.

The driving speed verification unit 240 may acquire a driving image and a reference image including the distance information obtained by the driving image acquiring unit 220 or the reference image acquiring unit 230, and a start frame or an end frame of the two images. You can play the video to match it.

In addition, the driving speed verification unit 240 reproduces from the start frame of the driving image and the reference image when the driving image and the reference image are stored as the start frame and the end frame according to the distance information of the target vehicle and the reference vehicle. can start

Also, when the driving image and the reference image are all stored regardless of distance information of the target vehicle and the reference vehicle, the driving speed verification unit 240 may reproduce the driving image and the reference image according to the distance information. For example, the driving speed verification unit 240 sets an image frame corresponding to the longest distance information or a preset distance among image frames in which the distance information of the reference image and the driving image matches as the start frame, and starts playback from the start frame. can

For example, in a situation where the prescribed speed of the road is 30 km/h and there is a reference image of 30 km/h, in a situation where the driving image of the vehicle (ie, the target vehicle) whose driving speed is measured at 50 km/h is obtained, Assuming that a civil complaint is filed from the vehicle owner of the target vehicle, the driving speed verification unit 240 calls the driving image and the reference image of the target vehicle to play them simultaneously or together, so that the two speeds can be compared with the naked eye. It is expected that complaints will be resolved through this.

On the other hand, if the prescribed speed of the corresponding road is 30 km/h, the reference image acquisition unit 230 will be able to acquire at least one reference image in which the vehicle travels at 30, 40, and 50 km/h, and in actual practice, It will be possible to acquire at or close to the speed of

As a more specific embodiment, a plurality of reference images of a corresponding road are generated and stored, and at least one reference image to be called and played back according to the driving speed of the target vehicle can be selected from a plurality of candidate reference images. . That is, the reference image acquisition unit 230 may acquire at least one reference image from a plurality of previously generated and stored reference images according to the driving speed of the target vehicle. In this case, the reference speeds of the plurality of reference images may be set to have a speed difference of a certain size from each other. For example, when it is determined that the target vehicle is traveling at 65 km/h on a road with a prescribed speed of 50 km/h, three reference images with reference speeds of 50 km/h, 60 km/h, and 70 km/h are acquired, and they are By regenerating the verification unit 240 , a section (60 km/h to 70 km/h) to which the traveling speed belongs can be identified or recognized. That is, the driving speed verifying unit 240 may reproduce a plurality of reference images having different reference speeds simultaneously or together with the driving images, and in this case, the reference speeds of the plurality of reference images have a speed difference of a certain size. can be set.

In addition, since time-lapse information can be displayed or included in the reference image and the driving image, and the time-lapse information on both sides is set to have the same time interval, updating (that is, changing) the value of the time-lapse information on both sides It will be done with equal intervals (or periods). Accordingly, it can be shown that the two images are being played back at a normal speed (ie, standard playback).

In this way, the driving speed verification unit 240 reproduces the reference image and the driving image at the same time or together, and provides an interface that allows a relative comparison between them, and also solves the problem of the playback speed of the reference image and the driving image. For this purpose, it will be possible to prove that they are reproduced at the same speed by using time-lapse information.

Meanwhile, when the driving speed verification unit 240 reproduces the reference image and the driving image, the start frame or the end frame of the two images may be synchronized and reproduced. In this case, the position of the vehicle in the start frame or the end frame of the reference image and the driving image is preferably the same point on the road. The start frame of the two images may be played back at the playback start time of the reference image and the driving image, or the end frame of the two images may be played back at the end of the playback of the two images. Accordingly, the vehicle speed in the two images can make comparisons possible.

In addition, it is preferable that the reference image and the driving image include at least a scene in which the vehicle passes through a speed calculation section on the road. Accordingly, in the start frame and the end frame of the reference image and the driving image, the vehicle position may be at or before the start point of the speed calculation section, respectively, and may be at or after the end point of the speed calculation section.

In addition, for smooth comparison between the reference image and the driving image, the driving speed verification unit 240 may automatically stop the reproduction of the reference image and the driving image at a preset time point. More preferably, the automatic stop of the reproduction of the reference image and the driving image is a specific frame (eg, an intermediate frame) between the start frame and the end frame of the reference image based on the reference image or the start of the driving image based on the driving image It may be set to automatically stop at a preset point in time when a specific frame (eg, an intermediate frame) between the frame and the end frame is reproduced.

In addition, for smooth comparison of the reference image and the driving image, the driving speed verification unit 240 determines that the reference image and the driving image are reproduced at a preset location (for example, on the road) It can be set to automatically stop at the center point).

In addition, the driving speed verification unit 240 may reproduce the reference image and the driving image by controlling the playback speed to be the same in addition to the standard playback.

The control unit 250 includes components of the image analysis device 2 , for example, a driving information collection unit 210 , a driving image acquisition unit 220 , a reference image acquisition unit 230 , a driving speed verification unit 240 , and a communication unit. 260 and the storage unit 270 are controlled, and in more detail, a corresponding component can transmit an instruction/command to implement the features described in this specification, and receive a result thereof, and one component It can pass information, messages, data, etc. from one component to another.

The communication unit 260 obtains the driving information or vehicle image of the vehicle obtained by the driving information collecting unit 210 , the driving image of the vehicle obtained by the driving image obtaining unit 220 , and the reference image obtaining unit 230 . Information generated or acquired by the components of the image analysis device 2, such as the reference image, the reference image provided by the driving speed verification unit 240, simultaneous playback of the driving image, or the comparison result of the two images, to an external device Alternatively, the information may be transmitted to a system or the like, and in more detail, the corresponding information may be transmitted to an external system (eg, the operating device 3 ).

The storage unit 270 stores the original road image captured by the photographing device 1 , driving information of the vehicle acquired by the driving information collection unit 210 , and the vehicle acquired by the driving image acquisition unit 220 . The driving image, the reference image acquired by the reference image acquiring unit 230 , the reference image and the driving image provided by the driving speed verifying unit 240 , or a comparison result of the two images may be stored.

Although the storage unit 270 is shown as an individual component from other components in FIG. 2 , each component, for example, a driving information collection unit 210 , a driving image acquisition unit 220 , and a reference image acquisition unit 230 . ), the driving speed verifying unit 240 , the control unit 250 , and the communication unit 260 may also be individually provided with a storage unit (eg, as a temporary storage unit) inside at least one of the communicators 260 . Therefore, in this specification, it will be reasonable to view that the storage unit 270 corresponds to a concept including a temporary storage unit provided inside at least one of the components.

On the other hand, as described above, the image analysis apparatus 2 may operate in conjunction with the photographing apparatus 1 , the operating apparatus 3 , or various types of object detection apparatuses.

The photographing apparatus 1 may photograph a vehicle image of the target vehicle, a driving image, and a reference image of the reference vehicle. Also, the object detection apparatus may detect a traveling speed of a vehicle traveling on a road and detect a target vehicle accordingly.

The operation device 3 may receive the reference image and the driving image from the image analysis device 2 , display it on a display, and perform a function of providing it to an operator or the like. Also, the operating device 3 may receive information about the vehicle from the image analysis device 2 and display the vehicle information on the display. In addition, the operating device 3 receives information about the vehicle, driving information, driving image, etc. from the image analysis device 2 and receives at least one of traffic information, illegal parking information, speed violation information, signal violation information, and life crime prevention information. You can create one or provide it as a traffic information system, illegal parking enforcement system, speed enforcement system, signal violation enforcement system, or crime prevention system. To this end, the operating device 3 may be interlocked with a traffic information system, an illegal parking and stopping enforcement system, a speeding enforcement system, a signal violation enforcement system, or a crime prevention system.

3 shows an example of a reference image according to the present invention. The reference image may be acquired by the reference image acquisition unit 230 , reproduced by the driving speed verification unit 240 , and displayed on a display or the like.

3A shows a state in which a display is mounted on the exterior of a vehicle to obtain a reference image from a road, and is set to display driving speed and time-lapse information on the display. "A" of the display is an area for expressing the driving speed of the vehicle, and "B" is an area for expressing time lapse information (eg, in units of 1 second).

The vehicle and the display mounted on the vehicle are photographed using a photographing device that captures the front of the vehicle on the road, which is why the driving image and the reference image are preferably photographed under the same photographing conditions. It is preferable to take a driving image and a reference image by using a camera device having the same point, height, and angle of view conditions.

In the display of time-lapse information, since the time required to calculate the speed of the driving vehicle is only a few seconds, it is better to express the actual time (hours, minutes, seconds), for example, in units of seconds (sec) 1,2 ,3,4,5,6,7,8,9,0,1,..., etc., may be preferably configured in a form that is expressed in units of 1 second.

In addition, it is possible to configure the time-lapse information as a figure or a symbol on the display means, and the form is not limited as long as it is easy to identify and can identify the passage of time. For example, time-lapse information can be expressed in the form of dots, and at 1-second intervals, . It is also possible to express ... ... ... ..... (that is, expressed by the number of dots) or the like.

3B shows a driving scene of a vehicle traveling at 30 km/h, and time-lapse information is displayed for 5 seconds.

In general, when storing an image, it is possible to match and store the image frame and the shooting time information (or storage time information). At this time, it is possible to detect each image frame and the stored time information and process it to be displayed on the image .

However, in the present invention, time-lapse information does not require actual real time, since this is to indicate that continuous frames are reproduced at a normal speed (ie, standard reproduction).

Table 1 below shows an example of generating time lapse information. The time-lapse information according to Table 1 may be applied not only to the driving image but also to the reference image.

frame One 2 ... 10 ... n-2 n-1 n video

shooting time 12:20_23:100 12:20_23:200 ... 12:20_24:100 ... 12:20_25:070 12:20_25:150 12:20_25:250 time-lapse information 0 0 0 One One One 2 2

Since the accumulated time from frame 1 to frame 10 is 1 second, the time-lapse information indicating the passage of 1 second is expressed as “1” in frame 10, and when exactly 1 second has elapsed from frame 10, frame n-2 and frame n -1, the time-lapse information can be configured to display the next time-lapse information "2" in the nearest frame n-1 after the time point (12:20_25:100) exceeding 1 second.

This is to prepare for a situation in which it is not possible to acquire and store images at precise time intervals in the process of capturing images by the imaging device (it may not be able to accurately acquire 10 frames per second), which The recording time may be different, such as 3 seconds, 5 seconds, 7 seconds, 10 seconds, and the longer the recording time of the reference image or driving video, the more likely it is that an accurate time point will occur even if there is a partial error.

On the other hand, in the example related to Table 1 above, although frames 1 to n have been described, the time-lapse information is for frames in some sections among all image frames of the reference image or driving video, start and end frames within the partial section. may be created for That is, when the start frame and the end frame of the reference image or the driving image to be played back are determined by the driving speed verification unit 240, time-lapse information is calculated from the start frame to 0, 1, 2, ... (or 1, 2, 3, .,,,), etc., time-lapse information is generated, and the generated time-lapse information may be displayed or included in the reference image or the driving image.

In the above example, the time unit of the time-lapse information is expressed in "seconds", but it constitutes time-lapse information in a more granular unit (eg, 1/100 second), and in addition to the time-lapse information of the electronic sign board installed in the vehicle, It is also possible to generate time-lapse information in the image itself by using the recording time information (or storage time information) of the reference image.

4 and 5 show an example of the interface 2400 of the traveling speed verification unit 240 according to the present invention. The interface shown in FIG. 4 or 5 can be displayed, for example, on the display of the operating device 3 .

In this embodiment, the prescribed speed of the road is 30 km/h, and three reference images are generated of a vehicle traveling at 30, 40, and 50 km/h on the corresponding road, and a driving image in which the target vehicle speed is 45 km/h Assume a situation in which .

In FIG. 4 , an interface 2400 in which a driving image and each reference image are provided one-to-one is shown. In each of (a), (b) and (c) of FIG. 4 , an operation unit 2410 supporting playback and pause is configured at the lower end of the interface 2400 . At the bottom of the interface 2400, time-lapse information is displayed.

5 shows an interface 2400 in which a driving image and three reference images are provided simultaneously or together. On the left side of the interface 2400, a control unit 2410 supporting playback and pause is configured, and on the upper left side, information of the target vehicle, the location where the driving image and the reference image were taken, the maximum speed specified for the road, etc. An information display unit 2420 is configured. In addition, time-lapse information is displayed at the bottom of the interface 2400 . In addition, the interface 2400 includes a reference line 2430 that facilitates comparison of the relative positions of the target vehicle and the reference vehicle.

The driving speed verification unit 240 provides time-lapse information from the driving image and the reference image through the interface 2400, so that it is possible to know that it is being reproduced at a normal speed, and the time-lapse information of the driving image is Like 1, it is possible to express 0, 1, 2, 3, 4, ..., etc. It is possible to detect the change point in "seconds" in the form of numbers or figures (eg, dots) and provide them so that they can be compared on the interface.

That is, in FIG. 5 , a scene in which the time lapse information of the driving image and the reference image are displayed identically as “2” seconds is shown, but the driving speed verifying unit 240 or the interface 2400 shows the time lapse of different values. Information can also be displayed. After all, since the time-lapse information only needs to be able to prove that the driving image and the reference image are reproduced at the same playback speed, it only needs to be able to indicate that the time interval in "seconds" of the time-lapse information of each image is the same. Of course, as the unit of the time interval of the time-lapse information, other time units (eg, 1/10 second, etc.) other than "second" may be used.

In addition, as described above, the interface 2400 of the driving speed verification unit 240 of the present invention includes a function of automatically calling the reference image and the prescribed speed of the interception point (road) when the driving image of the target vehicle is called. can do.

In addition, for example, when the prescribed speed of the road is as high as 80 km/h and the shooting section of the driving image or the reference image is short (for example, an area of 30 m to 10 m in front of the angle of view is taken), the speed calculation section (e.g., usually about 5 m) ) is very short. Accordingly, the interface 2400 of the present invention can provide an automatic/manual pause function of "seconds" unit of images played simultaneously or together in order to compare two images in a short time, and at the same time, the same rate (eg, 0.5 It can be configured to enable slow playback at double speed). In addition, the interface 2400 is preferably configured such that a reference line 2430 for easy comparison of the relative position of the vehicle in each image is displayed, so that the relative position of the vehicle can be easily compared by an observer.

6 is a flowchart of an image analysis method for verifying the driving speed of a vehicle according to the present invention. The method may be performed by the image analysis device 2 or its components.

The image analysis apparatus 2 may obtain driving information of a vehicle traveling on a road (S610). The driving information may include a driving speed of the vehicle, a vehicle image, and a driving image. Here, the vehicle image refers to an image composed of one image frame, and the driving image refers to an image composed of a plurality of image frames. In addition, the driving information may include information obtainable through image analysis from the vehicle image. In addition, the driving information may include vehicle location information and time information at which the vehicle image was captured.

The image analysis apparatus 2 may identify a target vehicle traveling at a driving speed exceeding a preset speed among the acquired driving information (S620). Here, the driving image refers to an image composed of a plurality of image frames, and corresponds to a commonly called “moving image”. In addition, the preset speed means a speed higher or lower by a certain speed value from a prescribed speed or a prescribed speed of a road on which the vehicle travels.

The image analysis apparatus 2 may acquire a driving image of the identified target vehicle (S630).

The image analysis apparatus 2 may provide an interface for reproducing a driving image and a reference image of a vehicle traveling at a reference speed simultaneously or together (S640). The reference image may be set to include the reference speed and time-lapse information of the reference image, so that the vehicle speed and the reproduction speed of the reference image shown in the reference image are normal speeds.

In addition, the driving image is also set to include the driving speed and time-lapse information of the driving image, so that the vehicle speed and the playback speed of the driving image shown in the driving image may represent a normal speed or the same playback speed as the reference image.

The image analysis method related to FIG. 6 may include at least some of the contents related to the present invention described with reference to FIGS. 1 to 5 as a configuration of the method. For a detailed description, refer to the description related to FIGS. 1 to 5 .

In the above specification, "device" or "system" and its components (driving information collection unit 210, driving image acquisition unit 220, reference image acquisition unit 230, driving speed verification unit 240, control unit) 250, the communication unit 260, the storage unit 270, etc.) have been described as carrying out the invention, but "device" and "system" and components belonging thereto are only names, and the scope of rights is not subordinated thereto. That is, the method or procedure of the present invention may be performed with a name other than an apparatus or a system, and the method or method is performed by software for image analysis or a code readable by a computer or other machine, device, etc. can be

In addition, as another aspect of the present invention, the above-described proposal or operation of the invention is performed by a "computer" (a comprehensive concept including a system on chip (SoC) or (micro) processor, etc.) Code that can be implemented, implemented or executed, or a computer-readable storage medium storing or including the code, or a computer program product, etc. a computer-readable storage medium including a computer program product or a computer program product.

The detailed description of the preferred embodiments of the present invention disclosed as described above is provided to enable any person skilled in the art to make and practice the present invention. Although the above has been described with reference to preferred embodiments of the present invention, it will be understood by those skilled in the art that various modifications and changes can be made to the present invention described in the claims below. Accordingly, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (20)

As a device for verifying the running speed of a vehicle,
An apparatus for providing an interface for simultaneously or simultaneously playing a driving image of a target vehicle traveling at a speed exceeding a preset speed and at least one reference image including a reference speed and time-lapse information of the reference vehicle. The method of claim 1, wherein the interface comprises:
a control unit that supports playback and pause of driving images and reference images; and
An apparatus comprising an information display unit for displaying the vehicle number of the target vehicle and the shooting location of the driving image. The method of claim 1, wherein the interface comprises:
When the driving image is called, the apparatus for automatically calling the prescribed speed and the reference image of the road. According to claim 1,
The reference image is obtained by photographing a reference vehicle traveling at the reference speed using an object detection device on a road on which the driving image is obtained. According to claim 1,
The reference image is selected and reproduced according to the speed of the target vehicle from a plurality of pre-stored candidate reference images. The apparatus of claim 1, wherein the reference speed is expressed through an externally mounted certified speedometer of the reference vehicle. The apparatus according to claim 1, wherein the time-lapse information is displayed on an external information display device of the reference vehicle. The apparatus of claim 1, wherein the driving image includes time lapse information, and the time lapse information of the driving image has a different value from the time lapse information of the reference image. The apparatus of claim 8, wherein the time-lapse information is in the form of numbers or figures. The apparatus of claim 1 , wherein each of the driving image and the reference image includes distance information between a photographing device of each image and the target vehicle and the reference vehicle. The apparatus of claim 10 , wherein the distance information is calculated by an object detection device that detects the target vehicle or the reference vehicle. The apparatus of claim 10 , wherein the distance information is calculated using a position of a license plate of the target vehicle or the reference vehicle on an image frame of the driving image or the reference image. The method of claim 10, wherein the interface comprises:
An apparatus for reproducing an image frame having distance information of a preset first value among image frames having the same distance information of the driving image and the reference image as a start frame of the driving image and the reference image. The method of claim 10, wherein the interface comprises:
An apparatus for reproducing an image frame having distance information of a preset second value among image frames having the same distance information of the driving image and the reference image as an end frame of the driving image. The method of claim 10, wherein the interface comprises:
An apparatus to reproduce an image frame between a start frame and an end frame of the driving image and the reference image obtained according to the distance information. The method of claim 1, wherein the interface comprises:
An apparatus for reproducing the start frame or the end frame of the reference image and the driving image to match each other. As a method for verifying the driving speed of a vehicle,
Comprising the step of providing an interface for simultaneously or simultaneously playing a driving image of a target vehicle traveling at a speed exceeding a preset speed and at least one reference image including a reference speed and time-lapse information of the reference vehicle, Way. 18. The method of claim 17,
When the driving image is called, the method comprising the step of automatically calling the reference image and the prescribed speed of the road. A computer program stored in a computer readable storage medium executed by a processor for performing the method according to claim 17 . A computer readable storage medium storing a computer program executed by a processor for performing the method according to claim 17 .

Images