WO2015184899A1 - Method and device for recognizing license plate of vehicle - Google Patents

Method and device for recognizing license plate of vehicle Download PDF

Info

Publication number
WO2015184899A1
WO2015184899A1 PCT/CN2015/074792 CN2015074792W WO2015184899A1 WO 2015184899 A1 WO2015184899 A1 WO 2015184899A1 CN 2015074792 W CN2015074792 W CN 2015074792W WO 2015184899 A1 WO2015184899 A1 WO 2015184899A1
Authority
WO
WIPO (PCT)
Prior art keywords
license plate
image frame
image
image frames
frames
Prior art date
Application number
PCT/CN2015/074792
Other languages
French (fr)
Chinese (zh)
Inventor
王勃飞
郑成建
夏珍
罗艳红
黄晓红
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2015184899A1 publication Critical patent/WO2015184899A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition

Definitions

  • the present invention relates to the field of image technologies, and in particular, to a vehicle license plate recognition method and apparatus.
  • license plate recognition has gradually become an important part of the intelligent transportation system.
  • the active license plate recognition technology for the bayonet has matured, and the technology can extract and recognize the moving license plate from the complex background, through license plate extraction, image preprocessing, feature extraction, license plate characters. Identification and other techniques to identify vehicle grades.
  • This kind of license plate recognition technology is highly commercial, and mainstream license plate recognition manufacturers can achieve more than 90% recognition accuracy.
  • the active license plate recognition technology for bayonet has been unable to meet the needs of practical applications, in order to quickly correct traffic violations, quickly detect traffic accidents and escape and motor vehicle robbery.
  • the case is crucial for passive license plate recognition technology for moving vehicle license plate recognition.
  • the recognition rate of such technologies is still very low, and the measured indicators of mainstream manufacturers show that the correct rate is less than 80%.
  • the license plate recognition technology in the prior art faces new challenges with the development of urban traffic. Due to various uncontrollable factors in the environment of the vehicle, such as occlusion due to positional changes, image distortion, etc., the quality of the captured image such as the bayonet cannot be stably guaranteed, thereby affecting the accuracy of the license plate recognition.
  • an embodiment of the present invention provides a vehicle license plate recognition method and apparatus.
  • the accuracy of the vehicle license plate recognition can be improved under the condition that the image acquisition effect due to the external environment and the like cannot be stably ensured.
  • a vehicle license plate recognition method comprising the following steps:
  • the identification data of the license plate obtains the recognition result of the license plate.
  • the step of identifying the image frames of the plurality of consecutive positions of the license plate in the screen acquisition range and obtaining the identification data of the license plate in the plurality of consecutive positions respectively comprises:
  • the character recognition result is output as license plate identification data.
  • the method further includes:
  • All image frames between the first image frame and the second image frame are used as image frames of the license plate at a plurality of consecutive positions within the screen acquisition range.
  • the step of identifying the image frame of the license plate entering the screen acquisition range comprises:
  • the associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
  • the method further includes:
  • the step of using the one image frame as the first image frame is entered.
  • the step of identifying that the license plate leaves the second image frame of the screen acquisition range comprises:
  • the target image frame is used as the second image frame
  • the next target image frame of the current target image frame is used as the target image frame, and returns to determine the current target image.
  • the associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
  • the two phases The two license plates in the adjacent image frame are associated license plates.
  • an embodiment of the present invention provides a vehicle license plate recognition device, including:
  • a recognition data acquisition module configured to identify image frames of a plurality of consecutive positions of the license plate within the screen acquisition range; and obtain identification data of the license plate when the plurality of consecutive positions are respectively obtained;
  • the statistics module when the plurality of locations are counted, the identification data of the license plate is used to obtain the recognition result of the license plate.
  • the identification data acquisition module includes:
  • a character recognition unit configured to: position the license plate in an image frame to obtain a corresponding area of the license plate in the image frame, and parse a corresponding area of the license plate in the image frame to obtain a character recognition result of the license plate picture;
  • the license plate recognition data output unit is configured to output the character recognition result as license plate identification data.
  • the device further includes:
  • a first image frame identification module configured to identify a first image frame in which the license plate enters a screen acquisition range
  • a second image frame identification module configured to identify the second image frame of the license plate leaving the screen acquisition range
  • the image frame extraction module is configured to set all the image frames between the first image frame and the second image frame as image frames of the plurality of consecutive positions of the license plate within the image acquisition range.
  • the first image frame identification module includes:
  • a first association determining unit configured to determine whether an associated license plate exists in a consecutively set number of image frames of a license plate in an image frame;
  • a first determination result determining unit configured to determine that the license plate in the one image frame does not have an associated license plate in a consecutively set number of image frames in front of the license plate;
  • a first image frame determining unit configured to use the one image frame as a first image frame
  • the associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
  • the first image frame identification module further includes:
  • Unrecognized record association judging unit configured to determine whether the license plate in the one image frame has an associated license plate in the currently recorded unrecognized license plate set; and set to continuously set the license plate in the one image frame before The first image frame determining unit is triggered when there is no associated license plate in the number of image frames.
  • the second image frame identification module includes:
  • a target image frame determining unit configured to use the temporally adjacent image frame of the first image frame as a target image frame;
  • a second association determining unit configured to determine whether an associated license plate exists in a continuously set number of image frames of the license plate in the current target image frame;
  • a second image frame determining unit configured to determine that the target image frame is the second image frame when the license plate in the current target image frame does not have an associated license plate in a consecutively set number of image frames; In order to determine that the license plate in the current target image frame has an associated license plate in a consecutive set number of image frames, the next target image frame is used as the target image frame, and the second association is triggered.
  • the associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
  • the two phases The two license plates in the adjacent image frame are associated license plates.
  • the vehicle license plate recognition method and device provided by the embodiments of the present invention are directed to the problem that the license plate recognition result is adversely affected due to the unstable image acquisition condition in the actual application process, and the vehicle enters the screen.
  • the image frames of multiple positions appearing successively are processed to obtain the identification data, and the identification data is statistically obtained to obtain the license plate recognition result, thereby improving the accurate recognition of the license plate under the influence of environmental factors. Probability.
  • the vehicle license plate recognition method and apparatus according to the embodiment of the present invention can perform high-accuracy determination of the state in which the license plate enters and leaves the screen acquisition range by association recognition.
  • the license plate vehicle identification method and apparatus provided by the present invention and its embodiments are particularly suitable for a mobile vehicle to adapt to the current traffic development trend.
  • FIG. 1 is a schematic flow chart of a vehicle license plate recognition method according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of steps involved in recognizing a license plate before an image frame of a plurality of consecutive positions within a screen acquisition range according to an embodiment of the present invention
  • FIG. 3 is a schematic structural view of a vehicle license plate recognition device according to an embodiment of the present invention.
  • the embodiment of the invention firstly provides a vehicle license plate recognition method, which comprises the steps shown in FIG. 1 :
  • Step 101 Identify image frames of a plurality of consecutive positions of the license plate in the screen acquisition range; and obtain identification data of the license plate when the plurality of consecutive positions are respectively obtained;
  • Step 102 When the plurality of locations are counted, the identification data of the license plate obtains the recognition result of the license plate.
  • the vehicle license plate recognition method identifies an image frame of a plurality of consecutive positions within the screen acquisition range of the license plate and obtains corresponding license plate identification data, so that when the license plate is within the screen acquisition range.
  • the probability that the license plate cannot be recognized is reduced.
  • the license plate recognition error rate can be reduced and the recognition accuracy can be improved.
  • the image frames of the plurality of consecutive positions may be image frames that are continuously played in the video, or may be image frames that are acquired by the photographing device at consecutively set time intervals.
  • the license plate is in a plurality of consecutive positions within the screen acquisition range, and refers to a plurality of positions in which the license plate appears successively in a complete process of entering the screen acquisition range to leaving the screen acquisition range.
  • the step of identifying the image frames of the plurality of consecutive positions within the screen acquisition range of the license plate and obtaining the identification data of the license plate at the plurality of consecutive positions respectively comprises:
  • Step 1011 Positioning the license plate in an image frame to obtain a corresponding area of the license plate in the image frame, and parsing a corresponding area of the license plate in the image frame to obtain a character recognition result of the license plate picture;
  • Step 1012 Output the character recognition result as license plate identification data.
  • the step of parsing the corresponding area of the license plate in the image frame to obtain the character recognition result of the license plate picture may be implemented by the following steps 1031-1032:
  • Step 1031 Positioning the license plate in the currently read image frame.
  • the license plate positioning may be performed by combining the grayscale projection information and the texture information method of the license plate area. Firstly, the image is gray-scale transformed, and the edge image is generated by edge detection using Sobel operator. Then, the horizontal and vertical projection images of the edge image are calculated and the possible license plate area is determined according to the peak and valley information of the projected image. Finally, according to The license plate character area is rich in texture and further determines and cuts the possible license plate area to determine the final license plate area.
  • Step 1032 The license plate picture character is divided.
  • the task of character segmentation is to cut each character in the license plate image from the entire image into a single character.
  • Common methods of segmentation include projection-based segmentation, matching-based segmentation, and clustering-based segmentation.
  • the projection-based segmentation includes simple vertical projection segmentation, upper and lower edge projection segmentation, and the like.
  • the matching based segmentation includes template matching segmentation.
  • the cluster-based segmentation divides the characters in the license plate image according to the principle that the pixels belonging to the same character form a connected domain, and combines the prior knowledge of the license plate height and the fixed proportional relationship of the spacing.
  • the license plate acquisition image may be tilted to some extent due to problems such as the shooting angle, so the license plate image should be corrected.
  • the license plate rotation angle can be estimated according to the edge gradient information of the license plate region, and then the license plate is corrected to the horizontal state by affine transformation; then, the algorithm initially determines the license plate type according to the license plate background color, and combines the character region. The peak-to-valley information pair projected in the vertical direction separates each license plate character.
  • Step 1033 License plate character recognition.
  • features are extracted and identified for the characters segmented in step 1031.
  • Common features include direction line features, mesh features, gradient features, and the like.
  • Commonly used recognition methods include template matching method, linear discriminating method, SVM (Support Vector Machine) and so on.
  • the segmented character extraction direction line feature is used to identify the license plate characters: First, a common series of preprocessing operations including smoothing, contrast enhancement, position normalization, size normalization, and binarization , to obtain a normalized grayscale image or binarization map of size 64x64 pixels.
  • the character stroke linear feature is extracted, and the Mahalanobis distance between it and all the character template features to be recognized is calculated, and the character corresponding to the closest template feature is selected as the result of the character recognition.
  • the character recognition result can be statistically analyzed, that is, the recognition result with the highest probability of occurrence in the recognition result of the same character position of the license plate is selected as the recognition of the character position on the license plate. result. For example, by recognizing seven image frames of seven successive positions of the license plate within the screen acquisition range; and obtaining identification data of the license plate at the seven consecutive positions, respectively.
  • the identification data of the first to seventh image frames are: Beijing BEQ7C2, Beijing BF02C2, expensive BE0702, Yue BE07C2, Yue BF07C2, Yue BE07C2, Yue BE07C2, Yue BE07C2, Yue BE07C2.
  • the character recognition results of the seven character positions are respectively counted; if the first character position is identified as “Beijing” 2 times, the recognition as “expensive” has 1 time, and the recognition as “Yue” has 4 times, it is considered that The final recognition result of the position is “Yue”; similarly, the recognition results of the second to seventh character positions are: "B", “E”, “0”, "7", “C”, "2".
  • the plurality of recognition results are recorded for selection.
  • the process illustrated in FIG. 2 is also included:
  • Step 201 Identify that the license plate enters a first image frame of a screen acquisition range
  • Step 202 Identify that the license plate leaves the second image frame of the screen acquisition range
  • Step 203 Use all image frames between the first image frame and the second image frame as image frames of the plurality of consecutive positions in the screen acquisition range of the license plate.
  • the image frames acquired by the license plate belonging to the same vehicle entering the screen acquisition range and the exit screen acquisition range are used as the image frames of the license plate at a plurality of consecutive positions within the screen acquisition range. Tracking the license plate when it is in the screen acquisition range, to the greatest extent, ensuring that at least one image frame of the license plate can be used as an image object recognized by the license plate, and can overcome a certain frame or a certain number during the running of the vehicle.
  • the frame acquisition image can not identify or identify the wrong interference, and solves the problem that the image quality of the license plate acquisition image is difficult to be stabilized when the license plate recognition of the moving vehicle is simple and effective.
  • the step of identifying the license plate entering the image frame of the screen acquisition range comprises:
  • Step 2011 determining whether the license plate in an image frame has an associated license plate in a consecutively set number of image frames in front of the license plate;
  • Step 2012 determining that the license plate in the one image frame does not have an associated license plate in a consecutively set number of image frames in front of the license plate;
  • Step 2013 using the image frame as a first image frame
  • the associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
  • all license plate recognition results of the previous time series image frame are associated with all license plate recognition results of the current image frame frame, and the determination method is: if the previous timing is adjacent If the i-th license plate of the image frame and the j-th license plate similarity of the current image frame reach the set condition, it is considered that the i-th license plate of the preceding sequential adjacent image frame and the j-th license plate of the current image frame can be associated.
  • a license plate in the preceding adjacent time-series image frame does not have an associated license plate in the subsequent adjacent time-series image frame, the license plate is considered to be unrecognizable at present, and the license plate is added to the unrecognizable license plate set.
  • the image frame may be considered as the first image frame in which the license plate k enters the screen acquisition range.
  • the license plate m in an image frame, when there is no associated license plate in the preceding adjacent time-series image frame, it is possible that the license plate m is occluded in consecutive n-1 image frames in front of the image frame or Not being clearly captured, but appearing in the nth image frame before the image frame, then the image frame is the first image frame in which the license plate m enters the screen acquisition range and the second image frame in which the license plate m leaves the screen acquisition range. Image frame between.
  • step 2012 it also includes:
  • Step 2014 determining whether the license plate in the one image frame has an associated license plate in the currently recorded unrecognizable license plate set
  • Step 2015 When the license plate in the one image frame does not have an associated license plate in a consecutively set number of image frames, the process proceeds to step 2013.
  • the image frame may be considered as the license plate h leaving the screen.
  • the second image frame of the range In the actual processing, in some cases, for the license plate h in an image frame, if there is no associated license plate in the sequence of adjacent image frames behind the image frame, the image frame may be considered as the license plate h leaving the screen.
  • the second image frame of the range In the actual processing, in some cases, for the license plate h in an image frame, if there is no associated license plate in the sequence of adjacent image frames behind the image frame, the image frame may be considered as the license plate h leaving the screen.
  • the second image frame of the range In the actual processing, in some cases, for the license plate h in an image frame, if there is no associated license plate in the sequence of adjacent image frames behind the image frame, the image frame may be considered as the license plate h leaving the screen.
  • the second image frame of the range In the actual processing, in some cases, for the license plate h in an image frame, if there is no associated license plate in the sequence of adjacent image
  • the image frame is the first image frame in which the license plate g enters the screen acquisition range and the second image frame in which the license plate g leaves the screen acquisition range. Image frame between.
  • step 202 includes:
  • Step 2021 The subsequent image frame of the first image frame is used as the target image frame.
  • Step 2022 Determine whether the license plate in the current target image frame has an associated license plate in a consecutively set number of image frames behind it;
  • Step 2023 Determine that the target image frame is used as the second image frame when the license plate in the current target image frame does not have an associated license plate in a consecutively set number of image frames.
  • Step 2024 When it is determined that the license plate in the current target image frame has an associated license plate in a consecutive set number of image frames, the next target image frame of the current target image frame is used as the target image frame; and the judgment is returned. a step of whether the license plate in the current target image frame has an associated license plate in a continuously set number of image frames behind it;
  • the associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
  • the license plate for a certain image frame, if a certain license plate in the preceding adjacent time-series image frame does not have an associated license plate in a subsequent adjacent time-series image frame, the license plate is considered to be unrecognizable at present. And add the license plate to the unrecognizable license plate collection.
  • the above step 2022 can be implemented by the following process:
  • Step 301 Determine whether the license plate in the current target image frame has an associated license plate in the first image frame behind it. If not, add the license plate to the unrecognizable license plate set, record the number of unrecognizable numbers as 1, and proceed to the next step. If yes, proceed to step 2024 above.
  • Step 302 Determine whether the unrecognized number of times reaches the set value, and if yes, proceed to step 2023; if not, proceed to the next step.
  • Step 303 Determine whether the associated license plate exists in the next image frame of the license plate in the current target image frame. If not, increase the number of unrecognized times by one, and return to step 302; if yes, proceed to step 2024.
  • the distance between the center point of the area where the a-th license plate of the last processing frame and the b-th license plate of the current processing frame are located is less than 1/4 of the diagonal length of the image, and no less than 5 characters are recognized. Similarly, we believe that the a-th license plate of the previous processing frame and the b-th license plate of the current processing frame can be associated.
  • the vehicle license plate recognition method provided by the present invention and the embodiments thereof can solve the problem that the recognition result is inaccurate or the recognition result cannot be generated due to insufficient clarity or occlusion of the captured image frame of the vehicle. . At the same time, the accuracy of recognition has been improved.
  • an embodiment of the present invention provides a vehicle license plate recognition device, and the structure is as shown in FIG. 3, including:
  • a recognition data acquisition module configured to identify image frames of a plurality of consecutive positions of the license plate within the screen acquisition range; and obtain identification data of the license plate when the plurality of consecutive positions are respectively obtained;
  • the statistics module when the plurality of locations are counted, the identification data of the license plate is used to obtain the recognition result of the license plate.
  • the identification data acquisition module includes:
  • a character recognition unit configured to: position the license plate in an image frame to obtain a corresponding area of the license plate in the image frame, and parse a corresponding area of the license plate in the image frame to obtain a character recognition result of the license plate picture;
  • the license plate recognition data output unit is configured to output the character recognition result as license plate identification data.
  • the apparatus further includes:
  • a first image frame identification module configured to identify a first image frame in which the license plate enters a screen acquisition range
  • a second image frame identification module configured to identify the second image frame of the license plate leaving the screen acquisition range
  • the image frame extraction module is configured to set all the image frames between the first image frame and the second image frame as image frames of the plurality of consecutive positions of the license plate within the image acquisition range.
  • the first image frame identification module includes:
  • a first association determining unit configured to determine whether an associated license plate exists in a consecutively set number of image frames of a license plate in an image frame;
  • a first determination result determining unit configured to determine that the license plate in the one image frame does not have an associated license plate in a consecutively set number of image frames in front of the license plate;
  • a first image frame determining unit configured to use the one image frame as a first image frame
  • the associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
  • the first image frame identification module further includes:
  • Unrecognized record association judging unit configured to determine whether the license plate in the one image frame has an associated license plate in the currently recorded unrecognized license plate set; and set to continuously set the license plate in the one image frame before The first image frame determining unit is triggered when there is no associated license plate in the number of image frames.
  • the second image frame identification module includes:
  • a target image frame determining unit configured to use the temporally adjacent image frame of the first image frame as a target image frame;
  • a second association determining unit configured to determine whether an associated license plate exists in a continuously set number of image frames of the license plate in the current target image frame;
  • a second image frame determining unit configured to determine that the target image frame is the second image frame when the license plate in the current target image frame does not have an associated license plate in a consecutively set number of image frames; In order to determine that the license plate in the current target image frame has an associated license plate in a consecutive set number of image frames, the next target image frame is used as the target image frame, and the second association is triggered.
  • the associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
  • the vehicle license plate recognition method and device provided by the embodiments of the present invention are directed to the problem that the license plate recognition result is adversely affected due to the unstable image acquisition condition in the actual application process, and the vehicle enters the screen.
  • the image frames of multiple positions appearing successively are processed to obtain the identification data, and the identification data is statistically obtained to obtain the license plate recognition result, thereby improving the accurate recognition of the license plate under the influence of environmental factors. Probability.
  • the vehicle license plate recognition method and apparatus according to the embodiment of the present invention can perform high-accuracy determination of the state in which the license plate enters and leaves the screen acquisition range by association recognition.
  • the vehicle license plate recognition method and apparatus can perform high-accuracy determination of the state in which the license plate enters and leaves the screen acquisition range by association recognition.
  • the license plate vehicle identification method and apparatus provided by the present invention and its embodiments are particularly suitable for a mobile vehicle to adapt to the current traffic development trend.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Traffic Control Systems (AREA)
  • Character Discrimination (AREA)
  • Image Analysis (AREA)

Abstract

A method and device for recognizing a license plate of a vehicle. The method comprises the steps of: recognizing image frames of a license plate in a plurality of continuous positions within a picture acquisition range; and respectively obtaining recognition data of the license plate in the plurality of continuous positions; and making statistics about the recognition data of the license plate in the plurality of continuous positions, to obtain a recognition result of the license plate. The device comprises: a recognition data acquisition module configured to recognize image frames of a license plate in a plurality of continuous positions within a picture acquisition range; and respectively obtain recognition data of the license plate in the plurality of continuous positions; and a statistics module configured to count the recognition data of the license plate in the plurality of positions, to obtain a recognition result of the license plate. The method and device can increase the accuracy of license plate recognition for a vehicle in the case where an image collection effect cannot be stably guaranteed due to external environment and other reasons.

Description

一种车辆车牌识别方法及装置Vehicle license plate recognition method and device 技术领域Technical field
本发明涉及图像技术领域,尤其涉及一种车辆车牌识别方法及装置。The present invention relates to the field of image technologies, and in particular, to a vehicle license plate recognition method and apparatus.
背景技术Background technique
随着人们生活发展和科技进步,车牌识别逐渐成为智能交通系统的一个重要组成部分。现有技术中,用于卡口的主动式车牌识别技术已趋成熟,该技术能够将运动中的汽车牌照从复杂背景中提取并识别出来,通过车牌提取、图像预处理、特征提取、车牌字符识别等技术,识别车辆牌号。这种车牌识别技术商用程度高,主流车牌识别厂家均能取得90%以上识别正确率。但随着城市车流量的不断增加,交通状况复杂化,用于卡口的主动式车牌识别技术已不能满足实际应用的需要,为快速纠正交通违法行为、快速侦破交通肇事逃逸和机动车盗抢案件,对于移动车辆车牌识别的被动式车牌识别技术显得至关重要。然后受诸多因素的影响,目前这类技术的识别率还很低,主流厂家实测指标显示正确率尚不足80%。With people's life development and technological advancement, license plate recognition has gradually become an important part of the intelligent transportation system. In the prior art, the active license plate recognition technology for the bayonet has matured, and the technology can extract and recognize the moving license plate from the complex background, through license plate extraction, image preprocessing, feature extraction, license plate characters. Identification and other techniques to identify vehicle grades. This kind of license plate recognition technology is highly commercial, and mainstream license plate recognition manufacturers can achieve more than 90% recognition accuracy. However, with the continuous increase of traffic volume in the city and complicated traffic conditions, the active license plate recognition technology for bayonet has been unable to meet the needs of practical applications, in order to quickly correct traffic violations, quickly detect traffic accidents and escape and motor vehicle robbery. The case is crucial for passive license plate recognition technology for moving vehicle license plate recognition. Then, influenced by many factors, the recognition rate of such technologies is still very low, and the measured indicators of mainstream manufacturers show that the correct rate is less than 80%.
现有技术中的车牌识别技术随着城市交通的发展面临新的挑战。由于车辆所处环境中存在多种不可控的因素,如由于位置变化而出现的遮挡、图像失真等,导致卡口等采集图像的质量无法稳定保证,从而影响了车牌识别的准确度。The license plate recognition technology in the prior art faces new challenges with the development of urban traffic. Due to various uncontrollable factors in the environment of the vehicle, such as occlusion due to positional changes, image distortion, etc., the quality of the captured image such as the bayonet cannot be stably guaranteed, thereby affecting the accuracy of the license plate recognition.
发明内容Summary of the invention
有鉴于此,本发明实施例提供一种车辆车牌识别方法及装置。能够在由于外界环境等原因导致的图像采集效果无法稳定保证的情况下,提高车辆车牌识别的精度。In view of this, an embodiment of the present invention provides a vehicle license plate recognition method and apparatus. The accuracy of the vehicle license plate recognition can be improved under the condition that the image acquisition effect due to the external environment and the like cannot be stably ensured.
基于上述目的本发明实施例提供的一种车辆车牌识别方法,包括如下步骤:A vehicle license plate recognition method according to an embodiment of the present invention, comprising the following steps:
识别车牌在画面获取范围内多个连续位置的图像帧;并分别获得在所述多个连续位置时,所述车牌的识别数据;Identifying image frames of the plurality of consecutive positions of the license plate in the screen acquisition range; and obtaining identification data of the license plate when the plurality of consecutive positions are respectively obtained;
统计所述多个位置时,所述车牌的识别数据,得到所述车牌的识别结果。When the plurality of locations are counted, the identification data of the license plate obtains the recognition result of the license plate.
可选地,识别车牌在画面获取范围内多个连续位置的图像帧、并分别获得在所述多个连续位置时所述车牌的识别数据的步骤包括: Optionally, the step of identifying the image frames of the plurality of consecutive positions of the license plate in the screen acquisition range and obtaining the identification data of the license plate in the plurality of consecutive positions respectively comprises:
在图像帧中对所述车牌进行定位以获得图像帧中所述车牌的对应区域,并解析图像帧中所述车牌的对应区域以获得车牌图片的字符识别结果;Positioning the license plate in an image frame to obtain a corresponding area of the license plate in the image frame, and parsing a corresponding area of the license plate in the image frame to obtain a character recognition result of the license plate picture;
将所述字符识别结果作为车牌识别数据输出。The character recognition result is output as license plate identification data.
可选地,识别车牌在画面获取范围内多个位置的图像帧、并分别获得在多个位置时的车牌识别数据之前,还包括:Optionally, before identifying the image frames of the plurality of locations within the screen acquisition range and obtaining the license plate identification data when the plurality of locations are respectively obtained, the method further includes:
识别所述车牌进入画面获取范围的第一图像帧;Identifying the first image frame of the license plate entering a screen acquisition range;
识别所述车牌离开画面获取范围的第二图像帧;Recognizing that the license plate leaves the second image frame of the screen acquisition range;
将所述第一图像帧和第二图像帧之间的所有图像帧作为所述车牌在画面获取范围内多个连续位置的图像帧。All image frames between the first image frame and the second image frame are used as image frames of the license plate at a plurality of consecutive positions within the screen acquisition range.
可选地,识别车牌进入画面获取范围的图像帧的步骤包括:Optionally, the step of identifying the image frame of the license plate entering the screen acquisition range comprises:
判断一个图像帧中的车牌在其前面连续设定数目的图像帧中是否存在关联车牌;Determining whether a license plate in an image frame has an associated license plate in a consecutively set number of image frames in front of it;
确定所述一个图像帧中的车牌在其前面连续设定数目的图像帧中不存在关联车牌;Determining that the license plate in the one image frame does not have an associated license plate in a consecutively set number of image frames in front of the license plate;
将所述一个图像帧作为第一图像帧;Taking the one image frame as a first image frame;
所述关联车牌,指的是分别出现于两个相邻图像帧中、相似度大于等于设定值的车牌。The associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
可选地,确定所述一个图像帧中的车牌在其前面连续设定数目的图像帧中不存在关联车牌之后,还包括:Optionally, after determining that the license plate in the one image frame does not have an associated license plate in a consecutively set number of image frames in front of the image frame, the method further includes:
判断所述一个图像帧中的车牌在当前记录的无法识别车牌集合中是否存在关联车牌;Determining whether the license plate in the one image frame has an associated license plate in the currently recorded unrecognized license plate set;
当所述一个图像帧中的车牌在其前连续设定数目的图像帧中不存在关联车牌时,进入将所述一个图像帧作为第一图像帧的步骤。When the license plate in the one image frame does not have an associated license plate in a consecutively set number of image frames, the step of using the one image frame as the first image frame is entered.
可选地,识别所述车牌离开画面获取范围的第二图像帧的步骤包括:Optionally, the step of identifying that the license plate leaves the second image frame of the screen acquisition range comprises:
将所述第一图像帧后一时序相邻图像帧作为目标图像帧; And adopting the first image frame and the subsequent time-series adjacent image frame as the target image frame;
判断当前目标图像帧中的车牌在其后面连续设定数目的图像帧中是否存在关联车牌;Determining whether the license plate in the current target image frame has an associated license plate in a continuously set number of image frames behind it;
确定所述当前目标图像帧中的车牌在其后面连续设定数目的图像帧中不存在关联车牌时,将所述目标图像帧作为第二图像帧;Determining, when the license plate in the current target image frame does not have an associated license plate in a consecutively set number of image frames, the target image frame is used as the second image frame;
确定所述当前目标图像帧中的车牌在其后面连续的设定数目的图像帧中存在关联车牌时,将当前目标图像帧后一时序相邻图像帧作为目标图像帧,并返回判断当前目标图像帧中的车牌在其后面连续设定数目的图像帧中是否存在关联车牌的步骤;Determining that, when the license plate in the current target image frame has an associated license plate in a consecutive set number of image frames, the next target image frame of the current target image frame is used as the target image frame, and returns to determine the current target image. The step of whether the license plate in the frame has an associated license plate in a consecutive number of image frames behind it;
所述关联车牌,指的是分别出现于两个相邻图像帧中、相似度大于等于设定值的车牌。The associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
可选地,当分别出现于两个相邻图像帧中的两个车牌所在区域中心距离小于设定的距离阈值且车牌字符识别结果相似比例大于设定的相似比例阈值时,所述两个相邻图像帧中的两个车牌为关联车牌。Optionally, when the distance between the center of the two license plates respectively appearing in two adjacent image frames is less than the set distance threshold and the similarity ratio of the license plate character recognition result is greater than the set similarity ratio threshold, the two phases The two license plates in the adjacent image frame are associated license plates.
进一步,本发明实施例提供一种车辆车牌识别装置,包括:Further, an embodiment of the present invention provides a vehicle license plate recognition device, including:
识别数据获取模块:设置为识别车牌在画面获取范围内多个连续位置的图像帧;并分别获得在所述多个连续位置时,所述车牌的识别数据;a recognition data acquisition module: configured to identify image frames of a plurality of consecutive positions of the license plate within the screen acquisition range; and obtain identification data of the license plate when the plurality of consecutive positions are respectively obtained;
统计模块:设置为统计所述多个位置时,所述车牌的识别数据,得到所述车牌的识别结果。The statistics module: when the plurality of locations are counted, the identification data of the license plate is used to obtain the recognition result of the license plate.
可选地,识别数据获取模块包括:Optionally, the identification data acquisition module includes:
字符识别单元:设置为在图像帧中对所述车牌进行定位以获得图像帧中所述车牌的对应区域,并解析图像帧中所述车牌的对应区域以获得车牌图片的字符识别结果;a character recognition unit configured to: position the license plate in an image frame to obtain a corresponding area of the license plate in the image frame, and parse a corresponding area of the license plate in the image frame to obtain a character recognition result of the license plate picture;
车牌识别数据输出单元:设置为将所述字符识别结果作为车牌识别数据输出。The license plate recognition data output unit is configured to output the character recognition result as license plate identification data.
可选地,所述装置还包括:Optionally, the device further includes:
第一图像帧识别模块:设置为识别所述车牌进入画面获取范围的第一图像帧;a first image frame identification module: configured to identify a first image frame in which the license plate enters a screen acquisition range;
第二图像帧识别模块:设置为识别所述车牌离开画面获取范围的第二图像帧;a second image frame identification module: configured to identify the second image frame of the license plate leaving the screen acquisition range;
图像帧提取模块:设置为将所述第一图像帧和第二图像帧之间的所有图像帧作为所述车牌在画面获取范围内多个连续位置的图像帧。 The image frame extraction module is configured to set all the image frames between the first image frame and the second image frame as image frames of the plurality of consecutive positions of the license plate within the image acquisition range.
可选地,第一图像帧识别模块包括:Optionally, the first image frame identification module includes:
第一关联判断单元:设置为判断一个图像帧中的车牌在其前面连续设定数目的图像帧中是否存在关联车牌;a first association determining unit: configured to determine whether an associated license plate exists in a consecutively set number of image frames of a license plate in an image frame;
第一判断结果确定单元:设置为确定所述一个图像帧中的车牌在其前面连续设定数目的图像帧中不存在关联车牌;a first determination result determining unit: configured to determine that the license plate in the one image frame does not have an associated license plate in a consecutively set number of image frames in front of the license plate;
第一图像帧确定单元:设置为将所述一个图像帧作为第一图像帧;a first image frame determining unit: configured to use the one image frame as a first image frame;
所述关联车牌,指的是分别出现于两个相邻图像帧中、相似度大于等于设定值的车牌。The associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
可选地,所述第一图像帧识别模块还包括:Optionally, the first image frame identification module further includes:
无法识别记录关联判断单元:设置为判断所述一个图像帧中的车牌在当前记录的无法识别车牌集合中是否存在关联车牌;并设置为当所述一个图像帧中的车牌在其前连续设定数目的图像帧中不存在关联车牌时,触发第一图像帧确定单元。Unrecognized record association judging unit: configured to determine whether the license plate in the one image frame has an associated license plate in the currently recorded unrecognized license plate set; and set to continuously set the license plate in the one image frame before The first image frame determining unit is triggered when there is no associated license plate in the number of image frames.
可选地,第二图像帧识别模块包括:Optionally, the second image frame identification module includes:
目标图像帧确定单元:设置为将所述第一图像帧后一时序相邻图像帧作为目标图像帧;a target image frame determining unit: configured to use the temporally adjacent image frame of the first image frame as a target image frame;
第二关联判断单元:设置为判断当前目标图像帧中的车牌在其后面连续设定数目的图像帧中是否存在关联车牌;a second association determining unit: configured to determine whether an associated license plate exists in a continuously set number of image frames of the license plate in the current target image frame;
第二图像帧确定单元:设置为确定所述当前目标图像帧中的车牌在其后面连续设定数目的图像帧中不存在关联车牌时,将所述目标图像帧作为第二图像帧;并设置为当确定所述当前目标图像帧中的车牌在其后面连续的设定数目的图像帧中存在关联车牌时,将当前目标图像帧后一时序相邻图像帧作为目标图像帧,触发第二关联判断单元;a second image frame determining unit: configured to determine that the target image frame is the second image frame when the license plate in the current target image frame does not have an associated license plate in a consecutively set number of image frames; In order to determine that the license plate in the current target image frame has an associated license plate in a consecutive set number of image frames, the next target image frame is used as the target image frame, and the second association is triggered. Judging unit
所述关联车牌,指的是分别出现于两个相邻图像帧中、相似度大于等于设定值的车牌。The associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
可选地,当分别出现于两个相邻图像帧中的两个车牌所在区域中心距离小于设定的距离阈值且车牌字符识别结果相似比例大于设定的相似比例阈值时,所述两个相邻图像帧中的两个车牌为关联车牌。 Optionally, when the distance between the center of the two license plates respectively appearing in two adjacent image frames is less than the set distance threshold and the similarity ratio of the license plate character recognition result is greater than the set similarity ratio threshold, the two phases The two license plates in the adjacent image frame are associated license plates.
从上面所述可以看出,本发明实施例提供的车辆车牌识别方法及装置,针对因在实际应用过程中车辆图片采集状况不稳定而导致车牌识别结果受到不良影响的问题,对车辆在进入画面获取范围的连续过程中,先后出现的多个位置的图像帧进行处理得到识别数据,并对这些识别数据进行统计,得到车牌识别结果,提高了在环境因素影响下,对车牌进行较为准确识别的概率。本发明实施例的车辆车牌识别方法及装置,通过关联识别,能够对车牌进入和离开画面获取范围的状态进行高准确度的判断。本发明及其实施例所提供的车牌车辆识别方法和装置,尤其适用于移动的车辆,适应如今的交通发展趋势。It can be seen from the above that the vehicle license plate recognition method and device provided by the embodiments of the present invention are directed to the problem that the license plate recognition result is adversely affected due to the unstable image acquisition condition in the actual application process, and the vehicle enters the screen. In the continuous process of obtaining the range, the image frames of multiple positions appearing successively are processed to obtain the identification data, and the identification data is statistically obtained to obtain the license plate recognition result, thereby improving the accurate recognition of the license plate under the influence of environmental factors. Probability. The vehicle license plate recognition method and apparatus according to the embodiment of the present invention can perform high-accuracy determination of the state in which the license plate enters and leaves the screen acquisition range by association recognition. The license plate vehicle identification method and apparatus provided by the present invention and its embodiments are particularly suitable for a mobile vehicle to adapt to the current traffic development trend.
附图说明DRAWINGS
图1为本发明实施例的车辆车牌识别方法流程示意图;1 is a schematic flow chart of a vehicle license plate recognition method according to an embodiment of the present invention;
图2为本发明一种实施例中,识别车牌在画面获取范围内多个连续位置的图像帧之前所包含的步骤示意图;2 is a schematic diagram of steps involved in recognizing a license plate before an image frame of a plurality of consecutive positions within a screen acquisition range according to an embodiment of the present invention;
图3为本发明一种实施例的车辆车牌识别装置结构示意图。3 is a schematic structural view of a vehicle license plate recognition device according to an embodiment of the present invention.
具体实施方式detailed description
为了给出有效的实现方案,本发明提供了下述实施例,以下结合说明书附图对本发明实施例进行说明。In order to provide an effective implementation, the present invention provides the following embodiments, which are described below in conjunction with the accompanying drawings.
本发明实施例首先提供一种车辆车牌识别方法,包括如图1所示的步骤:The embodiment of the invention firstly provides a vehicle license plate recognition method, which comprises the steps shown in FIG. 1 :
步骤101:识别车牌在画面获取范围内多个连续位置的图像帧;并分别获得在所述多个连续位置时,所述车牌的识别数据;Step 101: Identify image frames of a plurality of consecutive positions of the license plate in the screen acquisition range; and obtain identification data of the license plate when the plurality of consecutive positions are respectively obtained;
步骤102:统计所述多个位置时,所述车牌的识别数据,得到所述车牌的识别结果。Step 102: When the plurality of locations are counted, the identification data of the license plate obtains the recognition result of the license plate.
从上面所述可以看出,本发明实施例所提供的车辆车牌识别方法,识别车牌在画面获取范围内多个连续位置的图像帧并获得相应车牌识别数据,从而当车牌在画面获取范围内的大部分图像帧中被遮挡、或者由于其它原因导致车牌在画面获取范围内大部分图像帧无法识别时,降低车牌无法识别的概率。此外,通过统计多个位置时的车牌识别数据,可降低车牌识别错误率,提高识别精度。 As can be seen from the above, the vehicle license plate recognition method provided by the embodiment of the present invention identifies an image frame of a plurality of consecutive positions within the screen acquisition range of the license plate and obtains corresponding license plate identification data, so that when the license plate is within the screen acquisition range. When most of the image frames are occluded, or for other reasons, most of the image frames in the image acquisition range are not recognized, the probability that the license plate cannot be recognized is reduced. In addition, by counting the license plate identification data at multiple locations, the license plate recognition error rate can be reduced and the recognition accuracy can be improved.
所述多个连续位置的图像帧,可从是视频中连续播放的图像帧,也可以是在连续设定时间间隔通过拍照装置获取的图像帧。The image frames of the plurality of consecutive positions may be image frames that are continuously played in the video, or may be image frames that are acquired by the photographing device at consecutively set time intervals.
在本发明实施例中,所述车牌在画面获取范围内多个连续位置,指车牌在进入画面获取范围到离开画面获取范围的一个完整过程中,先后出现的多个位置。In the embodiment of the present invention, the license plate is in a plurality of consecutive positions within the screen acquisition range, and refers to a plurality of positions in which the license plate appears successively in a complete process of entering the screen acquisition range to leaving the screen acquisition range.
在本发明一些较佳实施例中,识别车牌在画面获取范围内多个连续位置的图像帧、并分别获得在所述多个连续位置时所述车牌的识别数据的步骤包括:In some preferred embodiments of the present invention, the step of identifying the image frames of the plurality of consecutive positions within the screen acquisition range of the license plate and obtaining the identification data of the license plate at the plurality of consecutive positions respectively comprises:
步骤1011:在图像帧中对所述车牌进行定位以获得图像帧中所述车牌的对应区域,并解析图像帧中所述车牌的对应区域以获得车牌图片的字符识别结果;Step 1011: Positioning the license plate in an image frame to obtain a corresponding area of the license plate in the image frame, and parsing a corresponding area of the license plate in the image frame to obtain a character recognition result of the license plate picture;
步骤1012:将所述字符识别结果作为车牌识别数据输出。Step 1012: Output the character recognition result as license plate identification data.
当所述图像帧来自视频时,读入一个解码后的视频图像帧,然后按照步骤1011对该图像帧进行处理。When the image frame is from a video, a decoded video image frame is read in, and then the image frame is processed in accordance with step 1011.
在本发明一些实施例中,上述步骤1011中,解析图像帧中所述车牌的对应区域以获得车牌图片的字符识别结果的步骤可通过下述步骤1031-1032实现:In some embodiments of the present invention, in the above step 1011, the step of parsing the corresponding area of the license plate in the image frame to obtain the character recognition result of the license plate picture may be implemented by the following steps 1031-1032:
步骤1031:对车牌在当前读取的图像帧中的位置进行定位。Step 1031: Positioning the license plate in the currently read image frame.
可选地,可采用结合灰度图投影信息和车牌所在区域纹理信息方法进行车牌定位。首先,对图像进行灰度变换,并采用Sobel算子对图像进行边缘检测生成边缘图像,然后,计算边缘图像的水平垂直投影图像并根据投影图像的波峰波谷信息确定可能的车牌区域,最后,根据车牌字符区域纹理丰富的特点,对可能的车牌区域进行进一步判定和裁剪,确定最终的车牌区域。Alternatively, the license plate positioning may be performed by combining the grayscale projection information and the texture information method of the license plate area. Firstly, the image is gray-scale transformed, and the edge image is generated by edge detection using Sobel operator. Then, the horizontal and vertical projection images of the edge image are calculated and the possible license plate area is determined according to the peak and valley information of the projected image. Finally, according to The license plate character area is rich in texture and further determines and cuts the possible license plate area to determine the final license plate area.
步骤1032:车牌图片字符分割。Step 1032: The license plate picture character is divided.
字符切分的任务是把车牌图像中的每个字符从整个图像中切割出来成为单个字符。常用方法分割方法有:基于投影的分割、基于匹配的分割和基于聚类分析的分割等等。The task of character segmentation is to cut each character in the license plate image from the entire image into a single character. Common methods of segmentation include projection-based segmentation, matching-based segmentation, and clustering-based segmentation.
所述基于投影的分割包括简单垂直投影分割、上下边缘投影分割等。The projection-based segmentation includes simple vertical projection segmentation, upper and lower edge projection segmentation, and the like.
所述基于匹配的分割包括模板匹配法分割。 The matching based segmentation includes template matching segmentation.
所述基于聚类的分割按照属于同一个字符的像素构成一个连通域的原则,再结合牌照字符高度、间距的固定比例关系等先验知识,来分割车牌图像中的字符。The cluster-based segmentation divides the characters in the license plate image according to the principle that the pixels belonging to the same character form a connected domain, and combines the prior knowledge of the license plate height and the fixed proportional relationship of the spacing.
执行步骤1032时,首先,由于拍摄角度等问题,车牌采集图像可能存在一定程度倾斜,所以应对车牌图像进行校正。在一种具体实施例中,可根据车牌区域边缘梯度信息估计出车牌旋转角度,进而通过仿射变换将车牌校正至水平状态;然后,本算法根据车牌底色初步确定车牌类型,并结合字符区域在垂直方向投影的波峰波谷信息对分割出各个车牌字符。When step 1032 is executed, first, the license plate acquisition image may be tilted to some extent due to problems such as the shooting angle, so the license plate image should be corrected. In a specific embodiment, the license plate rotation angle can be estimated according to the edge gradient information of the license plate region, and then the license plate is corrected to the horizontal state by affine transformation; then, the algorithm initially determines the license plate type according to the license plate background color, and combines the character region. The peak-to-valley information pair projected in the vertical direction separates each license plate character.
步骤1033:车牌字符识别。Step 1033: License plate character recognition.
在上述步骤1033中,对步骤1031中分割的字符提取特征并进行识别,常用特征包括方向线素特征、网格特征、梯度特征等等。常用识别方法包括模板匹配方法、线性判别方法、SVM(Support Vector Machine支撑向量机方法)等等。In the above step 1033, features are extracted and identified for the characters segmented in step 1031. Common features include direction line features, mesh features, gradient features, and the like. Commonly used recognition methods include template matching method, linear discriminating method, SVM (Support Vector Machine) and so on.
在一种具体实施例中,对分割的字符提取方向线素特征对车牌字符进行识别:首先,通用一系列的预处理操作包括平滑处理、对比度加强、位置规范化、大小归一化和二值化,得到大小为64x64象素的规范化灰度图或二值化图。本实施例提取字符笔画线素特征,并计算其与所有待识别字符模板特征之间的马氏距离,选择距离最近的模板特征对应的字符作为字符识别的结果。In a specific embodiment, the segmented character extraction direction line feature is used to identify the license plate characters: First, a common series of preprocessing operations including smoothing, contrast enhancement, position normalization, size normalization, and binarization , to obtain a normalized grayscale image or binarization map of size 64x64 pixels. In this embodiment, the character stroke linear feature is extracted, and the Mahalanobis distance between it and all the character template features to be recognized is calculated, and the character corresponding to the closest template feature is selected as the result of the character recognition.
将所述字符识别结果作为车牌识别数据输出之后,即可对所述字符识别结果进行统计分析,即选择车牌同一字符位置的识别结果中出现概率最高的识别结果,作为车牌上该字符位置的识别结果。例如,通过识别车牌在画面获取范围内七个连续位置的七个图像帧;并分别获得在所述七个连续位置时,所述车牌的识别数据。第一至第七图像帧的识别数据为:京BEQ7C2、京BF02C2、贵BE0702、粤BE07C2、粤BF07C2、粤BE07C2、粤BE07C2、粤BE07C2。分别对七个字符位置的字符识别结果进行统计;则对于第一字符位置,识别为“京”有2次,识别为“贵”有1次,识别为“粤”有4次,则认为该位置最终识别结果为“粤”;同理,第二至第七字符位置的识别结果依次为:“B”、“E”、“0”、“7”、“C”、“2”。After the character recognition result is output as the license plate identification data, the character recognition result can be statistically analyzed, that is, the recognition result with the highest probability of occurrence in the recognition result of the same character position of the license plate is selected as the recognition of the character position on the license plate. result. For example, by recognizing seven image frames of seven successive positions of the license plate within the screen acquisition range; and obtaining identification data of the license plate at the seven consecutive positions, respectively. The identification data of the first to seventh image frames are: Beijing BEQ7C2, Beijing BF02C2, expensive BE0702, Yue BE07C2, Yue BF07C2, Yue BE07C2, Yue BE07C2, Yue BE07C2. The character recognition results of the seven character positions are respectively counted; if the first character position is identified as "Beijing" 2 times, the recognition as "expensive" has 1 time, and the recognition as "Yue" has 4 times, it is considered that The final recognition result of the position is "Yue"; similarly, the recognition results of the second to seventh character positions are: "B", "E", "0", "7", "C", "2".
在优选实施例中,若同一字符位置存在多个出现概率最高的识别结果,则将这多个识别结果都予以记录,以备选择。In a preferred embodiment, if there are multiple recognition results with the highest probability of occurrence in the same character position, the plurality of recognition results are recorded for selection.
在本发明的一些实施例中,识别车牌在画面获取范围内多个位置的图像帧、并分别获得在多个位置时的车牌识别数据之前,还包括图2所示的过程: In some embodiments of the present invention, prior to identifying the image frames of the plurality of locations within the screen acquisition range and obtaining the license plate identification data at the plurality of locations, the process illustrated in FIG. 2 is also included:
步骤201:识别所述车牌进入画面获取范围的第一图像帧;Step 201: Identify that the license plate enters a first image frame of a screen acquisition range;
步骤202:识别所述车牌离开画面获取范围的第二图像帧;Step 202: Identify that the license plate leaves the second image frame of the screen acquisition range;
步骤203:将所述第一图像帧和第二图像帧之间的所有图像帧作为所述车牌在画面获取范围内多个连续位置的图像帧。Step 203: Use all image frames between the first image frame and the second image frame as image frames of the plurality of consecutive positions in the screen acquisition range of the license plate.
在本发明上述实施例中,将属于同一辆车的车牌进入画面获取范围和离开画面获取范围的一个整个过程中所获取的图像帧作为所述车牌在画面获取范围内多个连续位置的图像帧,在所述车牌处于画面获取范围时对其进行跟踪,在最大程度上保证了至少由一张该车牌的图像帧能够作为车牌识别的图像对象,能克服车辆运行过程中某一帧或某几帧采集图像无法识别或识别错误的干扰,简单有效的解决了移动车辆车牌识别时车牌采集图像质量难以稳定保证的问题。In the above embodiment of the present invention, the image frames acquired by the license plate belonging to the same vehicle entering the screen acquisition range and the exit screen acquisition range are used as the image frames of the license plate at a plurality of consecutive positions within the screen acquisition range. Tracking the license plate when it is in the screen acquisition range, to the greatest extent, ensuring that at least one image frame of the license plate can be used as an image object recognized by the license plate, and can overcome a certain frame or a certain number during the running of the vehicle. The frame acquisition image can not identify or identify the wrong interference, and solves the problem that the image quality of the license plate acquisition image is difficult to be stabilized when the license plate recognition of the moving vehicle is simple and effective.
在本发明一些实施例中,识别车牌进入画面获取范围的图像帧的步骤包括:In some embodiments of the invention, the step of identifying the license plate entering the image frame of the screen acquisition range comprises:
步骤2011:判断一个图像帧中的车牌在其前面连续设定数目的图像帧中是否存在关联车牌;Step 2011: determining whether the license plate in an image frame has an associated license plate in a consecutively set number of image frames in front of the license plate;
步骤2012:确定所述一个图像帧中的车牌在其前面连续设定数目的图像帧中不存在关联车牌;Step 2012: determining that the license plate in the one image frame does not have an associated license plate in a consecutively set number of image frames in front of the license plate;
步骤2013:将所述一个图像帧作为第一图像帧;Step 2013: using the image frame as a first image frame;
所述关联车牌,指的是分别出现于两个相邻图像帧中、相似度大于等于设定值的车牌。The associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
在本发明一种具体实施例中,处理每一帧图像时,将前面时序图像帧所有车牌识别结果与当前图像帧帧所有车牌识别结果一一进行关联判断,判断方法为:如果前面时序相邻图像帧第i个车牌和当前图像帧第j个车牌相似度达到设定的条件,则认为前面时序相邻图像帧第i个车牌和当前图像帧第j个车牌能够关联。In a specific embodiment of the present invention, when processing each frame image, all license plate recognition results of the previous time series image frame are associated with all license plate recognition results of the current image frame frame, and the determination method is: if the previous timing is adjacent If the i-th license plate of the image frame and the j-th license plate similarity of the current image frame reach the set condition, it is considered that the i-th license plate of the preceding sequential adjacent image frame and the j-th license plate of the current image frame can be associated.
初始化状态下,第一个图像帧前面时序图像帧所有车牌为0个。In the initialization state, all the license plates in the time series image frame in front of the first image frame are zero.
对于某一个图像帧,若其前面相邻时序图像帧中的某个车牌在后面相邻时序图像帧中不存在关联车牌,则认为该车牌目前无法识别,并将该车牌加入无法识别车牌集合。 For an image frame, if a license plate in the preceding adjacent time-series image frame does not have an associated license plate in the subsequent adjacent time-series image frame, the license plate is considered to be unrecognizable at present, and the license plate is added to the unrecognizable license plate set.
在一些情况下,对于某一个图像帧中的车牌k,在前面相邻时序图像帧中不存在关联车牌,则可认为该图像帧为车牌k进入画面获取范围的第一图像帧。In some cases, for a license plate k in an image frame, if there is no associated license plate in the preceding adjacent time-series image frame, the image frame may be considered as the first image frame in which the license plate k enters the screen acquisition range.
在另一些情况下,对于某一个图像帧中的车牌m,在前面相邻时序图像帧中不存在关联车牌时,有可能车牌m在该图像帧前面连续n-1个图像帧中被遮挡或未被清晰拍摄,而在该图像帧前数第n个图像帧中出现过,那么该图像帧为车牌m进入画面获取范围的第一图像帧和车牌m离开画面获取范围的第二图像帧之间的图像帧。In other cases, for the license plate m in an image frame, when there is no associated license plate in the preceding adjacent time-series image frame, it is possible that the license plate m is occluded in consecutive n-1 image frames in front of the image frame or Not being clearly captured, but appearing in the nth image frame before the image frame, then the image frame is the first image frame in which the license plate m enters the screen acquisition range and the second image frame in which the license plate m leaves the screen acquisition range. Image frame between.
因此,在步骤2012之后,还包括:Therefore, after step 2012, it also includes:
步骤2014:判断所述一个图像帧中的车牌在当前记录的无法识别车牌集合中是否存在关联车牌;Step 2014: determining whether the license plate in the one image frame has an associated license plate in the currently recorded unrecognizable license plate set;
步骤2015:当所述一个图像帧中的车牌在其前连续设定数目的图像帧中不存在关联车牌时,进入步骤2013。Step 2015: When the license plate in the one image frame does not have an associated license plate in a consecutively set number of image frames, the process proceeds to step 2013.
实际处理过程中,在一些情况下,对于某个图像帧中的车牌h,在该图像帧的后面时序相邻图像帧中不存在相关联车牌,则可认为该图像帧为车牌h离开画面获取范围的第二图像帧。In the actual processing, in some cases, for the license plate h in an image frame, if there is no associated license plate in the sequence of adjacent image frames behind the image frame, the image frame may be considered as the license plate h leaving the screen. The second image frame of the range.
在另一些情况下,对于某一个图像帧中的车牌g,在后面相邻时序图像帧中不存在关联车牌时,有可能车牌g在该图像帧后面连续n-1个图像帧中被遮挡或未被清晰拍摄,而在该图像帧前数第n个图像帧中再次出现,那么该图像帧为车牌g进入画面获取范围的第一图像帧和车牌g离开画面获取范围的第二图像帧之间的图像帧。In other cases, for the license plate g in an image frame, when there is no associated license plate in the subsequent adjacent time-series image frames, it is possible that the license plate g is occluded in consecutive n-1 image frames behind the image frame or Without being clearly captured, and appearing again in the nth image frame of the image frame, the image frame is the first image frame in which the license plate g enters the screen acquisition range and the second image frame in which the license plate g leaves the screen acquisition range. Image frame between.
在本发明一些实施例中,仍然参照图2,步骤202包括:In some embodiments of the invention, still referring to FIG. 2, step 202 includes:
步骤2021:将所述第一图像帧后一时序相邻图像帧作为目标图像帧;Step 2021: The subsequent image frame of the first image frame is used as the target image frame.
步骤2022:判断当前目标图像帧中的车牌在其后面连续设定数目的图像帧中是否存在关联车牌;Step 2022: Determine whether the license plate in the current target image frame has an associated license plate in a consecutively set number of image frames behind it;
步骤2023:确定所述当前目标图像帧中的车牌在其后面连续设定数目的图像帧中不存在关联车牌时,将所述目标图像帧作为第二图像帧;Step 2023: Determine that the target image frame is used as the second image frame when the license plate in the current target image frame does not have an associated license plate in a consecutively set number of image frames.
步骤2024:确定所述当前目标图像帧中的车牌在其后面连续的设定数目的图像帧中存在关联车牌时,将当前目标图像帧后一时序相邻图像帧作为目标图像帧;并返回判断当前目标图像帧中的车牌在其后面连续设定数目的图像帧中是否存在关联车牌的步骤; Step 2024: When it is determined that the license plate in the current target image frame has an associated license plate in a consecutive set number of image frames, the next target image frame of the current target image frame is used as the target image frame; and the judgment is returned. a step of whether the license plate in the current target image frame has an associated license plate in a continuously set number of image frames behind it;
所述关联车牌,指的是分别出现于两个相邻图像帧中、相似度大于等于设定值的车牌。The associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
由于在本发明的一些实施例中,对于某一个图像帧,若其前面相邻时序图像帧中的某个车牌在后面相邻时序图像帧中不存在关联车牌,则认为该车牌目前无法识别,并将该车牌加入无法识别车牌集合。在本发明一种具体实施例中,上述步骤2022可通过下述过程实现:In some embodiments of the present invention, for a certain image frame, if a certain license plate in the preceding adjacent time-series image frame does not have an associated license plate in a subsequent adjacent time-series image frame, the license plate is considered to be unrecognizable at present. And add the license plate to the unrecognizable license plate collection. In a specific embodiment of the present invention, the above step 2022 can be implemented by the following process:
步骤301:判断当前目标图像帧中的车牌在其后面第一个图像帧中是否存在关联车牌,若否,则将该车牌加入无法识别车牌集合,将无法识别次数记为1,并进入下一步;若是,则进入上述步骤2024。Step 301: Determine whether the license plate in the current target image frame has an associated license plate in the first image frame behind it. If not, add the license plate to the unrecognizable license plate set, record the number of unrecognizable numbers as 1, and proceed to the next step. If yes, proceed to step 2024 above.
步骤302:判断无法识别次数是否达到设定值,若是,则进入上述步骤2023;若否,进入下一步。Step 302: Determine whether the unrecognized number of times reaches the set value, and if yes, proceed to step 2023; if not, proceed to the next step.
步骤303:判断当前目标图像帧中的车牌在其后面时序的下一图像帧中是否存在关联车牌,若否,则将无法识别次数增加1,并返回步骤302;若是,则进入上述步骤2024。Step 303: Determine whether the associated license plate exists in the next image frame of the license plate in the current target image frame. If not, increase the number of unrecognized times by one, and return to step 302; if yes, proceed to step 2024.
在本发明一些实施例中,当分别出现于两个相邻图像帧中的两个车牌所在区域中心距离小于设定的距离阈值且车牌字符识别结果相似比例大于设定的相似比例阈值时,所述两个相邻图像帧中的两个车牌为关联车牌。In some embodiments of the present invention, when the distance between the center of the two license plates respectively appearing in two adjacent image frames is less than the set distance threshold and the similarity ratio of the license plate character recognition result is greater than the set similarity ratio threshold, Two of the two adjacent image frames are associated license plates.
在一种具体实施例中,如果上一处理帧第a个车牌和当前处理帧第b个车牌所在区域中心点距离小于图像对角线长度的1/4,并且不少于5个字符识别结果相同,我们认为上一处理帧第a个车牌和当前处理帧第b个车牌能够关联。In a specific embodiment, if the distance between the center point of the area where the a-th license plate of the last processing frame and the b-th license plate of the current processing frame are located is less than 1/4 of the diagonal length of the image, and no less than 5 characters are recognized. Similarly, we believe that the a-th license plate of the previous processing frame and the b-th license plate of the current processing frame can be associated.
从上面所述可以看出,本发明及其实施例提供的车辆车牌识别方法,能够解决因为采集的车辆图像帧清晰度不够或存在遮挡等原因引起的识别结果不准确或无法产生识别结果的问题。同时识别的准确度得到了提高。It can be seen from the above that the vehicle license plate recognition method provided by the present invention and the embodiments thereof can solve the problem that the recognition result is inaccurate or the recognition result cannot be generated due to insufficient clarity or occlusion of the captured image frame of the vehicle. . At the same time, the accuracy of recognition has been improved.
进一步,本发明实施例提供一种车辆车牌识别装置,结构如图3所示,包括:Further, an embodiment of the present invention provides a vehicle license plate recognition device, and the structure is as shown in FIG. 3, including:
识别数据获取模块:设置为识别车牌在画面获取范围内多个连续位置的图像帧;并分别获得在所述多个连续位置时,所述车牌的识别数据;a recognition data acquisition module: configured to identify image frames of a plurality of consecutive positions of the license plate within the screen acquisition range; and obtain identification data of the license plate when the plurality of consecutive positions are respectively obtained;
统计模块:设置为统计所述多个位置时,所述车牌的识别数据,得到所述车牌的识别结果。 The statistics module: when the plurality of locations are counted, the identification data of the license plate is used to obtain the recognition result of the license plate.
在本发明的一些实施例中,识别数据获取模块包括:In some embodiments of the present invention, the identification data acquisition module includes:
字符识别单元:设置为在图像帧中对所述车牌进行定位以获得图像帧中所述车牌的对应区域,并解析图像帧中所述车牌的对应区域以获得车牌图片的字符识别结果;a character recognition unit configured to: position the license plate in an image frame to obtain a corresponding area of the license plate in the image frame, and parse a corresponding area of the license plate in the image frame to obtain a character recognition result of the license plate picture;
车牌识别数据输出单元:设置为将所述字符识别结果作为车牌识别数据输出。The license plate recognition data output unit is configured to output the character recognition result as license plate identification data.
在本发明的一些实施例中,仍然参照图3,所述装置还包括:In some embodiments of the present invention, still referring to FIG. 3, the apparatus further includes:
第一图像帧识别模块:设置为识别所述车牌进入画面获取范围的第一图像帧;a first image frame identification module: configured to identify a first image frame in which the license plate enters a screen acquisition range;
第二图像帧识别模块:设置为识别所述车牌离开画面获取范围的第二图像帧;a second image frame identification module: configured to identify the second image frame of the license plate leaving the screen acquisition range;
图像帧提取模块:设置为将所述第一图像帧和第二图像帧之间的所有图像帧作为所述车牌在画面获取范围内多个连续位置的图像帧。The image frame extraction module is configured to set all the image frames between the first image frame and the second image frame as image frames of the plurality of consecutive positions of the license plate within the image acquisition range.
在本发明的一些实施例中,第一图像帧识别模块包括:In some embodiments of the present invention, the first image frame identification module includes:
第一关联判断单元:设置为判断一个图像帧中的车牌在其前面连续设定数目的图像帧中是否存在关联车牌;a first association determining unit: configured to determine whether an associated license plate exists in a consecutively set number of image frames of a license plate in an image frame;
第一判断结果确定单元:设置为确定所述一个图像帧中的车牌在其前面连续设定数目的图像帧中不存在关联车牌;a first determination result determining unit: configured to determine that the license plate in the one image frame does not have an associated license plate in a consecutively set number of image frames in front of the license plate;
第一图像帧确定单元:设置为将所述一个图像帧作为第一图像帧;a first image frame determining unit: configured to use the one image frame as a first image frame;
所述关联车牌,指的是分别出现于两个相邻图像帧中、相似度大于等于设定值的车牌。The associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
在本发明的一些实施例中,所述第一图像帧识别模块还包括:In some embodiments of the present invention, the first image frame identification module further includes:
无法识别记录关联判断单元:设置为判断所述一个图像帧中的车牌在当前记录的无法识别车牌集合中是否存在关联车牌;并设置为当所述一个图像帧中的车牌在其前连续设定数目的图像帧中不存在关联车牌时,触发第一图像帧确定单元。Unrecognized record association judging unit: configured to determine whether the license plate in the one image frame has an associated license plate in the currently recorded unrecognized license plate set; and set to continuously set the license plate in the one image frame before The first image frame determining unit is triggered when there is no associated license plate in the number of image frames.
在本发明的一些实施例中,第二图像帧识别模块包括:In some embodiments of the present invention, the second image frame identification module includes:
目标图像帧确定单元:设置为将所述第一图像帧后一时序相邻图像帧作为目标图像帧; a target image frame determining unit: configured to use the temporally adjacent image frame of the first image frame as a target image frame;
第二关联判断单元:设置为判断当前目标图像帧中的车牌在其后面连续设定数目的图像帧中是否存在关联车牌;a second association determining unit: configured to determine whether an associated license plate exists in a continuously set number of image frames of the license plate in the current target image frame;
第二图像帧确定单元:设置为确定所述当前目标图像帧中的车牌在其后面连续设定数目的图像帧中不存在关联车牌时,将所述目标图像帧作为第二图像帧;并设置为当确定所述当前目标图像帧中的车牌在其后面连续的设定数目的图像帧中存在关联车牌时,将当前目标图像帧后一时序相邻图像帧作为目标图像帧,触发第二关联判断单元;a second image frame determining unit: configured to determine that the target image frame is the second image frame when the license plate in the current target image frame does not have an associated license plate in a consecutively set number of image frames; In order to determine that the license plate in the current target image frame has an associated license plate in a consecutive set number of image frames, the next target image frame is used as the target image frame, and the second association is triggered. Judging unit
所述关联车牌,指的是分别出现于两个相邻图像帧中、相似度大于等于设定值的车牌。The associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
在本发明的一些实施例中,当分别出现于两个相邻图像帧中的两个车牌所在区域中心距离小于设定的距离阈值且车牌字符识别结果相似比例大于设定的相似比例阈值时,所述两个相邻图像帧中的两个车牌为关联车牌。In some embodiments of the present invention, when the center distance of the area where the two license plates respectively appear in two adjacent image frames are less than the set distance threshold and the similarity ratio of the license plate character recognition result is greater than the set similarity ratio threshold, Two of the two adjacent image frames are associated license plates.
从上面所述可以看出,本发明实施例提供的车辆车牌识别方法及装置,针对因在实际应用过程中车辆图片采集状况不稳定而导致车牌识别结果受到不良影响的问题,对车辆在进入画面获取范围的连续过程中,先后出现的多个位置的图像帧进行处理得到识别数据,并对这些识别数据进行统计,得到车牌识别结果,提高了在环境因素影响下,对车牌进行较为准确识别的概率。本发明实施例的车辆车牌识别方法及装置,通过关联识别,能够对车牌进入和离开画面获取范围的状态进行高准确度的判断。It can be seen from the above that the vehicle license plate recognition method and device provided by the embodiments of the present invention are directed to the problem that the license plate recognition result is adversely affected due to the unstable image acquisition condition in the actual application process, and the vehicle enters the screen. In the continuous process of obtaining the range, the image frames of multiple positions appearing successively are processed to obtain the identification data, and the identification data is statistically obtained to obtain the license plate recognition result, thereby improving the accurate recognition of the license plate under the influence of environmental factors. Probability. The vehicle license plate recognition method and apparatus according to the embodiment of the present invention can perform high-accuracy determination of the state in which the license plate enters and leaves the screen acquisition range by association recognition.
工业实用性:本发明实施例的车辆车牌识别方法及装置,通过关联识别,能够对车牌进入和离开画面获取范围的状态进行高准确度的判断。本发明及其实施例所提供的车牌车辆识别方法和装置,尤其适用于移动的车辆,适应如今的交通发展趋势。Industrial Applicability: The vehicle license plate recognition method and apparatus according to the embodiment of the present invention can perform high-accuracy determination of the state in which the license plate enters and leaves the screen acquisition range by association recognition. The license plate vehicle identification method and apparatus provided by the present invention and its embodiments are particularly suitable for a mobile vehicle to adapt to the current traffic development trend.
应当理解,本说明书所描述的多个实施例仅用于说明和解释本发明,并不用于限定本发明。并且在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。It is to be understood that the various embodiments of the present invention are intended to illustrate and explain the invention. And in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.
显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样,倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。 It is apparent that those skilled in the art can make various modifications and variations to the invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and modifications of the invention

Claims (14)

  1. 一种车辆车牌识别方法,包括:A vehicle license plate recognition method includes:
    识别车牌在画面获取范围内多个连续位置的图像帧;并分别获得在所述多个连续位置时,所述车牌的识别数据;Identifying image frames of the plurality of consecutive positions of the license plate in the screen acquisition range; and obtaining identification data of the license plate when the plurality of consecutive positions are respectively obtained;
    统计所述多个位置时,所述车牌的识别数据,得到所述车牌的识别结果。When the plurality of locations are counted, the identification data of the license plate obtains the recognition result of the license plate.
  2. 根据权利要求1所述的方法,其中,识别车牌在画面获取范围内多个连续位置的图像帧、并分别获得在所述多个连续位置时所述车牌的识别数据的步骤包括:The method according to claim 1, wherein the step of identifying the image frames of the plurality of consecutive positions of the license plate within the screen acquisition range and obtaining the identification data of the license plate at the plurality of consecutive positions respectively comprises:
    在图像帧中对所述车牌进行定位以获得图像帧中所述车牌的对应区域,并解析图像帧中所述车牌的对应区域以获得车牌图片的字符识别结果;Positioning the license plate in an image frame to obtain a corresponding area of the license plate in the image frame, and parsing a corresponding area of the license plate in the image frame to obtain a character recognition result of the license plate picture;
    将所述字符识别结果作为车牌识别数据输出。The character recognition result is output as license plate identification data.
  3. 根据权利要求1所述的方法,其中,识别车牌在画面获取范围内多个位置的图像帧、并分别获得在多个位置时的车牌识别数据之前,还包括:The method according to claim 1, wherein before identifying the image frames of the plurality of locations within the screen acquisition range and obtaining the license plate identification data at the plurality of positions, the method further comprises:
    识别所述车牌进入画面获取范围的第一图像帧;Identifying the first image frame of the license plate entering a screen acquisition range;
    识别所述车牌离开画面获取范围的第二图像帧;Recognizing that the license plate leaves the second image frame of the screen acquisition range;
    将所述第一图像帧和第二图像帧之间的所有图像帧作为所述车牌在画面获取范围内多个连续位置的图像帧。All image frames between the first image frame and the second image frame are used as image frames of the license plate at a plurality of consecutive positions within the screen acquisition range.
  4. 根据权利要求3所述的方法,其中,识别车牌进入画面获取范围的图像帧的步骤包括:The method of claim 3, wherein the step of identifying the license plate entering the image frame of the screen acquisition range comprises:
    判断一个图像帧中的车牌在其前面连续设定数目的图像帧中是否存在关联车牌;Determining whether a license plate in an image frame has an associated license plate in a consecutively set number of image frames in front of it;
    确定所述一个图像帧中的车牌在其前面连续设定数目的图像帧中不存在关联车牌;Determining that the license plate in the one image frame does not have an associated license plate in a consecutively set number of image frames in front of the license plate;
    将所述一个图像帧作为第一图像帧;Taking the one image frame as a first image frame;
    所述关联车牌,指的是分别出现于两个相邻图像帧中、相似度大于等于设定值的车牌。The associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
  5. 根据权利要求4所述的方法,其中,确定所述一个图像帧中的车牌在其前面连续设定数目的图像帧中不存在关联车牌之后,还包括: The method according to claim 4, wherein after determining that the license plate in the one image frame has no associated license plate in a consecutively set number of image frames in front of the image frame, the method further comprises:
    判断所述一个图像帧中的车牌在当前记录的无法识别车牌集合中是否存在关联车牌;Determining whether the license plate in the one image frame has an associated license plate in the currently recorded unrecognized license plate set;
    当所述一个图像帧中的车牌在其前连续设定数目的图像帧中不存在关联车牌时,进入将所述一个图像帧作为第一图像帧的步骤。When the license plate in the one image frame does not have an associated license plate in a consecutively set number of image frames, the step of using the one image frame as the first image frame is entered.
  6. 根据权利要求3所述的方法,其中,识别所述车牌离开画面获取范围的第二图像帧的步骤包括:The method of claim 3, wherein the step of identifying the second image frame of the license plate leaving the screen acquisition range comprises:
    将所述第一图像帧后一时序相邻图像帧作为目标图像帧;And adopting the first image frame and the subsequent time-series adjacent image frame as the target image frame;
    判断当前目标图像帧中的车牌在其后面连续设定数目的图像帧中是否存在关联车牌;Determining whether the license plate in the current target image frame has an associated license plate in a continuously set number of image frames behind it;
    确定所述当前目标图像帧中的车牌在其后面连续设定数目的图像帧中不存在关联车牌时,将所述目标图像帧作为第二图像帧;Determining, when the license plate in the current target image frame does not have an associated license plate in a consecutively set number of image frames, the target image frame is used as the second image frame;
    确定所述当前目标图像帧中的车牌在其后面连续的设定数目的图像帧中存在关联车牌时,将当前目标图像帧后一时序相邻图像帧作为目标图像帧,并返回判断当前目标图像帧中的车牌在其后面连续设定数目的图像帧中是否存在关联车牌的步骤;Determining that, when the license plate in the current target image frame has an associated license plate in a consecutive set number of image frames, the next target image frame of the current target image frame is used as the target image frame, and returns to determine the current target image. The step of whether the license plate in the frame has an associated license plate in a consecutive number of image frames behind it;
    所述关联车牌,指的是分别出现于两个相邻图像帧中、相似度大于等于设定值的车牌。The associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
  7. 根据权利要求4-6中任意一项所述的方法,其中,当分别出现于两个相邻图像帧中的两个车牌所在区域中心距离小于设定的距离阈值且车牌字符识别结果相似比例大于设定的相似比例阈值时,所述两个相邻图像帧中的两个车牌为关联车牌。The method according to any one of claims 4-6, wherein the center distance of the area where the two license plates respectively appear in the two adjacent image frames is smaller than the set distance threshold and the similarity ratio of the license plate character recognition result is greater than When the similarity ratio threshold is set, two of the two adjacent image frames are associated license plates.
  8. 一种车辆车牌识别装置,包括:A vehicle license plate recognition device includes:
    识别数据获取模块:设置为识别车牌在画面获取范围内多个连续位置的图像帧;并分别获得在所述多个连续位置时,所述车牌的识别数据;a recognition data acquisition module: configured to identify image frames of a plurality of consecutive positions of the license plate within the screen acquisition range; and obtain identification data of the license plate when the plurality of consecutive positions are respectively obtained;
    统计模块:设置为统计所述多个位置时,所述车牌的识别数据,得到所述车牌的识别结果。The statistics module: when the plurality of locations are counted, the identification data of the license plate is used to obtain the recognition result of the license plate.
  9. 根据权利要求8所述的装置,其中,识别数据获取模块包括: The apparatus of claim 8, wherein the identification data acquisition module comprises:
    字符识别单元:设置为在图像帧中对所述车牌进行定位以获得图像帧中所述车牌的对应区域,并解析图像帧中所述车牌的对应区域以获得车牌图片的字符识别结果;a character recognition unit configured to: position the license plate in an image frame to obtain a corresponding area of the license plate in the image frame, and parse a corresponding area of the license plate in the image frame to obtain a character recognition result of the license plate picture;
    车牌识别数据输出单元:设置为将所述字符识别结果作为车牌识别数据输出。The license plate recognition data output unit is configured to output the character recognition result as license plate identification data.
  10. 根据权利要求8所述的装置,其中,所述装置还包括:The apparatus of claim 8 wherein said apparatus further comprises:
    第一图像帧识别模块:设置为识别所述车牌进入画面获取范围的第一图像帧;a first image frame identification module: configured to identify a first image frame in which the license plate enters a screen acquisition range;
    第二图像帧识别模块:设置为识别所述车牌离开画面获取范围的第二图像帧;a second image frame identification module: configured to identify the second image frame of the license plate leaving the screen acquisition range;
    图像帧提取模块:设置为将所述第一图像帧和第二图像帧之间的所有图像帧作为所述车牌在画面获取范围内多个连续位置的图像帧。The image frame extraction module is configured to set all the image frames between the first image frame and the second image frame as image frames of the plurality of consecutive positions of the license plate within the image acquisition range.
  11. 根据权利要求10所述的装置,其中,第一图像帧识别模块包括:The apparatus of claim 10 wherein the first image frame identification module comprises:
    第一关联判断单元:设置为判断一个图像帧中的车牌在其前面连续设定数目的图像帧中是否存在关联车牌;a first association determining unit: configured to determine whether an associated license plate exists in a consecutively set number of image frames of a license plate in an image frame;
    第一判断结果确定单元:设置为确定所述一个图像帧中的车牌在其前面连续设定数目的图像帧中不存在关联车牌;a first determination result determining unit: configured to determine that the license plate in the one image frame does not have an associated license plate in a consecutively set number of image frames in front of the license plate;
    第一图像帧确定单元:设置为将所述一个图像帧作为第一图像帧;a first image frame determining unit: configured to use the one image frame as a first image frame;
    所述关联车牌,指的是分别出现于两个相邻图像帧中、相似度大于等于设定值的车牌。The associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
  12. 根据权利要求11所述的装置,其中,所述第一图像帧识别模块还包括:The apparatus of claim 11, wherein the first image frame identification module further comprises:
    无法识别记录关联判断单元:设置为判断所述一个图像帧中的车牌在当前记录的无法识别车牌集合中是否存在关联车牌;并设置为当所述一个图像帧中的车牌在其前连续设定数目的图像帧中不存在关联车牌时,触发第一图像帧确定单元。Unrecognized record association judging unit: configured to determine whether the license plate in the one image frame has an associated license plate in the currently recorded unrecognized license plate set; and set to continuously set the license plate in the one image frame before The first image frame determining unit is triggered when there is no associated license plate in the number of image frames.
  13. 根据权利要求10所述的装置,其中,第二图像帧识别模块包括:The apparatus of claim 10 wherein the second image frame identification module comprises:
    目标图像帧确定单元:设置为将所述第一图像帧后一时序相邻图像帧作为目标图像帧; a target image frame determining unit: configured to use the temporally adjacent image frame of the first image frame as a target image frame;
    第二关联判断单元:设置为判断当前目标图像帧中的车牌在其后面连续设定数目的图像帧中是否存在关联车牌;a second association determining unit: configured to determine whether an associated license plate exists in a continuously set number of image frames of the license plate in the current target image frame;
    第二图像帧确定单元:设置为确定所述当前目标图像帧中的车牌在其后面连续设定数目的图像帧中不存在关联车牌时,将所述目标图像帧作为第二图像帧;并设置为当确定所述当前目标图像帧中的车牌在其后面连续的设定数目的图像帧中存在关联车牌时,将当前目标图像帧后一时序相邻图像帧作为目标图像帧,触发第二关联判断单元;a second image frame determining unit: configured to determine that the target image frame is the second image frame when the license plate in the current target image frame does not have an associated license plate in a consecutively set number of image frames; In order to determine that the license plate in the current target image frame has an associated license plate in a consecutive set number of image frames, the next target image frame is used as the target image frame, and the second association is triggered. Judging unit
    所述关联车牌,指的是分别出现于两个相邻图像帧中、相似度大于等于设定值的车牌。The associated license plate refers to a license plate that appears in two adjacent image frames and has a similarity equal to or greater than a set value.
  14. 根据权利要求11-13中任意一项所述的装置,其中,当分别出现于两个相邻图像帧中的两个车牌所在区域中心距离小于设定的距离阈值且车牌字符识别结果相似比例大于设定的相似比例阈值时,所述两个相邻图像帧中的两个车牌为关联车牌。 The apparatus according to any one of claims 11 to 13, wherein when the distance between the center of the two license plates respectively appearing in the two adjacent image frames is less than the set distance threshold and the similarity ratio of the license plate character recognition result is greater than When the similarity ratio threshold is set, two of the two adjacent image frames are associated license plates.
PCT/CN2015/074792 2014-07-23 2015-03-20 Method and device for recognizing license plate of vehicle WO2015184899A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410354010.5 2014-07-23
CN201410354010.5A CN105303153A (en) 2014-07-23 2014-07-23 Vehicle license plate identification method and apparatus

Publications (1)

Publication Number Publication Date
WO2015184899A1 true WO2015184899A1 (en) 2015-12-10

Family

ID=54766122

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/074792 WO2015184899A1 (en) 2014-07-23 2015-03-20 Method and device for recognizing license plate of vehicle

Country Status (2)

Country Link
CN (1) CN105303153A (en)
WO (1) WO2015184899A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113792696A (en) * 2021-09-23 2021-12-14 北京中电兴发科技有限公司 Vehicle target quality evaluation method applied to target snapshot
CN116612569A (en) * 2023-07-17 2023-08-18 南方电网调峰调频发电有限公司信息通信分公司 Intelligent vehicle access registration method and device based on power generation enterprises

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105654733B (en) * 2016-03-08 2019-05-21 新智认知数据服务有限公司 A kind of front and back licence plate recognition method and device based on video detection
CN107085707A (en) * 2017-04-14 2017-08-22 河海大学 A kind of license plate locating method based on Traffic Surveillance Video
CN107273889B (en) * 2017-04-27 2020-04-28 浙江工业大学 License plate recognition method based on statistics
CN110543883A (en) * 2019-08-27 2019-12-06 河海大学 license plate recognition method based on deep learning
CN111063199B (en) * 2019-12-19 2021-08-06 深圳市捷顺科技实业股份有限公司 Method and device for associating vehicle with license plate and terminal equipment
CN115298705A (en) * 2020-01-10 2022-11-04 顺丰科技有限公司 License plate recognition method and device, electronic equipment and storage medium
CN111310698A (en) * 2020-02-26 2020-06-19 北京停简单信息技术有限公司 License plate recognition method and device and inspection vehicle
CN111339949A (en) * 2020-02-26 2020-06-26 北京停简单信息技术有限公司 License plate recognition method and device and inspection vehicle
CN111523527B (en) * 2020-07-02 2020-10-27 平安国际智慧城市科技股份有限公司 Special transport vehicle monitoring method and device, medium and electronic equipment
CN112034423B (en) * 2020-09-08 2023-12-26 湖南大学 High-precision mobile vehicle positioning method based on LED visible light communication
CN115082832A (en) * 2022-07-13 2022-09-20 北京京东乾石科技有限公司 Information identification method, device and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201159903Y (en) * 2008-03-14 2008-12-03 北京信路威科技发展有限公司 License plate recognition device
JP2011060138A (en) * 2009-09-11 2011-03-24 Toshiba Corp License plate reader and license plate reading method
CN202422423U (en) * 2011-12-20 2012-09-05 杭州海康威视系统技术有限公司 Vehicle license plate recognition device and system
CN103035125A (en) * 2012-12-12 2013-04-10 北京蓝卡软件技术有限公司 Vehicle license plate recognition method and system thereof

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101377811B (en) * 2007-08-31 2010-06-30 北京万集科技有限责任公司 Method and system for recognizing license plate
CN101877174B (en) * 2009-09-29 2012-07-25 杭州海康威视软件有限公司 Vehicle speed measurement method, supervisory computer and vehicle speed measurement system
CN101957920B (en) * 2010-09-08 2012-07-11 中国人民解放军国防科学技术大学 Vehicle license plate searching method based on digital videos
CN103390156B (en) * 2012-11-05 2016-09-21 深圳市捷顺科技实业股份有限公司 A kind of licence plate recognition method and device
CN103000029B (en) * 2012-11-20 2015-10-07 河南亚视软件技术有限公司 Automobile video frequency recognition methods and application thereof
CN103235938B (en) * 2013-05-03 2016-01-27 通号通信信息集团有限公司 The method and system of car plate detection and indentification
CN103413147B (en) * 2013-08-28 2017-07-07 庄浩洋 A kind of licence plate recognition method and system
CN103824066B (en) * 2014-03-18 2017-10-10 厦门翼歌软件科技有限公司 A kind of licence plate recognition method based on video flowing

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201159903Y (en) * 2008-03-14 2008-12-03 北京信路威科技发展有限公司 License plate recognition device
JP2011060138A (en) * 2009-09-11 2011-03-24 Toshiba Corp License plate reader and license plate reading method
CN202422423U (en) * 2011-12-20 2012-09-05 杭州海康威视系统技术有限公司 Vehicle license plate recognition device and system
CN103035125A (en) * 2012-12-12 2013-04-10 北京蓝卡软件技术有限公司 Vehicle license plate recognition method and system thereof

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113792696A (en) * 2021-09-23 2021-12-14 北京中电兴发科技有限公司 Vehicle target quality evaluation method applied to target snapshot
CN113792696B (en) * 2021-09-23 2023-07-18 北京中电兴发科技有限公司 Vehicle target quality assessment method applied to target snapshot
CN116612569A (en) * 2023-07-17 2023-08-18 南方电网调峰调频发电有限公司信息通信分公司 Intelligent vehicle access registration method and device based on power generation enterprises
CN116612569B (en) * 2023-07-17 2024-02-20 南方电网调峰调频发电有限公司信息通信分公司 Intelligent vehicle access registration method and device based on power generation enterprises

Also Published As

Publication number Publication date
CN105303153A (en) 2016-02-03

Similar Documents

Publication Publication Date Title
WO2015184899A1 (en) Method and device for recognizing license plate of vehicle
WO2019169532A1 (en) License plate recognition method and cloud system
CN105938622B (en) Method and apparatus for detecting object in moving image
CN111382704B (en) Vehicle line pressing violation judging method and device based on deep learning and storage medium
US20170032514A1 (en) Abandoned object detection apparatus and method and system
EP3806064A1 (en) Method and apparatus for detecting parking space usage condition, electronic device, and storage medium
WO2018103608A1 (en) Text detection method, device and storage medium
TWI497422B (en) A system and method for recognizing license plate image
KR101912914B1 (en) Method and system for recognition of speed limit sign using front camera
CN110334569B (en) Passenger flow volume in-out identification method, device, equipment and storage medium
CN103324930B (en) A kind of registration number character dividing method based on grey level histogram binaryzation
US9971941B2 (en) Person counting method and device for same
EP2662827B1 (en) Video analysis
US11257220B2 (en) Asset tracking systems
CN111191611B (en) Traffic sign label identification method based on deep learning
WO2014026483A1 (en) Character identification method and relevant device
JP5931662B2 (en) Road condition monitoring apparatus and road condition monitoring method
JP6226368B2 (en) Vehicle monitoring apparatus and vehicle monitoring method
WO2014193220A2 (en) System and method for multiple license plates identification
WO2018058530A1 (en) Target detection method and device, and image processing apparatus
CN108090484B (en) License plate recognition method and device
Prates et al. Brazilian license plate detection using histogram of oriented gradients and sliding windows
WO2021022698A1 (en) Following detection method and apparatus, and electronic device and storage medium
Rabiu Vehicle detection and classification for cluttered urban intersection
Salarian et al. A vision based system for traffic lights recognition

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15802477

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15802477

Country of ref document: EP

Kind code of ref document: A1