US20160092742A1 - Method for instant recognition of traffic lights countdown image - Google Patents
Method for instant recognition of traffic lights countdown image Download PDFInfo
- Publication number
- US20160092742A1 US20160092742A1 US14/499,692 US201414499692A US2016092742A1 US 20160092742 A1 US20160092742 A1 US 20160092742A1 US 201414499692 A US201414499692 A US 201414499692A US 2016092742 A1 US2016092742 A1 US 2016092742A1
- Authority
- US
- United States
- Prior art keywords
- image
- pixels
- lightness
- countdown
- candidate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 24
- 238000006073 displacement reaction Methods 0.000 claims abstract description 7
- 238000005192 partition Methods 0.000 claims description 10
- 238000009877 rendering Methods 0.000 claims description 7
- 230000003044 adaptive effect Effects 0.000 claims description 6
- 230000002708 enhancing effect Effects 0.000 claims description 4
- 238000003708 edge detection Methods 0.000 claims description 3
- 238000007519 figuring Methods 0.000 claims description 3
- 238000010801 machine learning Methods 0.000 claims description 3
- 238000010606 normalization Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 15
- 238000012790 confirmation Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V20/584—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
-
- G06K9/00825—
-
- G06K9/4642—
-
- G06K9/4652—
-
- G06K9/6215—
-
- G06K9/628—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30252—Vehicle exterior; Vicinity of vehicle
Definitions
- the invention relates to a method for instant recognition of traffic lights countdown image that can quickly scan and confirm the circular feature of a traffic light, and retrieve the countdown image thereof by calculating the displacement ratio from the circular feature, then process the countdown image to display a feature image thereof and bring out the recognition result.
- Traffic lights have red, yellow, and green lights, among which the red and green lights may have countdown function to remind the drivers when the lights are about to change, so as to eliminate safety concerns during the driving.
- the drivers may lose attention to the countdown of traffic lights due to poor sight or distraction when driving, and thus cause irreparable loss.
- optical illusion may happen owning to long time driving or exhaustion; but the optical illusion can be remedied by machine vision to recognize the status of the countdown.
- the countdown image is conversed from RGB image to greyscale image, but the LED light source emitting the countdown numbers would cause detailed and undetectable changes of the greyscale image.
- the countdown image can be difficult to recognize due to the effects from the ambient lights, and the contours of the figures are different, making the recognizing process even more complicated and the entire process is therefore slower.
- Another object of the present invention is to provide a method for instant recognition of traffic lights countdown image that proceeds the countdown image with enhancing, cutting, and recognizing operation, so as to provide a solution to the problem of slow detection of the counting-down in the prior art.
- the present invention comprises the following steps: retrieving information of a real-time image that is divided into a plurality of partitions, each having the four corners as confirmed pixels which are processed within HSL (hue, saturation, lightness) color space; scanning the color features—hue, saturation, and lightness—of the confirmed pixels and when the color features conform to the predetermined ones, rendering the confirmed pixels as candidate pixels which turn the neighboring four partitions into candidate regions; searching the neighboring confirmed pixels of the candidate pixels that resemble the features thereof and render them as candidate pixels as well until every neighboring confirmed pixel is checked, and merging all the candidate pixels and the candidate regions thereof together as a group; conversing the merged candidate regions within HSL color space by adjusting the threshold value of the lightness of said merged candidate regions with adaptive threshold algorithm, conversing into a binary image of lightness, and then conversing the binary image of lightness into an edge image of lightness after the edge detection processing, then intersecting the edge image of lightness and a binary image of hue conversed from the
- the range of the hue is from 0.3 to 0.92 after normalization.
- the present invention can quickly scan and confirm the circular feature of a traffic light, and retrieve the countdown image thereof by calculating the displacement ratio from the circular feature, then enhance, cut and converse the countdown image to display a feature image thereof so as to fulfill the effectiveness of searching and instantly recognizing the countdown image of a traffic light.
- FIG. 1 is a flow diagram of the present invention
- FIG. 2A is a schematic diagram illustrating the settling of confirmed pixels of the present invention.
- FIG. 2B is a schematic diagram illustrating a confirmed pixel becoming a candidate pixel and rendering its neighboring area as candidate regions;
- FIG. 2C is a schematic diagram illustrating a resembling confirmed pixel becoming another candidate pixel and rendering its neighboring area as candidate regions;
- FIG. 3A is a schematic diagram of a binary image of lightness conversed from the hue of the candidate regions
- FIG. 3B is a schematic diagram of an edge image of lightness according to the present invention.
- FIG. 3C is a schematic diagram illustrating the hue of the candidate regions conversing into a binary image
- FIG. 3D is a schematic diagram of an edge image produced after intersecting process according to the present invention.
- FIG. 3E is a schematic diagram illustrating the circular feature found by the method of the present invention.
- FIG. 4 is a schematic diagram of a countdown image retrieved by the method of the present invention.
- FIG. 5A is a schematic diagram of a greyscale image of the image retrieved by the method of the present invention.
- FIG. 5B is a schematic diagram of a binary image of the image retrieved by the method of the present invention.
- FIG. 6A is a horizontal projection histogram of the binary image according to the present invention.
- FIG. 6B is a vertical projection histogram of the binary image according to the present invention.
- FIG. 6C is a schematic diagram of a numeral image according to the present invention with the surrounding blank area excised;
- FIG. 6D is a schematic diagram of cut numeral image according to the present invention.
- FIG. 7 is a schematic diagram of a feature image according to the present invention.
- Step 1 S 1 initiating the process.
- Step 2 S 2 retrieving information of a real-time image that is divided into a plurality of partitions, each having the four corners as the confirmed pixels which are processed within HSL (hue, saturation, lightness) color space.
- HSL hue, saturation, lightness
- 2A is a partial image of the real-time image that is divided into 12 partitions C 1 , C 2 , C 3 , C 4 , C 5 , C 6 , C 7 , C 8 , C 9 , C 10 , C 11 , C 12 , in which the fifth partition C 5 has its four corners as the first, second, third, and fourth confirmed pixels P 1 , P 2 , P 3 , and P 4 , and the sixth partition has its four corners as the second, fourth, fifth, and sixth confirmed pixels P 2 , P 4 , P 5 , and P 6 .
- Step 3 S 3 scanning the color features—hue, saturation, and lightness—of the confirmed pixels and when the features conform to the predetermined ones, rendering the confirmed pixels as candidate pixels which turn the neighboring four partitions into candidate regions.
- the range of the hue is from 0.3 to 0.92 after normalization, but it is not limited to such application.
- the first confirmed pixel P 1 conforms to the predetermined color features and becomes the first candidate pixel T 1 , rendering the neighboring first, second, fourth, and fifth partitions C 1 , C 2 , C 4 , and C 5 as the first, second, fourth, and fifth candidate regions R 1 , R 2 , R 4 , and R 5 .
- Step 4 S 4 searching the neighboring confirmed pixels of the candidate pixels that resemble the features thereof and render them as candidate pixels as well until every neighboring confirmed pixel is checked, and merging all the candidate pixels and the candidate regions thereof together as a group.
- the color features of the second confirmed pixel P 2 resemble the ones of the first candidate pixel T 1 , rendering the second confirmed pixel P 2 as the second candidate pixel T 2 .
- the first and second candidate pixels T 1 , T 2 merge into a group together with the first, second, third, fourth, fifth, and sixth candidate regions R 1 , R 2 , R 3 , R 4 , R 5 , and R 6 .
- Step 5 S 5 conversing the merged candidate regions within HSL color space by adjusting the threshold value of the lightness of said merged candidate regions with adaptive threshold algorithm, conversing into a binary image of lightness W 1 as shown in FIG. 3A , and then conversing the binary image of lightness W 1 into an edge image of lightness E 1 after the edge detection processing as illustrated in FIG. 3B ; then intersecting the edge image of lightness E 1 and a binary image of hue presented in FIG. 3C , conversed from the candidate regions in accordance with its range of color; the result of intersecting is shown in FIG. 3D .
- an edge image E 2 is produced which has a feature of circular image F 1 found after Hough transform algorithm operation and to be compared with a predetermined circular shape of a traffic light.
- Step 6 S 6 referring to FIG. 4 , confirming the feature of circular image F 1 as the shape of a traffic light and then retrieving the center and the diameter D 1 thereof to calculate the displacement ratio D 2 from the circular image F 1 and then retrieve the countdown image F 2 ; if the confirmation failed, go to step 7 S 7 : reexamining the candidate regions for another confirmation process as in step 6 S 6 . If there is another area within the regions to be confirmed, go to step 4 S 4 and run the process again therefrom; if every area within the candidate regions is examined and the confirmation still failed, go to step 11 S 11 : terminating the process.
- Step 8 S 8 as shown in FIG. 5A , enhancing said countdown image F 2 by super resolution algorithm and conversing into a greyscale image V, then adjusting the threshold value thereof by adaptive threshold algorithm and conversing into an image of binary numbers A as presented in FIG. 5B .
- Step 9 S 9 with reference to FIGS. 6A , 6 B, 6 C and 6 D, gathering the horizontal and vertical projection information of the image of binary numbers A, finding the threshold value of the top and bottom margin thereof, excising the surrounding blank area and figuring out the width and the estimated cutting curve G thereof, and then cutting the image of binary numbers along the cutting curve calculated by partial distribution statistics of the vertical projection information near the estimated cutting curve.
- the image of binary numbers A includes a digit of the units A 1 and a digit of the tens A 2 .
- the position of the digit of the units A 1 has to be located first, according to which the one of the digit of the tens A 2 is located as well; then find out the right-hand margin of the digit of the units A 1 , according to which the left-hand margin thereof as well.
- the estimated cutting curve G is therefore confirmed as the left-hand margin of the digit of the units A 1 . Then perform an operation on the vertical projection of the area within 10 pixels extending from the estimated position to both sides thereof, so as to find the exact cutting curve.
- each side of the blocks is defined as 20 pixels, thus defining each block having 400 pixels within.
- Step 10 S 10 classifying and concluding all collected images of numbers by a plurality of classifiers with machine learning algorithm to analyze and compare with the feature image Z, and calculating the percentage of similarity, then bringing out the image of the highest percentage as the recognition result among the ones from the classifiers.
- Step 11 S 11 terminating the process.
- the method for instant recognition of traffic lights countdown image can be written as a program and further applied when being installed on devices with shooting function. For example, it can be applied to navigation systems for best route analysis, instant traffic monitor, or traffic warning system for drivers. Also, it can be applied to cloud systems for keeping track of the countdown of other traffic lights nearby. With the applications, the present invention has achieved effectiveness of instant recognition and expanded tracking and monitoring in the practical fields.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Image Analysis (AREA)
Abstract
Description
- 1. Field of the Invention
- The invention relates to a method for instant recognition of traffic lights countdown image that can quickly scan and confirm the circular feature of a traffic light, and retrieve the countdown image thereof by calculating the displacement ratio from the circular feature, then process the countdown image to display a feature image thereof and bring out the recognition result.
- 2. Description of the Related Art
- Traffic lights have red, yellow, and green lights, among which the red and green lights may have countdown function to remind the drivers when the lights are about to change, so as to eliminate safety concerns during the driving.
- Nevertheless, the drivers may lose attention to the countdown of traffic lights due to poor sight or distraction when driving, and thus cause irreparable loss. Also, optical illusion may happen owning to long time driving or exhaustion; but the optical illusion can be remedied by machine vision to recognize the status of the countdown.
- However, there are still some defects for machine vision to recognize the countdown image of traffic lights because of unexpected situations caused by traffic and environment variation. Firstly, the countdown has different image of numbers with the passing of time; consequently, the machine vision has to process different contours of the numbers individually. When the machine vision cannot proceed with the image of numbers in time, it cannot further proceed with the recognition, therefore decreasing its reliability. Secondly, when the ambient light is weak, the retrieved image may have diffraction areas and result in difficulty in retrieving the exact image and conversing the image to binary mode in accordance with its features. Such problem cannot be solved even if the image is enhanced. Besides, the countdown image is conversed from RGB image to greyscale image, but the LED light source emitting the countdown numbers would cause detailed and undetectable changes of the greyscale image. Hence, the countdown image can be difficult to recognize due to the effects from the ambient lights, and the contours of the figures are different, making the recognizing process even more complicated and the entire process is therefore slower.
- It is a primary object of the present invention to provide a method for instant recognition of traffic lights countdown image that can quickly scan and confirm the circular feature of a traffic light and retrieve the countdown image thereof by calculating the displacement ratio from the circular feature, so as to provide a solution to the problem of finding the countdown image of a traffic light in the prior art.
- Another object of the present invention is to provide a method for instant recognition of traffic lights countdown image that proceeds the countdown image with enhancing, cutting, and recognizing operation, so as to provide a solution to the problem of slow detection of the counting-down in the prior art.
- In order to achieve the objects above, the present invention comprises the following steps: retrieving information of a real-time image that is divided into a plurality of partitions, each having the four corners as confirmed pixels which are processed within HSL (hue, saturation, lightness) color space; scanning the color features—hue, saturation, and lightness—of the confirmed pixels and when the color features conform to the predetermined ones, rendering the confirmed pixels as candidate pixels which turn the neighboring four partitions into candidate regions; searching the neighboring confirmed pixels of the candidate pixels that resemble the features thereof and render them as candidate pixels as well until every neighboring confirmed pixel is checked, and merging all the candidate pixels and the candidate regions thereof together as a group; conversing the merged candidate regions within HSL color space by adjusting the threshold value of the lightness of said merged candidate regions with adaptive threshold algorithm, conversing into a binary image of lightness, and then conversing the binary image of lightness into an edge image of lightness after the edge detection processing, then intersecting the edge image of lightness and a binary image of hue conversed from the candidate regions in accordance with its range of color, and producing an edge image which has a feature of circular image found after Hough transform algorithm operation and to be compared with a predetermined circular shape of a traffic light; confirming the circular feature as the shape of a traffic light and then retrieving a countdown image by calculating the displacement ratio from the circular image; enhancing said countdown image by super resolution algorithm and conversing into a greyscale image, then adjusting the threshold value thereof by adaptive threshold algorithm and conversing into an image of binary numbers; gathering the horizontal and vertical projection information of the image of binary numbers, finding the threshold value of the top and bottom edge thereof and figuring out the width and the estimated cutting curve thereof, and then cutting the image of binary numbers along the cutting curve calculated by partial distribution statistics of the vertical projection information near the estimated cutting curve, then applying the block coding algorithm to display a feature image by dividing the image of binary numbers into equal rectangular blocks, calculating the ratio of black pixels and white pixels of each rectangular block, and encoding the results; and classifying and concluding all collected images of numbers by a plurality of classifiers with machine learning algorithm to analyze and compare with the feature image, and calculating the percentage of similarity, then bringing out the image of the highest percentage as the recognition result among the ones from the classifiers.
- In the process mentioned above, the range of the hue is from 0.3 to 0.92 after normalization.
- As stated above, the present invention can quickly scan and confirm the circular feature of a traffic light, and retrieve the countdown image thereof by calculating the displacement ratio from the circular feature, then enhance, cut and converse the countdown image to display a feature image thereof so as to fulfill the effectiveness of searching and instantly recognizing the countdown image of a traffic light.
-
FIG. 1 is a flow diagram of the present invention; -
FIG. 2A is a schematic diagram illustrating the settling of confirmed pixels of the present invention; -
FIG. 2B is a schematic diagram illustrating a confirmed pixel becoming a candidate pixel and rendering its neighboring area as candidate regions; -
FIG. 2C is a schematic diagram illustrating a resembling confirmed pixel becoming another candidate pixel and rendering its neighboring area as candidate regions; -
FIG. 3A is a schematic diagram of a binary image of lightness conversed from the hue of the candidate regions; -
FIG. 3B is a schematic diagram of an edge image of lightness according to the present invention; -
FIG. 3C is a schematic diagram illustrating the hue of the candidate regions conversing into a binary image; -
FIG. 3D is a schematic diagram of an edge image produced after intersecting process according to the present invention; -
FIG. 3E is a schematic diagram illustrating the circular feature found by the method of the present invention; -
FIG. 4 is a schematic diagram of a countdown image retrieved by the method of the present invention; -
FIG. 5A is a schematic diagram of a greyscale image of the image retrieved by the method of the present invention; -
FIG. 5B is a schematic diagram of a binary image of the image retrieved by the method of the present invention; -
FIG. 6A is a horizontal projection histogram of the binary image according to the present invention; -
FIG. 6B is a vertical projection histogram of the binary image according to the present invention; -
FIG. 6C is a schematic diagram of a numeral image according to the present invention with the surrounding blank area excised; -
FIG. 6D is a schematic diagram of cut numeral image according to the present invention; and -
FIG. 7 is a schematic diagram of a feature image according to the present invention. - Referring to
FIGS. 1 to 7 , a preferred embodiment of the present invention includes steps as following. Step 1 S1: initiating the process. Step 2 S2: retrieving information of a real-time image that is divided into a plurality of partitions, each having the four corners as the confirmed pixels which are processed within HSL (hue, saturation, lightness) color space.FIG. 2A is a partial image of the real-time image that is divided into 12 partitions C1, C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, in which the fifth partition C5 has its four corners as the first, second, third, and fourth confirmed pixels P1, P2, P3, and P4, and the sixth partition has its four corners as the second, fourth, fifth, and sixth confirmed pixels P2, P4, P5, and P6. - Step 3 S3: scanning the color features—hue, saturation, and lightness—of the confirmed pixels and when the features conform to the predetermined ones, rendering the confirmed pixels as candidate pixels which turn the neighboring four partitions into candidate regions. In this embodiment, the range of the hue is from 0.3 to 0.92 after normalization, but it is not limited to such application. In
FIG. 2B , the first confirmed pixel P1 conforms to the predetermined color features and becomes the first candidate pixel T1, rendering the neighboring first, second, fourth, and fifth partitions C1, C2, C4, and C5 as the first, second, fourth, and fifth candidate regions R1, R2, R4, and R5. - Step 4 S4: searching the neighboring confirmed pixels of the candidate pixels that resemble the features thereof and render them as candidate pixels as well until every neighboring confirmed pixel is checked, and merging all the candidate pixels and the candidate regions thereof together as a group. As shown in
FIG. 2C , in this embodiment, the color features of the second confirmed pixel P2 resemble the ones of the first candidate pixel T1, rendering the second confirmed pixel P2 as the second candidate pixel T2. When there is no other candidate pixel, the first and second candidate pixels T1, T2 merge into a group together with the first, second, third, fourth, fifth, and sixth candidate regions R1, R2, R3, R4, R5, and R6. - Step 5 S5: conversing the merged candidate regions within HSL color space by adjusting the threshold value of the lightness of said merged candidate regions with adaptive threshold algorithm, conversing into a binary image of lightness W1 as shown in
FIG. 3A , and then conversing the binary image of lightness W1 into an edge image of lightness E1 after the edge detection processing as illustrated inFIG. 3B ; then intersecting the edge image of lightness E1 and a binary image of hue presented inFIG. 3C , conversed from the candidate regions in accordance with its range of color; the result of intersecting is shown inFIG. 3D . With reference toFIG. 3E , an edge image E2 is produced which has a feature of circular image F1 found after Hough transform algorithm operation and to be compared with a predetermined circular shape of a traffic light. - Step 6 S6: referring to
FIG. 4 , confirming the feature of circular image F1 as the shape of a traffic light and then retrieving the center and the diameter D1 thereof to calculate the displacement ratio D2 from the circular image F1 and then retrieve the countdown image F2; if the confirmation failed, go to step 7 S7: reexamining the candidate regions for another confirmation process as in step 6 S6. If there is another area within the regions to be confirmed, go to step 4 S4 and run the process again therefrom; if every area within the candidate regions is examined and the confirmation still failed, go to step 11 S11: terminating the process. - Step 8 S8: as shown in
FIG. 5A , enhancing said countdown image F2 by super resolution algorithm and conversing into a greyscale image V, then adjusting the threshold value thereof by adaptive threshold algorithm and conversing into an image of binary numbers A as presented inFIG. 5B . -
Step 9 S9: with reference toFIGS. 6A , 6B, 6C and 6D, gathering the horizontal and vertical projection information of the image of binary numbers A, finding the threshold value of the top and bottom margin thereof, excising the surrounding blank area and figuring out the width and the estimated cutting curve G thereof, and then cutting the image of binary numbers along the cutting curve calculated by partial distribution statistics of the vertical projection information near the estimated cutting curve. - In this embodiment, the image of binary numbers A includes a digit of the units A1 and a digit of the tens A2. To find out the estimated cutting curve, the position of the digit of the units A1 has to be located first, according to which the one of the digit of the tens A2 is located as well; then find out the right-hand margin of the digit of the units A1, according to which the left-hand margin thereof as well. The estimated cutting curve G is therefore confirmed as the left-hand margin of the digit of the units A1. Then perform an operation on the vertical projection of the area within 10 pixels extending from the estimated position to both sides thereof, so as to find the exact cutting curve.
- Referring to
FIG. 7 , dividing the image of binary numbers A equally into twenty-one rectangular blocks and assign as B1˜B12; calculating the ratio of black pixels X and white pixels Y of each rectangular block and encoding the results to converse into a feature image Z. The amount of the white pixels Y within each block is the descriptor. Besides, in order to have an identical standard for processing, each side of the blocks is defined as 20 pixels, thus defining each block having 400 pixels within. -
Step 10 S10: classifying and concluding all collected images of numbers by a plurality of classifiers with machine learning algorithm to analyze and compare with the feature image Z, and calculating the percentage of similarity, then bringing out the image of the highest percentage as the recognition result among the ones from the classifiers.Step 11 S11: terminating the process. - The method for instant recognition of traffic lights countdown image can be written as a program and further applied when being installed on devices with shooting function. For example, it can be applied to navigation systems for best route analysis, instant traffic monitor, or traffic warning system for drivers. Also, it can be applied to cloud systems for keeping track of the countdown of other traffic lights nearby. With the applications, the present invention has achieved effectiveness of instant recognition and expanded tracking and monitoring in the practical fields.
Claims (2)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/499,692 US9305224B1 (en) | 2014-09-29 | 2014-09-29 | Method for instant recognition of traffic lights countdown image |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/499,692 US9305224B1 (en) | 2014-09-29 | 2014-09-29 | Method for instant recognition of traffic lights countdown image |
Publications (2)
Publication Number | Publication Date |
---|---|
US20160092742A1 true US20160092742A1 (en) | 2016-03-31 |
US9305224B1 US9305224B1 (en) | 2016-04-05 |
Family
ID=55584793
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/499,692 Expired - Fee Related US9305224B1 (en) | 2014-09-29 | 2014-09-29 | Method for instant recognition of traffic lights countdown image |
Country Status (1)
Country | Link |
---|---|
US (1) | US9305224B1 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150324394A1 (en) * | 2014-05-06 | 2015-11-12 | Shutterstock, Inc. | Systems and methods for color pallete suggestion |
CN106600569A (en) * | 2016-11-28 | 2017-04-26 | 浙江宇视科技有限公司 | Signal lamp color effect enhancement processing method and apparatus thereof |
CN108764216A (en) * | 2018-07-11 | 2018-11-06 | 天津天瞳威势电子科技有限公司 | A kind of traffic lights recognition methods of view-based access control model and device |
US20190279022A1 (en) * | 2018-03-08 | 2019-09-12 | Chunghwa Picture Tubes, Ltd. | Object recognition method and device thereof |
US20200133266A1 (en) * | 2018-10-18 | 2020-04-30 | Cartica Ai Ltd | Safe transfer between manned and autonomous driving modes |
CN113869239A (en) * | 2021-09-30 | 2021-12-31 | 南通大学 | Traffic signal lamp countdown identification system and construction method and application method thereof |
JP7090251B2 (en) | 2016-08-08 | 2022-06-24 | バイエリシエ・モトーレンウエルケ・アクチエンゲゼルシヤフト | A method of detecting an LED light source in a series of image frames, a method of detecting a traffic signal light having at least one LED light source, and a vehicle. |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102012221159A1 (en) * | 2012-11-20 | 2014-05-22 | Robert Bosch Gmbh | Method and device for detecting variable message signs |
CN105832501A (en) * | 2016-03-23 | 2016-08-10 | 京东方科技集团股份有限公司 | Blind person navigation method and blind person navigation equipment |
Family Cites Families (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1220182A3 (en) * | 2000-12-25 | 2005-08-17 | Matsushita Electric Industrial Co., Ltd. | Image detection apparatus, program, and recording medium |
JP4253271B2 (en) * | 2003-08-11 | 2009-04-08 | 株式会社日立製作所 | Image processing system and vehicle control system |
TWI236901B (en) * | 2004-06-11 | 2005-08-01 | Oriental Inst Technology | An apparatus and method for identifying surrounding environment by means of image processing and for outputting the resutls |
JP4631750B2 (en) * | 2006-03-06 | 2011-02-16 | トヨタ自動車株式会社 | Image processing system |
WO2008038370A1 (en) * | 2006-09-28 | 2008-04-03 | Pioneer Corporation | Traffic information detector, traffic information detecting method, traffic information detecting program, and recording medium |
US8751154B2 (en) * | 2008-04-24 | 2014-06-10 | GM Global Technology Operations LLC | Enhanced clear path detection in the presence of traffic infrastructure indicator |
US8233662B2 (en) * | 2008-07-31 | 2012-07-31 | General Electric Company | Method and system for detecting signal color from a moving video platform |
JP5188430B2 (en) * | 2009-03-24 | 2013-04-24 | 富士重工業株式会社 | Image processing device |
JP5462609B2 (en) * | 2009-12-09 | 2014-04-02 | 富士重工業株式会社 | Stop line recognition device |
WO2011074087A1 (en) * | 2009-12-16 | 2011-06-23 | パイオニア株式会社 | Signal identification device, signal identification method, and signal identification program |
US8559673B2 (en) * | 2010-01-22 | 2013-10-15 | Google Inc. | Traffic signal mapping and detection |
US9070305B1 (en) * | 2010-01-22 | 2015-06-30 | Google Inc. | Traffic light detecting system and method |
JP5386539B2 (en) * | 2011-05-12 | 2014-01-15 | 富士重工業株式会社 | Environment recognition device |
JP5537491B2 (en) * | 2011-05-12 | 2014-07-02 | 富士重工業株式会社 | Environment recognition device |
JP5386537B2 (en) * | 2011-05-12 | 2014-01-15 | 富士重工業株式会社 | Environment recognition device |
JP5386538B2 (en) * | 2011-05-12 | 2014-01-15 | 富士重工業株式会社 | Environment recognition device |
JP5272042B2 (en) * | 2011-05-12 | 2013-08-28 | 富士重工業株式会社 | Environment recognition apparatus and environment recognition method |
JP5803402B2 (en) * | 2011-08-08 | 2015-11-04 | 株式会社ソシオネクスト | Image processing apparatus, imaging apparatus, imaging system, and data processing method |
JP5480925B2 (en) * | 2012-03-05 | 2014-04-23 | 本田技研工業株式会社 | Vehicle periphery monitoring device |
US9145140B2 (en) * | 2012-03-26 | 2015-09-29 | Google Inc. | Robust method for detecting traffic signals and their associated states |
JP5397714B1 (en) * | 2012-08-01 | 2014-01-22 | 株式会社ジェイエイアイコーポレーション | Surveillance camera device |
US9158980B1 (en) * | 2012-09-19 | 2015-10-13 | Google Inc. | Use of relationship between activities of different traffic signals in a network to improve traffic signal state estimation |
DE112013003884A5 (en) * | 2012-10-01 | 2015-04-16 | Continental Teves Ag & Co. Ohg | A method of assisting a driver at a traffic light for a vehicle |
EP2923349A4 (en) * | 2012-11-20 | 2016-09-14 | Harman Int Ind | Method and system for detecting traffic lights |
JP6292054B2 (en) * | 2013-11-29 | 2018-03-14 | 富士通株式会社 | Driving support device, method, and program |
JP5852637B2 (en) * | 2013-12-27 | 2016-02-03 | 富士重工業株式会社 | Arrow signal recognition device |
US9205835B2 (en) * | 2014-01-30 | 2015-12-08 | Mobileye Vision Technologies Ltd. | Systems and methods for detecting low-height objects in a roadway |
-
2014
- 2014-09-29 US US14/499,692 patent/US9305224B1/en not_active Expired - Fee Related
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150324394A1 (en) * | 2014-05-06 | 2015-11-12 | Shutterstock, Inc. | Systems and methods for color pallete suggestion |
US10489408B2 (en) * | 2014-05-06 | 2019-11-26 | Shutterstock, Inc. | Systems and methods for color pallete suggestion |
JP7090251B2 (en) | 2016-08-08 | 2022-06-24 | バイエリシエ・モトーレンウエルケ・アクチエンゲゼルシヤフト | A method of detecting an LED light source in a series of image frames, a method of detecting a traffic signal light having at least one LED light source, and a vehicle. |
CN106600569A (en) * | 2016-11-28 | 2017-04-26 | 浙江宇视科技有限公司 | Signal lamp color effect enhancement processing method and apparatus thereof |
US20190279022A1 (en) * | 2018-03-08 | 2019-09-12 | Chunghwa Picture Tubes, Ltd. | Object recognition method and device thereof |
CN110245667A (en) * | 2018-03-08 | 2019-09-17 | 中华映管股份有限公司 | Object discrimination method and its device |
CN108764216A (en) * | 2018-07-11 | 2018-11-06 | 天津天瞳威势电子科技有限公司 | A kind of traffic lights recognition methods of view-based access control model and device |
US20200133266A1 (en) * | 2018-10-18 | 2020-04-30 | Cartica Ai Ltd | Safe transfer between manned and autonomous driving modes |
CN113869239A (en) * | 2021-09-30 | 2021-12-31 | 南通大学 | Traffic signal lamp countdown identification system and construction method and application method thereof |
Also Published As
Publication number | Publication date |
---|---|
US9305224B1 (en) | 2016-04-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9305224B1 (en) | Method for instant recognition of traffic lights countdown image | |
US10133941B2 (en) | Method, apparatus and device for detecting lane boundary | |
US10025998B1 (en) | Object detection using candidate object alignment | |
CN107507167B (en) | Cargo tray detection method and system based on point cloud plane contour matching | |
CN102509098B (en) | Fisheye image vehicle identification method | |
US9773176B2 (en) | Image processing apparatus and image processing method | |
US9224055B2 (en) | Exterior environment recognition device | |
CN104899554A (en) | Vehicle ranging method based on monocular vision | |
US8989439B2 (en) | Environment recognition device and environment recognition method | |
Gomez et al. | Traffic lights detection and state estimation using hidden markov models | |
WO2018040756A1 (en) | Vehicle body colour identification method and device | |
Ellahyani et al. | Traffic sign detection and recognition using features combination and random forests | |
US20120269391A1 (en) | Environment recognition device and environment recognition method | |
KR20150125863A (en) | Apparatus for recognizing of object and method thereof | |
García-Garrido et al. | Robust traffic signs detection by means of vision and V2I communications | |
CN108734172B (en) | Target identification method and system based on linear edge characteristics | |
US10726277B2 (en) | Lane line detection method | |
US11210548B2 (en) | Railroad track recognition device, program, and railroad track recognition method | |
CN110427979B (en) | Road water pit identification method based on K-Means clustering algorithm | |
US11164012B2 (en) | Advanced driver assistance system and method | |
US9558410B2 (en) | Road environment recognizing apparatus | |
CN105117724A (en) | License plate positioning method and apparatus | |
CN110211172B (en) | Fast ground plane discrimination in stereoscopic images | |
JP2014191400A (en) | Image detection apparatus, control program, and image detection method | |
US11415698B2 (en) | Point group data processing device, point group data processing method, point group data processing program, vehicle control device, and vehicle |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: YUAN ZE UNIVERSITY, TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHEN, DUAN-YU;CHOU, YI-TUNG;REEL/FRAME:033845/0496 Effective date: 20140929 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |