CN114333380A - Traffic light identification method and system based on camera and V2x, and vehicle - Google Patents

Traffic light identification method and system based on camera and V2x, and vehicle Download PDF

Info

Publication number
CN114333380A
CN114333380A CN202111520959.4A CN202111520959A CN114333380A CN 114333380 A CN114333380 A CN 114333380A CN 202111520959 A CN202111520959 A CN 202111520959A CN 114333380 A CN114333380 A CN 114333380A
Authority
CN
China
Prior art keywords
vehicle
lane
traffic light
turn
driving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202111520959.4A
Other languages
Chinese (zh)
Inventor
张家彬
肖雄
袁宁
卢斌
谭秀全
梁锋华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing Changan Automobile Co Ltd
Original Assignee
Chongqing Changan Automobile Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing Changan Automobile Co Ltd filed Critical Chongqing Changan Automobile Co Ltd
Priority to CN202111520959.4A priority Critical patent/CN114333380A/en
Publication of CN114333380A publication Critical patent/CN114333380A/en
Withdrawn legal-status Critical Current

Links

Images

Landscapes

  • Traffic Control Systems (AREA)

Abstract

The invention discloses a traffic light identification method based on a camera and V2x, which comprises the following steps: the method comprises the steps that traffic light information is obtained through a camera and a V2x receiving terminal, screening is carried out according to the type of traffic light signals, unconventional vehicle driving indication traffic lights are filtered, and the conventional vehicle driving indication traffic lights are reserved; acquiring driving direction signs of a road surface through a camera, and judging the driving direction type of a lane where the vehicle is located by combining vehicle positioning navigation information and vehicle driving information provided by map positioning navigation, wherein the driving direction type of the lane where the vehicle is located comprises straight running, left turning, right turning and turning around; and judging the effective traffic lights matched with the lane where the vehicle is located according to the reserved normal vehicle running indication traffic lights and the running direction type of the lane where the vehicle is located. By the traffic light identification method based on the camera and the V2x, the accuracy of traffic light identification is effectively improved, and an important floor is laid for realizing urban automatic driving.

Description

Traffic light identification method and system based on camera and V2x, and vehicle
Technical Field
The invention relates to the technical field of urban road auxiliary intelligent driving, in particular to a traffic light identification method and system based on a camera and V2x and a vehicle.
Background
The traditional traffic light identification scheme is based on single or multiple cameras or only depends on V2x to acquire signals, the former can increase the identification accuracy rate by improving the performance of the cameras or increasing the number of the cameras, but cannot solve the problem that the traffic light is physically shielded; the traffic light is perfectly shielded by the latter, but due to the defects of low universality, low popularization speed, high popularization cost and the like of V2x equipment, the traffic light identification of all traffic intersections is difficult to cover.
Disclosure of Invention
The invention aims to provide a traffic light identification method and system based on a camera and V2x and a vehicle, wherein the accuracy of traffic light identification is effectively improved by identifying and judging intersection traffic lights based on the camera and V2x and adding real-time map positioning information, and an important floor is laid for realizing urban automatic driving.
In order to achieve the above object, the present invention provides a traffic light identification method based on a camera and V2x, comprising the steps of:
the method comprises the steps that traffic light information is obtained through a camera and a V2x receiving terminal, screening is carried out according to the type of traffic light signals, unconventional vehicle driving indication traffic lights are filtered, and the conventional vehicle driving indication traffic lights are reserved; wherein the non-conventional vehicle driving indicating traffic light comprises a sidewalk light, a non-motor vehicle light and a slow-down and slow-moving prompting light; conventional vehicle travel indicating traffic lights include traffic lights;
acquiring driving direction signs of a road surface through a camera, and judging the driving direction type of a lane where the vehicle is located by combining vehicle positioning navigation information and vehicle driving information provided by map positioning navigation, wherein the driving direction type of the lane where the vehicle is located comprises straight running, left turning, right turning and turning around;
and judging the effective traffic lights matched with the lane where the vehicle is located according to the reserved normal vehicle running indication traffic lights and the running direction type of the lane where the vehicle is located.
Further, the traffic information is obtained through the camera and the V2x, the unconventional vehicle running indicating traffic lights are screened and filtered according to the types of the traffic light signals, and the conventional vehicle running indicating traffic lights are reserved; the following steps are specifically executed:
(S01) acquiring traffic light and road type signals;
(S02) judging whether a traffic light exists, if yes, turning to the step (S03); otherwise, go to execute step (S01);
(S03) judging whether an unconventional traffic light exists, if so, screening and filtering the unconventional vehicle driving indicating traffic light, and turning to the step (S04); otherwise, go to execute step (S04);
(S04) the normal vehicle running indication traffic light is retained.
Furthermore, the driving direction signs of the road surface are obtained through the camera, and the driving direction types of the lanes where the vehicle is located are judged by combining the vehicle positioning navigation information and the vehicle driving information provided by map positioning navigation, wherein the driving direction types of the lanes where the vehicle is located comprise straight running, left turning, right turning and turning around; judging the effective traffic lights matched with the lane where the vehicle is located according to the reserved conventional vehicle running indication traffic lights and the running direction category of the lane where the vehicle is located, and specifically executing the following steps:
(S11) judging whether there is only one traffic light in front, if yes, outputting the traffic light as an effective traffic light, and ending the process; otherwise, go to execute step (S12);
(S12) judging whether the vehicle is located in the multidirectional drivable lane according to the driving direction sign of the road surface, if so, turning to the execution step (S13); otherwise, go to execute step (S15);
(S13) determining whether the driving intention can be determined without the driving intention violating the lane in which the host vehicle is located; if yes, go to step (S14); otherwise, outputting all traffic lights corresponding to the multi-directional lane of the lane, and ending the process; the whole vehicle driving information is used for determining the driving intention of a driver;
(S14) determining whether the driving intention is straight and located in a straight lane, or right turn and located in a right turn lane, or left turn and located in a left turn lane, or u-turn and located in a u-turn lane;
if the driving intention is straight and is located in a straight lane, the driving direction of the lane where the vehicle is located is straight, then whether a straight lamp exists in the front is judged, if yes, the straight lamp closest to the vehicle in the front is output as an effective traffic lamp matched with the lane where the vehicle is located, and the process is ended; otherwise, the traffic light is not output, and the process is ended;
if the driving intention is left turn and the vehicle is located in a lane capable of left turn, the driving direction type of the lane where the vehicle is located is left turn, then whether a left turn lamp exists in the front or not is judged, if yes, the left turn lamp closest to the vehicle in the front is output as an effective traffic lamp matched with the lane where the vehicle is located, and the process is ended; otherwise, the traffic light is not output, and the process is ended;
if the driving intention is right turn and the vehicle is located in a right turn lane, the driving direction of the lane where the vehicle is located is right turn, then whether a right turn light exists in front or not is judged, if yes, the right turn light closest to the vehicle in front is output as an effective traffic light matched with the lane where the vehicle is located, and the process is ended; otherwise, outputting a straight running light closest to the vehicle in front as an effective traffic light matched with the lane where the vehicle is located, and ending the process;
if the driving intention is turning around and is positioned in a lane capable of turning around; if so, outputting the turning lamp closest to the vehicle in front as an effective traffic lamp matched with the lane where the vehicle is located, and ending the process; otherwise, the traffic light is not output, and the process is ended;
otherwise, the traffic light is not output, and the process is ended;
(S15) determining whether the type of the host vehicle road is a straight lane only, a u-turn lane only, a left-turn lane only, or a right-turn lane only;
if the type of the road of the vehicle is a straight lane, the driving direction type of the lane where the vehicle is located is straight, then whether a straight lamp exists in the front or not is judged, if yes, the straight lamp closest to the vehicle in the front is output as an effective traffic lamp matched with the lane where the vehicle is located, and the process is ended; otherwise, the traffic light is not output, and the process is ended;
if the type of the road of the vehicle is a left-turn lane, the driving direction type of the lane where the vehicle is located is left-turn, then whether a left-turn lamp exists in the front or not is judged, if yes, the left-turn lamp closest to the vehicle in the front is output as an effective traffic lamp matched with the lane where the vehicle is located, and the process is ended; otherwise, the traffic light is not output, and the process is ended;
if the type of the vehicle road is the turning-around lane, the type of the driving direction of the lane where the vehicle is located is turning around, then whether turning-around lamps exist in the front or not is judged, if yes, the turning-around lamps closest to the vehicle in the front are output as effective traffic lamps matched with the lane where the vehicle is located, and the process is ended; otherwise, the traffic light is not output, and the process is ended;
if the type of the road of the vehicle is a right-turn lane, the type of the driving direction of the lane where the vehicle is located is right turn, then whether a right-turn lamp exists in the front or not is judged, if yes, the right-turn lamp closest to the vehicle in the front is output as an effective traffic lamp matched with the lane where the vehicle is located, and the process is ended; otherwise, outputting a straight running light closest to the vehicle in front as an effective traffic light matched with the lane where the vehicle is located, and ending the process;
otherwise, the traffic light is not output, and the process is ended.
Further, the vehicle driving information includes turn signal information and turn angle information.
Further, the driving direction signs of the road surface comprise lane straight running, left turning, right turning, turning around, straight running plus left turning, straight running plus right turning, straight running plus turning around, stop lines, sidewalk early warning lines and special lane character information.
The invention also provides a traffic light identification system based on the camera and the V2x, which comprises the following components:
the V2x receiving terminal is used for acquiring traffic light information in real time;
the camera is used for acquiring traffic light information in real time;
map positioning navigation, which is used for providing the positioning navigation information of the vehicle;
the sensing module is used for acquiring the driving information of the whole vehicle;
the intelligent traffic light controller is used for receiving traffic light information, vehicle positioning navigation information and vehicle driving information, screening and filtering the traffic light information and judging effective traffic lights matched with a lane where the vehicle is located;
the V2x receiving terminal, the camera, the map positioning navigation and sensing module are all connected with an intelligent traffic light controller, and the traffic light identification system based on the camera and V2x is configured to execute the steps of the traffic light identification method based on the camera and V2 x.
Furthermore, the V2x receiving terminal, the camera, the map positioning navigation and sensing module are all connected with the intelligent traffic light controller through a bus CAN.
And the display module is used for receiving the effective traffic light matched with the lane where the vehicle is located and carrying out scene reconstruction and image display, and the display module is connected with the intelligent traffic light controller through a CAN bus.
The invention also provides a vehicle comprising the traffic light identification system based on the camera and the V2 x.
Compared with the prior art, the invention has the following advantages:
according to the traffic light identification method and system based on the camera and the V2x and the vehicle, the identification and judgment of the intersection traffic light are carried out by adding the real-time map positioning information based on the camera and the V2x, so that the accuracy of traffic light identification is effectively improved, the method is visual, accurate and efficient, and an important floor is laid for realizing urban automatic driving.
Drawings
FIG. 1 is a flow chart of a traffic light identification method based on a camera and V2x according to the present invention;
FIG. 2 is a front view of FIG. 1;
fig. 3 is a schematic diagram of the traffic light identification system based on the camera and V2 x.
In the figure:
the system comprises a 1-V2x receiving terminal, a 2-camera, a 3-map positioning navigation, a 4-sensing module, a 5-intelligent traffic light controller and a 6-display module.
Detailed Description
The following further describes embodiments of the present invention with reference to the drawings.
Referring to fig. 1 to 3, the present embodiment discloses a traffic light identification method based on a camera and V2x, which includes the following steps:
the method comprises the steps that traffic light information is obtained through a camera and a V2x receiving terminal, screening is carried out according to the type of traffic light signals, unconventional vehicle driving indication traffic lights are filtered, and the conventional vehicle driving indication traffic lights are reserved; the non-conventional vehicle running indicating traffic light comprises a sidewalk light, a non-motor vehicle light and a deceleration and jogging prompting light, and in some embodiments, the non-conventional vehicle running indicating traffic light further comprises a rider light, and the non-conventional vehicle running indicating traffic light is not limited herein; conventional vehicle travel indicating traffic lights include traffic lights;
acquiring driving direction signs of a road surface through a camera, and judging the driving direction type of a lane where the vehicle is located by combining vehicle positioning navigation information and vehicle driving information provided by map positioning navigation, wherein the driving direction type of the lane where the vehicle is located comprises straight running, left turning, right turning and turning around;
and judging the effective traffic lights matched with the lane where the vehicle is located according to the reserved normal vehicle running indication traffic lights and the running direction type of the lane where the vehicle is located.
The V2x receiving terminal is used for carrying out real-time communication on a traffic light signal sending terminal for road paving; to obtain real-time traffic light information, the V2x receiving terminal obtains traffic light information including traffic light color, shape, type, status (e.g., flashing status), location, and countdown.
The camera acquires videos or pictures through image recognition, and the camera further converts the shot videos and pictures into communication signals which can be used for transmission through an image recognition technology; the traffic light information acquired by the camera comprises the color, shape, type, state, position, countdown, the shape and position of the road surface indicating arrow of the current lane and the adjacent lane and the shape and position of the road surface indicating arrow marked by the guideboard.
The map positioning navigation provides navigation positioning information of the vehicle, navigation planning and lane-level navigation path planning of the vehicle; the host vehicle positioning navigation information includes a lane-level navigation path plan of the host vehicle.
The vehicle travel information is derived from: the vehicle body controller and the steering angle sensor are arranged on the vehicle, and the driving information of the whole vehicle comprises the state of a steering lamp and the steering wheel steering angle state and is used for predicting the steering intention of a driver.
In this embodiment, the traffic information is acquired through the camera and the V2x, the unconventional vehicle driving indicating traffic lights are screened and filtered out according to the types of the traffic light signals, and the conventional vehicle driving indicating traffic lights are reserved; the following steps are specifically executed:
(S01) acquiring traffic light and road type signals;
(S02) judging whether a traffic light exists, if yes, turning to the step (S03); otherwise, go to execute step (S01);
(S03) judging whether an unconventional traffic light exists, if so, screening and filtering the unconventional vehicle driving indicating traffic light, and turning to the step (S04); otherwise, go to execute step (S04);
(S04) the normal vehicle running indication traffic light is retained.
In this embodiment, the driving direction signs of the road surface are acquired through the camera, and the driving direction types of the lanes where the vehicle is located are judged by combining the vehicle positioning navigation information and the vehicle driving information provided by the map positioning navigation, wherein the driving direction types of the lanes where the vehicle is located include straight running, left turning, right turning and turning around; judging the effective traffic lights matched with the lane where the vehicle is located according to the reserved conventional vehicle running indication traffic lights and the running direction category of the lane where the vehicle is located, and specifically executing the following steps:
(S11) judging whether there is only one traffic light in front, if yes, outputting the traffic light as an effective traffic light, and ending the process; otherwise, go to execute step (S12);
(S12) judging whether the vehicle is located in the multidirectional drivable lane according to the driving direction sign of the road surface, if so, turning to the execution step (S13); otherwise, go to execute step (S15);
(S13) determining whether the driving intention can be determined without the driving intention violating the lane in which the host vehicle is located; if yes, go to step (S14); otherwise, outputting all traffic lights corresponding to the multi-directional lane of the lane, and ending the process; the whole vehicle driving information is used for determining the driving intention of a driver; for example, the following steps are carried out: if the driver intention or the driving intention is not contrary to the lane where the vehicle is located, outputting a plurality of matchable traffic lights corresponding to the vehicle lane; such as: and if the vehicle is running straight and turning left, outputting a straight running lamp closest to the vehicle and a left turning lamp closest to the vehicle.
(S14) determining whether the driving intention is straight and located in a straight lane, or right turn and located in a right turn lane, or left turn and located in a left turn lane, or u-turn and located in a u-turn lane;
if the driving intention is straight and is located in a straight lane, the driving direction of the lane where the vehicle is located is straight, then whether a straight lamp exists in the front is judged, if yes, the straight lamp closest to the vehicle in the front is output as an effective traffic lamp matched with the lane where the vehicle is located, and the process is ended; otherwise, the traffic light is not output, and the process is ended;
if the driving intention is left turn and the vehicle is located in a lane capable of left turn, the driving direction type of the lane where the vehicle is located is left turn, then whether a left turn lamp exists in the front or not is judged, if yes, the left turn lamp closest to the vehicle in the front is output as an effective traffic lamp matched with the lane where the vehicle is located, and the process is ended; otherwise, the traffic light is not output, and the process is ended;
if the driving intention is right turn and the vehicle is located in a right turn lane, the driving direction of the lane where the vehicle is located is right turn, then whether a right turn light exists in front or not is judged, if yes, the right turn light closest to the vehicle in front is output as an effective traffic light matched with the lane where the vehicle is located, and the process is ended; otherwise, outputting a straight running light closest to the vehicle in front as an effective traffic light matched with the lane where the vehicle is located, and ending the process;
if the driving intention is turning around and is positioned in a lane capable of turning around; if so, outputting the turning lamp closest to the vehicle in front as an effective traffic lamp matched with the lane where the vehicle is located, and ending the process; otherwise, the traffic light is not output, and the process is ended;
otherwise, the traffic light is not output, and the process is ended;
(S15) determining whether the type of the host vehicle road is a straight lane only, a u-turn lane only, a left-turn lane only, or a right-turn lane only;
if the type of the road of the vehicle is a straight lane, the driving direction of the lane where the vehicle is located is straight, then whether a straight lamp exists in the front is judged, and if yes, the straight lamp closest to the vehicle in the front is output as an effective traffic lamp matched with the lane where the vehicle is located; wherein, the straight lamp comprises a round lamp and a front arrow lamp; otherwise, the traffic light is not output, and the process is ended;
if the type of the road of the vehicle is a left-turn lane, the driving direction type of the lane where the vehicle is located is left-turn, then whether a left-turn lamp exists in the front or not is judged, if yes, the left-turn lamp closest to the vehicle in the front is output as an effective traffic lamp matched with the lane where the vehicle is located, and the process is ended; otherwise, the traffic light is not output, and the process is ended;
if the type of the vehicle road is the turning-around lane, the type of the driving direction of the lane where the vehicle is located is turning around, then whether turning-around lamps exist in the front or not is judged, if yes, the turning-around lamps closest to the vehicle in the front are output as effective traffic lamps matched with the lane where the vehicle is located, and the process is ended; otherwise, the traffic light is not output, and the process is ended;
if the type of the road of the vehicle is a right-turn lane, the type of the driving direction of the lane where the vehicle is located is right turn, then whether a right-turn lamp exists in the front or not is judged, if yes, the right-turn lamp closest to the vehicle in the front is output as an effective traffic lamp matched with the lane where the vehicle is located, and the process is ended; otherwise, outputting a straight running light closest to the vehicle in front as an effective traffic light matched with the lane where the vehicle is located, and ending the process;
otherwise, the traffic light is not output, and the process is ended.
In the present embodiment, the entire vehicle driving information includes turn signal information and turn angle information.
In this embodiment, the driving direction signs of the road surface include lane straight running, left turning, right turning, turning around, straight running + left turning, straight running + right turning, straight running + turning around, stop line, sidewalk early warning line and special lane text information.
Referring to fig. 3, the embodiment further discloses a traffic light identification system based on a camera and V2x, including:
the V2x receiving terminal 1 is used for acquiring traffic light information in real time;
the camera 2 is used for acquiring traffic light information in real time;
map positioning navigation 3 for providing the vehicle positioning navigation information;
the sensing module 4 is used for acquiring the driving information of the whole vehicle; the sensing module 4 comprises a vehicle body controller and a steering angle sensor, and the driving information of the whole vehicle comprises the state of a steering lamp and the steering wheel steering angle state and is used for predicting the steering intention of a driver.
The intelligent traffic light controller 5 is used for receiving the traffic light information, the vehicle positioning navigation information and the vehicle driving information, screening and filtering the traffic light information and judging an effective traffic light matched with a lane where the vehicle is located;
the V2x receiving terminal 1, the camera 2, the map positioning navigation 3 and the sensing module 4 are all connected with the intelligent traffic light controller 5, and the camera and V2 x-based traffic light identification system is configured to execute the steps of the camera and V2 x-based traffic light identification method. The map positioning navigation 3 provides navigation positioning information of the vehicle, provides lane-level navigation path planning of the vehicle according to the navigation planning, and acquires accurate positioning of the vehicle and judgment of the driving direction by combining vehicle driving information (such as a steering lamp, a steering wheel corner and the like) and the identified road driving direction type of the lane where the vehicle is located.
In this embodiment, the V2x receiving terminal 1, the camera 2, the map positioning navigation 3 and the sensing module 4 are all connected with the intelligent traffic light controller 5 through a bus CAN.
In this embodiment, the vehicle-mounted intelligent traffic light control system further comprises a display module 6 for receiving an effective traffic light matched with a lane where the vehicle is located and performing scene reconstruction and image display, wherein the display module 6 is connected with the intelligent traffic light controller 5 through a CAN bus. The display module 6 receives an effective traffic light signal matched with the lane where the vehicle is located on the vehicle-mounted bus through the internal bus transmission module; the display module 6 converts the received signal into image information and performs scene reconstruction on the traffic light image under the rule of UI design thereof. Therefore, a real-time display scheme of the corresponding effective traffic light of the vehicle is realized.
The invention also discloses a vehicle which comprises the traffic light identification system based on the camera and the V2 x.
According to the traffic light identification method and system based on the camera and the V2x and the vehicle, the identification and judgment of the intersection traffic light are carried out by adding the real-time map positioning information based on the camera and the V2x, so that the accuracy of traffic light identification is effectively improved, the method is visual, accurate and efficient, and an important floor is laid for realizing urban automatic driving.
The foregoing detailed description of the preferred embodiments of the invention has been presented. It should be understood that numerous modifications and variations could be devised by those skilled in the art in light of the present teachings without departing from the inventive concepts. Therefore, the technical solutions available to those skilled in the art through logic analysis, reasoning and limited experiments based on the prior art according to the concept of the present invention should be within the scope of protection defined by the claims.

Claims (9)

1. A traffic light identification method based on a camera and V2x is characterized by comprising the following steps:
the method comprises the steps that traffic light information is obtained through a camera and a V2x receiving terminal, screening is carried out according to the type of traffic light signals, unconventional vehicle driving indication traffic lights are filtered, and the conventional vehicle driving indication traffic lights are reserved; wherein the non-conventional vehicle driving indicating traffic light comprises a sidewalk light, a non-motor vehicle light and a slow-down and slow-moving prompting light; conventional vehicle travel indicating traffic lights include traffic lights;
acquiring driving direction signs of a road surface through a camera, and judging the driving direction type of a lane where the vehicle is located by combining vehicle positioning navigation information and vehicle driving information provided by map positioning navigation, wherein the driving direction type of the lane where the vehicle is located comprises straight running, left turning, right turning and turning around;
and judging the effective traffic lights matched with the lane where the vehicle is located according to the reserved normal vehicle running indication traffic lights and the running direction type of the lane where the vehicle is located.
2. The camera and V2 x-based traffic light recognition method according to claim 1, wherein the camera and V2x are used to obtain traffic information, filter and filter out non-conventional vehicle driving traffic lights according to the type of traffic light signal, and keep the conventional vehicle driving traffic lights; the following steps are specifically executed:
(S01) acquiring traffic light and road type signals;
(S02) judging whether a traffic light exists, if yes, turning to the step (S03); otherwise, go to execute step (S01);
(S03) judging whether an unconventional traffic light exists, if so, screening and filtering the unconventional vehicle driving indicating traffic light, and turning to the step (S04); otherwise, go to execute step (S04);
(S04) the normal vehicle running indication traffic light is retained.
3. The camera and V2 x-based traffic light recognition method according to claim 1 or 2, wherein the camera is used to obtain driving direction signs of a road surface, and the driving direction categories of the lane in which the vehicle is located are determined by combining vehicle positioning navigation information and vehicle driving information provided by map positioning navigation, and the driving direction categories of the lane in which the vehicle is located include straight running, left turning, right turning and turning around; judging the effective traffic lights matched with the lane where the vehicle is located according to the reserved conventional vehicle running indication traffic lights and the running direction category of the lane where the vehicle is located, and specifically executing the following steps:
(S11) judging whether there is only one traffic light in front, if yes, outputting the traffic light as an effective traffic light, and ending the process; otherwise, go to execute step (S12);
(S12) judging whether the vehicle is located in the multidirectional drivable lane according to the driving direction sign of the road surface, if so, turning to the execution step (S13); otherwise, go to execute step (S15);
(S13) determining whether the driving intention can be determined without the driving intention violating the lane in which the host vehicle is located; if yes, go to step (S14); otherwise, outputting all traffic lights corresponding to the multi-directional lane of the lane, and ending the process; the whole vehicle driving information is used for determining the driving intention of a driver;
(S14) determining whether the driving intention is straight and located in a straight lane, or right turn and located in a right turn lane, or left turn and located in a left turn lane, or u-turn and located in a u-turn lane;
if the driving intention is straight and is located in a straight lane, the driving direction of the lane where the vehicle is located is straight, then whether a straight lamp exists in the front is judged, if yes, the straight lamp closest to the vehicle in the front is output as an effective traffic lamp matched with the lane where the vehicle is located, and the process is ended; otherwise, the traffic light is not output, and the process is ended;
if the driving intention is left turn and the vehicle is located in a lane capable of left turn, the driving direction type of the lane where the vehicle is located is left turn, then whether a left turn lamp exists in the front or not is judged, if yes, the left turn lamp closest to the vehicle in the front is output as an effective traffic lamp matched with the lane where the vehicle is located, and the process is ended; otherwise, the traffic light is not output, and the process is ended;
if the driving intention is right turn and the vehicle is located in a right turn lane, the driving direction of the lane where the vehicle is located is right turn, then whether a right turn light exists in front or not is judged, if yes, the right turn light closest to the vehicle in front is output as an effective traffic light matched with the lane where the vehicle is located, and the process is ended; otherwise, outputting a straight running light closest to the vehicle in front as an effective traffic light matched with the lane where the vehicle is located, and ending the process;
if the driving intention is turning around and is positioned in a lane capable of turning around; if so, outputting the turning lamp closest to the vehicle in front as an effective traffic lamp matched with the lane where the vehicle is located, and ending the process; otherwise, the traffic light is not output, and the process is ended;
otherwise, the traffic light is not output, and the process is ended;
(S15) determining whether the type of the host vehicle road is a straight lane only, a u-turn lane only, a left-turn lane only, or a right-turn lane only;
if the type of the road of the vehicle is a straight lane, the driving direction type of the lane where the vehicle is located is straight, then whether a straight lamp exists in the front or not is judged, if yes, the straight lamp closest to the vehicle in the front is output as an effective traffic lamp matched with the lane where the vehicle is located, and the process is ended; otherwise, the traffic light is not output, and the process is ended;
if the type of the road of the vehicle is a left-turn lane, the driving direction type of the lane where the vehicle is located is left-turn, then whether a left-turn lamp exists in the front or not is judged, if yes, the left-turn lamp closest to the vehicle in the front is output as an effective traffic lamp matched with the lane where the vehicle is located, and the process is ended; otherwise, the traffic light is not output, and the process is ended;
if the type of the vehicle road is the turning-around lane, the type of the driving direction of the lane where the vehicle is located is turning around, then whether turning-around lamps exist in the front or not is judged, if yes, the turning-around lamps closest to the vehicle in the front are output as effective traffic lamps matched with the lane where the vehicle is located, and the process is ended; otherwise, the traffic light is not output, and the process is ended;
if the type of the road of the vehicle is a right-turn lane, the type of the driving direction of the lane where the vehicle is located is right turn, then whether a right-turn lamp exists in the front or not is judged, if yes, the right-turn lamp closest to the vehicle in the front is output as an effective traffic lamp matched with the lane where the vehicle is located, and the process is ended; otherwise, outputting a straight running light closest to the vehicle in front as an effective traffic light matched with the lane where the vehicle is located, and ending the process;
otherwise, the traffic light is not output, and the process is ended.
4. The camera and V2 x-based traffic light identification method according to claim 3, wherein the entire vehicle driving information includes turn signal information and turn angle information.
5. The camera and V2 x-based traffic light recognition method according to claim 1, 2 or 4, wherein the driving direction signs of the road surface comprise lane straight running, left turning, right turning, u-turn, straight running + left turning, straight running + right turning, straight running + u-turn, stop line, sidewalk precaution line and special lane text information.
6. A camera and V2 x-based traffic light identification system, comprising:
the V2x receiving terminal (1) is used for acquiring traffic light information in real time;
the camera (2) is used for acquiring traffic light information in real time;
a map positioning navigation (3) for providing the vehicle positioning navigation information;
the sensing module (4) is used for acquiring the driving information of the whole vehicle;
the intelligent traffic light controller (5) is used for receiving the traffic light information, the vehicle positioning navigation information and the vehicle driving information, screening and filtering the traffic light information and judging an effective traffic light matched with a lane where the vehicle is located;
the V2x receiving terminal (1), the camera (2), the map positioning navigation (3) and the sensing module (4) are all connected with an intelligent traffic light controller (5), and the camera and V2 x-based traffic light identification system is configured to execute the steps of the camera and V2 x-based traffic light identification method according to any one of claims 1 to 5.
7. The camera and V2 x-based traffic light recognition system according to claim 6, wherein the V2x receiving terminal (1), camera (2), map positioning navigation (3) and sensing module (4) are all connected with an intelligent traffic light controller (5) through a bus CAN.
8. The camera and V2 x-based traffic light recognition system according to claim 6 or 7, further comprising a display module (6) for receiving valid traffic lights matched with the lane where the vehicle is located, performing scene reconstruction and image display, wherein the display module (6) is connected with the intelligent traffic light controller (5) through a CAN bus.
9. A vehicle comprising a camera and V2 x-based traffic light identification system according to any one of claims 6 to 8.
CN202111520959.4A 2021-12-13 2021-12-13 Traffic light identification method and system based on camera and V2x, and vehicle Withdrawn CN114333380A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111520959.4A CN114333380A (en) 2021-12-13 2021-12-13 Traffic light identification method and system based on camera and V2x, and vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111520959.4A CN114333380A (en) 2021-12-13 2021-12-13 Traffic light identification method and system based on camera and V2x, and vehicle

Publications (1)

Publication Number Publication Date
CN114333380A true CN114333380A (en) 2022-04-12

Family

ID=81051297

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111520959.4A Withdrawn CN114333380A (en) 2021-12-13 2021-12-13 Traffic light identification method and system based on camera and V2x, and vehicle

Country Status (1)

Country Link
CN (1) CN114333380A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116824895A (en) * 2023-08-29 2023-09-29 成都通广网联科技有限公司 Network connection system and method for controlling automatic driving vehicle to enter intersection waiting area

Citations (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101772791A (en) * 2007-08-06 2010-07-07 丰田自动车株式会社 Drive assistance device
CN101988831A (en) * 2009-08-03 2011-03-23 阿尔派株式会社 Navigation device and road information prompting method
CN103473946A (en) * 2013-06-25 2013-12-25 中国计量学院 Coordinate-based crossing signal lamp state instant prompting method and coordinate-based crossing signal lamp state instant prompting
CN104376728A (en) * 2013-08-13 2015-02-25 昆山研达电脑科技有限公司 Traffic signal light reminding device and method thereof
CN105185140A (en) * 2015-09-30 2015-12-23 上海修源网络科技有限公司 Auxiliary driving method and system
CN106504554A (en) * 2016-09-30 2017-03-15 乐视控股(北京)有限公司 The method and device of identification traffic light status information
CN107622683A (en) * 2016-07-15 2018-01-23 郑州宇通客车股份有限公司 The crossing passing method and system of autonomous land vehicle
CN107767680A (en) * 2016-08-22 2018-03-06 福特环球技术公司 Crossing traffic signal based reminding method and Vehicular multifunction atmosphere lamp system
CN108154711A (en) * 2016-12-02 2018-06-12 铃木株式会社 Drive assistance device
CN108437986A (en) * 2017-02-16 2018-08-24 上海汽车集团股份有限公司 Vehicle drive assist system and householder method
CN108831175A (en) * 2018-04-19 2018-11-16 北京汽车股份有限公司 Automobile navigation control method, device and vehicle
CN109410604A (en) * 2018-12-25 2019-03-01 重庆长安汽车股份有限公司 Traffic lights information acquisition device and method
CN109409301A (en) * 2018-10-30 2019-03-01 奇瑞汽车股份有限公司 Information acquisition method, device and the storage medium of traffic lights
CN109515316A (en) * 2018-10-17 2019-03-26 上海工程技术大学 A kind of intersection intelligent driving auxiliary system and method
CN109801495A (en) * 2019-01-29 2019-05-24 合肥革绿信息科技有限公司 A kind of signal lamp prompt system and method based on image recognition
CN110415541A (en) * 2019-07-19 2019-11-05 重庆长安汽车股份有限公司 A kind of crossing prevailing state reminding method and system
CN110889965A (en) * 2019-11-22 2020-03-17 北京京东乾石科技有限公司 Unmanned vehicle control method and device and unmanned vehicle
CN111046709A (en) * 2018-10-15 2020-04-21 广州汽车集团股份有限公司 Vehicle lane level positioning method and system, vehicle and storage medium
CN111572472A (en) * 2020-04-30 2020-08-25 汉腾新能源汽车科技有限公司 Method for avoiding running red light
CN211792049U (en) * 2020-04-15 2020-10-27 北京四维图新科技股份有限公司 Vehicle-road cooperative auxiliary system and vehicle
CN112309151A (en) * 2019-08-01 2021-02-02 上海擎感智能科技有限公司 Traffic light state reminding method and device, vehicle machine and vehicle
CN112533174A (en) * 2020-11-24 2021-03-19 东风汽车集团有限公司 Early warning and communication redundancy method and system for red light running scene based on C-V2X
CN112699773A (en) * 2020-12-28 2021-04-23 北京百度网讯科技有限公司 Traffic light identification method and device and electronic equipment
CN113706912A (en) * 2021-08-27 2021-11-26 北京万集科技股份有限公司 Auxiliary driving method and system for vehicle, terminal device and storage medium
CN113715840A (en) * 2021-08-23 2021-11-30 北京汽车研究总院有限公司 Vehicle lane occupation reminding method and device
CN113781808A (en) * 2021-08-30 2021-12-10 东风汽车集团股份有限公司 Method and system for passing internet-connected automatic driving vehicle at traffic light intersection

Patent Citations (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101772791A (en) * 2007-08-06 2010-07-07 丰田自动车株式会社 Drive assistance device
CN101988831A (en) * 2009-08-03 2011-03-23 阿尔派株式会社 Navigation device and road information prompting method
CN103473946A (en) * 2013-06-25 2013-12-25 中国计量学院 Coordinate-based crossing signal lamp state instant prompting method and coordinate-based crossing signal lamp state instant prompting
CN104376728A (en) * 2013-08-13 2015-02-25 昆山研达电脑科技有限公司 Traffic signal light reminding device and method thereof
CN105185140A (en) * 2015-09-30 2015-12-23 上海修源网络科技有限公司 Auxiliary driving method and system
CN107622683A (en) * 2016-07-15 2018-01-23 郑州宇通客车股份有限公司 The crossing passing method and system of autonomous land vehicle
CN107767680A (en) * 2016-08-22 2018-03-06 福特环球技术公司 Crossing traffic signal based reminding method and Vehicular multifunction atmosphere lamp system
CN106504554A (en) * 2016-09-30 2017-03-15 乐视控股(北京)有限公司 The method and device of identification traffic light status information
CN108154711A (en) * 2016-12-02 2018-06-12 铃木株式会社 Drive assistance device
CN108437986A (en) * 2017-02-16 2018-08-24 上海汽车集团股份有限公司 Vehicle drive assist system and householder method
CN108831175A (en) * 2018-04-19 2018-11-16 北京汽车股份有限公司 Automobile navigation control method, device and vehicle
CN111046709A (en) * 2018-10-15 2020-04-21 广州汽车集团股份有限公司 Vehicle lane level positioning method and system, vehicle and storage medium
CN109515316A (en) * 2018-10-17 2019-03-26 上海工程技术大学 A kind of intersection intelligent driving auxiliary system and method
CN109409301A (en) * 2018-10-30 2019-03-01 奇瑞汽车股份有限公司 Information acquisition method, device and the storage medium of traffic lights
CN109410604A (en) * 2018-12-25 2019-03-01 重庆长安汽车股份有限公司 Traffic lights information acquisition device and method
CN109801495A (en) * 2019-01-29 2019-05-24 合肥革绿信息科技有限公司 A kind of signal lamp prompt system and method based on image recognition
CN110415541A (en) * 2019-07-19 2019-11-05 重庆长安汽车股份有限公司 A kind of crossing prevailing state reminding method and system
CN112309151A (en) * 2019-08-01 2021-02-02 上海擎感智能科技有限公司 Traffic light state reminding method and device, vehicle machine and vehicle
CN110889965A (en) * 2019-11-22 2020-03-17 北京京东乾石科技有限公司 Unmanned vehicle control method and device and unmanned vehicle
CN211792049U (en) * 2020-04-15 2020-10-27 北京四维图新科技股份有限公司 Vehicle-road cooperative auxiliary system and vehicle
CN111572472A (en) * 2020-04-30 2020-08-25 汉腾新能源汽车科技有限公司 Method for avoiding running red light
CN112533174A (en) * 2020-11-24 2021-03-19 东风汽车集团有限公司 Early warning and communication redundancy method and system for red light running scene based on C-V2X
CN112699773A (en) * 2020-12-28 2021-04-23 北京百度网讯科技有限公司 Traffic light identification method and device and electronic equipment
CN113715840A (en) * 2021-08-23 2021-11-30 北京汽车研究总院有限公司 Vehicle lane occupation reminding method and device
CN113706912A (en) * 2021-08-27 2021-11-26 北京万集科技股份有限公司 Auxiliary driving method and system for vehicle, terminal device and storage medium
CN113781808A (en) * 2021-08-30 2021-12-10 东风汽车集团股份有限公司 Method and system for passing internet-connected automatic driving vehicle at traffic light intersection

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116824895A (en) * 2023-08-29 2023-09-29 成都通广网联科技有限公司 Network connection system and method for controlling automatic driving vehicle to enter intersection waiting area

Similar Documents

Publication Publication Date Title
US10882532B2 (en) Driving assistance device and driving assistance method
CN105608927A (en) Alerting apparatus
US20100198488A1 (en) Method and device for identifying traffic-relevant information
CN109883438B (en) Vehicle navigation method, device, medium and electronic equipment
US20160347323A1 (en) Driving assistance device and driving assistance method
CN108447305B (en) Pre-warning method and pre-warning system for courier pedestrian
WO2007018145A1 (en) Pavement marking recognition system
CN110276986B (en) Vehicle control device and vehicle control method
CN108248611B (en) Automatic driving method, automobile control equipment, automobile and system
CN110634297B (en) Signal lamp state identification and passing control system based on vehicle-mounted laser radar
US10235976B2 (en) Vehicle display device for changing the position of displayed traffic indicators based on the road having left or right side traffic
CN109712388B (en) Street crossing intention detection system and method for non-motor vehicle or pedestrian
US10102747B2 (en) Intersection traffic signal indicator systems and methods for vehicles
JP2009122825A (en) Traveling state determination device
JP4888285B2 (en) Driving support device, driving support method, and computer program
CN114333380A (en) Traffic light identification method and system based on camera and V2x, and vehicle
CN104228670A (en) Event data recorder of large vehicle and implementation method thereof
CN116745831A (en) Map generation device, map generation program, and in-vehicle device
JP4924303B2 (en) Driving support device, driving support method, and computer program
CN113781836B (en) Driving support device and driving support method
CN110745141A (en) Driving assistance method and device
CN111260943A (en) Intelligent signal sign system for parking yielding intersection and vehicle passing method
JP7507707B2 (en) Control device, mobile object, control method and program
JP3456357B2 (en) Information display device
CN115457786B (en) Method for passing through intersection of unmanned low-speed vehicle

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20220412