WO2016006029A1 - 信号機検出装置及び信号機検出方法 - Google Patents
信号機検出装置及び信号機検出方法 Download PDFInfo
- Publication number
- WO2016006029A1 WO2016006029A1 PCT/JP2014/068105 JP2014068105W WO2016006029A1 WO 2016006029 A1 WO2016006029 A1 WO 2016006029A1 JP 2014068105 W JP2014068105 W JP 2014068105W WO 2016006029 A1 WO2016006029 A1 WO 2016006029A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- traffic signal
- vehicle
- traffic
- search area
- shielding
- Prior art date
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 100
- 238000003384 imaging method Methods 0.000 claims abstract description 12
- 230000000903 blocking effect Effects 0.000 abstract 2
- 238000000034 method Methods 0.000 description 22
- 230000002123 temporal effect Effects 0.000 description 11
- 238000004364 calculation method Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 230000005484 gravity Effects 0.000 description 8
- 230000001133 acceleration Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 238000004590 computer program Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/09623—Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V20/584—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
- B60W30/18—Propelling the vehicle
- B60W30/18009—Propelling the vehicle related to particular drive situations
- B60W30/18154—Approaching an intersection
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Y—INDEXING SCHEME RELATING TO ASPECTS CROSS-CUTTING VEHICLE TECHNOLOGY
- B60Y2400/00—Special features of vehicle units
- B60Y2400/30—Sensors
- B60Y2400/301—Sensors for position or displacement
- B60Y2400/3015—Optical cameras
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
- G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30252—Vehicle exterior; Vicinity of vehicle
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
Definitions
- the present invention relates to a signal detection device and a signal detection method.
- the present invention has been made in view of the above problems, and an object thereof is to provide a traffic signal detection apparatus and a traffic signal detection method capable of appropriately selecting a traffic signal to be detected based on the continuation state of the traffic signal. It is to be.
- a traffic signal detection apparatus and a traffic signal detection method capture a surrounding image by an imaging unit mounted on a vehicle, estimate the position of the traffic signal around the vehicle from the vehicle position and map information, and Set a traffic light search area that is estimated to exist, detect the traffic light search area on the image to detect the traffic light, estimate whether the traffic light is continuously shielded in the traffic light search area, When it is estimated that the shielding continuation state is assumed, the traffic light search region is selected based on the shielding continuation state.
- FIG. 1 is a block diagram showing an example of the configuration of a traffic light detection apparatus according to an embodiment of the present invention.
- FIG. 2 is a block diagram showing an example of the configuration of the position estimation system according to the embodiment of the present invention.
- FIG. 3 is a block diagram showing an example of the configuration of the shielding estimation system according to the embodiment of the present invention.
- FIG. 4 is a block diagram showing an example of the configuration of the traffic light detection system according to the embodiment of the present invention.
- FIG. 5 is a block diagram showing an example of the configuration of the vehicle control system according to the embodiment of the present invention.
- FIG. 6 is a flowchart showing an example of the traffic light detection method according to the embodiment of the present invention.
- FIG. 1 is a block diagram showing an example of the configuration of a traffic light detection apparatus according to an embodiment of the present invention.
- FIG. 2 is a block diagram showing an example of the configuration of the position estimation system according to the embodiment of the present invention.
- FIG. 3 is a block diagram showing
- FIG. 7 is a flowchart showing an example of traffic signal position estimation processing according to the embodiment of the present invention.
- FIG. 8 is a flowchart showing an example of shielding estimation processing according to the embodiment of the present invention.
- FIG. 9 is a flowchart showing an example of traffic signal detection processing according to the embodiment of the present invention.
- FIG. 10 is a flowchart showing an example of the vehicle control process according to the embodiment of the present invention.
- FIGS. 11A and 11B are schematic diagrams illustrating an example of a temporal change of the front image according to the first embodiment of the present invention.
- FIG. 12A is a timing chart showing a change over time of the distance to the stop position according to the first embodiment of the present invention.
- FIG. 12B is a timing chart showing the time change of the vehicle speed according to the first embodiment of the present invention.
- FIG. 12C is a timing chart showing temporal changes in the object position and the traffic light search area position according to the first embodiment of the present invention.
- FIG. 12 (d) is a timing chart showing temporal changes in the relative position of the traffic light search area with respect to the object position according to the first embodiment of the present invention.
- FIGS. 13A and 13B are schematic diagrams illustrating an example of a temporal change of the front image according to the second embodiment of the present invention.
- FIG. 14A is a timing chart showing a change over time in the distance to the stop position according to the second embodiment of the present invention.
- FIG. 14 (b) is a timing chart showing the time change of the vehicle speed according to the second embodiment of the present invention.
- FIG. 14C is a timing chart showing temporal changes in the object position and the traffic light search area position according to the second embodiment of the present invention.
- FIG. 14 (d) is a timing chart showing the time change of the relative position of the traffic light search area with respect to the object position according to the second embodiment of the present invention.
- FIGS. 15A and 15B are schematic diagrams illustrating an example of a temporal change of the front image according to the third embodiment of the present invention.
- FIG. 16A is a timing chart showing a change over time of the distance from the stop position according to the third embodiment of the present invention.
- FIG. 16B is a timing chart showing the time change of the vehicle speed according to the third embodiment of the present invention.
- FIG. 16C is a timing chart showing temporal changes in the object position and the traffic light search area position according to the third embodiment of the present invention.
- FIG. 16D is a timing chart showing temporal changes in the relative position of the traffic light search area with respect to the object position according to the third embodiment of the present invention.
- FIGS. 17A and 17B are schematic diagrams illustrating an example of a temporal change of the front image according to the fourth embodiment of the present invention.
- FIG. 18A is a timing chart showing a change over time of the distance to the stop position according to the fourth embodiment of the present invention.
- FIG. 18B is a timing chart showing the time change of the vehicle speed according to the fourth embodiment of the present invention.
- FIG. 18C is a timing chart showing temporal changes in the object position and the traffic light search area position according to the fourth embodiment of the present invention.
- FIG. 18D is a timing chart showing temporal changes in the relative position of the traffic light search area with respect to the object position according to the fourth embodiment of the present invention.
- the traffic light detection apparatus 10 can be applied to a vehicle capable of automatic driving.
- the traffic signal detection apparatus 10 includes a position estimation system 1, a shielding estimation system 2, a traffic signal detection system 3, and a vehicle control system 4.
- the position estimation system 1, the shielding estimation system 2, the traffic light detection system 3, and the vehicle control system 4 can be realized mainly using a central processing unit (CPU), a microcontroller including a memory and an input / output unit, or the like.
- the CPU configures a plurality of information processing units 1 to 4 by executing computer programs installed in advance.
- the microcontroller may also be used as an electronic control unit (ECU) used for automatic driving control of the vehicle.
- ECU electronice control unit
- the position estimation system 1 includes position information D1 including the position of the host vehicle obtained from the global positioning system (GPS) and the number of wheel rotations, and shielding information D4 including the shielding state of the traffic light by an object (shielding object) Is entered.
- the object that blocks the traffic light is not particularly limited, and examples thereof include a preceding vehicle, an oncoming vehicle, a roadside tree, a signboard, and a sign.
- the position estimation system 1 estimates the position of a traffic light existing at an intersection where the host vehicle is approaching.
- the position estimation system 1 outputs road information D2 including the distance from the position of the host vehicle to the approaching intersection and traffic signal area information D3 regarding the estimated position of the traffic light.
- the shielding estimation system 2 includes signal area information D3 output from the position estimation system 1, sensor information D5 obtained from various sensors such as a laser, a millimeter wave radar, and a stereo camera mounted on the host vehicle, and information on the host vehicle.
- the video signal D6 obtained from the mounted imaging unit or the like and the traffic signal detection result D7 output from the traffic signal detection system 3 are input.
- the sensor information D5 includes a distance to an object around the host vehicle.
- the video signal D6 includes regulatory information such as white lines and yellow lines drawn on the road.
- the shielding estimation system 2 estimates the shielding state of the traffic light existing at the approaching intersection, and outputs the estimation result as shielding information D4.
- the traffic signal detection system 3 receives the traffic signal area information D3 output from the position estimation system 1 and the video signal D6 obtained from an imaging unit or the like mounted on the host vehicle.
- the traffic signal detection system 3 detects a traffic signal from surrounding images and outputs a traffic signal detection result D7.
- the vehicle control system 4 includes road information D2 output from the position estimation system 1, shielding information D4 output from the shielding estimation system 2, a traffic light detection result D7 output from the traffic light detection system 3, and the own vehicle.
- a vehicle signal D8 including a vehicle speed obtained from various mounted sensors or the like is input.
- the vehicle control system 4 determines an approach method (vehicle control method) for approaching an intersection such as following the preceding vehicle, decelerating stop, and accelerating, and outputs it as control information D9 for vehicle control.
- the position estimation system 1 includes a vehicle position detection unit 11, a map information unit (map database) 12, and a traffic signal position estimation unit 13, as shown in FIG.
- the vehicle position detection unit 11 is based on the position information D1 including the position of the host vehicle obtained from the GPS, the number of rotations of the wheels, and the like, and road information D2 obtained from the map information stored in the map information unit 12.
- the relative position and posture of the host vehicle with respect to the road are detected and output as the vehicle position D11.
- the map information unit 12 stores map information including road information D2 in a memory in advance. Based on the vehicle position D11 output by the vehicle position detection unit 11, the map information unit 12 determines from the map information the traffic light coordinates D12 of the traffic light installed at the intersection where the host vehicle is approaching and the road information in the vehicle traveling direction. D2 is extracted.
- the traffic signal position estimation unit 13 estimates the relative position of the traffic signal with respect to the host vehicle based on the traffic signal coordinates D12 obtained from the map information unit 12.
- the traffic signal position estimation unit 13 further sets an area where it is estimated that there is a high possibility that a traffic signal exists based on the relative position of the traffic signal as a traffic signal search area.
- the traffic signal search area can be appropriately set within a predetermined range according to the detection accuracy of the vehicle position D11 and the like.
- the traffic signal position estimation unit 13 sets a traffic signal search area for each of the plurality of traffic lights. Furthermore, the traffic signal position estimation unit 13 selects and sets one or a plurality of traffic signal search areas as a traffic signal detection target area from a plurality of traffic signal search areas according to a predetermined priority. In addition, according to a predetermined priority order, it was possible to detect the traffic signal after trying to detect the traffic signal once for all the traffic signal search areas without narrowing down and selecting the traffic signal detection target area from the traffic signal search areas. The traffic signal search area may be narrowed down and selected as the traffic signal detection target area.
- the priority order of the traffic light located on the opposite lane side is set higher than the traffic light located on the own lane side.
- traffic lights located on the own lane side will be continuously shielded by a preceding vehicle or a roadside tree.
- a traffic signal located on the oncoming lane side is temporarily blocked by the oncoming vehicle for a short time. For this reason, it is possible to increase the detection probability of the traffic signal by giving priority to the traffic signal located on the opposite lane side.
- the priority of the traffic lights closer to the own vehicle is set higher than the traffic lights far from the own vehicle. Since the traffic signal closer to the own vehicle is reflected in the image, the traffic signal can be easily detected.
- the traffic signal search area of the traffic signal located on the opposite lane side is preferentially selected and set as the traffic signal detection target area.
- the traffic signal on the own lane side is continuously shielded by the preceding vehicle. For this reason, the detection efficiency of a traffic signal can be improved by selecting the traffic signal search area of the traffic signal located on the opposite lane side.
- the predetermined priority order can be appropriately set in addition to the above.
- the predetermined priority order may be stored in advance in the memory.
- the traffic signal position estimation unit 13 selects a traffic signal search region based on the shielding information D4 output from the shielding estimation system 2. For example, when it is estimated that the traffic signal search area of the currently set traffic signal is not shielded or shielded but is temporary and eliminated, the traffic signal position estimation unit 13 is currently set. Select to maintain the traffic signal search area. On the other hand, when the traffic signal search area of the currently set traffic signal is estimated to be currently shielded or shielded in the future, and when it is estimated to be continuous shielding Performs a selection to switch the detection target area of the traffic signal from the currently set traffic signal search area to the traffic signal search area of another traffic signal.
- the currently set traffic signal search area is selected to be excluded from the traffic signal detection target area, and the traffic signal search area of another traffic signal is selected to be set as a new traffic signal detection target area.
- the traffic signal position estimating unit 13 outputs the traffic signal area information D3 including the traffic signal search area selected as the traffic signal detection target area.
- some traffic signal search areas are currently shielded or estimated to be shielded in the future, and this is continuous. If it is estimated that the traffic signal is to be shielded, the traffic signal search area in which continuous shielding is estimated is selected to be excluded from the traffic signal detection target area, and the other traffic signal search areas are continued as the traffic signal detection target area. You may make it perform selection to do.
- the shielding estimation system 2 includes an object detection unit 21 and a shielding estimation unit 22.
- the object detection unit 21 detects an object existing around the vehicle based on the sensor information D5 including the distance to the object existing around the vehicle and the video signal D6 including regulation information such as a white line and a yellow line around the vehicle. .
- the detected object for example, a preceding vehicle, an oncoming vehicle, a roadside tree, a signboard, a sign, and the like are assumed.
- the object detection unit 21 further calculates a relative position, a moving direction, and a moving speed of the object with respect to the own vehicle for each detected object, and outputs the calculated object position D11.
- the occlusion estimation unit 22 determines from the host vehicle the positional relationship between the traffic signal search area and the object. It is determined whether or not the traffic signal search area is currently occluded by the object. At this time, it may be determined that the traffic signal search area is shielded when it is completely shielded by the object, or it is determined that the traffic signal search area is shielded even when the traffic signal search area is partially shielded by the object. May be.
- the shielding estimation unit 22 may determine that the traffic signal search area is shielded when the traffic signal detection result D7 output from the traffic signal detection system 3 indicates that the traffic signal cannot be detected.
- the shielding estimation unit 22 further includes a relative position of the host vehicle, the traffic signal search area, and the object, From the moving direction and moving speed, it is determined (estimated) whether the traffic signal search area will be blocked by an object in the future.
- the shielding estimation unit 22 determines whether it is continuous shielding or temporary shielding.
- continuous shielding is a situation where the traffic light on the own lane side remains shielded by roadside trees, or when the traffic signal on the own lane side is shielded whenever there is a preceding vehicle and the inter-vehicle distance becomes narrower. is assumed.
- temporary shielding for example, a traffic light on the oncoming lane side is temporarily shielded by an oncoming vehicle, but it is assumed that the shielding is canceled when the host vehicle and the oncoming vehicle pass each other.
- the shielding estimation unit 22 is based on the relative position, the moving direction, the moving speed, and the like of the own vehicle, the object and the traffic light search area, The shielding time of the traffic signal search area (in other words, the time until shielding is eliminated) is calculated.
- the shielding estimation unit 22 further determines that the shielding is temporary if the calculated shielding time is equal to or shorter than a predetermined time (threshold). On the other hand, if the shielding time is longer than the predetermined time (threshold), it is determined that the shielding is continuous.
- the threshold for comparison with the shielding time can be appropriately set by the shielding estimation unit 22 or the like.
- the threshold is set to a time during which the vehicle can decelerate and stop at the stop position of the intersection.
- the threshold value in this case is, for example, calculating the time that the host vehicle must start the deceleration control from the position of the host vehicle, the distance to the stop position of the intersection, the vehicle speed of the host vehicle, and the allowable deceleration. Can be set.
- the shielding estimation unit 22 may determine that the shielding is continuous when the object and the traffic signal search area are moving at least in the same direction.
- the traffic signal detection system 3 includes an imaging unit 31 and a traffic signal detection unit 32.
- the imaging unit 31 is a digital camera such as a CCD camera or a CMOS camera, for example, and images a landscape around the vehicle and acquires a surrounding image.
- the angle of view of the imaging unit 31 may be fixed, and may be appropriately adjusted in the vertical direction and the horizontal direction based on the video signal D6 and the like.
- the traffic light detection unit 32 associates the image D31 captured by the imaging unit 31 with the traffic signal area information D3 output from the traffic signal position estimation unit 13, and sets a traffic signal search area on the image D31.
- the traffic signal detector 32 further searches for a traffic signal search area on the image D31 to detect a traffic signal.
- a signal detection method for example, a synchronous detection process based on an AC cycle of a commercial power supply, a hue and shape similarity determination process, and other known algorithms can be employed.
- the traffic signal detector 32 outputs a traffic signal detection result D7 including the color information of the traffic light.
- the traffic signal detection unit 32 outputs a traffic signal detection result D7 including that the traffic signal could not be detected.
- the vehicle control system 4 includes a vehicle signal acquisition unit 41, an inter-vehicle and stop position calculation unit 42, and a vehicle control unit 43.
- the vehicle signal acquisition unit 41 acquires the vehicle signal D8 and extracts vehicle speed information D41 including the vehicle speed of the host vehicle from the vehicle signal D8.
- the inter-vehicle and stop position calculation unit 42 determines whether the preceding vehicle and the stop position calculation unit 42 are based on the vehicle speed information D41 or the like. The distance between the vehicle and the vehicle is calculated. The inter-vehicle and stop position calculation unit 42 calculates the time until a collision for not only a preceding vehicle but also an obstacle on the course.
- the inter-vehicle and stop position calculation unit 42 determines the position of the host vehicle when there is a stop line (stop position) such as a stop line at the next intersection. Calculate the distance from to the stop position. The calculation results by the inter-vehicle and stop position calculation unit 42 are output as inter-vehicle and stop position information D42.
- the vehicle control unit 43 controls the vehicle when approaching the intersection based on the traffic signal detection result D7 output from the traffic signal detection unit 32 and the inter-vehicle and stop position information D42 output from the inter-vehicle and stop position calculation unit 42. A method is selected and output as control information D9.
- the vehicle control unit 43 determines that the traffic signal is continuously blocked by the preceding vehicle. If it is determined that the vehicle can stop before the vehicle, it is selected to follow the preceding vehicle. In addition, the vehicle control unit 43 indicates that the traffic signal is continuously blocked by the preceding vehicle, and the vehicle control unit 43 determines that the vehicle cannot stop to the stop position at normal deceleration based on the inter-vehicle and stop position information D42. If so, select Deceleration.
- the vehicle control unit 43 selects that the current vehicle speed is to be maintained when the traffic signal is indicated by the shielding information D4 and the color of the traffic light included in the traffic signal detection result D7 is blue. . Further, the vehicle control unit 43 indicates that the traffic signal is not shielded by the shielding information D4, the color of the traffic light included in the traffic signal detection result D7 is red, and a normal deceleration from the current vehicle speed. To stop at the stop position, select deceleration. In addition, the vehicle control unit 43 indicates that the traffic signal is not shielded by the shielding information D4, and when the color of the traffic light included in the traffic signal detection result D7 changes from red to blue during deceleration, Select acceleration to restore speed to speed limit.
- the vehicle control unit 43 cancels the traffic signal shielding based on the relative positional relationship between the host vehicle, the object, and the traffic signal.
- the traffic signal can be easily detected by reducing the speed so that the distance between the preceding vehicle and the preceding vehicle is increased.
- it is possible to easily detect the traffic signal by performing steering control so that the vehicle approaches one of the left and right sides in the lane.
- FIG. 6 shows the overall processing flow of the traffic signal detection method.
- the position estimation system 1 mainly estimates the position of the traffic light installed at the intersection where the vehicle is approaching. The details are shown in the flowchart of FIG.
- the vehicle position detection unit 11 detects the position and posture of the host vehicle based on the position information D1 and the road information D2, and outputs it as the vehicle position D11.
- the map information unit 12 outputs the traffic light coordinates D12 of the traffic light set at the intersection where the vehicle is approaching based on the vehicle position D11.
- step S13 the traffic signal position estimating unit 13 determines the presence or absence of a traffic signal installed at the approaching intersection from the vehicle position D11 and the traffic light coordinates D12. If it is determined that there is no traffic light, the process is completed. On the other hand, if it is determined that there is a traffic light, the process proceeds to step S14.
- step S14 the traffic signal position estimation unit 13 estimates the relative position of the traffic signal with respect to the host vehicle from the vehicle position D11 and the traffic light coordinates D12. The traffic signal position estimation unit 13 further sets an area where it is estimated that there is a high possibility that a traffic signal exists as a traffic signal search area. Further, when there are a plurality of traffic signal search areas, the traffic signal position estimation unit 13 selects and sets one or a plurality of traffic signal search areas as detection target areas of the traffic lights according to a predetermined priority.
- the shielding estimation system 2 mainly estimates the shielding state of the traffic light by the object.
- the object detection unit 21 detects an object around the vehicle based on the sensor information D5 including the distance to the object around the vehicle, the video signal D6, and the like.
- the object detection unit 21 further calculates the relative position, moving direction, and moving speed of the object with respect to the host vehicle for each detected object.
- step S23 the shielding estimation unit 22 determines whether the traffic signal search area is shielded by the object based on the positional relationship between the traffic signal search area and the object. Further, the shielding estimation unit 22 determines whether or not the traffic signal will be shielded in the future by the object, based on the traffic signal search area and the position, moving direction, and moving speed of the object. When it is determined that the traffic signal is not shielded now or in the future, the process proceeds to step S29, and the traffic signal position estimation unit 13 maintains the currently set traffic signal search area without switching. On the other hand, if it is determined in step S23 that the traffic light is currently blocked or will be blocked in the future, the process proceeds to step S24.
- step S24 the shielding estimation unit 22 calculates a time (shielding time) until shielding of the traffic signal search area is canceled based on the traffic signal search area and the position, moving direction, and moving speed of the object.
- step S25 the shielding estimation unit 22 reads a threshold value from the memory and determines whether or not the shielding time is equal to or greater than the threshold value. When the shielding time is equal to or less than the threshold, it is determined that the shielding is temporary, the process proceeds to step S29, and the traffic signal position estimation unit 13 maintains the currently set traffic signal search area without switching. On the other hand, if the time until the shielding is eliminated in step S25 is longer than the threshold, it is determined that the shielding is continuous, and the process proceeds to step S26.
- step S26 the traffic signal position estimation unit 13 determines whether there is a candidate for another traffic signal in the currently set traffic signal search area. If it is determined that there is another traffic signal candidate, the process proceeds to step S27, and the traffic signal detection target is switched to the traffic signal search area corresponding to the other traffic signal. On the other hand, if it is determined in step S26 that there are no other traffic signal candidates, the process proceeds to step S28, and vehicle control is performed so that safety can be ensured even if the traffic signal is shielded.
- step S3 the traffic signal detection system 3 mainly detects traffic signals around the vehicle.
- the imaging unit 31 acquires an image D31.
- step S32 the traffic signal detection unit 32 associates the image D31 with the traffic signal search area, and sets the traffic signal search area on the image D31.
- step S33 the traffic signal detection unit 32 searches the traffic signal search area on the image D31 to detect a traffic signal.
- step S4 the vehicle control system 4 mainly controls the vehicle according to the shielding state of the traffic light.
- the vehicle signal acquisition unit 41 acquires the vehicle signal D8, and extracts the vehicle speed information D41 included in the vehicle signal D8.
- the inter-vehicle and stop position calculation unit 42 calculates the inter-vehicle distance between the own vehicle and the preceding vehicle and the distance from the position of the own vehicle to the stop position of the intersection based on the road information D2.
- step S43 the vehicle control unit 43 selects a vehicle control method according to the shielding information D4, the traffic signal detection result D7, the distance between vehicles and the stop position information D42, and outputs the vehicle control method as control information D9.
- the ECU mounted on the vehicle performs vehicle control according to the control information.
- a traffic signal 101 on the own lane side and a traffic signal 102 on the opposite lane side are installed at an intersection in front of the vehicle.
- the traffic signal search area A11 of the traffic signal 101 on the own lane side is partially shielded by the roadside tree 100.
- the traffic signal search area A ⁇ b> 11 of the traffic light 101 on the own lane side is continuously shielded by the street tree 100.
- the traffic signal search area A12 of the traffic signal 102 on the opposite lane side is reflected in the image without being blocked.
- FIG. 12A shows the time change of the distance to the stop position of the vehicle
- FIG. 12B shows the time change of the vehicle speed
- FIG. 12C shows the vanishing point in the front image.
- FIG. 12 (d) shows the time change of the position (the center of gravity position in the vehicle width direction) of the object (street tree) 100 and the traffic signal search areas A 11 and A 12, and FIG. The time change of a position (center of gravity position in the vehicle width direction) is shown.
- the shielding estimation unit 22 has the traffic signal search area A11 and the street tree 100 in close proximity, and the street tree 100 searches for the traffic signal. It is determined that the area A11 is shielded. Further, the shielding estimation unit 22 moves at substantially the same speed in substantially the same direction while the traffic signal search area A11 and the roadside tree 100 are close to each other after time t10, and the shielding time is longer than the predetermined time (threshold value) T1. Estimate continuous shielding.
- the traffic signal position estimation unit 13 switches the traffic signal search area A12 of another traffic signal 102 to the traffic signal detection target.
- the traffic signal detector 32 detects the traffic signal 102 from the traffic signal search area A12.
- the traffic light 102 is detected to be red by the traffic light detection unit 32, as shown in FIGS. 12 (a) and 12 (b)
- the vehicle starts decelerating at time t11, and at the stop position of the intersection at time t12. Stop.
- FIG. 13A shows a state of following the preceding vehicle 200, and there is a traffic signal 201 on the own lane side and a traffic signal 202 on the opposite lane side at the intersection in front of the vehicle.
- FIG. 13B when the preceding vehicle 200 decelerates or stops due to a red signal, the distance between the own vehicle and the preceding vehicle 200 is reduced, and the traffic signal search area A21 of the traffic signal 201 on the own lane side is blocked. It can be said that it is a continuous shielding state.
- FIG. 14 (a) shows the time change of the distance to the stop position
- FIG. 14 (b) shows the time change of the vehicle speed
- FIG. 14 (c) shows the object
- FIG. 14 (d) shows the time changes of the positions of the preceding vehicle) 200 and the traffic signal search areas A21, A22 (the center of gravity position in the vehicle width direction). The time change of the center of gravity position in the vehicle width direction is shown.
- the shielding estimation unit 22 determines that the traffic signal search area A21 is shielded by the preceding vehicle 200 at a future time t21, as shown in FIGS. 14 (c) and 14 (d). Furthermore, the shielding estimation unit 22 estimates that the preceding vehicle 200 is continuously shielded because the estimated position of the preceding vehicle 200 does not change much and the shielding time is longer than the predetermined time (threshold value) T2.
- the traffic signal position estimation unit 13 switches the traffic signal search area A22 of the traffic signal 202 on the opposite lane side to the traffic signal detection target.
- the switching from the traffic signal search area A21 to the traffic signal search area A22 may be performed immediately at time t20 or may be performed when the traffic signal search area A21 is shielded at time t21.
- the traffic signal detector 32 detects the traffic signal 202 from the traffic signal search area A22 selected as the detection target.
- the traffic light 202 is detected to be red by the traffic light detection unit 32, as shown in FIGS. 14 (a) and 14 (b)
- the vehicle starts decelerating at time t22, and at the stop position of the intersection at time t23. Stop.
- FIG. 15A shows a state where the host vehicle is stopped together with the preceding vehicle 300 at the intersection
- FIG. 15B shows a state after the preceding vehicle 300 has started.
- FIG. 16A shows the time change of the distance from the stop position
- FIG. 16B shows the time change of the vehicle speed
- FIG. 16C shows the preceding vehicle with respect to the vanishing point in the front image
- FIG. 16D shows the time change of the position 300 (the center of gravity position) and the positions of the traffic signal search areas A31, A32 (the center of gravity position in the vehicle width direction). The time change of the center of gravity position in the vehicle width direction is shown.
- the shielding estimation unit 22 determines that the preceding vehicle 300 has started and the shielding of the traffic light search area A31 has been eliminated. Thereafter, at time t32, the host vehicle starts as shown in FIGS. 16 (a) and 16 (b).
- the traffic light search area A32 is out of the field of view. For this reason, at the time t32 before that, the traffic signal detection area A31 is switched from the traffic signal search area A32 to the traffic signal search area A31 in which shielding is eliminated.
- FIG. 17A shows a situation where there is an oncoming vehicle 400 and the traffic signal search area A41 is shielded
- FIG. 17B shows a traffic signal search area when the host vehicle and the oncoming vehicle 400 move so as to pass each other.
- the situation where the traffic light 401 corresponding to A41 is reflected is shown.
- FIG. 18A shows a time change of the distance to the stop position
- FIG. 14B shows a time change of the vehicle speed
- FIG. 18C shows an object
- FIG. 18 (d) shows the relative position (in the vehicle width direction) of the traffic signal search area A41 with respect to the object (opposite vehicle) 400.
- FIG. The time change of the center of gravity position) is shown.
- the shielding estimation unit 22 estimates that the traffic light search area A41 is shielded by the oncoming vehicle 400 at a future time t41, as shown in FIGS. 18 (a) and 18 (b).
- the shielding estimation unit 22 further calculates a shielding time T41 from the moving direction and moving speed of the oncoming vehicle 400 with respect to the traffic signal search area A41.
- the shielding estimation unit 22 further compares the shielding time T41 with a predetermined time (threshold value) T42 required for deceleration and stopping. Since the shielding time T41 is equal to or shorter than the predetermined time T42, it is estimated that the shielding is temporary.
- the traffic signal position estimation unit 13 maintains the currently set traffic signal search area A41 and waits for cancellation of the traffic signal search area A41 even if other traffic signal candidates exist in the same intersection.
- the traffic signal detection unit 32 searches the traffic signal search area A41 to detect the traffic signal.
- the current and future shielding states due to the traffic light object are estimated, and the traffic light search area is selected and set based on the estimated shielding state, so that the traffic light is detected.
- the traffic signal search area can be appropriately selected. As a result, the traffic signal at the intersection can be detected with high accuracy.
- the traffic light's shielding time is estimated, and when the estimated shielding time is less than or equal to a threshold, the set traffic signal search area is maintained, The traffic light can be detected after the temporary shielding is eliminated, and the traffic light search area need not be switched unnecessarily. As a result, the load on the traffic light detection device 10 can be reduced.
- the traffic lights can be detected by switching from the set traffic light search area to the traffic light search area of another traffic light.
- a suitable traffic light search area can be selected appropriately.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Multimedia (AREA)
- Automation & Control Theory (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
本発明の実施の形態に係る信号機検出装置10は、自動運転可能な車両に適用しうる。本発明の実施の形態に係る信号機検出装置10は、図1に示すように、位置推定システム1、遮蔽推定システム2、信号機検出システム3及び車両制御システム4を備える。
物体検出部21は、車両周囲に存在する物体までの距離を含むセンサ情報D5及び車両周囲の白線、黄線等の規制情報を含む映像信号D6に基づいて、車両周囲に存在する物体を検出する。検出される物体としては、例えば、先行車や対向車、街路樹、看板、標識等が想定される。物体検出部21は更に、検出された物体のそれぞれについて、自車両に対する物体の相対位置、移動方向及び移動速度を計算し、物体位置D11として出力する。
次に、図6~図10のフローチャートを参照しながら、本発明の実施の形態に係る信号機検出方法の一例を説明する。本発明の実施の形態に係る信号機検出方法の一連の処理は所定の間隔で繰り返し実行することができる。
次に、本発明の第1の実施例として、図11及び図12を用いて、信号機の近くの街路樹や看板により信号機が継続的に遮蔽される場合を説明する。
次に、本発明の第2の実施例として、図13及び図14を用いて、先行車により継続的に遮蔽される場合を説明する。
次に、本発明の第3の実施例として、図15及び図16を用いて、先行車があり交差点で停車している場合を説明する。
次に、本発明の第4の実施例として、図17及び図18を用いて、対向車等による一時的遮蔽の場合を説明する。
本発明の実施の形態によれば、信号機の物体による現在及び将来の遮蔽状態を推定し、推定された遮蔽状態に基づいて信号機探索領域を選択して設定することにより、信号機の検出対象とする信号機探索領域を適切に選択することができる。この結果、交差点の信号機を高精度に検出することができる。
2 遮蔽推定システム
3 信号機検出システム
4 車両制御システム
10 信号機検出装置
11 車両位置検出部
12 地図情報部
13 信号機位置推定部
21 物体検出部
22 遮蔽推定部
31 撮像部
32 信号機検出部
41 車両信号取得部
42 車間及び停止位置計算部
43 車両制御部
Claims (7)
- 車両に搭載され、周囲の画像を撮像する撮像部と、
前記車両の位置を検出する車両位置検出部と、
地図情報を記憶している地図情報部と、
前記車両の位置及び前記地図情報から、前記車両周囲の信号機の位置を推定し、前記信号機が存在すると推定される信号機探索領域を設定する信号機位置推定部と、
前記画像上で前記信号機探索領域を探索して前記信号機を検出する信号機検出部と、
前記信号機探索領域で前記信号機が継続して遮蔽される遮蔽継続状態になるか推定する遮蔽推定部
とを備え、
前記信号機位置推定部は、前記遮蔽推定部で遮蔽継続状態になると推定された場合には、前記遮蔽継続状態に基づいて前記信号機探索領域を選択することを特徴とする信号機検出装置。 - 前記遮蔽推定部は、前記信号機が現在遮蔽されているか又は将来遮蔽される場合に、前記信号機の遮蔽時間を推定し、
前記信号機位置推定部は、前記設定されている信号機検索領域で前記推定された遮蔽時間が閾値以下の場合に、前記設定されている信号機探索領域を維持する
ことを特徴とする請求項1に記載の信号機検出装置。 - 前記信号機位置推定部は、前記車両周囲の信号機が複数存在し、且つ前記推定された遮蔽時間が前記閾値より長い場合に、前記設定されている信号機探索領域から他の信号機の信号機探索領域に切り替えることを特徴とする請求項2に記載の信号機検出装置。
- 前記信号機位置推定部は、前記車両及び前記複数の信号機の位置関係から優先順を設定し、前記優先順に前記他の信号機の信号機探索領域を選択する特徴とする請求項3に記載の信号機検出装置。
- 前記信号機位置推定部は、先行車追従制御中は、対向車線側に位置する信号機の信号機探索領域を選択する特徴とする請求項1~4のいずれか1項に記載の信号機検出装置。
- 前記車両、前記物体及び前記信号機の相対的な位置関係に基づいて、前記信号機の遮蔽が解消される位置関係に向けて前記車両を制御することを特徴とする請求項1~5のいずれか1項に記載の信号機検出装置。
- 車両に搭載された撮像部により周囲の画像を撮像するステップと、
前記車両の位置及び地図情報から、前記車両周囲の信号機の位置を推定するステップと、
前記信号機が存在すると推定される信号機探索領域を設定するステップと、
前記画像上で前記信号機探索領域を探索して前記信号機を検出するステップと、
前記信号機探索領域で前記信号機が継続して遮蔽される遮蔽継続状態になるかを推定するステップと、
前記遮蔽継続状態になると推定された場合には、前記遮蔽継続状態に基づいて前記信号機探索領域を選択するステップ
とを含むことを特徴とする信号機検出方法。
Priority Applications (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP14896968.6A EP3168823B1 (en) | 2014-07-08 | 2014-07-08 | Traffic signal detection device and traffic signal detection method |
JP2016532811A JP6256611B2 (ja) | 2014-07-08 | 2014-07-08 | 信号機検出装置及び信号機検出方法 |
PCT/JP2014/068105 WO2016006029A1 (ja) | 2014-07-08 | 2014-07-08 | 信号機検出装置及び信号機検出方法 |
CN201480080421.8A CN106663374B (zh) | 2014-07-08 | 2014-07-08 | 信号机检测装置以及信号机检测方法 |
RU2017102931A RU2634852C1 (ru) | 2014-07-08 | 2014-07-08 | Устройство обнаружения светофора и способ обнаружения светофора |
US15/324,519 US9922259B2 (en) | 2014-07-08 | 2014-07-08 | Traffic light detection device and traffic light detection method |
MX2017000063A MX354764B (es) | 2014-07-08 | 2014-07-08 | Dispositivo de deteccion de semaforo y metodo de deteccion de semaforo. |
BR112017000267-1A BR112017000267B1 (pt) | 2014-07-08 | 2014-07-08 | Dispositivo de detecção de sinal de tráfego e método para detecção de sinal de tráfego |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2014/068105 WO2016006029A1 (ja) | 2014-07-08 | 2014-07-08 | 信号機検出装置及び信号機検出方法 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2016006029A1 true WO2016006029A1 (ja) | 2016-01-14 |
Family
ID=55063706
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2014/068105 WO2016006029A1 (ja) | 2014-07-08 | 2014-07-08 | 信号機検出装置及び信号機検出方法 |
Country Status (8)
Country | Link |
---|---|
US (1) | US9922259B2 (ja) |
EP (1) | EP3168823B1 (ja) |
JP (1) | JP6256611B2 (ja) |
CN (1) | CN106663374B (ja) |
BR (1) | BR112017000267B1 (ja) |
MX (1) | MX354764B (ja) |
RU (1) | RU2634852C1 (ja) |
WO (1) | WO2016006029A1 (ja) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2019149131A (ja) * | 2018-02-28 | 2019-09-05 | トヨタ自動車株式会社 | 運転支援装置 |
JP2020106961A (ja) * | 2018-12-26 | 2020-07-09 | トヨタ自動車株式会社 | 信号機判定装置 |
US11010624B2 (en) | 2018-01-11 | 2021-05-18 | Toyota Jidosha Kabushiki Kaisha | Traffic signal recognition device and autonomous driving system |
JP2021096700A (ja) * | 2019-12-18 | 2021-06-24 | トヨタ自動車株式会社 | 運転支援装置 |
WO2021153051A1 (ja) * | 2020-01-29 | 2021-08-05 | 日立Astemo株式会社 | 車両制御装置、車両制御方法またはプログラム |
JP7409257B2 (ja) | 2020-08-07 | 2024-01-09 | 株式会社デンソー | 信号機認識装置、信号機認識方法、車両制御装置 |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3306589B1 (en) * | 2015-06-05 | 2019-01-09 | Nissan Motor Co., Ltd. | Traffic signal detection device and traffic signal detection method |
DE102015224112A1 (de) * | 2015-12-02 | 2017-06-08 | Bayerische Motoren Werke Aktiengesellschaft | System zur Beeinflussung von Fahrzeugsystemen durch Berücksichtigung relevanter Signalgeber |
US10124804B2 (en) * | 2017-04-12 | 2018-11-13 | GM Global Technology Operations LLC | Method and apparatus for traffic control device detection optimization |
DE102017212034A1 (de) * | 2017-07-13 | 2019-01-17 | Bayerische Motoren Werke Aktiengesellschaft | System und Verfahren zur automatisierten Längsführung eines Kraftfahrzeugs bis in den Stillstand |
CN111448598A (zh) | 2017-12-05 | 2020-07-24 | 日产自动车株式会社 | 车辆的控制方法以及控制装置 |
US11161464B2 (en) | 2018-01-12 | 2021-11-02 | Uatc, Llc | Systems and methods for streaming processing for autonomous vehicles |
US10884424B2 (en) * | 2018-09-07 | 2021-01-05 | GM Global Technology Operations LLC | Traffic light occlusion detection for autonomous vehicle |
CN109035831B (zh) | 2018-09-07 | 2021-07-27 | 百度在线网络技术(北京)有限公司 | 交通指示灯的识别方法、装置、设备、存储介质及车辆 |
US20210211568A1 (en) * | 2020-01-07 | 2021-07-08 | Motional Ad Llc | Systems and methods for traffic light detection |
US11681780B2 (en) | 2020-09-30 | 2023-06-20 | Nissan North America, Inc. | Annotation and mapping for vehicle operation in low-confidence object detection conditions |
CN112141176B (zh) * | 2020-09-30 | 2022-07-22 | 青岛海信微联信号有限公司 | 一种可移动设备搜索的方法及设备 |
CN112699773B (zh) * | 2020-12-28 | 2023-09-01 | 阿波罗智联(北京)科技有限公司 | 交通灯识别方法、装置及电子设备 |
KR102652486B1 (ko) * | 2021-09-24 | 2024-03-29 | (주)오토노머스에이투지 | 라이다를 이용한 신호등 정보 예측 방법 및 이를 이용한 서버 |
CN116071945A (zh) * | 2021-10-29 | 2023-05-05 | 通用汽车环球科技运作有限责任公司 | 交通灯可见性检测和增强显示 |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2007178223A (ja) * | 2005-12-27 | 2007-07-12 | Aisin Aw Co Ltd | 地物認識装置 |
JP2007257299A (ja) * | 2006-03-23 | 2007-10-04 | Honda Motor Co Ltd | 車外認識装置 |
JP2007320458A (ja) * | 2006-06-01 | 2007-12-13 | Toyota Motor Corp | 車間距離制御装置 |
WO2008038370A1 (en) * | 2006-09-28 | 2008-04-03 | Pioneer Corporation | Traffic information detector, traffic information detecting method, traffic information detecting program, and recording medium |
JP2008149786A (ja) * | 2006-12-14 | 2008-07-03 | Mazda Motor Corp | 車両用運転支援装置及び車両用運転支援システム |
JP2008293277A (ja) * | 2007-05-24 | 2008-12-04 | Aisin Aw Co Ltd | 信号機検出装置、信号機検出方法及びプログラム |
JP2013171489A (ja) * | 2012-02-22 | 2013-09-02 | Fuji Heavy Ind Ltd | 車外環境認識装置および車外環境認識方法 |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4631750B2 (ja) * | 2006-03-06 | 2011-02-16 | トヨタ自動車株式会社 | 画像処理システム |
JP4852482B2 (ja) * | 2007-06-25 | 2012-01-11 | 日立オートモティブシステムズ株式会社 | 車両走行支援制御装置 |
US8576069B2 (en) * | 2009-10-22 | 2013-11-05 | Siemens Corporation | Mobile sensing for road safety, traffic management, and road maintenance |
JP5591613B2 (ja) * | 2010-07-27 | 2014-09-17 | 株式会社小糸製作所 | 車両検出装置 |
RU2469410C1 (ru) * | 2011-04-04 | 2012-12-10 | Общество с ограниченной ответственностью "СПбГАСУ-ТУДД" | Система управления движением на многополосных перекрестках |
RU116258U1 (ru) * | 2011-11-15 | 2012-05-20 | Игорь Юрьевич Мацур | Система регулирования движения транспортных средств |
CN103680176B (zh) | 2012-09-18 | 2016-04-27 | 中国移动通信集团公司 | 基于位置信息的信号灯识别系统 |
-
2014
- 2014-07-08 RU RU2017102931A patent/RU2634852C1/ru active
- 2014-07-08 EP EP14896968.6A patent/EP3168823B1/en active Active
- 2014-07-08 US US15/324,519 patent/US9922259B2/en active Active
- 2014-07-08 MX MX2017000063A patent/MX354764B/es active IP Right Grant
- 2014-07-08 WO PCT/JP2014/068105 patent/WO2016006029A1/ja active Application Filing
- 2014-07-08 JP JP2016532811A patent/JP6256611B2/ja active Active
- 2014-07-08 CN CN201480080421.8A patent/CN106663374B/zh active Active
- 2014-07-08 BR BR112017000267-1A patent/BR112017000267B1/pt active IP Right Grant
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2007178223A (ja) * | 2005-12-27 | 2007-07-12 | Aisin Aw Co Ltd | 地物認識装置 |
JP2007257299A (ja) * | 2006-03-23 | 2007-10-04 | Honda Motor Co Ltd | 車外認識装置 |
JP2007320458A (ja) * | 2006-06-01 | 2007-12-13 | Toyota Motor Corp | 車間距離制御装置 |
WO2008038370A1 (en) * | 2006-09-28 | 2008-04-03 | Pioneer Corporation | Traffic information detector, traffic information detecting method, traffic information detecting program, and recording medium |
JP2008149786A (ja) * | 2006-12-14 | 2008-07-03 | Mazda Motor Corp | 車両用運転支援装置及び車両用運転支援システム |
JP2008293277A (ja) * | 2007-05-24 | 2008-12-04 | Aisin Aw Co Ltd | 信号機検出装置、信号機検出方法及びプログラム |
JP2013171489A (ja) * | 2012-02-22 | 2013-09-02 | Fuji Heavy Ind Ltd | 車外環境認識装置および車外環境認識方法 |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11010624B2 (en) | 2018-01-11 | 2021-05-18 | Toyota Jidosha Kabushiki Kaisha | Traffic signal recognition device and autonomous driving system |
JP2019149131A (ja) * | 2018-02-28 | 2019-09-05 | トヨタ自動車株式会社 | 運転支援装置 |
JP7003735B2 (ja) | 2018-02-28 | 2022-01-21 | トヨタ自動車株式会社 | 運転支援装置 |
JP2020106961A (ja) * | 2018-12-26 | 2020-07-09 | トヨタ自動車株式会社 | 信号機判定装置 |
JP2021096700A (ja) * | 2019-12-18 | 2021-06-24 | トヨタ自動車株式会社 | 運転支援装置 |
JP7347193B2 (ja) | 2019-12-18 | 2023-09-20 | トヨタ自動車株式会社 | 運転支援装置 |
WO2021153051A1 (ja) * | 2020-01-29 | 2021-08-05 | 日立Astemo株式会社 | 車両制御装置、車両制御方法またはプログラム |
JPWO2021153051A1 (ja) * | 2020-01-29 | 2021-08-05 | ||
JP7409257B2 (ja) | 2020-08-07 | 2024-01-09 | 株式会社デンソー | 信号機認識装置、信号機認識方法、車両制御装置 |
Also Published As
Publication number | Publication date |
---|---|
US20180012088A1 (en) | 2018-01-11 |
MX2017000063A (es) | 2017-04-27 |
CN106663374B (zh) | 2018-08-28 |
JPWO2016006029A1 (ja) | 2017-05-25 |
MX354764B (es) | 2018-03-21 |
EP3168823A4 (en) | 2018-01-03 |
JP6256611B2 (ja) | 2018-01-10 |
CN106663374A (zh) | 2017-05-10 |
BR112017000267A2 (pt) | 2017-10-31 |
US9922259B2 (en) | 2018-03-20 |
RU2634852C1 (ru) | 2017-11-07 |
EP3168823B1 (en) | 2020-05-13 |
BR112017000267B1 (pt) | 2021-12-28 |
EP3168823A1 (en) | 2017-05-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6256611B2 (ja) | 信号機検出装置及び信号機検出方法 | |
US10000208B2 (en) | Vehicle control apparatus | |
US20190126923A1 (en) | Controller for a vehicle | |
JP6774297B2 (ja) | 車両認識装置及び車両認識方法 | |
US20170066445A1 (en) | Vehicle control apparatus | |
JP6331811B2 (ja) | 信号機検出装置及び信号機検出方法 | |
US10055656B2 (en) | Traffic signal detection device and traffic signal detection method | |
JP5202741B2 (ja) | 分岐路進入判定装置 | |
JP2007280132A (ja) | 走行誘導障害物検出装置および車両用制御装置 | |
US10210407B2 (en) | Traffic signal detection device and traffic signal detection method | |
JP2010072947A (ja) | 障害物検出装置 | |
US11210955B2 (en) | Collision avoidance assist apparatus | |
JP7245653B2 (ja) | 信号機認識方法及び信号機認識装置 | |
JP2006004188A (ja) | 障害物認識方法及び障害物認識装置 | |
KR102485318B1 (ko) | 단안 영상 기반 추월 및 합류 차량 인식 시스템 및 방법 | |
JP4074550B2 (ja) | 物体認識装置及び認識方法 | |
US11769337B2 (en) | Traffic signal recognition method and traffic signal recognition device | |
JP2019012322A (ja) | 車両制御装置 | |
EP2720211B1 (en) | Other-vehicle detection device and other-vehicle detection method | |
JP6564682B2 (ja) | 対象物検出装置、対象物検出方法、及び、対象物検出プログラム | |
JP7149171B2 (ja) | 物体認識方法及び物体認識装置 | |
Porikli et al. | Special issue on car navigation and vehicle systems | |
JPWO2018230342A1 (ja) | 車両運転支援装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14896968 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2016532811 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: MX/A/2017/000063 Country of ref document: MX |
|
WWE | Wipo information: entry into national phase |
Ref document number: 15324519 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112017000267 Country of ref document: BR |
|
REEP | Request for entry into the european phase |
Ref document number: 2014896968 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2014896968 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2017102931 Country of ref document: RU Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 112017000267 Country of ref document: BR Kind code of ref document: A2 Effective date: 20170105 |