WO2019013253A1 - Dispositif de détection - Google Patents

Dispositif de détection Download PDF

Info

Publication number
WO2019013253A1
WO2019013253A1 PCT/JP2018/026192 JP2018026192W WO2019013253A1 WO 2019013253 A1 WO2019013253 A1 WO 2019013253A1 JP 2018026192 W JP2018026192 W JP 2018026192W WO 2019013253 A1 WO2019013253 A1 WO 2019013253A1
Authority
WO
WIPO (PCT)
Prior art keywords
line
brightness
luminance
vehicle
threshold
Prior art date
Application number
PCT/JP2018/026192
Other languages
English (en)
Japanese (ja)
Inventor
章伸 酒井
謙二 岡野
Original Assignee
株式会社デンソー
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社デンソー filed Critical 株式会社デンソー
Publication of WO2019013253A1 publication Critical patent/WO2019013253A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis

Definitions

  • the present disclosure relates to a technique for recognizing a lane mark from an image.
  • Patent Document 1 when a plurality of line candidates serving as lane mark candidates are detected from an image captured by a camera mounted on a vehicle, the line candidate having the highest luminance among the plurality of line candidates is selected.
  • a technique has been proposed which recognizes as a lane mark.
  • the lane mark may include a line having lower luminance than the white line, such as a yellow line, for example.
  • the technique described in Patent Document 1 always detects only the white line if a plurality of line candidates having different luminances, such as a white line and a yellow line, are detected.
  • a problem was found that there is a possibility that the vehicle may be recognized as a lane mark. That is, with the technique described in Patent Document 1, it has been found that there is a possibility that lane marks can not be detected properly.
  • One aspect of the present disclosure provides a technique for appropriately detecting a lane mark that defines a traveling path on which a vehicle travels.
  • One aspect of the present disclosure is a detection device mounted on a vehicle.
  • the detection device includes an image acquisition unit, a candidate extraction unit, a luminance determination unit, a multiple determination unit, a recognition unit, and an output unit.
  • the image acquisition unit is configured to repeatedly acquire an image captured by at least one camera mounted on the vehicle and including a travel path which is a road on which the vehicle travels.
  • the candidate extraction unit determines at least one line candidate which is a candidate for a division line that divides the lane from the captured image based on the feature point at which the luminance changes by a predetermined change threshold or more between adjacent pixels in the captured image. It is configured to extract
  • the luminance determination unit is configured to acquire the luminance of the line candidate for each of the line candidates, and determine whether the luminance of the line candidate is equal to or more than a predetermined luminance threshold.
  • the multiple determination unit is configured to determine whether there is a plurality of section candidates that are line candidates and the luminance determination unit determines that the luminance of the line candidate is equal to or higher than the luminance threshold.
  • the recognition unit is a travel division line that is a division line that divides the lane where the vehicle travels, which is the division candidate closest to the vehicle among the plurality of division candidates when it is determined by the multiple determination unit that there are a plurality of division candidates. It is configured to recognize as.
  • the output unit is configured to output the recognition result by the recognition unit.
  • the section candidate closest to the vehicle is recognized as a traveling section line, so the traveling section line is appropriately selected regardless of the difference in the luminance of the section line. Can be detected.
  • FIG. 2 is a block diagram showing the configuration of a driving support system.
  • Explanatory drawing which shows an example of the arrangement position of a camera.
  • Explanatory drawing which shows the function of ECU. Schematic diagram of the bird's eye view image.
  • Explanatory drawing which shows the luminance of the dividing line in the area
  • 6 is a flowchart of detection processing. The flowchart of recognition processing. Explanatory drawing explaining a brightness
  • Explanatory drawing which shows the other example of the arrangement position of a camera.
  • the driving support system 1 shown in FIG. 1 is mounted on a vehicle 70.
  • the driving support system 1 recognizes lane markings of a road from an image obtained by photographing the surroundings of the vehicle 70, estimates traveling path parameters, and executes various driving assistances based on the estimated traveling path parameters.
  • a demarcation line is what is called a lane mark, and is a white line and a yellow line drawn on the road surface so that the lane of a traveling path may be divided.
  • the travel path is a road on which the vehicle travels.
  • the travel path parameters represent the state of the travel path for the vehicle 70 and the shape of the travel path.
  • the driving support system 1 includes an ECU 30.
  • the driving support system 1 may include a camera 10, a sensor group 20, and a vehicle control device 50.
  • the camera 10 includes a front camera 11, a left side camera 12, a right side camera 13, and a rear camera 14.
  • Each of the cameras 11 to 14 can be configured using a CCD image sensor, a CMOS image sensor, or the like.
  • the front camera 11 is installed, for example, on a bumper at the front end of the vehicle such that the road surface in front of the vehicle is a shooting range.
  • the left side camera 12 is installed, for example, on the left side mirror so that the road surface on the left side of the vehicle is in the shooting range.
  • the right side camera 13 is installed, for example, on the right side mirror such that the road surface on the right side of the vehicle is the shooting range.
  • the rear camera 14 is installed, for example, on a bumper at the rear end of the vehicle such that the road surface on the rear side of the vehicle is in the shooting range.
  • the sensor group 20 is a sensor that measures the behavior of the vehicle 70.
  • the sensor group 20 includes a vehicle speed sensor that measures the vehicle speed of the vehicle 70, a yaw rate sensor that measures the yaw rate of the vehicle 70, and the like.
  • the sensor group 20 is a GPS sensor that detects the position of the vehicle 70, a radar sensor that detects the distance and relative speed with a target present around the vehicle 70, and an illuminance sensor that detects the brightness around the vehicle 70 Etc. may be provided.
  • the sensor group 20 outputs detection results such as sensor values to the ECU 30.
  • the vehicle control device 50 includes a microcomputer having a semiconductor memory such as a CPU, a ROM, a RAM, and a flash memory.
  • the vehicle control device 50 controls steering of the vehicle 70, a brake, an engine, and the like so that the vehicle 70 travels in the lane based on the recognition result of the dividing line output from the ECU 30.
  • the recognition results of the lane markings may include roadway parameters.
  • the ECU 30 includes a microcomputer having a CPU 41 and a semiconductor memory (hereinafter, memory 42) such as a RAM, a ROM, and a flash memory.
  • memory 42 such as a RAM, a ROM, and a flash memory.
  • the various functions of the ECU 30 are realized by the CPU 41 executing a program stored in a non-transitional tangible storage medium.
  • the memory 42 corresponds to a non-transitional tangible storage medium storing a program. Also, by executing this program, a method corresponding to the program is executed.
  • the ECU 30 may include one microcomputer or may include a plurality of microcomputers.
  • the ECU 30 includes an input processing unit 31, a combining processing unit 32, a recognition processing unit 33, and an output processing unit 34 as a configuration of functions realized by the CPU 41 executing a program.
  • the recognition processing unit 33 also includes an output unit image acquisition unit, a candidate extraction unit, a luminance determination unit, a multiple determination unit, a recognition unit, an accumulation unit, an update unit, an environment determination unit, and an output unit.
  • the method for realizing these elements is not limited to software, and some or all of the elements may be realized using hardware combining logic circuits, analog circuits, and the like.
  • FIG. 4 is a schematic view of a bird's-eye view image generated by the combination processing unit 32.
  • An area indicated by a broken line at the center of the figure is a vehicle area in which the vehicle 70 is present.
  • the synthesis processing unit 32 synthesizes the camera images captured by the four cameras 11-14 and converts it into a bird's-eye view to generate a bird's-eye view image surrounding the vehicle area.
  • a solid yellow line and a solid white line, and a repair mark are present on the traveling path.
  • solid yellow lines and solid white lines are dividing lines.
  • the brightness of the white line is greater than the brightness of the yellow line. Therefore, if it is assumed that a division line with the highest luminance in the photographed image is always detected as a traveling division line, there is a possibility that a yellow line may not be detected as a traveling division line.
  • a traveling division line is a division line which divides the lane which a vehicle drive
  • a repair mark is a mark which repaired the crack of the road surface.
  • the repair marks may include, for example, a mark obtained by repairing a crack in the asphalt road surface with tar, a mark formed by repairing a crack in the concrete road surface with asphalt, and the like. Cracks on the road surface often occur along the dividing line due to tire pressure, particularly in snowy areas such as North America, and the repair marks often become linear along the dividing line.
  • the brightness of the repair marks is smaller than the brightness of the dividing lines such as white and yellow lines.
  • the luminance of the repair mark is smaller than the luminance of the road surface.
  • a straight line obtained by performing processing such as Hough transformation on a feature point extracted from a photographed image is recognized as a dividing line.
  • the feature points referred to here are edge points.
  • An edge point is a point at which the luminance changes by at least a change threshold which is a predetermined threshold between adjacent pixels in a captured image.
  • a plurality of repair marks extending substantially parallel to the dividing line are positioned across the road surface, and the intervals of the plurality of repair marks are substantially the same as the width of the dividing line.
  • a road surface sandwiched by a plurality of repair marks may be erroneously detected as a dividing line. If there is a portion whose luminance is lower than the road surface, such as a repair mark, the low luminance portion is erroneously recognized as the road surface, and the original road surface is erroneously recognized as the dividing line.
  • the low luminance regions referred to below are each of a plurality of linear regions located on the road surface so as to be parallel to the division lines, and are separated from each other by the same extent as the width of the division lines. Is a low area.
  • the low luminance region may include the above-described repair marks.
  • the low luminance region may include cracks of the road surface, tire marks, and the like.
  • parallel is not limited to being strictly parallel, and may not be strictly parallel as long as misrecognition may occur as described above.
  • the line referred to here is not limited to the line in the strict meaning, and may not be the line strictly as long as there is a possibility that the same may be misrecognized.
  • the same as the width of the dividing line mentioned here is not limited to the same width as the dividing line in a strict sense, and if there is a possibility of misrecognition as above, the dividing line strictly It does not have to be the same width as.
  • the non-section line area mentioned below is an area sandwiched between a plurality of low luminance areas on the road surface, and is an area substantially parallel to the section line which may be erroneously recognized as a section line. Such a characteristic is present in the photographed image of the traveling road. Therefore, in the present embodiment, the ECU 30 is configured to appropriately detect a traveling lane line regardless of the difference in the luminance of the lane line by executing a detection process described later. Further, the ECU 30 is configured to determine a non-section line area and a section line due to a repair mark or the like by executing detection processing.
  • the detection processing represents a processing procedure for recognizing and outputting a traveling lane line based on the feature in the photographed image of the traveling road described above. This detection process is repeatedly executed at shooting time intervals of the camera 11-14.
  • step (hereinafter, referred to as S) 10 the ECU 30 acquires a camera image captured by the camera 11-14, and converts the acquired camera image into a digital signal by sampling.
  • the ECU 30 converts the four camera images converted into digital signals into a bird's-eye view seen from a preset virtual viewpoint and combines them, and generates a bird's-eye view image of the surroundings of the vehicle 70.
  • the ECU 30 recognizes a traveling division line from the bird's-eye view image generated in step S20 by executing recognition processing. Details of the recognition process will be described later.
  • the ECU 30 estimates traveling path parameters of the traveling lane lines recognized in the recognition process. Then, the ECU 30 outputs traveling path parameters to the vehicle control device 50 via the in-vehicle network as a recognition result of the traveling lane lines.
  • the travel path parameters may include, for example, the curvature of the dividing line, the width of the lane, the angle between the traveling direction of the vehicle 70 and the tangential direction of the dividing line, and the like.
  • the ECU 30 ends the present recognition process as described above.
  • S10 corresponds to the processing by the input processing unit 31
  • S20 corresponds to the processing by the combining processing unit 32
  • S30 corresponds to the processing by the recognition processing unit 33
  • S40 by the output processing unit 34. It corresponds to processing.
  • the photographed image referred to here is an image photographed by at least one camera 10 mounted on the vehicle 70 and is an image including a traveling path.
  • the ECU 30 acquires the bird's-eye view image generated in S20 as a photographed image.
  • the ECU 30 extracts line candidates from the captured image based on the edge points in the captured image.
  • the line candidate is a candidate for a dividing line that divides the lane.
  • the change threshold when extracting an edge point is stored in advance in the memory 42.
  • the ECU 30 applies the sobel filter or the like to the bird's-eye view image acquired in S100 to detect an edge point. Then, the ECU 30 applies a Hough transform or the like to the detected edge point to detect a straight line, and extracts the detected straight line as a line candidate.
  • the ECU 30 extracts line candidates on each of the left side and the right side of the vehicle 70. As the extracted line candidate, a line candidate existing in a predetermined range may be extracted from the vehicle 70. Specifically, since line candidates existing outside the predetermined range from the vehicle 70 have a high probability of being adjacent lanes, the processing load can be reduced by excluding such line candidates. .
  • the ECU 30 acquires the luminance of the line candidate.
  • the luminance of the line candidate is the luminance value of the line candidate extracted in S110.
  • the ECU 30 calculates the average value of the luminance values for all the pixels included in the line candidate, and acquires the average value as the luminance of the line candidate.
  • the method of calculating the luminance of the line candidate is not limited to this.
  • the ECU 30 may be configured to calculate an average value of luminance values for any of a plurality of pixels included in the line candidate, and acquire the average value as the luminance of the line candidate.
  • the ECU 30 acquires the luminance of the line candidate for each of the plurality of line candidates.
  • the ECU 30 acquires a luminance threshold.
  • the luminance threshold is a predetermined value, and is a value used to discriminate between the dividing line and the non-dividing line area.
  • the luminance threshold is stored in the memory 42 as described later.
  • the ECU 30 determines whether the brightness of the traveling path around the vehicle 70 (hereinafter, the periphery of the vehicle) satisfies a predetermined condition.
  • the brightness of the traveling path around the vehicle may include the brightness around the vehicle 70 in addition to the brightness of the traveling path itself around the vehicle 70.
  • the brightness of the traveling path around the vehicle is simply referred to as the brightness of the traveling path.
  • the ECU 30 shifts the processing to S150 when the brightness of the travel path satisfies the predetermined condition, and shifts the processing to S160 when the brightness of the travel path does not satisfy the predetermined condition.
  • the present S140 is a process for determining whether or not S160-S180 and S240-S250 described later are not to be executed.
  • the processes of S160 to S180 are processes for excluding line candidates which are line candidates and whose luminance is less than the luminance threshold, from the section candidates, as described later.
  • the processes of S240 to S250 are processes for updating the luminance threshold as described later.
  • the brightness of the traveling road is such brightness that the difference between the brightness of the dividing line and the brightness of the road surface is less than a predetermined threshold (hereinafter referred to as bright threshold) (hereinafter referred to as bright condition). It is taken as a predetermined condition.
  • a predetermined threshold hereinafter referred to as bright threshold
  • the brightness of the road surface may have the same size as the brightness of the dividing line such as a white line or a yellow line. That is, the difference between the luminance of the road surface and the luminance of the dividing line such as a white line or a yellow line can be less than the bright threshold.
  • the bright threshold referred to here may be a value sufficiently smaller than, for example, the brightness of the road surface or the brightness of the dividing line, such as close to zero.
  • the brightness of the road is such that the difference between the brightness of the low brightness area and the brightness of the road surface is less than a predetermined threshold (hereinafter referred to as dark threshold) (hereinafter referred to as dark condition) ,)
  • a predetermined threshold hereinafter referred to as dark threshold
  • dark condition a predetermined threshold
  • a traveling path at night, a traveling path in a tunnel, etc. may be mentioned as an example where the brightness of the traveling path satisfies the dark condition.
  • the road surface may have the same brightness as the repair mark. That is, the difference between the brightness of the road surface and the brightness of a low brightness area such as a repair mark can be less than the dark threshold.
  • the dark threshold referred to here may be, for example, a value close to 0, which is sufficiently smaller than the brightness of the road surface and the brightness of a repair mark.
  • the bright threshold and the dark threshold may be the same value.
  • the light threshold and the dark threshold may be confirmed by experiment or the like.
  • the ECU 30 determines that the brightness of the traveling path does not satisfy the predetermined condition if the brightness threshold value acquired in S130 is a value within the predetermined range in this step.
  • the brightness threshold value acquired in S130 is a value within the predetermined range in this step.
  • the luminance threshold is a value proportional to a value based on the luminance of a travel lane line recognized in the past. That is, the brightness threshold is a large value when the brightness of the traveling path is sufficiently bright to satisfy the light condition. In addition, the brightness threshold is a small value when the brightness of the traveling path is sufficiently dark to satisfy the dark condition.
  • the ECU 30 determines whether the brightness of the traveling path satisfies the predetermined condition based on whether the luminance threshold is within the predetermined range. That is, when the luminance threshold is equal to or higher than the upper threshold, it is determined that the brightness of the travel path satisfies the bright condition. That is, it is determined that the brightness of the travel path satisfies the predetermined condition. When the brightness threshold is less than the lower limit threshold, it is determined that the brightness of the travel path satisfies the dark condition. That is, it is determined that the brightness of the travel path satisfies the predetermined condition.
  • the upper limit threshold and the lower limit threshold for representing the predetermined range here are predetermined by experiments or the like, and are stored in the memory 42.
  • the ECU 30 sets all line candidates detected at S110 as section candidates to be described later, as an exception to the processing at S160-S180. Then, the ECU 30 shifts the process to S190.
  • the ECU 30 obtains the luminance of the line candidate for each of the line candidates, and determines whether the luminance of the line candidate is equal to or greater than the luminance threshold.
  • the ECU 30 shifts the processing to S170 when the luminance of the line candidate is equal to or higher than the luminance threshold.
  • the ECU 30 sets a line candidate determined to be equal to or higher than the luminance threshold in S160 as a section candidate, and shifts the processing to S180.
  • the ECU 30 shifts the processing to S180.
  • the luminance threshold is a value proportional to a value based on the luminance of a travel lane line recognized in the past.
  • the brightness threshold value is a value close to the brightness of the travel lane lines recognized in the past, and is a value smaller than the brightness of the travel lane lines recognized in the past.
  • the process of S160 is a process for determining a non-partitioning line area from among a plurality of line candidates by comparing the brightness of the line candidate with the brightness threshold.
  • the ECU 30 repeats the processing of S160 to S180 until the determination of S160 is performed for each of all the line candidates detected in S110.
  • the ECU 30 shifts the processing to S190 when the determination of S160 is performed for all the line candidates detected in S110.
  • the ECU 30 determines in S150 or S170 whether a plurality of section candidates are set.
  • the ECU 30 shifts the processing to S200 when one segment candidate is set, and shifts the processing to S210 when a plurality of segment candidates are set.
  • the ECU 30 determines the section candidate as a traveling section line. Then, the ECU 30 shifts the process to S220.
  • the ECU 30 determines a section candidate closest to the vehicle 70 among the plurality of section candidates as a travel section line. Then, the ECU 30 shifts the process to S220.
  • the ECU 30 determines travel division lines on the right and left sides of the vehicle 70, respectively. That is, the ECU 30 determines a pair of travel division lines estimated to represent the left and right boundaries of the travel path of the vehicle 70.
  • the ECU 30 is not limited to this, and may be configured to determine the travel division line on at least one of the right side and the left side of the vehicle 70.
  • the ECU 30 stores the traveling division line luminance in the memory 42 at S220.
  • the traveling parting line luminance is the luminance of the traveling parting line determined in S200 or S210. Specifically, among the luminances of the line candidates acquired in S120, the luminances of the line candidates determined as the traveling division lines are used as the traveling division line luminances.
  • the ECU 30 determines whether the brightness of the travel path satisfies the predetermined condition, as in S140.
  • the ECU 30 ends the recognition process when the brightness of the travel path satisfies the predetermined condition, and shifts the process to S240 when the brightness of the travel path does not satisfy the predetermined condition.
  • the ECU 30 does not satisfy the predetermined condition when the brightness of the traveling path satisfies the predetermined condition when the traveling division line luminance stored in the memory 42 in S220 is within the predetermined value. to decide. Specifically, the ECU 30 determines that the brightness of the traveling path satisfies the predetermined condition when the traveling division line luminance is equal to or higher than a predetermined first threshold. Further, the ECU 30 determines that the brightness of the traveling path satisfies the predetermined condition when the traveling lane line luminance is less than a second threshold smaller than the first threshold.
  • the first threshold and the second threshold are predetermined by experiment or the like, and are stored in the memory 42.
  • the first threshold is a value corresponding to the upper limit threshold
  • the second threshold is a value corresponding to the lower limit threshold.
  • the ECU 30 calculates an average brightness at S240.
  • the average luminance is an average value of a plurality of past luminances.
  • the past luminance is the traveling part line luminance accumulated in the memory 42 in the past.
  • an average value of a plurality of past luminances accumulated in the memory 42 in the most recent predetermined past period is calculated as the average luminance.
  • the ECU 30 calculates a reference value in S250.
  • the reference value is a value obtained by multiplying the average luminance by a predetermined multiple ⁇ .
  • the multiple ⁇ is a value less than 1 and may be set to a value such as 0.7 to 0.8. However, the multiple ⁇ is not limited to this, and may be appropriately set based on an experiment or the like.
  • the ECU 30 re-stores the calculated reference value in the memory 42 as a new brightness threshold.
  • the ECU 30 ends the present recognition process as described above.
  • the ECU 30 repeatedly acquires the captured image, and in S110, extracts at least one line candidate from the captured image based on the edge point in the captured image.
  • the ECU 30 determines, for each of at least one line candidate, whether or not the brightness of the line candidate is equal to or greater than the brightness threshold, and sets one having the brightness of the line candidate equal to or greater than the brightness threshold as a section candidate.
  • the ECU 30 recognizes a section candidate closest to the vehicle 70 as a traveling section line when there are a plurality of section candidates.
  • the ECU 30 outputs a recognition result in S40.
  • the section candidate closest to the vehicle 70 is identified as a traveling section line, so that the traveling section line is properly detected regardless of the difference in the luminance of the section line. be able to.
  • the non-section line area and the section line can be discriminated. That is, it is suppressed that a non-section line area is mistakenly extracted as a section candidate. As a result, it is possible to appropriately detect a traveling division line from among the division candidates.
  • the ECU 30 stores the traveling division line luminance in the memory 42 in S220 each time the traveling division line is recognized in S210.
  • the ECU 30 calculates an average luminance, which is an average value of a plurality of past luminances, and calculates a reference value smaller than the average luminance every time the traveling lane line luminance is stored in the memory 42 at S250.
  • the value is stored back in the memory 42 as a new luminance threshold.
  • the ECU 30 acquires the luminance threshold value thus stored in the memory 42, and makes a determination using the luminance threshold value.
  • the luminance threshold is set based on the luminances of a plurality of travel markings recognized in the past, an appropriate luminance threshold is set that reflects the change in the brightness of the environment around the vehicle 70 which changes from moment to moment. Be done.
  • the luminance threshold is appropriately set, it is possible to suppress that a non-section line area due to a repair mark or the like is erroneously extracted as a section candidate. As a result, it is possible to properly detect the traveling lanes.
  • the ECU 30 is configured to determine whether the brightness of the travel path around the vehicle satisfies the predetermined condition. As a result, processing can be performed according to the brightness of the travel path around the vehicle.
  • the brightness threshold is not updated using the reference value.
  • the reference value is, as described above, a value based on the luminance of the travel lane lines recognized in the past.
  • the reference value is a large value when the brightness of the travel path is bright, and is a small value when the brightness of the travel path is dark.
  • the brightness threshold may be set to a value larger than the brightness of the normal yellow line.
  • the brightness threshold is set to a value smaller than the brightness of a low brightness area such as a repair mark There is a fear.
  • the yellow line may not be extracted as a section candidate.
  • the low luminance region may be extracted as a section candidate.
  • the brightness threshold is not updated using the reference value. As a result, it is possible to suppress that the yellow line is not extracted as a section candidate based on the luminance threshold. Further, based on the luminance threshold value, extraction of a low luminance area as a section candidate can be suppressed.
  • the ECU 30 when it is determined that the brightness of the traveling path satisfies the predetermined condition in S210, the ECU 30 is at least one line candidate extracted in S110 and among all the line candidates The line candidate closest to the vehicle 70 is recognized as a travel division line.
  • the division candidate extraction based on the luminance threshold is not performed, and the line candidate closest to the vehicle 70 among all the line candidates is traveled. Recognized as a dividing line.
  • the luminance threshold is not appropriately set, and therefore, there is a possibility that the section candidate may not be appropriately extracted. Therefore, in this embodiment, extraction of a section candidate is stopped in such a case. As a result, erroneous recognition of the travel lane lines based on the lane candidates is suppressed.
  • the ECU 30 determines in S140 or S230 that the predetermined condition is that the brightness of the traveling road is such that the difference between the brightness of the dividing line and the brightness of the road surface is less than a predetermined bright threshold. , Is configured to make a decision.
  • the ECU 30 determines that the brightness of the traveling path is such that the difference between the brightness of the low brightness area and the brightness of the road surface is less than a predetermined dark threshold. As, it is configured to make a decision.
  • the ECU 30 determines that the brightness of the traveling path satisfies the predetermined condition when the luminance threshold is equal to or higher than the predetermined upper limit threshold in S140. Further, in S140, the ECU 30 determines that the brightness of the traveling path satisfies the predetermined condition in S140 if the brightness threshold is less than the predetermined lower limit threshold smaller than the upper limit threshold. As a result, in order to detect the brightness of the traveling path, it is easily determined whether the brightness of the traveling path satisfies the predetermined condition without providing a new configuration such as an illuminance sensor or the like. Can.
  • the ECU 30 determines that the brightness of the traveling path satisfies the predetermined condition when the traveling lane line luminance is equal to or higher than a predetermined first threshold value in S230. Further, in step S230, the ECU 30 determines that the brightness of the traveling path satisfies the predetermined condition when the traveling division line luminance is less than a second threshold smaller than the first threshold. As a result, the same effect as the above (3h) can be obtained.
  • the ECU 30 corresponds to a detection device
  • the memory 42 corresponds to a storage unit.
  • S40 corresponds to the processing by the output unit
  • S100 corresponds to the processing by the image acquisition unit
  • S110 corresponds to the processing by the candidate extraction unit
  • S140 and S230 correspond to the processing by the environment judgment unit
  • S160 represents the luminance. It corresponds to the processing by the judgment unit.
  • S190 corresponds to the processing by the multiple judgment unit
  • S210 corresponds to the processing by the recognition unit
  • S220 corresponds to the processing by the storage unit
  • S250 corresponds to the processing by the updating unit.
  • a bird's-eye view image corresponds to a photographed image
  • an edge point corresponds to a feature point.
  • each of the bright condition and the dark condition corresponds to a predetermined condition.
  • an illuminance sensor that detects ambient brightness may be mounted as a sensor of the sensor group 20.
  • the ECU 30 may be configured to determine that the brightness of the traveling path satisfies the predetermined condition when the sensor value of the illuminance sensor is equal to or greater than the predetermined first illuminance threshold. Further, when the sensor value of the illuminance sensor is less than a second illuminance threshold which is a value smaller than the first illuminance threshold, the ECU 30 assumes that the brightness of the traveling path satisfies the predetermined condition. It may be configured to make a decision.
  • a GPS device may be mounted as a sensor of the sensor group 20, and a map database storing map data may be mounted.
  • the ECU 30 determines that the current position of the vehicle 70 is in the tunnel based on the detection result of the GPS device and the map data, it is assumed that the brightness of the traveling path satisfies the predetermined condition. It may be configured to make a decision.
  • the ECU 30 may be configured to stop the output of the recognition result when it is determined in S40 that the brightness of the traveling path satisfies the predetermined condition in S40. As a result, it is possible to suppress output of an erroneous recognition result. In addition, it is possible to suppress erroneous vehicle control from being performed based on an erroneous traveling path parameter.
  • the ECU 30 is configured to recognize the traveling division line from the bird's-eye view image using the bird's-eye view image generated based on the camera image by the camera 11-14 as the shot image.
  • the image is not limited to a bird's eye view image.
  • one camera 10 may be mounted on a vehicle so as to capture a road surface ahead of the vehicle 70.
  • the camera 10 is mounted on the center front side of the vehicle 70, and as shown in FIG. 9, it is configured to photograph an area extending in a predetermined angle range toward the front of the vehicle 70 It is also good.
  • ECU30 detects an edge point from the photography picture photoed with the camera 10 like the above-mentioned embodiment, and based on an edge point, it may be constituted so that a run division line may be recognized from the photography picture. good.
  • the plurality of functions of one component in the above embodiment may be realized by a plurality of components, or one function of one component may be realized by a plurality of components . Also, a plurality of functions possessed by a plurality of components may be realized by one component, or one function realized by a plurality of components may be realized by one component.
  • part of the configuration of the above embodiment may be omitted.
  • at least a part of the configuration of the above embodiment may be added to or replaced with the configuration of the other above embodiment.
  • all the aspects contained in the technical thought specified from the wording described in the claim are an embodiment of this indication.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)
  • Traffic Control Systems (AREA)

Abstract

La présente invention concerne un dispositif de détection (30) monté sur un véhicule (70). Le dispositif de détection est pourvu d'une unité d'acquisition d'image (S100), d'une unité d'extraction de candidat (S110), d'une unité de détermination de luminosité (S160), d'une unité de détermination de pluralité (S190), d'une unité de reconnaissance (S210) et d'une unité de sortie (S40). Si l'unité de détermination de pluralité détermine l'existence d'une pluralité de candidats de démarcation, l'unité de reconnaissance (S210) reconnaît la ligne de démarcation candidate la plus proche du véhicule comme repère de voie, c'est-à-dire une ligne de démarcation qui délimite la voie dans laquelle le véhicule se déplace. L'unité de sortie (S40) délivre le résultat de reconnaissance émis par l'unité de reconnaissance.
PCT/JP2018/026192 2017-07-14 2018-07-11 Dispositif de détection WO2019013253A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017137854A JP2019020957A (ja) 2017-07-14 2017-07-14 検出装置
JP2017-137854 2017-07-14

Publications (1)

Publication Number Publication Date
WO2019013253A1 true WO2019013253A1 (fr) 2019-01-17

Family

ID=65001319

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/026192 WO2019013253A1 (fr) 2017-07-14 2018-07-11 Dispositif de détection

Country Status (2)

Country Link
JP (1) JP2019020957A (fr)
WO (1) WO2019013253A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7446830B2 (ja) 2020-01-30 2024-03-11 フォルシアクラリオン・エレクトロニクス株式会社 画像処理装置及び画像処理方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005056322A (ja) * 2003-08-07 2005-03-03 Toshiba Corp 白線推定装置
WO2006101004A1 (fr) * 2005-03-22 2006-09-28 Honda Motor Co., Ltd. Systeme, procede et programme de traitement d'images embarques, vehicule et procede de formulation d'un systeme de traitement d'images embarque
JP2010224926A (ja) * 2009-03-24 2010-10-07 Fuji Heavy Ind Ltd 停止線検出装置
JP2010286995A (ja) * 2009-06-10 2010-12-24 Honda Motor Co Ltd 車両用画像処理システム
JP2017010464A (ja) * 2015-06-25 2017-01-12 富士通株式会社 車線検出装置及び車線検出方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005056322A (ja) * 2003-08-07 2005-03-03 Toshiba Corp 白線推定装置
WO2006101004A1 (fr) * 2005-03-22 2006-09-28 Honda Motor Co., Ltd. Systeme, procede et programme de traitement d'images embarques, vehicule et procede de formulation d'un systeme de traitement d'images embarque
JP2010224926A (ja) * 2009-03-24 2010-10-07 Fuji Heavy Ind Ltd 停止線検出装置
JP2010286995A (ja) * 2009-06-10 2010-12-24 Honda Motor Co Ltd 車両用画像処理システム
JP2017010464A (ja) * 2015-06-25 2017-01-12 富士通株式会社 車線検出装置及び車線検出方法

Also Published As

Publication number Publication date
JP2019020957A (ja) 2019-02-07

Similar Documents

Publication Publication Date Title
JP6416293B2 (ja) 自動車に接近する対象車両を自動車のカメラシステムにより追跡する方法、カメラシステムおよび自動車
US8477999B2 (en) Road division line detector
US8090152B2 (en) Road lane boundary detection system and road lane boundary detecting method
US9405980B2 (en) Arrow signal recognition device
JP6220327B2 (ja) 走行区画線認識装置、走行区画線認識プログラム
US9965690B2 (en) On-vehicle control device
JP5480917B2 (ja) 車両周辺監視装置
US10635910B2 (en) Malfunction diagnosis apparatus
US8643723B2 (en) Lane-marker recognition system with improved recognition-performance
US20180005073A1 (en) Road recognition apparatus
JP2007220013A (ja) 車両用白線検出装置
KR101268282B1 (ko) 차량용 내비게이션의 차선 이탈 알림 시스템 및 방법
JP6426512B2 (ja) 走行区画線認識装置
US9916672B2 (en) Branching and merging determination apparatus
KR20170055738A (ko) 영상 기반 주행 차로 판단 장치 및 방법
JP5097681B2 (ja) 地物位置認識装置
JP5407920B2 (ja) 点灯色識別装置及びプログラム
KR101511586B1 (ko) 터널 인식에 의한 차량 제어장치 및 제어방법
WO2019013253A1 (fr) Dispositif de détection
US11749002B2 (en) Lane line recognition apparatus
WO2014050285A1 (fr) Dispositif de caméra stéréoscopique
JP2019109681A (ja) 区画線特定装置
WO2017122688A1 (fr) Dispositif de détection d'anomalie d'objectif de caméra embarquée
JP6453571B2 (ja) 立体物認識装置
US20230386224A1 (en) Stop line recognition device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18832877

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18832877

Country of ref document: EP

Kind code of ref document: A1