WO2018124388A1 - Method and apparatus for notifying object around vehicle - Google Patents

Method and apparatus for notifying object around vehicle Download PDF

Info

Publication number
WO2018124388A1
WO2018124388A1 PCT/KR2017/002362 KR2017002362W WO2018124388A1 WO 2018124388 A1 WO2018124388 A1 WO 2018124388A1 KR 2017002362 W KR2017002362 W KR 2017002362W WO 2018124388 A1 WO2018124388 A1 WO 2018124388A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
image
lane
brightness
around
Prior art date
Application number
PCT/KR2017/002362
Other languages
French (fr)
Korean (ko)
Inventor
엄정흠
Original Assignee
주식회사 캠시스
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 캠시스 filed Critical 주식회사 캠시스
Publication of WO2018124388A1 publication Critical patent/WO2018124388A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • B60R21/01Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
    • B60R21/013Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting collisions, impending collisions or roll-over
    • B60R21/0134Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting collisions, impending collisions or roll-over responsive to imminent contact with an obstacle, e.g. using radar systems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • G06T5/90
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/90Determination of colour characteristics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/16Image acquisition using multiple overlapping images; Image stitching
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/60Extraction of image or video features relating to illumination properties, e.g. using a reflectance or lighting model
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/98Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143Alarm means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo or light sensitive means, e.g. infrared sensors
    • B60W2420/403Image sensing, e.g. optical camera
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20208High dynamic range [HDR] image processing

Definitions

  • the present invention relates to a method for notifying objects around vehicles, and more particularly, when a vehicle without headlights turned on near a driving vehicle but is not detected by a camera of the driving vehicle, lane shapes are analyzed by analyzing lane information within a certain distance.
  • the present invention relates to a method and apparatus for notifying a vehicle around an object that can notify a driver that a vehicle or an object is nearby to greatly reduce the occurrence of a vehicle accident.
  • the AVM (Around View Monitoring) system is a system that acquires images of surrounding vehicles with front / rear and left / right cameras, and enables the driver to recognize objects in each direction.
  • the AVM system shows the driver the vehicle around them, helping them to prevent accidents.
  • the conventional AVM system has a difficulty in recognizing a headlight failure vehicle or a vehicle that does not turn on the headlight at night in a low light situation.
  • the conventional AVM system was unable to recognize an object located in a relatively dark area at low light, and if the object is present but not recognized by the AVM camera, the user cannot be warned in advance about the possibility of an accident. There was a problem.
  • the first problem to be solved by the present invention is when the vehicle is not turned on the headlights, the vehicle around the object that can significantly reduce the occurrence of a vehicle accident can be recognized by the driver in advance the risk of accidents due to lane change To provide a way.
  • the second problem to be solved by the present invention is to provide a vehicle around the object notification method that can improve the function of the existing AVM product because it can recognize a vehicle, a moving object, or a person even in low light.
  • the third problem to be solved by the present invention is to provide an object notification method around the vehicle capable of producing a low-cost product to increase the object recognition using only the camera even in low light.
  • the present invention provides a computer-readable recording medium having recorded thereon a program for executing the above method on a computer.
  • the lane image If there is no part of the present invention provides a method for notifying objects around the vehicle informing the driver that there is an object around.
  • the driver when there is a vehicle that does not turn on the headlights, the driver can recognize the risk of an accident due to a lane change in advance, thereby greatly reducing the occurrence of a vehicle accident.
  • a vehicle, a moving object, or a person can be recognized even at low light, thereby improving the function of an existing AVM product.
  • FIG. 1 is a block diagram of a vehicle surrounding object notification device according to an embodiment of the present invention.
  • FIG. 2 is a flowchart illustrating a method of notifying a vehicle surrounding object according to an exemplary embodiment of the present invention.
  • FIG. 3 is a flowchart illustrating a method for notifying a vehicle surrounding object according to another exemplary embodiment of the present invention.
  • FIG. 4 is a flowchart illustrating a method for notifying a vehicle surrounding object according to another exemplary embodiment of the present invention.
  • FIG. 5 conceptually illustrates a situation in which a driving vehicle senses a surrounding vehicle and determines whether a lane image is abnormal according to an embodiment of the present disclosure.
  • the present invention is to detect the surrounding objects of the vehicle driving by using the image obtained from the camera to achieve the first object; Determining whether the lane image is abnormal by analyzing an image acquired from the direction in which the object is not found as a result of the detection; And informing the driver of the driving vehicle that there is an object around when there is no part of the lane image as a result of the determination.
  • the detecting of the surrounding objects of the vehicle in operation may include detecting a vehicle within a predetermined distance from the vehicle, and the predetermined distance may be determined in consideration of a vehicle congestion degree or speed around the vehicle.
  • the image obtained from the camera may include at least one or more of the front, rear, left, or right of the vehicle.
  • the present invention comprises the steps of sensing the surrounding objects of the vehicle driving by using the image obtained from the camera to achieve the second object; Determining whether the lane image is abnormal by analyzing an image acquired from the direction in which the object is not found as a result of the detection; Performing color correction or brightness correction on the obtained image when there is no part of the lane image as a result of the determination; Checking the presence or absence of an object around the vehicle from the corrected image; And informing the driver of the driving vehicle that the object is around when there is an object around the vehicle as a result of the checking.
  • the brightness correction may include generating a plurality of images having different exposure times based on a brightness value of an image acquired in a partial region of the lane image, and in the plurality of images, brightness values of boundary lines of objects.
  • the lower part increases the brightness value by using an image with a long exposure time, and the higher brightness value at the boundary line of an object lowers the brightness value by using an image with a short exposure time, and then synthesizes the plurality of images. You can make corrections.
  • the color correction may perform a white balance to correct the color temperature of light.
  • color correction or brightness correction when there is no part of the lane image, color correction or brightness correction may be performed on a partial region having an abnormality in the vehicle image regardless of the surrounding brightness of the vehicle. .
  • the detecting of the surrounding objects of the vehicle in operation may include detecting a vehicle within a predetermined distance from the vehicle, and the predetermined distance may be determined in consideration of a vehicle congestion degree or speed around the vehicle.
  • a method including: detecting a surrounding object of a driving vehicle by using an image acquired from a rear of a driving vehicle to achieve the third object; Performing color correction or brightness correction on an area within a predetermined distance when there is no object as a result of the detection; Checking the presence of an object behind the vehicle from the corrected image; And informing the driver of the driving vehicle that there is an object behind the vehicle when there is an object behind the vehicle as a result of the checking.
  • the present invention provides a computer-readable recording medium having recorded thereon a program for executing the above-mentioned vehicle surrounding object notification method on a computer.
  • FIG. 1 is a block diagram of a vehicle surrounding object notification device according to an embodiment of the present invention.
  • an object information notification apparatus around a vehicle includes an object detecting unit 110, a lane abnormality determining unit 120, and an information notification unit 130.
  • the object detecting unit 110 detects a peripheral object of a driving vehicle by using the image acquired from the camera.
  • the object detecting unit 110 may selectively detect a surrounding object by using a general mode 113 using a basic camera and an HDR mode 116 using a high dynamic range (HDR) function.
  • HDR high dynamic range
  • the HDR mode 116 described herein refers to a mode in which regions having a large amount of color information are synthesized for each region of an image to generate an entire image having a large amount of color information.
  • HDR high dynamic range
  • HDR high dynamic range
  • It is a technology that adjusts the resolution of brightness values of bright areas to make the hue and brightness of the entire image frame clear.
  • a high-end image processor is required.
  • the object detecting unit 110 uses the normal mode 113 to determine the presence or absence of the surrounding object, and uses the HDR mode 116 when the lane abnormality determining signal comes from the lane abnormality determining unit 120. In the mode 113, an object not detected may be recognized. In addition, the processing speed can be improved by restricting the processing region of the HDR mode to the lane abnormality region.
  • the object detecting unit 110 when the object detecting unit 110 recognizes the surrounding object of the vehicle in the normal mode 113, the object detecting unit 110 transmits the surrounding object information to the information notification unit 130 to notify the driver without passing through the lane abnormality determining unit 120. Can be.
  • the lane abnormality determining unit 120 determines whether the lane image is abnormal by analyzing an image obtained from the direction in which the object is not detected as a result of the detection by the object detecting unit 110.
  • the abnormality of the lane image may be determined to be abnormal in the lane image when there is no part of the continuous or repeated lane image, but is not limited thereto.
  • the lane abnormality determiner 120 determines that the image is acquired by the general mode 113 of the object detector 110, and when a portion of the surrounding lane that is continuous or repeated is not detected, the lane abnormality determiner 120 lanes the object to the object detector 110. An abnormality detection signal can be transmitted.
  • the object detecting unit 110 When the object detecting unit 110 receives the lane abnormality detection signal, the object detecting unit 110 corrects the received image or the lane abnormality area through the HDR mode 116 and determines whether a neighboring object exists based on the corrected image. can do. If the object detecting unit 110 determines that there is a surrounding object, the object detecting unit 110 transmits information indicating that an object is in the vicinity of the vehicle.
  • the information notification unit 130 may notify the driver of the driving vehicle. You can tell that there is an object around.
  • the information detector 130 receives object information from the object detector 110 and transmits the object information to the driver. You can tell if there is an object.
  • the object detecting unit 110 detects a surrounding object through the HDR mode 116, when the object detecting unit 110 receives a lane abnormal signal from the lane abnormality determining unit 120 or a nearby vehicle behind the driving vehicle enters a certain distance. It is preferable that it is a case of judgment.
  • FIG. 2 is a flowchart illustrating a method of notifying a vehicle surrounding object according to an exemplary embodiment of the present invention.
  • the method for notifying a vehicle surrounding object according to the present embodiment includes steps that are processed in time series in the apparatus for notification of a vehicle surrounding object shown in FIG. 1. Therefore, even if omitted below, the above descriptions of the apparatus for notifying the surrounding objects of the vehicle shown in FIG. 1 also apply to the method for notifying the surrounding objects of the vehicle according to the present embodiment. In addition, the content overlapping with what is described in FIGS. 3 to 4 will be omitted.
  • the surrounding object is detected by using the general mode 113 of the object detecting unit 110, and the lane is abnormal after determining whether the lane is abnormal for the area without the surrounding object. If it is determined, a warning signal is sent to the vehicle driver.
  • the vehicle surrounding object notification device detects a surrounding object of a driving vehicle using an image obtained from a camera.
  • the apparatus for notifying surrounding object information may detect an object within a certain distance from the vehicle using the AVM system. Therefore, the image obtained from the camera of the AVM system may include at least one or more of the front, rear, left, or right of the vehicle.
  • the predetermined distance is an object recognition distance at which the neighboring object information notification device recognizes an object, and is a distance that is variably determined in consideration of a traffic density.
  • the speed of the surrounding vehicle within a predetermined distance may be determined based on the speed of the current driving vehicle, and the vehicle congestion degree may be calculated in consideration of the number of the surrounding vehicles.
  • the congestion degree is high and the predetermined distance to be maintained between the vehicles can be set relatively short.
  • the speed of the traveling vehicle is low and the number of surrounding vehicles having similar speeds is small, the vehicle congestion degree is low and the predetermined distance to be maintained between the vehicles can be set relatively long.
  • the vehicle congestion degree is high, the constant distance can be set relatively short.
  • the peripheral object information notification device determines the direction in which the object is not in accordance with the result of the object detection unit 110 detects the surrounding object, and the lane abnormality determination unit for the image area of the determined direction ( It is preferable that 120 determines whether the lane is abnormal.
  • the direction without an object may be any one of four directions: front, rear, left, and right, but may be increased in 8 directions, 16 directions, or the like for more accurate results.
  • the peripheral object information notification device in step 210 detects the object within a certain distance from the vehicle proceeds to step 230 to inform the driver of the detected object information. However, if the object is not detected within a certain distance from the vehicle in step 210, after determining the direction without the object proceeds to step 220.
  • the neighboring object information notification device acquires an image in a direction in which the object is absent as a result of sensing in operation 210, and determines whether the lane image existing within a predetermined distance from the vehicle is abnormal.
  • the predetermined distance may be variably determined according to the degree of vehicle congestion. If it is determined in step 220 that the lane image is normal, the process proceeds to step 210. If the lane image is determined to be abnormal, the process proceeds to step 230.
  • the abnormality of the lane image may be determined to be abnormal in the lane image when there is no part of the continuous or repeated lane image, but is not limited thereto.
  • the apparatus for notifying the surrounding object information may notify the vehicle driver of the object information when the object is identified in step 210 or may warn the driver when it is determined that the lane shape is abnormal.
  • FIG. 3 is a flowchart illustrating a method for notifying a vehicle surrounding object according to another exemplary embodiment of the present invention.
  • the method for notifying a vehicle surrounding object according to the present embodiment includes steps that are processed in time series in the apparatus for notification of a vehicle surrounding object shown in FIG. 1. Therefore, even if omitted below, the above descriptions of the apparatus for notifying the surrounding objects of the vehicle shown in FIG. 1 also apply to the method for notifying the surrounding objects of the vehicle according to the present embodiment. In addition, the content overlapping with what is described in FIG. 2 or FIG. 4 will be omitted.
  • the surrounding object is detected by using the general mode 113 of the object detecting unit 110, and after determining whether the lane is abnormal for an area without the surrounding object, the lane is abnormal. If it is determined that the presence of the surrounding object by using the HDR mode 116 of the object detection unit 110 to inform the driver of the surrounding object information.
  • steps 310, 320, and 350 shown in FIG. 3 overlap with descriptions of steps 210, 220, and 250 shown in FIG. 2, a description thereof will be omitted.
  • the neighboring object information notification device performs image processing in the HDR mode 116 on the area where the lane is determined to be abnormal in operation 320.
  • color correction or brightness correction may be performed on a portion of the vehicle image abnormality regardless of the surrounding brightness of the vehicle.
  • high dynamic range (HDR) technology is a technology for increasing the recognition rate of an image.
  • the image is captured at different shutter speeds, the resolution of the dark area brightness value of the slow shutter speed is increased, and the shutter It is a technology that adjusts the resolution of brightness values of bright areas of a fast image so that the hue and brightness of the entire image frame are clear.
  • white balance may be performed on the region determined to be abnormal.
  • White balance refers to a technique of correcting color temperature of light so that an ideal white image is captured. When the color temperature is low, the image becomes reddish, and when the color temperature is high, the light becomes blue.
  • the white balance is adjusted to white by adjusting gains of R, G, and B values in each case.
  • the apparatus for notifying the surrounding object information analyzes the color corrected or brightness corrected image to determine the presence of an object.
  • the neighboring object information notifying apparatus notifies the driver of the vehicle that is driving when there is an object around the vehicle.
  • FIG. 4 is a flowchart illustrating a method for notifying a vehicle surrounding object according to another exemplary embodiment of the present invention.
  • the method for notifying a vehicle surrounding object according to the present exemplary embodiment includes steps that are processed in time series in the apparatus for notification of a vehicle surrounding object shown in FIG. 1. Therefore, even if omitted below, the above descriptions of the apparatus for notifying the surrounding objects of the vehicle shown in FIG. 1 also apply to the method for notifying the surrounding objects of the vehicle according to the present embodiment. In addition, the content overlapping with what is described in FIGS. 2 to 3 will be omitted.
  • the general mode 1130 and the HDR mode may be used to detect a vehicle in which the headlight is broken or the headlight is not turned on. 116) determines whether there is a surrounding object present in the rear and informs the driver of the surrounding object information.
  • an apparatus for notifying surrounding object information detects surrounding objects of a driving vehicle by using an image obtained from the rear of the driving vehicle, and corrects colors for an area within a certain distance when there is no object as a result of the sensing. Or proceed to step 410 to correct the brightness.
  • the surrounding object information notification device processes the image acquired from the front or the rear of the vehicle while driving in the HDR mode.
  • HDR image processing is a technique that readjusts color resolution, taking into account the difference and distribution of high and low pixel values throughout an image frame.
  • HDR mode can add or replace other methods as an example of brightness correction or color correction.
  • the brightness correction generates a plurality of images having different exposure times based on the brightness value of the image acquired in the partial region abnormal to the lane image, and the portion of the plurality of images having the lower brightness value of the boundary line of the object is exposed.
  • the brightness value is increased by using an image having a long time and the brightness value of the boundary line of an object is a correction that synthesizes the plurality of images after lowering the brightness value by using an image having a short exposure time.
  • the color correction may be performed using a white balance that corrects the color temperature of light. On the other hand, it is preferable to perform the color correction or brightness correction irrespective of the ambient brightness of the vehicle.
  • the surrounding object information notification device confirms whether an object is located in front of or behind the vehicle from the corrected image in operation 410.
  • the predetermined distance may be determined in consideration of the congestion or speed of the vehicle around the vehicle.
  • the surrounding object information notification device notifies the driver of the driving vehicle that the object is in the front or the rear when the object is located in the front or the rear of the vehicle.
  • FIG. 5 conceptually illustrates a situation in which a driving vehicle senses a surrounding vehicle and determines whether a lane image is abnormal according to an embodiment of the present disclosure.
  • the first embodiment of the present invention detects surrounding objects while driving by using an image acquired from the camera of the general mode 113 of the vehicle A.
  • FIG. As a result of the sensing, an image in a direction in which the object is not obtained is determined to determine whether the lane image is abnormal. That is, the vehicle B and the vehicle D of FIG. 5 are detected as the surrounding objects by the camera of the general mode 113 of the vehicle A, but the vehicle C is not detected as the surrounding objects because the headlight is not turned on. In this case, it is determined whether the lane image is abnormal by acquiring an image in the direction of the vehicle C. If there is no part of the lane image that is continuous or repeated as a result of the determination, the driver of the driving vehicle is notified that there is an object in the vicinity.
  • the camera when the vehicle does not turn on the headlights in the diagonal diagonal direction, the camera is not recognized as a neighboring vehicle, it is determined whether the vehicle is covering the lane, it can be informed to the driver with a warning message.
  • the difference between the second embodiment and the first embodiment is that in the second embodiment, if it is determined that the lane image is abnormal by analyzing an image acquired from a direction in which there is no object, color correction or brightness correction is performed on the obtained image. After confirming the presence or absence of an object around the vehicle from the corrected image, the information of the surrounding vehicle is transmitted to the driver.
  • the vehicle without the headlights when the vehicle without the headlights is located at the rear, the vehicle can be detected by HDR image processing without determining whether the lane image is abnormal.
  • High-performance cameras capable of HDR image processing for rear vehicles without headlights can be used to increase object recognition in low light.
  • ' ⁇ part' used in the present embodiment refers to software or a hardware component such as a field-programmable gate array (FPGA) or an ASIC, and ' ⁇ part' performs certain roles.
  • ' ⁇ ' is not meant to be limited to software or hardware.
  • ' ⁇ Portion' may be configured to be in an addressable storage medium or may be configured to play one or more processors.
  • ' ⁇ ' means components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, procedures, and the like. Subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables.
  • the functionality provided within the components and the 'parts' may be combined into a smaller number of components and the 'parts' or further separated into additional components and the 'parts'.
  • the components and ' ⁇ ' may be implemented to play one or more CPUs in the device or secure multimedia card.
  • a processor such as a microprocessor, a controller, a microcontroller, an application specific integrated circuit (ASIC), or the like according to software or program code coded to perform the function.
  • ASIC application specific integrated circuit

Abstract

The present invention relates to a method for notifying an object around a vehicle, the method comprising the steps of: detecting an object around a moving vehicle by using an image acquired from a camera; determining whether a lane image is abnormal by analyzing the image acquired from a direction for which an object does not exist as a result of the detection; and notifying, to a driver of the moving vehicle, the presence of the object around the moving vehicle when a part of the lane image is not present as a result of the determination, thereby greatly reducing an occurrence of vehicle accidents by enabling the driver to recognize, in advance, a risk of accident according to a lane change.

Description

차량 주변 물체 알림 방법 및 장치Method and device for notification of objects around vehicles
본 발명은 차량 주변 물체 알림 방법에 관한 것으로서, 더욱 상세하게는 전조등을 켜지 않은 차량이 주행차량 주변에 있으나 주행차량의 카메라에 의해 감지되지 않는 경우, 일정 거리 안에서 차선정보를 분석하여 차선형상이 이상하다고 판단되면, 차량이나 물체가 주변에 있다고 운전자에게 알려주어 차량 사고 발생을 크게 낮출 수 있는 차량 주변 물체 알림 방법 및 장치에 관한 것이다.The present invention relates to a method for notifying objects around vehicles, and more particularly, when a vehicle without headlights turned on near a driving vehicle but is not detected by a camera of the driving vehicle, lane shapes are analyzed by analyzing lane information within a certain distance. The present invention relates to a method and apparatus for notifying a vehicle around an object that can notify a driver that a vehicle or an object is nearby to greatly reduce the occurrence of a vehicle accident.
AVM(Around View Monitoring) 시스템은 전/후방 및 좌/우 카메라로 주변 차량의 이미지를 획득하고, 운전자가 각 방향으로 물체인식을 가능하도록 하는 시스템이다. AVM 시스템은 운전자에게 주변 차량을 보여줌으로써, 운전자가 사고방지를 위한 조작을 할 수 있도록 도와준다.The AVM (Around View Monitoring) system is a system that acquires images of surrounding vehicles with front / rear and left / right cameras, and enables the driver to recognize objects in each direction. The AVM system shows the driver the vehicle around them, helping them to prevent accidents.
그러나 종래의 AVM 시스템은 저조도 상황인 야간에 전조등 고장차량이나 전조등을 켜지 않은 차량을 인식하는 데에 어려움이 있었다. 또한, 종래의 AVM 시스템은 저조도에서 상대적으로 어두운 영역에 위치한 물체를 인식할 수 없었고, 물체가 존재함에도 불구하고 AVM 카메라에서 인식되지 않은 경우, 사고 발생 가능성에 대해 사전에 사용자에게 경고를 할 수 없는 문제가 있었다.However, the conventional AVM system has a difficulty in recognizing a headlight failure vehicle or a vehicle that does not turn on the headlight at night in a low light situation. In addition, the conventional AVM system was unable to recognize an object located in a relatively dark area at low light, and if the object is present but not recognized by the AVM camera, the user cannot be warned in advance about the possibility of an accident. There was a problem.
따라서, 본 발명이 해결하고자 하는 첫 번째 과제는 전조등을 켜지 않은 차량이 주변에 있는 경우, 차선변경에 따른 사고 위험을 운전자가 사전에 인지할 수 있어 차량 사고 발생을 크게 낮출 수 있는 차량 주변 물체 알림 방법을 제공하는 것이다.Therefore, the first problem to be solved by the present invention is when the vehicle is not turned on the headlights, the vehicle around the object that can significantly reduce the occurrence of a vehicle accident can be recognized by the driver in advance the risk of accidents due to lane change To provide a way.
본 발명이 해결하고자 하는 두 번째 과제는 저조도에서도 차량, 이동체, 또는 사람을 인식할 수 있으므로 기존 AVM 제품의 기능을 개선할 수 있는 차량 주변 물체 알림 방법을 제공하는 것이다.The second problem to be solved by the present invention is to provide a vehicle around the object notification method that can improve the function of the existing AVM product because it can recognize a vehicle, a moving object, or a person even in low light.
본 발명이 해결하고자 하는 세 번째 과제는 저조도에서도 카메라만을 이용하여 물체인식을 높이는 저가 제품 생산이 가능한 차량 주변 물체 알림 방법을 제공하는 것이다.The third problem to be solved by the present invention is to provide an object notification method around the vehicle capable of producing a low-cost product to increase the object recognition using only the camera even in low light.
또한, 상기된 방법을 컴퓨터에서 실행시키기 위한 프로그램을 기록한 컴퓨터로 읽을 수 있는 기록 매체를 제공하는데 있다.Further, the present invention provides a computer-readable recording medium having recorded thereon a program for executing the above method on a computer.
상기 기술적 과제를 해결하기 위하여, 카메라로부터 획득한 이미지를 이용하여 주행 중인 차량의 주변 물체를 감지하고, 감지 결과 물체가 없는 방향으로부터 획득한 이미지를 분석하여 차선 이미지의 이상 여부를 판단한 후, 차선 이미지의 일부가 없는 경우 운전자에게 주변에 물체가 있음을 알리는 차량 주변 물체 알림 방법을 제공한다.In order to solve the technical problem, by using the image obtained from the camera to detect the surrounding objects of the vehicle driving, by analyzing the image obtained from the direction in which no object as a result of determining the abnormality of the lane image, the lane image If there is no part of the present invention provides a method for notifying objects around the vehicle informing the driver that there is an object around.
본 발명에 따르면, 전조등을 켜지 않은 차량이 주변에 있는 경우, 차선변경에 따른 사고 위험을 운전자가 사전에 인지할 수 있어 차량 사고 발생을 크게 낮출 수 있다. 또한, 본 발명에 따르면, 저조도에서도 차량, 이동체, 또는 사람을 인식할 수 있으므로 기존 AVM 제품의 기능을 개선할 수 있다. 나아가 본 발명에 따르면, 레이더나 적외선 신호를 사용하는 경우보다 상대적으로 저렴한 비용으로 저조도에서 물체를 인식할 수 있고, 저조도에서도 카메라만을 이용하여 물체인식을 높이는 저가 제품 생산이 가능하다.According to the present invention, when there is a vehicle that does not turn on the headlights, the driver can recognize the risk of an accident due to a lane change in advance, thereby greatly reducing the occurrence of a vehicle accident. In addition, according to the present invention, a vehicle, a moving object, or a person can be recognized even at low light, thereby improving the function of an existing AVM product. Furthermore, according to the present invention, it is possible to recognize an object at low light at a relatively low cost than using a radar or an infrared signal, and to produce a low-cost product that raises object recognition using only a camera even at low light.
도 1은 본 발명의 바람직한 일 실시 예에 따른 차량 주변 물체 알림 장치의 구성도이다.1 is a block diagram of a vehicle surrounding object notification device according to an embodiment of the present invention.
도 2는 본 발명의 바람직한 일 실시 예에 따른 차량 주변 물체 알림 방법의 흐름도이다.2 is a flowchart illustrating a method of notifying a vehicle surrounding object according to an exemplary embodiment of the present invention.
도 3은 본 발명의 바람직한 다른 실시 예에 따른 차량 주변 물체 알림 방법의 흐름도이다.3 is a flowchart illustrating a method for notifying a vehicle surrounding object according to another exemplary embodiment of the present invention.
도 4는 본 발명의 바람직한 또 다른 실시 예에 따른 차량 주변 물체 알림 방법의 흐름도이다.4 is a flowchart illustrating a method for notifying a vehicle surrounding object according to another exemplary embodiment of the present invention.
도 5는 본 발명에 따른 실시 예에 따라 주행 중인 차량이 주변 차량을 감지하고, 차선 이미지 이상 여부를 판단하는 상황을 개념적으로 도시한 것이다.FIG. 5 conceptually illustrates a situation in which a driving vehicle senses a surrounding vehicle and determines whether a lane image is abnormal according to an embodiment of the present disclosure.
본 발명은 상기 첫 번째 과제를 달성하기 위하여, 카메라로부터 획득한 이미지를 이용하여 주행 중인 차량의 주변 물체를 감지하는 단계; 상기 감지 결과 물체가 없는 방향으로부터 획득한 이미지를 분석하여 차선 이미지의 이상 여부를 판단하는 단계; 및 상기 판단 결과 차선 이미지의 일부가 없는 경우 상기 주행 중인 차량의 운전자에게 주변에 물체가 있음을 알리는 단계를 포함하는 차량 주변 물체 알림 방법을 제공한다.The present invention is to detect the surrounding objects of the vehicle driving by using the image obtained from the camera to achieve the first object; Determining whether the lane image is abnormal by analyzing an image acquired from the direction in which the object is not found as a result of the detection; And informing the driver of the driving vehicle that there is an object around when there is no part of the lane image as a result of the determination.
상기 주행 중인 차량의 주변 물체를 감지하는 단계는, 상기 차량으로부터 일정 거리 내에 있는 차량을 감지하고, 상기 일정 거리는 상기 차량 주변의 차량 혼잡도 또는 속도를 고려하여 결정되는 것이 바람직하다.The detecting of the surrounding objects of the vehicle in operation may include detecting a vehicle within a predetermined distance from the vehicle, and the predetermined distance may be determined in consideration of a vehicle congestion degree or speed around the vehicle.
또한, 상기 카메라로부터 획득한 이미지는 상기 차량의 전방, 후방, 좌측, 또는 우측 중 적어도 하나 이상을 포함할 수 있다.In addition, the image obtained from the camera may include at least one or more of the front, rear, left, or right of the vehicle.
본 발명은 상기 두 번째 과제를 달성하기 위하여 카메라로부터 획득한 이미지를 이용하여 주행 중인 차량의 주변 물체를 감지하는 단계; 상기 감지 결과 물체가 없는 방향으로부터 획득한 이미지를 분석하여 차선 이미지의 이상 여부를 판단하는 단계; 상기 판단 결과 차선 이미지의 일부가 없는 경우 상기 획득한 이미지에 대하여 색 보정 또는 밝기 보정을 하는 단계; 상기 보정된 이미지로부터 상기 차량 주변의 물체 유무를 확인하는 단계; 및 상기 확인 결과 상기 차량 주변에 물체가 있는 경우 상기 주행 중인 차량의 운전자에게 주변에 물체가 있음을 알리는 단계를 포함하는 차량 주변 물체 알림 방법을 제공한다.The present invention comprises the steps of sensing the surrounding objects of the vehicle driving by using the image obtained from the camera to achieve the second object; Determining whether the lane image is abnormal by analyzing an image acquired from the direction in which the object is not found as a result of the detection; Performing color correction or brightness correction on the obtained image when there is no part of the lane image as a result of the determination; Checking the presence or absence of an object around the vehicle from the corrected image; And informing the driver of the driving vehicle that the object is around when there is an object around the vehicle as a result of the checking.
상기 밝기 보정을 하는 단계는, 상기 차선이미지에 이상에 있는 일부 영역에서 획득한 이미지의 밝기값을 기준으로 노출시간이 다른 복수의 이미지를 생성하고, 상기 복수의 이미지에서 물체의 경계선의 밝기값이 낮은 부분은 노출시간이 긴 이미지를 이용하여 해당 밝기값을 높이고, 물체의 경계선의 밝기값이 높은 부분은 노출시간이 짧은 이미지를 이용하여 해당 밝기값을 낮춘 후, 상기 복수의 이미지를 합성하여 밝기 보정을 할 수 있다.The brightness correction may include generating a plurality of images having different exposure times based on a brightness value of an image acquired in a partial region of the lane image, and in the plurality of images, brightness values of boundary lines of objects. The lower part increases the brightness value by using an image with a long exposure time, and the higher brightness value at the boundary line of an object lowers the brightness value by using an image with a short exposure time, and then synthesizes the plurality of images. You can make corrections.
또한, 상기 색 보정을 하는 단계는 빛의 색 온도를 보정하는 화이트 밸런스를 수행할 수 있다.In addition, the color correction may perform a white balance to correct the color temperature of light.
또한, 상기 색 보정 또는 밝기 보정을 하는 단계는, 상기 차선 이미지의 일부가 없는 경우 상기 차량의 주위 밝기와 무관하게 상기 차량 이미지에 이상이 있는 일부 영역에 대해 색 보정 또는 밝기 보정을 하는 것이 바람직하다.In the color correction or brightness correction, when there is no part of the lane image, color correction or brightness correction may be performed on a partial region having an abnormality in the vehicle image regardless of the surrounding brightness of the vehicle. .
상기 주행 중인 차량의 주변 물체를 감지하는 단계는, 상기 차량으로부터 일정 거리 내에 있는 차량을 감지하고, 상기 일정 거리는 상기 차량 주변의 차량 혼잡도 또는 속도를 고려하여 결정되는 것이 바람직하다.The detecting of the surrounding objects of the vehicle in operation may include detecting a vehicle within a predetermined distance from the vehicle, and the predetermined distance may be determined in consideration of a vehicle congestion degree or speed around the vehicle.
본 발명은 상기 세 번째 과제를 달성하기 위하여, 주행중인 차량의 후방으로 부터 획득한 이미지를 이용하여 주행 중인 차량의 주변 물체를 감지하는 단계; 상기 감지 결과 물체가 없는 경우 일정 거리 내에 영역에 대해 색 보정 또는 밝기 보정을 하는 단계; 상기 보정된 이미지로부터 상기 차량 후방의 물체 유무를 확인하는 단계; 및 상기 확인 결과 상기 차량 후방에 물체가 있는 경우 상기 주행 중인 차량의 운전자에게 후방에 물체가 있음을 알리는 단계를 포함하는 차량 주변 물체 알림 방법을 제공한다.According to an aspect of the present invention, there is provided a method including: detecting a surrounding object of a driving vehicle by using an image acquired from a rear of a driving vehicle to achieve the third object; Performing color correction or brightness correction on an area within a predetermined distance when there is no object as a result of the detection; Checking the presence of an object behind the vehicle from the corrected image; And informing the driver of the driving vehicle that there is an object behind the vehicle when there is an object behind the vehicle as a result of the checking.
상기 기술적 과제를 해결하기 위하여, 본 발명은 상기된 차량 주변 물체 알림 방법을 컴퓨터에서 실행시키기 위한 프로그램을 기록한 컴퓨터로 읽을 수 있는 기록 매체를 제공한다. SUMMARY OF THE INVENTION In order to solve the above technical problem, the present invention provides a computer-readable recording medium having recorded thereon a program for executing the above-mentioned vehicle surrounding object notification method on a computer.
이하, 첨부된 도면을 참조하여 본 발명의 실시예를 상세하게 설명한다. 본 발명의 이점 및 특징, 그리고 그것들을 달성하는 방법은 첨부되는 도면과 함께 상세하게 후술되어 있는 실시예들을 참조하면 명확해질 것이다. 그러나, 본 발명은 이하에서 개시되는 실시예들에 제한되는 것이 아니라 서로 다른 다양한 형태로 구현될 수 있으며, 단지 본 실시예들은 본 발명의 개시가 완전하도록 하고, 본 발명이 속하는 기술분야에서 통상의 지식을 가진 자에게 본 발명의 범주를 완전하게 알려주기 위해 제공되는 것이며, 본 발명은 청구항의 범주에 의해 정의될 뿐이다.Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Advantages and features of the present invention and methods for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but can be embodied in various different forms, and the present embodiments only make the disclosure of the present invention complete, and those of ordinary skill in the art to which the present invention belongs. It is provided to fully inform those skilled in the art of the scope of the invention, which is defined only by the scope of the claims.
본 명세서에서 사용된 용어는 실시예들을 설명하기 위한 것이며 본 발명을 제한하고자 하는 것은 아니다. 본 명세서에서, 단수형은 문구에서 특별히 언급하지 않는 한 복수형도 포함한다. 명세서에서 사용되는 "포함한다(comprises)" 및/또는 "포함하는(comprising)"은 언급된 구성요소 외에 하나 이상의 다른 구성요소의 존재 또는 추가를 배제하지 않는다. 명세서 전체에 걸쳐 동일 참조 부호는 동일 구성 요소를 지칭한다. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, "comprises" and / or "comprising" does not exclude the presence or addition of one or more other components in addition to the mentioned components. Like reference numerals refer to like elements throughout.
다른 정의가 없다면, 본 명세서에서 사용되는 모든 용어(기술 및 과학적 용어를 포함)는 본 발명이 속하는 기술분야에서 통상의 지식을 가진 자에게 공통적으로 이해될 수 있는 의미로 사용될 수 있을 것이다. 또한, 일반적으로 사용되는 사전에 정의되어 있는 용어들은 명백하게 특별히 정의되어 있지 않는 한 이상적으로 또는 과도하게 해석되지 않는다.Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used in a sense that can be commonly understood by those skilled in the art. In addition, terms that are defined in a commonly used dictionary are not ideally or excessively interpreted unless they are specifically defined clearly.
이하에서는 도면을 참조하여 본 발명의 바람직한 실시 예들을 상세히 설명한다.Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.
도 1은 본 발명의 바람직한 일 실시 예에 따른 차량 주변 물체 알림 장치의 구성도이다.1 is a block diagram of a vehicle surrounding object notification device according to an embodiment of the present invention.
도 1을 참조하면, 본 실시 예에 따른 차량 주변 물체 정보 알림 장치는 물체 감지부(110), 차선 이상 판단부(120), 및 정보 알림부(130)로 구성된다. Referring to FIG. 1, an object information notification apparatus around a vehicle according to the present exemplary embodiment includes an object detecting unit 110, a lane abnormality determining unit 120, and an information notification unit 130.
물체 감지부(110)는 카메라로부터 획득한 이미지를 이용하여 주행 중인 차량의 주변 물체를 감지한다. 물체 감지부(110)는 기본 카메라를 사용하는 일반 모드(113)와 HDR(high dynamic range) 기능을 사용하는 HDR 모드(116)를 선택적으로 사용하여 주변 물체를 감지할 수 있다.The object detecting unit 110 detects a peripheral object of a driving vehicle by using the image acquired from the camera. The object detecting unit 110 may selectively detect a surrounding object by using a general mode 113 using a basic camera and an HDR mode 116 using a high dynamic range (HDR) function.
본 명세서에 기재된 HDR 모드(116)란, 이미지의 각 영역별로 많은 색 정보를 갖는 영역들을 합성하여 많은 색 정보를 갖는 전체 이미지를 생성하는 모드를 말한다. 한편, HDR(high dynamic range) 기술은 영상의 인식율을 높이기 위한 기술로서, 서로 다른 셔터 속도로 이미지를 촬영하고, 셔터속도가 느린 이미지의 어두운 영역 밝기값의 분해능은 높이고, 셔터속도가 빠른 이미지의 밝은 영역의 밝기값의 분해능은 낮추어 전체 이미지 프레임의 색조 및 밝기가 선명하도록 조절하는 기술이다. 그러나 전체 이미지 프레임에 대해 색조 및 밝기가 조절되므로, 고사양의 이미지 프로세서를 필요하다.The HDR mode 116 described herein refers to a mode in which regions having a large amount of color information are synthesized for each region of an image to generate an entire image having a large amount of color information. On the other hand, HDR (high dynamic range) technology is a technology for improving the recognition rate of the image, to shoot the image at different shutter speeds, to increase the resolution of the dark area brightness value of the image with a slow shutter speed, It is a technology that adjusts the resolution of brightness values of bright areas to make the hue and brightness of the entire image frame clear. However, because hue and brightness are adjusted for the entire image frame, a high-end image processor is required.
물체 감지부(110)는 주변 물체의 유무를 판단할 때에는 일반 모드(113)를 사용하고, 차선 이상 판단부(120)로부터 차선 이상 판단 신호가 오는 경우에는 HDR 모드(116)를 사용함으로써, 일반 모드(113)에서 감지하지 못하는 물체를 인식할 수 있다. 또한 HDR 모드의 처리 영역을 차선 이상 영역에 한정하여 처리함으로써 처리속도를 향상 시킬 수 있다.The object detecting unit 110 uses the normal mode 113 to determine the presence or absence of the surrounding object, and uses the HDR mode 116 when the lane abnormality determining signal comes from the lane abnormality determining unit 120. In the mode 113, an object not detected may be recognized. In addition, the processing speed can be improved by restricting the processing region of the HDR mode to the lane abnormality region.
한편, 물체 감지부(110)는 일반 모드(113)에서 차량의 주변 물체를 인식한 경우 차선 이상 판단부(120)를 거치지 않고, 정보 알림부(130)로 주변 물체 정보를 전송하여 운전자에게 알릴 수 있다.Meanwhile, when the object detecting unit 110 recognizes the surrounding object of the vehicle in the normal mode 113, the object detecting unit 110 transmits the surrounding object information to the information notification unit 130 to notify the driver without passing through the lane abnormality determining unit 120. Can be.
차선 이상 판단부(120)는 물체 감지부(110)가 감지한 결과, 물체가 없는 방향으로부터 획득한 이미지를 분석하여 차선 이미지의 이상 여부를 판단한다. 차선 이미지의 이상 여부는 연속되거나 반복되는 차선 이미지의 일부가 없는 경우 차선 이미지에 이상이 있다고 판단할 수 있으나 이에 한정되지 않는다.The lane abnormality determining unit 120 determines whether the lane image is abnormal by analyzing an image obtained from the direction in which the object is not detected as a result of the detection by the object detecting unit 110. The abnormality of the lane image may be determined to be abnormal in the lane image when there is no part of the continuous or repeated lane image, but is not limited thereto.
차선 이상 판단부(120)는 물체 감지부(110)의 일반 모드(113)에 의해 획득한 이미지로부터 판단한 결과, 연속되거나 반복되는 주변 차선의 일부가 감지되지 않으면, 물체 감지부(110)로 차선 이상 감지 신호를 전송할 수 있다. The lane abnormality determiner 120 determines that the image is acquired by the general mode 113 of the object detector 110, and when a portion of the surrounding lane that is continuous or repeated is not detected, the lane abnormality determiner 120 lanes the object to the object detector 110. An abnormality detection signal can be transmitted.
물체 감지부(110)가 상기 차선 이상 감지 신호를 수신하면, 수신한 이미지 또는 차선 이상 영역에 한정하여 HDR 모드(116)을 통해 보정하고, 보정된 이미지를 기초로 주변 물체가 존재하는지 여부를 판단할 수 있다. 물체 감지부(110)가 주변 물체가 존재하는 것으로 판단하면, 정보 알림부(130)로 차량 주변에 물체가 있다는 정보를 전송한다.When the object detecting unit 110 receives the lane abnormality detection signal, the object detecting unit 110 corrects the received image or the lane abnormality area through the HDR mode 116 and determines whether a neighboring object exists based on the corrected image. can do. If the object detecting unit 110 determines that there is a surrounding object, the object detecting unit 110 transmits information indicating that an object is in the vicinity of the vehicle.
정보 알림부(130)는 차선 이상 판단부(120)의 판단 결과 연속되거나 반복되는 차선 이미지의 일부가 없어 차선 이상 판단부(120)로부터 차선 이상 감지 신호를 수신하면, 상기 주행 중인 차량의 운전자에게 주변에 물체가 있음을 알릴 수 있다.If the information notification unit 130 receives a lane abnormality detection signal from the lane abnormality determining unit 120 because a part of the lane image that is continuous or repeated is not found as a result of the determination of the lane abnormality determining unit 120, the information notification unit 130 may notify the driver of the driving vehicle. You can tell that there is an object around.
또한, 정보 알림부(130)는 물체 감지부(110)가 일반 모드(113) 또는 HDR 모드(116)으로 물체를 감지하면, 물체 감지부(110)로부터 물체 정보를 수신하여 운전자에게 차량 주변에 물체가 있음을 알릴 수 있다. 물체 감지부(110)가 HDR 모드(116)를 통해 주변 물체를 감지하는 경우는 차선 이상 판단부(120)로부터 차선 이상 신호를 수신하거나 주행 차량의 후방에 있는 주변 차량이 일정 거리 내에 들어오는 경우를 판단하는 경우인 것이 바람직하다.In addition, when the object detector 110 detects an object in the normal mode 113 or the HDR mode 116, the information detector 130 receives object information from the object detector 110 and transmits the object information to the driver. You can tell if there is an object. When the object detecting unit 110 detects a surrounding object through the HDR mode 116, when the object detecting unit 110 receives a lane abnormal signal from the lane abnormality determining unit 120 or a nearby vehicle behind the driving vehicle enters a certain distance. It is preferable that it is a case of judgment.
도 2는 본 발명의 바람직한 일 실시 예에 따른 차량 주변 물체 알림 방법의 흐름도이다.2 is a flowchart illustrating a method of notifying a vehicle surrounding object according to an exemplary embodiment of the present invention.
도 2를 참조하면, 본 실시 예에 따른 차량 주변 물체 알림 방법은 도 1에 도시된 차량 주변 물체 알림 장치에서 시계열적으로 처리되는 단계들로 구성된다. 따라서, 이하 생략된 내용이라 하더라도 도 1에 도시된 차량 주변 물체 알림 장치에 관하여 이상에서 기술된 내용은 본 실시 예에 따른 차량 주변 물체 알림 방법에도 적용된다. 또한, 도 3 내지 4에 기술한 내용과 중복되는 내용은 생략하기로 한다.Referring to FIG. 2, the method for notifying a vehicle surrounding object according to the present embodiment includes steps that are processed in time series in the apparatus for notification of a vehicle surrounding object shown in FIG. 1. Therefore, even if omitted below, the above descriptions of the apparatus for notifying the surrounding objects of the vehicle shown in FIG. 1 also apply to the method for notifying the surrounding objects of the vehicle according to the present embodiment. In addition, the content overlapping with what is described in FIGS. 3 to 4 will be omitted.
도 2에 도시된 차량 주변 물체 알림 방법은 물체 감지부(110)의 일반 모드(113)를 이용하여 주변 물체를 감지하고, 주변 물체가 없는 영역에 대해서 차선의 이상 여부를 판단한 다음 차선이 이상하다고 판단되는 경우 차량 운전자에게 경고 신호를 보낸다.In the vehicle surrounding object notification method illustrated in FIG. 2, the surrounding object is detected by using the general mode 113 of the object detecting unit 110, and the lane is abnormal after determining whether the lane is abnormal for the area without the surrounding object. If it is determined, a warning signal is sent to the vehicle driver.
210 단계에서 차량 주변 물체 알림 장치는 카메라로부터 획득한 이미지를 이용하여 주행 중인 차량의 주변 물체를 감지한다.In operation 210, the vehicle surrounding object notification device detects a surrounding object of a driving vehicle using an image obtained from a camera.
본 발명에 따른 주변 물체 정보 알림 장치는 AVM 시스템을 이용하여 상기 차량으로부터 일정거리 내에 있는 물체를 감지할 수 있다. 따라서 AVM 시스템의 카메라로부터 획득한 이미지는 상기 차량의 전방, 후방, 좌측, 또는 우측 중 적어도 하나 이상을 포함할 수 있다. 상기 일정 거리는 주변 물체 정보 알림 장치가 물체를 인식하는 물체 인식거리로서, 차량 혼잡도(traffic density)를 고려하여 가변적인 결정되는 거리이다. 이때, 현재 주행 차량의 속도를 기준으로 일정 거리 안에 있는 주변 차량의 속도를 파악하고, 주변차량의 수를 고려하여 차량혼잡도를 계산할 수 있다. The apparatus for notifying surrounding object information according to the present invention may detect an object within a certain distance from the vehicle using the AVM system. Therefore, the image obtained from the camera of the AVM system may include at least one or more of the front, rear, left, or right of the vehicle. The predetermined distance is an object recognition distance at which the neighboring object information notification device recognizes an object, and is a distance that is variably determined in consideration of a traffic density. In this case, the speed of the surrounding vehicle within a predetermined distance may be determined based on the speed of the current driving vehicle, and the vehicle congestion degree may be calculated in consideration of the number of the surrounding vehicles.
예를 들어, 주행차량의 속도가 저속이고, 속도가 유사한 주변차량의 수가 많은 경우, 차량혼잡도는 높고, 차량간 유지해야 하는 일정거리는 상대적으로 짧게 설정할 수 있다. 한편, 주행차량의 속도가 저속이고, 속도가 유사한 주변차량의 수가 적은 경우, 차량혼잡도는 낮고, 차량간 유지해야 하는 일정거리는 상대적으로 길게 설정 가능하다.For example, when the speed of the traveling vehicle is low and the number of surrounding vehicles having similar speeds is large, the congestion degree is high and the predetermined distance to be maintained between the vehicles can be set relatively short. On the other hand, when the speed of the traveling vehicle is low and the number of surrounding vehicles having similar speeds is small, the vehicle congestion degree is low and the predetermined distance to be maintained between the vehicles can be set relatively long.
반면 주행 차량의 속도가 고속이고, 속도가 유사한 주변차량의 수가 적은 경우에는 차량 혼잡도가 낮으므로, 유지해야 할 차량의 일정거리를 상대적으로 크게 설정 가능할 수 있고, 반대로 속도가 유사한 주변차량의 수가 많은 경우에는 차량 혼잡도가 높으므로, 일정거리는 상대적으로 짧게 설정 가능하다.On the other hand, when the speed of the driving vehicle is high and the number of vehicles with similar speeds is small, the vehicle congestion is low. Therefore, a certain distance of the vehicle to be maintained may be relatively large, and conversely, the number of vehicles with similar speeds may be large. In this case, since the vehicle congestion degree is high, the constant distance can be set relatively short.
다만, 같은 차량 혼잡도라고 하더라도 주행 차량의 속도가 저속인 경우보다 고속인 경우 차량간 유지해야 하는 일정거리를 길게 설정하는 것이 바람직하다.However, even in the same vehicle congestion degree, it is preferable to set a predetermined distance to be maintained between vehicles when the speed of the traveling vehicle is higher than when the speed of the driving vehicle is high.
또한, 본 발명의 실시 예에 따른 주변 물체 정보 알림 장치는 물체 감지부(110)가 주변 물체를 감지한 결과에 따라 물체가 없는 방향을 결정하고, 결정된 방향의 이미지 영역에 대해서 차선 이상 판단부(120)가 차선의 이상 여부를 판단하는 것이 바람직하다. 물체가 없는 방향은 전후좌우 4 방향 중 어느 한 방향일 수 있으나, 보다 정확한 결과를 위해 8방향, 16방향 등으로 늘릴 수 있을 것이다. In addition, the peripheral object information notification device according to an embodiment of the present invention determines the direction in which the object is not in accordance with the result of the object detection unit 110 detects the surrounding object, and the lane abnormality determination unit for the image area of the determined direction ( It is preferable that 120 determines whether the lane is abnormal. The direction without an object may be any one of four directions: front, rear, left, and right, but may be increased in 8 directions, 16 directions, or the like for more accurate results.
한편, 본 발명의 다른 실시 예에 따른 주변 물체 정보 알림 장치는 210 단계에서 상기 차량으로부터 일정거리 안에 있는 물체를 감지한 경우 230 단계로 진행하여 운전자에게 감지한 물체의 정보를 알린다. 그러나, 210 단계에서 상기 차량으로부터 일정거리 안에 있는 물체를 감지하지 못한 경우 물체가 없는 방향을 결정한 후 220 단계로 진행한다.On the other hand, the peripheral object information notification device according to another embodiment of the present invention in step 210 detects the object within a certain distance from the vehicle proceeds to step 230 to inform the driver of the detected object information. However, if the object is not detected within a certain distance from the vehicle in step 210, after determining the direction without the object proceeds to step 220.
220 단계에서 주변 물체 정보 알림 장치는 210 단계에서 감지한 결과 물체가 없는 방향의 이미지를 획득하여 상기 차량으로부터 일정 거리 내에 존재하는 차선 이미지의 이상 여부를 판단한다. 상기 일정 거리는 차량 혼잡도에 따라 가변적으로 결정될 수 있다. 220 단계에서 차선 이미지가 정상이라고 판단되면, 210 단계로 진행하고, 차선 이미지가 이상하다고 판단되면, 230 단계로 진행한다. 차선 이미지의 이상 여부는 연속되거나 반복되는 차선 이미지의 일부가 없는 경우 차선 이미지에 이상이 있다고 판단할 수 있으나 이에 한정되지 않는다.In operation 220, the neighboring object information notification device acquires an image in a direction in which the object is absent as a result of sensing in operation 210, and determines whether the lane image existing within a predetermined distance from the vehicle is abnormal. The predetermined distance may be variably determined according to the degree of vehicle congestion. If it is determined in step 220 that the lane image is normal, the process proceeds to step 210. If the lane image is determined to be abnormal, the process proceeds to step 230. The abnormality of the lane image may be determined to be abnormal in the lane image when there is no part of the continuous or repeated lane image, but is not limited thereto.
250 단계에서 주변 물체 정보 알림 장치는 210 단계에서 물체가 확인되면 차량 운전자에게 물체 정보를 알리거나 차선 형상이 이상하다고 판단되면, 운전자에게 경고를 할 수 있다.In operation 250, the apparatus for notifying the surrounding object information may notify the vehicle driver of the object information when the object is identified in step 210 or may warn the driver when it is determined that the lane shape is abnormal.
도 3은 본 발명의 바람직한 다른 실시 예에 따른 차량 주변 물체 알림 방법의 흐름도이다.3 is a flowchart illustrating a method for notifying a vehicle surrounding object according to another exemplary embodiment of the present invention.
도 3을 참조하면, 본 실시 예에 따른 차량 주변 물체 알림 방법은 도 1에 도시된 차량 주변 물체 알림 장치에서 시계열적으로 처리되는 단계들로 구성된다. 따라서, 이하 생략된 내용이라 하더라도 도 1에 도시된 차량 주변 물체 알림 장치에 관하여 이상에서 기술된 내용은 본 실시 예에 따른 차량 주변 물체 알림 방법에도 적용된다. 또한, 도 2 또는 도 4에 기술한 내용과 중복되는 내용은 생략하기로 한다.Referring to FIG. 3, the method for notifying a vehicle surrounding object according to the present embodiment includes steps that are processed in time series in the apparatus for notification of a vehicle surrounding object shown in FIG. 1. Therefore, even if omitted below, the above descriptions of the apparatus for notifying the surrounding objects of the vehicle shown in FIG. 1 also apply to the method for notifying the surrounding objects of the vehicle according to the present embodiment. In addition, the content overlapping with what is described in FIG. 2 or FIG. 4 will be omitted.
도 3에 도시된 차량 주변 물체 알림 방법은 물체 감지부(110)의 일반 모드(113)를 이용하여 주변 물체를 감지하고, 주변 물체가 없는 영역에 대해서 차선의 이상 여부를 판단한 다음, 차선이 이상하다고 판단되는 경우 물체 감지부(110)의 HDR 모드(116)를 이용하여 주변 물체의 존재 여부를 판단하여 운전자에게 주변 물체 정보를 알린다. In the vehicle surrounding object notification method illustrated in FIG. 3, the surrounding object is detected by using the general mode 113 of the object detecting unit 110, and after determining whether the lane is abnormal for an area without the surrounding object, the lane is abnormal. If it is determined that the presence of the surrounding object by using the HDR mode 116 of the object detection unit 110 to inform the driver of the surrounding object information.
도 3에 도시된 310 단계, 320 단계, 350 단계는 도 2에 도시된 210 단계, 220 단계, 250 단계와 설명이 중복되므로, 생략하기로 한다.Since steps 310, 320, and 350 shown in FIG. 3 overlap with descriptions of steps 210, 220, and 250 shown in FIG. 2, a description thereof will be omitted.
330 단계에서 주변 물체 정보 알림 장치는 320 단계에서 차선이 이상하다고 판단되는 영역에 대해 HDR 모드(116)로 이미지 처리를 한다. In operation 330, the neighboring object information notification device performs image processing in the HDR mode 116 on the area where the lane is determined to be abnormal in operation 320.
이때, 차선 이미지의 이상 여부는 연속되거나 반복되는 차선 이미지의 일부가 없는 경우 차선 이미지에 이상이 있다고 판단할 수 있다. 상기 차선 이미지의 일부가 없는 경우 상기 차량의 주위 밝기와 무관하게 상기 차량 이미지 이상이 있는 일부 영역에 대해 색 보정 또는 밝기 보정을 할 수 있다.In this case, it may be determined whether the lane image has an abnormality in the lane image when there is no part of the continuous or repeated lane image. When there is no part of the lane image, color correction or brightness correction may be performed on a portion of the vehicle image abnormality regardless of the surrounding brightness of the vehicle.
밝기 보정의 일 예로서, HDR(high dynamic range) 기술은 영상의 인식율을 높이기 위한 기술로서, 서로 다른 셔터 속도로 이미지를 촬영하고, 셔터속도가 느린 이미지의 어두운 영역 밝기값의 분해능은 높이고, 셔터속도가 빠른 이미지의 밝은 영역의 밝기값의 분해능은 낮추어 전체 이미지 프레임의 색조 및 밝기가 선명하도록 조절하는 기술이다. As an example of brightness correction, high dynamic range (HDR) technology is a technology for increasing the recognition rate of an image. The image is captured at different shutter speeds, the resolution of the dark area brightness value of the slow shutter speed is increased, and the shutter It is a technology that adjusts the resolution of brightness values of bright areas of a fast image so that the hue and brightness of the entire image frame are clear.
색 보정의 일 예로서, 상기 이상하다고 판단되는 영역에 대해서 화이트 밸런스(White balance)을 수행할 수 있다. 화이트 밸런스란, 빛의 색온도를 보정하여 이상적인 흰색이 촬영되도록 하는 기술을 말한다. 색온도가 낮으면 이미지가 붉은 빛을 띄고, 색온도가 높은 경우에는 파란 빛을 띄게 되는데, 화이트 밸런스는 각각의 경우에 R,G,B 값의 게인(gain)을 조정함으로써, 흰색으로 조정하는 것이다. As an example of color correction, white balance may be performed on the region determined to be abnormal. White balance refers to a technique of correcting color temperature of light so that an ideal white image is captured. When the color temperature is low, the image becomes reddish, and when the color temperature is high, the light becomes blue. The white balance is adjusted to white by adjusting gains of R, G, and B values in each case.
또한, 차선 이미지가 이상한 부분의 픽셀에 대해서만 HDR 이미지 처리를 함으로써, 계산량을 줄이고 실시간으로 차선 이상 여부를 효과적으로 판단할 수 있다.In addition, by performing HDR image processing only on the pixel of the strange part of the lane image, it is possible to reduce the calculation amount and effectively determine whether the lane is abnormal in real time.
340 단계에서 주변 물체 정보 알림 장치는 330 단계에서 색 보정 또는 밝기 보정된 이미지를 분석하여 물체의 유무를 확인한다. In operation 340, the apparatus for notifying the surrounding object information analyzes the color corrected or brightness corrected image to determine the presence of an object.
350 단계에서 주변 물체 정보 알림 장치는 340 단계에서 확인한 결과 상기 차량 주변에 물체가 있는 경우 상기 주행 중인 차량의 운전자에게 주변에 물체가 있음을 알린다.In operation 350, the neighboring object information notifying apparatus notifies the driver of the vehicle that is driving when there is an object around the vehicle.
도 4는 본 발명의 바람직한 또 다른 실시 예에 따른 차량 주변 물체 알림 방법의 흐름도이다.4 is a flowchart illustrating a method for notifying a vehicle surrounding object according to another exemplary embodiment of the present invention.
도 4를 참조하면, 본 실시 예에 따른 차량 주변 물체 알림 방법은 도 1에 도시된 차량 주변 물체 알림 장치에서 시계열적으로 처리되는 단계들로 구성된다. 따라서, 이하 생략된 내용이라 하더라도 도 1에 도시된 차량 주변 물체 알림 장치에 관하여 이상에서 기술된 내용은 본 실시 예에 따른 차량 주변 물체 알림 방법에도 적용된다. 또한, 도 2 내지 3에 기술한 내용과 중복되는 내용은 생략하기로 한다.Referring to FIG. 4, the method for notifying a vehicle surrounding object according to the present exemplary embodiment includes steps that are processed in time series in the apparatus for notification of a vehicle surrounding object shown in FIG. 1. Therefore, even if omitted below, the above descriptions of the apparatus for notifying the surrounding objects of the vehicle shown in FIG. 1 also apply to the method for notifying the surrounding objects of the vehicle according to the present embodiment. In addition, the content overlapping with what is described in FIGS. 2 to 3 will be omitted.
도 4에 도시된 차량 주변 물체 알림 방법은 주행 중인 차량의 후방에 있는 주변 차량 중 전조등이 고장나거나 전조등을 켜지 않은 차량을 감지하기 위해 물체 감지부(110)의 일반 모드(1130)와 HDR 모드(116)를 이용하여 후방에 존재하는 주변 물체의 존재 여부를 판단하고 운전자에게 주변 물체 정보를 알린다. In the vehicle surrounding object notification method illustrated in FIG. 4, the general mode 1130 and the HDR mode (of the object detecting unit 110) may be used to detect a vehicle in which the headlight is broken or the headlight is not turned on. 116) determines whether there is a surrounding object present in the rear and informs the driver of the surrounding object information.
본 발명의 실시 예에 따른 주변 물체 정보 알림 장치는 주행 중인 차량의 후방으로부터 획득한 이미지를 이용하여 주행 중인 차량의 주변 물체를 감지하고, 상기 감지결과 물체가 없는 경우 일정 거리 내의 영역에 대해 색 보정 또는 밝기 보정을 하기 위해 410 단계로 진행한다.According to an exemplary embodiment of the present disclosure, an apparatus for notifying surrounding object information detects surrounding objects of a driving vehicle by using an image obtained from the rear of the driving vehicle, and corrects colors for an area within a certain distance when there is no object as a result of the sensing. Or proceed to step 410 to correct the brightness.
410 단계에서 주변 물체 정보 알림 장치는 주행 중 차량의 전방 또는 후방으로부터 획득한 이미지를 HDR 모드로 이미지 처리한다. HDR 이미지 프로세싱은 이미지 프레임 전체의 높은 픽셀값과 낮은 픽셀값의 차이 및 분포를 고려하여, 색 분해능을 재조정하는 기술이다. HDR 모드는 밝기 보정 또는 색 보정의 일 례로서 다른 방식을 추가하거나 대체할 수 있다.In operation 410, the surrounding object information notification device processes the image acquired from the front or the rear of the vehicle while driving in the HDR mode. HDR image processing is a technique that readjusts color resolution, taking into account the difference and distribution of high and low pixel values throughout an image frame. HDR mode can add or replace other methods as an example of brightness correction or color correction.
상기 밝기 보정은 상기 차선 이미지에 이상에 있는 일부 영역에서 획득한 이미지의 밝기값을 기준으로 노출시간이 다른 복수의 이미지를 생성하고, 상기 복수의 이미지에서 물체의 경계선의 밝기값이 낮은 부분은 노출시간이 긴 이미지를 이용하여 해당 밝기값을 높이고, 물체의 경계선의 밝기값이 높은 부분은 노출시간이 짧은 이미지를 이용하여 해당 밝기값을 낮춘 후, 상기 복수의 이미지를 합성하는 보정이다. 또한, 빛의 색온도를 보정하는 화이트 밸런스를 이용하여 상기 색 보정을 할 수 있다. 한편, 상기 차량의 주위 밝기와 무관하게 상기 색 보정 또는 밝기 보정을 하는 것이 바람직하다. The brightness correction generates a plurality of images having different exposure times based on the brightness value of the image acquired in the partial region abnormal to the lane image, and the portion of the plurality of images having the lower brightness value of the boundary line of the object is exposed. The brightness value is increased by using an image having a long time and the brightness value of the boundary line of an object is a correction that synthesizes the plurality of images after lowering the brightness value by using an image having a short exposure time. In addition, the color correction may be performed using a white balance that corrects the color temperature of light. On the other hand, it is preferable to perform the color correction or brightness correction irrespective of the ambient brightness of the vehicle.
420 단계에서 주변 물체 정보 알림 장치는 410 단계에서 보정된 이미지로부터 상기 차량의 전방 또는 후방의 물체 유무를 확인한다.In operation 420, the surrounding object information notification device confirms whether an object is located in front of or behind the vehicle from the corrected image in operation 410.
이때, 상기 차량의 전방 또는 후방으로부터 일정 거리 내에 있는 차량을 감지하는 것이 바람직하고, 상기 일정 거리는 상기 차량 주변의 차량 혼잡도 또는 속도를 고려하여 결정될 수 있다.At this time, it is preferable to detect a vehicle within a predetermined distance from the front or rear of the vehicle, the predetermined distance may be determined in consideration of the congestion or speed of the vehicle around the vehicle.
430 단계에서 주변 물체 정보 알림 장치는 420 단계에서 확인한 결과 상기 차량의 전방 또는 후방에 물체가 있는 경우 상기 주행 중인 차량의 운전자에게 전방 또는 후방에 물체가 있음을 알린다.In operation 430, the surrounding object information notification device notifies the driver of the driving vehicle that the object is in the front or the rear when the object is located in the front or the rear of the vehicle.
도 5는 본 발명에 따른 실시 예에 따라 주행 중인 차량이 주변 차량을 감지하고, 차선 이미지 이상 여부를 판단하는 상황을 개념적으로 도시한 것이다.FIG. 5 conceptually illustrates a situation in which a driving vehicle senses a surrounding vehicle and determines whether a lane image is abnormal according to an embodiment of the present disclosure.
도 2와 도 5를 참조하여 본 발명의 바람직한 제1 실시예를 살펴보면, 차량 A의 일반 모드(113) 카메라로부터 획득한 이미지를 이용하여 주행 중인 주변 물체를 감지한다. 상기 감지 결과 상기 물체가 없는 방향의 이미지를 획득하여 차선 이미지의 이상 여부를 판단한다. 즉, 도 5의 차량 B와 차량 D는 차량 A의 일반 모드(113) 카메라에 의해 주변 물체로 감지되었으나 차량 C는 전조등이 켜지지 않아 주변 물체로 감지되지 않는다. 이 경우 차량 C 방향의 이미지를 획득하여 차선 이미지의 이상 여부를 판단하게 되는데, 상기 판단 결과 연속되거나 반복되는 차선 이미지의 일부가 없는 경우 상기 주행 중인 차량의 운전자에게 주변에 물체가 있음을 알리게 된다.Referring to FIG. 2 and FIG. 5, the first embodiment of the present invention detects surrounding objects while driving by using an image acquired from the camera of the general mode 113 of the vehicle A. FIG. As a result of the sensing, an image in a direction in which the object is not obtained is determined to determine whether the lane image is abnormal. That is, the vehicle B and the vehicle D of FIG. 5 are detected as the surrounding objects by the camera of the general mode 113 of the vehicle A, but the vehicle C is not detected as the surrounding objects because the headlight is not turned on. In this case, it is determined whether the lane image is abnormal by acquiring an image in the direction of the vehicle C. If there is no part of the lane image that is continuous or repeated as a result of the determination, the driver of the driving vehicle is notified that there is an object in the vicinity.
도 3과 도 5를 참조하여 본 발명의 바람직한 제2 실시예를 살펴보면, 일반 모드(113) 카메라와 HDR 모드(116) 카메라를 선택적으로 이용하여 전조등을 켜지 않은 차량이 옆 차선에 있는 경우, 해당 차량이 차선을 가리고 있는지 여부를 판단하여, HDR 이미지 프로세싱 작동시켜, 주변 물체 유무를 확인할 수 있다. Referring to FIG. 3 and FIG. 5, when a vehicle in which a headlight is not turned on by using a general mode 113 camera and an HDR mode 116 camera is selectively located in a side lane, It may be determined whether the vehicle is covering the lane, and HDR image processing may be performed to determine whether or not the surrounding object is present.
또한, 전조등을 켜지 않은 차량이 후미 대각선 방향에 있는 경우, 카메라로 주변 차량으로 인식되지는 않지만, 해당 차량이 차선을 가리고 있는지 여부를 판단하여, 운전자에게 경고 메시지로 알려줄 수 있다.In addition, when the vehicle does not turn on the headlights in the diagonal diagonal direction, the camera is not recognized as a neighboring vehicle, it is determined whether the vehicle is covering the lane, it can be informed to the driver with a warning message.
제2 실시예와 제1 실시예의 차이점은 제2 실시예에서는 물체가 없는 방향으로부터 획득한 이미지를 분석하여 차선 이미지가 이상하다고 판단되면, 상기 획득한 이미지에 대하여 색 보정 또는 밝기 보정을 하고, 상기 보정된 이미지로부터 상기 차량 주변의 물체 유무를 확인한 후, 운전자에게 상기 주변 차량의 정보를 전달하는 것이다.The difference between the second embodiment and the first embodiment is that in the second embodiment, if it is determined that the lane image is abnormal by analyzing an image acquired from a direction in which there is no object, color correction or brightness correction is performed on the obtained image. After confirming the presence or absence of an object around the vehicle from the corrected image, the information of the surrounding vehicle is transmitted to the driver.
도 4와 도 5를 참조하여 본 발명의 바람직한 제3 실시예를 살펴보면, 전조등을 켜지 않은 차량이 후방에 있는 경우, 차선 이미지의 이상 여부를 판단하지 않고 해당 차량을 HDR 이미지 프로세싱으로 감지할 수 있다. 전조등을 켜지 않은 후방 차량에 대하여 HDR 이미지 프로세싱이 가능한 고성능 카메라를 이용하여 저조도에서 물체 인식율을 높일 수 있다.Referring to FIG. 4 and FIG. 5, when the vehicle without the headlights is located at the rear, the vehicle can be detected by HDR image processing without determining whether the lane image is abnormal. . High-performance cameras capable of HDR image processing for rear vehicles without headlights can be used to increase object recognition in low light.
본 실시 예에서 사용되는 '~부'라는 용어는 소프트웨어 또는 FPGA(field-programmable gate array) 또는 ASIC과 같은 하드웨어 구성요소를 의미하며, '~부'는 어떤 역할들을 수행한다. 그렇지만 '~부'는 소프트웨어 또는 하드웨어에 한정되는 의미는 아니다. '~부'는 어드레싱할 수 있는 저장 매체에 있도록 구성될 수도 있고 하나 또는 그 이상의 프로세서들을 재생시키도록 구성될 수도 있다. 따라서, 일 예로서 '~부'는 소프트웨어 구성요소들, 객체지향 소프트웨어 구성요소들, 클래스 구성요소들 및 태스크 구성요소들과 같은 구성요소들과, 프로세스들, 함수들, 속성들, 프로시저들, 서브루틴들, 프로그램 코드의 세그먼트들, 드라이버들, 펌웨어, 마이크로코드, 회로, 데이터,데이터베이스, 데이터 구조들, 테이블들, 어레이들, 및 변수들을 포함한다. 구성요소들과 '~부'들 안에서 제공되는 기능은 더 작은 수의 구성요소들 및 '~부'들로 결합되거나 추가적인 구성요소들과 '~부'들로 더 분리될 수 있다. 뿐만 아니라, 구성요소들 및 '~부'들은 디바이스 또는 보안 멀티미디어카드 내의 하나 또는 그 이상의 CPU들을 재생시키도록 구현될 수도 있다.The term '~ part' used in the present embodiment refers to software or a hardware component such as a field-programmable gate array (FPGA) or an ASIC, and '~ part' performs certain roles. However, '~' is not meant to be limited to software or hardware. '~ Portion' may be configured to be in an addressable storage medium or may be configured to play one or more processors. Thus, as an example, '~' means components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, procedures, and the like. Subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables. The functionality provided within the components and the 'parts' may be combined into a smaller number of components and the 'parts' or further separated into additional components and the 'parts'. In addition, the components and '~' may be implemented to play one or more CPUs in the device or secure multimedia card.
상술한 모든 기능은 상기 기능을 수행하도록 코딩된 소프트웨어나 프로그램 코드 등에 따른 마이크로프로세서, 제어기, 마이크로제어기, ASIC(Application Specific Integrated Circuit) 등과 같은 프로세서에 의해 수행될 수 있다. 상기 코드의 설계, 개발 및 구현은 본 발명의 설명에 기초하여 당업자에게 자명하다고 할 것이다.All of the above functions may be performed by a processor such as a microprocessor, a controller, a microcontroller, an application specific integrated circuit (ASIC), or the like according to software or program code coded to perform the function. The design, development and implementation of the code will be apparent to those skilled in the art based on the description of the present invention.
이상 본 발명에 대하여 실시 예를 참조하여 설명하였지만, 해당 기술 분야의 통상의 지식을 가진 자는 본 발명의 기술적 사상 및 영역으로부터 벗어나지 않는 범위 내에서 본 발명을 다양하게 수정 및 변경시켜 실시할 수 있음을 이해할 수 있을 것이다. 따라서 상술한 실시 예에 한정되지 않고, 본 발명은 이하의 특허청구범위의 범위 내의 모든 실시 예들을 포함한다고 할 것이다.Although the present invention has been described above with reference to the embodiments, it will be understood by those skilled in the art that various modifications and changes of the present invention can be made without departing from the spirit and scope of the present invention. I can understand. Therefore, the present invention is not limited to the above-described embodiment, and the present invention will include all embodiments within the scope of the following claims.

Claims (17)

  1. 카메라로부터 획득한 이미지를 이용하여 주행 중인 차량의 주변 물체를 감지하는 단계;Detecting a peripheral object of a driving vehicle using an image obtained from a camera;
    상기 감지 결과 물체가 없는 방향으로부터 획득한 이미지를 분석하여 차선 이미지의 이상 여부를 판단하는 단계; 및Determining whether the lane image is abnormal by analyzing an image acquired from the direction in which the object is not found as a result of the detection; And
    상기 판단 결과 차선 이미지의 일부가 없는 경우 상기 주행 중인 차량의 운전자에게 주변에 물체가 있음을 알리는 단계를 포함하는 차량 주변 물체 알림 방법.And informing the driver of the driving vehicle that there is an object around when there is no part of the lane image as a result of the determination.
  2. 제1 항에 있어서,According to claim 1,
    상기 주행 중인 차량의 주변 물체를 감지하는 단계는,Detecting a peripheral object of the driving vehicle,
    상기 차량으로부터 일정 거리 내에 있는 차량을 감지하고,Detect a vehicle within a certain distance from the vehicle,
    상기 일정 거리는 상기 차량 주변의 차량 혼잡도 또는 속도를 고려하여 결정되는 차량 주변 물체 알림 방법.The predetermined distance is determined in consideration of vehicle congestion or speed around the vehicle surrounding object notification method.
  3. 제1 항에 있어서,According to claim 1,
    상기 카메라로부터 획득한 이미지는 상기 차량의 전방, 후방, 좌측, 또는 우측 중 적어도 하나 이상을 포함하는 차량 주변 물체 알림 방법.The image obtained from the camera comprises at least one of the front, rear, left, or right side of the vehicle at least one object notification method.
  4. 카메라로부터 획득한 이미지를 이용하여 주행 중인 차량의 주변 물체를 감지하는 단계;Detecting a peripheral object of a driving vehicle using an image obtained from a camera;
    상기 감지 결과 물체가 없는 방향으로부터 획득한 이미지를 분석하여 차선 이미지의 이상 여부를 판단하는 단계; Determining whether the lane image is abnormal by analyzing an image acquired from the direction in which the object is not found as a result of the detection;
    상기 판단 결과 차선 이미지의 일부가 없는 경우 상기 획득한 이미지에 대하여 색 보정 또는 밝기 보정을 하는 단계; Performing color correction or brightness correction on the obtained image when there is no part of the lane image as a result of the determination;
    상기 보정된 이미지로부터 상기 차량 주변의 물체 유무를 확인하는 단계; 및Checking the presence or absence of an object around the vehicle from the corrected image; And
    상기 확인 결과 상기 차량 주변에 물체가 있는 경우 상기 주행 중인 차량의 운전자에게 주변에 물체가 있음을 알리는 단계를 포함하는 차량 주변 물체 알림 방법.If there is an object around the vehicle as a result of the checking, informing the driver of the driving vehicle that the object is around the vehicle.
  5. 제4 항에 있어서,The method of claim 4, wherein
    상기 밝기 보정을 하는 단계는, The brightness correction step,
    상기 차선이미지에 이상에 있는 일부 영역에서 획득한 이미지의 밝기값을 기준으로 노출시간이 다른 복수의 이미지를 생성하고, 상기 복수의 이미지에서 물체의 경계선의 밝기값이 낮은 부분은 노출시간이 긴 이미지를 이용하여 해당 밝기값을 높이고, 물체의 경계선의 밝기값이 높은 부분은 노출시간이 짧은 이미지를 이용하여 해당 밝기값을 낮춘 후, 상기 복수의 이미지를 합성하는 것을 특징으로 하는 차량 주변 물체 알림 방법.A plurality of images having different exposure times are generated based on brightness values of an image acquired in a part of the lane image that is abnormal, and a portion of the plurality of images having a low brightness value of an edge of an object has a long exposure time image. Increasing the corresponding brightness value using the image, and lowering the corresponding brightness value by using an image having a short exposure time in a portion where the brightness value of the boundary line of the object is reduced, and then synthesizing the plurality of images. .
  6. 제4 항에 있어서,The method of claim 4, wherein
    상기 색 보정을 하는 단계는 빛의 색 온도를 보정하는 화이트 밸런스를 수행하는 것을 특징으로 하는 차량 주변 물체 알림 방법.Wherein the color correction step is a vehicle around the object notification method, characterized in that for performing a white balance to correct the color temperature of the light.
  7. 제4 항에 있어서,The method of claim 4, wherein
    상기 색 보정 또는 밝기 보정을 하는 단계는,The color correction or brightness correction step,
    상기 차선 이미지의 일부가 없는 경우 상기 차량의 주위 밝기와 무관하게 상기 차량 이미지에 이상이 있는 일부 영역에 대해 색 보정 또는 밝기 보정을 하는 것을 특징으로 하는 차량 주변 물체 알림 방법.When the part of the lane image does not exist, the object around the vehicle notification method characterized in that the color correction or brightness correction for a partial region of the vehicle image irrespective of the ambient brightness of the vehicle.
  8. 제4 항에 있어서,The method of claim 4, wherein
    상기 주행 중인 차량의 주변 물체를 감지하는 단계는,Detecting a peripheral object of the driving vehicle,
    상기 차량으로부터 일정 거리 내에 있는 차량을 감지하고,Detect a vehicle within a certain distance from the vehicle,
    상기 일정 거리는 상기 차량 주변의 차량 혼잡도 또는 속도를 고려하여 결정되는 차량 주변 물체 알림 방법.The predetermined distance is determined in consideration of vehicle congestion or speed around the vehicle surrounding object notification method.
  9. 주행중인 차량의 후방으로 부터 획득한 이미지를 이용하여 주행 중인 차량의 주변 물체를 감지하는 단계;Detecting a peripheral object of the driving vehicle using an image acquired from the rear of the driving vehicle;
    상기 감지 결과 물체가 없는 경우 일정 거리 내에 영역에 대해 색 보정 또는 밝기 보정을 하는 단계;Performing color correction or brightness correction on an area within a predetermined distance when there is no object as a result of the detection;
    상기 보정된 이미지로부터 상기 차량 후방의 물체 유무를 확인하는 단계; 및Checking the presence of an object behind the vehicle from the corrected image; And
    상기 확인 결과 상기 차량 후방에 물체가 있는 경우 상기 주행 중인 차량의 운전자에게 후방에 물체가 있음을 알리는 단계를 포함하는 차량 주변 물체 알림 방법.And informing the driver of the driving vehicle that there is an object behind the vehicle when there is an object behind the vehicle as a result of the checking.
  10. 제9 항에 있어서,The method of claim 9,
    상기 밝기 보정을 하는 단계는, The brightness correction step,
    상기 획득한 이미지의 밝기값을 기준으로 노출시간이 다른 복수의 이미지를 생성하고, 상기 복수의 이미지에서 물체의 경계선의 밝기값이 낮은 부분은 노출시간이 긴 이미지를 이용하여 해당 밝기값을 높이고, 물체의 경계선의 밝기값이 높은 부분은 노출시간이 짧은 이미지를 이용하여 해당 밝기값을 낮춘 후, 상기 복수의 이미지를 합성하는 것을 특징으로 하는 차량 주변 물체 알림 방법.Generate a plurality of images having different exposure times based on the brightness value of the obtained image, and increase the corresponding brightness value by using an image having a long exposure time in a portion where the brightness value of the boundary of the object is low in the plurality of images, The high-brightness value of the boundary line of the object lowers the brightness value by using an image having a short exposure time, and then synthesizes the plurality of images.
  11. 제9 항에 있어서,The method of claim 9,
    상기 색 보정을 하는 단계는 빛의 색온도를 보정하는 화이트 밸런스를 수행하는 것을 특징으로 하는 차량 주변 물체 알림 방법.Wherein the color correction step is a vehicle around the object notification method, characterized in that for performing a white balance to correct the color temperature of the light.
  12. 제9 항에 있어서,The method of claim 9,
    상기 색 보정 또는 밝기 보정을 하는 단계는,The color correction or brightness correction step,
    상기 차량의 주위 밝기와 무관하게 상기 일정 거리 내에 영역에 대해 색 보정 또는 밝기 보정을 하는 것을 특징으로 하는 차량 주변 물체 알림 방법.Color correction or brightness correction method for the area within the predetermined distance irrespective of the ambient brightness of the vehicle.
  13. 제9 항에 있어서,The method of claim 9,
    상기 일정 거리는 상기 차량 주변의 차량 혼잡도 또는 속도를 고려하여 결정되는 차량 주변 물체 알림 방법.The predetermined distance is determined in consideration of vehicle congestion or speed around the vehicle surrounding object notification method.
  14. 카메라로부터 획득한 이미지를 이용하여 주행 중인 차량의 주변 물체를 감지하는 물체 감지부;An object detecting unit detecting an object around the vehicle while driving by using an image obtained from a camera;
    상기 감지 결과 물체가 없는 방향으로부터 획득한 이미지를 분석하여 차선 이미지의 이상 여부를 판단하는 차선 이상 판단부; 및A lane abnormality determining unit which analyzes an image acquired from a direction in which no object exists and determines whether the lane image is abnormal; And
    상기 판단 결과 차선 이미지의 일부가 없는 경우 상기 주행 중인 차량의 운전자에게 주변에 물체가 있음을 알리는 정보 알림부를 포함하는 차량 주변 물체 알림 장치.And an information notification unit for notifying a driver of the driving vehicle that there is an object in the vicinity when the lane image is not part of the determination result.
  15. 제14 항에 있어서,The method of claim 14,
    상기 차선 이상 판단부의 판단 결과 차선 이미지가 일부 없는 경우 상기 물체 감지부는 상기 차선 이미지의 이상이 있는 영역의 이미지에 대하여 색 보정 또는 밝기 보정을 하고, 상기 보정된 이미지로부터 상기 차량 주변의 물체 유무를 확인하고,If there is no lane image as a result of the determination of the lane abnormality determining unit, the object detecting unit corrects color or brightness of the image of the area having the abnormality of the lane image, and confirms the presence or absence of an object around the vehicle from the corrected image. and,
    상기 정보 알림부는 상기 확인 결과 상기 차량 주변에 물체가 있는 경우 상기 주행 중인 차량의 운전자에게 주변에 물체가 있음을 알리는 것을 특징으로 하는 차량 주변 물체 알림 장치.And the information notification unit notifies the driver of the driving vehicle that the object is present when there is an object around the vehicle.
  16. 주행중인 차량의 후방으로부터 획득한 이미지를 이용하여 주행 중인 차량의 주변 물체를 감지하고, 상기 감지 결과 물체가 없는 경우 일정 거리 내에 영역에 대해 색 보정 또는 밝기 보정을 하고, 상기 보정된 이미지로부터 상기 차량 후방의 물체 유무를 확인하는 물체 감지부; 및Using the image acquired from the rear of the driving vehicle to detect the surrounding objects of the driving vehicle, if there is no object as a result of the detection, color correction or brightness correction for the area within a certain distance, and from the corrected image An object detecting unit checking an object behind the object; And
    상기 확인 결과 상기 차량 후방에 물체가 있는 경우 상기 주행 중인 차량의 운전자에게 후방에 물체가 있음을 알리는 정보 알림부를 포함하는 차량 주변 물체 알림 장치.And an information notification unit for notifying a driver of the driving vehicle that there is an object behind the vehicle when there is an object behind the vehicle.
  17. 제1 항 내지 제13 항 중에 어느 한 항의 방법을 컴퓨터에서 실행시키기 위한 프로그램을 기록한 컴퓨터로 읽을 수 있는 기록매체. A computer-readable recording medium having recorded thereon a program for executing the method of any one of claims 1 to 13 on a computer.
PCT/KR2017/002362 2016-12-29 2017-03-06 Method and apparatus for notifying object around vehicle WO2018124388A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2016-0181869 2016-12-29
KR1020160181869A KR20180078361A (en) 2016-12-29 2016-12-29 Method and apparatus of noticing objects around a vehicle

Publications (1)

Publication Number Publication Date
WO2018124388A1 true WO2018124388A1 (en) 2018-07-05

Family

ID=62709906

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2017/002362 WO2018124388A1 (en) 2016-12-29 2017-03-06 Method and apparatus for notifying object around vehicle

Country Status (2)

Country Link
KR (1) KR20180078361A (en)
WO (1) WO2018124388A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112738412A (en) * 2020-12-31 2021-04-30 佛山市南海天富科技有限公司 Full-automatic light supplementing method and device based on warp knitting machine flaw detection system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11339195A (en) * 1998-05-22 1999-12-10 Kansei Corp Lane abnormality detection circuit, and rear-end collision alarm device using the same
KR20070004300A (en) * 2005-07-04 2007-01-09 현대자동차주식회사 Rear side approach vehicle warning method and system using image recognition
KR20140081377A (en) * 2012-12-21 2014-07-01 주식회사 만도 Environment recognition system of vehicle
KR101414572B1 (en) * 2013-02-18 2014-08-06 주식회사 만도 Apparatus for assisting in recognizing lane and method for assisting thereof
US20150363659A1 (en) * 2012-09-14 2015-12-17 Oki Electric Industry Co., Ltd. Data processing apparatus, data processing method, and program

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11339195A (en) * 1998-05-22 1999-12-10 Kansei Corp Lane abnormality detection circuit, and rear-end collision alarm device using the same
KR20070004300A (en) * 2005-07-04 2007-01-09 현대자동차주식회사 Rear side approach vehicle warning method and system using image recognition
US20150363659A1 (en) * 2012-09-14 2015-12-17 Oki Electric Industry Co., Ltd. Data processing apparatus, data processing method, and program
KR20140081377A (en) * 2012-12-21 2014-07-01 주식회사 만도 Environment recognition system of vehicle
KR101414572B1 (en) * 2013-02-18 2014-08-06 주식회사 만도 Apparatus for assisting in recognizing lane and method for assisting thereof

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112738412A (en) * 2020-12-31 2021-04-30 佛山市南海天富科技有限公司 Full-automatic light supplementing method and device based on warp knitting machine flaw detection system

Also Published As

Publication number Publication date
KR20180078361A (en) 2018-07-10

Similar Documents

Publication Publication Date Title
WO2018070655A1 (en) Moving object collision warning device and method for large vehicle
JP5846872B2 (en) Image processing device
JP5852637B2 (en) Arrow signal recognition device
JP4863951B2 (en) Traffic light recognition device
WO2015056890A1 (en) Night-time front vehicle detection and location measurement system using single multi-exposure camera and method therefor
WO2020171281A1 (en) Visible light and infrared fusion image-based object detection method and apparatus
JP2005143083A (en) Image processing device, operation supporting device, and operation supporting system
WO2013191078A1 (en) Object detection device for area around vehicle
WO2015088190A1 (en) Vehicle control system for providing warning message and method thereof
WO2021107171A1 (en) Deep learning processing apparatus and method for multiple sensors for vehicle
WO2012011715A2 (en) Vehicle collision warning system and method therefor
WO2018124388A1 (en) Method and apparatus for notifying object around vehicle
US11462026B2 (en) Image processing device and method for processing image
US20190318175A1 (en) Street marking color recognition
JP3272694B2 (en) Outside monitoring device with fail-safe function
KR101237374B1 (en) Image processing method for detecting traffic light
JP2001216597A (en) Method and device for processing picture
JP2008026991A (en) Device for traffic light recognition
JP3638028B2 (en) Vehicle number recognition device
US20220398853A1 (en) Traffic Signal Recognition Method and Traffic Signal Recognition Device
KR101850030B1 (en) Apparatus and method for lane change assistance using illumination
KR20140054922A (en) Method and device for detecting front vehicle
WO2019088595A1 (en) Surround view monitoring system
KR101844851B1 (en) Black box having the function of controlling turn signal lamp and control method using the same
JP2012256112A (en) Lamp color discrimination device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17886116

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17886116

Country of ref document: EP

Kind code of ref document: A1