JP3165729U - Video radar driving assistance device - Google Patents

Abstract

A video radar driving assistance device is provided. The video radar driving assistance device includes a camera array, a video recognition unit, an environmental monitoring unit, a video radar display facility, an alarm unit, a driving control unit, and a braking unit, and the camera array captures an environmental video. The image recognition unit recognizes the environmental article and its image, position, color, speed and direction, and reads the environmental monitor unit to generate reproduction environment information near the vehicle, and the relative space between the vehicle and the environmental article. Determining whether the relationship generates alarm information, the video radar display equipment and the alarm unit respectively display a single frame of reproduction environment information and execute the corresponding alarm operation of the alarm information, the operation control unit and the braking unit; Generates a control command based on the reproduction environment information, It controls the steering wheel, to increase the safety of the operation. [Selection diagram] Fig. 1

Description

  The present invention relates to a kind of video radar driving assistance device, and more particularly, to a device that enhances driving safety using a video radar display facility, an alarm unit, an operation control unit, and a braking unit.

  How to improve driving safety has always been the direction of industry efforts, and many manufacturers use infrared, ultrasonic radar, microwaves and radio waves to detect obstacles around the vehicle and drive the road to the driver Developing methods to call attention to the situation. For example, there is a Toyota Camry series ACC system used for the front vehicle impact warning display, or an Audi series side assist system for left and right turn alarms.

  However, infrared and ultrasonic radars have a small detection range, a short distance, and are susceptible to interference. Microwaves and radio waves are only harmful to the human body when the detection range is strengthened and the emission power must be increased. The price is expensive. Most severely, both of these designs have fatal drawbacks, most of which can only monitor a single target (cars, passers-by or road items), some are non- Metal objects (eg road signs or plastic obstacles) cannot be detected.

  In addition, currently advanced control systems in automobiles provide front-rear and left-right images to the right front of the driver seat to assist the driver in grasping driving information. For example, the Luxgen or Volvo S40BLIS system. However, the driver must monitor three mirrors and one screen at the same time, and a slow-responsive driver is confused and prone to danger.

  Therefore, it is necessary to provide a video radar driving assistance device that provides a consistent single screen and does not need to monitor all the mirrors, and solves the above known technical problems.

  The present invention provides a kind of video radar driving assistance device, which includes a camera array, a video recognition unit, an environmental monitoring unit, a video radar display facility, an alarm unit, a driving control unit and a braking unit.

  The camera array captures an environmental video, recognizes the environmental article and its video, position, color, speed and direction by the video recognition unit, and stores them in the environmental article database and the video recognition database, respectively.

  The environmental monitor unit reads the image, position, color, moving speed and moving direction of the environmental article, generates reproduction environmental information, and refers to the current driving database, and between the vehicle and at least one environmental article. It is determined whether or not alarm information is generated by determining the relative spatial relationship.

  Each of the video radar display facility and the alarm unit displays a single frame of reproduction environment information and executes a corresponding alarm operation of the alarm information to alert the driver.

  The driving control unit and the braking unit generate a control command based on the reproduction environment information to control the accelerator, the brake, or the steering wheel, thereby improving driving safety.

  Accordingly, the video radar driving assist device of the present invention provides a video radar function and assists the driver by being installed in a vehicle, a ship or an airplane, in particular, achieves a driving record and an automatic driving function, a forward vehicle collision alarm. Achieving functions, rear vehicle collision alarm function, side collision alarm function, reverse collision alarm function or dangerous driving alarm function, thereby further improving vehicle driving safety.

It is a display figure of the video radar driving assistance device of the present invention. It is a camera array installation display figure of the video radar driving assistance device of the present invention. It is a single screen display figure of the video radar driving assistance device of the present invention.

  In order to describe in detail the technical contents, structural features, and objects to be achieved of the present invention, examples will be described below in combination with the drawings.

  Please refer to FIG. 1 and FIG. These are a display diagram of the video radar driving assistance device of the present invention and an installation display diagram of the camera array, respectively. As shown in FIG. 1, the video radar driving assistance device of the present invention includes at least one camera array 10, at least one video recognition unit 20, an environmental article database 22, a video recognition database 24, a driving database 26, and an environmental monitoring unit. 30, a video radar display facility 40, an alarm unit 50, an operation control unit 60, and a braking unit 70, which are installed on a traffic tool, so that, for example, the vehicle 80 shown in FIG. As well as assisting driving, thereby improving driving safety.

  It should be noted that the vehicle 80 in the figure is merely an example for explaining the features of the present invention, and does not limit the scope of the present invention. The traffic tool on which the driving assistance device can be installed can be a ship or an airplane.

  Each camera array 10 includes at least one camera, for example, as shown in FIG. 2, including a first camera 11, a second camera 12, a third camera 13, and a fourth camera 14, which are vehicles 80. Are installed in different directions to capture the environment around the vehicle and generate a corresponding plurality of environment images. For example, the first camera 11, the second camera 12, the third camera 13, and the fourth camera 14 are installed toward the front D1, the left side D2, the rear D3, and the right side D4, respectively.

  In order to increase the angle and length of detection, a long lens, a wide angle lens, and an infrared lens are added to each camera array 10 or the number of cameras is directly increased to monitor in more directions.

  Each video recognition unit 20 is electrically connected to the camera array 10 by a video medium and receives these environmental videos, and at least one environmental article in these environmental videos and its video, position, color, moving speed and movement Recognize direction. More specifically, the environmental article may include a vehicle, a ground mark, a ground display character, a traffic sign, a surrounding obstacle, a passerby, or a protective fence.

  The video medium described above is either a USB or a video cable. The video cable can be any of composite, color difference, HDMI, RGB, YUV, CCIR601 and CCIR656 cables.

  The environmental article database 22 is connected to the video recognition unit 20 to receive and store images of environmental articles, and the video recognition database 24 is connected to the video recognition unit 20 to detect the position, color, and movement of environmental articles. Receive and store speed and direction of travel.

  The driving database 26 includes dynamic information and static information of the vehicle 80. The dynamic information includes the GPS information of the vehicle, the dynamic speed and direction of the vehicle, and the static information includes the braking distance, the turning radius, and the acceleration capability input in advance. , Safety inter-vehicle distance or vehicle length, width, and height.

  The environmental monitor unit 30 is connected to the environmental article database 22, the video recognition database 24, and the operation database 26, reads the video, position, color, moving speed and moving direction of the environmental article, and displays the surrounding environment of the vehicle 80. Reproduction environment information is generated, and a relative spatial relationship between the vehicle 80 and the environmental article is determined based on the reproduction environment information. For example, a static relationship and a dynamic relationship are determined. The direction and dynamic relationship includes the relative speed, thereby generating alarm information. The relative speed is calculated by adding the article distance change to the dynamic vehicle speed of the vehicle 80 in the driving database 26.

  For example, the environmental monitor unit 30 generates alarm information when the relative distance between the vehicle 80 and the environmental article is smaller than a predetermined safety distance, and the set safety distance increases the relative speed between the vehicle 80 and the environmental article by 10 km / hour. Each time, it increases by at least 6 m and is adjusted according to various vehicle types and models. All of these pieces of information are stored in advance in the operation database 26, and the current operation speed and direction are updated continuously during the operation, and are used for dynamic determination of the environment monitor unit 30.

  The video radar display facility 40 has a video display function, receives the reproduction environment information of the environment monitor unit 30, and displays a single screen of the surrounding environment of the vehicle 80, and the single screen is at least one of a bird's eye view and a radar diagram. Displayed in one way.

  For example, the corresponding articles on the front D1, left side D2, rear D3, and right side D4 of the vehicle 80 are respectively located on the upper, left, lower, and right sides of the single screen, and thus the driver is in a road condition around the vehicle. Making it easier to understand.

  The alarm unit 50 receives alarm information from the environmental monitor unit 30 and generates a corresponding sound, light or vibration to wake up the driver of the vehicle 80.

  The operation control unit 60 receives the reproduction environment information of the environment monitor unit 30 and generates a control command based on the reproduction environment information.

  The braking unit 70 receives and converts the control command of the driving control unit 60 through a transmission medium, generates a corresponding control signal, and controls at least one of the accelerator, brake and steering wheel of the vehicle 80 (traffic tool).

  The above transmission medium is either a wired medium or a wireless medium. Among them, the wired medium is any one of a local interconnect network (LIN), a controller area network (CAN), and a transmission control protocol / Internet protocol (TCP / IP).

  The wireless medium is any one of an infrared data association (IrDA) agreement using infrared, a Bluetooth agreement using radio frequency (RF), and a WIFI / WIMAX / 3G / LTE used between a computer and a mobile phone.

  To further clarify the features of the present invention, please refer to FIG. FIG. 3 is a single screen display diagram of the video radar driving assistance device of the present invention. As shown in FIG. 3, the single screen displayed by the video radar display facility 40 of the present invention is the main car 90, the first car 91, the second car 92, the third car 93, the fourth car 94, the fifth car. It includes a car 95, a roadway RL, a first sign RS1, a second sign RS2, a third sign RS3, a first alarm sign DS1, a second alarm sign DS2, and a third alarm sign DS3.

  Among them, the main vehicle 90 is a vehicle in which the video radar driving assistance device of the present invention is installed, and the first vehicle 91, the second vehicle 92, the third vehicle 93, and the fourth vehicle 94 are vehicles around the main vehicle 90. The roadway line RL is a separation line drawn on the roadway, and includes, for example, a leftmost and rightmost continuous line and a plurality of dotted lines between the roadways. The first sign RS1, the second sign RS2, and the third sign RS3 are the next road exit sign, speed limit sign, and road distance sign, respectively.

  In addition, the first alarm sign DS1, the second alarm sign DS2, and the third alarm sign DS3 in FIG. 3 are displayed on a single screen after the video radar display facility 40 further receives the alarm information of the environmental monitor unit 30. Of the alarm information to be displayed, the first alarm sign DS1 displays the danger of the main vehicle 90 colliding with the first vehicle 91 due to being too close to the first vehicle 91 ahead. The second alarm sign DS2 indicates that the third car 93 is too close to the main car 90 or too far from the original driving lane, or is preparing to change the road, or the main car 90 changes the lane to the left lane. This is a side collision alarm that occurs when trying to change to. The third alarm sign DS3 displays the danger that the fourth vehicle 94 will collide with the main vehicle 90 because it is too close to the main vehicle 90.

  It should be noted that although FIG. 3 is described as an example with environmental articles on multiple lanes in the same direction, the single screen of the present invention can substantially include environmental articles on opposite lanes. is there.

  The video radar driving assistance device of the present invention may further include a driving recording unit (not shown). It is connected to the environmental monitor unit 30 to receive and record the image, position, color, moving speed and moving direction of the environmental article.

  The feature of the present invention is that the video radar driving assist device realizes an automatic driving function, a forward collision alarm function, a rear collision alarm function, a side collision alarm function, a reverse collision alarm function, and a dangerous driving alarm function, and a large traffic tool. For example, it can be applied to airplanes and ships. In particular, for these traffic tools with a large volume, the video radar driving assistance device of the present invention cannot be monitored by the driver, and the angle and area are very large. To improve driving safety.

  The above description is only an example of the present invention, and does not limit the scope of the present invention. Any equivalent changes and modifications that can be made based on the scope of the claims of the present invention are all described in the present invention. Shall belong to the scope covered by the rights.

DESCRIPTION OF SYMBOLS 10 Camera array 20 Image | video recognition unit 22 Environmental goods database 24 Image | video recognition database 26 Operation database 30 Environmental monitor unit 40 Video radar display equipment 50 Alarm unit 60 Operation control unit 70 Braking unit 80 Vehicle 90 Main vehicle 92 Second vehicle 93 Third vehicle 94 Fourth car 95 Fifth car D1 Front D2 Left side D3 Rear D4 Right side DS1 First alarm sign DS2 Second alarm sign DS3 Third alarm sign RL Roadway line RS1 First sign RS2 Second sign RS3 Third sign

Claims (10)

In the video radar driving assistance device, the video radar driving assistance device is attached to a traffic tool to assist the driver in driving the traffic tool, and the video radar driving assistance device includes:
At least one camera array, each camera array including at least one camera, wherein the camera is attached to the traffic tool and images the environment in different directions to generate a corresponding plurality of environmental images. The at least one camera array, wherein a long lens, a wide-angle lens, an infrared lens can be added, or the detection angle and length are increased by increasing the camera quantity;
At least one image recognition unit, which is electrically connected to the corresponding camera array by a video medium to receive these environment images, and at least one environment article in these environment images and its image, position, color Recognizing the moving speed and moving direction, the at least one image recognition unit;
An environmental goods database, connected to the at least one video recognition unit, for receiving and storing videos of the at least one environmental goods;
A video recognition database, connected to the at least one video recognition unit, for receiving and storing information on the position, color, moving speed and moving direction of the at least one environmental article;
A driving database comprising dynamic data and static data of the traffic tool, the dynamic data being dynamic speed and direction of the traffic tool, the static data being a braking distance previously recorded on the traffic tool, The driving database, which is a turning radius, a safe inter-vehicle distance, and a length, width and height of the traffic tool;
An environmental monitoring unit, connected to the environmental article database, the video recognition database, and the traffic tool operation database, for information on video, position, color, moving speed and moving direction of the at least one environmental article Receiving and generating reproduction environment information for displaying the surroundings of the traffic tool, determining a relative spatial relationship between the traffic tool and the at least one environmental article based on the reproduction environment information, and alarm information. The environmental monitor unit to display,
A video radar display facility that receives reproduction environment information of the environment monitor unit and displays a single screen of the surrounding environment of the traffic tool; and
An alarm unit that receives alarm information of the environmental monitor unit and generates a corresponding sound, light or vibration to wake up the driver; and
An operation control unit that receives reproduction environment information of the environment monitor unit, and generates a control command based on the reproduction environment information; and
A braking unit that receives a control command of the operation control unit by a transmission medium, converts the control command into a control signal, and controls any of an accelerator, a brake, and a steering wheel; and
A video radar driving assistance device characterized by comprising:   2. The video radar driving assistance device according to claim 1, wherein the traffic tool is any one of a vehicle, a ship, and an airplane.   2. The video radar driving assistance device according to claim 1, wherein the video medium is one of a USB and a video cable, and the video cable is a composite, color difference, HDMI, RGB, YUV, CCIR601 and CCIR656 cable. A video radar driving assistance device, characterized in that it is any of the above.   2. The video radar driving assist device according to claim 1, wherein the at least one camera faces at least one of the front, rear, left side, and right side of the vehicle. Auxiliary device.   The video radar driving assistance device according to claim 1, wherein the relative spatial relationship includes a static relationship and a dynamic relationship.   2. The video radar driving assistance device according to claim 1, wherein the single screen is displayed in either a bird's eye view or a radar diagram.   2. The video radar driving assistance device according to claim 1, wherein the environmental monitoring unit generates the alarm information when a device distance between the vehicle and the at least one environmental article is smaller than a predetermined safety distance. A video radar driving assistance device.   8. The video radar driving assistance device according to claim 7, wherein the driving database has a safe inter-vehicle distance to be recorded in advance, a braking distance, and a length, width and height of the traffic tool, and is recorded in advance. A video radar driving assistance device, characterized in that the safety inter-vehicle distance increases at least 6 meters for every 10 km / h of relative speed between the traffic tool and the at least one environmental article.   2. The video radar driving assistance apparatus according to claim 1, wherein the transmission medium is one of a wired medium and a wireless medium, and the wired medium includes a local interconnect network (LIN) and a controller area network (CAN), a transmission control protocol / Internet. One of the protocols (TCP / IP), the wireless medium is an infrared data association (IrDA) agreement using infrared, a Bluetooth agreement using radio frequency (RF), and WIFI / WIMAX used between computers and mobile phones / 3G / LTE, a video radar driving assistance device.   2. The video radar driving assistance device according to claim 1, wherein the video radar display facility receives alarm information of the environmental monitor unit and displays an image corresponding to the alarm information in the single screen. Radar driving assistance device.

Images