KR20110076300A - Adaptive multi-mode view system for recognition of vision dead zone based on vehicle information and controlling method for the same - Google Patents

Abstract

PURPOSE: An adaptive multi-mode view system for recognizing a blind spot on the basis of vehicle information and a controlling method thereof are provided to improve a recognition rate of a driver about a blind spot by displaying various images of combination to the driver. CONSTITUTION: An adaptive multi-mode view system for recognizing a blind spot on the basis of vehicle information comprises one or more cameras(111,112,113,114), a display part(120), and a display control part(130). One or more cameras take an image of peripheral area of a vehicle. The display part indicates the image transmitted from one or more cameras. The individual image size of the display part is varied correspondently to the progressive direction and steering direction of the vehicle. The display control part indicates the image, transmitted from one or more cameras, in the display part.

Description

Adaptive Multi-mode View System for Recognition of vision dead zone based on Vehicle Information and Controlling Method for the same}

The present invention relates to a multi-mode view system for a vehicle, and more particularly, to intelligently display image information of a blind spot based on vehicle information transmitted from an electronic control unit (ECU) provided in a vehicle. The present invention relates to a vehicle information-based blind spot recognition adaptive multimode view system and a control method thereof.

In general, a variety of devices are installed in a car to secure the driver's view. The driver's vision is secured by the driver's vision, and the driver's vision can be directly detected through the windshield glass, and the driver can secure the driver's vision through the rear view mirror and the side mirrors on both sides.

These room mirrors and side mirrors are formed to reflect objects in a flat mirror or a block mirror and can be adjusted automatically or manually according to the physical condition of the driver.

The larger the rearview mirror or side mirror, the larger the side mirror, which should be sufficient to secure the driver's field of view, the greater the risk of collision and air resistance. There was a disadvantage that can not be formed in a constant size.

Accordingly, recently, in order to ensure convenience and safety when driving backwards in a narrow area, ultrasonic waves or lasers are fired toward the rear of the vehicle to determine the presence of an object, or a rear camera is used to identify the rear region by using a camera. This way, you will be safe when you back up.

However, the image information of the blind spot display device is a simple display that displays the front or the rear individually or shows both the front and the side at the same time but is not linked to the information related to the driving of the vehicle. In this case, the technology for inducing safer driving by adaptively displaying the front, rear, left, and right images to the driver according to the movement of the vehicle in front, rear, left and right has not been applied.

For this reason, you may want to park in a parking area where the actual parking space is very narrow or full of vehicles, or if you are going to turn left or right on a very narrow curved road or go forward or backward, Since obstacles can act as obstacles to safe driving, imaging system technology is required to maintain safer vehicle operation even in such cases.

An object of the present invention is to provide an adaptive multi-mode view system for vehicle information-based blind spot recognition and a control method thereof capable of adaptively displaying front, rear, left and right images according to the movement of the vehicle.

In order to achieve the above object of the present invention, the present invention is characterized in that the size of the individual image of the display unit for displaying an image transmitted from one or more cameras photographing the vehicle surroundings is changed in correspondence to the traveling direction and steering direction of the vehicle. It is possible to provide an adaptive multimode view system for blind spot recognition based on vehicle information.

Here, the view system includes a display control unit for controlling to display the image transmitted from the at least one camera to the display unit, the display control unit transmits the driving direction and steering direction of the vehicle from the electronic control unit provided in the vehicle And change the size of the image of the display unit.

The display unit may increase the size of the image corresponding to the steering direction of the vehicle traveling forward to display the image.

In addition, the display unit is characterized in that to increase the size of the image opposite to the steering direction of the vehicle traveling backwards, characterized in that for displaying.

The display may display an object in front or rear when an object is recognized in front or rear of the vehicle.

According to a preferred embodiment of the present invention, the adaptive multi-mode view system for blind spot recognition based on vehicle information includes a front camera, a rear camera, a left camera, and a right camera installed at the front, rear, left and right sides of the vehicle, respectively; A display unit for displaying images of the front, rear, left and right cameras; And a display control unit controlling an image of the front, rear, left and right cameras displayed on the display unit, and varying the size of the image according to the traveling direction and the steering direction of the vehicle.

The display unit may be divided into one or more sectors to display images of the front, rear, left and right cameras.

The display control unit may be linked with an electronic control unit (ECV) that receives steering angle information from a steering angle sensor that recognizes a steering direction of the vehicle, and receives driving direction information from a transmission for manipulating the traveling direction of the vehicle.

In addition, when the display control unit receives forward driving information and left turn information of the vehicle from the electronic control unit, the display controller increases the size of the image of the left camera displayed on the display unit and simultaneously adjusts the size of the image of the right camera. It is characterized by reducing.

In addition, when the display control unit receives forward driving information and right turn information of the vehicle from the electronic control unit, the display controller increases the size of the image of the right camera displayed on the display unit and simultaneously adjusts the size of the image of the left camera. It is characterized by reducing.

In addition, when the display control unit receives the backward driving information and the left turn information of the vehicle from the electronic control unit, the display controller increases the size of the image of the right camera displayed on the display unit and simultaneously adjusts the size of the image of the left camera. It is characterized by reducing.

In addition, the display control unit increases the size of the image of the left camera displayed on the display unit and receives the size of the image of the right camera when receiving the backward driving information and the right turn information of the vehicle from the electronic control unit. It is characterized by reducing.

The display control unit may recognize the object in front of or behind the vehicle, and when the object recognition information is transmitted from the front / rear sensor for transmitting the object recognition information to the electronic control unit, the display unit may forward or backward. It is characterized by displaying an image of a camera.

The control method of the adaptive multi-mode view system for vehicle information based blind spot recognition in which the size of the image of the front, rear, left and right sides of the vehicle is varied according to the traveling direction and the steering direction of the vehicle of the present invention is displayed. Displaying an image of the front and rear cameras by recognizing an obstacle through a rear sensor; Recognizing a forward or backward moving direction through a transmission of the vehicle; Recognizing a left turn or right turn steering direction through a steering angle sensor of the vehicle; And changing a size of a sector of a display unit displaying the image in correspondence with a driving direction and a steering direction of the vehicle.

Here, in the displaying of the front and rear images, when an object is recognized by the front and rear sensors, the front and rear images are displayed on the upper or lower sectors of the display unit, and the sectors on which the front and rear images are displayed. Is set to an unusable sector.

In addition, in the size changing step, when the vehicle driving forward moves left, the size of the sector of the display displaying the left image of the vehicle is increased, and the size of the sector displaying the right image of the vehicle is reduced. It is characterized by.

Further, in the size changing step, when the vehicle traveling forward is turned right, the size of the sector of the display displaying the right image of the vehicle is increased, and the size of the sector displaying the left image of the vehicle is reduced. It is characterized by.

Further, in the size changing step, when the vehicle driving backwards is turned left, the size of the sector of the display displaying the right image of the vehicle is increased, and the size of the sector displaying the left image of the vehicle is reduced. It is characterized by.

Further, in the size changing step, when the vehicle driving backwards is turned right, the size of the sector of the display displaying the left image of the vehicle is increased, and the size of the sector displaying the right image of the vehicle is reduced. It is characterized by.

The size of the sector of the display may vary in response to the steering angle of the steering angle sensor.

According to the present invention, it is possible to provide an adaptive multi-mode view system for vehicle information based blind spot recognition that can vary the size of the image of the front, rear, left and right of the vehicle according to the traveling direction and the steering direction of the vehicle. Can be.

In addition, by linking with vehicle driving information such as steering angle and forward or backward gear state information, the ratio of blind spot image and cognitive zone image can be changed adaptively, or displayed to the driver with a combination of various blind spots of the driver. Increased local awareness can lead to safer vehicle operation.

Hereinafter, with reference to the accompanying drawings will be described in detail with respect to the vehicle information-based blind spot recognition adaptive multi-mode view system and its control method according to an embodiment of the present invention.

As shown in FIG. 1, the adaptive multi-mode view system 100 for vehicle information based blind spot recognition according to the present embodiment includes one or more cameras 110, a display 120, and a display controller 130. do.

One or more cameras 110 are for capturing an image of the surroundings of the vehicle and displaying them on the display unit 120. The camera 110 of the present embodiment includes a front camera 111 for capturing an image in front of the vehicle and a vehicle. And a rear camera 112 for photographing rear images and left / right cameras 113 and 114 for photographing left and right images of the vehicle.

The front camera 111 is attached to the front of the vehicle to take an image of the front of the vehicle and transmit it to the display control unit 130, the rear camera 112 is attached to the rear of the vehicle, and the left / right cameras 113 and 114 are connected to the vehicle. Are installed in the vicinity of the left and right side mirrors of the vehicle to shoot the left and right images of the vehicle and transmit them to the display controller 130.

The display unit 120 is for displaying an image captured by the camera 110, and the display unit 120 according to the present embodiment displays an image captured by the camera transmitted by the display control unit 130 to the user. .

As shown in FIG. 2, the display 120 according to the present exemplary embodiment may be divided into various sectors to separately display images of the front / rear / left / right cameras 111, 112, 113, and 114, and each sector may be a display control unit of the present exemplary embodiment. 130 can be individually controlled. For example, when a vehicle or an object is recognized in front of the vehicle when the vehicle is parked or running slowly, the image in front of the vehicle may be selectively displayed in the D1, D2, D11, and D12 sectors. Similarly, when a vehicle or an object is recognized at the rear of the vehicle during the reverse parking of the vehicle, an image of the rear of the vehicle may be selectively displayed in the sectors D5, D6, D15, and D16.

In addition, the display 120 may intelligently display the blind spot of the vehicle as the vehicle moves. For example, as shown in FIG. 3, when the vehicle is parked backward, the blind spot of the vehicle may be determined through the steering angle of the steering wheel, and by increasing the image size of the camera 110 displaying the blind spot, User convenience can be improved.

As shown in FIG. 3, when the steering angle sensor 150 detects that the steering wheel is rotated to the left during the reverse parking of the vehicle, the image size of the right side of the vehicle, which is the blind spot of the vehicle, may be increased. In addition, during the progression of the reverse parking, when the rotation angle of the steering wheel is reduced, the size of the right image can be reduced and the size of the left image can be increased.

The sector of the display unit 120 shown in FIG. 2 is arbitrarily set for easy description of the present invention, and it will be apparent to those skilled in the art that the size and shape of the sector of the display unit 120 can be variously modified.

The display control unit 130 is for displaying an image transmitted from the camera 110 to the display unit 120 and displays various state and motion information of the vehicle from an electronic control unit (ECU) that electronically controls the vehicle. The controller intelligently controls the image to be displayed on the display 120.

Specifically, as shown in FIG. 1, the electronic control unit 140 includes steering angle information of the vehicle from the steering angle sensor 150, traveling direction information of the vehicle from the transmission 160, and front and rear sensors 170. Object recognition information such as a vehicle or an obstacle in front of or behind the vehicle is received, and various such information is transmitted to the display controller 130.

The display control unit 130 may determine whether the vehicle is currently driving forward, moving slowly, moving forward or backward parking, and the direction of rotation of the vehicle, based on the driving direction information and the steering angle information of the vehicle. Image information to be displayed on the display unit 120 may be controlled in response to the forward / reverse and rotation directions.

In general, the steering angle sensor 150 for collecting steering angle information of the vehicle is mounted at the lower end of the steering wheel of the vehicle to detect steering speed, steering direction, and steering angle of the steering wheel, and the steering information of the vehicle is controlled by the electronic control unit 140. To transmit. Transmission 160 is a transmission that converts the power generated by the engine to the required rotational force according to the speed and transmits, the general transmission 160 has a gear shifting stage 1 to 5, the reverse gear for the reverse of the vehicle It is provided. The front and rear sensors 170 are installed at the front and rear of the vehicle to determine the presence or absence of vehicles, obstacles, pedestrians, etc. in the front or rear of the vehicle. In general, the front and rear sensors 170 emit ultrasonic waves and recognize the ultrasonic waves reflected on the objects. An ultrasonic sensor for determining the presence or absence may be used. On the contrary, instead of having a separate ultrasonic front / rear sensor 170, object presence technology for recognizing an object from an image of the camera 110 may be used to determine the presence or absence of an object in front of or behind the vehicle.

The display control unit 130 may control to selectively select and display images of the front / rear / left / right cameras 111, 112, 113, and 114 on each sector of the display unit 120 illustrated in FIG. 2. Referring to FIG. When the vehicle parks backward, the size of the image of the display 120 may be adjusted based on the steering angle transmitted through the steering angle sensor 150.

The vehicle shown on the left side of FIG. 3 rotates the steering wheel to the left and then performs reverse parking. In this case, the display controller 130 increases the size of the image of the right camera 114 installed on the right side of the vehicle. The display unit 120 may be controlled to display the blind spot on the right side of the vehicle in more detail. In this case, an image of the left camera 113 is displayed on the left sector of the display 120, but the left image may be displayed smaller in size than the right image.

For example, in the above case, the image of the left camera 113 is displayed in the sectors D1, D3, and D5 of the display unit 120 shown in FIG. 2, and the images D2, D4, D6, D11, D13, D15, D12, In the D14 and D16 sectors, an image of the right camera 114 may be displayed.

The vehicle shown on the right side of FIG. 3 rotates the steering wheel to the right and then performs reverse parking. In this case, the display controller 130 increases the size of the image of the left camera 113 installed on the left side of the vehicle. The display unit 120 may be controlled to display the blind spot on the left side of the vehicle in more detail. In this case, an image of the right camera 114 is displayed in the right sector of the display 120, but the right image may be displayed smaller in size than the left image.

For example, in the above case, the image of the left camera 113 is displayed in the sectors D1, D3, D5, D2, D4, D6, D11, D13, and D15 of the display unit 120 shown in FIG. In the D14 and D16 sectors, an image of the right camera 114 may be displayed.

The sector of the display unit 120 may be changed as the steering angle of the vehicle is changed, and when the steering wheel is located at the center of the reverse parking, the image of the left camera 113 and the image of the right camera 114 are changed. The size may be indicated the same.

Meanwhile, when the vehicle is parked, when the object is recognized in front of or behind the vehicle, the display controller 130 displays an image of the front or rear cameras 111 and 112 on the display 120, which is described with reference to FIG. 4. Let's explain.

As shown in FIG. 4, the vehicle rotates the steering wheel to the right and then performs reverse parking, and another vehicle is located in front of the vehicle. Other vehicles in front of the vehicle may be recognized by the front and rear sensors 170. In this case, the display 120 may display an image by the front camera 111 in addition to the left and right images.

For example, an image of the front of the vehicle by the front camera 111 may be displayed on the sectors D1, D2, D11, and D12 of the display unit 120 of FIG. 2, and the display is displayed because the steering wheel of the vehicle is rotated to the right. An image of the left camera 113 may be displayed in the sectors D3, D5, D4, D6, D13, and D15 of the unit 120, and an image of the right camera 114 may be displayed in the sectors D14 and D16.

In addition, the display control unit 130 may display the blind spot of the vehicle on the display unit 120 when the vehicle is in a slow motion, and as shown in FIG. 5, when the sharp curve region is located in front of the vehicle, An image of the left camera 113 of the vehicle and an image of the right camera 114 may be displayed on the display 120, but the size of the image of the left camera 113 having a relatively large blind spot may be increased.

As described above, the display controller 130 may adjust the size of the image displayed on the display unit 120 according to the forward / reverse direction and the left / rear rotation of the vehicle. Specifically, the size of the left image may be increased in the case of the left turn during the straight driving of the vehicle, but the size of the right image may be increased in the case of the left rotation during the backward driving of the vehicle.

The adaptive multi-mode view system for vehicle information-based blind spot recognition according to the present invention having the above-described configuration may be intelligently controlled through various information collected by the electronic control unit 140 for electronically controlling the vehicle. A control method of the blind spot recognition adaptive multimode view system will be described in more detail below with reference to FIGS. 6 to 9.

As shown in FIG. 6, the control method of the adaptive multi-mode view system for blind spot recognition based on the vehicle information of the present invention may include displaying an image of a front / rear camera by recognizing an obstacle through a front / rear sensor ( S110), recognizing a forward / reverse moving direction through a transmission (S120), recognizing a steering direction of left / right rotation through a steering angle sensor (S130), and a display unit corresponding to a traveling direction and a steering direction of a vehicle Changing the sector size (S140).

First, as illustrated in FIG. 7, an object located in front or rear of the vehicle is recognized through the front and rear sensors 170 installed at the front and rear of the vehicle. When an object is recognized by the front sensor, an image of the front camera 111 is displayed on D1, D2, D11, and D12 sectors of the display unit 120 of FIG. 2, and when the object is recognized by the rear sensor, the display unit of FIG. The image of the rear camera 112 is displayed in the sectors D5, D6, D15, and D16 of 120. FIG. Thereafter, as shown in FIG. 8, the usable sector of the display 120 may be searched for. For example, when an image of the front or rear camera 112 is displayed, the sector in which the front or rear image is displayed may be set to an unusable area for displaying the left or right image.

Next, as shown in FIGS. 8 and 9, the forward or backward travel direction of the vehicle is determined based on the information of the transmission 160 transmitted to the electronic control unit 140 of the vehicle. In the case of driving forward, the size of the image displayed on the display 120 corresponds to the steering direction of the vehicle, but in the case of driving backward, the size of the image displayed on the display 120 may be opposite to the steering direction of the vehicle. will be.

Next, as shown in FIGS. 8 and 9, the left turn or the rear turn steering direction of the vehicle is determined based on the information of the steering angle sensor 150 transmitted to the electronic control unit 140 of the vehicle. When the vehicle is turned left or right, the size of the image displayed on the display 120 may be determined according to the traveling direction of the vehicle.

Next, the size of the usable sector of the display 120 may be changed to correspond to the traveling direction and the steering direction of the vehicle. For example, when the vehicle travels straight but turns left, the size of the image of the left camera 113 is increased, but when the vehicle runs backward but turns left, the size of the image of the left camera 113 is the right camera 114. Will be displayed smaller than the size of the image. More specifically, as shown in FIG. 3, when an object such as an obstacle is not recognized in front and rear of the vehicle and all sectors of the display 120 are set as available sectors, the vehicle turns left for backward parking. In this case, the right image may be displayed on D2, D4, D6, D11, D13, D15, D12, D14, and D14 by increasing the size of a sector displaying the image of the right camera 114 of the display unit 120. .

In this case, the size of the left or right image of the display 120 may vary in response to the steering angle detected by the steering angle sensor 150.

In the above, the adaptive multi-mode view system for vehicle information-based blind spot recognition and a control method thereof have been described with reference to a preferred embodiment of the present invention, but the scope of the present invention is not limited to the above-described embodiment. It will be apparent to those skilled in the art that modifications, changes and various modifications can be made without departing from the spirit of the invention.

1 is a schematic diagram showing an adaptive multi-mode view system for vehicle information based blind spot recognition according to a preferred embodiment of the present invention;

FIG. 2 is a schematic conceptual view of the display unit of FIG. 1; FIG.

3 to 5 are schematic diagrams illustrating a driving and parking process of a vehicle to which the view system of FIG. 1 is applied; And

6 through 9 are schematic flowcharts of a control method of an adaptive multi-mode view system for vehicle information based blind spot recognition according to an exemplary embodiment of the present invention.

<Description of the symbols for the main parts of the drawings>

100: Adaptive multi-mode view system for blind spot recognition based on vehicle information

110: Camera 111,112,113,114: Front / Rear / Left / Right Camera

120: display unit 130: display control unit

140: electronic control unit 150: steering angle sensor

160: Transmission 170: Front / Rear Sensor

Claims (20)

Adaptive multi-mode view for vehicle information-based blind spot recognition, characterized in that the size of the individual image of the display unit displaying the image transmitted from one or more cameras photographing the surroundings of the vehicle is changed corresponding to the traveling direction and the steering direction of the vehicle. system. The method according to claim 1, And a display controller for controlling to display the image transmitted from the one or more cameras on the display unit. And the display control unit receives the traveling direction and the steering direction of the vehicle from the electronic control unit provided in the vehicle to change the size of the image of the display unit. The method according to claim 1 or 2, The display unit adaptive multi-mode view system for recognizing blind spots, characterized in that for increasing the size of the image corresponding to the steering direction of the vehicle traveling forward. The method of claim 3, The display unit adaptive multimode view system for vehicle information based blind spot recognition, characterized in that for increasing the size of the image opposite to the steering direction of the vehicle driving backward. The method according to claim 4, And the display unit displays an object in front or rear when the object is recognized in front or rear of the vehicle. A front camera, a rear camera, a left camera and a right camera installed at the front, rear, left and right sides of the vehicle, respectively; A display unit for displaying images of the front, rear, left and right cameras; And And a display controller for controlling the images of the front, rear, left, and right cameras displayed on the display unit, and varying the size of the images according to the traveling direction and the steering direction of the vehicle. Adaptive multimode view system for blind spot recognition. The method according to claim 6, The display unit is divided into one or more sectors to display the image of the front, rear, left, right cameras adaptive multi-mode view system for blind spot recognition. The method according to claim 6 or 7, The display control unit is interlocked with an electronic control unit (ECC) that receives steering angle information from a steering angle sensor that recognizes a steering direction of the vehicle and receives driving direction information from a transmission for manipulating the traveling direction of the vehicle. Adaptive multimode view system for blind spot recognition. The method according to claim 8, When the display control unit receives forward driving information and left turn information of the vehicle from the electronic control unit, the display controller increases the size of the image of the left camera displayed on the display unit and reduces the size of the image of the right camera. Adaptive multi-mode view system for vehicle information based blind spot recognition. The method according to claim 8, When the display control unit receives forward driving information and right turn information of the vehicle from the electronic control unit, the display controller increases the size of the image of the right camera displayed on the display unit and reduces the size of the image of the left camera. Adaptive multi-mode view system for vehicle information based blind spot recognition. The method according to claim 8, The display control unit may increase the size of the image of the right camera displayed on the display unit and reduce the size of the image of the left camera when receiving the backward driving information and the left turn information of the vehicle from the electronic control unit. Adaptive multi-mode view system for vehicle information based blind spot recognition. The method according to claim 8, When the display control unit receives the reverse driving information and the right turn information of the vehicle from the electronic control unit, the display controller increases the size of the image of the left camera displayed on the display unit and decreases the size of the image of the right camera. Adaptive multimode view system for blind spot recognition based on vehicle information. The method according to claim 8, The display control unit, When object recognition information is transmitted from the front / rear sensor for recognizing an object in front of or behind the vehicle and transferring object recognition information to the electronic control unit, displaying an image of the front or rear camera on the display unit. Adaptive multi-mode view system for blind spot recognition based on vehicle information. In a control method of a vehicle information-based blind spot recognition adaptive multi-mode view system for varying the size of the image of the front, rear, left and right of the vehicle according to the traveling direction and the steering direction of the vehicle, Displaying an image of the front / rear camera by recognizing an obstacle through a front / rear sensor; Recognizing a forward or backward moving direction through a transmission of the vehicle; Recognizing a left turn or right turn steering direction through a steering angle sensor of the vehicle; And And changing a size of a sector of a display unit which displays the image corresponding to a driving direction and a steering direction of the vehicle. The method according to claim 14, In the displaying of the front and rear images, When an object is recognized by the front / rear sensor, the front / rear image is displayed on the upper or lower sector of the display unit, and the sector on which the front / rear image is displayed is set as an unusable sector. Control Method of Adaptive Multimode Viewing System for Recognition Based on Blind Spots. The method according to claim 14 or 15, In the size change step, When the vehicle driving forward moves left, the size of the sector of the display displaying the left image of the vehicle is increased, and the size of the sector displaying the right image of the vehicle is reduced. Control method of adaptive multimode view system for zone recognition. The method according to claim 14 or 15, In the size change step, The vehicle information-based blind spot is characterized in that when the vehicle driving forward moves right, the size of a sector of the display displaying the right image of the vehicle is increased, and the size of the sector displaying the left image of the vehicle is reduced. Control method of adaptive multimode view system for zone recognition. The method according to claim 14 or 15, In the size change step, When the vehicle driving backwards is turned left, the size of the sector of the display displaying the right image of the vehicle is increased, and the size of the sector displaying the left image of the vehicle is reduced. Control method of adaptive multimode view system for zone recognition. The method according to claim 14 or 15, In the size change step, When the vehicle driving backwards is turned right, the size of the sector of the display displaying the left image of the vehicle is increased, and the size of the sector displaying the right image of the vehicle is reduced. Control method of adaptive multimode view system for zone recognition. The method according to claim 14 or 15, In the size change step, And the size of the sector of the display is variable in correspondence to the steering angle of the steering angle sensor.

Images