KR102536826B1 - Apparatus and method for driving information of a car, and program recorded on a recording medium performing the method - Google Patents

Abstract

The embodiment includes at least two image acquisition units disposed in a vehicle and acquiring images of subjects in different directions; an object recognizing unit recognizing a subject from the obtained image; a control unit for recognizing a subject approaching the vehicle from among the recognized subjects; a first display unit displaying the approaching subject information inside the vehicle; and a second display unit transmitting a signal to the outside of the vehicle in the direction of the subject.

Description

Apparatus and method for displaying driving information of a vehicle, and program stored in a recording medium implementing the method

Embodiments relate to a vehicle driving information display device and method, and a program stored in a recording medium implementing the method.

In a vehicle traveling at high speed, it is very important to form a driving space so that the driver can accurately look ahead, left and right, and rearward, and also to monitor a very close position when parking or stopping.

That is, when driving at high speed, it is necessary to be able to look at the far rear of the vehicle, and when driving at low speed, such as when driving at a high speed, it is necessary to be able to keep an eye on a position close to the vehicle when the vehicle needs to be stopped at a certain position.

To this end, the vehicle has a room mirror installed inside the vehicle to keep an eye on the rear and rear, and an outside mirror installed on the left and right outside the vehicle so that the left and right sides of the vehicle can be seen, so that the side and rear of the vehicle can be seen while driving. When parking and stopping, a rear detection sensor (proximity sensor, ultrasonic sensor, etc.) installed on the rear bumper of the vehicle or a rear camera detects an invisible proximity position.

That is, the above-described outside mirror is used to look at the rear of the vehicle from a long distance or to check the passengers in the rear seat of the vehicle while driving, and the detection sensor or rear camera installed on the rear bumper is not visible to the rear of the vehicle as a room mirror and an outside mirror. It can warn the driver by detecting foreign objects such as children and obstacles in the lower part.

In addition, the vehicle rear camera operates when the vehicle gear is in reverse mode, can receive power from the vehicle's battery or taillight, and is connected to the navigation system by wire to image the rear of the vehicle when the vehicle is in reverse. displayed in the navigation.

However, the conventional rear camera for vehicles has the following problems.

First, when an image captured by a vehicle rear camera is displayed on a display device of a navigation system or an alarm sounds when an adjacent subject is detected, the driver can visually check the subject and drive considering the distance to the subject.

Second, when driving a vehicle at night or in a dark environment, it may be difficult to identify with the naked eye even if an image captured by a rear camera or the like is displayed on a display device of a navigation system.

Third, even if another vehicle or the like is approaching from the rear or side of the vehicle while the vehicle is driving, it is difficult to confirm it through a navigation system or the like.

Fourth, the image taken by the rear camera is provided to the driver of the vehicle to provide the driver's convenience, but no information is provided to pedestrians approaching the vehicle.

The embodiment is intended to prevent accidents and increase driver convenience by enabling a driver to easily recognize an approaching subject while driving a vehicle, and to inform pedestrians of danger.

The embodiment includes at least two image acquisition units disposed in a vehicle and acquiring images of subjects in different directions; an object recognizing unit recognizing a subject from the obtained image; a control unit for recognizing a subject approaching the vehicle from among the recognized subjects; a first display unit displaying the approaching subject information inside the vehicle; and a second display unit transmitting a signal to the outside of the vehicle in the direction of the subject.

The image acquisition unit may include a camera disposed on at least one of front, rear, and side surfaces of the vehicle.

The image acquisition unit may further include a moving unit that moves the aperture of each of the cameras.

The controller may move the camera in a moving direction of the approaching subject.

The driving information display device of the vehicle may further include a distance measuring unit that transmits a signal to a subject and receives a signal reflected from the subject.

The driving information display device of the vehicle may further include a correction unit for correcting the image quality and/or brightness of the image of the approaching subject.

The first display unit may display driving information of the vehicle on a main screen and display an image of the approaching subject in a PIP manner.

The first display unit may display the driving map of the vehicle as driving information of the vehicle.

The control unit transmits a distance to the image displayed in the PIP method in correspondence with the image displayed in the PIP method, and the first display unit is adjacent to the image displayed in the PIP method and displayed in the PIP method. The distance to the image can be displayed.

The first display unit may output the approaching subject information to the inside of the vehicle as a sound.

The driving information display device of the vehicle may further include a lighting unit disposed outside the vehicle, and the second display unit may turn on or blink the lighting unit outside the vehicle in the direction of the approaching subject.

The driving information display device of the vehicle may further include an audio output unit disposed outside the vehicle, and the second display unit may output an alarm sound to the outside of the vehicle.

Another embodiment includes obtaining images of a plurality of directions outside the vehicle; recognizing a subject approaching the vehicle from the images of the plurality of directions; displaying the approaching subject information inside the vehicle; and transmitting a signal from the vehicle in the direction of the subject.

Acquisition of the image may be performed by taking a picture of a camera disposed at least one of the front, rear, and side of the vehicle.

The subject may be photographed by moving the opening of the camera in the direction of the subject approaching the vehicle.

To identify a subject approaching the vehicle, a signal corresponding to the plurality of images may be transmitted and a distance of each image information may be determined from a signal received after being reflected.

In order to display the approaching subject information inside the vehicle, an image of the subject may be displayed on a display device of the vehicle.

Driving information of the vehicle may be displayed on the main screen, and information on the approaching subject may be displayed in a picture in picture (PIP) method.

Vehicle driving information may indicate a driving map of the vehicle.

Adjacent to the image information displayed in the PIP method, a distance to the image information displayed in the PIP method may be displayed.

When the approaching subject information is displayed inside the vehicle, the subject information may be output as a sound to the inside of the vehicle.

Transmission of the signal in the direction of the subject may turn on or blink a lighting unit outside the vehicle.

Transmission of the signal in the direction of the subject may output an alarm sound to the outside of the vehicle.

Another embodiment provides a program stored in a recording medium that implements the aforementioned vehicle driving information providing methods.

An apparatus and method for displaying driving information of a vehicle according to an embodiment and a program stored in a recording medium implementing the method measure an image of the front, side, or rear of the vehicle, identify a subject approaching the vehicle, and If the brightness and image quality of the image of the subject are improved and displayed in the PIP method and voice on the navigation inside the vehicle, the driver identifies the subject approaching the vehicle through the PIP method displayed on the navigation and collides with the subject. You can safely drive your vehicle without it.

In addition, through a lighting unit or a horn outside the vehicle, pedestrians may be visually or audibly aware of the approach of the vehicle.

In addition, when the corrected image and audio of the above-described subject are provided to a smart device provided outside the vehicle through wireless communication, the driving state of the vehicle can be grasped by the smart device outside the vehicle. In the case of commercial vehicles, the management can frequently check whether the driver complies with safe driving rules through a smart device.

1 is a flowchart of a first embodiment of a method for displaying vehicle driving information;
2 is a view showing a vehicle equipped with a vehicle driving information display device;
3 is a view showing a process of measuring the distance between the vehicle and the subject in FIG. 2;
4 is a diagram showing a first embodiment of a vehicle driving information display device;
5A and 5B are diagrams illustrating exemplary embodiments in which driving information and image information displayed on a display device of a vehicle are displayed;
6 is a view showing the movement of the camera in the direction of the subject,
7 is a flowchart of a second embodiment of a method for displaying vehicle driving information;
8 is a diagram showing a second embodiment of a vehicle driving information display device;
9 is a view showing lighting units disposed outside the vehicle;
10 is a view showing the operation of a headlight of a vehicle among the lighting units of FIG. 9;
FIG. 11 is a view showing an action of a door light of a vehicle among the lighting units of FIG. 9 .

Hereinafter, examples will be described in order to explain the present invention in detail, and will be described in detail with reference to the accompanying drawings to help understanding of the present invention. However, embodiments according to the present invention can be modified in many different forms, and the scope of the present invention should not be construed as being limited to the embodiments described below. Embodiments of the present invention are provided to more completely explain the present invention to those skilled in the art.

In addition, relational terms such as "first" and "second", "upper" and "lower" used below do not necessarily require or imply any physical or logical relationship or order between such entities or elements. As such, it may be used only to distinguish one entity or element from another entity or element.

1 is a flowchart of a first embodiment of a method for displaying driving information of a vehicle, FIG. 2 is a diagram showing a vehicle equipped with a driving information display device of a vehicle, and FIG. 3 is a method for measuring a distance between a vehicle and a subject in FIG. 4 is a diagram showing a first embodiment of a vehicle driving information display device, and FIGS. 5A and 5B show one embodiment in which driving information and image information displayed on a vehicle display device are displayed. FIG. 6 is a diagram showing movement of a camera in the direction of a subject.

Hereinafter, a first embodiment of a vehicle driving information display device and method will be described with reference to FIGS. 1 to 6 .

As shown in FIG. 4 , an apparatus for displaying vehicle driving information according to an embodiment includes an image acquisition unit 210 , a distance measurement unit 220 , a control unit 300 , and a display unit 400 .

The image acquisition unit 210 may include at least two image acquisition units 211 to 218 disposed in a vehicle and acquiring images of subjects in different directions, and the image acquisition units 211 to 218 are image sensors. can be

The distance measurement unit 220 may include distance measurement units 221 to 228 that measure distances from the vehicle of each subject in the image.

The control unit 300 includes an object recognition unit 310, a calculation unit 320, a correction unit 330, a control unit 340, and a communication unit 350.

The moving object detection unit 310 checks whether a subject is included in the image captured by the image acquisition unit 210, and may proceed through a change in pixels of the captured image or by other known methods. It is not necessarily limited thereto.

The calculation unit 320 may check the movement state of the subject recognized by the object recognizing unit 310 and predict the movement of the subject. The correction unit 330 may correct the image quality and/or brightness of the image of the subject described above, and the control unit 340 may move the image information acquisition units 211 to 218 according to the movement direction of the recognized subject. . The communication unit 350 may receive the above-described data from the image acquisition unit 210 and the distance measurement unit 220 and transmit the corrected image to the display unit 400 .

A method of displaying driving information of a vehicle according to the present embodiment will be described in detail.

First, images of a plurality of directions outside the vehicle are acquired (S100).

As shown in FIG. 2 , the image acquisition unit may include a plurality of image acquisition units 211 to 218 disposed at the front, side, rear, and side of the vehicle 100 . The vehicle 100 may be an electric vehicle, a bus, or a two-wheeled vehicle in addition to the illustrated passenger vehicle.

The image acquisition units 211 to 218 may be cameras provided outside the vehicle to capture images of the surroundings, or may capture still images or moving images.

In this embodiment, two image acquisition units 211 and 212 are provided at the rear of the vehicle, two image acquisition units 213 and 214 are provided at the rear of the vehicle, and two image acquisition units are provided at the side of the vehicle. 215 and 216 are provided, and two image acquisition units 217 and 218 are provided at the front of the vehicle, but are not necessarily limited thereto.

The above-described image acquisition units 211 to 218 may operate while the vehicle is driving or while the engine is turned on, and each image acquisition unit 211 to 218 is provided to rotate or move an opening. It can be.

In addition, a subject moving in the direction of the vehicle is identified in a plurality of images (S110).

The subject can be identified through the change of pixels of the image described above in the moving object detection unit 310 . Also, the calculation unit 320 may check the motion state of the subject recognized by the object recognizing unit 310 and predict the movement of the subject.

In addition, the distance measuring unit 220 may measure the distance to the subject. In FIG. 4 , the distance measurement unit 220 includes a plurality of distance measurement units 221 to 228 . In this embodiment, each image acquisition unit 211 to 218 includes one distance measurement unit 221 to 228 . may be arranged in correspondence with each other.

In FIG. 3, one distance measurement unit 221 is disposed on one image acquisition unit 211, but the distance measurement unit 221 corresponds to the image acquisition unit 211 and is photographed by the image acquisition unit 211. If the distance to can be measured, it may be placed in another location.

In FIG. 3 , a pedestrian is photographed by the image acquisition unit 211, and the distance measurement unit 221 transmits a signal in the direction of the subject, the pedestrian, receives a signal reflected from the pedestrian, and measures the distance between the pedestrian and the vehicle. can do. In this case, the above-described signal may be an ultrasonic wave or the like.

The distance measurement in FIG. 3 may be performed in the distance measurement units 221 to 228 provided in the eight image acquisition units 211 to 218 shown in FIG. In addition to checking and predicting the movement, a subject disposed closest to the vehicle may be determined by mutually comparing distances measured by the distance measurement units 221 to 228 .

Then, the image quality and/or brightness of the image of the approaching subject is corrected (S120). In this case, only the subject portion may be enlarged along with image correction, and the same applies to embodiments described later.

In a dark environment, especially at night, the image captured by the image acquisition device may be dark or of poor quality. Image quality and brightness can be improved. Improvement of the image quality and brightness of an image may be performed by a known method, but is not necessarily limited thereto.

And, the driving information of the vehicle and the above-described corrected image may be displayed on the display unit of the vehicle (S130). can be moved That is, an opening such as a camera or an image sensor moves along a moving subject, so that a subject approaching in the direction of the vehicle can be continuously photographed.

The communication unit 350 may receive the above-described data from the image acquisition unit 210 and the distance measurement unit 220 and transmit the corrected image to the display unit 400 .

The display unit 400 may be a navigation device displayed inside a vehicle, and as shown in FIG. 5A , may display a corrected image of a subject transmitted together with vehicle driving information such as a driving map, for example. For example, the vehicle driving information may be used as the main screen and the corrected image of the subject may be displayed in a picture in picture (PIP) method. At this time, the image of the above-described PIP method enlarges and displays the received image of the subject, so that the driver's perception can be facilitated.

Here, the 'driving map' may be a map displaying a map around the vehicle and/or a route to a destination, as shown in FIG. 5A and the like.

In FIG. 5A, the driving map is displayed on the main screen, but the corrected image of the subject closest to the vehicle is displayed in PIP, so that the driver can check the image of the subject approaching the vehicle with improved brightness and quality.

FIG. 5B is the same as FIG. 5A , but the distance of the above-described subject from the vehicle is displayed adjacent to the corrected image of the subject, so that the driver's convenience can be further provided.

That is, in FIG. 5A, only the PIP-type image is displayed, and in FIG. 5B, distance information (1m) between the subject and the vehicle in the image displayed under the PIP-type image is displayed.

6 is a diagram illustrating movement of a camera in the direction of a subject.

As described above, the control unit 340 moves the image information acquisition units 211 to 218 according to the movement direction of the recognized subject, so that the movement of the subject may be continuously photographed and displayed. At this time, the controller 340 may separately move each of the image information acquisition units 211 to 218 according to the movement of the subject.

In addition, object information approaching the vehicle may be output as voice through a display unit of the vehicle (S140), but this step may be omitted depending on the embodiment.

As an audio output of subject information, for example, a voice such as 'approaching an object 1 meter from the right rear of the vehicle' may be transmitted to the inside of the vehicle through a speaker 410 disposed in the display unit 400 . At this time, the driver can grasp the approaching direction and distance of the subject without looking at a display device such as a navigation device.

In the above-described embodiments, an image such as the front, side, or rear of the vehicle is measured, a subject approaching the vehicle is identified therefrom, brightness and image quality of the image of the approaching subject are improved, and the PIP method is used for navigation inside the vehicle. If indicated by voice, the driver can safely drive the vehicle without colliding with the subject by recognizing a subject approaching the vehicle through the picture-in-picture (PIP) video and audio displayed on the navigation system.

In addition, the corrected image and audio of the subject transmitted from the communication unit 350 in the control unit 300 to a display unit such as a navigation system provided in the vehicle are transferred to a smart device provided outside the vehicle in a wireless communication method. can be conveyed

At this time, if the corrected image and audio of the above-described subject are provided to a smart device provided outside the vehicle through wireless communication, the driving state of the vehicle can be grasped by the smart device outside the vehicle. In the case of commercial vehicles, the management can frequently check whether the driver complies with safe driving rules through a smart device.

7 is a flowchart of a method for displaying driving information of a vehicle according to a second embodiment, FIG. 8 is a diagram illustrating a device for displaying driving information of a vehicle according to a second embodiment, and FIG. 9 is a diagram illustrating lighting units disposed outside the vehicle. FIG. 10 is a view showing an operation of a vehicle headlight among the lighting units of FIG. 9 , and FIG. 11 is a view showing an operation of a door lamp of the vehicle among the lighting units of FIG. 9 .

Hereinafter, a second embodiment of a vehicle driving information display device and method will be described with reference to FIGS. 7 to 11 , but configurations overlapping those of the above-described embodiments may be omitted.

First, images of a plurality of directions outside the vehicle are obtained, and a subject moving in the direction of the vehicle is identified from the plurality of images (S210).

As shown in FIGS. 2 and 4 , the image acquisition unit may be a plurality of image acquisition units 211 to 218 at the front, rear, rear, side, and side of the vehicle 100 .

As described above, the identification of the subject may be performed in the moving object detection unit 310, and the operation unit 320 checks the movement state of the subject recognized by the object recognition unit 310 and moves the subject. may be predicted, and the distance to the subject may be measured by the distance measuring unit 220 .

Then, the image quality and/or brightness of the image of the approaching subject is corrected (S220). In this case, only the subject portion may be enlarged along with image correction.

As described in the above-described embodiment, the image quality and brightness of the image of a subject approaching the vehicle can be improved by the picture quality improvement unit 331 and the brightness improvement unit 332 in the correction unit 330, and also of other subjects. The above-described improvement or correction of image quality and brightness may also be performed on images.

And, the driving information of the vehicle and the above-described corrected image may be displayed on the display unit of the vehicle (S230). The communication unit 350 may receive the above-described data from the image acquisition unit 210 and the distance measurement unit 220 and transmit the corrected image to the display unit 400 .

The display unit 400 may be a navigation device displayed inside the vehicle, and as shown in FIGS. 5A and 5B , it may display a corrected image of a subject transmitted together with vehicle driving information such as a driving map. . At this time, the control unit 340 moves the image information obtaining units 211 to 218 according to the movement direction of the recognized subject, so that the movement of the subject may be continuously photographed and displayed.

In addition, object information approaching the vehicle may be output as voice through the display unit of the vehicle (S240). .

In addition, a lighting unit outside the vehicle may be turned on or blinked (S250), and the pedestrian may recognize the approach of the vehicle by turning on or blinking the lighting unit.

As shown in FIG. 9 , the lighting unit outside the vehicle may be a front light 110 , a door light 120 , or a tail light 130 of the vehicle 100 .

When the distance between the vehicle and the subject measured by the distance recognition unit 220 is within a certain range, the controller 340 turns on or blinks the headlights of FIG. 10 or the door lights of FIG. may draw attention. That is, the controller 340 may control the operation of the lighting unit in addition to the above-described operation of controlling the movement of the camera.

In addition, by outputting an alarm sound from a horn outside the vehicle (S260), the pedestrian can recognize the approach of the vehicle through hearing.

In this embodiment, an image such as the front, side, or rear of the vehicle is measured, a subject approaching the vehicle is identified therefrom, the brightness and image quality of the image of the approaching subject are improved, and the PIP method and voice are used for navigation inside the vehicle. If so, the driver can identify a subject approaching the vehicle through the picture-in-picture (PIP) video and audio displayed on the navigation system, and safely drive the vehicle without colliding with the subject.

In addition, through a lighting unit or a horn outside the vehicle, pedestrians may be visually or audibly aware of the approach of the vehicle.

In addition, the corrected image and audio of the subject transmitted from the communication unit 350 in the control unit 300 to a display unit such as a navigation system provided in the vehicle are transferred to a smart device provided outside the vehicle in a wireless communication method. That it can be delivered is the same as in the above-described embodiment.

The vehicle driving information display method according to the above-described embodiments, that is, the method shown in FIGS. 1 and 7 may be stored as a program in a recording medium.

Although the above has been described with reference to the embodiments, these are merely examples and do not limit the present invention, and those skilled in the art to which the present invention belongs will not deviate from the essential characteristics of the present embodiment. It will be appreciated that various variations and applications are possible. For example, each component specifically shown in the embodiment can be modified and implemented. And the differences related to these modifications and applications should be construed as being included in the scope of the present invention as defined in the appended claims.

100: vehicle 210: image acquisition unit
211 to 218: image acquisition unit 220: distance measuring unit
221 to 218: distance measuring unit 300: control unit
310: object recognition unit 320: calculation unit
330: correction unit 331: image quality improvement unit
332: brightness improvement unit 340: control unit
330: communication unit 400: display unit
410, 510: speaker 500: lighting unit

Claims (16)

at least two image acquisition units disposed in the vehicle to acquire images of subjects in different directions;
an object recognizing unit recognizing a subject from the obtained image;
a control unit for recognizing a subject approaching the vehicle from among the recognized subjects;
a calculator configured to determine a motion state of the subject recognized by the object recognizing unit and to predict a movement of the subject;
a correction unit correcting at least one of image quality and brightness of the image of the approaching subject;
a distance measuring unit including a plurality of distance measuring units transmitting a signal to the subject and receiving a signal reflected from the subject;
a first display unit displaying the approaching subject information inside the vehicle;
a second display unit transmitting a signal to the outside of the vehicle in the direction of the subject; and
A communication unit for transmitting the corrected image and audio of the subject to a smart device outside the vehicle in a wireless communication method;
The image acquisition unit includes a camera disposed on at least one of the front, rear, and side of the vehicle,
The image acquisition unit further comprises a moving unit for moving the opening of each camera,
The camera recognizes the subject by rotating or moving an opening while the vehicle is turned on,
The calculation unit compares the distances measured by the plurality of distance measurement units to determine a subject disposed closest to the vehicle,
The first display unit displays driving information including a driving map of the vehicle along with a corrected image of the subject on a main screen, enlarges and displays the corrected image of the subject in a PIP method,
The control unit transmits a distance to the image displayed in the PIP method in correspondence with the image displayed in the PIP method,
The first display unit is adjacent to the image displayed in the PIP method and displays the distance to the image displayed in the PIP method, and outputs the approaching subject information to the inside of the vehicle as a sound. . delete delete According to claim 1,
Wherein the control unit moves the camera in the moving direction of the approaching subject. delete delete delete delete delete delete According to claim 1,
Further comprising a lighting unit disposed outside the vehicle,
The second display unit turns on or blinks a lighting unit outside the vehicle in the direction of the approaching subject. According to claim 1,
Further comprising an audio output unit disposed outside the vehicle;
The second display unit outputs an alarm sound to the outside of the vehicle. delete delete delete delete

Images