KR20130076215A - Device for alarming image change of vehicle - Google Patents

Abstract

PURPOSE: An alarming device of changes in an image for a vehicle is provided to allow a driver to know a change of an object that the driver wants to pay attention to by outputting an alarm when there is a change in an image including the object, thereby allowing the driver to easily concentrate on driving. CONSTITUTION: An alarming device of changes in an image for a vehicle comprises a front image acquisition unit (110) configured to acquire an front image including an object which a driver is interested in and wants to monitor; a memory (120) configured to store the front image acquired at an arbitrary time point; and a control unit (130) configured to receive a selection of the object which the driver wants to monitor from the front image acquired at an arbitrary time point and to output an alarm to the driver when detecting a change with respect to the object in front images acquired by the front image acquisition unit in real time. [Reference numerals] (110) Front image acquisition unit; (120) Memory; (130) Control unit; (140) Output unit; (150) Key controlling unit; (160) Driver recognition unit

Description

Vehicle image change notification device {DEVICE FOR ALARMING IMAGE CHANGE OF VEHICLE}

The present invention relates to an image change notification device of a vehicle. In detail, an image change of an object of interest is acquired from a front image obtained in real time in a state where an object of interest to be monitored is selected from a front image obtained by acquiring a front image. Is detected, the present invention relates to a vehicle image change notification device outputting notification information to a driver.

Recently, as the penetration rate of vehicles increases, congestion sections increase on the road regardless of time zones, which causes the driver to feel bored when driving in the congestion section and to watch another place for a long time or drowsy driving.

As described above, when the driver does not concentrate on driving and does not recognize the start of the front vehicle while performing other actions, there is a problem of disturbing the flow of the vehicle or being surprised by the horn generated from the rear vehicle.

In order to solve this problem, recently, a radar is mounted on a vehicle and a device for informing a driver of a departure of the front vehicle according to a distance from the front vehicle has been developed.

Since the prior art merely informs the departure of the vehicle ahead by the distance difference with the vehicle ahead, when the vehicle ahead starts to violate the signal, the driver starts only by the alarm sound, which causes an accident. The problem is likely to increase.

In addition, in the prior art, since the driver generates an alarm sound even when the driver observes the front and recognizes the start of the vehicle ahead, the driver is stressed by frequent alarm sounds, causing a problem that concentration is blurred. This increases the driver's chance of having an accident due to lack of concentration.

In addition, vehicle functionality has increased, and drivers' dispersal factors such as phone calls and device settings have increased. There was a problem that the driver had to concentrate on changing the state of the object without a break.

As traffic becomes more complex, more traffic lights are waiting for the signal. However, in the past, since there was no system for monitoring the change of traffic lights, if the signal is missed momentarily in the waiting state, it may interfere with the driving and suffer from the drivers around.

The problem to be solved by the present invention, when the image of the target of interest is detected from the front image obtained in real time in the state of selecting the target of interest to be monitored in the front image obtained by acquiring the front image, information to the driver An object of the present invention is to provide an image change notification device for outputting a vehicle.

According to one aspect of the invention, the front image acquisition unit for obtaining a front image including the target of interest to be monitored; A memory for storing a forward image obtained at an arbitrary time point; And selecting an object of interest to be monitored from the front image acquired at the arbitrary time point, and outputting notification information to the driver when an image change of the object of interest is detected from the front image acquired in real time by the front image acquisition unit. An image change notification device for a vehicle including a control unit is provided.

The controller may display category information on a plurality of objects of interest on the screen from the front image acquired by the front image acquisition unit.

The category information may include one or more of a traffic light, a store, a front vehicle, and a manual designation.

The image conversion notification device of the vehicle may further include a driver recognizing unit for acquiring the driver's gaze or gesture in order to receive the selection of the object of interest.

The controller may correct the position of the selected object of interest through image tracking while the object of interest is selected.

The controller may output notification information by using one or more of sound, voice, blinking, lighting, turning off, wind pressure, and state change of the screen.

According to the present invention, when an image of interest is detected from a front image obtained in real time in a state where an object of interest to be monitored is selected from a front image obtained by acquiring a front image, the driver outputs notification information to the driver. Even if the user is not paying attention to the object of interest, the driver can comfortably drive because the video information on the object of interest can be naturally known through the notification information. As a result, it is possible to perform a driver-friendly notification function can be a great help to improve the customer satisfaction.

1 is a block diagram illustrating an image change notification apparatus of a vehicle according to an exemplary embodiment of the present invention.
2 is a view for explaining a front image obtained by the image change notification device of a vehicle according to an embodiment of the present invention.
3 is an exemplary view showing a front image obtained by the image change notification device of a vehicle according to an embodiment of the present invention.
4 is an exemplary view showing a front image obtained by the image change notification device of a vehicle according to an embodiment of the present invention.
5 is a view illustrating a driver's seat in an image change notification apparatus of a vehicle according to an exemplary embodiment of the present invention.
6 illustrates a front image obtained by the image change notification device of a vehicle according to an exemplary embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings will be described embodiments of the present invention; The following embodiments are provided by way of example so that those skilled in the art can fully understand the spirit of the present invention. Therefore, the present invention is not limited to the embodiments described below, but may be embodied in other forms.

1 is a block diagram illustrating a driver authentication apparatus using driver's body type information according to an exemplary embodiment of the present invention.

Referring to FIG. 1, a driver authentication apparatus using driver's body type information according to an exemplary embodiment of the present invention may include a front image acquisition unit 110, a memory 120, a controller 130, an output unit 140, and a key manipulation unit ( 150, the driver recognition unit 160 may be included.

The front image acquirer 110 acquires a front image including an object of interest to be monitored. For example, the front image acquisition unit 110 may be a camera, and may be installed inside or outside the vehicle to acquire a front image.

The memory 120 stores the front image acquired by the front image acquisition unit 110 at any time.

The memory 120 stores category information so that the driver can select a target to be monitored from the front image acquired by the front image acquisition unit 110. These category information may include information about traffic lights, shops, forward vehicles, manual assignments.

The memory 120 may store driver information, body shape information, and driving habit information of the driver. The driver information may include the driver's name, age, and gender. The driver's body type information may include height, sitting height, weight, and hip shapes, and the number may be adjusted as needed.

The memory 120 may store face recognition information, gaze information, and gesture information acquired by the driver recognition unit 160.

The controller 130 selects an object of interest to be monitored from the front image acquired at an arbitrary point of view, and when the image change of the object of interest is detected from the front image obtained in real time by the front image acquisition unit 110, the driver is sent to the driver. Output notification information.

The controller 130 may display category information on the plurality of objects of interest on the screen from the front image acquired by the front image acquisition unit 110.

The category information displayed on the screen may include information about a traffic light, a store, a vehicle ahead, and a manual designation.

The controller 130 may correct the position of the selected object of interest through image tracking while the object of interest is selected. The controller 130 may notify the driver of the image change by outputting the notification information by using one or more of sound, voice, blinking, lighting, turning off, wind pressure, and state change of the screen.

The output unit 140 outputs various information such as a front image obtained by the front image acquisition unit 110 or a target selected by the driver as voice, image, and text. To this end, the output unit 140 may include a speaker or a display device.

The key operation unit 150 receives a driver's selection signal for selecting an image to be monitored from the front image, or activates or deactivates a notification mode.

The driver recognition unit 160 may obtain a driver's gaze or gesture in order to receive an object of interest from the driver. The driving recognition unit 160 may be, for example, a camera.

For example, the camera of the driver recognition unit 160 may be installed at an appropriate position in front of the driver's seat in order to recognize the driver's gaze or gesture. If necessary, the camera may be an infrared camera. However, the present invention is not limited thereto and can be modified as many as possible.

In addition, although not shown, various sensors necessary for driving the vehicle may be included. For example, the sensors may include a steering angle sensor, a vehicle speed sensor, a lateral acceleration sensor, a rotation angle velocity sensor, a camera recognition module, and an illumination sensor. The sensor unit may detect steering angle, speed, lateral acceleration, rotation angle speed, illuminance value, and camera image recognition information of the vehicle.

2 is a view for explaining a front image obtained by the image change notification device of a vehicle according to an embodiment of the present invention.

Referring to FIG. 2, the front image acquisition unit 110 obtains a front image by using a camera. The front image information acquired by the front image acquisition unit 110 is transferred to and stored in the memory 130 under the control of the controller 120.

3 is an exemplary view showing a front image obtained by the image change notification device of a vehicle according to an embodiment of the present invention.

Referring to FIG. 3, the controller 120 displays the front image acquired by the front image acquisition unit 110 on the screen of the output unit 140. In this case, the controller 120 displays an object of interest to be monitored by the driver in the front image on the screen. At this time, the categories 142 stored in the memory 120 are displayed on one screen area of the output unit 140. For example, categories may include traffic lights, shops, vehicles ahead, and manual assignments.

If the driver selects an arbitrary category in the category 142 displayed on the screen, the driver displays the objects of interest corresponding to the category on the screen. In the drawings, the objects of interest are indicated by dotted lines or solid lines. Indeed, this may be displayed, and various methods of displaying only the corresponding object of interest may be used. Here is an exemplary view of a screen in which a traffic light is selected in the category 142 by the driver.

The driver may select an object of interest to be monitored on the screen of the output unit 140. In this case, the driver may select an object of interest by pressing the key operation unit 150. Here, an embodiment of the touch panel in which the key manipulation unit 150 is formed on the output unit 140 is shown. Accordingly, the driver may select the object of interest 141 that the user wants to monitor on the touch panel.

Accordingly, the controller 120 monitors the change of the selected object of interest, and if the image of the object of interest changes, the controller 120 notifies the driver of the changed fact through the output unit 140 by voice or image.

Meanwhile, the controller 120 may move the vehicle in the middle of the monitoring process so that the driver is notified when a change to the image of the target object of interest is detected by adjusting the micro position of the target of interest through image tracking.

Here, the driver directly selects an object of interest to be monitored through the touch panel.

However, in another variation of the present invention, the driver may select an object of interest by recognizing the driver's gaze or gesture.

4 is an exemplary view showing a front image obtained by the image change notification device of a vehicle according to an embodiment of the present invention.

Referring to FIG. 4, the camera of the driver recognition unit 160 may obtain a driver's gaze or a gesture in order to receive an object of interest from the driver. In addition, the target of interest may be selected from the front image according to where the driver's eyes stay or the recognition of the gesture. For example, the driver recognizes the driver's gaze, recognizes the point where the gaze stays, and primarily selects an object of interest in the front image, and recognizes the driver's gesture to move the selection area (circle) 143 in the front image more accurately. You can select the target.

The controller 130 detects the driver's gaze by the driver recognition unit 160 when a category is selected and a candidate group is already present and a plurality of candidates are displayed on the screen. The driver may enable the controller 130 to execute a process of selecting an object of interest by using the key manipulation unit 150 or a voice or continuous blinking or gesture of an eye.

When the driver stares at the object of interest, the controller 130 detects the driver's gaze direction and estimates the position at which the driver stares. The estimated position (area) is displayed on the screen. If the estimated position is appropriate, the driver selects using the key operation unit 150 or voice or gesture. Thereafter, the controller 130 monitors the target of interest. If the estimated position is incorrect, the driver presses the restart button of the key control unit 150 or uses a voice, a gesture, for example, a blink of an eye, to fix the gaze again on another object of interest.

As another example, when the driver gazes at the candidate of the interest to be selected for monitoring, the controller 130 may analyze the driver's gaze and select the interest as the interest to be monitored. In this case, the controller 130 may basically designate a target of interest displayed at the center of the screen of the output unit 140 among the candidate groups as a virtual candidate. The designated virtual candidate is displayed with a selection mark on the screen. When the driver moves the eye's direction like a joystick (← ↑ → ↓), the virtual candidate is moved to the closest candidate interest object along the direction and the object becomes a virtual candidate. Thereafter, when the candidate is selected, the key manipulation unit 150 selects the target of interest as the target of interest to be monitored. When only the candidate group is requested to be displayed selectively, if there is only one candidate on the screen, the candidate can be automatically monitored.

As another example, when the candidate group of interest to be displayed is selected, the controller 130 selects a candidate of interest in the moving direction when the hand is moved with the palm open. Once you have made your selection, grab your fist while the hand stops moving and your target of interest will be selected.

On the other hand, when the candidate group displayed in the front image is not selected, when the hand is moved with the palm open, the cursor having the state coordinates moves on the screen of the output unit 140 according to the movement of the hand. When the selection is complete, the target of interest may be selected by clenching the fist while the hand stops moving. Thereafter, the controller 130 tracks the image change of the selected object of interest.

FIG. 5 is a view illustrating a driver's seat in an image change notification apparatus of a vehicle according to an embodiment of the present invention, and FIG. 6 is a front image obtained by the image change notification apparatus of a vehicle according to an embodiment of the present invention. .

5 and 6, the controller 130 may analyze the driver's gaze direction through the camera of the driver recognition unit 160 and select an object displayed on the gaze of the driver's gaze as an object of interest.

The camera of the driver recognizing unit 160 acquires the driver's gaze that is attached to the wind shield in order to receive an object of interest from the driver. Meanwhile, the front image acquirer 110 acquires the front image. The controller 130 may determine an image position of the corresponding point in the front image acquired by the front image acquisition unit 110 in response to the gaze point 111 of the driver's gaze recognized by the camera of the driver recognition unit 160. Match Subsequently, the region 112 corresponding to the gaze point 111 may be selected as an object of interest.

To this end, the controller 130 analyzes the driver's gaze and calculates which part of the windshield is primarily viewed. To this end, the camera of the front image acquisition unit 110 installed inside (or outside) the vehicle acquires the front image of the vehicle. The controller 130 may match the input front image with the view seen as the windshield from the driver's seat, and then select an object that is closest to the position in the windshield that the driver is staring at.

The controller 130 may notify by using a sound or a voice or by using a change of light. For example, the driver may be notified by blinking, turning on, turning off the light, or generating wind pressure toward the driver. Alternatively, a status change message can be displayed on the screen inside the vehicle.

Meanwhile, if the driver does not want to set the target of interest, the driver may cancel the selected target of interest by manipulating the key manipulation unit 150 or using a separate gesture.

According to the present invention, when an image of interest is detected from a front image acquired in real time in a state where an object of interest to be monitored is selected from a front image obtained by acquiring a front image, the driver outputs notification information to the driver. Even if the user is not paying attention to the object of interest, the driver can comfortably drive because the video information on the object of interest can be naturally known through the notification information. As a result, it is possible to perform a driver-friendly notification function can be a great help to improve the customer satisfaction. For example, it may be useful when waiting for a signal, waiting in front of a girlfriend's house, or doing latent work.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the exemplary embodiments are defined by the appended claims rather than by the foregoing description. But may be embodied in the spirit and scope of the present invention as embodied in the appended claims.

110: front image acquisition unit 120: memory
130 control unit 140 output unit
150: key operation unit 160: driver recognition unit

Claims (6)

A front image acquisition unit which acquires a front image including an object of interest to be monitored;
A memory for storing a forward image obtained at an arbitrary time point; And
Selecting an object of interest to be monitored from the front image acquired at the arbitrary time point, and outputting notification information to the driver when an image change of the object of interest is detected from the front image acquired in real time by the front image acquisition unit; Image change notification device of a vehicle comprising a control unit. The method according to claim 1,
And the controller is configured to display category information on a plurality of objects of interest on a screen from a front image acquired by the front image acquirer. The method according to claim 2,
And the category information includes at least one of a traffic light, a store, a front vehicle, and a manual designation. The method according to claim 1,
And a driver recognition unit configured to acquire the driver's gaze or gesture to receive the selection of the object of interest. The method according to claim 1,
And the control unit corrects the position of the selected object of interest through image tracking while the object of interest is selected. The method according to claim 1,
The control unit is a video change notification device for a vehicle for outputting the notification information by using one or more of sound, voice, flicker, light, turn off, wind pressure, the state change of the screen.

Images