KR102213632B1 - Driver assistance apparatus and Vehicle including the same - Google Patents

Abstract

The present invention is provided inside a vehicle, is formed of a translucent material to block light entering the vehicle interior, a projection unit for projecting a beam toward the light blocking unit, and the projection unit And a processor for controlling the projection unit to provide vehicle-related information by displaying an image on the light blocking unit through the beam.

Description

Driver assistance apparatus and vehicle including the same

The present invention relates to a vehicle driving assistance device and a vehicle having the same.

A vehicle is a device that moves in a direction desired by a boarding user. A typical example is a car.

On the other hand, for the convenience of a user using a vehicle, various types of sensors and electronic devices are being provided. In particular, various devices have been developed for the convenience of the user's driving.

On the other hand, one of the devices for driving convenience is a sun visor for protecting the occupant's eyes from direct sunlight. Since the light entering the vehicle's windshield or window directly dazzles the occupant or is reflected on the display device installed in the vehicle to reduce the readability of the display device, the occupant manipulates the sun visor to block the inflow of light. do.

However, the sun visor according to the prior art has a problem that also covers the front view of the occupant. Due to the problem of obstructing the occupant's view, the probability of a traffic accident may increase. Accordingly, there is a need for research on a vehicle driving assistance device that protects the occupant's eyes from direct sunlight and does not block the occupant's view.

In order to solve the above problems, the present invention relates to a vehicle driving assistance apparatus including a light blocking unit capable of blocking light, formed of a translucent material, and capable of displaying an image projected through a beam.

The problems of the present invention are not limited to the problems mentioned above, and other problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, the vehicle driving assistance device according to the embodiment of the present invention is provided inside the vehicle, is formed of a translucent material, and is formed of a light blocking unit that blocks light entering the vehicle, and toward the light blocking unit. And a processor that provides a projection unit for projecting a beam and image information to the projection unit, and controls the projection unit to provide vehicle-related information by displaying an image on the light blocking unit through the beam.

Details of other embodiments are included in the detailed description and drawings.

According to an embodiment of the present invention, one or more of the following effects are provided.

First, by using a translucent material for the light blocking portion, there is an effect of preventing the occupant's view from being obscured.

Second, since the length of the light-blocking area is adjusted in consideration of the illuminance, the position of the sun, or the occupant's gaze, there is an effect of adaptively preventing the occupant's glare.

Third, if necessary, there is an effect of enabling safe driving for occupants by displaying an image that assists driving in the image display area.

The effects of the present invention are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by those skilled in the art from the description of the claims.

1 is a view showing the exterior of a vehicle according to an embodiment of the present invention.
2 is a block diagram of a vehicle driving assistance apparatus according to an embodiment of the present invention.
3 to 4 are diagrams referred to for describing a vehicle driving assistance apparatus when a plurality of light blocking units are included according to an exemplary embodiment of the present invention.
5 to 6 are diagrams referred to for describing a vehicle driving assistance apparatus when the light blocking unit is configured with a plurality of stages according to an embodiment of the present invention.
7 is a diagram referenced to describe the user input unit 125 according to an embodiment of the present invention.
8 is an example of an internal block diagram of the electronic control device inside the vehicle of FIG. 1.
9 to 10 are exemplary diagrams referenced for describing a vehicle driving assistance apparatus according to an embodiment of the present invention.
11A to 11C are views referenced to explain a screen displayed on a light blocking unit according to an exemplary embodiment of the present invention.
12 is a diagram referenced for describing an operation of controlling an image display area through a mobile terminal according to an embodiment of the present invention.
13 is a diagram referenced for describing an operation of outputting vehicle information as a voice according to an embodiment of the present invention.
14 is a diagram referenced for explaining an operation of receiving a voice command according to an embodiment of the present invention.
15 is a diagram referenced for explaining an operation of controlling an image display area by detecting a passenger's gaze according to an embodiment of the present invention.
16 is a diagram referenced for describing an operation of detecting a gesture of a passenger according to an embodiment of the present invention.
17 is a diagram referenced for explaining an operation of displaying text message reception information and call reception information according to an embodiment of the present invention.

Hereinafter, exemplary embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but identical or similar elements are denoted by the same reference numerals regardless of reference numerals, and redundant descriptions thereof will be omitted. The suffixes "module" and "unit" for components used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not have meanings or roles that are distinguished from each other by themselves. In addition, in describing the embodiments disclosed in the present specification, if it is determined that a detailed description of related known technologies may obscure the subject matter of the embodiments disclosed in the present specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are for easy understanding of the embodiments disclosed in the present specification, and the technical idea disclosed in the present specification is not limited by the accompanying drawings, and all modifications included in the spirit and scope of the present invention It should be understood to include equivalents or substitutes.

Terms including ordinal numbers, such as first and second, may be used to describe various elements, but the elements are not limited by the terms. These terms are used only for the purpose of distinguishing one component from another component.

When a component is referred to as being "connected" or "connected" to another component, it is understood that it may be directly connected or connected to the other component, but other components may exist in the middle. Should be. On the other hand, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there is no other component in the middle.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

In the present application, terms such as "comprises" or "have" are intended to designate the presence of features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, but one or more other features. It is to be understood that the presence or addition of elements or numbers, steps, actions, components, parts, or combinations thereof, does not preclude in advance.

Vehicles described herein may be concepts including automobiles and motorcycles. Hereinafter, the vehicle will be mainly described.

The vehicle described herein may be a concept including both an internal combustion engine vehicle having an engine as a power source, a hybrid vehicle including an engine and an electric motor as a power source, an electric vehicle including an electric motor as a power source, and the like.

In the following description, the left side of the vehicle means the left side in the driving direction of the vehicle, that is, the driver's seat side, and the right side of the vehicle means the right side in the driving direction of the vehicle, that is, the side of the assistant seat.

1 is a view showing the exterior of a vehicle according to an embodiment of the present invention.

Referring to FIG. 1, the vehicle 10 includes a wheel (103FR, 103FL, 103RL, ...) that rotates by a power source, a steering wheel for adjusting the traveling direction of the vehicle 10, and a vehicle driving assistance device 100 It may include.

According to an embodiment of the present invention, the vehicle driving assistance device 100 may be provided inside a vehicle. It is preferable that the vehicle driving assistance device 100 is attached to the ceiling inside the vehicle on the driver's seat side.

2 is a block diagram of a vehicle driving assistance apparatus according to an embodiment of the present invention.

Referring to FIG. 2, a vehicle driving assistance apparatus 100 according to an embodiment of the present invention includes a communication unit 110, an input unit 120, a sensing unit 140, an interface unit 160, a memory 170, and a processor ( 180), a power supply unit 190, an audio output unit 220, a projection unit 230, a light blocking unit 240, and a driving unit 245.

The communication unit 110 may exchange data with the mobile terminal 245 or the server 260 in a wireless manner. In particular, the communication unit 110 may exchange data wirelessly with a mobile terminal of a vehicle occupant. As a wireless data communication method, various data communication methods such as Bluetooth, WiFi Direct, WiFi, and APiX are possible.

The communication unit 110 may receive weather information, road traffic condition information, for example, Transport Protocol Expert Group (TPEG) information from the mobile terminal 245 or the server 260.

Meanwhile, when a user boards a vehicle, the user's mobile terminal 245 and the vehicle driving assistance device 100 may perform pairing with each other automatically or by executing an application by the user.

Meanwhile, the communication unit 110 may receive a control signal from a mobile terminal of a vehicle occupant. For example, the mobile terminal generates a control signal corresponding to an input signal received from a user and transmits it to the vehicle driving assistance apparatus 100. In this case, the communication unit 110 may receive the control signal and transmit it to the processor 180.

The input unit 120 includes a camera or video input unit for inputting an image signal, a microphone 123 for inputting an audio signal, or an audio input unit, and a user input unit 125 for receiving information from a user (for example, a touch key). (touch key), push key (mechanical key, etc.). The voice data or image data collected by the input unit 120 may be analyzed and processed as a user's control command.

The input unit 120 may include a vision module 121, a microphone 123, and a user input unit 125.

The vision module 121 acquires an image around the vehicle or an image inside the vehicle.

The vision module 121 processes image frames such as still images or moving images obtained by an image sensor. The processed image frame may be displayed on the light blocking unit 240 or stored in the memory 170 through a beam projected from the projection unit 230. Meanwhile, a plurality of cameras provided in the vision module 121 may be arranged to form a matrix structure, and through the camera forming a matrix structure as described above, a plurality of images having various angles or focuses to the vehicle driving assistance device 100 Information can be entered. In addition, the plurality of cameras 121 may be arranged in a stereo structure to obtain a left image and a right image for implementing a stereoscopic image.

Meanwhile, the vision module 121 may include a plurality of cameras.

For example, the vision module 121 may include at least one camera that acquires a rear image of the vehicle. Here, the at least one camera may include a first camera, a second camera, and a third camera. The first camera may be provided at the rear of the vehicle to obtain a first image. In this case, the first image may be an image behind the vehicle. The second camera may be provided on the left side of the vehicle to obtain a second image. In this case, the second image may be an image behind the left side of the vehicle. The third camera may be provided on the right side of the vehicle to obtain a third image. In this case, the third image may be an image behind the right side of the vehicle.

For example, the vision module 121 may include at least one camera provided inside the vehicle to obtain an image inside the vehicle.

For example, the vision module 121 may include at least one camera provided inside or outside the vehicle to obtain an image in front of the vehicle. Here, the at least one camera may be a stereo camera. The stereo camera may acquire a stereo image in front of the vehicle.

For example, the vision module 121 may include at least one camera that is provided inside the vehicle and senses a passenger's gaze. Here, the at least one camera may acquire an image of the eyes of a passenger in the vehicle.

The microphone 123 processes an external sound signal into electrical voice data. The processed voice data may be used in various ways according to a function (or an application program being executed) being executed by the vehicle driving assistance apparatus 100. Meanwhile, the microphone 123 may be implemented with various noise removal algorithms for removing noise generated in the process of receiving an external sound signal.

Meanwhile, the microphone 123 may receive a voice input of a passenger. The microphone 123 may convert the received voice input into an electrical signal.

The user input unit 125 is for receiving information from a user, and when information is input through the user input unit 125, the processor 180 controls the operation of the vehicle driving assistance device 100 to correspond to the input information. I can. The user input unit 125 may include a mechanical input means (or a mechanical key, for example, a button, a dome switch, a jog wheel, a jog switch, etc.) and a touch input means. .

The user input unit 125 may receive an input for controlling the projection unit 230 or the light blocking unit 240 from a passenger. The vehicle occupant may control the projection unit 230 through the user input unit 125 to control an image displayed on the light blocking unit. In addition, the vehicle occupant may control the driving unit 241 through the user input unit 125 to adjust the size of the light blocking unit 240.

The sensing unit 140 may include one or more sensors for sensing at least one of information in the vehicle driving assistance device 100, surrounding environment information surrounding the vehicle driving assistance device 100, and user information. For example, the sensing unit 140 may include a solar sensor 141 and a light amount sensor 142.

The sun sensor 141 tracks the position of the sun. For example, the sun sensor 141 tracks the azimuth and elevation angles of the sun. The solar sensor 141 may include one or more photodiodes to track the position of the sun.

The light amount sensor 142 detects the amount of light flowing into the vehicle. Specifically, the light amount sensor 142 detects the amount of sunlight. The light quantity sensor 142 may include a photoconductive device such as a CdS photoconductive cell or a CdS cell.

The interface unit 160 may receive map information related to vehicle driving through data communication with the AVN device 400. For example, the AVN device 400 may include a navigation system, and the interface unit 160 may receive a map and information on the location of the vehicle on the map from the navigation and transmit it to the processor 180. .

Meanwhile, the interface unit 160 may receive sensor information from the ECU 770 or the vehicle sensor unit 760.

Here, the sensor information includes vehicle slip degree, vehicle direction information, vehicle position information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward/reverse information, battery information, and fuel information. , Tire information, vehicle ramp information, vehicle interior temperature information, and vehicle interior humidity information.

Such sensor information includes wheel speed sensor, heading sensor, yaw sensor, gyro sensor, position module, vehicle forward/reverse sensor, wheel sensor, It may be obtained from a vehicle speed sensor, a vehicle body tilt sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor by steering wheel rotation, a temperature sensor inside a vehicle, a humidity sensor inside a vehicle, and the like. Meanwhile, the position module may include a GPS module for receiving GPS information.

Meanwhile, among the sensor information, vehicle direction information, vehicle position information, vehicle angle information, vehicle speed information, vehicle inclination information, and the like related to vehicle driving may be referred to as vehicle driving information.

The interface unit 160 may receive vehicle attitude information generated by the vehicle attitude detection unit 771.

The memory 170 may store various data for the overall operation of the vehicle driving assistance apparatus 100, such as a program for processing or controlling the processor 180. The memory 170 may be various storage devices such as ROM, RAM, EPROM, flash drive, and hard drive.

The processor 180 controls the overall operation of each unit in the vehicle driving assistance apparatus 100.

The processor 180 provides image information to the projection unit 230. The processor 180 may display an image on the light blocking unit 240 through a beam projected from the projection unit 230. The processor 180 may control the projection unit 230 to provide vehicle-related information through the image. Here, the vehicle-related information may include vehicle control information for direct control of a vehicle or vehicle driving assistance information for a driving guide to a vehicle occupant. The vehicle related information may be information received through the input unit 120. Alternatively, the vehicle-related information may be information received from the vehicle sensor unit 760 through the interface unit 160. Alternatively, the vehicle information may be information received from the ECU 770 through the interface unit 160. Alternatively, the vehicle information may be information received from the mobile terminal 245 or the server 260 through the communication unit 110.

The processor 180 may receive information on the amount of light flowing into the vehicle from the light amount sensor 142. When the light blocking unit 240 is configured as a transparent display, the processor 180 may adjust the transparency of the transparent display based on the amount of light.

The processor 180 receives image data obtained from the vision module 121. The processor 180 may control the projection unit 230 based on the image data.

For example, when the vision module 121 includes at least one camera for acquiring a rear image of a vehicle, the processor 180 receives the rear image of the vehicle, and the rear image of the vehicle is converted to the light blocking unit 240 It is possible to control the projection unit 230 to be displayed on.

Cameras that acquire the rear image of the vehicle may include a first camera, a second camera, and a third camera. The first camera may be provided at the rear of the vehicle to obtain a first image. In this case, the first image may be an image behind the vehicle. The second camera may be provided on the left side of the vehicle to obtain a second image. In this case, the second image may be an image behind the left side of the vehicle. The third camera may be provided on the right side of the vehicle to obtain a third image. In this case, the third image may be an image behind the right side of the vehicle.

The processor 180 may generate a synthesized image by receiving the first to third images and synthesizing the first to third images. The processor 180 may control the projection unit 230 to display a composite image on the light blocking unit 240.

When generating a synthesized image, the processor 180 may synthesize the first image and the second image based on an extension line (hereinafter, referred to as a first line) of the left body line of the vehicle when viewed from above. Specifically, the processor 180 may synthesize the right side of the first line based on the first image and the left side of the first line based on the second image based on the first line. For example, after excluding the vehicle body region 1171b from the second image, the first image and the second image may be synthesized based on the first line.

Also, when viewed from above, the processor 180 may synthesize the first image and the third image based on an extension line (hereinafter, referred to as a second line) of the right body line of the vehicle. Specifically, the processor 180 may synthesize the second line based on the second line, the left side of the second line based on the first image, and the right side of the second line based on the third image. For example, after excluding the vehicle body region 1171c from the third image, the first image and the third image may be synthesized based on the second line.

In this way, by synthesizing the first to third images, an image of a wide field of view toward the rear of the vehicle may be provided to the occupant.

When generating a synthesized image, the processor 180 may synthesize the first to third images by adjusting distances for the second and third images based on the position of the first camera. For example, the second and third cameras may not be disposed on the same plane as the first camera. The first camera may be disposed above or below the vehicle rear license plate, the second camera may be disposed on the left side mirror module, and the third camera may be disposed on the right side mirror module. In this case, a point at which the second and third cameras acquire an image is different from a point at which the first camera acquires an image. Accordingly, a sense of distance occurs between the second and third images and the first image according to the distance between the second and third cameras and the first camera. The processor 180 may adjust the distance through scaling as if the first to third images were captured on the same plane.

For example, when the vision module 121 includes at least one camera that acquires an image inside the vehicle, the processor 180 receives the image inside the vehicle, and the image inside the vehicle is converted to the light blocking unit 240 It is possible to control the projection unit 230 to be displayed on. For example, when the camera acquires an image of a rear seat of the vehicle, the processor 180 may control the projection unit 230 so that the rear seat image is displayed on the light blocking unit 240. In this case, the light blocking unit 240 may perform a room mirror function.

For example, when the vision module 121 includes at least one camera for acquiring an image in front of the vehicle, the processor 180 receives the image in front of the vehicle, and information based on the image in front of the vehicle is The projection unit can be controlled to be displayed at 240.

On the other hand, when the camera for obtaining the front image of the vehicle is configured as a stereo camera, the processor 180 obtains a stereo image of the front of the vehicle from the first camera 121a, and based on the stereo image, A disparity operation may be performed, object detection may be performed on at least one of the stereo images based on the calculated disparity information, and movement of the object may be continuously tracked after object detection.

In particular, the processor 180, when detecting an object, lane detection (LD), vehicle detection (VD), pedestrian detection (PD), light detection (Brightspot Detection, BD), traffic Traffic Sign Recognition (TSR), road surface detection, and the like can be performed.

In addition, the processor 180 may calculate a distance with respect to the detected surrounding vehicle, calculate a speed of the detected surrounding vehicle, and calculate a speed difference with the detected surrounding vehicle.

For example, when the vision module 121 includes at least one camera that detects the occupant's gaze, the processor 180 may adjust a region in which the beam is projected based on the occupant's gaze. A camera that detects the occupant's gaze can photograph the occupant's eyes. In this case, the processor 180 receives an image of the eye. The processor 180 extracts a pupil from the received image of the eye. The processor 180 tracks the extracted pupil. The processor 180 calculates a trajectory toward the pupil in response to the tracked pupil movement. Based on the trajectory, the processor 180 may control the projection unit 230 to receive a beam projected from the projection unit 230 in a region where the pupil is directed at the light blocking unit 240.

Meanwhile, when the light blocking unit 240 is configured with a plurality of stages, the processor 180 may adjust the end of the light blocking unit 240 in response to a user input through the user input unit 125. Alternatively, the processor 180 may adjust the end of the light blocking unit 240 based on the position of the sun tracked by the sun sensor 141.

Meanwhile, the light blocking unit 240 may be formed in plural. For example, when the light blocking part 240 is composed of a first light blocking part 240a and a second light blocking part 240b larger than the first light blocking part 240a, the processor 180 In response to a user input through the input unit 125, the first light blocking unit 240a or the second light blocking unit 240b may be selectively opened or folded. Alternatively, the processor 180 may selectively open or fold the first light blocking part 240a or the second light blocking part 240b based on the position of the sun tracked by the solar sensor 141.

The processor 180 may correct the output of the beam so that the image displayed on the light blocking unit 240 does not shake in response to the attitude of the vehicle. For example, when the vehicle moves up and down, the beam projected from the projection unit 230 is shaken up and down, so that the light shielding unit 240 shakes up and down. The picture may be shaken. In this case, the processor 180 may vertically correct the output of the beam projected from the projection unit 231 corresponding to the posture of the vehicle moving up and down.

The processor 180 may generate vehicle related information. The processor 180 may display vehicle-related information on the light blocking unit 240 through a beam projected from the projection unit 230. Here, the vehicle-related information may include vehicle control information for direct control of a vehicle or vehicle driving assistance information for a driving guide to a vehicle occupant.

The processor 180 is formed as an electrical unit for performing digital signal processor (DSP), application specific integrated circuit (ASIC), microcontroller, programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and other functions. Thus, it can be mounted on one surface of a predetermined circuit board.

The power supply unit 190 may supply power required for operation of each component under the control of the processor 180. In particular, the power supply unit 190 may receive power from a battery inside a vehicle.

The sound output unit 220, the sound output unit 220, converts the electrical signal from the processor 180 into an audio signal and outputs it. To this end, a speaker or the like may be provided. The sound output unit 220 may output a sound corresponding to the user input unit 125, that is, an operation of a button.

The projection unit 230 projects a beam toward the light blocking unit. The projection unit 230 may include a light source and a projection lens. The projection unit 230 implements an image corresponding to information processed by the processor 180. The projection unit 230 implements an image using light generated from a light source, and projects the implemented image to the light blocking unit. It is preferable to use an LED, a laser, etc. as a light source.

The light blocking part 240 is provided inside the vehicle. The light blocking part 240 is formed of a translucent material to block light entering the vehicle. In addition, the light blocking unit 240 includes a region where an image is formed by receiving a beam projected from the projection unit 230. In this case, the area where the image is formed may be varied.

On the other hand, the translucent material is a material having a predetermined transparency while blocking light. For example, the light blocking part 240 may be formed of a synthetic resin material made of a translucent material.

Meanwhile, according to the embodiment, the light blocking unit 240 may be formed as a transparent display. Meanwhile, the transparent display may have a predetermined transparency. In order to have such transparency, the transparent display is at least one of a transparent TFEL (Thin Film Elecroluminescent), a transparent OLED (Organic Light-Emitting Diode), a transparent LCD (Liquid Crystal Display), a transmissive transparent display, and a transparent LED (Light Emitting Diode) display. It may include. The transparency of the transparent display may be adjusted according to the control of the processor 180. The light blocking unit 240 prevents direct irradiation of light incident from the sun to the occupant by adjusting the transparency of the transparent display. The light blocking unit 240 may have a size or a degree of transparency adjusted based on data sensed by the solar sensor 141 or the light amount sensor 142.

On the other hand, the light blocking portion 240 is composed of a plurality of steps (段), each end can be folded. Corresponding to the position of the sun, the end of the light blocking unit 240 may be adjusted. In addition, the end of the light blocking unit 240 may be adjusted according to a user input received through the user input unit 125.

Meanwhile, the light blocking unit 240 may be configured in plural. For example, the light blocking part 240 may include a first light blocking part 240a and a second light blocking part 240b that is larger than the first light blocking part 240a. Depending on the position of the sun, the first light blocking portion 240a or the second light blocking portion 240b may be selectively used. Alternatively, the first light blocking unit 240a or the second light blocking unit 240b may be selectively used according to the image projected onto the light blocking unit 240. Alternatively, according to a user input through the user input unit 125, the first light blocking unit 240a or the second light blocking unit 240b may be selectively used.

The driving unit 245 provides a driving force that enables the light blocking unit 245 to move under the control of the processor 180. For example, the driving unit 245 may include a motor.

For example, when a plurality of light blocking units 240 are formed, driving force may be provided so that each light blocking unit 240 is folded or unfolded. For example, when the light blocking unit 240 is composed of a plurality of stages, the driving unit 245 may provide a driving force so that each stage is folded or unfolded.

3 to 4 are diagrams referred to for describing a vehicle driving assistance apparatus when a plurality of light blocking units are included according to an exemplary embodiment of the present invention.

3 to 4, the projection unit 230 may be attached to the vehicle interior ceiling. The projection unit 230 projects a beam toward the light blocking unit.

The light blocking unit 240 may be disposed between the projection unit 230 and the windshield 300. The light blocking unit 240 may be configured in plural. For example, the light blocking part 240 may include a first light blocking part 240a and a second light blocking part 240b that is larger than the first light blocking part 240a. Depending on the position of the sun, the first light blocking portion 240a or the second light blocking portion 240b may be selectively used. Alternatively, the first light blocking unit 240a or the second light blocking unit 240b may be selectively used according to the image projected onto the light blocking unit 240. Alternatively, according to a user input through the user input unit 125, the first light blocking unit 240a or the second light blocking unit 240b may be selectively used.

When the first light blocking unit 240a is selected, the processor 180 transmits the driving force to the light blocking unit 240 through the driving unit 245 (see FIG. 2 ). In this case, as shown in FIG. 4 (a), the first light blocking portion 240a may rotate downward with respect to the hinge portion 310 by a driving force. That is, the processor 170 may control the first light blocking part 240a to rotate downward with respect to the hinge part 310. The first light blocking part 240a may block sunlight directly irradiated to the occupant's eyes. In addition, the first light blocking unit 240a may receive a beam projected from the projection unit 230 and display an image based on the beam.

When the second light blocking unit 240b is selected, the processor 180 transmits a driving force to the light blocking unit 240 through the driving unit 245 (see FIG. 2 ). In this case, as shown in FIG. 4B, the second light blocking portion 240b may rotate downward with respect to the hinge portion 310 by a driving force. That is, the processor 170 may control the second light blocking part 240b to rotate downward with respect to the hinge part 310. The second light blocking unit 240b may block sunlight directly irradiated to the occupant's eyes. In addition, the second light blocking unit 240b may receive a beam projected from the projection unit 230 and display an image based on the beam.

Meanwhile, according to an embodiment, the microphone 123 described above may be disposed outside the case of the projection unit 230. According to an embodiment, at least one camera may be disposed outside the case of the projection unit 230 to detect a passenger's gaze provided in the vision module 121 described above.

5 to 6 are diagrams referred to for describing a vehicle driving assistance apparatus when the light blocking unit is configured with a plurality of stages according to an embodiment of the present invention.

5 to 6, the projection unit 230 may be attached to the vehicle interior ceiling. The projection unit 230 projects a beam toward the light blocking unit 240.

The light blocking unit 240 may be disposed between the projection unit 230 and the windshield 300. The light blocking unit 240 may be configured with a plurality of stages. In the present embodiment, the light blocking unit 240 is described as having a first stage and a second stage, but is not limited thereto.

When the light blocking part 240 is composed of a first end and a second end, the light blocking part 240 includes a first light blocking part 530, a second light blocking part 540, and a first hinge part 510. ) And a second hinge part 520. The first hinge part 520 rotatably connects the vehicle interior ceiling and the first light blocking part 530. The second hinge part 520 connects the first light blocking part 530 and the second light blocking part 540 to be rotatable.

When the first stage is selected, the processor 180 transmits the driving force to the light blocking unit 240 through the driving unit 245 (see FIG. 2 ). In this case, as shown in FIG. 5 (b), the first light blocking unit 530 and the second light blocking unit 540 rotate downward with respect to the first hinge unit 510 by a driving force. I can. The processor 180 may control the first and second light blocking portions 530 and 540 to rotate downward based on the first hinge portion 510. The first light blocking unit 530 and the second light blocking unit 540 may block sunlight directly irradiated to the occupant's eyes. That is, the first light blocking unit 530 and the second light blocking unit 540 may be overlapped and block sunlight directly irradiated to the occupant's eyes. In addition, the first light blocking unit 530 may receive a beam projected from the projection unit 230 and display an image based on the beam.

When the second stage is selected, the processor 180 transmits the driving force to the light blocking unit 240 through the driving unit 245 (see FIG. 2 ). In this case, as shown in Figs. 6 (a) and 6 (b), the second light blocking unit 540 may rotate downward based on the second hinge unit 520 by a driving force. . The processor 180 may control the second light blocking unit 540 to rotate downward based on the second hinge unit 520. The first light blocking unit 530 and the second light blocking unit 540 may block sunlight directly irradiated to the occupant's eyes. That is, the first light blocking unit 530 and the second light blocking unit 540 are in an unfolded state, and may block sunlight directly irradiated to the occupant's eyes. Further, the first light blocking unit 530 and the second light blocking unit 540 may receive a beam projected from the projection unit 230 and display an image based on the beam.

On the other hand, according to an embodiment, as illustrated in FIG. 6 (a), in a state in which the first light blocking part 530 is rotated downward and unfolded, the second light blocking part 540 is ) And may be positioned at a predetermined angle 610. Here, the angle 610 may be 90° to 180°.

7 is a diagram referenced to describe the user input unit 125 according to an embodiment of the present invention.

Referring to FIG. 7, the user input unit 125 may be attached to the steering wheel 710. The user input unit 125 may be configured to perform an input with a thumb while the occupant holds the steering wheel 710.

7A, the user input unit 125 may include a first button 711 and a second button 712. Here, each of the buttons 711 and 712 may be a physical button or a soft key.

When the light blocking unit 240 is composed of a plurality of light blocking units 240a and 204b, when an input is received from the first button 711, the processor 180 is configured with the first light blocking unit 240a. It can be controlled to rotate downward based on the branch 310 (see FIG. 4). When an input is received from the second button 712, the processor 180 may control the second light blocking unit 240b to rotate downward with respect to the hinge unit 310 (see FIG. 4 ).

When the light blocking unit 240 is composed of a plurality of stages, when an input is received through the first button 711, the processor 180 is configured with the first and second light blocking units 530 and 540 It can be controlled to rotate downward based on the branch 510 (see FIG. 5). When an input is received from the second button 712, the processor 180 controls the second light blocking unit 540 to rotate downward based on the second hinge unit 520 (see FIGS. 5 and 6). can do.

As shown in (b) of FIG. 7, the user input unit 125 may be configured as a ball type 720 (ball type). The ball-type user input unit may receive up, down, left, and right rolling inputs.

For example, when the light blocking unit 240 is composed of a plurality of light blocking units 240a and 204b, and when a rolling input is received in the first direction, the processor 180 may use the first light blocking unit 240a May be controlled to rotate downward based on the hinge part 310 (see FIG. 4). When a rolling input is received in the second direction, the processor 180 may control the second light blocking unit 240b to rotate downward with respect to the hinge unit 310 (refer to FIG. 4 ).

For example, when the light blocking unit 240 is composed of a plurality of stages, and a rolling input is received in the first direction, the processor 180 includes the first and second light blocking units 530 and 540 1 It can be controlled to rotate downward based on the hinge part 510 (refer to FIG. 5). When a rolling input is received in the second direction, the processor 180 may control the second light blocking unit 540 to rotate downward based on the second hinge unit 520 (see FIGS. 5 and 6). have.

Meanwhile, it is specified that the control operation of the processor 180 corresponding to the above-described rolling direction is only an embodiment. The control operation of the processor 180 corresponding to the rolling direction may be various embodiments according to the matching combination, and each embodiment may be included in the scope of the present invention.

8 is an example of an internal block diagram of the electronic control device inside the vehicle of FIG. 1.

Referring to FIG. 8, the vehicle 200 may include an electronic control device 700 for vehicle control. The electronic control device 700 may exchange data with the vehicle driving assistance device 100 and the AVN device 400 described above.

The electronic control device 700 includes an input unit 710, a communication unit 720, a vehicle memory 740, a lamp drive unit 751, a steering drive unit 752, a brake drive unit 753, a power source drive unit 754, and a sunroof. Driving unit 755, suspension driving unit 756, air conditioning driving unit 757, window driving unit 758, airbag driving unit 759, vehicle sensor unit 760, ECU 770, display unit 780, audio output unit ( 785) and a power supply unit 790 may be provided.

The input unit 710 may include a plurality of buttons or a touch screen disposed inside the vehicle 200. It is possible to perform various input operations through a plurality of buttons or a touch screen.

The communication unit 720 may exchange data with the mobile terminal 245 or the server 260 in a wireless manner. In particular, the communication unit 720 may wirelessly exchange data with a mobile terminal of a vehicle occupant. As a wireless data communication method, various data communication methods such as Bluetooth, WiFi Direct, WiFi, and APiX are possible.

The communication unit 720 may receive weather information, road traffic condition information, for example, Transport Protocol Expert Group (TPEG) information from the mobile terminal 245 or the server 260.

Meanwhile, when the user boards the vehicle, the user's mobile terminal 245 and the electronic control device 700 may perform pairing with each other automatically or by executing an application by the user.

The vehicle memory 740 may store various data for overall operation of the electronic control device 700, such as a program for processing or controlling the ECU 770.

The lamp driving unit 751 may control turn on/off of lamps disposed inside and outside the vehicle. In addition, it is possible to control the light intensity and direction of the lamp. For example, it is possible to control a direction indicator lamp, a brake lamp, and the like.

The steering drive unit 752 may perform electronic control on a steering apparatus (not shown) in the vehicle 200. Thereby, the traveling direction of the vehicle can be changed.

The brake driving unit 753 may perform electronic control on a brake apparatus (not shown) in the vehicle 200. For example, by controlling the operation of a brake disposed on a wheel, the speed of the vehicle 200 may be reduced. As another example, the moving direction of the vehicle 200 may be adjusted to the left or to the right by different operations of the brakes disposed on the left and right wheels.

The power source driving unit 754 may perform electronic control on a power source in the vehicle 200.

For example, when a fossil fuel-based engine (not shown) is a power source, the power source driving unit 754 may perform electronic control on the engine. Thereby, it is possible to control the output torque of the engine and the like. When the power source driving unit 754 is an engine, the speed of the vehicle may be limited by limiting the engine output torque according to the control of the ECU 770.

As another example, when an electricity-based motor (not shown) is a power source, the power source driver 754 may control the motor. Thereby, it is possible to control the rotational speed and torque of the motor.

The sunroof driving unit 755 may perform electronic control of a sunroof apparatus (not shown) in the vehicle 200. For example, it is possible to control the opening or closing of the sunroof.

The suspension driving unit 756 may perform electronic control on a suspension apparatus (not shown) in the vehicle 200. For example, if there is a curve on the road surface, the suspension device may be controlled to reduce vibration of the vehicle 200.

The air conditioning driver 757 may perform electronic control on an air cinditioner (not shown) in the vehicle 200. For example, when the temperature inside the vehicle is high, the air conditioning device is operated to control the supply of cold air into the vehicle.

The window driving unit 758 may perform electronic control on a suspension apparatus (not shown) in the vehicle 200. For example, it is possible to control the opening or closing of the left and right windows on the side of the vehicle.

The airbag driver 759 may perform electronic control of an airbag apparatus in the vehicle 200. For example, in case of danger, the airbag can be controlled to fire.

The vehicle sensor unit 760 senses a signal related to driving of the vehicle 100 or the like. To this end, the vehicle sensor unit 760 includes a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward/reverse sensor, and a wheel sensor. ), vehicle speed sensor, vehicle body tilt detection sensor, battery sensor, fuel sensor, tire sensor, steering sensor by steering wheel rotation, vehicle interior temperature sensor, vehicle interior humidity sensor, and the like.

Accordingly, the vehicle sensor unit 760 includes vehicle direction information, vehicle position information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward/reverse information, battery information, and fuel information. , Tire information, vehicle ramp information, vehicle internal temperature information, vehicle internal humidity information, and the like may be acquired.

Meanwhile, the vehicle sensor unit 760 includes, in addition, an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an intake air temperature sensor (ATS), a water temperature sensor (WTS), A throttle position sensor (TPS), a TDC sensor, a crank angle sensor (CAS), and the like may be further provided.

The ECU 770 may control the overall operation of each unit in the electronic control device 700.

By inputting by the input unit 710, a specific operation may be performed, or a signal sensed by the vehicle sensor unit 760 may be received and transmitted to the vehicle driving assistance device 100, and map information from the AVN device 400 Can receive and control the operation of each type of driving unit (751,752, 753,754,756).

In addition, the ECU 770 may receive weather information, road traffic condition information, for example, Transport Protocol Expert Group (TPEG) information from the communication unit 720.

Meanwhile, the ECU 770 may include a vehicle attitude detecting unit 771. Depending on the embodiment, the vehicle attitude detecting unit 771 may be configured as a separate module from the ECU 770. The vehicle attitude detecting unit 771 detects a vehicle attitude based on information sensed by a plurality of sensors provided in the vehicle sensor unit 760 and generates vehicle attitude information. For example, the vehicle attitude detecting unit 771 is a heading sensor, a yaw sensor, a gyro sensor, a position module, a wheel sensor, and a vehicle body tilt detection. Based on signals detected by sensors, steering sensors, etc., the attitude of the vehicle can be detected.

The display unit 780 may display an image related to an operation of the vehicle driving assistance device. To display such an image, the display unit 780 may include a cluster or a head up display (HUD) in the front of the vehicle interior. Meanwhile, when the display unit 780 is a HUD, it may include a projection module that projects an image onto the windshield of the vehicle 200. Meanwhile, the display unit 780 may include a touch screen capable of inputting.

The audio output unit 785 converts the electrical signal from the ECU 770 into an audio signal and outputs it. To this end, a speaker or the like may be provided. The audio output unit 785 may also output a sound corresponding to an operation of the input unit 710, that is, a button.

The power supply unit 790 may supply power required for the operation of each component under the control of the ECU 770. In particular, the power supply unit 790 may receive power from a battery (not shown) inside the vehicle.

9 to 10 are exemplary diagrams referenced for describing a vehicle driving assistance apparatus according to an embodiment of the present invention.

Referring to FIG. 9, the projection unit 230 projects a beam toward the light blocking unit. The light blocking part 240 is provided inside the vehicle. The light blocking part 240 is formed of a translucent material to block light entering the vehicle. In addition, the light blocking unit 240 includes a region where an image is formed by receiving a beam projected from the projection unit 230. In this case, the area where the image is formed may be varied.

Meanwhile, according to the embodiment, the light blocking unit 240 may be formed as a transparent display. Meanwhile, the transparent display may have a predetermined transparency. The light blocking unit 240 may have a size or a degree of transparency adjusted based on data sensed by the solar sensor 141 or the light amount sensor 142.

When the light blocking unit 240 is composed of a plurality, the first light blocking unit 240a or the second light according to the position of the sun detected by the sun sensor 141 and a user input received from the user input unit 124 The blocking part 240b may be selected.

When the light blocking unit 240 is composed of a plurality of light blocking units 240a and 204b, when the first light blocking unit 240a is selected, the processor 180 is operated through the driving unit 245 (see Fig. 2). , Transmits the driving force to the light blocking unit 240. The first light blocking portion 240a may rotate downward with respect to the hinge portion 310 by a driving force. That is, the processor 170 may control the first light blocking part 240a to rotate downward with respect to the hinge part 310.

In this case, as shown in (a) of FIG. 9, the first light blocking unit 240a may block sunlight directly irradiated to the occupant's eyes. In addition, the first light blocking unit 240a may receive a beam projected from the projection unit 230 and display an image based on the beam.

When the light blocking unit 240 is composed of a plurality of light blocking units 240a and 204b, when the second light blocking unit 240b is selected, the processor 180 is operated through the driving unit 245 (see Fig. 2). , Transmits the driving force to the light blocking unit 240. The second light blocking part 240b may rotate downward with respect to the hinge part 310 by a driving force. That is, the processor 170 may control the second light blocking part 240b to rotate downward with respect to the hinge part 310.

In this case, as shown in (b) of FIG. 9, the second light blocking unit 240b may block sunlight directly irradiated to the occupant's eyes. In addition, the second light blocking unit 240b may receive a beam projected from the projection unit 230 and display an image based on the beam.

Referring to FIG. 10, when the light blocking unit 240 is composed of a plurality of stages, the first stage or the first stage or the second stage according to the user input received from the user input unit 124 and the position of the sun detected by the sun sensor 141 The second stage can be selected.

When the light blocking unit 240 is composed of a first stage and a second stage, when the first stage is selected, the processor 180 is connected to the light blocking unit 240 through the driving unit 245 (refer to FIG. 2). It transmits the driving force. The first and second light blocking portions 530 and 540 may rotate downward with respect to the first hinge portion 510 by a driving force. The processor 180 may control the first and second light blocking portions 530 and 540 to rotate downward based on the first hinge portion 510.

In this case, as shown in (a) of FIG. 10, the first light blocking unit 530 and the second light blocking unit 540 may block sunlight directly irradiated to the occupant's eyes. That is, the first light blocking unit 530 and the second light blocking unit 540 may be overlapped and block sunlight directly irradiated to the occupant's eyes. In addition, the first light blocking unit 530 may receive a beam projected from the projection unit 230 and display an image based on the beam.

When the light blocking unit 240 is composed of a first stage and a second stage, when the second stage is selected, the processor 180 passes through the driving unit 245 (see FIG. 2) to the light blocking unit 240. It transmits the driving force. The second light blocking part 540 may rotate downward based on the second hinge part 520 by a driving force. The processor 180 may control the second light blocking unit 540 to rotate downward based on the second hinge unit 520.

In this case, as shown in (b) of FIG. 10, the first light blocking unit 530 and the second light blocking unit 540 may block sunlight directly irradiated to the occupant's eyes. That is, the first light blocking unit 530 and the second light blocking unit 540 are in an unfolded state, and may block sunlight directly irradiated to the occupant's eyes. Further, the first light blocking unit 530 and the second light blocking unit 540 may receive a beam projected from the projection unit 230 and display an image based on the beam.

11A to 11C are views referenced to explain a screen displayed on a light blocking unit according to an exemplary embodiment of the present invention.

Referring to FIG. 11A, the processor 180 provides image information to the projection unit 230. The processor 180 may display an image on the light blocking unit 240 through a beam projected from the projection unit 230. The light blocking unit 240 includes a region where an image is formed by receiving a beam projected from the projection unit 230. Here, the area where the image is formed may be referred to as an image display area.

The processor 180 receives image data obtained from the vision module 121. The processor 180 may control the projection unit 230 based on the image data.

For example, when the vision module 121 includes at least one camera for acquiring a rear image of a vehicle, the processor 180 receives the rear image of the vehicle, and the rear image of the vehicle is converted to the light blocking unit 240 It is possible to control the projection unit 230 to be displayed on.

FIG. 11B shows an embodiment of controlling the projection unit 230 so that the vehicle rear image is received and the vehicle rear image is displayed on the light blocking unit 240.

The camera that acquires the rear image of the vehicle may include a first camera 1160a, a second camera 1160b, and a third camera 1160c. The first camera 1160a may be provided at the rear of the vehicle (eg, above or below the rear license plate). The first camera 1160a may acquire a first image 1170a. In this case, the first image 1170a may be an image behind the vehicle. The second camera 1160b may be provided on the left side of the vehicle (eg, a left side mirror module). The second camera 1160b may acquire a second image 1170b. In this case, the second image 1170b may be an image behind the left side of the vehicle. The third camera 1160c may be provided on the right side of the vehicle (eg, a right side mirror module). The third camera 1160c may acquire a third image 1170c. In this case, the third image 1170c may be an image behind the right side of the vehicle.

The processor 180 may generate a synthesized image 1180 by receiving the first to third images 1170a, 1170b, and 1170c, and synthesizing the first to third images 1170a, 1170b, and 1170c. The processor 180 may control the projection unit 230 so that the composite image 1180 is displayed on the light blocking unit 240.

Meanwhile, a region overlapping each image acquired by the first to third cameras 1160a, 1160b, and 1160c may be generated. When generating the composite image 1180, it is necessary to process overlapping regions.

The processing of overlapping areas can be processed in the following manner. When generating the synthesized image 1180, the processor 180 synthesizes the first image 1170a and the second image 1170b based on the extension line 1162a (hereinafter, referred to as the first line) of the left body line of the vehicle. can do. Specifically, the processor 180 is based on the first line 1162a, the right side of the first line 1162a is based on the first image 1170a, the left side of the first line 1162a is the second image 1170b. ) Can be synthesized. Also, the processor 180 may synthesize the first image 1170a and the third image 1170c based on the extension line 1162b (hereinafter, referred to as the second line) of the right body line of the vehicle. Specifically, the processor 180 is based on the second line 1162b, the left side of the second line 1162b is based on the first image 1170a, and the right side of the second line 1162b is the third image ( 1170c) can be synthesized. In this way, by synthesizing the first to third images, an image of a wide field of view toward the rear of the vehicle may be provided to the occupant.

Meanwhile, the positions of the first to third cameras 1160a, 1160b, and 1160c are different from each other. Accordingly, a sense of distance may be generated in an image acquired from each camera. When generating the composite image 1180, a sense of distance correction is required.

Distance correction can be processed in the following way. When generating a synthesized image, the processor 180 may synthesize the first to third images by adjusting distances for the second and third images based on the position of the first camera. For example, the second and third cameras may not be disposed on the same plane as the first camera. The first camera may be provided above or below the vehicle rear license plate, the second camera may be provided in the left side mirror module, and the third camera may be provided in the right side mirror module. In this case, a point at which the second and third cameras acquire an image is different from a point at which the first camera acquires an image. Accordingly, a sense of distance occurs between the second and third images and the first image according to the distance between the second and third cameras and the first camera. The processor 180 may adjust the distance through scaling as if the first to third images were captured on the same plane.

11C shows an embodiment of a displayed image. When the vision module 121 includes at least one camera that acquires an image inside the vehicle, as shown in (a) of FIG. 11C, the processor 180 receives the image inside the vehicle and The projection unit 230 may be controlled so that the image 1150 is displayed on the light blocking unit 240. For example, when the camera acquires an image of a rear seat of the vehicle, the processor 180 may control the projection unit 230 so that the rear seat image is displayed on the light blocking unit 240. In this case, the light blocking unit 240 may perform a room mirror function.

The processor 180 may control the projection unit 230 to display vehicle information on the image display area. Here, the vehicle information may be information received from the vehicle sensor unit 760 through the interface unit 160. Alternatively, the vehicle information may be information received from the ECU 770 through the interface unit 160. Alternatively, the vehicle information may be information received from the mobile terminal 245 or the server 260 through the communication unit 110. Alternatively, the vehicle information may be information received through the input unit 120.

For example, the processor 180 may display the vehicle speed information 1151, traffic sign information, navigation information, fuel remaining amount information 1152, vehicle failure information, traffic information, etc. on the image display area. 230) can be controlled.

In particular, when displaying navigation information, the processor 180 may display vehicle driving direction information by at least one of an arrow, a left-handed arrow, a right-handed arrow, and a U-shaped arrow. That is, the processor 180 may display the TBT (Turn by Turn) format.

For example, when the vision module 121 includes at least one camera for obtaining an image in front of the vehicle, the processor 180 receives the image in front of the vehicle, and information based on the image in front of the vehicle is displayed in an image display area. It is possible to control the projection unit 230 to be displayed on. For example, the information based on the image in front of the vehicle may include a distance to an object in front, an estimated time to collision with an object in front (TTC: Time To Collision), detected obstacles or traffic signs, and extracted road surface information. I can.

Referring to FIG. 11D, the processor 180 may exchange data with the server 260 through the communication unit 110. In this case, the server 260 may be a home server. For example, an image captured from a camera installed at home may be transmitted to a home server. The processor 180 may receive the captured image 1153 through the communication unit 110 and control the projection unit 230 so that the captured image 1153 is displayed on an image display area.

12 is a diagram referenced for describing an operation of controlling an image display area through a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 12, in a state in which the mobile terminal 245 and the vehicle driving assistance device 100 are paired, the processor 180 receives a control signal from the mobile terminal 245 to control the projection unit 230. I can.

For example, in a state in which the mobile terminal 245 and the vehicle driving assistance device 100 are paired, when a pinch in input is received on the display unit of the mobile terminal 245, the processor 180 By controlling the projection unit 230 according to the pinch-in input, the size of the image display area 1210 displayed on the light blocking unit 240 may be reduced.

For example, in a state in which the mobile terminal 245 and the vehicle driving assistance device 100 are paired, when a pinch out input is received on the display unit of the mobile terminal 245, the processor 180 By controlling the projection unit 230 according to a pinch-out input, the size of the image display area 1210 displayed on the light blocking unit 240 may be increased.

For example, in a state in which the mobile terminal 245 and the vehicle driving assistance device 100 are paired, when a touch and drag input is received on the display unit of the mobile terminal 245, the processor 180 , By controlling the projection unit 230, the position of the image display area 1210 displayed on the light blocking unit 240 may be changed.

13 is a diagram referenced for describing an operation of outputting vehicle information as a voice according to an embodiment of the present invention.

Referring to FIG. 13, the processor 180 may output vehicle information as voice through the sound output unit 220.

For example, as shown, the processor 180 may output 1310 a state of the remaining fuel amount as a voice. If the amount of remaining fuel is insufficient, a voice 1310 may ask whether to search for a nearby gas station. In this case, the processor 180 may receive a voice command through the microphone 123.

Meanwhile, the processor 180 may provide a calendar function. Here, the calendar function may be provided through an application provided in the vehicle 10. Alternatively, the calendar function of the mobile terminal 245 may be provided through pairing. For example, as illustrated, when the processor 180 corresponds to a preset schedule, the processor 180 may output 1320 a preset schedule as a voice through the sound output unit 220. Also, the processor 180 may output navigation information corresponding to a preset schedule as a voice 1320.

14 is a diagram referenced to explain an operation of receiving a voice command according to an embodiment of the present invention.

Referring to FIG. 14, the processor 180 may receive a user voice command through the microphone 123. For example, as shown, the occupant may ask the reason for the road congestion in the road congestion section through the voice 1410. In this case, the processor 180 may receive information from the server 260 through the communication unit 110. Here, the server 260 may be a server that provides traffic information. The processor 180 may output the received information as a voice 1420 through the sound output unit 220. Alternatively, the processor 180 may display the received information on the light blocking unit 240 through the control of the projection unit 230.

15 is a diagram referenced for explaining an operation of controlling an image display area by detecting a passenger's gaze according to an embodiment of the present invention.

Referring to FIG. 15, a camera included in the vision module may photograph a passenger's gaze. For example, the camera can photograph the occupant's eyes. In this case, the processor 180 receives an image from the camera. The processor 180 extracts a pupil from the received image. The processor 180 tracks the extracted pupil.

If the pupil is located above the preset position, the processor 180 may activate the image display area 1510. That is, when the occupant's gaze is directed toward the front of the vehicle, the light blocking unit 240 serves only to block light from the outside. When the occupant's line of sight 1520 is directed to the light blocking unit 240, the processor 180 controls the projection unit 230, so that a difference in the image display area? Control, and the light blocking unit 240 may serve as a display means.

Meanwhile, the image described with reference to FIGS. 11A to 11D may be displayed in the image display area 1510.

16 is a diagram referenced for describing an operation of detecting a gesture of a passenger according to an embodiment of the present invention.

Referring to FIG. 16, when a call is received to the mobile terminal 245 in a state of being paired with the mobile terminal 245, the processor 180 may use the display unit 210 or the sound output unit 220. , Call reception information can be output.

In this case, when a passenger makes a preset gesture, the processor 180 receives the gesture input through the second camera 121b. When the gesture input is a gesture corresponding to a call reception operation, the processor 180 transmits a call reception command to the mobile terminal 245. Accordingly, the mobile terminal 245 can make a call. In this case, the processor 180 may receive a user voice through the microphone 123 and may output the received voice through the sound output unit 220.

17 is a diagram referenced for explaining an operation of displaying text message reception information and call reception information according to an embodiment of the present invention.

As shown in (a) of FIG. 17, when a text message is received from the mobile terminal 245 in a paired state with the mobile terminal 245, the processor 180 transmits a text message through the communication unit 110. Is received, the projection unit 230 is controlled and displayed on the light blocking unit 240. Specifically, the processor 180 displays a text message on the image display area 1710 included in the light blocking unit 240.

As shown in (b) of FIG. 17, when a call signal is received from the mobile terminal 245 in a state of being paired with the mobile terminal 245, the processor 180 is transmitted through the communication unit 110. , The call signal is received, the projection unit 230 is controlled, and displayed on the light blocking unit 240. Specifically, the processor 180 displays a call signal event on the image display area 1720 included in the light blocking unit 240.

The above-described present invention can be implemented as a computer-readable code on a medium on which a program is recorded. The computer-readable medium includes all types of recording devices storing data that can be read by a computer system. Examples of computer-readable media include HDD (Hard Disk Drive), SSD (Solid State Disk), SDD (Silicon Disk Drive), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is also a carrier wave (eg, transmission over the Internet). Further, the computer may include a processor 170 or an ECU 770. Therefore, the detailed description above should not be construed as restrictive in all respects and should be considered as illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

10: vehicle
100: vehicle driving assistance device
110: communication department
110: input unit
140: sensor unit
170: memory
180: processor
190: power supply
220: sound output unit
230: projection part
240: light blocking part

Claims (18)

A light blocking unit provided inside the vehicle and formed of a translucent material to block light flowing into the vehicle;
A projection unit for projecting a beam toward the light blocking unit;
A vision module including at least one camera detecting a driver's gaze, and obtaining an image around the vehicle or an image inside the vehicle; And
Controls the projection unit to receive image information from the vision module and provide it to the projection unit, and display an image to the light blocking unit through the beam based on the image information received from the vision module to provide vehicle-related information Including;
The processor,
A vehicle driving assistance device that adjusts an area to which the beam is projected based on the driver's gaze. The method of claim 1,
The light blocking unit includes; an area where an image is formed by receiving the beam,
A vehicle driving assistance device in which the size of the area is variable. The method of claim 1,
The light blocking unit is a vehicle driving assistance device formed of a transparent display capable of outputting an image. The method of claim 3,
Further comprising a; a light amount sensor for sensing the amount of light introduced into the vehicle interior,
The processor is a vehicle driving assistance device that adjusts the transparency of the transparent display based on the amount of light. The method of claim 1,
The vision module,
Including; at least one camera for obtaining a vehicle rear image,
The processor is a vehicle driving assistance device that controls the projection unit so that the rear image is displayed on the light blocking unit. The method of claim 5,
The at least one camera,
A first camera provided at the rear of the vehicle to obtain a rear image of the vehicle;
A second camera provided on the left side of the vehicle to obtain a left rear image of the vehicle; And
Includes; a third camera provided on the right side of the vehicle to obtain a right rear image of the vehicle,
The processor generates a composite image by synthesizing a first image received from the first camera, a second image received from the second camera, and a third image received from the third camera, and the light blocking unit A vehicle driving assistance device that controls the projection unit to display the synthesized image. The method of claim 6,
The processor, when viewed from above, is based on an extension line (hereinafter, referred to as the first line) of the left body line of the vehicle, the right side of the first line is based on the first image, and the left side of the first line is the second Composite based on the image,
When viewed from above, based on the extension line (hereinafter, referred to as the second line) of the right body line of the vehicle, the left side of the second line is based on the first image, and the right side of the second line is based on the third image Synthesizing vehicle driving aids. The method of claim 6,
The processor, based on the location of the first camera, adjusts distances for the second and third images, and synthesizes the first to third images. The method of claim 1,
The vision module,
Including; at least one camera provided inside the vehicle to obtain an image inside the vehicle,
The processor is a vehicle driving assistance device that controls the projection unit so that the vehicle interior image is displayed on the light blocking unit. The method of claim 1,
The vision module,
Includes; at least one camera for obtaining an image in front of the vehicle,
The processor is a vehicle driving assistance device that controls the projection unit so that information based on the front image is displayed on the light blocking unit. The method of claim 1,
The light blocking unit is a vehicle driving assistance device that is folded into a plurality of stages. The method of claim 11,
Further comprising a; user input unit for receiving a user input,
The processor,
A vehicle driving assistance device that adjusts an end of the light blocking unit according to the user input. The method of claim 12,
A solar sensor for sensing the position of the sun; further comprising,
The processor,
A vehicle driving assistance device that adjusts the stage of the light blocking unit based on the position of the sun. The method of claim 1,
The vehicle driving assistance device includes a first light blocking unit and a second light blocking unit larger than the first light blocking unit. The method of claim 1,
Further comprising; an interface unit for receiving vehicle attitude information,
The processor, in response to the attitude of the vehicle, corrects the output of the beam so that the image displayed on the light blocking unit does not shake. A vehicle comprising the vehicle driving assistance device according to any one of claims 1 to 15.


delete delete

Images