KR102480989B1 - Display apparatus for vehicle and operating method thereof - Google Patents

Abstract

A display device for a vehicle according to an embodiment of the present invention includes a camera that captures an image of the front of the vehicle, a first display unit that displays a graphic image on a windshield of the vehicle, and is installed inside the vehicle and includes a map screen or a navigation screen. A second display unit for displaying and detects a narrow road from the photographed image, determines whether or not driving in the narrow road is possible based on the width of the vehicle and the driver's narrow road driving data, and guides the narrow road based on the determination result. and a processor unit displaying through the first display unit.

Description

Vehicle display device and operation method thereof {DISPLAY APPARATUS FOR VEHICLE AND OPERATING METHOD THEREOF}

Embodiments according to the concept of the present invention relate to a vehicle display device provided in a vehicle, and more particularly, to a vehicle display device capable of providing a guide based on driving data such as a driver's driving skill level and an operating method thereof.

A vehicle is a device that allows a user to move in a desired direction. A typical example is a car.

According to the classification according to the prime mover used, automobiles include an internal combustion engine automobile, an external combustion engine automobile, a gas turbine automobile, or an electric vehicle.

An electric vehicle refers to a vehicle that uses electricity as energy to turn an electric motor, and includes pure electric vehicles, hybrid electric vehicles (HEV), plug-in hybrid electric vehicles (PHEV), and hydrogen fuel cell electric vehicles (FCEV).

On the other hand, recently, for the safety or convenience of drivers, pedestrians, etc., the development of intelligent vehicles (Smart Vehicles) is being actively pursued.

In particular, recently, a head-up display displaying a graphic image on a windshield of a vehicle has attracted attention in order to deliver necessary information while maintaining a driver's gaze forward.

Such a head-up display has the advantage of displaying a graphic image on a windshield of a vehicle to prevent a driver's driving line from being dispersed and displaying useful information to the driver while driving.

When information or guidance is provided through the head-up display, the provided information or guide may or may not be necessary according to the driver's driving ability or style. If unnecessary information or guidance is provided to the driver through the head-up display, it may rather interfere with the driver's driving. Therefore, there is a need to provide optimized information or guide according to the driver's driving ability or style.

A technical problem to be achieved by the present invention is to provide a vehicle display device capable of providing a guide related to narrow road driving based on driving data such as a driver's driving skill level, and an operating method thereof.

A display device for a vehicle according to an embodiment of the present invention includes a camera that captures an image of the front of the vehicle, a first display unit that displays a graphic image on a windshield of the vehicle, and is installed inside the vehicle and includes a map screen or a navigation screen. A second display unit for displaying and detects a narrow road from the photographed image, determines whether or not driving in the narrow road is possible based on the width of the vehicle and the driver's narrow road driving data, and guides the narrow road based on the determination result. and a processor unit displaying through the first display unit.

The processor unit may calculate a width of each of the at least one road included in the image, and as a result of the calculation, detect a road having a narrower width than a reference width as the narrow road.

According to an embodiment, when the width of the narrow road is narrower than that of the vehicle, the processor unit may display a first narrow road driving guide indicating that driving on the narrow road is impossible through the first display unit.

The processor unit may display a guidance guide for guiding a detour instead of the narrow path through the first display unit, and display the detour on the map screen or the navigation screen displayed on the second display unit.

The driver's narrow-road driving data includes driving proficiency determined based on the degree of reduction in speed of the vehicle when driving in a narrow-road and biometric information acquired from a wearable mobile terminal worn on a part of the driver's body when driving in a narrow-road The biometric information may include at least one of heart rate information obtained from a heart rate sensor of the mobile terminal and skin conduction obtained from an SKT sensor (skin temperature sensor) of the mobile terminal.

According to an embodiment, the processor unit, when the width of the narrow road is wider than the width of the vehicle, determines whether or not driving on the narrow road is possible based on the driving skill level, and as a result of the determination, if driving on the narrow road is impossible, the narrow road A first narrow-road driving guide indicating that driving on the narrow road is displayed through the first display unit, and when driving on the narrow road is possible as a result of the determination, a second narrow-road driving guide indicating that driving on the narrow road is possible may be displayed through the first display unit.

According to an embodiment, the processor unit displays a third narrow-road driving guide through the first display unit when, as a result of the determination, caution or alert is required when driving on the narrow-road, and a vehicle steering guide indicating steering of the vehicle is displayed on the first display unit. It can be displayed through the display unit.

When the vehicle travels on the narrow road, the processor unit displays information related to driving on the narrow road to the first display unit or the second display unit based on a plurality of narrow road driving data for other vehicles that have driven on the narrow road. can be displayed through

The processor unit detects the driver's line of sight direction using a driver status monitor (DSM) included in the vehicle, determines whether or not driving on the road existing in the sensed line of sight direction is possible, and as a result of the determination, driving on the road is determined. When it is impossible, an entry blocking guide for inducing the vehicle not to enter the road may be displayed through the first display unit.

A vehicle according to an embodiment of the present invention includes the vehicle display device.

According to an embodiment of the present invention, a method of operating a display device for a vehicle including a first display unit displaying a graphic image on a windshield of a vehicle, and a second display unit installed inside the vehicle and displaying a map screen or a navigation screen. Obtaining an image of the front of the vehicle from a camera included in the vehicle, detecting a narrow road from the obtained image, and determining whether driving in the narrow road is possible based on the width of the vehicle and the driver's narrow road driving data and displaying a narrow road driving guide based on the determination result through the first display unit.

The vehicle display device according to an embodiment of the present invention has an effect of providing a narrow-road driving guide optimized for the driver's driving skill level based on the narrow-road driving data reflecting the driver's driving skill level.

In addition, personalized narrow-road driving data may be generated using a change in a driving pattern, such as a degree of reduction in speed, and biometric information obtained from a wearable mobile terminal when driving in a narrow-road.

In addition, the display device for a vehicle according to an embodiment of the present invention can help the driver's driving by intuitively notifying the driver that there is a narrow road in which driving is impossible on the set route and automatically providing a detour.

1 shows the appearance of a vehicle including a display device for a vehicle according to an embodiment of the present invention.
2 shows a block diagram of a display device for a vehicle according to an embodiment of the present invention.
3 shows an example of a method for detecting a situation inside a vehicle according to an embodiment of the present invention.
4 shows a plane of a vehicle equipped with a display device for a vehicle according to an embodiment of the present invention.
5 shows an example of a camera according to an embodiment of the present invention.
6 and 7 are diagrams for explaining an example of a method of generating image information from an image of a camera according to an embodiment of the present invention.
8 is a diagram illustrating the interior of a vehicle including a display device for a vehicle according to an embodiment of the present invention.
9 is a flowchart for explaining a method of operating a display device for a vehicle according to an embodiment of the present invention.
10A to 10D are diagrams showing examples of screens displayed when the vehicle display device according to an embodiment of the present invention detects a narrow road in which driving is impossible.
11A and 11B are diagrams showing examples of screens that are displayed according to the detection result after the vehicle display device detects a narrow road in which driving is impossible based on map information, etc., according to an embodiment of the present invention.
12A and 12B are exemplary views of screens displayed when the vehicle display apparatus detects a driver's gaze direction and cannot drive in a narrow road located in the detected gaze direction according to an embodiment of the present invention.
13 is a flowchart illustrating an operation of generating and recording driver's narrow-road driving data by the vehicle display apparatus according to an embodiment of the present invention.
14A and 14B are diagrams showing examples of narrow-road driving guide screens in which the vehicle display apparatus according to an embodiment of the present invention determines whether narrow-road driving is possible based on the driver's narrow-road driving data and displays the result of the determination.
FIG. 15 is a flowchart illustrating an operation of providing a steering guide or an alarm based on driving data of a driver when the vehicle deviates from a lane or tilts to a lane by the vehicle display device according to an embodiment of the present invention.
16A and 16B are exemplary diagrams of a steering guide and an alarm according to the embodiment shown in FIG. 15 .
17 is an example of an internal block diagram of the vehicle of FIG. 1 including the aforementioned vehicle display device.

Hereinafter, the embodiments disclosed in this specification will be described in detail with reference to the accompanying drawings, but the same or similar elements are given the same reference numerals regardless of reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "unit" for components used in the following description are given or used together in consideration of ease of writing the specification, and do not have meanings or roles that are distinct from each other by themselves. In addition, in describing the embodiments disclosed in this specification, if it is determined that a detailed description of a related known technology may obscure the gist of the embodiment disclosed in this specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in this specification, the technical idea disclosed in this specification is not limited by the accompanying drawings, and all changes included in the spirit and technical scope of the present invention , it should be understood to include equivalents or substitutes.

Terms including ordinal numbers, such as first and second, may be used to describe various components, but the components are not limited by the terms. These terms are only used for the purpose of distinguishing one component from another.

It is understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, but other elements may exist in the middle. It should be. On the other hand, when an element is referred to as “directly connected” or “directly connected” to another element, it should be understood that no other element exists in the middle.

Singular expressions include plural expressions unless the context clearly dictates otherwise.

In this application, terms such as "comprise" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

A vehicle described in this specification may be a concept including a car and a motorcycle. Hereinafter, vehicles will be mainly described with respect to vehicles.

The vehicle described in this specification may be a concept including all of an internal combustion engine vehicle having an engine as a power source, a hybrid vehicle having an engine and an electric motor as a power source, an electric vehicle having an electric motor as a power source, and the like.

In the following description, the left side of the vehicle means the left side of the driving direction of the vehicle, and the right side of the vehicle means the right side of the driving direction of the vehicle.

In the following description, unless otherwise noted, a left hand drive (LHD) vehicle will be mainly described.

Further, in the following description, the vehicle display device is a separate device provided in the vehicle, and is described as exchanging necessary information with the vehicle through data communication and executing vehicle driving assistance functions. However, a set of some of vehicle units may be defined as a vehicle display device.

When the vehicle display device is a separate device, at least some of the units (see FIG. 2 ) of the vehicle display device are not included in the vehicle display device and may be units of the vehicle or other devices mounted on the vehicle. In addition, it can be understood that these external units are included in the vehicle display device by transmitting and receiving data through the interface unit of the vehicle display device.

For convenience of explanation, the display device for a vehicle according to the embodiment will be described as directly including each unit shown in FIG. 2 .

Hereinafter, a vehicle display device according to an embodiment will be described in detail with reference to the drawings.

1 shows the appearance of a vehicle including a display device for a vehicle according to an embodiment of the present invention.

Referring to FIG. 1 , a vehicle 700 according to an embodiment may include wheels 13FL and 13RL rotating by a power source and a display device 100 for a vehicle.

The vehicle display apparatus 100 may detect a situation around the vehicle, detect an object to be observed by the driver in the surrounding situation, and then display a graphic image on the windshield according to the location of the object and the driver's field of view. That is, the vehicle display device 100 detects objects around the vehicle, determines a display method of a graphic image on the windshield according to information on the object around the vehicle, and provides a graphic image suitable for the situation around the vehicle to the driver. can

Here, the graphic image display method may include at least one of a location where the graphic image is displayed on the windshield, transparency, saturation, color, size, and amount of information displayed by the graphic image.

For example, the display device 100 for a vehicle sets a display area so that an object viewed through a windshield and a graphic image do not overlap, and displays a graphic image according to the size of the display area so as not to obstruct the driver's view. Able to communicate the necessary information effectively.

Referring to FIGS. 2 to 8 , the vehicle display device 100 according to the embodiment will be described in detail.

2 shows a block diagram of a display device for a vehicle according to an embodiment of the present invention.

Referring to FIG. 2 , the vehicle display device 100 includes an input unit 110, a communication unit 120, an interface unit 130, a memory 140, a monitoring unit 150, a sensor unit, a processor unit 170, It may include a display unit 180, an audio output unit 185, and a power supply unit 190. However, the units of the vehicle display device 100 shown in FIG. 2 are not essential to implement the vehicle display device 100, so the vehicle display device 100 described in this specification is more than the components listed above. It may have many or few components.

The vehicle display device 100 may include an input unit 110 that senses a user's input.

For example, the user inputs settings for the windshield graphic image display function of the driving assistance device through the input unit 110, or executes input for turning on/off the power of the vehicle display device 100. etc.

The input unit 110 includes a gesture input unit that detects a user gesture (eg, an optical sensor) and a touch input unit that detects a touch (eg, a touch sensor, a touch key, or a touch input unit). A user input may be sensed by including at least one of a mechanical key, etc.) and a microphone that detects a voice input.

Next, the vehicle display device 100 may include a communication unit 120 communicating with other vehicles 520 , the terminal 600 , and the server 510 .

The vehicle display device 100 may receive communication information including at least one of navigation information, other vehicle driving information, and traffic information through the communication unit 120 . Among them, necessary information may be displayed on the vehicle display device 100 according to circumstances.

In addition, the communication unit 120 transmits at least one piece of information from the mobile terminal 600 or/and the server 510 among location information, weather information, and road traffic condition information (eg, Transport Protocol Expert Group (TPEG)). can receive more.

Also, the communication unit 120 may receive traffic information from the server 510 equipped with an intelligent traffic system (ITS). Here, the traffic information may include traffic light information, lane information, and the like.

Also, the communication unit 120 may receive navigation information from the server 510 or/and the mobile terminal 600 . Here, the navigation information may include at least one or more of map information related to vehicle driving, lane information, vehicle location information, set destination information, and route information according to the destination.

Also, the communication unit 120 may receive the real-time location of the vehicle 700 as navigation information. For example, the communication unit 120 may obtain the location of the vehicle by including a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module.

Also, the communication unit 120 may receive driving information of the other vehicle 520 from the other vehicle 520, transmit driving information of the vehicle 700, and share driving information between vehicles. Here, the mutually shared driving information may include at least one of direction information, location information, vehicle speed information, acceleration information, movement path information, forward/reverse information, adjacent vehicle information, and turn signal information.

Also, when the user gets on the vehicle 700, the user's mobile terminal 600 and the vehicle display device 100 may perform pairing with each other automatically or by the user's execution of an application.

The communication unit 120 may exchange data with another vehicle 520, the mobile terminal 600, or the server 510 in a wireless manner.

In detail, the communication unit may perform wireless communication using a wireless data communication method. As a wireless data communication method, technical standards or communication methods for mobile communication (eg, GSM (Global System for Mobile communication), CDMA (Code Division Multi Access), CDMA2000 (Code Division Multi Access 2000), EV-DO (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA (Wideband CDMA), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc.) can be used.

In addition, the communication unit 120 may use wireless Internet technology, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), Wireless Broadband (WiBro), World Interoperability for Microwave Access (WiMAX), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution (LTE-A) Term Evolution-Advanced) and the like can be used.

In addition, the communication unit 120 may use short range communication, for example, Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), and Ultra Wideband (UWB). ), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and wireless USB (Wireless Universal Serial Bus) technology.

In addition, the vehicle display device 100 is paired with the mobile terminal 600 inside the vehicle using a short-range communication method, and uses a long-distance wireless communication module of the mobile terminal 600 to communicate with another vehicle 520 or a server. (510) and the like can also exchange data wirelessly.

Next, the vehicle display device 100 may include an interface unit 130 that receives vehicle data or transmits signals processed or generated by the processor unit 170 to the outside.

In detail, the vehicle display device 100 may receive at least one of navigation information and sensor information through the interface unit 130 . Among them, necessary information may be displayed on the vehicle display device 100 according to circumstances.

In addition, the vehicle display device 100 may transmit a control signal for executing a windshield graphic image display function or information generated by the vehicle display device 100 through the interface unit 130 .

To this end, the interface unit 130 may perform data communication with at least one of the controller 770 inside the vehicle, the AVN (Audio Video Navigation) device 400, and the sensing unit 760 by wired or wireless communication. can

In detail, the interface unit 130 may receive navigation information through data communication with the controller 770, the AVN device 400, or/and a separate navigation device.

Also, the interface unit 130 may receive sensor information from the control unit 770 or the sensing unit 760 .

Here, the sensor information includes direction information, location information, vehicle speed information, acceleration information, tilt information, forward/backward information, fuel information, distance information from the front and rear vehicles, distance information between the vehicle and the lane, and turn signals of the vehicle 700 . It may include at least one or more pieces of information.

In addition, the sensor information includes a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward/backward sensor, a wheel sensor, a vehicle speed sensor, It may be obtained from a vehicle body tilt detection sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor by steering wheel rotation, a vehicle internal temperature sensor, a vehicle internal humidity sensor, a door sensor, and the like. Meanwhile, the position module may include a GPS module for receiving GPS information.

Also, the interface unit 130 may receive a user input received through the user input unit 110 of the vehicle 700 . The interface unit 130 may receive user input from an input unit of the vehicle 700 or via the control unit 770 . That is, when the input unit is disposed within the vehicle itself, a user input may be received through the interface unit 130 .

Also, the interface unit 130 may receive traffic information obtained from the server 510 . The server 510 may be a server located in a traffic control center that controls traffic. For example, when traffic information is received from the server 510 through the communication unit 120 of the vehicle 700, the interface unit 130 may receive the traffic information from the control unit 770.

Next, the memory 140 may store various data for overall operation of the vehicle display device 100, such as a program for processing or controlling the processor unit 170.

In detail, the memory 140 may store a plurality of application programs (application programs or applications) driven in the vehicle display device 100, data for operation of the vehicle display device 100, and commands. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs may exist on the vehicle display device 100 from the time of shipment for basic functions (eg, a windshield graphic image display function) of the vehicle display device 100 .

Also, these application programs may be stored in the memory 140 and driven by the processor unit 170 to perform an operation (or function) of the vehicle display device 100 .

Meanwhile, the memory 140 may store data for identifying an object included in an image. For example, the memory 140 may store data for confirming what the object corresponds to by a predetermined algorithm when a predetermined object is detected in an image around the vehicle acquired through the camera 160. .

For example, if a predetermined object such as a lane, a traffic sign, a two-wheeled vehicle, or a pedestrian is included in an image acquired through the camera 160, the memory 140 determines what the object corresponds to by a predetermined algorithm. data to be stored.

According to an embodiment, the memory 140 may store data for calculating a width of each of at least one road based on an image acquired through the camera 160 .

The memory 140 is a hardware type, a flash memory type, a hard disk type, a solid state disk type (SSD type), a silicon disk drive type (SDD type), and a multimedia card micro type. (multimedia card micro type), card-type memory (eg SD or XD memory, etc.), RAM (random access memory; RAM), SRAM (static random access memory), ROM (read-only memory; ROM), EEPROM It may include at least one type of storage medium among electrically erasable programmable read-only memory (PROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk.

In addition, the vehicle display device 100 may be operated in relation to a web storage performing a storage function of the memory 140 on the Internet.

Next, the monitoring unit 150 may obtain the user's biometric information.

In particular, the monitoring unit 150 may detect the driver's gaze and obtain monitoring information. Also, the acquired driver's gaze information may be used when displaying a graphic image. For example, the vehicle display apparatus 100 may determine a viewing area observed by the driver through the windshield according to the driver's line of sight and obtain a camera image corresponding to the viewing area. Then, the vehicle display device 100 may set a display area in the acquired image, display a graphic image on the display area, and display the graphic image on the windshield to match the driver's field of view.

In detail, the monitoring unit 150 may obtain an image for biometric recognition of the user. That is, the monitoring unit 150 may include an image acquisition module disposed inside the vehicle.

For example, referring to FIG. 3 , the monitoring unit 150 includes a monitoring camera that captures an image inside the vehicle, photographs the driver inside the vehicle, detects the direction of the driver's gaze, and performs facial recognition. Information can be obtained as monitoring information.

In addition, the biometric information detected by the monitoring unit 150 includes image information of the user, fingerprint recognition information, iris-scan information, retina-scan information, and hand shape. It may further include at least one or more of (hand geo-metry) information and voice recognition information.

Next, the vehicle display device 100 may further include a sensor unit that senses objects around the vehicle 700 . The vehicle display device 100 may include a separate sensor unit to detect surrounding objects, and may receive sensor information obtained from the sensing unit 770 of the vehicle 700 through the interface unit 130 .

In particular, the sensor unit may include a distance sensor that detects the position of an object and a camera 160 that acquires an image by photographing the surroundings of the vehicle.

The distance sensor can precisely detect the direction and distance of the object from the vehicle 700 and the moving direction of the object. Also, the distance sensor may continuously measure a positional relationship with the sensed object and accurately detect a change in the positional relationship. Such a distance sensor may include various distance measurement sensors such as a lidar sensor, a laser sensor, an ultrasonic waves sensor, and a stereo camera.

For example, the distance sensor is a laser sensor, and uses a time-of-flight (TOF) method or/and a phase-shift method according to a laser signal modulation method to detect the distance between the vehicle 700 and the object. The positional relationship between them can be measured. In detail, the time delay method may measure the separation distance and the separation direction from the object by emitting a pulse laser signal and measuring the time at which pulse signals reflected from objects within the measurement range arrive at the receiver.

The vehicle display device 100 may include a camera 160 that obtains an image around the vehicle. In addition, the processor unit 170 may generate image information by detecting an object around the vehicle and detecting a property of the object from the obtained image around the vehicle.

Here, the image information is information of at least one of the type of object, signal information displayed by the object, the distance between the object and the vehicle, and the location of the object, and may be included in the sensor information.

In detail, the processor unit 170 generates image information by performing object analysis such as detecting an object in a captured image through image processing, tracking the object, measuring a distance to the object, and identifying the object. can do.

Such a camera 160 may be provided in various locations.

In detail, referring to FIG. 4 , the camera 160 may include an internal camera 160f that captures a front image of the vehicle 700 from inside the vehicle.

In addition, the plurality of cameras 160 may be disposed on at least one of the left side, rear side, right side, front side, and ceiling of the vehicle 700, respectively.

The left camera 160b may be disposed in a case surrounding a left side mirror. Alternatively, the left camera 160b may be disposed outside the case surrounding the left side mirror. Alternatively, the left camera 160b may be disposed in an area outside the left front door, the left rear door, or the left fender.

The right camera 160c may be disposed in a case surrounding a right side mirror. Alternatively, the right camera 160c may be disposed outside the case surrounding the right side mirror. Alternatively, the right camera 160c may be disposed in an area outside a right front door, a right rear door, or a right fendere.

Also, the rear camera 160d may be disposed near a rear license plate or a trunk switch. The front camera 160a may be disposed near the emblem or near the radiator grill.

The processor unit 170 may provide an around view image of the vehicle 700 from a top view by synthesizing images captured from all directions. When creating an around-view image, a boundary between each image area is generated. Such a boundary portion may be naturally displayed by image blending.

In addition, the ceiling camera 160e may be disposed on the ceiling of the vehicle 700 to take pictures of the front, rear, left and right sides of the vehicle 700.

The camera 160 may directly include an image sensor and an image processing module. The camera 160 may process still images or moving images obtained by an image sensor (eg, CMOS or CCD). Also, the image processing module may process a still image or a moving image obtained through an image sensor, extract necessary image information, and transmit the extracted image information to the processor unit 170 .

In order for the processor unit 170 to perform object analysis more easily, the camera 160 may be a stereo camera that measures a distance to the object while capturing an image.

That is, in the embodiment, the sensor unit may simultaneously include the distance sensor and the camera 160 as a stereo camera. That is, the stereo camera can simultaneously acquire images and detect a positional relationship with an object.

Hereinafter, with reference to FIGS. 5 to 7 , a method for the processor unit 170 to detect image information using a stereo camera will be described in more detail.

First, referring to FIG. 5 , the stereo camera 160 may include a first camera 160a having a first lens 163a and a second camera 160b having a second lens 163b. .

Meanwhile, the vehicle driving assistance device includes a first light shield 162a and a second light shield 162a for shielding light incident on the first lens 163a and the second lens 163b, respectively. (162b) may be further provided.

The vehicle driving assistance device acquires a stereo image of the surroundings of the vehicle from the first and second cameras 160a and 160b, performs disparity detection based on the stereo image, and based on the disparity information Thus, object detection may be performed on at least one stereo image, and motion of the object may be continuously tracked after object detection.

Referring to FIG. 6 , as an example of an internal block diagram of the processor unit 170, the processor unit 170 in the vehicle display device 100 includes an image preprocessor 410, a disparity calculator 420, and an object detector ( 434), an object tracking unit 440, and an application unit 450. In FIG. 5 and the following description, the image is processed in the order of the image pre-processing unit 410, the disparity calculation unit 420, the object detection unit 434, the object tracking unit 440, and the application unit 450, but accordingly Not limited.

The image preprocessor 410 may receive an image from the camera 160 and perform preprocessing.

Specifically, the image pre-processing unit 410 performs noise reduction, rectification, calibration, color enhancement, and color space conversion (CSC) on the image. ), interpolation, camera 160 gain control, and the like can be performed. Accordingly, a clearer image than a stereo image photographed by the camera 160 may be obtained.

The disparity calculator 420 receives the image signal-processed by the image pre-processor 410, performs stereo matching on the received images, and generates a display according to the stereo matching. A parity map may be obtained. That is, disparity information of a stereo image of a front of the vehicle may be obtained.

In this case, stereo matching may be performed in units of pixels or blocks of stereo images. On the other hand, the disparity map may refer to a stereo image, that is, a map representing binocular parallax information of left and right images numerically.

The segmentation unit 432 may perform segmentation and clustering on at least one of the images based on the disparity information from the disparity operation unit 420 .

Specifically, the segmentation unit 432 may separate a background and a foreground of at least one of the stereo images based on the disparity information.

For example, a region in which disparity information is less than a predetermined value in the disparity map may be calculated as a background and the corresponding region may be excluded. Accordingly, the foreground can be relatively separated. As another example, a region having disparity information greater than or equal to a predetermined value in the disparity map may be calculated as a foreground and the corresponding portion may be extracted. In this way, the foreground can be separated.

In this way, by separating the foreground and the background based on the disparity information extracted based on the stereo image, it is possible to reduce the signal processing speed and the amount of signal processing when detecting an object later.

Next, the object detector 434 may detect an object based on the image segment from the segmentation unit 432 .

That is, the object detector 434 may detect an object in at least one of the images based on the disparity information.

Specifically, the object detector 434 may detect an object in at least one of the images. For example, an object may be detected from a foreground separated by an image segment.

Next, the object verification unit 436 can classify and verify the separated object.

To this end, the object identification unit 436 uses an identification method using a neural network, a Support Vector Machine (SVM) method, an AdaBoost method using Haar-like features, or a Histograms of Oriented Gradients (HOG) method. techniques can be used.

Meanwhile, the object identification unit 436 may compare objects stored in the memory 140 with the detected object to identify the object.

For example, the object identification unit 436 may identify surrounding vehicles, lanes, road surfaces, signs, dangerous areas, tunnels, and the like, located around the vehicle.

The object tracking unit 440 may perform tracking on the identified object. For example, sequentially identifying an object in acquired stereo images, calculating a motion or motion vector of the identified object, and tracking the movement of the object based on the calculated motion or motion vector. can Accordingly, it is possible to track surrounding vehicles, lanes, road surfaces, signs, dangerous areas, tunnels, and the like located around the vehicle.

Next, the application unit 450 may calculate the degree of danger of the vehicle based on various objects located around the vehicle, such as other vehicles, lanes, road surfaces, and signs. In addition, it is possible to calculate the possibility of a collision with the vehicle in front and whether or not the vehicle is slipping.

In addition, the application unit 450 may output, as vehicle driving assistance information, a message for informing the user of such information based on the calculated degree of risk, possibility of collision, slip or not, and the like. Alternatively, a control signal for posture control or driving control of the vehicle may be generated as vehicle control information.

Meanwhile, the image pre-processing unit 410, the disparity calculation unit 420, the segmentation unit 432, the object detection unit 434, the object confirmation unit 436, the object tracking unit 440, and the application unit 450 are processors may be included in section 170 .

Meanwhile, according to an embodiment, the processor unit 170 includes an image pre-processing unit 410, a disparity calculation unit 420, a segmentation unit 432, an object detection unit 434, an object identification unit 436, and an object tracking unit. 440 and some of the application unit 450 may be included. For example, when the camera 160 is configured as a mono camera 160 or an around view camera 160, the disparity calculation unit 420 may be excluded. Also, according to embodiments, the segmentation unit 432 may be excluded.

Referring to FIG. 7 , during the first frame period, the camera 160 may obtain a stereo image.

The disparity calculation unit 420 in the processor unit 170 receives the stereo images FR1a and FR1b signal-processed by the image pre-processing unit 410, and performs stereo matching on the received stereo images FR1a and FR1b. By performing this, a disparity map 520 is obtained.

The disparity map 520 is obtained by leveling the disparity between the stereo images FR1a and FR1b. The larger the disparity level, the closer the distance to the vehicle is, and the smaller the disparity level, the closer the distance to the vehicle is. The distance of can be calculated as long.

Meanwhile, when such a disparity map is displayed, the higher the disparity level, the higher the luminance, and the smaller the disparity level, the lower the luminance.

In the drawing, in the disparity map 520, the first to fourth lanes 528a, 528b, 528c, 528d, etc. have corresponding disparity levels, respectively, and the construction area 522 and the first vehicle ahead 524 ), the second front vehicle 526 each has a corresponding disparity level.

The segmentation unit 432, the object detection unit 434, and the object confirmation unit 436, based on the disparity map 520, for at least one of the stereo images FR1a and FR1b, segment, object detection, and Perform object verification.

In the figure, object detection and confirmation are performed on the second stereo image FR1b using the disparity map 520 .

That is, in the image 530, the first to fourth lanes 538a, 538b, 538c, and 538d, the construction area 532, the first vehicle in front 534, and the second vehicle in front 536 detect an object. and verification may be performed.

Through such image processing, the vehicle display device 100 may obtain object information such as the location, size, type, and movement direction of objects around the vehicle. In detail, the vehicle display apparatus 100 may process an image corresponding to a situation in which a driver looks through a windshield, obtain object information in the image, and determine a method of displaying a graphic image from the driver's point of view. That is, the vehicle display device 100 may display a graphic image on the windshield through the object information through the above process, and provide augmented reality to the driver through a combination of the object and the graphic image.

Next, the vehicle display device 100 may further include a display unit 180 that displays a graphic image to assist vehicle driving.

The display unit 180 may include a plurality of displays.

In detail, referring to FIG. 8 , the display unit may include a first display unit 180a that projects and displays a graphic image I on a windshield (W) of a vehicle. That is, the first display unit 180a is a Head Up Display (HUD) and may include a projection module that projects the graphic image I onto the windshield W. Also, the graphic image I projected by the projection module may have certain transparency. Accordingly, the user may simultaneously view the back of the graphic image I and the graphic image I.

Also, such a graphic image I may form augmented reality (AR) together with an object projected on the windshield W.

Meanwhile, the display unit may include a second display unit 180b that is separately installed inside the vehicle and displays an image of a vehicle driving assistance function.

In detail, the second display unit 180b may be a display of a vehicle navigation device or a cluster on the front side of the vehicle.

In addition, the second display unit 180b includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), At least one of a flexible display, a 3D display, and an e-ink display may be included.

The second display unit 180b may be combined with the gesture input unit to form a touch screen.

An image in front of the vehicle is displayed on the second display unit 180b, and a graphic image I for assisting vehicle driving is further displayed along with the front image, so that augmented reality may be implemented.

Hereinafter, the description will focus on the first display unit 180a, but the front image of the vehicle is displayed on the second display unit 180b, and a graphic image I for assisting vehicle driving is displayed along with the front image. In some cases, the description of the first display unit 180a may also be applied to the second display unit 180b.

In addition, the vehicle display device 100 may further include an audio output unit 185 and a power supply unit 190 .

In detail, the audio output unit 185 may output an audio message confirming a description of the function of the vehicle display device 100 and whether or not it is executed. That is, the vehicle display device 100 may complement descriptions of functions of the vehicle display device 100 through visual display through the display unit 180 and audio output through the audio output unit 185 .

In addition, the power supply unit 190 may receive external power and internal power under the control of the processor unit 170 to supply power necessary for the operation of each component.

Finally, the vehicle display device 100 may include a processor unit 170 that controls overall operations of each unit in the vehicle display device 100 .

In addition, the processor unit 170 may control at least some of the components discussed in conjunction with FIG. 3 in order to drive an application program. Furthermore, the processor unit 170 may combine and operate at least two or more of the components included in the vehicle display device 100 to drive the application program.

In terms of hardware, the processor unit 170 includes application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and processors. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions.

Also, the processor unit 170 may be controlled by the control unit 770 or control various functions of the vehicle 700 through the control unit 770 .

Also, the processor unit 170 controls general operations of the vehicle display device 100 in addition to operations related to application programs stored in the memory 140 . The processor unit 170 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the components described above or by driving an application program stored in the memory 140. .

In detail, the processor unit 170 may determine a graphic image display method to correspond to the detected information of objects around the vehicle, and control the display unit to display the graphic image according to the determined graphic image display method. Here, what is determined in the graphic image display method may be at least one of a location where the graphic image is displayed on the windshield, a graphic image size, transparency, saturation, color, and information displayed by the graphic image.

That is, the processor unit 170 may display a graphic image to correspond to information of objects around the vehicle, thereby improving graphic image identification and preventing driver's gaze from being diverted.

In particular, the processor unit 170 may calculate the width of each of the at least one road included in the image obtained from the camera 160, and determine whether or not to enter the road based on the calculation result. Various embodiments related to this will be described in more detail with reference to FIGS. 9 to 14B below.

9 is a flowchart for explaining a method of operating a display device for a vehicle according to an embodiment of the present invention.

Referring to FIG. 9 , the vehicle display device 100 may acquire a video (image) of the front of the vehicle 700 through the camera 160 (S100). The obtained image may include a road on which the vehicle 700 is currently driving and at least one road existing in front of the vehicle 700 . The front of the vehicle 700 may mean an area within a predetermined angular range based on the traveling direction of the vehicle 700 . That is, the camera 160 may capture an image including a predetermined angular range based on the traveling direction of the vehicle 700 .

The vehicle display device 100 may detect a narrow passage from the acquired image and calculate a width of the detected narrow passage (S110).

Specifically, the processor unit 170 may detect (or extract) a road on which the vehicle 700 is currently driving and at least one road existing in front of the vehicle 700 from the obtained image. After detecting the roads, the processor unit 170 may calculate the width of each of the detected roads. Since the distances between each of the detected roads and the vehicle 700 are different, the acquired image may include distance information for calculating the width of each of the detected roads. In addition, data (algorithm, etc.) necessary for the processor unit 170 to calculate the width of each of the sensed roads may be stored in the memory 140 .

The processor unit 170 may detect whether each of the at least one road existing in front of the vehicle 700 corresponds to a narrow road, based on a result of calculating the width of each of the detected roads. Here, the narrow road may mean a road whose width is narrower than a predetermined reference width.

The vehicle display device 100 may determine whether the vehicle 700 is capable of driving in a narrow road based on the calculated width of the narrow road and the width of the vehicle 700 (S120). That is, the processor unit 170 may compare the width of the narrow road calculated in step S110 with the width of the vehicle 700 pre-stored in the memory 140 to determine whether driving in the narrow road is possible.

As a result of the determination, if the width of the narrow road is narrower than the width of the vehicle (NO in S130), the vehicle display device 100 may display a first narrow road driving guide indicating that the vehicle 700 cannot drive in the narrow road. (S140).

Hereinafter, examples related to steps S100 to S140 will be described with reference to FIGS. 10A to 12B.

10A to 10D are diagrams showing examples of screens displayed when the vehicle display device according to an embodiment of the present invention detects a narrow road in which driving is impossible.

Referring to FIG. 10A , the camera 160 may capture an image I1 of the front of the vehicle 700 . For example, when an intersection (intersection) exists in front of the vehicle 700, the image I1 may include four roads based on the intersection. The four roads include a first road on which the vehicle 700 is currently driving, a second road on which the vehicle 700 can travel by going straight at an intersection, and a third road on which the vehicle 700 can travel by making a left turn at an intersection. It may be a road and a fourth road on which the vehicle 700 may drive by turning right at an intersection.

The processor unit 170 of the vehicle display device 100 acquires the image I1 photographed by the camera 160, and the width of each of the first to fourth roads included in the obtained image I1 ( W1 to W4) can be calculated. The image I1 may include distance-related data (eg, a depth map, depth data, etc.) in order to correct a distance difference between the camera 160 and each of the roads. there is. Also, the memory 140 of the vehicle display device 100 may store algorithms or data for calculating the widths W1 to W4 of each of the first to fourth roads.

The processor unit 170 may determine whether each of the second to fourth roads corresponds to a narrow road based on a result of calculating the widths W1 to W4 of each of the roads. For example, the processor unit 170 may determine a narrow road based on whether the calculated width is narrower than a preset reference width. In this case, the width W1 of the first road on which the vehicle 700 is currently driving is calculated. It may not be.

In the case of the embodiments of FIGS. 10A to 10D , it will be assumed that the width W2 of the second road is narrower than the reference width. In this case, the processor unit 170 may determine that the second road is narrow.

According to an embodiment, the processor unit 170 compares the width W1 of the first road on which the vehicle 700 is currently driving with the widths W2 to W4 of other roads, and as a result of the comparison, the width of the first road ( A road having a narrower width than W1) may be determined as a narrow road. That is, a method for determining the narrowness by the processor unit 170 may be implemented in various ways according to embodiments.

In addition, although not shown, when another vehicle is parked or stopped on the road, or another obstacle exists, the processor unit 170 calculates the width of the road reduced by the other vehicle or obstacle, and calculates the width of the road according to the calculation result. Based on this, a narrow path may be determined.

The processor unit 170 may compare the width W2 of the second road determined to be narrow and the width of the vehicle 700, and determine whether the vehicle 700 can drive on the second road based on the comparison result. there is.

Referring to FIG. 10B , as a result of the comparison, when the width W2 of the second road is narrower than the width of the vehicle 700, the processor unit 170 drives on the first narrow road in graphic form, which means that driving on the second road is impossible. The guide 1001 may be displayed on the first display unit 180a. A position where the first narrow road driving guide 1001 is displayed on the first display unit 180a may be a point corresponding to a straight line connecting the driver's eyes and the second road. Accordingly, the driver can see that the first narrow road driving guide 1001 is displayed on the second road, and accordingly can know that driving on the second road is impossible.

Referring to FIG. 10C , the processor unit 170 may display, in addition to the first narrow road driving guide 1001, a guidance guide 1002 for guiding the driver to drive on another road instead of an impossible road.

Also, referring to FIGS. 10C and 10D , the guidance guide 1002 may be displayed based on map information or navigation information received from the AVN device 400 or server 510 . That is, the processor unit 170 may display on the first display unit 180a the guidance guide 1002 for guiding a detour instead of a narrow road (second road) in which driving is impossible. Depending on the embodiment, the processor unit 170 may display the detour 1003 on the map screen (or navigation screen) displayed on the second display unit 180b.

Depending on the embodiment, the processor unit 170 may determine whether driving is possible only on a road corresponding to a movement route of the vehicle 700 in conjunction with the AVN device 400 or a separate navigation device (not shown). . That is, in the case of FIGS. 10A to 10D , the processor unit 170 may determine whether driving is possible only on the second road corresponding to the movement path of the vehicle 700 . When driving is impossible as a result of the determination, the processor unit 170 may determine whether driving on the remaining roads (third road and/or fourth road) is possible.

According to the embodiments shown in FIGS. 10A to 10D , the vehicle display device 100 can intuitively notify a driver when a narrow road in which driving is impossible exists on a set route, and automatically determine a detour based on map information or navigation information. It is possible to provide effective information that is helpful to the driver's driving.

11A and 11B are diagrams showing examples of screens that are displayed according to the detection result after the vehicle display device detects a narrow road in which driving is impossible based on map information, etc., according to an embodiment of the present invention.

Referring to FIGS. 11A and 11B , the processor unit 170 determines a narrow path based on map information or navigation information obtained from the server 510 or the AVN device 400 as well as an image acquired from the camera 160. can also detect

In particular, as shown in FIG. 11A, the entrance width W2 of a specific road is such that the vehicle 700 can drive, but when there is a section having a width W5 that cannot be driven in the specific road, the camera ( 160), the non-driving section may not be detected by the obtained image.

Accordingly, the processor unit 170 may detect the narrow road by obtaining information of the narrow road having the non-drivable section included in map information or navigation information provided from the server 510 or the AVN device 400.

Based on the detection result, the processor unit 170 displays the first narrow road driving guide 1001 on the navigation screen or map screen of the second display unit 180b as shown in FIG. 11A, or as shown in FIG. 11B. As described above, the first narrow-path travel guide 1001 may be displayed on the first display unit 180a. Depending on the embodiment, the processor unit 170 may inform the driver that the road on which the first narrow road driving guide 1001 is displayed includes a section in which driving is impossible by displaying a message or graphic.

12A and 12B are exemplary views of screens displayed when the vehicle display apparatus detects a driver's gaze direction according to an embodiment of the present invention and cannot drive in a narrow road located in the detected gaze direction.

Referring to FIG. 12A , the processor unit 170 detects the driver D's gaze direction 1010 using a DSM (driver status monitor; not shown) included in the vehicle 700, and detects the detected gaze direction ( 1010), it is possible to determine whether it is possible to drive on the existing road.

For example, when the driver D looks at the road to enter the road that exists on the front right side of the vehicle 700, the processor unit 170 determines the gaze direction 1010 detected using the DSM and the camera 160 ), it is possible to determine whether a road exists in the driver D's gaze direction 1010 based on the acquired image.

As a result of the determination, if a road exists, the processor unit 170 may calculate the width of the corresponding road. Since the method for calculating the width of the road by the processor unit 170 has been described above, a description thereof will be omitted.

As a result of the calculation, when it is determined that the vehicle 700 can drive on the corresponding road, the processor unit 170 may display a guide indicating that the vehicle 700 can drive or may not display any guide.

On the other hand, when it is determined that the vehicle 700 cannot drive on the corresponding road, the processor unit 170 displays the entry blocking guide 1011 for inducing the driver D not to allow the vehicle 700 to enter the corresponding road on the first display. It can be displayed on the portion 180a. Similar to the above with reference to FIG. 10B, the location where the entry blocking guide 1011 is displayed on the first display unit 180a corresponds to a straight line connecting the driver's eyes and the corresponding road or the entrance of the corresponding road. may be a branch.

Although the entry blocking guide 1011 displayed as a kind of wall shape is shown in FIG. 12B, the entry blocking guide 1011 may be displayed in various forms according to embodiments.

According to an embodiment, similar to the above with reference to FIGS. 11A and 11B , the processor unit 170 may perform the driver D's gaze direction 1010 based on the image obtained through the camera 160 and map information. It may be determined whether the vehicle 700 can drive on the corresponding road.

Figure 9 will be described again.

As a result of the determination in step S120, if the narrow-road width is wider than the vehicle width (YES in S130), the vehicle display device 100 may determine whether the narrow-road driving is possible based on the driver's narrow-road driving data (S150).

In detail, the processor unit 170 may determine whether the driver of the vehicle 700 is capable of driving on the narrow road based on narrow road driving data previously generated and stored in the memory 140 . The narrow road driving data is accumulated driving data on narrow roads previously driven by the driver, and may specifically include data related to changes in driving patterns, such as the degree of speed reduction of the vehicle 700 during narrow road driving.

In particular, the narrow-road driving data according to an embodiment of the present invention may include driver's biometric information generated from the wearable mobile terminal 600 worn by the driver while driving on the narrow-road. This will be described in more detail later with reference to FIG. 13 .

When it is determined that narrow-road driving is possible (YES in S160 ), the vehicle display device 100 may display a second narrow-road driving guide indicating that narrow-road driving is possible (S170). Depending on the embodiment, when it is determined that narrow-road driving is possible, the vehicle display device 100 may not display any narrow-road driving guide as in normal road driving.

On the other hand, if narrow-road driving is not possible or it is determined that caution or caution is required during narrow-road driving (NO in S160), the vehicle display device 100 displays a third narrow-road driving guide indicating that narrow-road driving is impossible or a driving boundary. It can be done (S180).

Steps S150 to S180 will be described in more detail with reference to FIGS. 13 to 14B.

13 is a flowchart illustrating an operation of generating and recording driver's narrow-road driving data by the vehicle display device according to an embodiment of the present invention.

Referring to FIG. 13 , the vehicle display device 100 may detect that the vehicle 700 enters a narrow road (S200). Similar to what has been described above in steps S100 to S110 of FIG. 9 , the processor unit 170 of the vehicle display device 100 detects a narrow road existing in front of the vehicle 700, and the vehicle 700 enters the detected narrow road. entry can be sensed.

The vehicle display device 100 may generate the driver's narrow-road driving data based on the degree of speed reduction of the vehicle 700 and the driver's biometric information obtained through the wearable device when the vehicle 700 drives the narrow-road. (S210).

In detail, the processor unit 170 may obtain vehicle speed information from the sensing unit 760 of the vehicle 700, and measure a degree of speed reduction of the vehicle 700 when traveling on a narrow road from the obtained vehicle speed information. The degree of speed sensitivity may be measured based on speed information of the vehicle 700 when driving on a road other than a narrow road and speed information of the vehicle 700 when driving on a narrow road. For example, as the degree of speed sensitivity increases, it may mean that the driver is not skilled in driving.

In addition, the processor unit 170 may obtain driver's biometric information from the wearable mobile terminal 600 connected through the communication unit 710 . The wearable mobile terminal 600 may be worn on a part of the driver's body and obtain biometric information of the driver when driving on a narrow road using various sensors.

For example, the mobile terminal 600 may obtain heartbeat information of the driver when driving on a narrow road using a heartbeat sensor or skin conduction data using an SKT sensor (skin temperature sensor). In addition, the mobile terminal 600 may obtain various types of biometric information, such as a driver's breathing change or pupil shaking.

The processor unit 170 may obtain biometric information such as heart rate information, skin conduction, respiration change, and/or pupil shaking from the mobile terminal 600 .

The processor unit 170 may generate narrow-road driving data for the driver based on the degree of speed reduction and the biometric information. For example, the processor unit 170 may determine the driver's driving skill level using the degree of speed reduction and the biometric information, and may generate the narrow road driving data including the determination result.

The processor unit 170 may record the generated narrow-road driving data in conjunction with narrow-road information (S220). The information on the narrow road is information on the narrow road on which the vehicle 700 traveled when generating the narrow road driving data, and may include at least one of location information of the narrow road and width information of the narrow road. The narrow road driving data may be stored in the memory 140 or transmitted to the server 510 through the communication unit 210 and stored in the server 510 or a database.

14A and 14B are diagrams showing examples of narrow-road driving guide screens in which the vehicle display apparatus according to an embodiment of the present invention determines whether or not narrow-road driving is possible based on the driver's narrow-road driving data and displays the result of the determination.

Referring to FIG. 14A, similar to FIGS. 10A to 10D, the roads existing in front of the vehicle 700 are the first road on which the vehicle 700 is currently driving, and the road on which the vehicle 700 can drive by going straight at an intersection. It may be a second road, a third road on which the vehicle 700 can drive by turning left at an intersection, and a fourth road on which the vehicle 700 can drive by turning right at an intersection.

The processor unit 170 may calculate the width of each of the roads and determine whether each of the second to fourth roads corresponds to a narrow road based on the calculation result. Since the method of determining whether each of the roads corresponds to a narrow road has been described above with reference to FIG. 10A , a description thereof will be omitted.

In the case of the embodiment shown in FIGS. 14A and 14B , it is assumed that the second road is narrow.

The processor unit 170 may compare the width of the second road with the width of the vehicle 700 . As a result of the comparison, when the width of the second road is wider than that of the vehicle 700, the processor unit 170 may determine whether driving on the second road is possible based on the driver's narrow-road driving data. In this case, the processor unit 170 transmits at least one narrow-road driving data for the second road from the memory 140 or the server 510 based on the location information of the second road among a plurality of narrow-road driving data for the driver. can load According to an embodiment, the processor unit 170 may perform narrow-road driving data for each of at least one narrow-road having the same or similar width as the second road based on width information of the second road among a plurality of narrow-road driving data for the driver. may be loaded from the memory 140 or the server 510.

The processor unit 170 may determine whether driving on the second road is possible based on the loaded narrow-road driving data. As described above with reference to FIG. 13, since the narrow-road driving data includes the driver's driving skill level determination result for the corresponding narrow road, the processor unit 170 determines whether driving on the second road is possible using the driving skill level. can judge

As a result of the determination, when it is determined that the driver can drive on the second road, the processor unit 170, as shown in FIG. It can be displayed on the display unit 180a.

Depending on the embodiment, the processor unit 170 may not display any narrow road driving guide, similar to driving on a general road.

On the other hand, as a result of the determination, if it is determined that the driver is unable to drive on the second road, or it is determined that caution or caution is required while driving, the processor unit 170 displays a third narrow road driving guide indicating that driving is impossible or a driving boundary is displayed on the first display. It can be displayed on the portion 180a.

That is, when the driver's driving skill level is high, for example, when the driving skill level included in the narrow-road driving data corresponds to the first skill level, the processor unit 170 may determine that the driver can drive on the second road.

On the other hand, when the driving skill of the driver is low, for example, when the driving skill included in the narrow-road driving data corresponds to a second skill level lower than the first skill level, or when an accident record is included in the narrow-road driving data, the processor unit (170) may determine that the driver cannot drive on the second road. When the third narrow-road driving guide means that driving is impossible, the third narrow-road driving guide may be substantially the same as the first narrow-road driving guide 1001 shown in FIG. 10B or 11B.

In addition, when the driver's driving skill level is intermediate, for example, when the driving skill level included in the narrow-road driving data corresponds to a third skill level between the first skill level and the second skill level, the processor unit 170 allows the driver to drive to the second road. It can be determined that caution or vigilance is required while driving. In this case, the processor unit 170 may display the third narrow-path driving guide 1021 as in the embodiment shown in FIG. 14B.

According to an embodiment, the processor unit 170 may further display a vehicle steering guide 1022 indicating steering of the vehicle 700 . With the vehicle steering guide 1022, the driver can adjust the position or direction of the vehicle 700 to prevent an accident or damage to the vehicle 700 as the vehicle 700 leans to one side when driving on a narrow road. .

In addition, although not shown, the processor unit 170 displays various information related to driving on the second road based on a plurality of narrow-road driving data of other vehicles that have driven on the second road to the display unit 180a or 180b. ) or through the sound output unit. For example, the processor unit 170 may provide history of accidents that occurred while driving on the second road or may provide narrow road driving data of other vehicles having the same or similar width as the vehicle 700 .

That is, according to the embodiments shown in FIGS. 13 to 14B , the vehicle display device 100 may provide a narrow-road driving guide optimized for the driver's driving skill level based on the narrow-road driving data in which the driver's driving skill level is reflected. .

15 is a flowchart illustrating an operation of providing a steering guide or an alarm based on driving data of a driver when the vehicle deviates from a lane or tilts the vehicle lane, according to an embodiment of the present invention.

Referring to FIG. 15 , the vehicle display device 100 detects lane departure or lane deviation while the vehicle 700 is driving (S300), and based on the driving data of the driver, the lane departure or lane deviation is caused by inexperienced driving. It is possible to distinguish whether it is caused by carelessness or carelessness (S310).

In detail, the processor unit 170 may detect lane departure or lane deviation of the vehicle 700 from an image acquired through the camera 160 . When detecting the lane departure or the lane deviation, the processor unit 170 processes driving data of the driver, for example, information on whether the lane departure or the lane deviation is temporary or continuous, information on whether or not to look forward while driving, and whether or not the driver is drowsy. Inexperienced driving and negligent driving can be distinguished based on information about driving.

For example, when it is determined that the lane departure or bias is continuous, the driver was looking forward while driving, and is not in a drowsy state, the processor unit 170 may determine that the lane departure or bias is due to inexperienced driving. On the other hand, if it is determined that the lane departure or bias is temporary, the driver does not look forward while driving, or is in a drowsy state, the processor unit 170 may determine that the lane departure or bias is due to negligence.

The above example is for convenience of explanation, and the operation of the processor unit 170 to distinguish between inexperienced driving and negligent driving may be implemented in various ways.

In the case of inexperienced driving (YES in S320), the vehicle display device 100 may display a steering guide indicating the steering of the vehicle 700 (S330). On the other hand, in the case of negligence rather than inexperienced driving (NO in S320), the vehicle display device 100 may output an alarm or notice only when the vehicle 700 departs from its lane (S340).

16A and 16B are exemplary diagrams of a steering guide and an alarm according to the embodiment shown in FIG. 15 .

Referring to FIG. 16A , when it is determined that lane deviation or deviation of the vehicle 700 is due to inexperienced driving, the processor unit 170 displays a steering guide 1030 indicating the steering of the vehicle 700 on a first display unit ( 180a). The driver can prevent the lane departure or deviation from continuously occurring by adjusting the steering of the vehicle 700 based on the displayed steering guide 1030 .

Referring to FIG. 16B , when it is determined that the lane departure or deviation of the vehicle 700 is caused by negligence, the processor unit 170 issues an alarm implemented as a warning line 1031 when the vehicle 700 departs from the lane in a first step. It may be displayed on the display unit 180a or an alarm in the form of a warning sound may be output through an audio output unit. The driver can call attention and correct the steering of the vehicle 700 based on the alarm.

According to an embodiment, the processor unit 170 may determine whether the driver is an elderly person with a slow reaction speed or a person with low vision using a DSM or a wearable device, and may adjust an alarm output time point based on the determination result. For example, the processor unit 170 may estimate the age of the driver by recognizing the driver's face using the DSM, or estimate whether the driver corresponds to a person with low vision by measuring the frequency of blinking of the driver.

For example, as a result of the determination, if the driver is an elderly person or a person with low vision, the processor unit 170 outputs an alarm to be output upon lane departure earlier than in the case of an ordinary person, thereby securing sufficient reaction time for the elderly or person with low vision to prevent an accident. possibility of occurrence can be reduced.

17 is an example of an internal block diagram of the vehicle of FIG. 1 including the aforementioned vehicle display device.

Referring to FIG. 17 , the aforementioned vehicle display device may be included in a vehicle.

The vehicle 700 includes a communication unit 710, an input unit 720, a sensing unit 760, an output unit 740, a vehicle driving unit 750, a memory 730, an interface unit 780, a control unit 770, and a power supply unit. 790, the vehicle display device 100, and the AVN device 400. Here, a unit included in the vehicle display device 100 and a unit having the same name among units described in the vehicle 700 will be described as being included in the vehicle 700 .

The communication unit 710 may include one or more modules enabling wireless communication between the vehicle and the mobile terminal 600, between the vehicle and the external server 510, or between the vehicle and another vehicle 520. Also, the communication unit 710 may include one or more modules that connect the vehicle to one or more networks.

The communication unit 710 may include a broadcast receiving module 711, a wireless Internet module 712, a short-distance communication module 713, a location information module 714, and an optical communication module 715.

The broadcast reception module 711 receives a broadcast signal or broadcast-related information from an external broadcast management server through a broadcast channel. Here, broadcasting includes radio broadcasting or TV broadcasting.

The wireless Internet module 712 refers to a module for wireless Internet access, and may be built into or external to a vehicle. The wireless Internet module 712 is configured to transmit and receive radio signals in a communication network based on wireless Internet technologies.

Wireless Internet technologies include, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX ( World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc., and the wireless Internet module 712 transmits and receives data according to at least one wireless Internet technology within a range including Internet technologies not listed above. For example, the wireless Internet module 712 may wirelessly exchange data with the external server 510 . The wireless Internet module 712 may receive weather information and road traffic condition information (eg, Transport Protocol Expert Group (TPEG)) information from the external server 510 .

The short-range communication module 713 is for short-range communication, and includes Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Short-range communication may be supported using at least one of near field communication (NFC), wireless-fidelity (Wi-Fi), Wi-Fi Direct, and wireless universal serial bus (USB) technologies.

The short-range communication module 713 may perform short-range communication between the vehicle and at least one external device by forming wireless area networks. For example, the short-distance communication module 713 may exchange data with the mobile terminal 600 wirelessly. The short-range communication module 713 may receive weather information and road traffic condition information (eg, Transport Protocol Expert Group (TPEG)) from the mobile terminal 600 . For example, when a user gets into a vehicle, the user's mobile terminal 600 and the vehicle may perform pairing with each other automatically or by the user's execution of an application.

The location information module 714 is a module for obtaining the location of a vehicle, and a representative example thereof is a Global Positioning System (GPS) module. For example, if a vehicle utilizes a GPS module, the location of the vehicle may be obtained using a signal transmitted from a GPS satellite.

The optical communication module 715 may include a light emitting unit and a light receiving unit.

The light receiver may receive information by converting a light signal into an electrical signal. The light receiving unit may include a photo diode (PD) for receiving light. Photodiodes can convert light into electrical signals. For example, the light receiver may receive information of the preceding vehicle through light emitted from a light source included in the preceding vehicle.

The light transmitting unit may include at least one light emitting device for converting an electrical signal into an optical signal. Here, the light emitting element is preferably an LED (Light Emitting Diode). The optical transmission unit converts an electrical signal into an optical signal and transmits it to the outside. For example, the light emitting unit may emit an optical signal to the outside through flickering of a light emitting device corresponding to a predetermined frequency. Depending on the embodiment, the light emitting unit may include a plurality of light emitting element arrays. Depending on the embodiment, the light emitting unit may be integrated with a lamp provided in a vehicle. For example, the light emitting unit may be at least one of a headlamp, a taillight, a brake light, a direction indicator light, and a vehicle sidelight. For example, the optical communication module 715 may exchange data with another vehicle 520 through optical communication.

The input unit 720 may include a driving control unit 721, a camera 195, a microphone 723, and a user input unit 724.

The driving control unit 721 receives a user input for vehicle driving. The driving control unit 721 may include a steering input unit 721A, a shift input unit 721D, an acceleration input unit 721C, and a brake input unit 721B.

The steering input unit 721A receives an input of a vehicle traveling direction from a user. The steering input unit 721A is preferably formed in a wheel shape to enable steering input by rotation. Depending on the embodiment, the steering input unit 721A may be formed as a touch screen, touch pad, or button.

The shift input unit 721D receives inputs of parking (P), forward (D), neutral (N), and reverse (R) of the vehicle from the user. The shift input unit 721D is preferably formed in a lever shape. Depending on the embodiment, the shift input unit 721D may be formed as a touch screen, touch pad, or button.

The acceleration input unit 721C receives an input for vehicle acceleration from the user. The brake input unit 721B receives an input for decelerating the vehicle from the user. The acceleration input means 721C and the brake input means 721B are preferably formed in the form of pedals. Depending on the embodiment, the acceleration input unit 721C or the brake input unit 721B may be formed as a touch screen, touch pad, or button.

The camera 722 may include an image sensor and an image processing module. The camera 722 may process still images or moving images obtained by an image sensor (eg, CMOS or CCD). The image processing module may process a still image or video acquired through an image sensor, extract necessary information, and transmit the extracted information to the controller 770 . Meanwhile, the vehicle may include a camera 722 that captures an image in front of the vehicle or an image around the vehicle and a monitoring unit 725 that captures an image inside the vehicle.

The monitoring unit 725 may obtain an image of the occupant. The monitoring unit 725 may obtain an image for biometric recognition of the occupant. The monitoring unit 725 may also perform the role of the DSM described above with reference to FIGS. 12A and 12B.

The microphone 723 may process an external acoustic signal into electrical data. The processed data can be used in various ways depending on the function being performed in the vehicle. The microphone 723 may convert a user's voice command into electrical data. The converted electrical data may be transmitted to the controller 770 .

Meanwhile, according to embodiments, the camera 722 or the microphone 723 may be a component included in the sensing unit 760 rather than a component included in the input unit 720 .

The user input unit 724 is for receiving information from a user. When information is input through the user input unit 724, the controller 770 can control the operation of the vehicle to correspond to the input information. The user input unit 724 may include a touch input unit or a mechanical input unit. Depending on the embodiment, the user input unit 724 may be disposed in one area of the steering wheel. In this case, the driver may manipulate the user input unit 724 with his/her fingers while holding the steering wheel.

The sensing unit 760 senses a signal related to driving of the vehicle. To this end, the sensing unit 760 includes a collision sensor, a wheel sensor, a speed sensor, an inclination sensor, a weight sensor, a heading sensor, a yaw sensor, and a gyro sensor. , position module, vehicle forward / backward sensor, battery sensor, fuel sensor, tire sensor, steering sensor by steering wheel rotation, vehicle internal temperature sensor, vehicle internal humidity sensor, ultrasonic sensor, radar, lidar, etc. can

Accordingly, the sensing unit 760 provides vehicle collision information, vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward/backward information, and battery information. , Fuel information, tire information, vehicle lamp information, vehicle internal temperature information, vehicle internal humidity information, and sensing signals for a steering wheel rotation angle may be obtained.

Meanwhile, the sensing unit 760 includes, in addition, an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an intake temperature sensor (ATS), a water temperature sensor (WTS), and a throttle. A position sensor (TPS), a TDC sensor, a crank angle sensor (CAS), and the like may be further included.

The sensing unit 760 may include a biometric information sensing unit. The biometric information detection unit detects and obtains the biometric information of the occupant. Biometric information includes fingerprint recognition information, iris-scan information, retina-scan information, hand geo-metry information, facial recognition information, voice recognition ( Voice recognition) information may be included. The biometric information detection unit may include a sensor that senses the biometric information of the occupant. Here, the monitoring unit 725 and the microphone 723 may operate as sensors. The biometric information sensor may obtain hand shape information and face recognition information through the monitoring unit 725 .

The output unit 740 is for outputting information processed by the controller 770, and may include a display unit 741, a sound output unit 742, and a haptic output unit 743.

The display unit 741 may display information processed by the controller 770. For example, the display unit 741 may display vehicle-related information. Here, the vehicle-related information may include vehicle control information for direct control of the vehicle or vehicle driving assistance information for driving guidance to the vehicle driver. In addition, the vehicle-related information may include vehicle state information indicating a current state of the vehicle or vehicle driving information related to driving of the vehicle.

The display unit 741 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display. display), a 3D display, and an e-ink display.

The display unit 741 may implement a touch screen by forming a mutual layer structure or integrally with the touch sensor. Such a touch screen may function as a user input unit 724 providing an input interface between the vehicle and the user and provide an output interface between the vehicle and the user. In this case, the display unit 741 may include a touch sensor that senses a touch on the display unit 741 so that a control command can be received by a touch method. Using this, when a touch is made to the display unit 741, the touch sensor can sense the touch, and the controller 770 can generate a control command corresponding to the touch based on this. Contents input by the touch method may be letters or numbers, or menu items that can be instructed or designated in various modes.

Meanwhile, the display unit 741 may include a cluster so that the driver can check vehicle condition information or vehicle driving information while driving. Clusters can be located above the dashboard. In this case, the driver can check the information displayed on the cluster while keeping his or her gaze in front of the vehicle.

Meanwhile, according to embodiments, the display unit 741 may be implemented as a Head Up Display (HUD). When the display unit 741 is implemented as a HUD, information may be output through a transparent display provided on the windshield. Alternatively, the display unit 741 may include a projection module to output information through an image projected on the windshield.

The audio output unit 742 converts the electrical signal from the control unit 770 into an audio signal and outputs it. To this end, the sound output unit 742 may include a speaker or the like. The sound output unit 742 may also output sound corresponding to the operation of the user input unit 724 .

The haptic output unit 743 generates a tactile output. For example, the haptic output unit 743 may vibrate a steering wheel, a seat belt, and a seat so that the user can recognize the output.

The vehicle driving unit 750 may control the operation of various vehicle devices. The vehicle driving unit 750 includes a power source driving unit 751, a steering driving unit 752, a brake driving unit 753, a lamp driving unit 754, an air conditioning driving unit 755, a window driving unit 756, an airbag driving unit 757, a sunroof A driving unit 758 and a suspension driving unit 759 may be included.

The power source driver 751 may perform electronic control of the power source in the vehicle.

For example, when a fossil fuel-based engine (not shown) is the power source, the power source driver 751 may perform electronic control of the engine. This makes it possible to control the output torque of the engine and the like. When the power source driving unit 751 is an engine, the speed of the vehicle may be limited by limiting engine output torque under the control of the control unit 770 .

As another example, when an electric motor (not shown) is a power source, the power source driver 751 may control the motor. This makes it possible to control the rotational speed and torque of the motor.

The steering driver 752 may perform electronic control of a steering apparatus in the vehicle. This makes it possible to change the traveling direction of the vehicle.

The brake driver 753 may perform electronic control of a brake apparatus (not shown) in the vehicle. For example, the speed of the vehicle may be reduced by controlling the operation of the brakes disposed on the wheels. As another example, the driving direction of the vehicle may be adjusted to the left or right by differentiating the operation of the brakes respectively disposed on the left and right wheels.

The lamp driving unit 754 may control turning on/off of lamps disposed inside or outside the vehicle. In addition, the intensity and direction of the light of the lamp can be controlled. For example, control of direction indicator lamps and brake lamps may be performed.

The air conditioning driving unit 755 may perform electronic control of an air cinditioner (not shown) in the vehicle. For example, when the temperature inside the vehicle is high, the air conditioner may be operated to supply cool air to the inside of the vehicle.

The window driver 756 may perform electronic control of a window apparatus in the vehicle. For example, it is possible to control the opening or closing of left and right windows on the side of the vehicle.

The airbag driving unit 757 may perform electronic control of an airbag apparatus in the vehicle. For example, in case of danger, the airbag can be controlled to explode.

The sunroof driving unit 758 may perform electronic control of a sunroof apparatus (not shown) in the vehicle. For example, the opening or closing of the sunroof can be controlled.

The suspension driver 759 may perform electronic control of a suspension apparatus (not shown) in the vehicle. For example, when there is a curve on the road surface, the vibration of the vehicle may be reduced by controlling the suspension device.

The memory 730 is electrically connected to the controller 770. The memory 770 may store basic data for the unit, control data for controlling the operation of the unit, and input/output data. In terms of hardware, the memory 790 may be various storage devices such as ROM, RAM, EPROM, flash drive, hard drive, and the like. The memory 730 may store various data for overall operation of the vehicle, such as a program for processing or control of the control unit 770 .

The interface unit 780 may serve as a passage for various types of external devices connected to the vehicle. For example, the interface unit 780 may have a port connectable to the mobile terminal 600 and connect to the mobile terminal 600 through the port. In this case, the interface unit 780 may exchange data with the mobile terminal 600 .

Meanwhile, the interface unit 780 may serve as a passage through which electrical energy is supplied to the connected mobile terminal 600 . When the mobile terminal 600 is electrically connected to the interface unit 780, the interface unit 780 provides electrical energy supplied from the power supply unit 790 to the mobile terminal 600 under the control of the controller 770. do.

The controller 770 may control the overall operation of each unit in the vehicle. The controller 770 may be referred to as an Electronic Control Unit (ECU).

The control unit 770 may execute a function corresponding to the transmitted signal according to transmission of the execution signal of the vehicle display device.

The controller 770, in terms of hardware, includes application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors ( It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions.

The control unit 770 may delegate the role of the processor 170 described above. That is, the processor 170 of the vehicle display device may be directly set in the controller 770 of the vehicle. In this embodiment, a vehicle display device may be understood to refer to a combination of some components of a vehicle.

Alternatively, the controller 770 may control components to transmit information requested by the processor 170 .

The power supply unit 790 may supply power required for operation of each component under the control of the control unit 770 . In particular, the power supply unit 770 may receive power from a battery (not shown) inside the vehicle.

The AVN (Audio Video Navigation) device 400 may exchange data with the controller 770 . The controller 770 may receive navigation information from the AVN device 400 or a separate navigation device (not shown). Here, the navigation information may include set destination information, route information according to the destination, map information related to vehicle driving, or vehicle location information.

The features, structures, effects, etc. described in the foregoing embodiments are included in at least one embodiment of the present invention, and are not necessarily limited to only one embodiment. Furthermore, the features, structures, effects, etc. illustrated in each embodiment can be combined or modified with respect to other embodiments by those skilled in the art in the field to which the embodiments belong. Therefore, contents related to these combinations and variations should be construed as being included in the scope of the present invention.

In addition, although the embodiments have been described above, these are merely examples and do not limit the present invention, and those of ordinary skill in the field to which the present invention belongs can exemplify the above to the extent that does not deviate from the essential characteristics of the present embodiment. It will be seen that various variations and applications that have not been made are possible. For example, each component specifically shown in the embodiments can be modified and implemented. And differences related to these variations and applications should be construed as being included in the scope of the present invention as defined in the appended claims.

Claims (19)

A camera that takes an image of the front of the vehicle;
a first display unit displaying a graphic image on the windshield of the vehicle;
a second display unit installed inside the vehicle and displaying a map screen or a navigation screen; and
Detecting a narrow road from the captured image, determining whether or not driving in the narrow road is possible based on the width of the vehicle and the driver's narrow road driving data, and displaying a narrow road driving guide through the first display unit based on the determination result. Including a processor unit,
The processor unit,
It detects whether the vehicle enters the narrow road, and if the vehicle enters the narrow road, determines the driver's driving skill level based on the degree of speed reduction of the vehicle traveling on the narrow road and the driver's biometric information, and determines the driver's driving skill level. Generates and records narrow-road driving data that includes
The degree of speed reduction of the vehicle,
When the vehicle travels on a narrow road, it is measured based on speed information of a vehicle traveling on the narrow road and speed information of a vehicle traveling on a road other than the narrow road;
The driver's biometric information,
A display device for a vehicle that is measured by a mobile terminal worn on a part of the driver's body when the vehicle drives on a narrow road. According to claim 1,
The processor unit,
A display device for a vehicle that calculates a width of each of the at least one road included in the image, and detects a road having a narrower width than a reference width as the narrow road as a result of the calculation. According to claim 2,
The processor unit,
When the width of the narrow road is narrower than the width of the vehicle, the vehicle display device displays a first narrow road driving guide indicating that driving on the narrow road is impossible through the first display unit. According to claim 3,
The processor unit,
A guidance guide for guiding a detour instead of the narrow path is displayed through the first display unit,
A display device for a vehicle that displays the detour on the map screen or the navigation screen displayed on the second display unit. According to claim 1,
The biometric information includes at least one of heart rate information obtained from a heart rate sensor of the mobile terminal and skin conduction obtained from an SKT sensor (skin temperature sensor) of the mobile terminal. According to claim 1,
The processor unit,
When the width of the narrow road is wider than the width of the vehicle, determining whether driving of the narrow road is possible based on the driving proficiency;
As a result of the determination, when driving on the narrow road is impossible, displaying a first narrow road driving guide indicating that driving on the narrow road is impossible through the first display unit;
When the determination result is that driving on the narrow road is possible, the vehicle display device displays a second narrow road driving guide indicating that driving on the narrow road is possible through the first display unit. According to claim 6,
The processor unit,
As a result of the determination, when caution or caution is required when driving on the narrow road, a third narrow road driving guide is displayed through the first display unit;
A display device for a vehicle that displays a vehicle steering guide representing steering of the vehicle through the first display unit. According to claim 7,
The processor unit,
For a vehicle displaying information related to driving of the narrow road through the first display unit or the second display unit, based on a plurality of narrow road driving data for other vehicles that have driven on the narrow road, when the vehicle is driving on the narrow road display device. According to claim 1,
The processor unit,
Detecting the direction of the driver's gaze using a driver status monitor (DSM) included in the vehicle;
Determining whether driving on a road existing in the detected gaze direction is possible,
A display device for a vehicle displaying, through the first display unit, an entry blocking guide for inducing the vehicle not to enter the road when driving on the road is impossible as a result of the determination. A vehicle comprising the vehicle display device according to any one of claims 1 to 9. A method of operating a display device for a vehicle including a first display unit displaying a graphic image on a vehicle windshield and a second display unit installed inside the vehicle and displaying a map screen or a navigation screen, the method comprising:
obtaining an image of the front of the vehicle from a camera included in the vehicle;
Detecting narrow passage from the obtained image;
determining whether driving in the narrow road is possible based on the width of the vehicle and the driver's narrow road driving data;
displaying a narrow road driving guide based on a result of the determination through the first display unit;
detecting whether the vehicle enters a narrow road;
determining a driving skill level of a driver based on a degree of speed reduction of the vehicle traveling on the narrow road and biometric information of the driver when the vehicle enters the narrow road; and
Generating and recording narrow-road driving data including the determined driving skill of the driver;
The degree of speed reduction of the vehicle,
When the vehicle travels on a narrow road, it is measured based on speed information of a vehicle traveling on the narrow road and speed information of a vehicle traveling on a road other than the narrow road;
The driver's biometric information,
A method of operating a display device for a vehicle that is measured by a mobile terminal worn on a part of the driver's body when the vehicle drives on a narrow road. According to claim 11,
The step of detecting the narrow passage,
calculating a width of each of at least one road included in the image; and
and detecting, as a result of the calculation, a road having a narrower width than a reference width as the narrow road. According to claim 12,
In the step of displaying the narrow road driving guide,
When the width of the narrow road is narrower than that of the vehicle, a first narrow road driving guide indicating that driving in the narrow road is impossible is displayed through the first display unit. According to claim 13,
In the step of displaying the narrow road driving guide,
displaying a guidance guide for guiding a detour instead of the narrow path through the first display unit; and
and displaying the detour on the map screen or the navigation screen displayed on the second display unit. According to claim 11,
The biometric information includes at least one of heart rate information obtained from a heart rate sensor of the mobile terminal and skin conduction obtained from an SKT sensor (skin temperature sensor) of the mobile terminal. According to claim 11,
The step of determining whether driving in the narrow road is possible,
When the width of the narrow road is wider than the width of the vehicle, determining whether driving of the narrow road is possible based on the driving proficiency;
In the step of displaying the narrow road driving guide,
As a result of the determination, when driving on the narrow road is impossible, displaying a first narrow road driving guide indicating that driving on the narrow road is impossible through the first display unit;
A method of operating a vehicle display device displaying, through the first display unit, a second narrow-road driving guide indicating that driving on the narrow-road is possible when the determination result is that driving on the narrow-road is possible. According to claim 16,
In the step of displaying the narrow road driving guide,
displaying a third narrow-road driving guide through the first display unit when caution or caution is required when driving on the narrow-road as a result of the determination; and
and displaying a vehicle steering guide representing steering of the vehicle through the first display unit. According to claim 17,
When the vehicle is driving on the narrow road, based on a plurality of narrow road driving data for other vehicles that have driven on the narrow road, information related to driving of the narrow road is displayed through the first display unit or the second display unit. A method of operating a display device for a vehicle further comprising the step. According to claim 11,
detecting a direction of the driver's gaze using a driver status monitor (DSM) included in the vehicle;
determining whether it is possible to drive on a road existing in the sensed gaze direction; and
and displaying, through the first display unit, an entry blocking guide for inducing the vehicle not to enter the road when driving on the road is impossible as a result of the determination.

Images