KR102391664B1 - Vehicle control device mounted on vehicle and method for controlling the vehicle - Google Patents

Abstract

The present invention relates to a vehicle control apparatus provided in a vehicle and a vehicle control method. A vehicle control apparatus according to an embodiment of the present invention provides a method for displaying information displayed in a region other than a region toward which the driver's gaze is directed among a plurality of regions of a sensing unit sensing a driver's gaze, a display unit, and the display unit, such that a display method is changed. and a processor for controlling the display unit.

Description

A vehicle control device provided in a vehicle and a vehicle control method

The present invention relates to a vehicle control apparatus provided in a vehicle and a vehicle control method.

A vehicle is a device capable of moving in a direction desired by a user on board. A typical example is a car.

Meanwhile, for the convenience of a user using a vehicle, various sensors and electronic devices are being provided. In particular, research on an advanced driver assistance system (ADAS) is being actively conducted for user's driving convenience. Furthermore, the development of autonomous vehicles (Autonomous Vehicle) is being actively made.

A vehicle may be equipped with various types of lamps. In general, a vehicle is provided with various vehicle lamps having a lighting function to easily check an object located around the vehicle when driving at night and a signal function to notify other vehicles or other road users of the driving state of the vehicle, and there is.

For example, the vehicle uses a lamp to directly emit light, such as a headlight that irradiates light to the front to secure the driver's view, a brake light that turns on when the brake is applied, and a direction indicator light that is used when turning right or left. A device may be provided.

As another example, reflectors that reflect light so that the vehicle can be easily recognized from the outside are mounted on the front and rear of the vehicle.

These vehicle lamps are regulated by laws and regulations regarding their installation standards and standards so that each function can be fully exhibited.

On the other hand, as the development of ADAS (Advanced Driving Assist System) is actively performed in recent years, the need for technology development that can maximize user convenience and safety in driving a vehicle is emerging.

SUMMARY OF THE INVENTION An object of the present invention is to provide a vehicle control apparatus and a vehicle control method capable of controlling a display unit provided in a vehicle in an optimized method according to a driver's gaze.

Another object of the present invention is to provide a vehicle control apparatus capable of outputting information optimized to a display unit according to a driver's gaze, and a vehicle control method.

Another object of the present invention is to provide a vehicle control device and a vehicle control method capable of outputting optimized information related to the driving situation to a display unit so that the driver's gaze can be directed to information necessary for the driving situation of the vehicle. there is.

The problems of the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, a vehicle control apparatus according to an embodiment of the present invention provides a sensing unit for sensing a driver's gaze, a display unit, and information displayed in a region other than the region toward which the driver's gaze is directed among a plurality of regions of the display unit and a processor for controlling the display unit so that the display method of the display is changed.

In an embodiment, the plurality of areas include a first area and a second area different from the first area, and the processor is configured to: when the sensed driver's gaze is directed toward the first area, the second area It is characterized in that the display method of the displayed information is changed.

In an embodiment, the processor is characterized in that the first information related to the vehicle displayed in the second area to which the driver's gaze is not directed is changed to second information different from the first information.

In an embodiment, the first information is an image received through a camera arranged to photograph the outside of the vehicle, the second information is a graphic object representing a situation outside the vehicle, and the processor is It is characterized in that the image being displayed in the second area to which the gaze is not directed is changed to the graphic object.

In an embodiment, when the driver's gaze is directed to the first area, the processor may not output at least a portion of the plurality of pieces of information output to the second area.

In an embodiment, the processor may reduce the brightness of the second area to which the driver's gaze is not directed.

In an embodiment, the processor may change a display method of information displayed on an area to which the driver's gaze is directed among the plurality of areas of the display unit.

In an embodiment, the processor is characterized in that the first information related to the vehicle displayed in the area to which the driver's gaze is directed is changed to second information different from the first information.

In an embodiment, the processor additionally outputs a graphic object to an area to which the driver's gaze is directed.

In an embodiment, the processor is configured to determine whether the driver's gaze is directed to any one of the plurality of regions while an image received through a camera disposed to photograph the outside of the vehicle is being output in any one of the plurality of regions. It is characterized in that the graphic object is output based on the

In an embodiment, the graphic object is output when the probability of collision between the present vehicle and the other vehicle is equal to or greater than a predetermined value, and is output based on a portion corresponding to the other vehicle in the image.

In an embodiment, the processor outputs an image received through a camera arranged to photograph the outside of the vehicle to a first region to which the driver's gaze is directed among the plurality of regions, and the image satisfies a preset condition In this case, a graphic object different from the image is output to a second area different from the first area.

In an embodiment, the sensing unit senses the possibility of collision with another vehicle, and the processor, when the probability of collision with the other vehicle is equal to or greater than a predetermined value, based on the direction in which the other vehicle exists with respect to the present vehicle. , an image received through a camera disposed to photograph the exterior of the vehicle is output to at least one of a plurality of regions of the display unit.

In an embodiment, the processor outputs an image received through a camera arranged to photograph the exterior of the vehicle to at least one of a plurality of regions of the display unit, based on the vehicle satisfying a preset condition characterized.

A vehicle according to an embodiment of the present invention includes the vehicle control device described herein.

A method of controlling a vehicle according to an embodiment of the present invention includes sensing a driver's gaze and changing a display method of information displayed in a region other than a region toward which the driver's gaze is directed among a plurality of regions of a display unit. .

In an embodiment, the plurality of areas include a first area and a second area different from the first area, and the changing may include: when the sensed driver's gaze is directed toward the first area, the first area It is characterized in that the display method of the information displayed in area 2 is changed.

In an embodiment, the changing may include changing first information related to a vehicle displayed in a second area to which the driver's gaze is not directed into second information different from the first information.

In an embodiment, the first information is an image received through a camera arranged to photograph the outside of the vehicle, and the second information is a graphic object representing a situation outside the vehicle, and the changing includes: The image being displayed in a second area to which the driver's gaze is not directed is changed to the graphic object.

In an embodiment, the method further includes changing a display method of information displayed on an area to which the driver's gaze is directed among the plurality of areas of the display unit.

The details of other embodiments are included in the detailed description and drawings.

According to an embodiment of the present invention, there are one or more of the following effects.

First, the present invention can provide a new vehicle interface capable of controlling the display unit in an optimized method according to the driver's gaze.

Second, the present invention can provide a new vehicle interface capable of controlling an area to which the driver's gaze is directed and an area to which the driver's gaze is not directed in different ways.

Third, the present invention outputs more specific information related to driving in an area to which the driver's gaze is directed, and simplifies and outputs the information output to an area to which the driver's gaze is not directed, thereby removing obstacles to the driver's driving, and helping It is possible to provide a new vehicle interface that can intensively output information that can give

Fourth, the present invention can provide a vehicle control device and a vehicle control method capable of outputting information optimized according to the driving state of the vehicle to a display unit.

Effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description of the claims.

1 is a view showing the exterior of a vehicle according to an embodiment of the present invention.
2 is a view of a vehicle according to an embodiment of the present invention as viewed from various angles from the outside.
3 to 4 are views illustrating the interior of a vehicle according to an embodiment of the present invention.
5 to 6 are diagrams referenced to describe an object according to an embodiment of the present invention.
7 is a block diagram referenced for explaining a vehicle according to an embodiment of the present invention.
8 is a conceptual diagram for explaining a vehicle control apparatus according to an embodiment of the present invention.
9 is a flowchart for explaining a representative control method of the present invention.
10 , 11 , 12 , 13 , 14 , 15 , 16 and 17 are conceptual diagrams for explaining the control method illustrated in FIG. 9 .

Hereinafter, the embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numbers regardless of reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "part" for components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have distinct meanings or roles by themselves. In addition, in describing the embodiments disclosed in the present specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in this specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical idea disclosed herein is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention , should be understood to include equivalents or substitutes.

Terms including an ordinal number such as 1st, 2nd, etc. may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

When an element is referred to as being “connected” or “connected” to another element, it is understood that it may be directly connected or connected to the other element, but other elements may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The singular expression includes the plural expression unless the context clearly dictates otherwise.

In the present application, terms such as “comprises” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

The vehicle described in this specification may be a concept including an automobile and a motorcycle. Hereinafter, the vehicle will be mainly described with respect to the vehicle.

The vehicle described herein may be a concept including both an internal combustion engine vehicle having an engine as a power source, a hybrid vehicle having an engine and an electric motor as a power source, and an electric vehicle having an electric motor as a power source.

In the following description, the left side of the vehicle means the left side in the driving direction of the vehicle, and the right side of the vehicle means the right side in the driving direction of the vehicle.

1 is a view showing the exterior of a vehicle according to an embodiment of the present invention.

2 is a view of a vehicle according to an embodiment of the present invention viewed from various angles from the outside.

3 to 4 are views illustrating the interior of a vehicle according to an embodiment of the present invention.

5 to 6 are diagrams referenced to describe an object according to an embodiment of the present invention.

7 is a block diagram referenced for explaining a vehicle according to an embodiment of the present invention.

1 to 7 , the vehicle 100 may include wheels rotated by a power source and a steering input device 510 for controlling the traveling direction of the vehicle 100 .

The vehicle 100 may be an autonomous driving vehicle.

The vehicle 100 may be switched to an autonomous driving mode or a manual mode based on a user input.

For example, the vehicle 100 may be switched from the manual mode to the autonomous driving mode or from the autonomous driving mode to the manual mode based on a user input received through the user interface device 200 .

The vehicle 100 may be switched to an autonomous driving mode or a manual mode based on driving situation information. The driving situation information may be generated based on object information provided by the object detection apparatus 300 .

For example, the vehicle 100 may be switched from the manual mode to the autonomous driving mode or from the autonomous driving mode to the manual mode based on the driving situation information generated by the object detection apparatus 300 .

For example, the vehicle 100 may be switched from the manual mode to the autonomous driving mode or from the autonomous driving mode to the manual mode based on driving situation information received through the communication device 400 .

The vehicle 100 may be switched from the manual mode to the autonomous driving mode or from the autonomous driving mode to the manual mode based on information, data, and signals provided from an external device.

When the vehicle 100 is operated in the autonomous driving mode, the autonomous driving vehicle 100 may be operated based on the driving system 700 .

For example, the autonomous vehicle 100 may be driven based on information, data, or signals generated by the driving system 710 , the taking-out system 740 , and the parking system 750 .

When the vehicle 100 is operated in the manual mode, the autonomous driving vehicle 100 may receive a user input for driving through the driving manipulation device 500 . Based on a user input received through the driving manipulation device 500 , the vehicle 100 may be driven.

The overall length refers to the length from the front part to the rear part of the vehicle 100 , the width refers to the width of the vehicle 100 , and the height refers to the length from the lower part of the wheel to the roof. In the following description, the overall length direction (L) is the standard direction for measuring the overall length of the vehicle 100 , the overall width direction (W) is the standard direction for measuring the full width of the vehicle 100 , and the total height direction (H) is the vehicle (100) may mean a direction that is the standard for measuring the total height.

As illustrated in FIG. 7 , the vehicle 100 includes a user interface device 200 , an object detection device 300 , a communication device 400 , a driving manipulation device 500 , a vehicle driving device 600 , and a driving system. 700 , a navigation system 770 , a sensing unit 120 , an interface unit 130 , a memory 140 , a control unit 170 , and a power supply unit 190 may be included.

Depending on the embodiment, the vehicle 100 may further include other components in addition to the components described herein, or may not include some of the components described herein.

The user interface device 200 is a device for communication between the vehicle 100 and a user. The user interface device 200 may receive a user input and provide information generated in the vehicle 100 to the user. The vehicle 100 may implement User Interfaces (UIs) or User Experiences (UXs) through the user interface device 200 .

The user interface device 200 may include an input unit 210 , an internal camera 220 , a biometric sensor 230 , an output unit 250 , and a processor 270 .

According to an embodiment, the user interface device 200 may further include other components in addition to the described components, or may not include some of the described components.

The input unit 200 is for receiving information from a user, and the data collected by the input unit 120 may be analyzed by the processor 270 and processed as a user's control command.

The input unit 200 may be disposed inside the vehicle. For example, the input unit 200 may include one region of a steering wheel, one region of an instrument panel, one region of a seat, one region of each pillar, and a door. One area of the door, one area of the center console, one area of the head lining, one area of the sun visor, one area of the windshield or the window (window) It may be disposed in one area or the like.

The input unit 200 may include a voice input unit 211 , a gesture input unit 212 , a touch input unit 213 , and a mechanical input unit 214 .

The voice input unit 211 may convert the user's voice input into an electrical signal. The converted electrical signal may be provided to the processor 270 or the controller 170 .

The voice input unit 211 may include one or more microphones.

The gesture input unit 212 may convert the user's gesture input into an electrical signal. The converted electrical signal may be provided to the processor 270 or the controller 170 .

The gesture input unit 212 may include at least one of an infrared sensor and an image sensor for detecting a user's gesture input.

According to an embodiment, the gesture input unit 212 may detect a user's 3D gesture input. To this end, the gesture input unit 212 may include a light output unit that outputs a plurality of infrared rays or a plurality of image sensors.

The gesture input unit 212 may sense the user's 3D gesture input through a time of flight (TOF) method, a structured light method, or a disparity method.

The touch input unit 213 may convert a user's touch input into an electrical signal. The converted electrical signal may be provided to the processor 270 or the controller 170 .

The touch input unit 213 may include a touch sensor for sensing a user's touch input.

According to an embodiment, the touch input unit 213 may be integrally formed with the display unit 251 to implement a touch screen. Such a touch screen may provide both an input interface and an output interface between the vehicle 100 and the user.

The mechanical input unit 214 may include at least one of a button, a dome switch, a jog wheel, and a jog switch. The electrical signal generated by the mechanical input unit 214 may be provided to the processor 270 or the control unit 170 .

The mechanical input unit 214 may be disposed on a steering wheel, a center fascia, a center console, a cockpick module, a door, and the like.

The internal camera 220 may acquire an image inside the vehicle. The processor 270 may detect the user's state based on the image inside the vehicle. The processor 270 may obtain the user's gaze information from the image inside the vehicle. The processor 270 may detect the user's gesture from the image inside the vehicle.

The biometric sensor 230 may obtain biometric information of the user. The biometric sensor 230 may include a sensor capable of obtaining the user's biometric information, and may obtain the user's fingerprint information, heart rate information, and the like, using the sensor. The biometric information may be used for user authentication.

The output unit 250 is for generating an output related to sight, hearing, or touch.

The output unit 250 may include at least one of a display unit 251 , a sound output unit 252 , and a haptic output unit 253 .

The display unit 251 may display graphic objects corresponding to various pieces of information.

The display unit 251 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (Flexible Display). display), a three-dimensional display (3D display), and an electronic ink display (e-ink display) may include at least one.

The display unit 251 may form a layer structure with the touch input unit 213 or be integrally formed to implement a touch screen.

The display unit 251 may be implemented as a head-up display (HUD). When the display unit 251 is implemented as a HUD, the display unit 251 may include a projection module to output information through an image projected on the windshield or window.

The display unit 251 may include a transparent display. The transparent display may be attached to a windshield or window.

The transparent display may display a predetermined screen while having predetermined transparency. Transparent display, in order to have transparency, transparent TFEL (Thin Film Elecroluminescent), transparent OLED (Organic Light-Emitting Diode), transparent LCD (Liquid Crystal Display), transmissive transparent display, transparent LED (Light Emitting Diode) display may include at least one of The transparency of the transparent display can be adjusted.

Meanwhile, the user interface device 200 may include a plurality of display units 251a to 251g.

The display unit 251 includes one area of the steering wheel, one area 521a, 251b, and 251e of the instrument panel, one area 251d of the seat, one area 251f of each pillar, and one area of the door ( 251g), one area of the center console, one area of the head lining, one area of the sun visor, or one area 251c of the windshield and one area 251h of the window.

The sound output unit 252 converts an electric signal provided from the processor 270 or the controller 170 into an audio signal and outputs the converted signal. To this end, the sound output unit 252 may include one or more speakers.

The haptic output unit 253 generates a tactile output. For example, the haptic output unit 253 may vibrate the steering wheel, seat belt, and seats 110FL, 110FR, 110RL, and 110RR so that the user can recognize the output.

The processor 270 may control the overall operation of each unit of the user interface device 200 .

According to an embodiment, the user interface apparatus 200 may include a plurality of processors 270 or may not include the processors 270 .

When the user interface device 200 does not include the processor 270 , the user interface device 200 may be operated under the control of a processor or the controller 170 of another device in the vehicle 100 .

Meanwhile, the user interface device 200 may be referred to as a vehicle display device.

The user interface device 200 may be operated under the control of the controller 170 .

The object detecting apparatus 300 is an apparatus for detecting an object located outside the vehicle 100 .

The object may be various objects related to the operation of the vehicle 100 .

5 to 6 , the object O includes a lane OB10, another vehicle OB11, a pedestrian OB12, a two-wheeled vehicle OB13, traffic signals OB14, OB15, light, road, structure, This may include speed bumps, features, animals, and the like.

The lane OB10 may be a driving lane, a lane next to the driving lane, or a lane in which vehicles facing each other travel. The lane OB10 may be a concept including left and right lines forming a lane.

The other vehicle OB11 may be a vehicle running in the vicinity of the vehicle 100 . The other vehicle may be a vehicle located within a predetermined distance from the vehicle 100 . For example, the other vehicle OB11 may be a vehicle preceding or following the vehicle 100 .

The pedestrian OB12 may be a person located in the vicinity of the vehicle 100 . The pedestrian OB12 may be a person located within a predetermined distance from the vehicle 100 . For example, the pedestrian OB12 may be a person located on a sidewalk or a roadway.

The two-wheeled vehicle OB12 may refer to a vehicle positioned around the vehicle 100 and moving using two wheels. The two-wheeled vehicle OB12 may be a vehicle having two wheels positioned within a predetermined distance from the vehicle 100 . For example, the two-wheeled vehicle OB13 may be a motorcycle or a bicycle located on a sidewalk or roadway.

The traffic signal may include a traffic light OB15, a traffic sign OB14, and a pattern or text drawn on a road surface.

The light may be light generated from a lamp provided in another vehicle. The light, can be the light generated from the street lamp. The light may be sunlight.

The road may include a road surface, a curve, an uphill slope, a downhill slope, and the like.

The structure may be an object located around a road and fixed to the ground. For example, the structure may include a street lamp, a street tree, a building, a power pole, a traffic light, and a bridge.

Features may include mountains, hills, and the like.

Meanwhile, the object may be classified into a moving object and a fixed object. For example, the moving object may be a concept including other vehicles and pedestrians. For example, the fixed object may be a concept including a traffic signal, a road, and a structure.

The object detecting apparatus 300 may include a camera 310 , a radar 320 , a lidar 330 , an ultrasonic sensor 340 , an infrared sensor 350 , and a processor 370 .

According to an embodiment, the object detecting apparatus 300 may further include other components in addition to the described components, or may not include some of the described components.

The camera 310 may be located at an appropriate place outside the vehicle in order to acquire an image outside the vehicle. The camera 310 may be a mono camera, a stereo camera 310a, an AVM (Around View Monitoring) camera 310b, or a 360 degree camera.

For example, the camera 310 may be disposed adjacent to the front windshield in the interior of the vehicle to acquire an image of the front of the vehicle. Alternatively, the camera 310 may be disposed around the front bumper or radiator grill.

For example, the camera 310 may be disposed adjacent to the rear glass in the interior of the vehicle to acquire an image of the rear of the vehicle. Alternatively, the camera 310 may be disposed around a rear bumper, a trunk, or a tailgate.

For example, the camera 310 may be disposed adjacent to at least one of the side windows in the interior of the vehicle in order to acquire an image of the side of the vehicle. Alternatively, the camera 310 may be disposed around a side mirror, a fender, or a door.

The camera 310 may provide the acquired image to the processor 370 .

The radar 320 may include an electromagnetic wave transmitter and a receiver. The radar 320 may be implemented in a pulse radar method or a continuous wave radar method in view of a radio wave emission principle. The radar 320 may be implemented as a frequency modulated continuous wave (FMCW) method or a frequency shift keyong (FSK) method according to a signal waveform among continuous wave radar methods.

The radar 320 detects an object based on a time of flight (TOF) method or a phase-shift method using an electromagnetic wave as a medium, and a position of the detected object, a distance from the detected object, and a relative speed can be detected.

The radar 320 may be disposed at an appropriate location outside of the vehicle to detect an object located in front, rear, or side of the vehicle.

The lidar 330 may include a laser transmitter and a receiver. The lidar 330 may be implemented in a time of flight (TOF) method or a phase-shift method.

The lidar 330 may be implemented as a driven or non-driven type.

When implemented as a driving type, the lidar 330 is rotated by a motor and may detect an object around the vehicle 100 .

When implemented as a non-driving type, the lidar 330 may detect an object located within a predetermined range with respect to the vehicle 100 by light steering. The vehicle 100 may include a plurality of non-driven lidars 330 .

The lidar 330 detects an object based on a time of flight (TOF) method or a phase-shift method as a laser light medium, and determines the position of the detected object, the distance to the detected object, and Relative speed can be detected.

The lidar 330 may be disposed at an appropriate location outside the vehicle to detect an object located in the front, rear, or side of the vehicle.

The ultrasonic sensor 340 may include an ultrasonic transmitter and a receiver. The ultrasound sensor 340 may detect an object based on ultrasound, and detect a position of the detected object, a distance from the detected object, and a relative speed.

The ultrasonic sensor 340 may be disposed at an appropriate location outside the vehicle to detect an object located in the front, rear, or side of the vehicle.

The infrared sensor 350 may include an infrared transmitter and a receiver. The infrared sensor 340 may detect an object based on infrared light, and detect a position of the detected object, a distance from the detected object, and a relative speed.

The infrared sensor 350 may be disposed at an appropriate location outside the vehicle to detect an object located in front, rear, or side of the vehicle.

The processor 370 may control the overall operation of each unit of the object detection apparatus 300 .

The processor 370 may detect and track the object based on the acquired image. The processor 370 may perform operations such as calculating a distance to an object and calculating a relative speed with respect to an object through an image processing algorithm.

The processor 370 may detect and track the object based on the reflected electromagnetic wave that is reflected by the object and returns. The processor 370 may perform operations such as calculating a distance to an object and calculating a relative speed with respect to the object based on the electromagnetic wave.

The processor 370 may detect and track the object based on reflected laser light from which the transmitted laser is reflected by the object and returned. The processor 370 may perform operations such as calculating a distance to an object and calculating a relative speed with respect to the object based on the laser light.

The processor 370 may detect and track the object based on the reflected ultrasound reflected back by the transmitted ultrasound. The processor 370 may perform operations, such as calculating a distance to an object and calculating a relative speed with respect to the object, based on the ultrasound.

The processor 370 may detect and track the object based on the reflected infrared light reflected back by the transmitted infrared light. The processor 370 may perform operations such as calculating a distance to an object and calculating a relative speed with respect to the object based on the infrared light.

According to an embodiment, the object detecting apparatus 300 may include a plurality of processors 370 or may not include the processors 370 . For example, each of the camera 310 , the radar 320 , the lidar 330 , the ultrasonic sensor 340 , and the infrared sensor 350 may individually include a processor.

When the object detecting apparatus 300 does not include the processor 370 , the object detecting apparatus 300 may be operated under the control of the processor or the controller 170 of the apparatus in the vehicle 100 .

The object detection apparatus 400 may be operated under the control of the controller 170 .

The communication apparatus 400 is an apparatus for performing communication with an external device. Here, the external device may be another vehicle, a mobile terminal, or a server.

The communication device 400 may include at least one of a transmit antenna, a receive antenna, a radio frequency (RF) circuit capable of implementing various communication protocols, and an RF element to perform communication.

The communication device 400 may include a short-range communication unit 410 , a location information unit 420 , a V2X communication unit 430 , an optical communication unit 440 , a broadcast transceiver 450 , and a processor 470 .

According to an embodiment, the communication device 400 may further include other components in addition to the described components, or may not include some of the described components.

The short-range communication unit 410 is a unit for short-range communication. The short-range communication unit 410, Bluetooth (Bluetooth™), RFID (Radio Frequency Identification), infrared communication (Infrared Data Association; IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless) -Fidelity), Wi-Fi Direct, and at least one of Wireless USB (Wireless Universal Serial Bus) technologies may be used to support short-distance communication.

The short-distance communication unit 410 may form wireless area networks to perform short-range communication between the vehicle 100 and at least one external device.

The location information unit 420 is a unit for obtaining location information of the vehicle 100 . For example, the location information unit 420 may include a Global Positioning System (GPS) module or a Differential Global Positioning System (DGPS) module.

The V2X communication unit 430 is a unit for performing wireless communication with a server (V2I: Vehicle to Infra), another vehicle (V2V: Vehicle to Vehicle), or a pedestrian (V2P: Vehicle to Pedestrian). The V2X communication unit 430 may include an RF circuit capable of implementing protocols for communication with infrastructure (V2I), vehicle-to-vehicle communication (V2V), and communication with pedestrians (V2P).

The optical communication unit 440 is a unit for performing communication with an external device via light. The optical communication unit 440 may include an optical transmitter that converts an electrical signal into an optical signal to transmit to the outside, and an optical receiver that converts the received optical signal into an electrical signal.

According to an embodiment, the light transmitter may be formed to be integrated with a lamp included in the vehicle 100 .

The broadcast transceiver 450 is a unit for receiving a broadcast signal from an external broadcast management server or transmitting a broadcast signal to the broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal.

The processor 470 may control the overall operation of each unit of the communication device 400 .

According to an embodiment, the communication device 400 may include a plurality of processors 470 or may not include the processors 470 .

When the communication device 400 does not include the processor 470 , the communication device 400 may be operated under the control of a processor or the controller 170 of another device in the vehicle 100 .

Meanwhile, the communication device 400 may implement a vehicle display device together with the user interface device 200 . In this case, the vehicle display device may be referred to as a telematics device or an AVN (Audio Video Navigation) device.

The communication device 400 may be operated under the control of the controller 170 .

The driving operation device 500 is a device that receives a user input for driving.

In the manual mode, the vehicle 100 may be driven based on a signal provided by the driving manipulation device 500 .

The driving manipulation device 500 may include a steering input device 510 , an acceleration input device 530 , and a brake input device 570 .

The steering input device 510 may receive a driving direction input of the vehicle 100 from the user. The steering input device 510 is preferably formed in a wheel shape to enable steering input by rotation. According to an embodiment, the steering input device may be formed in the form of a touch screen, a touch pad, or a button.

The acceleration input device 530 may receive an input for acceleration of the vehicle 100 from a user. The brake input device 570 may receive an input for decelerating the vehicle 100 from a user. The acceleration input device 530 and the brake input device 570 are preferably formed in the form of pedals. According to an embodiment, the acceleration input device or the brake input device may be formed in the form of a touch screen, a touch pad, or a button.

The driving operation device 500 may be operated under the control of the controller 170 .

The vehicle driving device 600 is a device that electrically controls driving of various devices in the vehicle 100 .

The vehicle driving unit 600 may include a power train driving unit 610 , a chassis driving unit 620 , a door/window driving unit 630 , a safety device driving unit 640 , a lamp driving unit 650 , and an air conditioning driving unit 660 . can

Depending on the embodiment, the vehicle driving apparatus 600 may further include other components in addition to the described components, or may not include some of the described components.

Meanwhile, the vehicle driving apparatus 600 may include a processor. Each unit of the vehicle driving apparatus 600 may include a processor, respectively.

The power train driver 610 may control the operation of the power train device.

The power train driving unit 610 may include a power source driving unit 611 and a transmission driving unit 612 .

The power source driving unit 611 may control the power source of the vehicle 100 .

For example, when a fossil fuel-based engine is a power source, the power source driving unit 610 may electronically control the engine. Thereby, the output torque of an engine, etc. can be controlled. The power source driving unit 611 may adjust the engine output torque according to the control of the control unit 170 .

For example, when the electric energy-based motor is the power source, the power source driving unit 610 may control the motor. The power source driving unit 610 may adjust the rotation speed, torque, etc. of the motor according to the control of the control unit 170 .

The transmission driving unit 612 may control the transmission.

The transmission driving unit 612 may adjust the state of the transmission. The transmission driving unit 612 may adjust the state of the transmission to forward (D), reverse (R), neutral (N), or park (P).

On the other hand, when the engine is the power source, the transmission driving unit 612 may adjust the engagement state of the gear in the forward (D) state.

The chassis driver 620 may control the operation of the chassis device.

The chassis driving unit 620 may include a steering driving unit 621 , a brake driving unit 622 , and a suspension driving unit 623 .

The steering driving unit 621 may perform electronic control of a steering apparatus in the vehicle 100 . The steering driving unit 621 may change the traveling direction of the vehicle.

The brake driving unit 622 may perform electronic control of a brake apparatus in the vehicle 100 . For example, the speed of the vehicle 100 may be reduced by controlling the operation of a brake disposed on the wheel.

Meanwhile, the brake driving unit 622 may individually control each of the plurality of brakes. The brake driving unit 622 may differently control the braking force applied to the plurality of wheels.

The suspension driving unit 623 may perform electronic control of a suspension apparatus in the vehicle 100 . For example, when there is a curve in the road surface, the suspension driving unit 623 may control the suspension device to reduce vibration of the vehicle 100 .

Meanwhile, the suspension driving unit 623 may individually control each of the plurality of suspensions.

The door/window driving unit 630 may perform electronic control of a door apparatus or a window apparatus in the vehicle 100 .

The door/window driving unit 630 may include a door driving unit 631 and a window driving unit 632 .

The door driving unit 631 may control the door device. The door driving unit 631 may control opening and closing of a plurality of doors included in the vehicle 100 . The door driving unit 631 may control opening or closing of a trunk or a tail gate. The door driving unit 631 may control opening or closing of a sunroof.

The window driving unit 632 may perform electronic control of a window apparatus. Opening or closing of a plurality of windows included in the vehicle 100 may be controlled.

The safety device driving unit 640 may perform electronic control of various safety apparatuses in the vehicle 100 .

The safety device driving unit 640 may include an airbag driving unit 641 , a seat belt driving unit 642 , and a pedestrian protection device driving unit 643 .

The airbag driving unit 641 may perform electronic control of an airbag apparatus in the vehicle 100 . For example, the airbag driving unit 641 may control the airbag to be deployed when a danger is detected.

The seat belt driving unit 642 may perform electronic control of a seat belt appartus in the vehicle 100 . For example, the seat belt driving unit 642 may control the occupant to be fixed to the seats 110FL, 110FR, 110RL, and 110RR using the seat belt when a danger is sensed.

The pedestrian protection device driving unit 643 may perform electronic control for the hood lift and the pedestrian airbag. For example, when detecting a collision with a pedestrian, the pedestrian protection device driving unit 643 may control to lift up the hood and deploy the pedestrian airbag.

The lamp driver 650 may electronically control various lamp apparatuses in the vehicle 100 .

The air conditioning driving unit 660 may perform electronic control of an air conditioner in the vehicle 100 . For example, when the temperature inside the vehicle is high, the air conditioning driving unit 660 may control the air conditioner to operate to supply cool air to the interior of the vehicle.

The vehicle driving apparatus 600 may include a processor. Each unit of the vehicle driving apparatus 600 may include a processor, respectively.

The vehicle driving apparatus 600 may be operated under the control of the controller 170 .

The operation system 700 is a system for controlling various operations of the vehicle 100 . The driving system 700 may be operated in an autonomous driving mode.

The driving system 700 may include a driving system 710 , a vehicle taking-out system 740 , and a parking system 750 .

Depending on the embodiment, the navigation system 700 may further include other components in addition to the described components, or may not include some of the described components.

Meanwhile, the driving system 700 may include a processor. Each unit of the navigation system 700 may each individually include a processor.

Meanwhile, according to an embodiment, when the operation system 700 is implemented in software, it may be a sub-concept of the control unit 170 .

Meanwhile, according to an embodiment, the driving system 700 may control at least one of the user interface device 200 , the object detection device 300 , the communication device 400 , the vehicle driving device 600 , and the control unit 170 . It may be a concept that includes

The driving system 710 may perform driving of the vehicle 100 .

The driving system 710 may receive navigation information from the navigation system 770 and provide a control signal to the vehicle driving device 600 to drive the vehicle 100 .

The driving system 710 may receive object information from the object detection apparatus 300 , and may provide a control signal to the vehicle driving apparatus 600 to drive the vehicle 100 .

The driving system 710 may receive a signal from an external device through the communication device 400 and provide a control signal to the vehicle driving device 600 to drive the vehicle 100 .

The un-parking system 740 may perform un-parking of the vehicle 100 .

The un-parking system 740 may receive navigation information from the navigation system 770 and provide a control signal to the vehicle driving device 600 to un-park the vehicle 100 .

The un-parking system 740 may receive the object information from the object detection apparatus 300 and provide a control signal to the vehicle driving apparatus 600 to un-park the vehicle 100 .

The un-parking system 740 may receive a signal from an external device through the communication device 400 and provide a control signal to the vehicle driving apparatus 600 to un-park the vehicle 100 .

The parking system 750 may perform parking of the vehicle 100 .

The parking system 750 may receive navigation information from the navigation system 770 and provide a control signal to the vehicle driving device 600 to park the vehicle 100 .

The parking system 750 may receive object information from the object detection apparatus 300 , and may provide a control signal to the vehicle driving apparatus 600 to park the vehicle 100 .

The parking system 750 may receive a signal from an external device through the communication device 400 and provide a control signal to the vehicle driving apparatus 600 to park the vehicle 100 .

The navigation system 770 may provide navigation information. The navigation information may include at least one of map information, set destination information, route information according to the destination setting, information on various objects on a route, lane information, and current location information of the vehicle.

The navigation system 770 may include a memory and a processor. The memory may store navigation information. The processor may control the operation of the navigation system 770 .

According to an embodiment, the navigation system 770 may receive information from an external device through the communication device 400 and update pre-stored information.

According to an embodiment, the navigation system 770 may be classified into sub-components of the user interface device 200 .

The sensing unit 120 may sense the state of the vehicle. The sensing unit 120 may include a posture sensor (eg, a yaw sensor, a roll sensor, a pitch sensor), a collision sensor, a wheel sensor, a speed sensor, and an inclination. sensor, weight sensor, heading sensor, yaw sensor, gyro sensor, position module, vehicle forward/reverse sensor, battery sensor, fuel sensor, tire sensor, steering wheel It may include a steering sensor by rotation, a vehicle internal temperature sensor, a vehicle internal humidity sensor, an ultrasonic sensor, an illuminance sensor, an accelerator pedal position sensor, a brake pedal position sensor, and the like.

The sensing unit 120 includes vehicle posture information, vehicle collision information, vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle inclination information, vehicle forward/reverse information, and a battery. Acquire sensing signals for information, fuel information, tire information, vehicle lamp information, vehicle interior temperature information, vehicle interior humidity information, steering wheel rotation angle, vehicle exterior illumination, pressure applied to the accelerator pedal, and pressure applied to the brake pedal can do.

The sensing unit 120 is, in addition, an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an intake air temperature sensor (ATS), a water temperature sensor (WTS), and a throttle position sensor. (TPS), a TDC sensor, a crank angle sensor (CAS), and the like.

The interface unit 130 may serve as a passage with various types of external devices connected to the vehicle 100 . For example, the interface unit 130 may have a port connectable to the mobile terminal, and may connect to the mobile terminal through the port. In this case, the interface unit 130 may exchange data with the mobile terminal.

Meanwhile, the interface unit 130 may serve as a passage for supplying electrical energy to the connected mobile terminal. When the mobile terminal is electrically connected to the interface unit 130 , under the control of the controller 170 , the interface unit 130 may provide the electric energy supplied from the power supply unit 190 to the mobile terminal.

The memory 140 is electrically connected to the control unit 170 . The memory 140 may store basic data for the unit, control data for operation control of the unit, and input/output data. The memory 140 may be various storage devices such as ROM, RAM, EPROM, flash drive, hard drive, etc. in terms of hardware. The memory 140 may store various data for the overall operation of the vehicle 100 , such as a program for processing or controlling the controller 170 .

According to an embodiment, the memory 140 may be formed integrally with the control unit 170 or may be implemented as a sub-component of the control unit 170 .

The controller 170 may control the overall operation of each unit in the vehicle 100 . The control unit 170 may be referred to as an Electronic Control Unit (ECU).

The power supply unit 190 may supply power required for the operation of each component under the control of the control unit 170 . In particular, the power supply unit 190 may receive power from a battery inside the vehicle.

Included in the vehicle 100, one or more processors and control unit 170, ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs ( field programmable gate arrays), processors, controllers, micro-controllers, microprocessors, and other electrical units for performing functions.

Meanwhile, the vehicle 100 related to the present invention may include a vehicle control device 800 .

The vehicle control apparatus 800 may control at least one of the components described with reference to FIG. 7 . From this point of view, the vehicle control device 800 may be the controller 170 .

However, the present invention is not limited thereto, and the vehicle control device 800 may have a separate configuration independent of the control unit 170 . When the vehicle control apparatus 800 is implemented as a component independent of the control unit 170 , the vehicle control apparatus 800 may be provided in a part of the vehicle 100 .

Hereinafter, for convenience of description, the vehicle control device 800 will be described as a separate component independent of the control unit 170 . Functions (operations) and control methods described for the vehicle control apparatus 800 in this specification may be performed by the control unit 170 of the vehicle. That is, all contents described in relation to the vehicle control device 800 may be analogously applied to the control unit 170 in the same/similar manner.

In addition, the vehicle control device 800 described in this specification may include the components described with reference to FIG. 7 and some of various components provided in the vehicle. In this specification, for convenience of description, the components described with reference to FIG. 7 and various components provided in the vehicle will be described with separate names and reference numerals.

Hereinafter, components included in the vehicle control apparatus 800 according to an embodiment of the present invention will be described in more detail with reference to the accompanying drawings.

8 is a conceptual diagram for explaining a vehicle control apparatus according to an embodiment of the present invention.

The vehicle control apparatus 800 related to the present invention may include a sensing unit 810 , a display unit 820 , a processor 870 , and the like.

The vehicle control apparatus 800 related to the present invention may include a sensing unit 810 .

The sensing unit 810 may include at least one of the object detecting apparatus 300 described with reference to FIG. 7 , the sensing unit 120 provided in the vehicle 100 , and the internal camera 220 provided in the vehicle 100 . can The sensing unit 810 may be formed of any one or a combination of at least two or more of the object detecting device 300 , the sensing unit 120 , and the internal camera 220 .

In addition, the sensing unit 810 includes an object detecting device 300 provided in the vehicle, the sensing unit 120 provided in the vehicle 100 , and an internal camera 220 provided in the vehicle 100 . It may be a sensing unit. Even when the sensing unit 810 is an independent sensing unit, the sensing unit 810 may include the characteristics of the sensing unit 120 , the internal camera 220 , or the object device 300 described with reference to FIG. 7 .

The sensing unit 810 may include the camera 310 described with reference to FIG. 7 .

In addition, the sensing unit 810 includes a camera 310 , a radar 320 , a lidar 330 , an ultrasonic sensor 340 , an infrared sensor 350 , and a sensing unit included in the object detection apparatus 300 . At least two of 120 and the input unit 210 (or the voice input unit 211 ) may be combined and implemented.

The sensing unit 810 may detect an object existing in the vicinity of the vehicle 100 and may sense information related to the object.

For example, the object may include the above-described surrounding vehicles, surrounding people, surrounding objects, surrounding terrain, and the like.

The sensing unit 810 may sense information related to the vehicle 100 of the present invention.

The vehicle-related information may be at least one of vehicle information (or driving state of the vehicle) and surrounding information of the vehicle.

For example, vehicle information includes the vehicle's driving speed, the vehicle's weight, the number of passengers in the vehicle, the vehicle's braking force, the vehicle's maximum braking force, the vehicle's driving mode (whether autonomous driving mode or manual driving mode), and vehicle parking mode (autonomous parking mode, automatic parking mode, manual parking mode), whether the user is in the vehicle, the status of the user present in the vehicle, and information related to the user (eg, whether the user is an authenticated user) Whether or not), etc. may be included.

The surrounding information of the vehicle may include, for example, the state of the road surface on which the vehicle is driving (friction force, whether or not a porthole exists, the type of road surface, etc.), weather, the distance to the front (or rear) vehicle, and the relative of the front (or rear) vehicle. Speed, location information of other vehicles, location information of objects (objects), curvature rate of the curve when the driving lane is a curve, ambient brightness of the vehicle, information related to objects existing within the reference area (constant area) based on the vehicle; It may be whether an object enters/leaves from the predetermined area, whether a user exists around the vehicle, and information related to the user (eg, whether the user is an authenticated user), and the like.

In addition, the surrounding information (or surrounding environment information) of the vehicle includes external information of the vehicle (eg, ambient brightness, temperature, sun position, surrounding subject (person, other vehicle, sign, etc.) information, and the type of road surface being driven. , topographical features, lane information, driving lane information), and information required for autonomous driving/autonomous parking/automatic parking/manual parking modes may be included.

In addition, the surrounding information of the vehicle includes an object (object) existing around the vehicle and the distance to the vehicle 100, the type of the object, a parking space in which the vehicle can be parked, and an object for identifying a parking space (for example, Parking lines, ropes, other vehicles, walls, etc.) may be further included.

In addition, the information related to the vehicle may include information related to driving of the vehicle, whether a passenger is on board next to the driver of the vehicle, and information related to content output to the display unit.

The driving-related information of the vehicle may include a driving mode (normal mode, sports mode, eco mode, etc.) of the vehicle, the speed of the vehicle, whether the vehicle is accelerated/decelerated, and the like.

Whether or not a passenger rides next to the driver of the vehicle is determined (determined) through an image received through the internal camera 220 of the sensing unit 810, or determined (determined) by a DSM (Driver Status Monitoring) system can be

The sensing unit 810 may determine (determine) whether a passenger is on board next to the driver of the vehicle by using a sensor (eg, a pressure sensor, etc.) formed on a seat provided inside the vehicle.

The information related to the content output to the display unit includes the type of content (eg, moving picture, image, graphic object, web page, various information, etc.) and the output type/output size of the execution screen of the content when the content is output. It may include /output ratio, information on whether the content is content linked to bend the display unit, and the like. Information related to the content output to the display unit may be sensed by the sensing unit 810 or sensed (detected, determined, determined, or extracted) by the processor 870 .

Also, the sensing unit 810 related to the present invention may sense the driver's gaze. The driver's gaze, for example, may be sensed (determined, determined, extracted, detected) based on an image received through an internal camera included in the sensing unit 810 .

The processor 870 determines, through the sensing unit 810 , the direction in which the driver's gaze is directed, whether the driver's gaze is directed toward any of a plurality of regions of the display unit, or which region of the plurality of regions of the display unit by the driver. It is possible to determine (judgment, extraction, detection, sensing) whether the region is gazing or not.

Since sensing the driver's gaze using a sensing unit (camera) is a general technique, a detailed description of the algorithm will be omitted.

Hereinafter, for convenience of description, a case in which the sensing unit 810 is separately provided in the vehicle control device 800 will be described as an example. The processor 870 acquires certain information through the sensing unit 810 means that the processor 870 is an object detecting device 300 provided in the vehicle 100 and a sensing unit 120 provided in the vehicle 100 . , it may be understood that certain information is acquired by using at least one of the internal camera 220 and the processor 870 provided in the vehicle 100 .

The display unit 820 included in the vehicle control device 800 related to the present invention is a display device provided in the vehicle 100 and may be the display unit 251 described above.

The display unit 820 may be the output unit 250 or the display unit 251 described in FIG. 7 . Also, the display unit 820 may include a transparent display. The transparent display may be attached to a windshield or window.

The display unit 820 includes one area of the steering wheel, one area 251a, 251b, and 251e of the instrument panel, one area 251d of the seat, one area 251f of each pillar, and one area of the door ( 251g), one area of the center console, one area of the head lining, one area of the sun visor, or one area 251c of the windshield and one area 251h of the window.

For example, the display unit 820 may include a cluster, a center fascia display (CID), a navigation device, and a head-up display (HUD).

The processor 870 may output various vehicle-related information to the display unit 820 . Also, the processor 870 may output the vehicle-related information to different locations on the display unit 820 according to the type of vehicle-related information.

The display unit 820 of the present invention may be provided in one area of the aforementioned instrument panel (or dashboard) to output (provide) content to the driver and/or passengers. there is.

Also, the display unit 820 may form a single display by integrating the cluster and the CID, or may refer to only the cluster.

The display unit 820 may include a plurality of regions formed to output information. Various information may be output to each of the plurality of areas.

The plurality of regions may be divided in advance when the display unit is produced or may be divided by output information (content, image, video, graphic object, text, etc.).

In addition, the plurality of regions may be determined or changed according to a setting of the processor 870 or a user.

In addition, the vehicle control apparatus 800 of the present invention may include a processor 870 capable of controlling the sensing unit 810 and the display unit 820 .

The processor 870 may be the control unit 170 described with reference to FIG. 7 .

The processor 870 may control the components described with reference to FIG. 7 and the components described with reference to FIG. 8 .

The processor 870 may control the display unit 820 in various ways based on the driver's gaze sensed through the sensing unit 810 .

For example, the processor 870 may display information displayed in a region other than the region to which the driver's gaze is directed among the plurality of regions of the display 820 based on the driver's gaze sensed by the sensing unit 810 . You can change the method.

As another example, the processor 870 may be configured to, based on the driver's gaze sensed by the sensing unit 810 , a region to which the driver's gaze is directed among a plurality of regions of the display unit 820 (ie, a region where the driver is gazing). You can change the display method of the information displayed in .

Hereinafter, a method of controlling a display unit in various ways based on a driver's gaze in a vehicle according to an embodiment of the present invention will be described in more detail with reference to the accompanying drawings.

9 is a flowchart for explaining a representative control method of the present invention, and FIGS. 10, 11, 12, 13, 14, 15, 16 and 17 are for explaining the control method shown in FIG. It is a conceptual diagram.

Referring to FIG. 9 , in the present invention, the step of sensing the driver's gaze is performed (S910). Specifically, the processor 870 may sense the driver's gaze using the sensing unit 810 described above.

Specifically, the processor 870 may detect the driver's gaze by using an image received through the sensing unit 810 (eg, an internal camera). The internal camera may be formed to face the driver. That is, the internal camera is formed to photograph the driver, and may be a driver monitoring camera of a DSM (Driver Status Monitoring) system.

The processor 870 may detect (detect, detect, determine) the driver's gaze using the image received through the internal camera (sensing unit 810). Here, the driver's gaze means the road or the driver's eye direction on which the driver's eyes gaze (gazing, looking, heading), and the meaning of the point on which the driver's gaze is directed (gazing point, gazing area) can include up to

The processor 870 may receive an image through an internal camera (sensing unit 810) configured to photograph the driver, and detect the driver's gaze by using (analyzing) the received image. Since a generally known method may be used to detect the driver's gaze using the image, a detailed description thereof will be omitted.

Thereafter, in the present invention, a step of changing the display method of information displayed in an area other than the area to which the driver's gaze is directed among the plurality of areas of the display unit is performed ( S920 ).

Specifically, the processor 870 of the vehicle control device 800 related to the present invention may change the display method of information displayed in a region other than the region to which the driver's gaze is directed among a plurality of regions of the display unit based on the driver's gaze. can

Hereinafter, a method of changing a display method of information displayed in an area other than the area to which the driver's gaze is directed will be described in more detail with reference to the accompanying drawings.

Referring to FIG. 10 , the internal camera included in the sensing unit 810 of the present invention may be configured to photograph the driver. The processor 870 may photograph the driver through the sensing unit 810 (internal camera). The processor 870 may sense the driver's gaze through the image captured by the driver.

The processor 870 may sense the driver's gaze through the sensing unit 810 based on a preset condition being satisfied.

Here, the preset condition may include various conditions linked to sensing the driver's gaze by controlling the sensing unit 810 , and may be determined by a user's setting or control of the processor 870 .

For example, the preset condition is when a user input is received, when the driving state of the vehicle corresponds to a specific condition (for example, when decelerating/accelerating, when the probability of collision with another vehicle is greater than or equal to a certain value) , when another vehicle is detected within a certain distance from the current vehicle, when the steering direction is changed by more than a certain angle, when the surrounding environment (weather, etc. corresponds to a specific environment, etc.) case or the type of road on which the vehicle is traveling (highway, city, national road, parking lot, etc.), etc. may be included.

Meanwhile, the display unit 820 of the present invention may include a plurality of areas 820a, 820b, and 820c capable of displaying information (images, images, graphic objects, pages, etc.).

Information set to be output may be output to the plurality of regions 820a, 820b, and 820c. In addition, the processor 870 may determine information to be output to the plurality of regions 820a, 820b, and 820c according to various conditions, or may change previously output information to other information.

For example, vehicle-related information may be output to a plurality of regions of the display unit 820 . The vehicle-related information may include state information of the vehicle and information related to driving of the vehicle.

The vehicle state information may include content being output from the vehicle and information related to components (eg, lamps, seat belts, engine oil, etc.) constituting the vehicle.

The information related to the driving of the vehicle includes the speed of the vehicle, RPM information of the vehicle engine, an image received through a camera disposed to photograph the exterior of the vehicle, a graphic object indicating the state of the exterior of the vehicle, and information related to an ADAS function, etc. may include

The plurality of regions may be two or more. In the present specification, the number of the plurality of regions 820a, 820b, and 820c will be described as an example.

On the other hand, when the driver's gaze 900 is sensed through the sensing unit 810 , the processor 870 is configured to include a region (ie, the driver) to which the driver's gaze 900 is directed among a plurality of regions of the display unit 820 . area) can be determined (sensing, detecting, judging, extracting).

For example, as shown in FIG. 10 , the plurality of regions of the display unit 820 may include a first region 820a and second regions 820b and/or 820c different from the first region. there is.

As shown in FIG. 10 , when the sensed driver's gaze 900 is directed toward the first area 820a, the processor 870 is configured to perform a second area 820b and/or a second area other than the first area 820a. The display method of the information displayed in 820c) may be changed.

For example, as shown in (a) of FIG. 11 , various information may be displayed in the plurality of areas 820a, 820b, and 820c. For example, the various information may include RPM information (RPM meter), speed information (speed meter), map information 110a, and a graphic object 1100b indicating a situation outside the vehicle.

For example, as shown in FIG. 11B , when the driver's gaze 900 is directed toward the first area 820a among the plurality of areas of the display unit 820 , the processor 870 is configured to At least some of the plurality of pieces of information output to the second area (eg, 820b) other than the first area 820a (eg, map information 1100a) may not be output.

For example, linked information may be output to the display unit 820 so that the information being output disappears when the driver's gaze is not directed. In this case, the processor 870 may lose the information when the driver's gaze is directed toward an area to which the information is not output (ie, the driver's gaze does not face an area to which the information is output). (May not be printed).

As another example, as shown in FIG. 11B , when the driver's gaze 900 is directed toward the first area 820a among the plurality of areas of the display unit 820 , the processor 870 may be configured to The brightness of the second area different from the first area 820a (ie, the second area (eg, 820c ) to which the driver's gaze 900 is not directed may be reduced. In other words, the processor 870 may Among the plurality of regions of the unit 820 , a region to which the driver's gaze 900 is not directed may be dimmed.

As another example, the processor 870 may set the first information related to the vehicle displayed in the second area to which the driver's gaze 900 is not directed, the second information different from the first information (ie, the second information related to the vehicle). can be changed to

The first information and the second information are vehicle-related information, and may be, for example, information indicating a driving state of the vehicle. The first information may be information with a large amount of information, and the second information may be information with a small amount of information. That is, the second information may have a smaller amount of information than the first information. That is, the second information may be understood as information more simplified than the first information.

For example, as shown in (a) of FIG. 13 , the first information may be an image 1220a received through a camera disposed to photograph the outside of the vehicle. As an example, the camera may include a camera 1210a formed to photograph the left rear side of the vehicle and a camera 1210b formed to photograph the right rear side of the vehicle (refer to FIG. 12(a) ).

An image received through the cameras 1210a and 1210b may correspond to a screen viewed through a side mirror.

As shown in (b) of FIG. 13 , the second information may be a graphic object 1300a indicating a situation outside the vehicle.

As an example, the graphic object representing the situation outside the vehicle includes a graphic object formed in a simplified form of an object (eg, another vehicle) existing within a certain distance based on the present vehicle 100 , and the present vehicle. It may include a corresponding graphic object.

The processor 870 may sense an object existing within a predetermined distance from the vehicle viewed through the sensing unit 810 , and may also sense the type of the object. For example, the processor 870 may sense the type of object existing within the predetermined distance, the distance (or relative speed, etc.) between the vehicle and the object, or the possibility of a collision.

The graphic object representing the situation outside the vehicle may be changed based on a change in the location of an object (eg, another vehicle) positioned with respect to the present vehicle.

The graphic object representing the external situation may inform the driver of the external situation in a simpler form than an image received through a camera disposed to photograph the outside of the vehicle.

An image received through a camera disposed to photograph the outside of the vehicle may be output to a second area (eg, 820c) of the plurality of areas of the display unit 820 .

In this state, when the driver's gaze 900 faces a first area among the plurality of areas of the display unit 820 , the processor 870 is configured to generate a second area (eg, the driver's gaze 900 ) not directed toward For example, the image (first information) being displayed in 820c may be changed to the graphic object (second information).

Through this configuration, the present invention provides a vehicle control device that prevents the driver's gaze from guiding the driver's gaze to an unnecessary part by not outputting the information being output to a place where the driver's gaze is not directed, reducing the brightness, or changing the information to simple information. can provide

Meanwhile, the vehicle control apparatus 800 related to the present invention may change a display method of information displayed on an area to which the driver's gaze is directed among a plurality of areas included in the display unit 820 .

Referring to FIG. 12A , the processor 870 related to the present invention senses (determines whether the driver's gaze is directed toward the side mirrors 1200a and 1200b provided in the vehicle through the sensing unit 810). , judge, detect, extract).

Specifically, the processor 870 may sense whether the driver's gaze is directed toward the left side mirror 1200a or the right side mirror 1200b through the sensing unit 810 .

Thereafter, the processor 870 may activate the cameras 1210a and 1210b arranged to photograph the outside of the vehicle based on the driver's gaze 900 toward the side mirror. The processor 870 may output an image received through the cameras 1210a and 1210b arranged to photograph the outside of the vehicle to the display unit 820 based on the driver's gaze 900 facing the side mirror. there is.

At this time, for example, as shown in (a) of FIG. 12 , the processor 870 is arranged to photograph the outside of the vehicle when the driver's gaze 900 is directed toward the left side mirror 1200a. An image received through the camera 1210a (or the first camera) disposed to photograph the left rear of the cameras may be output to the display unit 820 .

At this time, the image 1220a received through the camera 1210a arranged to photograph the left rear is a first area among the plurality of areas of the display unit 820 as shown in FIG. 12B . It may be output to 820a (or the leftmost region).

On the other hand, although not shown, the processor 870, when the driver's gaze 900 is directed toward the right side mirror 1200b, the camera 1210b arranged to photograph the right rear of the cameras arranged to photograph the outside of the vehicle. An image received through (or the second camera) may be output to the display unit 820 .

In this case, the image 1220b received through the camera 1210a arranged to photograph the right rear side is the third region 820c (or the rightmost region) among the plurality of regions of the display unit 820 . can be output to

Through this configuration, in the present invention, when the driver looks at the side mirror, the image received through the camera arranged to photograph the outside of the vehicle (that is, the image corresponding to the screen displayed on the side mirror) is displayed on the display unit inside the vehicle. It is possible to provide a vehicle interface that allows the driver to see the rear left or right rear of the vehicle more conveniently by outputting it to the .

Meanwhile, the processor 870 may additionally output a graphic object to an area to which the driver's gaze is directed.

For example, in the first area 820a of the display unit 820 , an image 1220a received through a camera 1210a disposed to photograph the exterior of the vehicle may be output.

At this time, as shown in FIG. 12(c) , the processor 870 is configured to generate an area 820a from which the image 1220a is output among a plurality of areas of the display unit 820 in which the driver's gaze 900 is displayed. In the case of , as shown in FIG. 12D , a graphic object 1230 may be additionally output to an area 820a toward which the driver's gaze 900 is directed.

Specifically, the processor 870 is in a state in which an image 1220a received through a camera 1210a disposed to photograph the exterior of a vehicle in any one of a plurality of regions of the display unit 820 is being output. , the graphic object 1230 may be output based on the direction of the driver's gaze 900 toward the one area 820a.

In this case, the graphic object 1230 may be output when the probability of a collision between the present vehicle 100 and another vehicle is greater than or equal to a predetermined value. Here, the processor 870 may sense information related to the present vehicle and information related to another vehicle through the sensing unit 810 . Also, the processor 870 may calculate the possibility of collision between the present vehicle and the other vehicle based on the information related to the present vehicle and information related to the other vehicle.

For example, the processor 870 may generate a collision between the present vehicle and another vehicle based on the speed of the present vehicle, the speed of the other vehicle, the relative speed between the present vehicle and the other vehicle, and the distance between the present vehicle and the other vehicle. The estimated time (Time to Collusion, TTC) can be calculated.

The collision probability may be determined based on the expected collision time, and the expected collision time and the collision probability may be inversely proportional. For example, the shorter the expected collision time, the higher the collision probability, and the longer the expected collision time, the lower the collision probability.

The graphic object 1230 additionally output to an image received through a camera disposed to photograph the outside of the vehicle may be a graphic object for warning the driver of the risk of collision with the other vehicle.

Accordingly, the processor 870 displays the graphic object 1230 among a plurality of areas of the display unit (via a camera disposed to photograph the outside of the vehicle) when the probability of collision between the present vehicle 100 and another vehicle is greater than or equal to a predetermined value. Among the regions where the received image is output), the driver's gaze may be directed to the region.

In this case, the graphic object 1230 may be output based on a portion corresponding to the other vehicle in the image, as shown in (d) of FIG. 12 .

The graphic object 1230 may overlap a portion of an image received through a camera disposed to photograph the outside of the vehicle, and the portion of the image may be a portion (or a portion) corresponding to the other vehicle. It may also be a peripheral area of a portion corresponding to the other vehicle.

Meanwhile, as shown in (d) of FIG. 12 , the processor 870 does not output at least a part 1100a of the plurality of pieces of information being output to regions (eg, 820b and 820c) to which the driver's gaze is not directed. Alternatively, the brightness of an area to which the driver's gaze is not directed may be reduced. Also, although not shown, the processor 870 may change information output to an area to which the driver's gaze is not directed among the plurality of areas.

Also, the processor 870 may change a display method of information output to an area to which the driver's gaze is directed. Specifically, the processor 870 may change the first information related to the vehicle displayed in the area to which the driver's gaze is directed into the second information different from the first information.

Here, the first and second information may be opposite to the first and second information described above. For example, the first information may be a graphic object representing a situation outside the vehicle, and the second information may be an image received through a camera disposed to photograph the outside of the vehicle.

That is, in a state in which the first information related to the vehicle (a graphic object indicating a situation outside the vehicle) is being output to any one of the plurality of areas of the display unit 820 , the processor 870 may Based on the sensed that the driver's gaze 900 is directed, the first information output to the one area is converted into vehicle-related second information (image received through a camera disposed to photograph the exterior of the vehicle). can be changed

Also, the processor 870 may increase the brightness of an area to which the driver's gaze is directed.

That is, the processor 870 outputs specific (or more realistic) information that can help the driver more intuitively drive the vehicle in the area to which the driver's gaze is directed, thereby improving driving convenience and safety at the same time. A vehicle interface can be provided.

Referring to FIGS. 13 and 14 , the above description will become more clear.

13A, at least some of the plurality of areas 820a, 820b, and 820c of the display unit have cameras 1210a and 1210b disposed to photograph the outside of the vehicle. The resulting images 1220a and 1220b may be output.

At this time, the processor 870 displays the images 1220a and 1220b in at least some of the plurality of regions 820a, 820c).

Thereafter, when the driver's gaze 900 is not directed toward the image being outputted from the images 1220a and 1220b for a predetermined period of time, the processor 870, as shown in FIG. , 1220b may be changed to graphic objects 1300a and 1300b indicating a situation outside the vehicle, information output to the output regions 820a and 820c.

Here, as shown in (b) of FIG. 13 , the processor 870 of the vehicle control apparatus 800 of the present invention may display the driver's gaze on any one of a plurality of areas of the display unit 820 . Even if 900 is directed, the display method of the information output to the one area 820b may not be changed. For example, preset information (eg, speed information, RPM information, map information, etc.) is output to the one area 820b, and the one area 820b is the one area 820b where the driver's gaze is directed or not. The preset information may always be output (that is, regardless of the driver's gaze).

Thereafter, as shown in (c) of FIG. 13 , the processor 870 places the driver in any one of the regions 820a and 820c in which the graphic objects 1300a and 1300b are output (eg, 820a). When the gaze 900 of 's gaze 900 is directed, the information (graphic object 1300a representing the situation outside the vehicle) being output to the one area 820a is transferred to other information (image received through a camera arranged to photograph the exterior of the vehicle). (1220a)).

That is, the processor 870 of the present invention, as described above, is based not only on the case where the driver's gaze is directed toward the side mirror, but also based on the fact that the driver's gaze is directed to a region where the image 1220a can be output among a plurality of regions. Accordingly, the image 1220a may be output to an area in which the driver's gaze is directed.

In addition, the processor 870, as shown in FIG. 13(c), when the probability of collision between the present vehicle and the other vehicle is equal to or greater than a predetermined value, the processor 870 is configured based on the portion corresponding to the other vehicle in the image 1220a. The graphic object 1230 may be output.

Referring to FIG. 14A , based on the driver's gaze 900 toward the first area 820a among the plurality of areas, the processor 870 places the first area 820a on the outside of the vehicle. The image 1220a received through the camera 1210a arranged to photograph the image 1220a may be output.

If another vehicle exists within a certain distance from the present vehicle and the probability of a collision between the present vehicle and the other vehicle is greater than or equal to a predetermined value, the processor 870 places a graphic on a portion corresponding to the other vehicle in the image 1220a. An object 1230 may be output (overlapped).

Conversely, as illustrated in (b) of FIG. 14 , based on the driver's gaze 900 toward the third area 820c among the plurality of areas, the processor 870 may An image 1220b received through a camera 1210b disposed to photograph the outside of the vehicle may be output.

Here, when another vehicle exists within a certain distance from the present vehicle and the probability of collision between the present vehicle and the other vehicle is equal to or greater than a predetermined value, the processor 870 places a graphic on a portion corresponding to the other vehicle in the image 1220b. An object 1230 may be output (overlapped).

Meanwhile, when the vehicle is moving in a straight line, the processor 870 outputs a graphic object representing a situation outside the vehicle in the first area 820a and the third area 820c among the plurality of areas of the display unit 820 . can do.

Thereafter, the processor 870, when it is detected that the vehicle changes to the left lane by the driver's manipulation (for example, rotating the steering wheel to the left by more than a certain angle or turning on the left blinker), An image 1220a received through a camera disposed to photograph the left rear of the vehicle may be output in the first area (or the leftmost area) among the plurality of areas of the display unit 820 .

In addition, the processor 870 is a graphic warning that a portion corresponding to the other vehicle in the image 1220a has a possibility of collision when the probability of collision between the vehicle and another vehicle existing in the left lane is equal to or greater than a predetermined value. An object 1230 may be output.

When it is sensed that the vehicle changes a lane to the right lane by the driver's manipulation (eg, rotating the steering wheel to the right by more than a certain angle or turning on the right blinker), the processor 870 is configured to display the display An image 1220b received through a camera disposed to photograph the right rear side of the vehicle may be output in the third area (or the rightmost area) among the plurality of areas of the unit 820 .

In addition, the processor 870 is a graphic warning that a portion corresponding to the other vehicle in the image 1220b is likely to collide when the probability of collision between the vehicle and another vehicle existing in the right lane is greater than or equal to a predetermined value. An object 1230 may be output.

Hereinafter, a method of outputting information optimized to a display unit to induce a driver's gaze according to various embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings.

The processor 870 may output an image received through a camera disposed to photograph the exterior of the vehicle to at least one of a plurality of regions of the display unit.

For example, the processor 870 may output an image received through a camera disposed to photograph the exterior of the vehicle to a first area (eg, 820a ) toward which the driver's gaze is directed among the plurality of areas.

At this time, as shown in (a) of FIG. 15 , when the image satisfies a preset condition, the processor 870 sets a graphic object different from the image to a second different graphic object from the first area 820a. It may output to the area (eg, 820b).

15 (a) and (b), the preset condition is when the image 1500 is out of focus, when water droplets form on the camera that receives the image 1500, the image 1500 ) may be dark, so the object cannot be identified.

For example, as shown in (a) of FIG. 15 , when water droplets form on the camera receiving the image 1500 and the image 1500 is out of focus, the processor 870 performs the ), a graphic object 1510 different from the image 1500 may be output to a second area (eg, 820b) different from the first area 820a on which it is output.

For example, the graphic object 1510 may be an image received through a camera different from the camera on which the water droplets are formed, or an infrared image received through an infrared camera, and the graphic object 1510 includes AR (argumented reality). Information may overlap.

As another example, as shown in (b) of FIG. 15 , the image 1520 output to the first area to which the driver's gaze is directed is set under a preset condition (for example, the brightness of the image is dark below a certain value and the object is difficult to identify), a graphic object 1530 (eg, an infrared image) different from the image 1520 output to the first area may be output to a second area different from the first area.

Through this configuration, in the present invention, even if the driver's gaze is directed toward the first region, if the image being output to the first region corresponds to a preset condition (that is, a condition difficult to identify), the first region is different from the first region. It is possible to provide an interface for a vehicle that can induce a driver's gaze by outputting different images to the two areas.

As another example, the processor 870, as shown in (c) of FIG. 15 , when the vehicle performs a lane change by the driver's manipulation, a camera provided in the lane changing direction (left direction) ( The image 1220a received through 1210a may be output to the leftmost area (eg, the first area 820a) among the plurality of areas of the display unit 820 .

At this time, when the driver's gaze 900 sensed by the sensing unit 810 is directed toward a second area (eg, 820c) instead of the first area 820a, the processor 870 is configured to control the image. 1220a may be additionally output to the area 820c toward which the driver's gaze is directed.

Through this configuration, in the present invention, when the driver's gaze is directed in a direction different from the driving direction (or lane change direction) of the vehicle, the driving of the vehicle is made so that the driver is aware of a situation occurring in the driving direction of the vehicle. The accident prevention rate can be increased by additionally outputting an image capturing the situation in the direction to the area to which the driver's gaze is directed.

Meanwhile, the sensing unit 810 related to the present invention may sense (determine, determine, extract, detect) the possibility of collision with another vehicle.

Here, the processor 870 may sense information related to the present vehicle and information related to another vehicle through the sensing unit 810 . Also, the processor 870 may calculate the possibility of collision between the present vehicle and the other vehicle based on the information related to the present vehicle and information related to the other vehicle.

For example, the processor 870 may generate a collision between the present vehicle and another vehicle based on the speed of the present vehicle, the speed of the other vehicle, the relative speed between the present vehicle and the other vehicle, and the distance between the present vehicle and the other vehicle. The estimated time (Time to Collusion, TTC) can be calculated.

The collision probability may be determined based on the expected collision time, and the expected collision time and the collision probability may be inversely proportional. For example, the shorter the expected collision time, the higher the collision probability, and the longer the expected collision time, the lower the collision probability.

For example, the processor 870 senses another vehicle 1600 approaching the vehicle 100 through the sensing unit 810 as shown in FIG. 16A , and the other vehicle and can sense the possibility of collision.

Thereafter, when the probability of collision with the other vehicle 1600 is equal to or greater than a predetermined value, the processor 870 uses a camera arranged to photograph the outside of the vehicle based on the direction in which the other vehicle exists with respect to the present vehicle. An image received through the display may be output to at least one of a plurality of regions of the display unit 820 .

For example, as shown in (a) of FIG. 16 , when the other vehicle 1600 is present on the right rear side with respect to the vehicle 100 as viewed, the processor 870 is configured to photograph the outside of the vehicle. Among the arranged cameras, a camera 1210b arranged to photograph the right rear side may be activated, and an image 1220b may be received through the activated camera 1210b.

Thereafter, the processor 870 may output the image 1220b to at least one of a plurality of regions of the display unit 820 . In this case, the region where the image 1220b is output may be determined based on the direction (position) of the other vehicle (or the type of the activated camera).

In (a) of FIG. 16 , since the other vehicle 1600 exists in the right direction with respect to the vehicle 100 (or the activated camera is a camera arranged to photograph the right rear side), the image 1220b is , may be output to the rightmost region among the plurality of regions of the display unit 820 .

If the collision probability is greater than or equal to a predetermined value, if there is another vehicle on the left side with respect to the viewed vehicle, the processor 870 displays the image received through the camera 1210a arranged to photograph the left rear of the plurality of areas. It can be printed in the area provided on the leftmost side.

Meanwhile, the processor 870 may display an image received through a camera disposed to photograph the exterior of the vehicle based on the vehicle 100 satisfying a preset condition among a plurality of regions of the display unit 820 . You can print one.

Here, the preset condition may mean a state of the vehicle 100 linked to output the image or a driving state of the vehicle.

For example, as shown in (b) of FIG. 16, the processor 870 senses a traffic light through the sensing unit 810, and when the vehicle is stopped by the signal of the traffic light, the outside of the vehicle Images 1220a and 1220b received through a camera arranged to be photographed may be output to at least one of a plurality of regions 820a and 820c of the display unit 820 .

In addition, although not shown, the processor 870 is an image captured by another vehicle approaching the vehicle from among a plurality of images received through a camera disposed to photograph the outside of the vehicle (eg, only from the right rear side) When another vehicle approaches, only the image 1220b photographed from the right rear) is at least one of the plurality of regions of the display unit 820 (eg, the rightmost image 1220b from the rear right side) may be output to the area 820c located in .

Through this configuration, the present invention can provide a new vehicle interface that allows the vehicle to be easily identified through the display unit instead of the side mirror when the vehicle is stopped by a signal.

Then, the processor 870, when the vehicle starts by a signal of a traffic light through the sensing unit 810, an image received through a camera disposed to photograph the exterior of the vehicle as a graphic object representing a situation outside the vehicle It can be changed to (1300a, 1300b).

Through this, the present invention can prevent unnecessary information from being exposed on the display unit.

On the other hand, the processor 870, when the vehicle is driving in a narrow alley (or driving a road in which the width d of the road is less than or equal to a certain size), as shown in (a) of FIG. 17, the exterior of the vehicle An image received through a camera (eg, an AVM camera) arranged to photograph may be output to at least one of a plurality of regions of the display unit.

In addition, the processor 870, when the vehicle is parked (eg, parked in reverse), as shown in FIG. 17 ( b ), a camera arranged to photograph the outside of the vehicle (eg, An image received through the AVM camera) may be output to at least one of a plurality of regions of the display unit.

For example, an image 1220a received through a camera arranged to photograph the left rear is output to a first region 820a (a region located on the leftmost side) among the plurality of regions, and a third region among the plurality of regions is output. An image 1220b received through a camera disposed to photograph the right rear may be output to the region 820c (the region located at the rightmost side).

In addition, in the second area 820b located between the first area and the third area among the plurality of areas, images of front/rear/left/right of the vehicle (eg, an image received through an AVM camera) ) (1700) may be output.

Meanwhile, when another car door other than the driver's seat door is opened, the processor 870 may sense an object (eg, a motorcycle, a bicycle, etc.) approaching the other car door through the sensing unit 810 .

At this time, the processor 870 may display an image received through a camera disposed to photograph the outside of the vehicle based on a direction in which an object approaching through the other vehicle door exists among a plurality of areas of the display unit 820 . You can print one.

For example, as shown in (c) of FIG. 17 , the processor 870 opens the right door of the vehicle, and when an object approaching toward the right door is sensed, a camera arranged to photograph the right rear The image 1220b received through 1210b may be output to at least one of a plurality of regions of the display unit 820 (eg, the rightmost region 820c).

Although not shown, when the left door of the vehicle is opened and an object approaching toward the left door is sensed, the processor 870 receives an image 1220a received through the camera 1210a arranged to photograph the left rear. The output may be performed on at least one of the plurality of regions of the display unit 820 (eg, the leftmost region 820a).

That is, the type of the camera that captures the image and the type of the region where the image is output may be determined based on an open car door and a direction (or location) of an approaching object.

Additionally, the processor 870 displays a graphic object 1710 including a warning message and a type of an object approaching through an open door as shown in FIG. 17( c ) in a plurality of areas of the display unit 820 . can be output to at least one of

In this case, the area where the graphic object 1710 is output may be an area other than the area received through the camera.

Through this configuration, the present invention can output information optimized according to the state of the vehicle or the driving state of the vehicle to the display unit, and an area (position) optimized to induce the driver's gaze for each situation It is possible to provide a vehicle control apparatus capable of outputting the optimized information to the , and a vehicle control method.

Meanwhile, in this specification, although it has been described that the display unit 820 includes a plurality of regions, the present disclosure is not limited thereto. Even when a plurality of display units are provided, the method of controlling a plurality of regions may be analogously applied to the contents described in this specification.

For example, when there are a plurality of display units, the processor 870 may change a display method of information output to a display unit other than the display unit to which the driver's gaze is directed.

As another example, when there are a plurality of display units, the processor 870 may change a display method of information output to the display unit to which the driver's gaze is directed.

According to an embodiment of the present invention, there are one or more of the following effects.

First, the present invention can provide a new vehicle interface capable of controlling the display unit in an optimized method according to the driver's gaze.

Second, the present invention can provide a new vehicle interface capable of controlling an area to which the driver's gaze is directed and an area to which the driver's gaze is not directed in different ways.

Third, according to the present invention, more specific information related to driving is output to an area to which the driver's gaze is directed, and information output to an area to which the driver's gaze is not directed is simplified and output, thereby removing obstacles to the driver's driving, and helping It is possible to provide a new vehicle interface that can intensively output information that can give

Fourth, the present invention can provide a vehicle control device and a vehicle control method capable of outputting information optimized according to the driving state of the vehicle to a display unit.

Effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description of the claims.

The vehicle control apparatus 800 described above may be included in the vehicle 100 .

In addition, the operation or control method of the vehicle control apparatus 800 described above may be analogously applied to the operation or control method of the vehicle 100 (or the controller 170 ) in the same/similar manner.

For example, in the control method of the vehicle 100 (or the control method of the vehicle control device 800 ), sensing the driver's gaze and displaying a display in a region other than the region toward which the driver's gaze is directed among a plurality of regions of the display unit It may include changing the display method of the information.

In an embodiment, the plurality of areas include a first area and a second area different from the first area, and the changing may include: when the sensed driver's gaze is directed toward the first area, the first area 2 You can change the display method of the information displayed in the area.

In addition, the changing may include changing the first information related to the vehicle displayed in the second area to which the driver's gaze is not directed into second information different from the first information.

In addition, the first information is an image received through a camera arranged to photograph the outside of the vehicle, the second information is a graphic object representing a situation outside the vehicle, and the changing step includes the driver's gaze The image being displayed in the non-facing second area may be changed to the graphic object.

In addition, the control method of the vehicle 100 (or the control method of the vehicle control device 800 ) may further include changing a display method of information displayed on an area to which the driver's gaze is directed among a plurality of areas of the display unit. can

Each of the above steps may be performed not only by the vehicle control device 800 , but also by the controller 170 provided in the vehicle 100 .

In addition, all functions, configurations, or control methods performed by the vehicle control device 800 described above may be performed by the controller 170 provided in the vehicle 100 . That is, all of the control methods described in this specification may be applied to a vehicle control method or may be applied to a control method of a control device.

The present invention described above can be implemented as computer-readable codes on a medium in which a program is recorded. The computer-readable medium includes all types of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is also a carrier wave (eg, transmission over the Internet) that is implemented in the form of. In addition, the computer may include a processor or a control unit. Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

Claims (20)

a sensing unit for sensing the driver's gaze;
display unit; and
a processor for controlling the display unit to change a display method of information displayed in an area other than the area to which the driver's gaze is directed among the plurality of areas of the display unit;
The plurality of regions includes a first region and a second region different from the first region,
The processor is
The vehicle control apparatus of claim 1, wherein first information related to a vehicle displayed in a second area to which the driver's gaze is not directed is changed to second information different from the first information. The method of claim 1,
The processor is
The vehicle control apparatus of claim 1, wherein when the sensed driver's gaze is directed toward the first area, a display method of information displayed on the second area is changed. The method of claim 1,
The first information is an image received through a camera arranged to photograph the outside of the vehicle,
The second information is a graphic object representing a situation outside the vehicle,
The processor is configured to change the image being displayed in a second area to which the driver's gaze is not directed into the graphic object. delete 3. The method of claim 2,
The processor is
The vehicle control apparatus of claim 1, wherein when the driver's gaze is directed to the first area, at least a portion of the plurality of pieces of information output to the second area is not output. delete The method of claim 1,
The processor is
It is characterized in that the display method of the information displayed on the area to which the driver's gaze is directed among the plurality of areas of the display unit is changed,
The processor is
The vehicle control apparatus of claim 1, wherein first information related to a vehicle displayed in an area to which the driver's gaze is directed is changed to second information different from the first information. delete 8. The method of claim 7,
The processor is
Characterized in that an additional graphic object is outputted to an area to which the driver's gaze is directed,
The processor is
In a state in which an image received through a camera disposed to photograph the exterior of a vehicle in any one of the plurality of areas is being output, outputting the graphic object based on the direction of the driver's gaze to the one area A vehicle control system characterized by the delete 10. The method of claim 9,
The graphic object is
The vehicle control device, characterized in that the output is output when the probability of collision between the present vehicle and the other vehicle is equal to or greater than a predetermined value, and outputted based on a portion corresponding to the other vehicle in the image. a sensing unit for sensing the driver's gaze;
display unit; and
An image received through a camera disposed to photograph the exterior of the vehicle is output to a first region to which the driver's gaze is directed among a plurality of regions of the display unit, and when the image satisfies a preset condition, a graphic different from the image and a processor for outputting an object to a second area different from the first area. The method of claim 1,
The sensing unit senses the possibility of collision with another vehicle,
The processor is
When the probability of collision with the other vehicle is equal to or greater than a predetermined value, an image received through a camera disposed to photograph the exterior of the vehicle is displayed in a plurality of regions of the display unit based on a direction in which the other vehicle exists with respect to the present vehicle. Vehicle control device, characterized in that the output to at least one of. The method of claim 1,
The processor is
and outputting an image received through a camera arranged to photograph the exterior of the vehicle to at least one of a plurality of areas of the display unit, based on the vehicle satisfying a preset condition. delete delete delete delete delete delete

Images