WO2018124525A1

WO2018124525A1 - Display apparatus and vehicle comprising same

Info

Publication number: WO2018124525A1
Application number: PCT/KR2017/014211
Authority: WO
Inventors: 김상원; 유승준; 전성환; 김경락
Original assignee: 엘지전자 주식회사
Priority date: 2016-12-28
Filing date: 2017-12-06
Publication date: 2018-07-05
Also published as: KR101919889B1

Abstract

The present invention is a display apparatus provided in a vehicle, the display apparatus comprising: a main display configured to display driving information of the vehicle; a plurality of sub-displays which are laminated on the main display and are formed to be transparent; a control unit which controls a graphic object related to the driving information to be displayed on any one of the plurality of sub-displays, wherein the any one of the plurality of sub-displays on which the graphic object is displayed varies depending on the driving circumstance of the vehicle.

Description

Display device and vehicle comprising the same

The present invention relates to a display device configured to display driving information of a vehicle and a vehicle including the same.

A vehicle is a means of transportation that can move people or luggage using kinetic energy. Representative examples of vehicles include automobiles and motorcycles.

For the safety and convenience of the user using the vehicle, the vehicle is equipped with various sensors and devices, the function of the vehicle is diversified.

The functions of the vehicle can be divided into convenience functions for the convenience of the driver and safety functions for the safety of the driver and / or the pedestrian.

First of all, the convenience function has development motivation related to driver comfort, such as giving infotainment (entertainment + entertainment) function to the vehicle, supporting partial autonomous driving function, or helping the driver's vision such as night vision or blind spot. . For example, active cruise control (ACC), smart parking assist system (SPAS), night vision (NV), head up display (HUD), around view monitor (around view monitor, AVM), adaptive headlight system (AHS).

Safety features are technologies that ensure driver safety and / or pedestrian safety, including lane departure warning system (LDWS), lane keeping assist system (LKAS), and autonomous emergency. braking, AEB).

As vehicle functions are diversified, various driving information is provided. The vehicle functions are classified into convenience functions and safety functions. The driving information on the safety functions needs to be intuitively transmitted to the driver as compared to the driving information on the convenience functions. There is a need for a display apparatus that can effectively transmit various driving information according to a driving situation of a vehicle.

It is an object of the present invention to solve the above and other problems.

One object of the present invention is to provide a display device capable of effectively transmitting various driving information and a vehicle including the same. Specifically, the present invention provides a display device capable of generating different depths according to the driving information to be displayed and a vehicle including the same.

One object of the present invention is to provide a display apparatus and a vehicle including the same, which can provide driving information in three dimensions by using not only the hardware characteristics of the display but also an optical illusion effect by software.

The present invention relates to a display apparatus, the display apparatus comprising: a main display configured to display driving information of the vehicle; A plurality of sub displays stacked on the main display and made transparent; And a controller configured to control a graphic object related to the driving information to be displayed on any one of the plurality of sub displays, wherein the one sub display on which the graphic object is displayed varies according to a driving situation of the vehicle. It features.

In one embodiment, the plurality of sub-displays may include a reference sub-display, and the reference sub-display may be configured to display at least one image for generating a three-dimensional optical illusion of the graphic object. have.

The plurality of sub displays may include: a preceding sub display positioned in front of the reference sub display; And a trailing sub display positioned behind the reference sub display.

According to an embodiment of the present disclosure, when there are a plurality of graphic objects, the controller may classify the plurality into a first group and a second group according to a predetermined criterion, and the graphic objects included in the first group may be the preceding group. The graphic objects displayed on the sub display and included in the second group may be controlled to be displayed on the trailing sub display.

In an embodiment, the preset criterion may be related to at least one of a driving direction, a traveling speed, and a position of the vehicle.

In one embodiment, when the graphic object is displayed on the trailing sub display, a portion of the graphic object is made to be covered by the image, and when the graphic object is displayed on the preceding sub display, A portion can be made obscured by the graphical object.

In at least one example embodiment, the at least one image may have a bar shape covering a portion of the main display.

In one embodiment, the position at which the at least one image is displayed may vary depending on the speed of the vehicle.

According to an embodiment, the number of the at least one image displayed on the reference sub display may vary according to the speed of the vehicle.

According to an embodiment of the present disclosure, the controller may adjust the size of the graphic object according to one of the sub-displays on which the graphic object is displayed.

In an embodiment, the controller may display at least one image for generating a 3D optical illusion of the graphic object on an adjacent subdisplay based on the one subdisplay.

According to an embodiment of the present disclosure, a position where the at least one image is displayed may vary depending on a position where the graphic object is displayed on the sub display.

According to an embodiment of the present disclosure, the type of the graphic object may vary according to the driving information displayed on the main display.

According to an embodiment of the present disclosure, when there is an object having a higher probability of collision based on the vehicle, the controller controls the graphic object to be displayed on the sub display, and the graphic object guides the object. It can be made to.

According to an embodiment of the present disclosure, the controller may compare the position set in the graphic object with the position of the vehicle and select one of the sub-displays based on a comparison result.

According to an embodiment, different reference distances may be set in the plurality of subdisplays, and the controller may be configured based on a position set in the graphic object, a distance between the vehicle, and a reference distance set in each subdisplay. The sub display may be selected.

In an embodiment, the reference distance set in each sub display may vary according to the speed of the vehicle.

According to an embodiment of the present disclosure, the controller may control the graphic object to move from one sub display to another sub display based on a driving condition of the vehicle.

According to an embodiment of the present disclosure, the controller may move and display the graphic object on one of the sub-displays in order along one direction based on the driving situation of the vehicle.

In addition, the present invention can be extended to a vehicle having a display device and / or a vehicle control method.

The effects of the display device and the vehicle including the same according to the present invention are as follows.

The display apparatus includes a main display and a plurality of sub displays sequentially arranged along one direction with respect to the main display, and the same graphic object may be displayed on different sub displays according to driving conditions of the vehicle. . Since the same graphic object has different three-dimensional depth values depending on which sub-displays are displayed, it is possible to provide information to the passengers in three dimensions.

1 is a view showing the appearance of a vehicle according to an embodiment of the present invention.

2 is a view of the vehicle according to an embodiment of the present invention from various angles from the outside;

3 to 4 are views showing the interior of a vehicle according to an embodiment of the present invention.

5 to 6 are views referred to to explain the object according to an embodiment of the present invention.

7 is a block diagram referred to describe a vehicle according to an embodiment of the present invention.

8 is a conceptual diagram illustrating a display apparatus according to an exemplary embodiment.

9 is a conceptual diagram illustrating a method of displaying a graphic object in the display device of FIG. 8.

10 is a flowchart illustrating a control method of a display apparatus according to an exemplary embodiment.

11A, 11B, and 12 are exemplary diagrams for describing the control method of FIG. 10 in more detail.

13 is a flowchart illustrating a control method of a display apparatus according to an exemplary embodiment.

14A and 14B are exemplary views for describing the control method of FIG. 13 in more detail.

15 is a flowchart illustrating a control method of a display apparatus according to an exemplary embodiment.

16A, 16B, and 16C are exemplary views for describing the control method of FIG. 15 in more detail.

17A, 17B, and 17C are conceptual views illustrating a method of providing driving information in a turn-by-turn manner using a plurality of displays.

18 is a diagram illustrating an operation of a display apparatus according to a possibility of collision.

19A, 19B, and 19C are exemplary diagrams for describing a method of providing a user interface for controlling a vehicle.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings, and the same or similar components are denoted by the same reference numerals regardless of the reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "unit" for components used in the following description are given or used in consideration of ease of specification, and do not have distinct meanings or roles from each other. In addition, in describing the embodiments disclosed herein, when it is determined that the detailed description of the related known technology may obscure the gist of the embodiments disclosed herein, the detailed description thereof will be omitted. In addition, the accompanying drawings are intended to facilitate understanding of the embodiments disclosed herein, but are not limited to the technical spirit disclosed herein by the accompanying drawings, all changes included in the spirit and scope of the present invention. It should be understood to include equivalents and substitutes.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

In this application, the terms "comprises" or "having" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

The vehicle described herein may be a concept including an automobile and a motorcycle. In the following, a vehicle is mainly described for a vehicle.

The vehicle described herein may be a concept including both an internal combustion engine vehicle having an engine as a power source, a hybrid vehicle having an engine and an electric motor as a power source, and an electric vehicle having an electric motor as a power source.

In the following description, the left side of the vehicle means the left side of the driving direction of the vehicle, and the right side of the vehicle means the right side of the driving direction of the vehicle.

2 is a view of the vehicle according to an embodiment of the present invention from various angles from the outside.

3 to 4 are views illustrating the interior of a vehicle according to an embodiment of the present invention.

5 to 6 are views referred to for describing an object according to an embodiment of the present invention.

7 is a block diagram referenced to describe a vehicle according to an embodiment of the present invention.

1 to 7, the vehicle 100 may include a wheel that rotates by a power source and a steering input device 510 for adjusting a traveling direction of the vehicle 100.

The vehicle 100 may be an autonomous vehicle.

Here, autonomous driving is defined as controlling at least one of acceleration, deceleration, and driving direction based on a preset algorithm. In other words, even if a user input is not input to the driving operation apparatus, the driving operation apparatus is automatically operated.

The vehicle 100 may be switched to an autonomous driving mode or a manual mode based on a user input.

For example, the vehicle 100 may be switched from the manual mode to the autonomous driving mode or from the autonomous driving mode to the manual mode based on the received user input through the user interface device 200.

The vehicle 100 may be switched to the autonomous driving mode or the manual mode based on the driving situation information. The driving situation information may be generated based on the object information provided by the object detecting apparatus 300.

For example, the vehicle 100 may be switched from the manual mode to the autonomous driving mode or from the autonomous driving mode to the manual mode based on the driving situation information generated by the object detecting apparatus 300.

For example, the vehicle 100 may be switched from the manual mode to the autonomous driving mode or from the autonomous driving mode to the manual mode based on the driving situation information received through the communication device 400.

The vehicle 100 may switch from the manual mode to the autonomous driving mode or from the autonomous driving mode to the manual mode based on information, data, and signals provided from an external device.

When the vehicle 100 is driven in the autonomous driving mode, the autonomous vehicle 100 may be driven based on the driving system 700.

For example, the autonomous vehicle 100 may be driven based on information, data, or signals generated by the driving system 710, the parking system 740, and the parking system 750.

When the vehicle 100 is driven in the manual mode, the autonomous vehicle 100 may receive a user input for driving through the driving manipulation apparatus 500. Based on a user input received through the driving manipulation apparatus 500, the vehicle 100 may be driven.

The overall length is the length from the front to the rear of the vehicle 100, the width is the width of the vehicle 100, and the height is the length from the bottom of the wheel to the roof. In the following description, the full length direction L is a direction in which the full length measurement of the vehicle 100 is a reference, the full width direction W is a direction in which the full width measurement of the vehicle 100 is a reference, and the total height direction H is a vehicle. It may mean the direction which is the reference of the height measurement of (100).

As illustrated in FIG. 7, the vehicle 100 includes a user interface device 200, an object detecting device 300, a communication device 400, a driving manipulation device 500, a vehicle driving device 600, and a traveling system. 700, a navigation system 770, a sensing unit 120, an interface unit 130, a memory 140, a control unit 170, and a power supply unit 190 may be included.

According to an embodiment, the vehicle 100 may further include other components in addition to the components described herein, or may not include some of the components described.

The user interface device 200 is a device for communicating with the vehicle 100 and a user. The user interface device 200 may receive a user input and provide the user with information generated in the vehicle 100. The vehicle 100 may implement user interfaces (UI) or user experience (UX) through the user interface device 200.

The user interface device 200 may include an input unit 210, an internal camera 220, a biometric detector 230, an output unit 250, and a processor 270.

According to an embodiment, the user interface device 200 may further include other components in addition to the described components, or may not include some of the described components.

The input unit 200 is for receiving information from a user, and the data collected by the input unit 200 may be analyzed by the processor 270 and processed as a control command of the user.

The input unit 200 may be disposed in the vehicle. For example, the input unit 200 may include one area of a steering wheel, one area of an instrument panel, one area of a seat, one area of each pillar, and a door. one area of the door, one area of the center console, one area of the head lining, one area of the sun visor, one area of the windshield or of the window It may be disposed in one area or the like.

The input unit 200 may include a voice input unit 211, a gesture input unit 212, a touch input unit 213, and a mechanical input unit 214.

The voice input unit 211 may convert a user's voice input into an electrical signal. The converted electrical signal may be provided to the processor 270 or the controller 170.

The voice input unit 211 may include one or more microphones.

The gesture input unit 212 may convert a user's gesture input into an electrical signal. The converted electrical signal may be provided to the processor 270 or the controller 170.

The gesture input unit 212 may include at least one of an infrared sensor and an image sensor for detecting a user's gesture input.

According to an embodiment, the gesture input unit 212 may detect a 3D gesture input of the user. To this end, the gesture input unit 212 may include a light output unit or a plurality of image sensors for outputting a plurality of infrared light.

The gesture input unit 212 may detect a user's 3D gesture input through a time of flight (TOF) method, a structured light method, or a disparity method.

The touch input unit 213 may convert a user's touch input into an electrical signal. The converted electrical signal may be provided to the processor 270 or the controller 170.

The touch input unit 213 may include a touch sensor for detecting a user's touch input.

According to an embodiment, the touch input unit 213 may be integrally formed with the display unit 251 to implement a touch screen. Such a touch screen may provide an input interface and an output interface between the vehicle 100 and the user.

The mechanical input unit 214 may include at least one of a button, a dome switch, a jog wheel, and a jog switch. The electrical signal generated by the mechanical input unit 214 may be provided to the processor 270 or the controller 170.

The mechanical input unit 214 may be disposed on a steering wheel, a cente facia, a center console, a cockpit module, a door, or the like.

The internal camera 220 may acquire a vehicle interior image. The processor 270 may detect a state of the user based on the vehicle interior image. The processor 270 may acquire the gaze information of the user from the vehicle interior image. The processor 270 may detect a gesture of the user in the vehicle interior image.

The biometric detector 230 may acquire biometric information of the user. The biometric detector 230 may include a sensor for acquiring biometric information of the user, and may acquire fingerprint information, heartbeat information, etc. of the user using the sensor. Biometric information may be used for user authentication.

The output unit 250 is for generating output related to visual, auditory or tactile.

The output unit 250 may include at least one of the display unit 251, the audio output unit 252, and the haptic output unit 253.

The display unit 251 may display graphic objects corresponding to various pieces of information.

The display unit 251 is a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display (flexible) display, a 3D display, or an e-ink display.

The display unit 251 forms a layer structure or is integrally formed with the touch input unit 213 to implement a touch screen.

The display unit 251 may be implemented as a head up display (HUD). When the display unit 251 is implemented as a HUD, the display unit 251 may include a projection module to output information through an image projected on a wind shield or a window.

The display unit 251 may include a transparent display. The transparent display can be attached to the wind shield or window.

The transparent display may display a predetermined screen while having a predetermined transparency. Transparent display, in order to have transparency, transparent display is transparent thin film elecroluminescent (TFEL), transparent organic light-emitting diode (OLED), transparent liquid crystal display (LCD), transmissive transparent display, transparent light emitting diode (LED) display It may include at least one of. The transparency of the transparent display can be adjusted.

The user interface device 200 may include a plurality of display units 251a to 251g.

The display unit 251 may include one region of the steering wheel, one

region

521a, 251b, and 251e of the instrument panel, one region 251d of the seat, one region 251f of each pillar, and one region of the door ( 251g), one area of the center console, one area of the head lining, one area of the sun visor, or may be implemented in one area 251c of the windshield and one area 251h of the window.

The sound output unit 252 converts an electrical signal provided from the processor 270 or the controller 170 into an audio signal and outputs the audio signal. To this end, the sound output unit 252 may include one or more speakers.

The haptic output unit 253 generates a tactile output. For example, the haptic output unit 253 may vibrate the steering wheel, the seat belt, and the seats 110FL, 110FR, 110RL, and 110RR so that the user may recognize the output.

The processor 270 may control the overall operation of each unit of the user interface device 200.

According to an embodiment, the user interface device 200 may include a plurality of processors 270 or may not include the processor 270.

When the processor 270 is not included in the user interface device 200, the user interface device 200 may be operated under the control of the processor or the controller 170 of another device in the vehicle 100.

The user interface device 200 may be referred to as a vehicle display device.

The user interface device 200 may be operated under the control of the controller 170.

The object detecting apparatus 300 is a device for detecting an object located outside the vehicle 100.

The object may be various objects related to the driving of the vehicle 100.

5 to 6, the object O includes a lane OB10, another vehicle OB11, a pedestrian OB12, a two-wheeled vehicle OB13, traffic signals OB14, OB15, light, a road, a structure, Speed bumps, features, animals and the like can be included.

The lane OB10 may be a driving lane, a lane next to the driving lane, and a lane in which an opposite vehicle travels. The lane OB10 may be a concept including left and right lines forming a lane.

The other vehicle OB11 may be a vehicle that is driving around the vehicle 100. The other vehicle may be a vehicle located within a predetermined distance from the vehicle 100. For example, the other vehicle OB11 may be a vehicle that precedes or follows the vehicle 100.

The pedestrian OB12 may be a person located near the vehicle 100. The pedestrian OB12 may be a person located within a predetermined distance from the vehicle 100. For example, the pedestrian OB12 may be a person located on a sidewalk or a roadway.

The two-wheeled vehicle OB12 may be a vehicle that is positioned around the vehicle 100 and moves using two wheels. The motorcycle OB12 may be a vehicle having two wheels located within a predetermined distance from the vehicle 100. For example, the motorcycle OB13 may be a motorcycle or a bicycle located on sidewalks or roadways.

The traffic signal may include a traffic light OB15, a traffic sign OB14, a pattern or text drawn on a road surface.

The light may be light generated by a lamp provided in another vehicle. The light, can be light generated from the street light. The light may be sunlight.

The road may include a road surface, a curve, an uphill slope, a slope downhill, or the like.

The structure may be an object located around a road and fixed to the ground. For example, the structure may include a street lamp, a roadside tree, a building, a power pole, a traffic light, a bridge.

The features may include mountains, hills, and the like.

On the other hand, the object may be classified into a moving object and a fixed object. For example, the moving object may be a concept including another vehicle and a pedestrian. For example, the fixed object may be a concept including a traffic signal, a road, and a structure.

The object detecting apparatus 300 may include a camera 310, a radar 320, a lidar 330, an ultrasonic sensor 340, an infrared sensor 350, and a processor 370.

According to an embodiment, the object detecting apparatus 300 may further include other components in addition to the described components, or may not include some of the described components.

The camera 310 may be located at a suitable place outside the vehicle to acquire an image outside the vehicle. The camera 310 may be a mono camera, a stereo camera 310a, an around view monitoring (AVM) camera 310b, or a 360 degree camera.

For example, the camera 310 may be disposed in close proximity to the front windshield in the interior of the vehicle in order to acquire an image in front of the vehicle. Alternatively, the camera 310 may be disposed around the front bumper or the radiator grille.

For example, the camera 310 may be disposed in close proximity to the rear glass in the interior of the vehicle to acquire an image of the rear of the vehicle. Alternatively, the camera 310 may be disposed around the rear bumper, the trunk, or the tail gate.

For example, the camera 310 may be disposed in close proximity to at least one of the side windows in the interior of the vehicle to acquire an image of the vehicle side. Alternatively, the camera 310 may be arranged around the side mirror, fender or door.

The camera 310 may provide the obtained image to the processor 370.

The radar 320 may include an electromagnetic wave transmitter and a receiver. The radar 320 may be implemented in a pulse radar method or a continuous wave radar method in terms of radio wave firing principle. The radar 320 may be implemented by a frequency modulated continuous wave (FSCW) method or a frequency shift key (FSK) method according to a signal waveform among the continuous wave radar methods.

The radar 320 detects an object based on a time of flight (TOF) method or a phase-shift method based on an electromagnetic wave, and detects the position of the detected object, distance to the detected object, and relative velocity. Can be detected.

The radar 320 may be disposed at an appropriate position outside the vehicle to detect an object located in front, rear, or side of the vehicle.

The lidar 330 may include a laser transmitter and a receiver. The lidar 330 may be implemented in a time of flight (TOF) method or a phase-shift method.

The lidar 330 may be implemented as driven or non-driven.

When implemented in a driving manner, the lidar 330 may be rotated by a motor and detect an object around the vehicle 100.

When implemented in a non-driven manner, the lidar 330 may detect an object located within a predetermined range with respect to the vehicle 100 by optical steering. The vehicle 100 may include a plurality of non-driven lidars 330.

The lidar 330 detects an object based on a time of flight (TOF) method or a phase-shift method using laser light, and detects an object, a position of the detected object, a distance from the detected object, and Relative speed can be detected.

The lidar 330 may be disposed at an appropriate position outside the vehicle to detect an object located in front, rear, or side of the vehicle.

The ultrasonic sensor 340 may include an ultrasonic transmitter and a receiver. The ultrasonic sensor 340 may detect an object based on the ultrasonic wave, and detect a position of the detected object, a distance to the detected object, and a relative speed.

The ultrasonic sensor 340 may be disposed at an appropriate position outside the vehicle to detect an object located in front, rear, or side of the vehicle.

The infrared sensor 350 may include an infrared transmitter and a receiver. The infrared sensor 340 may detect an object based on infrared light, and detect a position of the detected object, a distance to the detected object, and a relative speed.

The infrared sensor 350 may be disposed at an appropriate position outside the vehicle to detect an object located in front, rear, or side of the vehicle.

The processor 370 may control overall operations of each unit of the object detecting apparatus 300.

The processor 370 may detect and track the object based on the obtained image. The processor 370 may perform operations such as calculating a distance to an object and calculating a relative speed with the object through an image processing algorithm.

The processor 370 may detect and track the object based on the reflected electromagnetic wave reflected by the transmitted electromagnetic wave to the object. The processor 370 may perform an operation such as calculating a distance from the object, calculating a relative speed with the object, and the like based on the electromagnetic waves.

The processor 370 may detect and track the object based on the reflected laser light reflected by the transmitted laser back to the object. The processor 370 may perform an operation such as calculating a distance from the object, calculating a relative speed with the object, and the like based on the laser light.

The processor 370 may detect and track the object based on the reflected ultrasound, in which the transmitted ultrasound is reflected by the object and returned. The processor 370 may perform an operation such as calculating a distance from the object, calculating a relative speed with the object, and the like based on the ultrasound.

The processor 370 may detect and track the object based on the reflected infrared light from which the transmitted infrared light is reflected back to the object. The processor 370 may perform an operation such as calculating a distance to the object, calculating a relative speed with the object, and the like based on the infrared light.

According to an embodiment, the object detecting apparatus 300 may include a plurality of processors 370 or may not include the processor 370. For example, each of the camera 310, the radar 320, the lidar 330, the ultrasonic sensor 340, and the infrared sensor 350 may individually include a processor.

When the processor 370 is not included in the object detecting apparatus 300, the object detecting apparatus 300 may be operated under the control of the processor or the controller 170 of the apparatus in the vehicle 100.

The object detecting apparatus 300 may be operated under the control of the controller 170.

The communication device 400 is a device for performing communication with an external device. Here, the external device may be another vehicle, a mobile terminal or a server. The communication device 400 may be referred to as a "wireless communication unit."

The communication device 400 may include at least one of a transmit antenna, a receive antenna, a radio frequency (RF) circuit capable of implementing various communication protocols, and an RF element to perform communication.

The communication device 400 may include a short range communication unit 410, a location information unit 420, a V2X communication unit 430, an optical communication unit 440, a broadcast transceiver 450, and a processor 470.

According to an embodiment, the communication device 400 may further include other components in addition to the described components, or may not include some of the described components.

The short range communication unit 410 is a unit for short range communication. The local area communication unit 410 may include Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), and Wi-Fi (Wireless). Local area communication may be supported using at least one of Fidelity, Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies.

The short range communication unit 410 may form short range wireless networks to perform short range communication between the vehicle 100 and at least one external device.

The location information unit 420 is a unit for obtaining location information of the vehicle 100. For example, the location information unit 420 may include a global positioning system (GPS) module or a differential global positioning system (DGPS) module.

The V2X communication unit 430 is a unit for performing wireless communication with a server (V2I: Vehicle to Infra), another vehicle (V2V: Vehicle to Vehicle), or a pedestrian (V2P: Vehicle to Pedestrian). The V2X communication unit 430 may include an RF circuit that can implement a communication with the infrastructure (V2I), an inter-vehicle communication (V2V), and a communication with the pedestrian (V2P).

The optical communication unit 440 is a unit for performing communication with an external device via light. The optical communication unit 440 may include an optical transmitter that converts an electrical signal into an optical signal and transmits the external signal to the outside, and an optical receiver that converts the received optical signal into an electrical signal.

According to an embodiment, the light emitting unit may be formed to be integrated with the lamp included in the vehicle 100.

The broadcast transceiver 450 is a unit for receiving a broadcast signal from an external broadcast management server or transmitting a broadcast signal to a broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal.

The processor 470 may control the overall operation of each unit of the communication device 400.

According to an embodiment, the communication device 400 may include a plurality of processors 470 or may not include the processor 470.

When the processor 470 is not included in the communication device 400, the communication device 400 may be operated under the control of the processor or the controller 170 of another device in the vehicle 100.

Meanwhile, the communication device 400 may implement a vehicle display device together with the user interface device 200. In this case, the vehicle display device may be called a telematics device or an AVN (Audio Video Navigation) device.

The communication device 400 may be operated under the control of the controller 170.

The driving operation apparatus 500 is a device that receives a user input for driving.

In the manual mode, the vehicle 100 may be driven based on a signal provided by the driving manipulation apparatus 500.

The driving manipulation apparatus 500 may include a steering input apparatus 510, an acceleration input apparatus 530, and a brake input apparatus 570.

The steering input device 510 may receive a driving direction input of the vehicle 100 from the user. The steering input device 510 is preferably formed in a wheel shape to enable steering input by rotation. According to an embodiment, the steering input device may be formed in the form of a touch screen, a touch pad or a button.

The acceleration input device 530 may receive an input for accelerating the vehicle 100 from a user. The brake input device 570 may receive an input for deceleration of the vehicle 100 from a user. The acceleration input device 530 and the brake input device 570 are preferably formed in the form of a pedal. According to an embodiment, the acceleration input device or the brake input device may be formed in the form of a touch screen, a touch pad, or a button.

The driving manipulation apparatus 500 may be operated under the control of the controller 170.

The vehicle drive device 600 is a device that electrically controls the driving of various devices in the vehicle 100.

The vehicle driving apparatus 600 may include a power train driver 610, a chassis driver 620, a door / window driver 630, a safety device driver 640, a lamp driver 650, and an air conditioning driver 660. Can be.

According to an exemplary embodiment, the vehicle driving apparatus 600 may further include other components in addition to the described components, or may not include some of the described components.

On the other hand, the vehicle driving device 600 may include a processor. Each unit of the vehicle drive apparatus 600 may each include a processor individually.

The power train driver 610 may control the operation of the power train device.

The power train driver 610 may include a power source driver 611 and a transmission driver 612.

The power source driver 611 may control the power source of the vehicle 100.

For example, when the fossil fuel-based engine is a power source, the power source driver 610 may perform electronic control of the engine. Thereby, the output torque of an engine, etc. can be controlled. The power source drive unit 611 can adjust the engine output torque under the control of the control unit 170.

For example, when the electric energy based motor is a power source, the power source driver 610 may control the motor. The power source driver 610 may adjust the rotational speed, torque, and the like of the motor under the control of the controller 170.

The transmission driver 612 may control the transmission.

The transmission driver 612 can adjust the state of the transmission. The transmission drive part 612 can adjust the state of a transmission to forward D, backward R, neutral N, or parking P. FIG.

On the other hand, when the engine is a power source, the transmission drive unit 612 can adjust the bite state of the gear in the forward D state.

The chassis driver 620 may control the operation of the chassis device.

The chassis driver 620 may include a steering driver 621, a brake driver 622, and a suspension driver 623.

The steering driver 621 may perform electronic control of a steering apparatus in the vehicle 100. The steering driver 621 may change the traveling direction of the vehicle.

The brake driver 622 may perform electronic control of a brake apparatus in the vehicle 100. For example, the speed of the vehicle 100 may be reduced by controlling the operation of the brake disposed on the wheel.

On the other hand, the brake drive unit 622 can individually control each of the plurality of brakes. The brake driver 622 may control the braking force applied to the plurality of wheels differently.

The suspension driver 623 may perform electronic control of a suspension apparatus in the vehicle 100. For example, when there is a curvature on the road surface, the suspension driver 623 may control the suspension device to control the vibration of the vehicle 100 to be reduced.

Meanwhile, the suspension driver 623 may individually control each of the plurality of suspensions.

The door / window driver 630 may perform electronic control of a door apparatus or a window apparatus in the vehicle 100.

The door / window driver 630 may include a door driver 631 and a window driver 632.

The door driver 631 may control the door apparatus. The door driver 631 may control opening and closing of the plurality of doors included in the vehicle 100. The door driver 631 may control the opening or closing of a trunk or a tail gate. The door driver 631 may control the opening or closing of the sunroof.

The window driver 632 may perform electronic control of the window apparatus. The opening or closing of the plurality of windows included in the vehicle 100 may be controlled.

The safety device driver 640 may perform electronic control of various safety apparatuses in the vehicle 100.

The safety device driver 640 may include an airbag driver 641, a seat belt driver 642, and a pedestrian protection device driver 643.

The airbag driver 641 may perform electronic control of an airbag apparatus in the vehicle 100. For example, the airbag driver 641 may control the airbag to be deployed when the danger is detected.

The seat belt driver 642 may perform electronic control of a seatbelt appartus in the vehicle 100. For example, the seat belt driver 642 may control the passengers to be fixed to the seats 110FL, 110FR, 110RL, and 110RR by using the seat belts when the risk is detected.

The pedestrian protection device driver 643 may perform electronic control of the hood lift and the pedestrian airbag. For example, the pedestrian protection device driver 643 may control the hood lift up and the pedestrian air bag to be deployed when detecting a collision with the pedestrian.

The lamp driver 650 may perform electronic control of various lamp apparatuses in the vehicle 100.

The air conditioning driver 660 may perform electronic control of an air conditioner in the vehicle 100. For example, when the temperature inside the vehicle is high, the air conditioning driver 660 may control the air conditioning apparatus to operate to supply cool air to the inside of the vehicle.

The vehicle driving apparatus 600 may include a processor. Each unit of the vehicle drive apparatus 600 may each include a processor individually.

The vehicle driving apparatus 600 may be operated under the control of the controller 170.

The travel system 700 is a system for controlling various travels of the vehicle 100. The navigation system 700 can be operated in an autonomous driving mode.

The travel system 700 can include a travel system 710, a parking system 740, and a parking system 750.

In some embodiments, the navigation system 700 may further include other components in addition to the described components, or may not include some of the described components.

Meanwhile, the driving system 700 may include a processor. Each unit of the navigation system 700 may each include a processor individually.

In some embodiments, when the driving system 700 is implemented in software, the driving system 700 may be a lower concept of the controller 170.

According to an exemplary embodiment, the driving system 700 may include at least one of the user interface device 200, the object detecting device 300, the communication device 400, the vehicle driving device 600, and the controller 170. It may be a concept to include.

The traveling system 710 may perform driving of the vehicle 100.

The driving system 710 may receive navigation information from the navigation system 770, provide a control signal to the vehicle driving apparatus 600, and perform driving of the vehicle 100.

The driving system 710 may receive object information from the object detecting apparatus 300 and provide a control signal to the vehicle driving apparatus 600 to perform driving of the vehicle 100.

The driving system 710 may receive a signal from an external device through the communication device 400, provide a control signal to the vehicle driving device 600, and perform driving of the vehicle 100.

The taking-out system 740 may perform taking out of the vehicle 100.

The taking-out system 740 may receive navigation information from the navigation system 770, provide a control signal to the vehicle driving apparatus 600, and perform take-out of the vehicle 100.

The taking-out system 740 may receive the object information from the object detecting apparatus 300, provide a control signal to the vehicle driving apparatus 600, and perform take-out of the vehicle 100.

The taking-off system 740 may receive a signal from an external device through the communication device 400, provide a control signal to the vehicle driving apparatus 600, and perform take-out of the vehicle 100.

The parking system 750 may perform parking of the vehicle 100.

The parking system 750 may receive navigation information from the navigation system 770, provide a control signal to the vehicle driving apparatus 600, and perform parking of the vehicle 100.

The parking system 750 may receive the object information from the object detecting apparatus 300, provide a control signal to the vehicle driving apparatus 600, and perform parking of the vehicle 100.

The parking system 750 may receive a signal from an external device through the communication device 400, provide a control signal to the vehicle driving device 600, and perform parking of the vehicle 100.

The navigation system 770 can provide navigation information. The navigation information may include at least one of map information, set destination information, route information according to the destination setting, information on various objects on the route, lane information, and current location information of the vehicle.

The navigation system 770 may include a memory and a processor. The memory may store navigation information. The processor may control the operation of the navigation system 770.

According to an embodiment, the navigation system 770 may receive information from an external device through the communication device 400 and update the pre-stored information.

According to an embodiment, the navigation system 770 may be classified as a subcomponent of the user interface device 200.

The sensing unit 120 may sense a state of the vehicle. The sensing unit 120 may include an attitude sensor (for example, a yaw sensor, a roll sensor, a pitch sensor), a collision sensor, a wheel sensor, a speed sensor, and an inclination. Sensor, weight sensor, heading sensor, yaw sensor, gyro sensor, position module, vehicle forward / reverse sensor, battery sensor, fuel sensor, tire sensor, handle It may include a steering sensor, a vehicle interior temperature sensor, a vehicle interior humidity sensor, an ultrasonic sensor, an illuminance sensor, an accelerator pedal position sensor, a brake pedal position sensor, and the like by rotation.

The sensing unit 120 includes vehicle attitude information, vehicle collision information, vehicle direction information, vehicle position information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward / reverse information, battery Acquire sensing signals for information, fuel information, tire information, vehicle lamp information, vehicle internal temperature information, vehicle internal humidity information, steering wheel rotation angle, vehicle external illumination, pressure applied to the accelerator pedal, pressure applied to the brake pedal, and the like. can do.

The sensing unit 120 may further include an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an intake air temperature sensor (ATS), a water temperature sensor (WTS), and a throttle position sensor. (TPS), TDC sensor, crank angle sensor (CAS), and the like.

The interface unit 130 may serve as a path to various types of external devices connected to the vehicle 100. For example, the interface unit 130 may include a port connectable with the mobile terminal, and may connect with the mobile terminal through the port. In this case, the interface unit 130 may exchange data with the mobile terminal.

Meanwhile, the interface unit 130 may serve as a path for supplying electrical energy to the connected mobile terminal. When the mobile terminal is electrically connected to the interface unit 130, under the control of the controller 170, the interface unit 130 may provide the mobile terminal with electrical energy supplied from the power supply unit 190.

The memory 140 is electrically connected to the controller 170. The memory 140 may store basic data for the unit, control data for controlling the operation of the unit, and input / output data. The memory 140 may be various storage devices such as a ROM, a RAM, an EPROM, a flash drive, a hard drive, and the like, in hardware. The memory 140 may store various data for overall operation of the vehicle 100, such as a program for processing or controlling the controller 170.

According to an embodiment, the memory 140 may be integrally formed with the controller 170 or may be implemented as a subcomponent of the controller 170.

The controller 170 may control the overall operation of each unit in the vehicle 100. The controller 170 may be referred to as an electronic control unit (ECU).

The power supply unit 190 may supply power required for the operation of each component under the control of the controller 170. In particular, the power supply unit 190 may receive power from a battery inside the vehicle.

One or more processors and controllers 170 included in the vehicle 100 may include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), and FPGAs ( It may be implemented using at least one of field programmable gate arrays, processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions.

Hereinafter, the display apparatus 800 provided in the vehicle 100 will be described in detail.

The display apparatus 800 is provided in the vehicle 100, and may be formed as an independent device detachable from the vehicle 100 or may be configured as a part of the vehicle 100 that is integrally installed in the vehicle 100. . The display device may refer to the display unit 271 described above with reference to FIG. 7.

Hereinafter, for convenience of description, the display apparatus 800 will be described as a separate configuration independent of the control unit 170 of the vehicle 100. However, this is only an embodiment of the present disclosure, and the operations and control methods of all the display apparatuses 800 described herein may be performed by the controller 170 of the vehicle 100. That is, the operation and / or control method performed by the controller 840 of the display apparatus 800 may be performed by the controller 170 of the vehicle 800.

Referring to FIG. 8, the display apparatus 800 includes a communication unit 810, a main display 820, at least one sub display 830, and a controller 840.

The communication unit 810 is configured to communicate with various components described with reference to FIG. 7. For example, the communication unit 810 may receive various information provided through a controller are network (CAN). As another example, the communication unit 810 may communicate with all devices that can communicate, such as a vehicle, a mobile terminal and a server, and another vehicle. This may be referred to as vehicle to everything (V2X) communication. V2X communication can be defined as a technology for exchanging or sharing information such as traffic conditions while communicating with road infrastructure and other vehicles while driving.

The communication unit 810 may receive information related to driving of the vehicle from most devices provided in the vehicle 100. Information transmitted from the vehicle 100 to the display device 800 is referred to as 'vehicle driving information'.

The vehicle driving information includes vehicle information and surrounding information of the vehicle. Based on the frame of the vehicle 100, information related to the inside of the vehicle may be defined as vehicle information and information related to the outside of the vehicle as the surrounding information.

Vehicle information means information about the vehicle itself. For example, the vehicle information may include driving speed, driving direction, acceleration, angular velocity, position (GPS), weight, vehicle occupant, braking force of the vehicle, maximum braking force of the vehicle, air pressure of each wheel, and centrifugal force applied to the vehicle. , Driving mode of the vehicle (autonomous driving mode or manual driving), vehicle parking mode (autonomous parking mode, auto parking mode, manual parking mode), whether the user is in the vehicle and information related to the user It may include.

The surrounding information refers to information about other objects located within a predetermined range with respect to the vehicle and information related to the outside of the vehicle. For example, the condition of the road surface on which the vehicle is driving (frictional force), the weather, the distance to the front (or rear) vehicle, the relative speed of the front (or rear) vehicle, the curvature of the curve when the driving lane is a curve, the vehicle Ambient brightness, information related to an object existing in a reference area (constant area) based on a vehicle, whether an object enters / departs from the predetermined area, whether a user exists near a vehicle, and information related to the user (e.g., For example, whether or not the user is an authenticated user).

The surrounding information may include ambient brightness, temperature, sun position, object information (persons, other vehicles, signs, etc.) located in the vicinity, the type of road surface being driven, features, lane information, and driving lanes. ), And information necessary for autonomous driving / autonomous parking / automatic parking / manual parking mode.

In addition, the surrounding information may include, for example, a distance between an object (object) existing near the vehicle and the vehicle 100, a collision possibility, the type of the object, a parking space where the vehicle can park, and an object for identifying a parking space (for example, , Parking lines, ropes, other vehicles, walls, etc.) may be further included.

The vehicle driving information is not limited to the example described above, and may include all information generated from the components provided in the vehicle 100.

The main display 820 may output various pieces of information under the control of the controller 840 included in the display apparatus 800. For example, the main display 820 may display the vehicle driving information.

The main display 820 may include a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (LCD). It may include at least one of a flexible display, a 3D display, an e-ink display.

The main display 820 may also be transparent like the sub display 830 described below. In this case, the display apparatus 800 may be disposed in a windshield or a window of the vehicle 100. Terms such as 'main' and 'sub' are used to distinguish one component from other components, and the main display 820 and the sub display 830 may have the same structure.

Meanwhile, the display device 800 includes at least one sub display 830 that is distinguished from the main display 820.

The sub display 830 is transparent and is disposed at a position different from that of the main display 820. For example, at least a portion of the main display 820 may be overlapped. Accordingly, the information displayed on the main display 820 passes through the sub display 830 to the user.

As an example, when a first object is displayed on the main display 820 and a second object is displayed on the sub display 830, the user indicates that the second object is positioned on the first object. And the second object. Furthermore, the user may recognize the first and second objects as the second object is located closer to him than the first object, or the first object is farther from him than the second object. have. That is, due to the positional difference between the main display 820 and the sub display 830, the user may feel a three-dimensional depth.

When there are a plurality of sub-displays 830, the sub-displays 830 may be stacked along one direction of the main display 820 or spaced apart by a predetermined distance. If each of the sub displays is spaced apart from the main display at different intervals, a three-dimensional depth may be formed in the information displayed on each display (including the main and sub displays).

Here, the depth or depth value refers to an index indicating a distance difference between a virtual point and an object displayed on the display device 800. When the object displayed by the display device 800 is located at the one point, the depth value of the object may be defined as “0”. Depth values of the objects that appear to protrude out of the display device 800 from the one point may be defined as negative numbers, and depth values of the objects that appear to enter the inside may be defined as positive numbers. The greater the absolute value of the depth value, the more the object can be interpreted as being far from the one point.

Although the same graphic object is displayed in the same size, it may have different depth values depending on which display is displayed.

When no information is displayed on the sub display 830, the user is provided with information displayed on the main display 820 in a two-dimensional form.

In contrast, when information is displayed on the sub display 830, all the information displayed on the main display 820 and the sub display 830 may be provided in a three-dimensional form. This is because each information displayed on different displays has a different depth value due to the positional difference between the main display 820 and the sub display 830.

The sub display disposed at the outermost part of the display apparatus 800 may form a layer structure or an integral structure with the touch input unit, thereby implementing a touch screen. The controller 840 may vary the information displayed on the main display 820 and / or the sub display 830 based on the touch input applied to the touch screen.

The controller 840 is configured to control at least one of the main display 820 and the sub display 830.

In detail, the controller 840 may determine whether at least one condition is satisfied among a plurality of preset conditions based on the vehicle driving information received through the communication unit 810. According to a condition satisfied, the controller 840 may control at least one of the main display 820 and the sub display 830 in different ways.

In relation to the preset condition, the controller 840 may detect that an event occurs in the electronic device and / or the application provided in the vehicle 100, and determine whether the detected event satisfies the preset condition. In this case, the controller 840 may detect that an event occurs from the information received through the communication unit 810.

The application is a concept including a widget, a home launcher, etc., and means any type of program that can be driven in the vehicle 100. Accordingly, the application may be a program that performs a function of a web browser, video playback, message transmission, reception, schedule management, and application updating.

Furthermore, the application includes forward collision warning (FCW), blind spot detection (BSD), lane departure warning (LDW), pedestrian detection (PD), and curve speed warning. It may include at least one of (Curve Speed Warning, CSW) and turn by turn navigation (TBT).

For example, an event can occur when there is a missed call, when there is an application to be updated, when a message arrives, start on, start off, autonomous driving on / off, display activation key pressed (LCD awake key), alarm (alarm), incoming call (Incoming call), missed notification (missed notification) and the like.

As another example, the occurrence of an event may be a case in which an alert set in an advanced driver assistance system (ADAS) and a function set in an ADAS are performed. For example, when a forward collision warning occurs, when a blind spot detection occurs, when a lane departure warning occurs, and when a lane steering warning occurs If an assist warning occurs, it can be considered that an event has occurred when autonomous emergency braking is performed.

As another example, when a change from a forward gear to a reverse gear occurs, when an acceleration greater than a predetermined value occurs, when a deceleration greater than a predetermined value occurs, when the power unit is changed from an internal combustion engine to a motor, or when the motor The event can also be regarded as a change in the internal combustion engine.

In addition, it can be seen that an event has occurred even when various ECUs provided in the vehicle 100 perform a specific function.

When the generated event satisfies the preset condition, the controller 840 controls the main display 820 and / or the sub display 830 to display information corresponding to the satisfied condition.

When an event occurs, event information related to the generated event needs to be provided to the passenger of the vehicle 100. In this case, the information displayed on the main display 820 and the information displayed on the sub display 830 are distinguished.

For example, general information to be provided to the passenger may be displayed on the main display 820 as main information, and sub information for emphasizing the main information may be displayed on the sub display 830.

As another example, the above-described vehicle driving information may be displayed on the main display 820, and a graphic object related to the vehicle driving information may be displayed on the sub display 830.

When the graphic object related to the vehicle driving information is to be displayed on the sub display 830, the controller 840 selects one of a plurality of sub displays and displays the graphic object on the selected sub display. Can be.

The graphic object is for emphasizing the information displayed on the main display 820, and may be different graphic objects according to the information displayed on the main display 820. As another example, different graphic objects may be used depending on the type of event that has occurred. Different graphic objects mean, for example, images having different shapes, lengths, colors, and the like.

The type of the graphic object displayed on the sub display 830 may vary according to vehicle driving information displayed on the main display 820.

The one sub display in which the graphic object is displayed may vary according to a driving situation of the vehicle. Here, the driving situation may be related to at least one of the position, the acceleration, the driving speed, the driving direction, and the possibility of collision with an external object of the vehicle 100.

Since the vehicle is assumed to move, the information provided by the vehicle has unique location data. For example, in the case of the road guide information, the location data of the point to which the road guidance should be provided is included, and in the case of the object information having the possibility of collision, the road guide information has the location data of the point where the object is located.

When displaying information having location data, it is important to effectively inform passengers of a point corresponding to the location data, and the display apparatus 800 according to the present invention uses the plurality of sub-displays disposed at different locations. You can guide the point effectively.

In detail, the controller 840 of the display apparatus 800 may adjust the display position of the information to have different depth values according to how far the point is from the vehicle 100. This is because a plurality of subdisplays are sequentially arranged along one direction based on the main display, and have different depth values depending on which subdisplay has the same information.

For example, when the point is located within the first distance range, information guiding the point is displayed on the first sub display, and when the point is located within the second distance range, the information to be displayed on the second sub display is displayed. Can be. Since the depth is different depending on the displayed position, the passenger intuitively recognizes how far the point is.

FIG. 9 is a conceptual diagram illustrating a method of displaying a graphic object in the display device of FIG. 8.

According to an embodiment of the present disclosure, the display apparatus 800 may display an image 910 of photographing the object when there is an object 920 that is likely to collide in the driving direction of the vehicle 100.

In this case, the controller 840 displays the image 910 on the main display 820, and displays the graphic object 930 guiding the object 920 on one of the sub-displays 830a-830c. Can be.

The position at which the graphic object 930 is displayed may vary depending on the position of the object 920 and / or the speed of the vehicle 100.

For example, the graphic object 930 may be displayed on the first sub display 830a when the object 920 is located within a first distance range from the vehicle 100, and may be displayed when the object 920 is located within a second distance range. The second sub display 830b may be displayed on the second sub display 830b and positioned within the third distance range. Unlike this, if not located within the first to third distance ranges, the first to third sub displays 830a to 830c may not be displayed. That is, according to the distance between the wheel 920 and the vehicle 100, the graphic object 930 may be displayed on the sub display 830 and then disappear or may not be displayed.

As the object 920 is located closer, the graphic object 930 is displayed on the sub display closer to the passenger, so that the passenger may feel a depth reflected in the distance from the object 920.

The first to third distance ranges may vary depending on the speed of the vehicle 100. This is because the braking distance varies depending on the speed of the vehicle 100.

On the other hand, the display device 800 according to the present invention can generate a more enhanced sense of depth in a software manner as well as a hardware method using displays disposed at different positions.

A method of controlling a software method for improving depth is described in detail with reference to FIGS. 10 and 12.

10 is a flowchart illustrating a control method of the display apparatus according to an exemplary embodiment. FIGS. 11A, 11B, and 12 are exemplary diagrams for describing the control method of FIG. 10 in more detail.

The plurality of sub displays includes a reference sub display. The reference subdisplay may be defined as a reference plane of a three-dimensional optical illusion phenomenon. The reference sub display may be preset and invariable, or may vary according to any one sub display on which a graphic object is displayed.

First, an embodiment in the case where the reference sub display is preset will be described first.

Referring to FIG. 10, the controller 840 may display at least one image for generating a 3D optical illusion on the reference sub-display (S1010).

The reference subdisplay is a reference plane for generating a 3D optical illusion phenomenon, and may be any one subdisplay 830b positioned in the center of the plurality of subdisplays 830a-830c as illustrated in FIG. 11A.

In this case, the plurality of sub-displays may include a preceding sub-display 830a positioned in front of the reference sub-display 830b and a trailing sub-display 830c positioned behind the base reference sub-display 830b. have.

The preceding sub display 830a refers to a sub display located closer to the passenger than the reference sub display 830b, and the trailing sub display 830c refers to a sub display located farther from the passenger than the reference sub display 830b.

The graphic object related to the driving information displayed on the main display 820 may be displayed on any one of the reference sub display 830b, the preceding sub display 830a, and the trailing sub display 830c.

The graphic object may be recognized as being relatively close to the passenger when displayed on the preceding sub display 830a, and may be perceived as being relatively far away to the passenger when displayed on the trailing sub display 830c.

Meanwhile, the graphic object may be plural.

In this case, the plurality of graphic objects may be classified into a first group and a second group according to preset criteria. Graphic objects included in the first group may be displayed on the preceding sub display 830a, and graphic objects included in the second group may be displayed on the subsequent sub display 830c. Graphic objects that cannot be classified into any one of the first and second groups may be displayed on the reference sub display 830b.

The preset criterion may be related to at least one of a position, an acceleration, a traveling speed, a driving direction, and a possibility of collision with an external object of the vehicle 100. Graphic objects with high importance that passengers should carefully look at according to driving conditions of the vehicle 100 may be displayed on the preceding sub display 830a, and graphic objects having less importance may be displayed on the subsequent sub display 830b.

For example, when a notification image of a potential collision object is displayed as a graphic object, an object closer than the reference distance is displayed on the preceding sub display 830, and an object further than the reference distance is trailing sub display 830c. May be displayed. Alternatively, an object at a reference distance may be displayed on the reference sub display 830b. In this case, the criterion for determining the display position is a distant distance, and the reference distance may vary depending on the speed of the vehicle.

As another example, when the road guide information is displayed on the main display 820 in a turn-by-turn manner, the road guide information includes location data of a point at which the road guide should be provided. In this case, the road guidance information may be classified into a first group and a second group based on the distance between the point where the road guidance is to be provided and the vehicle 100.

The reference sub display 830b is configured to display at least one reference image 1100 that generates a 3D optical illusion of the

graphic objects

1120 and 1130 displayed on the sub display 830.

The reference image 1100 may be an image of a bar shape covering a portion of the main display 820. For example, the image may have a bar shape extending from one end of the main display 820 to the other end. Accordingly, the image may have a long bar shape or an image having a long bar shape.

The reference image 1110 is for generating an optical illusion effect on the graphic object displayed on the sub display 830 and is made to be covered by the first graphic object 1120 displayed on the preceding sub display 830a. And cover the second graphic object 1130 displayed on the trailing sub-display 830c.

In other words, when a graphic object is displayed on the trailing sub display 830c, a portion of the graphic object is hidden by the reference image 1110. When the graphic object is displayed on the preceding sub display 830a, a portion of the reference image 1110 is made to be covered by the graphic object.

Since the reference image 1110 is recognized as a reference plane by the user, the first graphic object 1120 displayed on the preceding sub display 830a and covering the reference image 1110 is positioned in front of the reference plane (or the reference plane). Closer). In contrast, the second graphic object 1130 is recognized as being located behind the reference plane (or further away from the reference plane).

In order to enable such a configuration, the controller 840 sets the display position and / or size of the reference image 1110 in consideration of the position where the graphic object is displayed. In other words, at least one of the display position and the size of the reference image 1110 may vary depending on the position where the graphic object is displayed. For example, the reference image 1110 may be displayed at the first position as shown in FIG. 11A or at the second position as shown in FIG. 11B.

Meanwhile, referring to FIG. 12, a position where the reference image 1210 is displayed may vary according to the speed of the vehicle 100.

For example, the display apparatus 800 may display an image 1200 received from a camera configured to photograph the side and / or the rear of the vehicle on the main display 820.

Furthermore, the sub display 830 may display

graphic objects

1220 and 1230 guiding objects included in the image 1200 that have a higher probability of collision with the vehicle 100 than the reference.

The controller 840 may classify an object having a collision possibility in a first range into a first group, and classify an object having a collision probability in a second range into a second group. The graphic object 1220 corresponding to the objects included in the first group is displayed on the preceding sub display 830a, and the graphic object 1230 corresponding to the objects included in the second group is displayed on the subsequent sub display 830c. Can be. In addition, the reference image 1210 that produces the 3D optical illusion may be displayed on the reference sub display 830b.

On the other hand, depending on the speed of the vehicle 100, the safety distance for avoiding the collision may vary. In order to guide the safety distance, the controller 840 may change at least one of the display position and the size of the reference image 1210. At least one of a position at which the reference image 1210 is displayed and a size of the reference image 1210 vary according to the speed of the vehicle 100.

As the reference image 1210 is located at the bottom of the display device 800, the user of the display apparatus 800 recognizes that an object included in the image 1200 is located closer, and may feel a high level of threat. In contrast, as the reference image 1210 is located at the top, the object included in the image 1200 is recognized as being farther away, and a lower level of threat may be felt.

As such, the controller 840 may transmit information to the user more effectively by changing at least one of the display position and the size of the reference image 1210 based on the speed of the vehicle 100.

Although not illustrated, the number of reference images displayed on the reference sub display 830b may vary depending on the speed of the vehicle 100. For example, n reference images may be displayed when the speed of the vehicle 100 is within a first speed range, and m reference images may be displayed when within a second speed range. Here, n and m are natural numbers.

The controller 840 may move the graphic object displayed on one sub display from one of the other to the other sub display according to the driving situation of the vehicle 100.

13 is a flowchart illustrating a control method of a display apparatus according to an exemplary embodiment, and FIGS. 14A and 14B are exemplary views for describing the control method of FIG. 13 in more detail.

First, the controller 840 may display the graphic object on one of the plurality of sub displays at time t (S1310).

For example, as shown in FIG. 14A, when the lane departure detection mode of the vehicle 100 is executed, graphic objects for guiding the position of the vehicle 100 with respect to the lane may be displayed on the sub display 830. Can be.

If the vehicle 100 is driving normally without leaving the lane, the vehicle graphic object 1410 guiding the vehicle 100 and two

reference images

1420a and 1420b guiding the lane are the reference sub display 830b. ) May be displayed.

Thereafter, when the driving situation of the vehicle 100 is changed, at least one display position of the vehicle graphic object 1410 and the

reference images

1420a and 1420b may be changed according to the driving situation of the vehicle. .

For example, as illustrated in FIG. 14A, the controller 840 may display the vehicle graphic object 1410 guiding the position of the vehicle 100 on the reference sub display 830b. Then, when the vehicle 100 leaves the lane, as illustrated in FIG. 14B, the controller 840 may move the vehicle graphic object 1410 to the preceding sub display 830a instead of the reference sub display 830b. I can display it.

In other words, the controller 840 may control the sub-displays to move the graphic object from one sub-display to the other sub-display based on the driving situation of the vehicle 100.

As shown in FIG. 14B, the

reference images

1420a and 1420b may not only generate a three-dimensional optical illusion of the vehicle graphic object 1410 but also guide a driving lane.

When the vehicle graphic object 1410 is displayed on the preceding sub-display 830a, and the

reference images

1420a and 1420b are displayed on the reference sub-display 830b, the passenger places the vehicle 100 on the left lane. You feel the same three-dimensional depth. Since the warning of lane departure is provided in three-dimensional form rather than two-dimensional form, the passenger can recognize the warning more intuitively.

When the reference sub display is fixed, the reference image is displayed on the reference sub display, and the graphic object may be displayed on any one of the preceding sub display, the reference sub display, and the following sub display. The controller 840 may select any one sub display in which the graphic object is displayed according to the driving situation of the vehicle 100.

When the reference image is fixedly displayed on the reference sub display, the controller 840 may change the display position of the graphic object, thereby creating a three-dimensional animation effect such as coming out of the reference image or being pushed behind the reference image. have.

For example, when the reference image guides the safety distance of the vehicle, the reference image may be displayed on the reference sub display. When an object located within the safety distance is detected, the graphic object guiding the object may be displayed on a preceding sub display, and when an object located outside the safety distance is detected, the graphic object may be displayed on a subsequent sub display.

Subsequently, when the object is located within the safety distance and then outside the safety distance, the graphic object may be displayed on the preceding sub display and then moved to the subsequent sub display.

The passenger can intuitively recognize the range of the object within the three-dimensional depth.

On the other hand, the reference sub display may vary according to the driving situation of the vehicle 100. An embodiment in which the reference sub-display is changed will be described in detail with reference to FIGS. 15, 16A, 16B, and 16C.

FIG. 15 is a flowchart illustrating a control method of a display apparatus according to an exemplary embodiment. FIGS. 16A, 16B, and 16C are exemplary diagrams for describing the control method of FIG. 15 in more detail.

Referring to FIG. 15, the controller 840 may select one of the plurality of sub displays based on the vehicle driving information (S1510).

Since the main display and the sub display are spaced apart at predetermined intervals, when defining the three-dimensional depth of the main display 820 as 0, the farther away from the main display 820, the depth corresponding to the integral multiple of z becomes. Occurs. For example, when a depth of z occurs in the third sub display 830c, a depth of 2z is generated in the second sub display 830b, and a depth of 3z is generated in the first sub display 830a. . Where z is a natural number.

The controller 840 may detect the occurrence of the event, determine how much depth is generated in the graphic object corresponding to the generated event, and select any one subdisplay corresponding thereto.

Next, at least one reference image for generating an adjacent sub-display 3D next phenomenon based on the selected sub-display may be displayed (S1530).

In this case, the sub display on which the graphic object is displayed becomes the reference sub display, and the controller 840 generates at least one reference image for generating a three-dimensional optical illusion of the graphic object on the adjacent sub display based on the reference sub display. Can be displayed. That is, when the depth value of the graphic object is determined, any one sub display in which the graphic object is to be displayed may be selected, and another sub display for generating a 3D optical illusion of the graphic object may be selected.

For example, based on the front of the vehicle 100, when the probability of collision is lower than the first criterion, no information may be displayed on the sub displays. When an object having a higher probability of collision is detected than the first criterion, the graphic object 1610 guiding the object may be displayed on one of the sub displays 830a to 830c. In this case, the controller 840 may select one of the sub-displays based on the possibility of collision of the object.

For example, as illustrated in FIG. 16A, when the collision probability of the object is within a first reference range, the graphic object 1610 is displayed on the third sub display 830c having the lowest depth payoff. Reference images 1620a and 1620d for generating a 3D optical illusion of the graphic object 1610 may be displayed on at least one of the first and

second sub-displays

830a and 830b. Since the reference images are recognized by the passenger as a reference line, when the graphic object 1610 is displayed behind the reference line, it may be recognized that the object to be careful is in the front but the level to be careful is low.

For another example, as shown in FIG. 16B, when the collision probability of the object is within a second reference range, the graphic object 1610 is displayed on the second sub display 830b having a medium depth payoff. Can be. The first reference image 1620a may be displayed on the third sub display 830c, and the second reference image 1620b may be displayed on the first sub display 830a.

By the

reference images

1620a and 1620b in which at least a portion of the graphic object 1610 overlaps, the effect of the 3D optical illusion may be increased.

In order to further increase the effect of the 3D optical illusion, the controller 840 may adjust the size of the graphic object 1610 according to any one sub-display in which the graphic object 1610 is displayed. For example, as the depth value of the graphic object 1610 increases, the controller 840 may control the sub display to increase the size of the graphic object 1610. In other words, the first graphic object may be displayed in a first size displayed on the first sub display, and may be displayed in a second size when displayed on the second sub display.

The controller 840 may set different display positions of the

reference images

1620a and 1620b according to the speed of the vehicle 100. This is because the three-dimensional depth of the graphic object 1610 varies depending on the distance between the

reference images

1620a and 1620b.

When the speed of the vehicle 100 is within the first speed range, the

reference images

1620a and 1620b may be disposed to be spaced apart by the first interval D1. In contrast, when the speed of the vehicle 100 is within the second speed range, the

reference images

1620a and 1620b may be disposed to be spaced apart by the second interval D2.

A passenger may feel a relatively urgency as the interval between the

reference images

1620a and 1620b is narrower, and an object corresponding to the graphic object 1610 may be closer to himself.

The controller 840 may display a graphic object having unique location data based on the location of the vehicle 100. For example, in the case of the road guide information, the location data of the point to which the road guidance should be provided is included, and in the case of the object information having the possibility of collision, the road guide information has the location data of the point where the object is located.

The controller 840 may compare the position set in the graphic object with the position of the vehicle 100, and select any one sub display to display the graphic object based on the comparison result.

More specifically, different reference distances may be set in the plurality of sub displays. The controller 840 may select one of the sub-displays based on the position set in the graphic object, the distance between the vehicle, and the reference distance set in each sub-display.

For example, as shown in FIG. 17A, the reference distance of the first sub display 830a is set to 1 km, the reference distance of the second sub display 830b is set to 2 km, and the reference distance of the third sub display 830a. The reference distance can be set to 3 km. In addition, reference images 1720a-1720c may be displayed on each sub display to guide each reference distance.

When 2km-3km is left to the point where the vehicle 100 should turn right, the road guide graphic object 1710 guiding the point may be displayed on the third sub display 830c. A three-dimensional optical illusion occurs in the road guide graphic object 1710 by the reference images 1720a-1730c, and a passenger is provided with road guidance information in three dimensions.

The reference distance set in each sub display may vary according to the speed of the vehicle. Specifically, if the speed of the vehicle 100 is within the first speed range, the unit distance to be set may be set to UD1, and if the speed of the vehicle 100 is within the second speed range, the unit distance may be set to UD2 different from the UD1. Here, UD1 and UD2 mean natural numbers.

Since the braking distance is longer as the speed of the vehicle 100 increases, it is necessary to secure a sufficient safety distance. Therefore, as the speed of the vehicle 100 increases, the unit distance may increase. For example, as shown in FIG. 17A, the unit distance is 1 km, and as shown in FIG. 17B, when the speed of the vehicle 100 is changed, the unit distance may be changed to 100 m.

Even the reference image having the same shape has a different meaning depending on the reference distance set in each sub display.

When 0m-100m is left to the point where the vehicle 100 should turn right due to the movement of the vehicle 100, the road guide graphic object 1710 guiding the point may be displayed on the first sub display 830a. . That is, as the vehicle 100 moves, the graphic object 1710 may also move from one of the sub displays 830a to 830c to the other.

In other words, the controller 840 may move and display the graphic object 1710 on one of the sub-displays in order along one direction based on the driving situation of the vehicle 100.

Meanwhile, when there is an object having a higher probability of collision based on the vehicle 100, the controller 840 may display the one display such that a graphic object corresponding to the object is displayed on the one sub display. Can be controlled. The graphic object is configured to guide the object, and forms a different depth depending on the displayed position.

For example, when the gear of the vehicle 100 is a reverse gear, the controller 840 receives an image from a camera configured to photograph the rear of the vehicle 100, and displays the main image to display the received image. 820 may be controlled.

As illustrated in FIG. 18, information 1810 may be displayed on the main display 820 to guide a possibility of collision within a predetermined range with respect to the vehicle 100.

Furthermore, the controller 840 may three-dimensionally provide a collision possibility using the sub-displays 830a-830c. Specifically, the graphic object is displayed on the reference sub display 830b, and the graphic object corresponding to the region having a higher probability of collision is displayed on the preceding sub display 830a, and the graphic object corresponding to the region lower than the reference is It may be displayed on the trailing sub display 830c.

The controller 840 may provide a three-dimensional user interface by using the sub-displays in displaying various menus.

When the user selects any one menu, the controller 840 may improve the recognition of the selected menu by adjusting the 3D effect of the selected menu.

In detail, a menu list including at least one menu item may be displayed on the main display 820. In this case, the controller 840 may display the reference image on any one subdisplay.

When one menu item is selected by a user input such as a touch input or a voice input, a graphic object guiding the selected menu item may be displayed on a sub display different from the one sub display. For example, the graphic object may be displayed on a first sub display, and the reference image may be displayed on a second sub display positioned between the first sub display and the main display.

In this way, the selected menu item is placed in front of the reference image, and the rest of the non-selected menu items have the same effect as lying behind the reference image.

Meanwhile, the present invention can be extended to the vehicle 100 having the display device 800 described with reference to FIGS. 8 to 19.

The present invention described above can be embodied as computer readable code (or an application or software) on a medium on which a program is recorded. The above-described control method of the autonomous vehicle can be realized by a code stored in a memory or the like.

The computer-readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include hard disk drives (HDDs), solid state disks (SSDs), silicon disk drives (SDDs), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and the like. This also includes those implemented in the form of carrier waves (eg, transmission over the Internet). The computer may also include a processor or a controller. Accordingly, the above detailed description should not be construed as limiting in all aspects and should be considered as illustrative. The scope of the invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the invention are included in the scope of the invention.

Claims

A display device provided in a vehicle,

A main display configured to display driving information of the vehicle;

A plurality of sub displays stacked on the main display and made transparent; And

And a controller configured to control the graphic object related to the driving information to be displayed on any one of the plurality of sub-displays.

The at least one sub display on which the graphic object is displayed varies according to a driving situation of the vehicle.
The method of claim 1,

The plurality of sub displays includes a reference sub display,

And the reference sub-display is configured to display at least one image producing a three-dimensional optical illusion of the graphic object.
The method of claim 2,

The plurality of sub displays,

A preceding sub display positioned in front of the reference sub display; And

And a trailing sub-display positioned behind the reference sub-display.
The method of claim 3,

The control unit,

When there are a plurality of graphic objects, the plurality of graphic objects are classified into a first group and a second group according to preset criteria.

And the graphic object included in the first group is displayed on the preceding sub display, and the graphic object included in the second group is displayed on the subsequent sub display.
The method of claim 4, wherein

The preset criterion is related to at least one of a driving direction, a traveling speed, and a position of the vehicle.
The method of claim 3,

When the graphical object is displayed on the trailing subdisplay, a portion of the graphical object is made to be covered by the image,

And when the graphic object is displayed on the preceding sub-display, a portion of the image is covered by the graphic object.
The method of claim 2,

The at least one image is a display device, characterized in that the bar shape covering a portion of the main display.
The method of claim 7, wherein

And the position at which the at least one image is displayed is changed according to the speed of the vehicle.
The method of claim 7, wherein

And the number of the at least one image displayed on the reference sub display varies according to the speed of the vehicle.
The method of claim 1,

The control unit,

And adjusting the size of the graphic object according to the one sub-display in which the graphic object is displayed.
The method of claim 1,

The control unit,

And displaying at least one image for generating a 3D optical illusion of the graphic object on an adjacent subdisplay based on the any one subdisplay.
The method of claim 11,

And the position at which the at least one image is displayed varies depending on the position at which the graphic object is displayed on the at least one sub-display.
The method of claim 1,

And a type of the graphic object is changed according to the driving information displayed on the main display.
The method of claim 1,

The control unit,

If there is an object with a higher probability of collision based on the vehicle, the graphic object is controlled to be displayed on the one sub display.

And the graphic object is configured to guide the object.
The method of claim 1,

The control unit,

And comparing the position of the graphic object with the position of the vehicle, and selecting one of the sub-displays based on a comparison result.
The method of claim 1,

Different reference distances are set in the plurality of sub displays.

The control unit,

And selecting one of the sub-displays based on a distance between the position set in the graphic object and the vehicle and a reference distance set in each sub-display.
The method of claim 16,

And a reference distance set in each sub display varies according to the speed of the vehicle.
The method of claim 1,

The control unit,

And controlling the graphic object to move from the one sub display to the other sub display based on the driving situation of the vehicle.
The method of claim 18,

The control unit,

And displaying the graphic object on one of the sub-displays in sequence along one direction based on a driving situation of the vehicle.
A vehicle comprising the display device of claim 1.