KR101807788B1 - Display apparatus for vehicle and control method for the same - Google Patents

Abstract

The present invention relates to a display device for a vehicle and a control method thereof, and a display device for a vehicle according to an embodiment of the present invention includes a display portion disposed in an interior of a vehicle, a sensing portion detecting an object approaching the display portion, Selecting one display mode to be applied to the display unit among a plurality of predetermined display modes based on position information of the object detected by the sensing unit and setting a screen configuration of the display unit according to the selected display mode Wherein the plurality of display modes includes a driver mode and a passenger mode.

Description

Technical Field [0001] The present invention relates to a display device for a vehicle and a control method thereof.

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a display device and a control method thereof, and more particularly, to a vehicle display device and a control method thereof that change a screen configuration in response to proximity of an object.

A vehicle is a device that drives a wheel to transport a person or cargo from one place to another. For example, two-wheeled vehicles such as a motorcycle, a four-wheeled vehicle such as a sedan, as well as a train belong to the vehicle.

In order to increase the safety and convenience of users who use the vehicle, development of technologies for connecting various sensors and electronic devices to the vehicle has been accelerated. In particular, a system that provides various functions (eg, smart cruise control, lane keeping assistance) developed for the user's driving convenience is installed in the vehicle. Thereby, so-called autonomous driving in which the vehicle runs on the road in consideration of the external environment itself becomes possible without the driver's operation.

Meanwhile, the vehicle may be provided with a display device for providing various vehicle information and convenience information to a passenger. However, the conventional display device displays the specific information uniformly without discriminating between the driver and the passenger, and thus the user's satisfaction and utilization are not high.

SUMMARY OF THE INVENTION The present invention is conceived to solve the above-described problems, and it is an object of the present invention to improve the usability and the driving stability of the occupant by changing the screen configuration according to the position, movement or number of objects close to the display on which predetermined information is output And an object of the present invention is to provide a display device for a vehicle and a control method thereof.

The problems of the present invention are not limited to the above-mentioned problems, and other problems not mentioned can be clearly understood by those skilled in the art from the following description.

According to an aspect of the present invention, there is provided an information processing apparatus including a display unit disposed in an interior of a vehicle, a sensing unit configured to detect an object approaching the display unit, And a processor for selecting a display mode to be applied to the display unit among a plurality of predetermined display modes and changing a screen configuration of the display unit in accordance with the selected display mode, The modes include a driver mode and a passenger mode.

The sensing unit may include at least one of an infrared sensor, a proximity sensor, and an illuminance sensor.

Further, the processor may select the driver mode among the plurality of display modes when the position of the object corresponds to the first area of the display unit, and the position of the object corresponds to the second area of the display unit A passenger mode among the plurality of display modes can be selected.

The processor may switch the screen displayed on the display unit to the first screen in the driver mode and switch the screen displayed on the display unit to the second screen in the passenger mode.

The processor may display the first menu list in the first area of the display unit in the driver mode and the second menu list in the second area of the display unit in the passenger mode.

Also, the second menu list may include at least one usage restriction menu, and the use restriction menu may be a menu related to a predetermined function such that execution in the driver mode is blocked.

In the driver mode, the processor may move at least one of the objects displayed on the display unit to a first area of the display unit. In the passenger mode, at least one of the objects displayed on the display unit may be To the second area of the display unit.

In addition, the plurality of display modes may further include a common mode, and the sensing unit may detect two objects simultaneously approaching the display unit, and the processor may be configured such that the position of any one of the two objects is different from that of the display unit 1, and if the position of the other of the two objects corresponds to a second area of the display unit, the common mode among the plurality of display modes may be selected.

Also, in the common mode, the processor may display a first virtual keyboard associated with a screen displayed on the display unit in a first area of the display unit, and display a second virtual keyboard associated with the screen displayed on the display unit, And can be displayed in the second area of the display unit.

The first area may be a region that is closer to the driver's seat of the vehicle than the second area and does not have a portion overlapping the second area.

The details of other embodiments are included in the detailed description and drawings.

Effects of the display device for a vehicle and the control method thereof according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, it is possible to improve the usability and the driving safety of the occupant by changing the screen configuration in accordance with the position, motion, or number of objects close to the display on which predetermined information is output .

Further, according to at least one of the embodiments of the present invention, the present invention can change the layout of the screen displayed on the display, or change the layout of the screen displayed on the display by selecting a display mode corresponding to the position, Or to provide a new user interface for restricting the display of specific information.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description of the claims.

FIG. 1A shows a block diagram of a vehicle according to an embodiment of the present invention.
Fig. 1B shows an exemplary appearance of the vehicle shown in Fig. 1A.
FIG. 1C shows an example of images generated by the plurality of cameras shown in FIG. 1B.
2 shows a block diagram of a display device according to an embodiment of the present invention.
FIGS. 3A and 3B illustrate an appearance of a display device installed in a vehicle interior according to an embodiment of the present invention. FIG.
4 shows a flow chart of an exemplary process performed by a display device in accordance with an embodiment of the present invention.
5A to 5C show an example of an operation in which a display apparatus according to an embodiment of the present invention changes the screen configuration of a display unit according to proximity of a single object.
6A to 6C show an example of an operation in which a display apparatus according to an embodiment of the present invention changes a screen configuration of a display unit according to proximity of a single object.
7A to 7C show an example of an operation in which a display apparatus according to an embodiment of the present invention changes the screen configuration of a display unit according to proximity of a single object.
8A to 8C show an example of an operation in which a display apparatus according to an embodiment of the present invention changes a screen configuration of a display unit according to proximity of a single object.
9A to 9C show an example of an operation in which a display apparatus according to an embodiment of the present invention changes a screen configuration of a display unit according to proximity of a single object.
10A to 10C illustrate an example of an operation in which a display apparatus according to an embodiment of the present invention changes the screen configuration of a display unit according to proximity of a single object.
11A to 11C show an example of an operation in which a display apparatus according to an embodiment of the present invention changes a screen configuration of a display unit according to proximity of a single object.
12A and 12B show an example of an operation in which a display apparatus according to an embodiment of the present invention changes a screen configuration of a display unit according to proximity of a single object.
13 shows an example of an operation in which a display apparatus according to an embodiment of the present invention changes the screen configuration of a display unit according to proximity of a plurality of objects.
14A to 14C show an example of an operation in which a display apparatus according to an embodiment of the present invention changes the screen configuration of the display unit 240 according to proximity of a plurality of objects.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between. It should also be understood that the term "controlling" one component is meant to encompass not only one component directly controlling the other component, but also controlling through mediation of a third component something to do. It is also to be understood that any element "providing" information or signals to another element is meant to encompass not only providing the element directly to the other element, but also providing it through intermediation of a third element .

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

The vehicle described in the present specification may be a concept including both an internal combustion engine vehicle having an engine as a power source, a hybrid vehicle having an engine and an electric motor as a power source, and an electric vehicle having an electric motor as a power source.

FIG. 1A shows a block diagram of a vehicle 100 according to one embodiment of the present invention.

1A, a vehicle 100 includes a communication unit 110, an input unit 120, a memory 130, an output unit 140, a vehicle driving unit 150, a sensing unit 160, a control unit 170, Unit 180, and a power source unit 190. [

The communication unit 110 may include one or more modules that enable wireless communication between the vehicle 100 and an external device (e.g., portable terminal, external server, other vehicle). In addition, the communication unit 110 may include one or more modules that connect the vehicle 100 to one or more networks.

The communication unit 110 may include a broadcast receiving module 111, a wireless Internet module 112, a local area communication module 113, a location information module 114, and an optical communication module 115.

The broadcast receiving module 111 receives broadcast signals or broadcast-related information from an external broadcast management server through a broadcast channel. Here, the broadcast includes a radio broadcast or a TV broadcast.

The wireless Internet module 112 refers to a module for wireless Internet access, and may be built in or externally mounted on the vehicle 100. The wireless Internet module 112 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, WLAN (Wireless LAN), Wi-Fi (Wireless Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA, WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) 112 transmit and receive data according to at least one wireless Internet technology, including Internet technologies not listed above. For example, the wireless Internet module 112 may exchange data wirelessly with an external server. The wireless Internet module 112 can receive weather information and road traffic situation information (for example, TPEG (Transport Protocol Expert Group)) from an external server.

The short-range communication module 113 is for short-range communication, and includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB) (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology.

The short-range communication module 113 may form short-range wireless communication networks to perform short-range communication between the vehicle 100 and at least one external device. For example, the short-range communication module 113 can wirelessly exchange data with the occupant's portable terminal. The short-range communication module 113 can receive weather information and road traffic situation information (for example, TPEG (Transport Protocol Expert Group)) from a portable terminal or an external server. For example, when the user aboard the vehicle 100, the user's portable terminal and the vehicle 100 can perform pairing with each other automatically or by execution of the user's application.

The position information module 114 is a module for acquiring the position of the vehicle 100, and a representative example thereof is a Global Positioning System (GPS) module. For example, when the vehicle utilizes a GPS module, it can acquire the position of the vehicle using a signal sent from the GPS satellite.

The optical communication module 115 may include a light emitting portion and a light receiving portion.

The light receiving section can convert the light signal into an electric signal and receive the information. The light receiving unit may include a photodiode (PD) for receiving light. Photodiodes can convert light into electrical signals. For example, the light receiving section can receive information of the front vehicle through light emitted from the light source included in the front vehicle.

The light emitting unit may include at least one light emitting element for converting an electric signal into an optical signal. Here, the light emitting element is preferably an LED (Light Emitting Diode). The optical transmitter converts the electrical signal into an optical signal and transmits it to the outside. For example, the optical transmitter can emit the optical signal to the outside through the blinking of the light emitting element corresponding to the predetermined frequency. According to an embodiment, the light emitting portion may include a plurality of light emitting element arrays. According to the embodiment, the light emitting portion can be integrated with the lamp provided in the vehicle 100. [ For example, the light emitting portion may be at least one of a headlight, a tail light, a brake light, a turn signal lamp, and a car light. For example, the optical communication module 115 can exchange data with other vehicles through optical communication.

The input unit 120 may include a driving operation unit 121, a microphone 123, and a user input unit 124.

The driving operation means 121 receives a user input for driving the vehicle 100. The driving operation means 121 may include a steering input means 121a, a shift input means 121b, an acceleration input means 121c and a brake input means 121d.

The steering input means 121a receives a forward direction input of the vehicle 100 from the user. The steering input means 121a may include a steering wheel. According to the embodiment, the steering input means 121a may be formed of a touch screen, a touch pad, or a button.

The shift input means 121b receives inputs of parking (P), forward (D), neutral (N), and reverse (R) of the vehicle 100 from the user. The shift input means 121b is preferably formed in a lever shape. According to an embodiment, the shift input means 121b may be formed of a touch screen, a touch pad, or a button.

The acceleration input means 121c receives an input for acceleration of the vehicle 100 from the user. The brake input means 121d receives an input for decelerating the vehicle 100 from the user. The acceleration input means 121c and the brake input means 121d are preferably formed in the form of a pedal. According to the embodiment, the acceleration input means 121c or the brake input means 121d may be formed of a touch screen, a touch pad, or a button.

The camera 122 is disposed at one side of the interior of the vehicle 100 to generate an indoor image of the vehicle 100. [ For example, the camera 122 may be disposed at various positions of the vehicle 100, such as a dashboard surface, a roof surface, a rear view mirror, etc., to photograph the passenger of the vehicle 100. In this case, the camera 122 may generate an indoor image of an area including the driver's seat of the vehicle 100. [ In addition, the camera 122 may generate an indoor image of an area including an operator's seat and an assistant seat of the vehicle 100. [ The indoor image generated by the camera 122 may be a two-dimensional image and / or a three-dimensional image. To generate a three-dimensional image, the camera 122 may include at least one of a stereo camera, a depth camera, and a three-dimensional laser scanner. The camera 122 can provide the indoor image generated by the camera 122 to the control unit 170 functionally combined with the indoor image.

The controller 170 analyzes the indoor image provided from the camera 122 and can detect various objects. For example, the control unit 170 can detect the sight line and / or the gesture of the driver from the portion corresponding to the driver's seat area in the indoor image. As another example, the control unit 170 can detect the sight line and / or the gesture of the passenger from the portion corresponding to the indoor area excluding the driver's seat area in the indoor image. Of course, the sight line and / or the gesture of the driver and the passenger may be detected at the same time.

The microphone 123 can process an external acoustic signal into electrical data. The processed data can be utilized variously according to functions performed in the vehicle 100. The microphone 123 can convert the voice command of the user into electrical data. The converted electrical data may be transmitted to the control unit 170.

The camera 122 or the microphone 123 may be a component included in the sensing unit 160 and not a component included in the input unit 120. [

The user input unit 124 is for receiving information from a user. When information is input through the user input unit 124, the controller 170 may control the operation of the vehicle 100 to correspond to the input information. The user input unit 124 may include a touch input means or a mechanical input means. According to an embodiment, the user input 124 may be located in one area of the steering wheel. In this case, the driver can operate the user input unit 124 with his / her finger while holding the steering wheel.

The input unit 120 may include a plurality of buttons or a touch sensor. It is also possible to perform various input operations through a plurality of buttons or touch sensors.

The sensing unit 160 senses a signal related to the running of the vehicle 100 or the like. To this end, the sensing unit 160 may include a sensor, a steering sensor, a speed sensor, a tilt sensor, a weight sensor, a heading sensor, a yaw sensor, a gyro sensor, Position sensor, vehicle forward / backward sensor, battery sensor, fuel sensor, tire sensor, steering sensor by steering wheel rotation, vehicle internal temperature sensor, internal humidity sensor, ultrasonic sensor, infrared sensor, radar, . ≪ / RTI >

Accordingly, the sensing unit 160 can sense the vehicle collision information, the vehicle direction information, the vehicle position information (GPS information), the vehicle angle information, the vehicle speed information, the vehicle acceleration information, the vehicle tilt information, Fuel information, tire information, vehicle lamp information, vehicle interior temperature information, vehicle interior humidity information, steering wheel rotation angle, and the like. The control unit 170 controls the acceleration and deceleration of the vehicle 100 based on the external environment information obtained by at least one of the camera, the ultrasonic sensor, the infrared sensor, the radar, A control signal for changing direction, etc. can be generated. Here, the external environment information may be information related to various objects located within a predetermined distance from the vehicle 100 in motion. For example, the external environment information may include information on the number of obstacles located within a distance of 100 m from the vehicle 100, a distance to the obstacle, a size of the obstacle, a type of the obstacle, and the like.

The sensing unit 160 may further include an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor AFS, an intake air temperature sensor ATS, a water temperature sensor WTS, A sensor (TPS), a TDC sensor, a crank angle sensor (CAS), and the like.

The sensing unit 160 may include a biometric information sensing unit. The biometric information sensing unit senses and acquires the biometric information of the passenger. The biometric information may include fingerprint information, iris-scan information, retina-scan information, hand geo-metry information, facial recognition information, Voice recognition information. The biometric information sensing unit may include a sensor that senses the passenger's biometric information. Here, the camera 122 and the microphone 123 can operate as sensors. The biometric information sensing unit can acquire hand shape information and facial recognition information through the camera 122. [

The sensing unit 160 may include at least one camera 161 for photographing the outside of the vehicle 100. [ The camera 161 may be referred to as an external camera. For example, the sensing unit 160 may include a plurality of cameras 161 disposed at different positions of the vehicle exterior. The camera 161 may include an image sensor and an image processing module. The camera 161 can process still images or moving images obtained by an image sensor (e.g., CMOS or CCD). The image processing module may process the still image or the moving image obtained through the image sensor, extract necessary information, and transmit the extracted information to the control unit 170.

The camera 161 may include an image sensor (e.g., CMOS or CCD) and an image processing module. In addition, the camera 161 can process still images or moving images obtained by the image sensor. The image processing module can process the still image or moving image obtained through the image sensor. In addition, the camera 161 may acquire an image including at least one of a traffic light, a traffic sign, a pedestrian, another vehicle, and a road surface.

The output unit 140 may include a display unit 141, an acoustic output unit 142, and a haptic output unit 143 for outputting information processed by the control unit 170.

The display unit 141 may display information processed by the controller 170. [ For example, the display unit 141 can display vehicle-related information. Here, the vehicle-related information may include vehicle control information for direct control of the vehicle, or vehicle driving assistance information for a driving guide to the vehicle driver. Further, the vehicle-related information may include vehicle state information indicating the current state of the vehicle or vehicle driving information related to the driving of the vehicle.

The display unit 141 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) display, a 3D display, and an e-ink display.

The display unit 141 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. Such a touch screen may function as a user input 124 that provides an input interface between the vehicle 100 and a user and may provide an output interface between the vehicle 100 and a user. In this case, the display unit 141 may include a touch sensor that senses a touch with respect to the display unit 141 so as to receive a control command by a touch method. When a touch is made to the display unit 141, the touch sensor senses the touch, and the control unit 170 generates a control command corresponding to the touch based on the touch. The content input by the touch method may be a letter or a number, an instruction in various modes, a menu item which can be designated, and the like.

Meanwhile, the display unit 141 may include a cluster so that the driver can check the vehicle state information or the vehicle driving information while driving. Clusters can be located on the dashboard. In this case, the driver can confirm the information displayed in the cluster while keeping the gaze ahead of the vehicle.

Meanwhile, according to the embodiment, the display unit 141 may be implemented as a Head Up Display (HUD). When the display unit 141 is implemented as a HUD, information can be output through a transparent display provided in the windshield. Alternatively, the display unit 141 may include a projection module to output information through an image projected on the windshield.

The sound output unit 142 converts an electric signal from the control unit 170 into an audio signal and outputs the audio signal. For this purpose, the sound output unit 142 may include a speaker or the like. It is also possible that the sound output unit 142 outputs a sound corresponding to the operation of the user input unit 124. [

The haptic output unit 143 generates a tactile output. For example, the haptic output section 143 may vibrate the steering wheel, the seat belt, and the seat so that the user can operate to recognize the output.

The vehicle driving unit 150 can control the operation of various devices of the vehicle. The vehicle driving unit 150 includes a power source driving unit 151, a steering driving unit 152, a brake driving unit 153, a lamp driving unit 154, an air conditioning driving unit 155, a window driving unit 156, an airbag driving unit 157, A driving unit 158, and a wiper driving unit 159. [0035]

The power source drive unit 151 may perform electronic control of the power source in the vehicle 100. [ The power source drive unit 151 may include an accelerator for increasing the speed of the vehicle 100 and a decelerator for decreasing the speed of the vehicle 100. [

For example, when the fossil fuel-based engine (not shown) is a power source, the power source drive unit 151 can perform electronic control of the engine. Thus, the output torque of the engine and the like can be controlled. When the power source drive unit 151 is an engine, the speed of the vehicle can be limited by limiting the engine output torque under the control of the control unit 170. [

In another example, when the electric motor (not shown) is a power source, the power source drive unit 151 can perform control on the motor. Thus, the rotation speed, torque, etc. of the motor can be controlled.

The steering driver 152 may include a steering apparatus. Accordingly, the steering driver 152 can perform electronic control of the steering apparatus in the vehicle 100. [ For example, the steering driver 152 may be provided with a steering torque sensor, a steering angle sensor, and a steering motor, and the steering torque applied by the driver to the steering wheel may be sensed by the steering torque sensor. The steering driver 152 can control the steering force and the steering angle by changing the magnitude and direction of the current applied to the steering motor based on the speed of the vehicle 100 and the steering torque. In addition, the steering driver 152 can determine whether the running direction of the vehicle 100 is properly adjusted based on the steering angle information obtained by the steering angle sensor. Thereby, the running direction of the vehicle can be changed. In addition, when the vehicle 100 is running at a low speed, the steering driver 152 lowers the weight of the steering wheel by increasing the steering force of the steering motor and reduces the steering force of the steering motor when the vehicle 100 is traveling at high speed, The weight can be increased. When the autonomous vehicle running function of the vehicle 100 is executed, the steering driver 152 may be configured to determine whether or not the steering wheel 160 is in a state where the driver operates the steering wheel (e.g., a situation in which the steering torque is not detected) It is also possible to control the steering motor to generate appropriate steering force based on the sensing signal or the control signal provided by the control unit 170. [

The brake driver 153 may perform electronic control of a brake apparatus (not shown) in the vehicle 100. [ For example, it is possible to reduce the speed of the vehicle 100 by controlling the operation of the brakes disposed on the wheels. As another example, it is possible to adjust the traveling direction of the vehicle 100 to the left or right by differently operating the brakes respectively disposed on the left wheel and the right wheel.

The lamp driving unit 154 may control the turn-on / turn-off of at least one or more lamps disposed inside or outside the vehicle. The lamp driver 154 may include a lighting device. Further, the lamp driving unit 154 can control intensity, direction, etc. of light output from each of the lamps included in the lighting apparatus. For example, it is possible to perform control for a direction indicating lamp, a head lamp, a brake lamp, and the like.

The air conditioning driving unit 155 may perform electronic control on an air conditioner (not shown) in the vehicle 100. For example, when the temperature inside the vehicle is high, the air conditioner can be operated to control the cool air to be supplied to the inside of the vehicle.

The window driving unit 156 may perform electronic control of a window apparatus in the vehicle 100. [ For example, it is possible to control the opening or closing of the side of the vehicle with respect to the left and right windows.

The airbag drive 157 may perform electronic control of the airbag apparatus in the vehicle 100. [ For example, in case of danger, the airbag can be controlled to fire.

The sunroof driving unit 158 may perform electronic control of a sunroof apparatus (not shown) in the vehicle 100. [ For example, the opening or closing of the sunroof can be controlled.

The wiper driving unit 159 may control the wipers 14a and 14b provided on the vehicle 100. [ For example, the wiper drive 159 may be configured to provide an electronic control for the number of drives, drive speeds, etc. of the wipers 14a, 14b in response to user input upon receipt of a user input instructing to drive the wiper through the user input 124 Can be performed. The wiper drive unit 159 may determine the amount or intensity of the rainwater based on the sensing signal of the rain sensor included in the sensing unit 160 so that the wipers 14a and 14b may be used without user input, Can be automatically driven.

Meanwhile, the vehicle driving unit 150 may further include a suspension driving unit (not shown). The suspension driving unit may perform electronic control of a suspension apparatus (not shown) in the vehicle 100. For example, when there is a curvature on the road surface, it is possible to control the suspension device so as to reduce the vibration of the vehicle 100. [

The memory 130 is electrically connected to the controller 170. The memory 170 may store basic data for the unit, control data for controlling the operation of the unit, and input / output data. The memory 190 may be, in hardware, various storage devices such as ROM, RAM, EPROM, flash drive, hard drive, and the like. The memory 130 may store various data for operation of the vehicle 100, such as a program for processing or controlling the controller 170. [

The interface unit 180 may serve as a path to various kinds of external devices connected to the vehicle 100. For example, the interface unit 180 may include a port connectable to the portable terminal, and may be connected to the portable terminal through the port. In this case, the interface unit 180 can exchange data with the portable terminal.

The interface unit 180 may receive the turn signal information. Here, the turn signal information may be a turn-on signal of the turn signal lamp for the left turn or the turn right turn inputted by the user. When the left or right turn signal turn-on input is received through the user input portion (724 in Fig. 6) of the vehicle, the interface portion 180 can receive left turn signal information or right turn signal information.

The interface unit 180 may receive vehicle speed information, rotation angle information of the steering wheel, or gear shift information. The interface unit 180 may receive the sensed vehicle speed information, the steering wheel rotation angle information, or the gear shift information through the sensing unit 160 of the vehicle. Alternatively, the interface unit 180 may receive the vehicle speed information, the steering wheel rotation angle information, or the gear shift information from the control unit 170 of the vehicle. Here, the gear shift information may be information on which state the shift lever of the vehicle is in. For example, the gear shift information may be information on which state the shift lever is in the parking (P), reverse (R), neutral (N), running (D) .

The interface unit 180 may receive user input received via the user input 124 of the vehicle 100. [ The interface unit 180 may receive the user input from the input unit 120 of the vehicle 100 or may receive the user input through the control unit 170. [

The interface unit 180 can receive information obtained from an external device. For example, when the traffic light change information is received from the external server through the communication unit 110 of the vehicle 100, the interface unit 180 can receive the traffic light change information from the control unit 170. [

The control unit 170 can control the overall operation of each unit in the vehicle 100. [ The control unit 170 may be referred to as an ECU (Electronic Control Unit).

The control unit 170 may be implemented in hardware as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs) ), Controllers, micro-controllers, microprocessors, and other electronic units for performing other functions.

The power supply unit 190 can supply power necessary for the operation of each component under the control of the controller 170. [ In particular, the power supply unit 170 can receive power from a battery (not shown) or the like inside the vehicle.

The AVN (Audio Video Navigation) device 400 can exchange data with the control unit 170. [ The control unit 170 may receive navigation information from the AVN apparatus or a separate navigation apparatus (not shown). Here, the navigation information may include set destination information, route information according to the destination, map information about the vehicle driving, or vehicle location information.

On the other hand, some of the components shown in FIG. 1A may not be essential for realizing the vehicle 100. FIG. Thus, the vehicle 100 described herein may have more or fewer components than those listed above. For example, the vehicle 100 may further include a display device 200 to be described later.

FIG. 1B shows an exemplary appearance of the vehicle 100 shown in FIG. 1A.

Referring to FIG. 1B, four cameras 161a, 161b, 161c, and 161d may be mounted at different positions of the vehicle 100 exterior. Each of the four cameras 161a, 161b, 161c, and 161d may be the same as the camera 161 described above. The plurality of cameras 161a, 161b, 161c, and 161d may be disposed at the front, left, right, and rear of the vehicle 100, respectively. Each of the plurality of cameras 161a, 161b, 161c, and 161d may be included in the camera 161 shown in FIG.

The front camera 161a may be disposed near the windshield, near the ambulance, or near the radiator grill.

The left camera 161b may be disposed in a case surrounding the left side mirror. Alternatively, the left camera 161b may be disposed outside the case surrounding the left side mirror. Alternatively, the left camera 161b may be disposed in one area outside the left front door, the left rear door, or the left fender.

The right camera 161c may be disposed in a case surrounding the right side mirror. Or the right camera 161c may be disposed outside the case surrounding the right side mirror. Alternatively, the right camera 161c may be disposed in one area outside the right front door, the right rear door, or the right fender.

On the other hand, the rear camera 161d may be disposed in the vicinity of a rear license plate or a trunk switch.

The respective images photographed by the plurality of cameras 161a, 161b, 161c, and 161d are transmitted to the control unit 170, and the control unit 170 may synthesize the respective images to generate an external image for each direction of the vehicle . Alternatively, each image photographed by the plurality of cameras 161a, 161b, 161c and 161d is transmitted to a processor 270 of a display device 200 to be described later, and the processor 270 synthesizes the respective images, To generate an external image for each direction.

FIG. 1C shows an example of images generated by the plurality of cameras 161a, 161b, 161c, and 161d shown in FIG. 1B.

Referring to FIG. 1C, the vehicle 100 may generate a composite image 400. FIG. The composite image 400 includes a first image area 401 corresponding to an external image photographed by the front camera 161a, a second image area 402 corresponding to an external image photographed by the left camera 161b, A third image region 403 corresponding to an external image photographed by the right camera 161c and a fourth image region 404 corresponding to an external image photographed by the rear camera 161d. The composite image 400 may be named an Around View Monitoring (AVM) image.

At the time of generating the composite image 400, the boundary lines 411, 412, 413, and 414 are generated between any two external images included in the composite image 400. The vehicle 100 can be naturally displayed by image blending processing the boundary lines 411, 412, 413, and 414.

In addition, a predetermined image may be included in the center of the composite image 400 to indicate the vehicle 100. In addition, the composite image 400 may be displayed on the display device 200 mounted in the interior of the vehicle 100. [

2 shows a block diagram of a display device 200 according to an embodiment of the present invention.

Referring to FIG. 2, the display device 200 may be fixedly or detachably mounted in the vehicle 100. FIG. The fixed display device 200 may be fixedly coupled to a predetermined space (e.g., center fascia) allocated in a dashboard of the vehicle 100. [ The removable display device 200 may be configured to be detachably mountable on the dashboard of the vehicle 100 and may be separated from the vehicle 100 by the user as the case may be.

The display device 200 according to the present embodiment is a term including, for example, all types of devices capable of information processing and display, such as a mobile terminal capable of performing a navigation function in the vehicle 100 .

4, the display device 200 includes a communication unit 110, an input unit 220, a memory 220, a display unit 240, an interface unit 250, a sensing unit 260, a processor 270 And a power supply unit 280. [

The communication unit 110 may include one or more modules that enable wireless communication with an external device (e.g., mobile terminal, external server, vehicle 100) including the vehicle 100. [ In addition, the communication unit 110 may include one or more modules that connect the vehicle 100 to one or more networks. For example, the communication unit 110 may form a wireless link with a mobile terminal (e.g., a smart phone) in the vehicle 100 by various data communication methods such as Bluetooth and WiFi.

In addition, the communication unit 110 may transmit and receive various types of video data such as traffic information such as TPEG format, terrestrial wave, satellite digital multimedia broadcasting (DMB), digital audio broadcasting (DAB), digital video broadcasting (DVB-T, DVB- Audio data can be received. For example, the traffic information received by the communication unit 110 may include lane information, traveling speed limit information, turn-by-turn information, traffic safety information, traffic guidance information, and route information.

Further, the communication unit 110 can generate position data of the vehicle 100 based on a global positioning system (GPS) signal received from the satellite. For example, the GPS signal may be transmitted to a wireless network including 802.11, which is a standard of a wireless network for a wireless LAN including a wireless LAN and some infrared communication proposed by IEEE (Institute of Electrical and Electronics Engineers), and a wireless including a Bluetooth, UWB, 802.16, which is a standard for a wireless MAN (Metropolitan Area Network) (BWA) including 802.15, which is a standard for PAN (Personal Area Network), and a city wideband network (FWA) (802.20), which is a standard for the mobile Internet for a Mobile Broadband Wireless Access (MBWA) including a WiBro, a WiMAX, and the like.

Also, the communication unit 110 may include a hands-free module that operates based on a communication protocol such as Bluetooth. Further, the communication unit 110 can perform telephone communication with the other party outside the vehicle 100 via the wireless communication network.

The input unit 220 may select at least one of a plurality of functions executable by the display device 200 from a user or input information. The input unit 220 may include various types of input means such as a keypad, a touch screen, a jog shuttle, a button, and a microphone.

The memory 220 may store map data and data and programs necessary for the display device 200 to operate. In hardware, it may be various storage devices such as ROM, RAM, EPROM, flash drive, hard drive, and the like. The memory 220 may store various data for operation of the display device 200, such as a program for processing or controlling the processor 270.

The map data stored in the memory 220 may include geographic coordinates (geographic coordinates or latitude and longitude coordinates) indicating latitude and longitude in units of minutes (DMS unit: Degree / Minute / Second). At this time, in addition to the above geographical coordinates, UTM (Universal Transverse Mercator) coordinates, UPS (Universal Polar System) coordinates, TM (Transverse Mercator) coordinates, and the like may be used as the map data.

The memory 220 may store various menu screens, point of interest (POI), and feature information (e.g., intersections, car players) for each location of the map data. The memory 220 also stores user interfaces associated with various user inputs, vehicle 100 information, and the like. Also, the memory 220 stores destination information input from the user through the input unit 220.

The display unit 240 can visually output various kinds of information processed by the processor 270. The display unit 240 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) display, a 3D display, and an e-ink display.

The display unit 240 may include a touch sensor. For example, the display unit 240 may be vertically coupled with the touch sensor to implement a touch screen.

The display unit 240 may display various contents such as various screens and route guidance information by using the user interface stored in the memory 220. Here, the content displayed on the display unit 240 may include various text or image data (including map data and various information data), an icon, a menu list, and the like.

The interface unit 250 may receive the data related to the vehicle 100 or may provide the signal processed or generated by the processor 270 to the outside. For example, the interface unit 250 can perform data communication with the sensing unit 160, the control unit 170, and the like of the vehicle 100 through a wired communication or a wireless communication method.

The sensing unit 260 detects an object proximate to the display unit 240 and detects the position or movement of the detected object in response to the position or motion of the detected object (e.g., moving direction, moving speed, moving distance, And provide the generated sensing information to the processor 270. [0050] FIG.

The sensing unit 260 may include at least one or more sensors of at least one of an infrared sensor 261, a proximity sensor 262, and an illuminance sensor 263. Specifically, the infrared sensor 261 may generate an infrared image of an object in proximity to the display unit 240.

The infrared sensor 261 may be operated on an active basis for copying infrared rays by itself to detect a change according to whether the light is intercepted or may be operated on a manual basis for detecting external infrared rays change only without copying the infrared rays themselves. On the other hand, the processor 270 can determine whether the user detected by the infrared sensor 261 is a driver or a passenger based on the infrared image provided from the infrared sensor 261.

For example, the display device 200 may be provided between the driver's seat mounted on the left side of the vehicle 100 and the assistant's seat mounted on the right side. A template corresponding to the left hand shape and a template corresponding to the right hand shape may be stored in the memory 220. The processor 270 compares the hand shape appearing in the infrared image with a template or the like stored in the memory 220, The appearance of the hand appearing can be judged by either the left hand shape or the right hand shape. If the hand shape of the infrared image matches the shape of the left hand, the processor 270 may determine that the user detected by the infrared sensor 261 is a passenger. If the hand shape shown in the infrared image matches the right hand shape, the processor 270 can determine that the user detected by the infrared sensor 261 is the driver.

The proximity sensor 262 detects that the object is approaching within a predetermined distance in a noncontact manner. The proximity sensor 262 can detect a nearby object based on the change of the alternating magnetic field, the change of the static magnetic field, the change of the capacitance, and the like. Alternatively, the proximity sensor may detect the proximity of an object using a light emitting diode and an optical sensor.

The illuminance sensor 263 can detect the presence or absence of an object close to the display unit 240 and its position based on a change in illuminance around the display unit 240. [ For example, when the user hands out near the display portion 240, the light intensity sensor 263 can provide the processor 270 with a sensing signal corresponding to the amount of light reduced by the user's hand. According to an embodiment, two or more illuminance sensors 263 may be provided so as to be spaced apart from each other by a predetermined distance.

The at least one sensor included in the sensing unit 260 may be disposed adjacent to the edge of the display unit 240 (e.g., within about 1 cm) to facilitate detection of an object close to the display unit 240 . For example, the infrared sensor 261 may be disposed at the upper end of the display unit 240, and the proximity sensor 262 and the illuminance sensor 263 may be disposed at the lower end of the display unit 240, respectively.

The processor 270 controls the full operation of the display device 200. The processor 270 may match the position data of the vehicle 100 with the map data stored in the memory 220 and output the image corresponding to the matched map information through the display unit 240. [ Specifically, the processor 270 obtains the vehicle 100 estimated position based on the vehicle 100 position data, reads the map data corresponding to the vehicle 100 estimated position and the traveling route from the memory 220 And can be displayed on the display unit 240. That is, the processor 270 generates the route guidance information based on the map information, and outputs the generated route guidance information to the display unit 240.

The processor 270 may be connected to the base station near the vehicle 100 through the communication unit 110 to perform a telephone conversation or transmit / receive information between the display apparatus 200 and the base station.

In addition, the processor 270 may display the external image received from the external camera of the vehicle 100 on the display unit 240 through the interface unit 250.

When the POI search menu is selected by the user, the processor 270 searches for a POI located on the route from the current position to the destination, and displays the POI on the display unit 240.

The power supply unit 280 may supply power necessary for operation of each component included in the display device 200 under the control of the processor 270. [ For example, the power supply unit 280 can supply the power stored in the battery built in the display device 200 to the power required for operation of each component included in the display device 200. Alternatively, the power supply unit 280 may be connected to a USB port of the vehicle 100 via a connector to supply power supplied from a battery (not shown) or the like inside the vehicle 100 to a power supply unit It is possible to supply power necessary for operation of the components.

On the other hand, some of the components shown in FIG. 2 may not be essential for realizing the display device 200. Thus, the display device 200 described herein may have more or fewer components than those listed above.

3A and 3B show an appearance of a display device 200 provided in a vehicle 100 according to an embodiment of the present invention.

Referring to FIG. 3A, the vehicle 100 may have a handle on the left side. The driver's seat 310 and the assistant seat 320 may be provided on the left and right sides, respectively, as shown.

The occupant (e.g., driver, passenger) of the vehicle 100 can confirm the outside (e.g., forward situation) of the vehicle 100 through the windshield 101. [ For example, the occupant can check the status of the other vehicle, the road condition, surrounding facilities, and the like located in front of the vehicle 100 through the windshield 101.

As described above, the display portion 141 of the vehicle 100 may include two or more displays. For example, as shown in FIG. 3A, the display section 141 may include a dash panel display 141a, a head-up display 141b, and a transparent display 141c. The head-up display 141b can project a virtual image corresponding to various kinds of information of the windshield 101. [ The transparent display 141c can be coupled to at least one region of the windshield 101 or replace the windshield 101. [ Since the transparent display 141c has a transparency of a certain level or more, the passenger can be prevented from being disturbed by the front view, and it is possible to check various information related to the vehicle 100 while looking at the front.

In addition, the indoor camera 122 photographs the interior of the vehicle 100, and the microphone 123 can receive the voice of the occupant of the vehicle 100. [

Meanwhile, the display device 200 according to an embodiment of the present invention may be disposed at the center portion of the dashboard, as shown in FIG. Specifically, the display device 200 may be provided between a portion corresponding to the driver's seat 310 and a portion corresponding to the assistant seat 320 among the entire area of the dashboard.

Referring to FIG. 3B, a plurality of input buttons 220a to 220h, a display unit 240, and a plurality of sensors 261, 262a, 262b, 263a, and 263b may be provided in the body of the display device 200 have.

The input button 220a may be a button for executing a radio reception function. For example, each time the input button 220a is pressed, it can be switched to the order of FM radio → AM radio → FM radio. The input button 220b may be a button for executing a media playback function. For example, every time the input button 220b is pressed, the medium in which the media file to be played is stored in the order of CD → USB → mobile terminal → CD may be activated. The input button 220c may be a button for executing the air conditioner / heater controlling function. The input button 220d may be a button for executing an output function of an external image provided from the external camera 161 shown in FIG. The input button 220e may be a button for executing a DMB (Digital Multimedia Broadcasting) function. The input button 220f may be a button for executing the destination search and route setting function of the navigation. The input button 220g may be a button for executing a hands-free function. The input button 220h may be a button for executing an internet connection function. It should be appreciated by those skilled in the art, however, that the plurality of input buttons 220a-220h shown in FIG. 3B and corresponding functions are exemplary and that fewer or more buttons may be mapped to different functions, according to an embodiment .

Meanwhile, the entire display area of the display unit 240 may be divided into a plurality of virtual areas A1 and A2. For example, the first area A1 corresponds to the left side with respect to the vertical center axis of the entire display area of the display part 240, and the second area A2 corresponds to the left side of the entire display area of the display part 240 And corresponds to the right side with respect to the vertical center axis. In this case, the sizes and shapes of the first area A1 and the second area A2 may be equal to each other as shown in the figure. However, according to the embodiment, the size or shape of at least one of the first area A1 and the second area A2 may be changed by user input. That is, the first area A1 may be an area that is closer to the driver's seat of the vehicle than the second area A2 and does not overlap with the second area A2.

The infrared sensor 261 may be disposed, for example, in the upper center of the display unit 240 of the main body. The infrared sensor 261 irradiates infrared rays to a space including at least the display unit 240 and detects an object within a predetermined distance from the display unit 240 based on the reflected infrared ray pattern, (E.g., position information, movement speed information, movement direction information, distance information) corresponding to the position or motion of the object can be continuously provided to the processor 270. [

The first proximity sensor 262a and the second proximity sensor 262b may be disposed on the left and right sides of the lower end of the display unit 240, respectively. The first proximity sensor 262a can detect an object close to the left side of the display unit 240 (i.e., the first area A1). The second proximity sensor 262b can detect an object close to the right side of the display unit 240 (i.e., the second area A2). The processor 270 determines that the object detected by the first proximity sensor 262a is a body part (e.g., a hand or a finger) of the driver and the object detected by the second proximity sensor 262b is a body part of the passenger It can be judged.

Similarly to the proximity sensors 262a and 262b, the first illuminance sensor 263a and the second illuminance sensor 263b are disposed on the left and right sides of the lower end of the display unit 240, . The first illuminance sensor 263a can detect an object in the vicinity of the left side of the display unit 240 based on the change in illuminance near the left side of the display unit 240 (i.e., the first area A1). The second illuminance sensor 263b can detect an object close to the right side of the display unit 240 based on the change in illuminance near the right side of the display unit 240 (i.e., the second area A2).

FIG. 4 shows a flow chart of an exemplary process (S400) performed by the display device 200 according to an embodiment of the present invention.

In step S410, the display device 200 may display an arbitrary screen on the display unit 240. [ For example, the processor 270 may display a route guidance screen on the display unit 240 in a normal driving situation. In another example, the processor 270 may display a screen corresponding to the generated event on the display unit 240 in response to the occurrence of the predetermined event. For example, when the processor 270 receives a telephone connection request from the other party outside the vehicle 100, the processor 270 may display a telephone reception notification screen on the display unit 240.

In step S420, the display device 200 can determine whether there is at least one object close to the display unit 240. [ Specifically, the processor 270 determines whether there is an object within a predetermined distance from the display unit 240 based on the sensing information provided from the sensing unit 260, and determines whether there is an object within a predetermined distance from the display unit 240 If there is an adjacent object, the number of nearby objects can be determined.

For example, when an object is detected only by the first proximity sensor 262a and the first illuminance sensor 263a shown in FIG. 3B, the processor 270 determines that one object is close to the first area A1 It can be judged.

In step S430, the display device 200 can select any one of a plurality of predetermined display modes based on the sensing information on the at least one object detected in step S420. The plurality of display modes basically includes a driver mode and a passenger mode, and may further include a common mode according to an embodiment.

For example, the processor 270 can select the driver mode when it is determined that only an object close to the first area A1 is detected, based on the sensing information provided from the sensing unit 260. [ That is, when the position of the detected object corresponds to the first area A1 of the display unit 240, the processor 270 can select the driver mode among the plurality of display modes.

For example, the processor 270 can select the passenger mode when it is determined that only an object close to the second area A2 is detected, based on the sensing information provided from the sensing unit 260. [ That is, when the position of the detected object corresponds to the second area A2 of the display unit 240, the processor 270 can select the passenger mode among the plurality of display modes.

For example, based on the sensing information provided from the sensing unit 260, the processor 270 may detect an object proximate to the first area A1 and an object proximate to the second area A2 simultaneously or sequentially The common mode can be selected. That is, when the position of any one of the detected plurality of objects corresponds to the first area A1 of the display unit 240 and the other position corresponds to the second area A2 , A common mode among a plurality of display modes can be selected.

In step S440, the display apparatus 200 can change the screen configuration of the display unit 240 according to the selected display mode.

If the driver mode is selected in step S430, the display device 200 may display a predetermined object in the first area A1 or display a preset screen on the display unit 240 to be outputted in the driver mode .

If the passenger mode is selected in step S430, the display device 200 may display a predetermined object in the second area A2 or display a preset screen on the display unit 240 so as to be output in the passenger mode .

If the common mode is selected in step S430, the display device 200 displays the same object or different objects related to the screen displayed on the display unit 240 in the first area A1 and the second area A2, respectively can do.

Operations for changing the screen configuration of the display unit 240 according to the driver mode, the passenger mode, and the common mode will be described in more detail with reference to FIGS. 5A to 14C.

5A to 5C show an example of an operation in which the display apparatus 200 according to the embodiment of the present invention changes the screen configuration of the display unit 240 according to proximity of a single object.

5A illustrates a state in which the home screen 510 is displayed on the display unit 240 before detection of a nearby object. The home screen 510 may include icons corresponding to the functions executable by the display device 200, as shown in FIG.

5B illustrates a situation in which the driver's hand 10 is detected as a single object. As shown, as the position of the driver's hand 10 enters a certain distance from the first area A1, the processor 270 may select the driver mode among the plurality of display modes.

The processor 270 may switch the screen 510 displayed on the display unit 240 to the first screen 521 in the driver mode. For example, when entering the driver mode, the processor 270 can display a reduced screen 511 in which the screen 510 displayed before the detection of the object 10 is reduced to a predetermined ratio in the first area A1 have. Accordingly, it is possible for the driver to easily select the icons that are displayed in a distributed manner in the screen 510. If the music icon included in the reduced screen 511 is selected by the object 10, it may be displayed in the entire area of the display unit 240 of the music list screen 521 as shown in the figure. That is, before or after entering the driver mode, the home screen 510 can be switched to the music list screen 521. In this case, the processor 270 can display the reduced screen 511 on the music list screen 521 in a superimposed manner.

5C illustrates a situation in which the hand 20 of the passenger is detected in the situation shown in Fig. 5A, unlike Fig. 5B. As shown, as the position of the passenger's hand 20 enters a certain distance from the second area A2, the processor 270 may select the passenger mode among the plurality of display modes.

The processor 270 may switch the screen 510 displayed on the display unit 240 to the second screen 522 in the passenger mode. For example, when entering the passenger mode, the processor 270 may display a reduced screen 512 in which the screen 510 displayed before the detection of the object 20 is reduced to a predetermined ratio in the second area A2 have. For example, the reduced screen 512 may be the same as the reduced screen 511 shown in FIG. 5B. Accordingly, it is possible for the passenger to easily select the icons displayed in the screen 510 in a distributed manner. If an image icon included in the reduced screen 512 is selected by the object 20, it may be displayed in the entire area of the display unit 240 of the photo list screen 522, as shown in the figure. That is, before or after entering the passenger mode, the home screen 510 may be switched to the photo list screen 522. [ In this case, the processor 270 may display the reduced screen 512 on the photo list screen 522 in a superimposed manner.

6A to 6C show an example of an operation in which the display apparatus 200 according to an embodiment of the present invention changes the screen configuration of the display unit 240 according to proximity of a single object.

6A illustrates a state in which a route guidance screen 610 is displayed on the display unit 240 before detection of a nearby object. As shown, the route guidance screen 610 may include a current speed of the vehicle 100, a detected route, a turn-by-turn indicator, and the like.

6B illustrates a situation in which the driver's hand 10 is detected as a single object. As shown, as the position of the driver's hand 10 enters a certain distance from the first area A1, the processor 270 may select the driver mode among the plurality of display modes.

The processor 270 may display at least one object related to the route guidance screen 610 displayed in the display unit 240 in the first area A1 in the driver mode. For example, when the processor 270 enters the driver mode, the processor 270 displays a menu list 621 related to functions that can be operated on the screen 610 displayed before the detection of the object 10 in the first area A1 Can be displayed. For example, the menu list 621 includes a home screen moving icon, a map view point changing icon, a navigation guide volume adjusting icon, a map enlarging icon, a scale automatic changing icon, a map reducing icon, etc. And the like. At this time, the route guide screen 610 can be moved to the right and reduced by the size of the menu list 621. Accordingly, the driver simply selects and executes a function of operating the route guidance screen 610 through the menu list 621 by merely moving the finger 10 into the first area A1 It is possible.

6C illustrates a situation in which the hand 20 of a passenger is detected as a single object in the situation shown in Fig. 6A, unlike Fig. 6B. As shown, as the position of the passenger's hand 20 enters a certain distance from the second area A2, the processor 270 may select the passenger mode among the plurality of display modes.

The processor 270 may display at least one object associated with the route guidance screen 610 displayed in the display unit 240 in the second area A2 in the passenger mode. For example, when entering the passenger mode, the processor 270 may display a menu list 622 related to functions that can manipulate the route guidance screen 610 that was displayed before the detection of the object 20 in the second area A2 ). ≪ / RTI > At this time, the route guidance screen 611 can be moved and reduced to the left by the size of the menu list 622. [ Accordingly, the passenger simply selects and executes a function of operating the route guidance screen 610 via the menu list 622 by simply moving the finger 20 into the second area A2 It is possible.

7A to 7C show an example of an operation in which the display device 200 according to an embodiment of the present invention changes the screen configuration of the display unit 240 according to proximity of a single object.

7A illustrates a state in which a route guidance screen 610 as shown in FIG. 6A is displayed on the display unit 240 before detection of a nearby object. On the other hand, when a telephone connection request is received from the other party outside the vehicle 100, the telephone reception notification screen 720 may be overlaid as shown in one area of the route guidance screen 610. [ The phone reception notification screen 720 may include a menu 721 including an icon for telephone connection and an icon for telephone rejection, together with contact information such as the name and telephone number of the telephone connection requestor.

Fig. 7B illustrates a situation in which the driver's hand 10 is detected as a single object. As shown, as the position of the driver's hand 10 enters a certain distance from the first area A1, the processor 270 may select the driver mode among the plurality of display modes.

The processor 270 may move at least one of the objects displayed on the display unit 240 to the first area A1 of the display unit 240 in the driver mode. For example, when entering the driver mode, the processor 270 displays the menu 721 included in the telephone reception notification screen 720, which was displayed before the detection of the object 10, And can be displayed in the area A1. Accordingly, the driver can simply approve or reject the telephone connection request by simply moving the finger 10 into the first area A1.

7C illustrates a situation in which the passenger's hand 10 is detected as a single object in the situation shown in Fig. 7A, unlike Fig. 7B. As shown, as the position of the passenger's hand 10 enters a certain distance from the first area A1, the processor 270 may select the passenger mode of the plurality of display modes.

The processor 270 may move at least one of the objects displayed on the display unit 240 to the second area A2 of the display unit 240 in the passenger mode. For example, when entering the passenger mode, the processor 270 displays the menu 721 included in the telephone reception notification screen 720, which was displayed before the detection of the object 20, Can be displayed in the area A2. Accordingly, the passenger can simply approve or reject the telephone connection request by merely moving the finger 20 into the second area A2.

8A to 8C show an example of an operation in which the display apparatus 200 according to the embodiment of the present invention changes the screen configuration of the display unit 240 according to proximity of a single object.

8A illustrates a state in which the music playback screen 810 is displayed on the display unit 240 before detection of a nearby object. As shown in the figure, the music reproduction screen 810 includes a plurality of objects such as a thumbnail list 811, an operation window 812, and lyrics information 813 of playable music files.

Fig. 8B illustrates a situation in which the driver's hand 10 is detected in the situation of Fig. 8A. As shown, as the position of the driver's hand 10 enters a certain distance from the first area A1, the processor 270 may select the driver mode among the plurality of display modes.

The processor 270 may move at least one of the objects displayed on the display unit 240 to the first area A1 of the display unit 240 in the driver mode. For example, when the player enters the driver mode, the processor 270 moves the operation window 812, which is one of the objects included in the music reproduction screen 810 displayed before the detection of the object 10, In the first area A1 corresponding to the first area A1. In this case, the processor 270 can change the arrangement order and the arrangement position of the thumbnail list 811 and the lyrics information 813 in accordance with the movement of the operation window 812. [ Accordingly, the driver can move the operation window 812 into the first area A1 by the processor 270 merely by moving the finger 10 into the first area A1, The user can easily operate the music file currently being reproduced through the window 812 and the music file to be reproduced.

8C illustrates a situation in which the hand 20 of the passenger is detected in the situation shown in Fig. 8A, unlike Fig. 8B. As shown, as the position of the passenger's hand 20 enters a certain distance from the second area A2, the processor 270 may select the passenger mode among the plurality of display modes.

The processor 270 may move at least one of the objects displayed on the display unit 240 to the second area A2 of the display unit 240 in the passenger mode. For example, when entering the passenger mode, the processor 270 displays an operation window 812, which is one of the objects included in the music reproduction screen 810 displayed before the detection of the object 20, In the second area A2 corresponding to the second area A2. In this case, the processor 270 can change the arrangement order and the arrangement position of the thumbnail list 811 and the lyrics information 813 in accordance with the movement of the operation window 812. [ Thus, the passenger is moved and displayed by the processor 270 in the second area A2 only by the action of simply moving the finger 20 into the second area A2, The user can easily operate the music file currently being reproduced through the window 812 and the music file to be reproduced.

9A to 9C show an example of an operation in which the display apparatus 200 according to the embodiment of the present invention changes the screen configuration of the display unit 240 according to proximity of a single object.

First, FIG. 9A illustrates a state in which a route guidance screen 610 as shown in FIG. 6A is displayed on the display unit 240 before detection of a nearby object. As shown, the route guidance screen 610 may include a current speed of the vehicle 100, a detected route, a turn-by-turn indicator, and the like. On the other hand, as shown, when the passenger generates a voice command 920 (e.g., "phone keypad display") designating a function to be executed, the voice command 920 is recognized And information on the recognized voice command 920 may be transmitted to the display device 200 through the interface unit 250 or the like. In this case, the display apparatus 200 can enter the execution waiting state of the function indicated by the voice command 920. [

FIG. 9B illustrates a situation in which a driver's hand 10 is detected as a single object. As shown, as the position of the driver's hand 10 enters a certain distance from the first area A1, the processor 270 may select the driver mode among the plurality of display modes.

The processor 270 may execute the function indicated by the voice command 920 in the operator mode and display the object 930 associated with the executed function in the first area A1. For example, as shown, the object 930 may be a keypad for inputting a telephone number corresponding to the voice command 920, and may be overlaid on the route guidance screen 610.

9C illustrates a situation in which the hand 10 of the passenger is detected in the situation shown in Fig. 9A, unlike Fig. 9B. As shown, as the position of the passenger's hand 20 enters a certain distance from the second area A2, the processor 270 may select the passenger mode among the plurality of display modes.

The processor 270 may execute the function indicated by the voice command 920 in the passenger mode and display the object 930 associated with the executed function in the second area A2. For example, as shown, the object 930 may be a keypad for inputting a telephone number corresponding to the voice command 920, and may be overlaid on the route guidance screen 610.

10A to 10C show an example of an operation in which the display apparatus 200 according to the embodiment of the present invention changes the screen configuration of the display unit 240 according to proximity of a single object.

10A illustrates a state in which a route guidance screen 610 as shown in FIG. 6A is displayed on the display unit 240 before detection of a nearby object. When the input button 220c of the display device 200 is clicked by the user, the air conditioning state of the vehicle 100 is classified into one area at the top of the display unit 240 A menu list 1020 can be displayed. For example, in the menu list 1020, there are displayed a driver's seat temperature setting icon, a cooling / heating automatic adjustment icon, a cooling execution icon, a wind amount adjustment icon, a wind direction adjustment icon, And various icons may be included.

Fig. 10B illustrates a situation in which the driver's hand 10 is detected as a single object. As shown, as the position of the driver's hand 10 enters a certain distance from the first area A1, the processor 270 may select the driver mode among the plurality of display modes.

The processor 270 may move at least one of the objects displayed on the display unit 240 to the first area A1 of the display unit 240 in the driver mode. For example, when entering the driver mode, the processor 270 displays a menu list 1021 in which the menu list 1020 is reduced by a predetermined ratio in the first area A1 corresponding to the position of the object 10 . Accordingly, the driver can easily adjust the air conditioning state of the vehicle 100 on the basis of the icon included in the menu list 1021 by merely moving the finger 10 into the first area A1.

10C illustrates a situation in which the passenger's hand 20 is detected as a single object in the situation shown in Fig. 10A, unlike Fig. 10B. As shown, as the position of the passenger's hand 20 enters a certain distance from the second area A2, the processor 270 may select the passenger mode among the plurality of display modes.

The processor 270 may move at least one of the objects displayed on the display unit 240 to the second area A2 of the display unit 240 in the passenger mode. For example, when entering the passenger mode, the processor 270 displays a menu list 1022 in which the menu list 1020 is reduced by a predetermined ratio in a second area A2 corresponding to the position of the object 20 . Accordingly, the passenger can easily adjust the air conditioning state of the vehicle 100 on the basis of the icon included in the menu list 1022 simply by moving the finger 20 into the second area A2.

On the other hand, the menu list 1021 shown in FIG. 10A is the same as the menu list 1022 shown in FIG. 10B, but the present invention is not limited to this. For example, the menu list 1021 may not include an assistant seat temperature setting icon. As another example, the menu list 1022 may include only a wind direction adjustment icon and an assistant stone temperature setting icon. The number and types of icons included in the menu lists 1021 and 1022 can be changed according to user input.

11A to 11C show an example of an operation in which the display apparatus 200 according to the embodiment of the present invention changes the screen configuration of the display unit 240 according to proximity of a single object.

11A illustrates a state in which the Internet connection screen 1110 is displayed before the detection of a nearby object. For example, the Internet connection screen 1110 may be a screen displayed when the input button 220h is clicked by the user. On the other hand, the search window 1111 in the internet connection screen 1110 is located at the upper part of the display unit 240, and the driver or the passenger may have difficulty in selecting the search word and inputting the search word.

FIG. 11B illustrates a situation in which the driver's hand 10 is detected as a single object. As shown, as the position of the driver's hand 10 enters a certain distance from the first area A1, the processor 270 may select the driver mode among the plurality of display modes.

The processor 270 may determine a screen configuration to be applied to the display unit 240 upon entering the driver mode according to the type of screen displayed on the display unit 240. [ For example, when the first type of screen is displayed on the display unit 240 immediately before entering the driver mode, the processor 270 can display the first object corresponding to the first type of screen when entering the driver mode have. As another example, when the second type of screen is displayed on the display unit 240 immediately before entering the driver mode, the processor 270 may display the second object corresponding to the second type of screen upon entering the driver mode .

As shown in the figure, when the screen displayed before entering the driver mode is the internet connection screen 1110, the processor 270 connects the virtual keyboard 1121 as a corresponding object to the internet connection screen 1110 in the first area A1 ). ≪ / RTI > Accordingly, instead of directly inputting a search word by touching the search window 1111, the driver can input a quick and convenient search word through the virtual keyboard 1121 located in the first area A1 relatively close to the driver's seat 310 This is possible.

11C illustrates a situation in which the passenger's hand 20 is detected as a single object in the situation shown in FIG. 11A, unlike FIG. 11B. As shown, as the position of the passenger's hand 20 enters a certain distance from the second area A2, the processor 270 may select the passenger mode among the plurality of display modes.

As shown in the figure, when the screen displayed before entering the passenger mode is the internet connection screen 1110, the processor 270 connects the virtual keyboard 1121 as the object corresponding to the internet connection screen 1110 to the second area A2 ). ≪ / RTI > Accordingly, instead of directly inputting the search word by touching the search window 1111, the passenger can input a quick and convenient search word through the virtual keyboard 1121 located in the second area A2 relatively close to the assistant seat 320 This is possible.

12A and 12B show an example of an operation in which the display apparatus 200 according to the embodiment of the present invention changes the screen configuration of the display unit 240 according to proximity of a single object.

12A illustrates a situation in which a driver's hand 10 is detected while a route guidance screen 610 is displayed on the display unit 240 as shown in FIG. 6A. Specifically, as the position of the driver's hand 10 enters a certain distance from the first area A1, the processor 270 can select the driver mode among the plurality of display modes.

The processor 270 may display the first menu list 1210, which is predetermined to be displayed in the driver mode, in the first area A1 of the display unit 240 in the driver mode. For example, the menu list 1210 may include a navigation volume control icon, a weather guide icon, and a schedule guidance icon, as shown in FIG. On the other hand, the memory 220 may store information on the use restriction menu. Here, the use restriction menu may be a menu related to a predetermined function so that execution in the driver mode is blocked. The use restriction menu may be set or changed according to user input. Upon entering the driver mode, the processor 270 accesses the memory 220 to obtain information on the use restriction menu, and based on the obtained information on the use restriction menu, Can be selected. That is, the processor 270 may exclude the icon corresponding to the use restriction menu from the first menu list 1210.

12B illustrates a situation in which the hand 20 of the passenger is detected while the route guidance screen 610 is displayed on the display unit 240 as shown in FIG. 6A, unlike FIG. 12A. Specifically, as the position of the passenger's hand 20 enters a certain distance from the second area A2, the processor 270 can select the passenger mode among the plurality of display modes.

The processor 270 may display the second menu list 1220, which is predetermined to be displayed in the passenger mode, in the second area A2 of the display unit 240 in the passenger mode. For example, the menu list 1220 may include a navigation volume control icon, a weather guide icon, a schedule guidance icon, a message icon, and an SNS icon, as shown in FIG. Here, the message icon and the SNS icon may be icons corresponding to the use restriction menu described above. That is, the second menu list 1220 may further include icons corresponding to the use restriction menu as well as the icons included in the first menu list 1210.

12A and 12B, the display device 200 displays menu lists 1210 and 1220 to be displayed on the display unit 240 according to whether the occupant currently operating the display unit 240 is a driver or a passenger, May include an icon corresponding to the use restriction menu. If the occupant who is currently operating the display unit 240 is the driver, restriction of the display of the icon corresponding to the use restriction menu is made so that the message creation action or the SNS confirmation action Can be prevented in advance.

FIG. 13 shows an example of an operation in which the display device 200 according to an embodiment of the present invention changes the screen configuration of the display unit 240 according to the proximity of a plurality of objects.

13 illustrates a situation in which the hand 10 of the driver and the hand 20 of the passenger are simultaneously or sequentially detected while the Internet connection screen 1110 is being displayed as shown in FIG. 11A.

Specifically, as shown in the drawing, at the same time, the position of the driver's hand 10 enters a certain distance from the first area A1, and the position of the passenger's hand 20 moves from the second area A2 When entering into a distance, the processor 270 may select a public mode among a plurality of display modes.

The processor 270 may determine a screen configuration to be applied to the display unit 240 when entering the common mode according to the type of screen displayed on the display unit 240. [ For example, the processor 270 may display a virtual keyboard associated with a screen displayed on the display unit 240 in at least one of the first area A1 and the second area A2 of the display unit 240 .

As shown in the figure, when the Internet access screen 1110 is displayed on the display unit 240 immediately before entering the common mode, the processor 270 sets the first virtual keyboard 1310 in the first area A1 And the second virtual keyboard 1320 can be displayed in the second area A2.

At this time, the processor 270 may determine the type of the first virtual keyboard 1310 or the second virtual keyboard 1320 to be displayed on the display unit 240 based on the occupant information. For example, the face image and personal image information (e.g., age, sex, nationality) of each vehicle 100 may be stored in the memory 220 in advance. The processor 270 extracts the driver's face and the passenger's face from the indoor image provided from the camera 122, compares the extracted driver's face and the passenger's face with the user-specific face image stored in the memory 220, Each individual information can be obtained. The processor 270 may determine the type of the first virtual keyboard 1310 and the second virtual keyboard 1320 in consideration of the acquired personal information of the driver and the passenger.

For example, if the nationality of the driver and the passenger are respectively Korean and American, the processor 270 determines a keyboard for inputting Korean as a first virtual keyboard 1310 and a keyboard for inputting English as a second virtual keyboard 1320 You can decide.

14A to 14C show an example of an operation in which the display apparatus 200 according to the embodiment of the present invention changes the screen configuration of the display unit 240 according to proximity of a plurality of objects.

FIG. 14A illustrates a situation where a driver's hand 10 and a passenger's hand 20 are detected while an arbitrary screen is displayed on the display unit 240 as shown in FIG. 12A. For example, the route guide screen 610 may be displayed on the display unit 240 immediately before the driver's hand 10 and the passenger's hand 20 are detected.

On the other hand, as shown, when a passenger generates a voice command 1420 (e.g., "show an external video list") that designates a function to perform, the voice command 1420 is recognized And information on the recognized voice command 1420 may be transmitted to the display device 200 through the interface unit 250 or the like. In this case, the display device 200 can enter the execution waiting state of the function indicated by the voice command 1420. [

14B illustrates a situation in which a driver's hand 10 and a passenger's hand 20 are detected in a state in which a voice command 1420 as shown in Fig. 14A is recognized by the display device 200. Fig. As shown, when the position of the driver's hand 10 corresponds to the first area A1 and the position of the passenger's hand 20 corresponds to the second area A2, The user can select the common mode among the display modes of FIG.

The processor 270 may display the objects 1421 and 1422 corresponding to the voice command 1420 in the first area A1 and the second area A2 respectively in the public mode. In one embodiment, the first object 1421 and the second object 1422 may include menus for selecting an orientation-dependent external image of the vehicle 100. For example, the first object 1421 and the second object 1422 may include an AVM image view icon, a left image view icon, a right image view icon, and a rear image view icon, respectively.

FIG. 14C illustrates a screen configuration changed according to operations of the driver and the passenger for the first object 1421 and the second object 1422 shown in FIG. 14B. 14C, when the driver selects the AVM image view icon of the first object 1421, the processor 270 displays the AVM image in the first area A1 of the display unit 240 . In addition, as the passenger selects the right image view icon of the second object 1422, the processor 270 can display the right image in the second area A2 of the display unit 240. [

The embodiments of the present invention described above are not only implemented by the apparatus and method but may be implemented through a program for realizing the function corresponding to the configuration of the embodiment of the present invention or a recording medium on which the program is recorded, The embodiments can be easily implemented by those skilled in the art from the description of the embodiments described above.

It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to be illustrative, The present invention is not limited to the drawings, but all or some of the embodiments may be selectively combined so that various modifications may be made.

100: vehicle
200: display device

Claims (10)

A display unit disposed in a vehicle interior;
A sensing unit for sensing an object in proximity to the display unit; And
A processor for displaying a first menu list or a second menu list on the display unit based on position information of the object detected by the sensing unit;
Lt; / RTI >
The processor comprising:
When a voice command is acquired, enters a standby state for executing a function corresponding to the voice command,
In the standby state of the function, when the position of the object detected by the sensing unit corresponds to the first area of the display unit, the function corresponding to the voice command is executed, and one or more Displaying the object in the first area as the first menu list,
When the position of the object detected by the sensing unit corresponds to the second area of the display unit in the execution waiting state of the function,
Displaying one or more objects for operating the function to be executed in the second area as the second menu list,
Wherein the first area is closer to the driver's seat of the vehicle than the second area and the second area is closer to the passenger seat of the vehicle than the first area.
The method according to claim 1,
The processor comprising:
When the position of the object detected by the sensing unit corresponds to the first area,
A reduced screen in which the entire screen is reduced in a predetermined ratio is displayed in the first area,
When the position of the object detected by the sensing unit corresponds to the second area,
And displays the reduced screen in the second area.
The method according to claim 1,
The processor comprising:
When the position of the object detected by the sensing unit corresponds to the first area,
Displaying one or more objects for operating a screen displayed on the display unit in the first area as the first menu list,
When the position of the object detected by the sensing unit corresponds to the second area,
And displays at least one object for operating a screen displayed on the display unit in the second area as the second menu list.
delete The method according to claim 1,
Wherein the second menu list comprises:
And a use restriction menu not included in the first menu list.
The method according to claim 1,
The processor comprising:
In a state in which a menu list for operating a screen is displayed on the display unit,
When the position of the object detected by the sensing unit corresponds to the first area,
Moving at least one of the objects included in the menu list to the first area,
When the position of the object detected by the sensing unit corresponds to the second area,
And moves at least one of the objects included in the menu list to the second area.
The method according to claim 1,
The processor comprising:
When the position of one of the two objects detected by the sensing unit corresponds to the first area and the position of the other one of the two objects corresponds to the second area,
Displaying the first menu list in the first area,
Displaying the second menu list in the second area,
And displays an object other than the first menu list and the second menu list in one area of the display unit except an area where the first menu list and the second menu list are displayed.
8. The method of claim 7,
The processor comprising:
When an input of a user selecting one of one or more objects included in the first menu list is received,
Displaying a screen corresponding to the selected object in the first area,
When an input of a user selecting one of one or more objects included in the second menu list is received,
And displays a screen corresponding to the selected object in the second area.
The method according to claim 1,
The processor comprising:
When the position of the object detected by the sensing unit corresponds to the first area,
A first virtual keyboard associated with a screen displayed on the display unit is displayed in a first area of the display unit,
When the position of the object detected by the sensing unit corresponds to the second area,
And displays a second virtual keyboard associated with the screen displayed on the display unit in a second area of the display unit.
10. The method of claim 9,
The processor comprising:
And determines the type of the first virtual keyboard or the second virtual keyboard based on the acquired occupant information.

Images