KR102125289B1 - Display device and vehicle comprising the same - Google Patents

Abstract

The present invention relates to a display device mounted on a vehicle, the display device comprising: a touch screen displaying a plurality of graphic objects linked to different control functions, a haptic module generating vibration in at least one area of the touch screen, The haptic module so that a predetermined tactile effect is generated on a finger to which the touch is applied in response to a touch applied to at least one of the graphic objects and the communication unit receiving the electronics information from one or more electronics mounted on the vehicle. It includes a processor for controlling the, the processor may control the haptic module to generate different tactile effects according to the electrical equipment information.

Description

DISPLAY DEVICE AND VEHICLE COMPRISING THE SAME

The present invention relates to a display device mounted on a vehicle and capable of providing various information to a passenger and a vehicle.

A vehicle is a means of transportation that can move people or luggage using kinetic energy. Examples of vehicles are automobiles and motorcycles.

For the safety and convenience of users of the vehicle, various sensors and devices are provided in the vehicle, and the functions of the vehicle are diversified.

The function of the vehicle can be divided into a convenience function for promoting the convenience of the driver and a safety function for promoting the safety of the driver and/or pedestrian.

First, the convenience function has a development motivation related to driver convenience, such as giving the vehicle an infotainment (information + entertainment) function, supporting a partial autonomous driving function, or helping secure a driver's view such as a night vision or a blind spot. . For example, active cruise control (ACC), smart parking assist system (SPAS), night vision (NV), head up display (HUD), around view monitor (around view monitor, AVM), and adaptive headlight system (AHS).

The safety function is a technology that ensures driver safety and/or pedestrian safety, lane departure warning system (LDWS), lane keeping assist system (LKAS), and autonomous emergency braking, AEB) functions.

The vehicle is provided with one or more displays for at least one passenger who has boarded the vehicle, and various driving information is provided through the display as functions of the vehicle are diversified. As the display changes from a device that simply transmits information to a device that interacts with the user, it is necessary to develop a user interface that can control the display in the vehicle.

Furthermore, since the driver is obliged to look ahead so that an accident does not occur, the user interface provided through the display should be made so that an accident does not occur.

The present invention aims to solve the above and other problems.

One object of the present invention is to provide a display device that provides a tactile effect so that a driver can focus on driving and a vehicle including the same.

The present invention relates to a display device mounted on a vehicle.

The display device includes a touch screen displaying a plurality of graphic objects linked to different control functions; A haptic module that generates vibration in at least one area of the touch screen; A communication unit configured to receive electronic equipment information from one or more electronic equipment mounted on the vehicle; And a processor that controls the haptic module to generate a tactile effect on a finger to which the touch is applied in response to a touch being applied to at least one of the graphic objects, and the processors control each other according to the electrical equipment information. The haptic module can be controlled to generate different tactile effects.

According to one embodiment, the processor determines the state of the vehicle based on the electrical equipment information, controls the haptic module to generate a first tactile effect in the first state, and in the second state, the The haptic module may be controlled to generate a second tactile effect different from the first tactile effect.

According to an embodiment of the present disclosure, the processor may determine the state of the vehicle as the first state in which the probability of collision is lower than the reference or the second state in which the probability of collision is higher than or equal to the reference based on the electrical equipment information. .

According to an embodiment, the processor may calculate the possibility of the collision based on the electronic information.

According to an embodiment, when the touch is applied to the at least one in the second state, the processor may transmit a control command to the steering wheel provided in the vehicle to generate a tactile effect through the communication unit.

According to an embodiment, when both hands are positioned on the steering wheel, the processor may transmit a new control command through the communication unit to stop the tactile effect generated by the steering wheel.

According to an embodiment, the first state is a manual driving state in which the driving direction of the vehicle is changed by the driver of the vehicle, and the second state is a driving direction of the vehicle in which the driving direction of the vehicle is changed regardless of the intention of the driver. It may be in an autonomous driving state.

According to an embodiment, the first state may be a state in which the vehicle is running within a first speed range, and the second state may be a state in a second speed range different from the first speed range.

According to an embodiment of the present disclosure, the electronic information includes passenger information on which the touch is input, and different tactile effects may occur depending on the seat of the passenger on which the touch is input.

According to one embodiment, the passenger information includes an image of the inside of the vehicle, and the processor determines the seat of the passenger who has input the touch based on the image, and has different tactile senses according to the seat. The haptic module can be controlled to produce an effect.

In addition, the present invention can be extended to a vehicle and/or a vehicle control method having the above-described display device.

The effects of the display device and the vehicle including the display device according to the present invention are as follows.

Since the display device differentiates the tactile effect according to the driving situation, it is possible to provide an effective user interface to the driver.

1 is a view showing the appearance of a vehicle according to an embodiment of the present invention
2 is a view of a vehicle according to an embodiment of the present invention as viewed from various angles outside
3 to 4 are views showing the interior of a vehicle according to an embodiment of the present invention
5 to 6 are diagrams referred to for describing an object according to an embodiment of the present invention
7 is a block diagram referred to for describing a vehicle according to an embodiment of the present invention
8 is a conceptual diagram illustrating a display device according to an embodiment of the present invention
9 is a flowchart illustrating a method of controlling the display device of FIG. 8.
10 is a flowchart illustrating a method of determining different tactile effects based on electrical equipment information.
11A, 11B, and 11C are exemplary views for explaining an embodiment of providing different tactile effects according to driving conditions.
12 is a flowchart for explaining a method of providing different tactile effects according to passengers who have input user input.
13 is an exemplary view showing the embodiment of FIG. 12;
14 is an exemplary view for explaining a method of providing a tactile effect to a steering wheel.

Hereinafter, exemplary embodiments disclosed herein will be described in detail with reference to the accompanying drawings, but the same or similar elements are assigned the same reference numbers regardless of the reference numerals, and overlapping descriptions thereof will be omitted. The suffixes "modules" and "parts" for components used in the following description are given or mixed only considering the ease of writing the specification, and do not have meanings or roles distinguished from each other in themselves. In addition, in describing the embodiments disclosed in this specification, detailed descriptions of related known technologies are omitted when it is determined that the gist of the embodiments disclosed in this specification may be obscured. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed herein, and the technical spirit disclosed in the specification is not limited by the accompanying drawings, and all modifications included in the spirit and technical scope of the present invention , It should be understood to include equivalents or substitutes.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from other components.

When an element is said to be "connected" or "connected" to another component, it is understood that other components may be directly connected to or connected to the other component, but there may be other components in between. It should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that no other component exists in the middle.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

In this application, terms such as "comprises" or "have" are intended to indicate the presence of features, numbers, steps, actions, components, parts or combinations thereof described in the specification, but one or more other features. It should be understood that the existence or addition possibilities of fields or numbers, steps, operations, components, parts or combinations thereof are not excluded in advance.

The vehicle described herein may be a concept including an automobile and a motorcycle. Hereinafter, a vehicle is mainly described for a vehicle.

The vehicle described in this specification may be a concept including both an internal combustion engine vehicle having an engine as a power source, a hybrid vehicle having an engine and an electric motor as a power source, and an electric vehicle having an electric motor as a power source.

In the following description, the left side of the vehicle means the left side of the driving direction of the vehicle, and the right side of the vehicle means the right side of the driving direction of the vehicle.

1 is a view showing the appearance of a vehicle according to an embodiment of the present invention.

2 is a view of a vehicle according to an embodiment of the present invention viewed from various angles outside.

3 to 4 are views showing the interior of a vehicle according to an embodiment of the present invention.

5 to 6 are views referred to for describing an object according to an embodiment of the present invention.

7 is a block diagram referred to for describing a vehicle according to an embodiment of the present invention.

1 to 7, the vehicle 100 may include a wheel rotated by a power source and a steering input device 510 for adjusting the traveling direction of the vehicle 100.

The vehicle 100 may be an autonomous vehicle.

Here, autonomous driving is defined as controlling at least one of acceleration, deceleration, and driving directions based on a preset algorithm. In other words, even if a user input is not input to the driving operation device, it means that the driving operation device is automatically operated.

The vehicle 100 may be switched to an autonomous driving mode or a manual mode based on a user input.

For example, the vehicle 100 may be switched from the manual mode to the autonomous driving mode or the autonomous driving mode to the manual mode based on the received user input through the user interface device 200.

The vehicle 100 may be switched to an autonomous driving mode or a manual mode based on driving situation information. The driving situation information may be generated based on object information provided by the object detection device 300.

For example, the vehicle 100 may be switched from the manual mode to the autonomous driving mode or from the autonomous driving mode to the manual mode based on the driving situation information generated by the object detection device 300.

For example, the vehicle 100 may be switched from the manual mode to the autonomous driving mode, or may be switched from the autonomous driving mode to the manual mode based on the driving situation information received through the communication device 400.

The vehicle 100 may be switched from a manual mode to an autonomous driving mode based on information, data, and signals provided from an external device, or may be switched from an autonomous driving mode to a manual mode.

When the vehicle 100 is operated in an autonomous driving mode, the autonomous driving vehicle 100 may be operated based on the driving system 700.

For example, the autonomous vehicle 100 may be driven based on information, data, or signals generated by the driving system 710, the exit system 740, and the parking system 750.

When the vehicle 100 is operated in the manual mode, the autonomous vehicle 100 may receive a user input for driving through the driving manipulation device 500. The vehicle 100 may be driven based on a user input received through the driving manipulation apparatus 500.

Overall length is the length from the front to the rear of the vehicle 100, width is the width of the vehicle 100, and height is the length from the bottom of the wheel to the roof. In the following description, the full-length direction L is a direction that is a reference for measuring the full-length of the vehicle 100, the full-width direction W is a direction that is a reference for the full-width measurement of the vehicle 100, and the front direction H is the vehicle It may mean a direction that is a reference for measuring the height of the (100).

As illustrated in FIG. 7, the vehicle 100 includes a user interface device 200, an object detection device 300, a communication device 400, a driving operation device 500, a vehicle driving device 600, and a driving system 700, a navigation system 770, a sensing unit 120, an interface unit 130, a memory 140, a control unit 170, and a power supply unit 190.

According to an embodiment, the vehicle 100 may further include other components in addition to the components described in this specification, or may not include some of the components described.

The user interface device 200 is a device for communication between the vehicle 100 and a user. The user interface device 200 may receive user input and provide information generated in the vehicle 100 to the user. The vehicle 100 may implement User Interfaces (UI) or User Experience (UX) through the user interface device 200.

The user interface device 200 may include an input unit 210, an internal camera 220, a biometric sensing unit 230, an output unit 250, and a processor 270.

According to an embodiment, the user interface device 200 may further include other components in addition to the components described, or may not include some of the components described.

The input unit 200 is for receiving information from a user, and data collected by the input unit 200 may be analyzed by the processor 270 and processed by a user's control command.

The input unit 200 may be disposed inside the vehicle. For example, the input unit 200 includes a region of a steering wheel, a region of an instrument panel, a region of a seat, a region of each pillar, and a door One area of the door, one area of the center console, one area of the head lining, one area of the sun visor, one area of the windshield or one of the windows It may be arranged in one area or the like.

The input unit 200 may include a voice input unit 211, a gesture input unit 212, a touch input unit 213, and a mechanical input unit 214.

The voice input unit 211 may convert a user's voice input into an electrical signal. The converted electrical signal may be provided to the processor 270 or the control unit 170.

The voice input unit 211 may include one or more microphones.

The gesture input unit 212 may convert a user's gesture input into an electrical signal. The converted electrical signal may be provided to the processor 270 or the control unit 170.

The gesture input unit 212 may include at least one of an infrared sensor and an image sensor for sensing a user's gesture input.

According to an embodiment, the gesture input unit 212 may detect a user's 3D gesture input. To this end, the gesture input unit 212 may include a light output unit outputting a plurality of infrared light or a plurality of image sensors.

The gesture input unit 212 may detect a user's 3D gesture input through a time of flight (TOF) method, a structured light method, or a disparity method.

The touch input unit 213 may convert a user's touch input into an electrical signal. The converted electrical signal may be provided to the processor 270 or the controller 170.

The touch input unit 213 may include a touch sensor for detecting a user's touch input.

According to an embodiment, the touch input unit 213 may be integrally formed with the display unit 251 to implement a touch screen. The touch screen may provide an input interface and an output interface between the vehicle 100 and a user.

The mechanical input unit 214 may include at least one of a button, a dome switch, a jog wheel, and a jog switch. The electrical signal generated by the mechanical input unit 214 may be provided to the processor 270 or the control unit 170.

The mechanical input unit 214 may be disposed on a steering wheel, center fascia, center console, cock module, door, or the like.

The internal camera 220 may acquire an image inside the vehicle. The processor 270 may detect a user's state based on an image inside the vehicle. The processor 270 may acquire the user's gaze information from the image inside the vehicle. The processor 270 may detect a gesture of the user from the image inside the vehicle.

The biometric sensing unit 230 may acquire biometric information of the user. The biometric sensing unit 230 includes a sensor capable of acquiring the user's biometric information, and may acquire the user's fingerprint information, heartbeat information, and the like using the sensor. Biometric information may be used for user authentication.

The output unit 250 is for generating output related to vision, hearing, or tactile sense.

The output unit 250 may include at least one of a display unit 251, an audio output unit 252, and a haptic output unit 253.

The display unit 251 may display graphic objects corresponding to various information.

The display unit 251 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). display), a three-dimensional display (3D display), an electronic ink display (e-ink display).

The display unit 251 forms a mutual layer structure with the touch input unit 213 or is integrally formed, thereby realizing a touch screen.

The display unit 251 may be implemented as a head up display (HUD). When the display unit 251 is implemented as a HUD, the display unit 251 may include a projection module to output information through a wind shield or an image projected on the window.

The display unit 251 may include a transparent display. The transparent display can be attached to a wind shield or window.

The transparent display can display a predetermined screen while having a predetermined transparency. For transparent display, to have transparency, the transparent display is transparent Thin Film Elecroluminescent (TFEL), transparent OLED (Organic Light-Emitting Diode), transparent LCD (Liquid Crystal Display), transmissive transparent display, transparent LED (Light Emitting Diode) display It may include at least one of. The transparency of the transparent display can be adjusted.

Meanwhile, the user interface device 200 may include a plurality of display units 251a to 251g.

The display unit 251 includes one region of the steering wheel, one region 521a, 251b, and 251e of the instrument panel, one region 251d of the seat, one region 251f of each filler, and one region of the door ( 251g), one area of the center console, one area of the headlining, one area of the sun visor, or one area 251c of the wind shield or one area 251h of the window.

The audio output unit 252 converts and outputs an electrical signal provided from the processor 270 or the controller 170 into an audio signal. To this end, the sound output unit 252 may include one or more speakers.

The haptic output unit 253 generates a tactile output. For example, the haptic output unit 253 may operate by vibrating the steering wheel, seat belt, and seats 110FL, 110FR, 110RL, 110RR, so that the user can recognize the output.

The processor 270 may control the overall operation of each unit of the user interface device 200.

According to an embodiment, the user interface device 200 may include a plurality of processors 270 or may not include a processor 270.

When the processor 270 is not included in the user interface device 200, the user interface device 200 may be operated under the control of the processor or control unit 170 of another device in the vehicle 100.

Meanwhile, the user interface device 200 may be referred to as a vehicle display device.

The user interface device 200 may be operated under the control of the control unit 170.

The object detection device 300 is a device for detecting an object located outside the vehicle 100.

The object may be various objects related to the operation of the vehicle 100.

5 to 6, the object (O) is a lane (OB10), other vehicles (OB11), pedestrians (OB12), two-wheeled vehicle (OB13), traffic signals (OB14, OB15), light, road, structure, It may include a speed bump, terrain, and animals.

The lane OB10 may be a driving lane, a side lane next to the driving lane, or a lane in which an opposing vehicle travels. The lane OB10 may be a concept including left and right lines forming a lane.

The other vehicle OB11 may be a vehicle driving around the vehicle 100. The other vehicle may be a vehicle located within a predetermined distance from the vehicle 100. For example, the other vehicle OB11 may be a vehicle preceding or following the vehicle 100.

The pedestrian OB12 may be a person located around the vehicle 100. The pedestrian OB12 may be a person located within a predetermined distance from the vehicle 100. For example, the pedestrian OB12 may be a person located on a sidewalk or a road.

The two-wheeled vehicle OB12 may be positioned around the vehicle 100 and may move using two wheels. The two-wheeled vehicle OB12 may be a vehicle having two wheels positioned within a predetermined distance from the vehicle 100. For example, the two-wheeled vehicle OB13 may be a motorcycle or a bicycle located on a sidewalk or a driveway.

The traffic signal may include a traffic light OB15, a traffic sign OB14, a pattern or text drawn on the road surface.

The light may be light generated from a lamp provided in another vehicle. Light can be light generated from street lights. The light can be sunlight.

Roads may include road surfaces, curves, slopes such as uphills, downhills, and the like.

The structure may be an object located around the road and fixed to the ground. For example, the structure may include street lights, street trees, buildings, power poles, traffic lights, and bridges.

Terrain can include mountains, hills, and the like.

Meanwhile, the object may be classified into a moving object and a fixed object. For example, the moving object may be a concept including other vehicles and pedestrians. For example, the fixed object may be a concept including traffic signals, roads, and structures.

The object detection device 300 may include a camera 310, a radar 320, a lidar 330, an ultrasonic sensor 340, an infrared sensor 350, and a processor 370.

According to an embodiment, the object detection apparatus 300 may further include other components in addition to the components described, or may not include some of the components described.

The camera 310 may be located at an appropriate location outside the vehicle in order to acquire an image outside the vehicle. The camera 310 may be a mono camera, a stereo camera 310a, an AVM (Around View Monitoring) camera 310b, or a 360 degree camera.

For example, the camera 310 may be disposed close to the front windshield, in the interior of the vehicle, to obtain an image in front of the vehicle. Alternatively, the camera 310 may be disposed around the front bumper or radiator grille.

For example, the camera 310 may be disposed close to the rear glass, in the interior of the vehicle, in order to acquire an image behind the vehicle. Alternatively, the camera 310 may be disposed around the rear bumper, trunk, or tail gate.

For example, the camera 310 may be disposed close to at least one of the side windows in the interior of the vehicle in order to acquire an image of the vehicle side. Alternatively, the camera 310 may be disposed around a side mirror, fender, or door.

The camera 310 may provide the obtained image to the processor 370.

The radar 320 may include an electromagnetic wave transmitting unit and a receiving unit. The radar 320 may be implemented in a pulse radar method or a continuous wave radar method in accordance with the principle of radio wave launch. The radar 320 may be implemented by a FMCW (Frequency Modulated Continuous Wave) method or a FSK (Frequency Shift Keyong) method according to a signal waveform among continuous wave radar methods.

The radar 320 detects an object based on a time-of-flight (TOF) method or a phase-shift method via electromagnetic waves, the position of the detected object, the distance from the detected object, and a relative speed Can be detected.

The radar 320 may be disposed at an appropriate location outside the vehicle to detect objects located in the front, rear, or side of the vehicle.

The lidar 330 may include a laser transmitter and a receiver. The lidar 330 may be implemented by a time of flight (TOF) method or a phase-shift method.

The lidar 330 may be implemented in a driving type or a non-driving type.

When implemented in a driving type, the lidar 330 is rotated by a motor and can detect objects around the vehicle 100.

When implemented in a non-driven manner, the rider 330 may detect an object located within a predetermined range based on the vehicle 100 by optical steering. The vehicle 100 may include a plurality of non-driven lidars 330.

The lidar 330 detects an object based on a time-of-flight (TOF) method or a phase-shift method using a laser light, and the position of the detected object, the distance to the detected object, and Relative speed can be detected.

The lidar 330 may be disposed at an appropriate location outside the vehicle in order to detect objects located in the front, rear, or side of the vehicle.

The ultrasonic sensor 340 may include an ultrasonic transmitter and a receiver. The ultrasonic sensor 340 may detect an object based on ultrasonic waves and detect a position of the detected object, a distance from the detected object, and a relative speed.

The ultrasonic sensor 340 may be disposed at an appropriate location outside the vehicle in order to sense an object located in front, rear, or side of the vehicle.

The infrared sensor 350 may include an infrared transmitter and a receiver. The infrared sensor 340 may detect an object based on infrared light, and detect a position of the detected object, a distance from the detected object, and a relative speed.

The infrared sensor 350 may be disposed at an appropriate location outside the vehicle in order to sense an object located in front, rear, or side of the vehicle.

The processor 370 may control the overall operation of each unit of the object detection device 300.

The processor 370 may detect and track an object based on the acquired image. The processor 370 may perform operations such as calculating the distance to the object and calculating the relative speed with the object through an image processing algorithm.

The processor 370 may detect and track the object based on the reflected electromagnetic wave from which the transmitted electromagnetic wave is reflected and returned. The processor 370 may perform operations such as calculating a distance from the object and calculating a relative speed with the object based on electromagnetic waves.

The processor 370 may detect and track the object based on the reflected laser light from which the transmitted laser is reflected and returned. The processor 370 may perform operations such as calculating the distance to the object and calculating the relative speed with the object, based on the laser light.

The processor 370 may detect and track the object based on the reflected ultrasonic waves from which the transmitted ultrasonic waves are reflected and returned. The processor 370 may perform operations such as calculating the distance to the object and calculating the relative speed with the object based on ultrasound.

The processor 370 may detect and track the object based on the reflected infrared light from which the transmitted infrared light is reflected and returned. The processor 370 may perform operations such as calculating the distance to the object and calculating the relative speed with the object based on infrared light.

According to an embodiment, the object detection apparatus 300 may include a plurality of processors 370 or may not include a processor 370. For example, each of the camera 310, the radar 320, the lidar 330, the ultrasonic sensor 340, and the infrared sensor 350 may individually include a processor.

When the processor 370 is not included in the object detection device 300, the object detection device 300 may be operated under the control of the processor or control unit 170 of the device in the vehicle 100.

The object detection device 300 may be operated under the control of the control unit 170.

The communication device 400 is a device for performing communication with an external device. Here, the external device may be another vehicle, a mobile terminal, or a server. The communication device 400 may be referred to as a “wireless communication unit”.

The communication device 400 may include at least one of a transmitting antenna, a receiving antenna, a radio frequency (RF) circuit capable of implementing various communication protocols, and an RF element to perform communication.

The communication device 400 may include a short-range communication unit 410, a location information unit 420, a V2X communication unit 430, an optical communication unit 440, a broadcast transmission/reception unit 450, and a processor 470.

According to an embodiment, the communication device 400 may further include other components in addition to the components described, or may not include some of the components described.

The short-range communication unit 410 is a unit for short-range communication. The short-range communication unit 410 includes Bluetooth (Bluetooth™), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), and Wireless Wi-Fi -Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology can be used to support short-range communication.

The short-range communication unit 410 may form short-range wireless communication networks (Wireless Area Networks) to perform short-range communication between the vehicle 100 and at least one external device.

The location information unit 420 is a unit for obtaining location information of the vehicle 100. For example, the location information unit 420 may include a Global Positioning System (GPS) module or a Differential Global Positioning System (DGPS) module.

The V2X communication unit 430 is a unit for performing wireless communication with a server (V2I: Vehicle to Infra), another vehicle (V2V: Vehicle to Vehicle), or a pedestrian (V2P: Vehicle to Pedestrian). The V2X communication unit 430 may include an RF circuit capable of implementing communication (V2I) with an infrastructure, communication between vehicles (V2V), and communication with a pedestrian (V2P).

The optical communication unit 440 is a unit for performing communication with an external device via light. The optical communication unit 440 may include an optical transmitter that converts an electrical signal into an optical signal and transmits it to the outside, and an optical receiver that converts the received optical signal into an electrical signal.

According to an embodiment, the light emitting unit may be formed integrally with a lamp included in the vehicle 100.

The broadcast transmission/reception unit 450 is a unit for receiving a broadcast signal from an external broadcast management server through a broadcast channel or transmitting a broadcast signal to the broadcast management server. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal.

The processor 470 may control the overall operation of each unit of the communication device 400.

According to an embodiment, the communication device 400 may include a plurality of processors 470 or may not include a processor 470.

When the processor 470 is not included in the communication device 400, the communication device 400 may be operated under the control of the processor or control unit 170 of another device in the vehicle 100.

Meanwhile, the communication device 400 may implement a vehicle display device together with the user interface device 200. In this case, the vehicle display device may be called a telematics device or an audio video navigation (AVN) device.

The communication device 400 may be operated under the control of the control unit 170.

The driving operation device 500 is a device that receives a user input for driving.

In the manual mode, the vehicle 100 may be driven based on a signal provided by the driving manipulation device 500.

The driving manipulation device 500 may include a steering input device 510, an acceleration input device 530, and a brake input device 570.

The steering input device 510 may receive an input of a traveling direction of the vehicle 100 from a user. The steering input device 510 is preferably formed in a wheel shape to enable steering input by rotation. According to an embodiment, the steering input device may be formed in the form of a touch screen, a touch pad, or a button.

The acceleration input device 530 may receive an input for acceleration of the vehicle 100 from a user. The brake input device 570 may receive an input for deceleration of the vehicle 100 from a user. The acceleration input device 530 and the brake input device 570 are preferably formed in the form of a pedal. According to an embodiment, the acceleration input device or the brake input device may be formed in the form of a touch screen, a touch pad or a button.

The driving operation apparatus 500 may be operated under the control of the control unit 170.

The vehicle driving device 600 is a device that electrically controls driving of various devices in the vehicle 100.

The vehicle driving device 600 includes a power train driving part 610, a chassis driving part 620, a door/window driving part 630, a safety device driving part 640, a lamp driving part 650 and an air conditioning driving part 660. You can.

According to an embodiment, the vehicle driving apparatus 600 may further include other components in addition to the components described, or may not include some of the components described.

Meanwhile, the vehicle driving apparatus 600 may include a processor. Each unit of the vehicle driving apparatus 600 may individually include a processor.

The power train driver 610 may control the operation of the power train device.

The power train driving unit 610 may include a power source driving unit 611 and a transmission driving unit 612.

The power source driving unit 611 may control the power source of the vehicle 100.

For example, when the fossil fuel-based engine is a power source, the power source driving unit 610 may perform electronic control of the engine. Thereby, the output torque of an engine, etc. can be controlled. The power source driving unit 611 can adjust the engine output torque under the control of the control unit 170.

For example, when the electric energy-based motor is a power source, the power source driving unit 610 may perform control for the motor. The power source driving unit 610 may adjust the rotational speed, torque, and the like of the motor under the control of the control unit 170.

The transmission driver 612 may perform control of the transmission.

The transmission drive unit 612 can adjust the state of the transmission. The transmission drive unit 612 can adjust the state of the transmission to forward (D), reverse (R), neutral (N), or parking (P).

On the other hand, when the engine is a power source, the transmission drive unit 612 may adjust the gear engagement state in the forward (D) state.

The chassis driver 620 may control the operation of the chassis device.

The chassis driving unit 620 may include a steering driving unit 621, a brake driving unit 622, and a suspension driving unit 623.

The steering driving unit 621 may perform electronic control of a steering apparatus in the vehicle 100. The steering driving unit 621 may change the traveling direction of the vehicle.

The brake driving unit 622 may perform electronic control of a brake apparatus in the vehicle 100. For example, by controlling the operation of the brake disposed on the wheel, the speed of the vehicle 100 can be reduced.

Meanwhile, the brake driving unit 622 can individually control each of the plurality of brakes. The brake driving unit 622 may control braking forces applied to the plurality of wheels differently.

The suspension driving unit 623 may perform electronic control of a suspension apparatus in the vehicle 100. For example, the suspension driving unit 623 may control the suspension device to control vibration of the vehicle 100 when the road surface is curved, by controlling the suspension device.

Meanwhile, the suspension driving unit 623 can individually control each of the plurality of suspensions.

The door/window driving unit 630 may perform electronic control of a door apparatus or window apparatus in the vehicle 100.

The door/window driving unit 630 may include a door driving unit 631 and a window driving unit 632.

The door driver 631 may perform control of the door device. The door driver 631 may control opening and closing of a plurality of doors included in the vehicle 100. The door driver 631 may control opening or closing of a trunk or tail gate. The door driving unit 631 may control opening or closing of a sunroof.

The window driver 632 may perform electronic control of a window apparatus. The opening or closing of a plurality of windows included in the vehicle 100 may be controlled.

The safety device driving unit 640 may perform electronic control of various safety devices in the vehicle 100.

The safety device driving unit 640 may include an airbag driving unit 641, a seat belt driving unit 642, and a pedestrian protection device driving unit 643.

The airbag driving unit 641 may perform electronic control of an airbag apparatus in the vehicle 100. For example, the airbag driving unit 641 may control the airbag to be deployed when a danger is detected.

The seat belt driving unit 642 may perform electronic control of the seat belt device (seatbelt appartus) in the vehicle 100. For example, the seat belt driving unit 642 may control the passenger to be fixed to the seats 110FL, 110FR, 110RL, and 110RR using the seat belt when the danger is detected.

The pedestrian protection device driver 643 may perform electronic control of the hood lift and the pedestrian airbag. For example, the pedestrian protection device driving unit 643 may control a hood lift-up and a pedestrian airbag to be deployed upon collision detection with a pedestrian.

The lamp driving unit 650 may perform electronic control of various lamp apparatuses in the vehicle 100.

The air conditioning driving unit 660 may perform electronic control of an air cinditioner in the vehicle 100. For example, when the temperature inside the vehicle is high, the air conditioning driving unit 660 may control the air conditioning device to operate so that cold air is supplied into the vehicle.

The vehicle driving apparatus 600 may include a processor. Each unit of the vehicle driving apparatus 600 may individually include a processor.

The vehicle driving apparatus 600 may be operated under the control of the control unit 170.

The operation system 700 is a system that controls various operations of the vehicle 100. The driving system 700 may be operated in an autonomous driving mode.

The driving system 700 may include a driving system 710, an exit system 740, and a parking system 750.

Depending on the embodiment, the driving system 700 may further include other components in addition to the components described, or may not include some of the components described.

Meanwhile, the driving system 700 may include a processor. Each unit of the driving system 700 may individually include a processor.

Meanwhile, according to an embodiment, when the driving system 700 is implemented in software, it may be a sub-concept of the control unit 170.

Meanwhile, according to an embodiment, the driving system 700 may include at least one of the user interface device 200, the object detection device 300, the communication device 400, the vehicle driving device 600, and the control unit 170. It can be an inclusive concept.

The driving system 710 may perform driving of the vehicle 100.

The driving system 710 may receive navigation information from the navigation system 770 and provide a control signal to the vehicle driving device 600 to perform driving of the vehicle 100.

The driving system 710 may receive object information from the object detection device 300 and provide a control signal to the vehicle driving device 600 to perform driving of the vehicle 100.

The driving system 710 may receive a signal from an external device through the communication device 400 and provide a control signal to the vehicle driving device 600 to perform driving of the vehicle 100.

The unloading system 740 may perform unloading of the vehicle 100.

The exit system 740 may receive navigation information from the navigation system 770 and provide a control signal to the vehicle driving apparatus 600 to perform the exit of the vehicle 100.

The unloading system 740 may receive object information from the object detection device 300 and provide a control signal to the vehicle driving device 600 to perform the unloading of the vehicle 100.

The exit system 740 may receive a signal from an external device through the communication device 400 and provide a control signal to the vehicle driving apparatus 600 to perform the exit of the vehicle 100.

The parking system 750 may perform parking of the vehicle 100.

The parking system 750 may receive the navigation information from the navigation system 770 and provide a control signal to the vehicle driving apparatus 600 to perform parking of the vehicle 100.

The parking system 750 may receive object information from the object detection device 300, provide a control signal to the vehicle driving device 600, and perform parking of the vehicle 100.

The parking system 750 may receive a signal from an external device through the communication device 400 and provide a control signal to the vehicle driving apparatus 600 to perform parking of the vehicle 100.

The navigation system 770 may provide navigation information. The navigation information may include at least one of map information, set destination information, route information according to the destination setting, information on various objects on the route, lane information, and current location information of the vehicle.

The navigation system 770 may include a memory and a processor. The memory can store navigation information. The processor can control the operation of the navigation system 770.

According to an embodiment, the navigation system 770 may receive information from an external device through the communication device 400 and update pre-stored information.

According to an embodiment, the navigation system 770 may be classified as a sub-component of the user interface device 200.

The sensing unit 120 may sense the state of the vehicle. The sensing unit 120 includes a posture sensor (for example, a yaw sensor, a roll sensor, a pitch sensor), a collision sensor, a wheel sensor, a speed sensor, and an inclination Sensor, weight sensor, heading sensor, yaw sensor, gyro sensor, position module, vehicle forward/reverse sensor, battery sensor, fuel sensor, tire sensor, handle It may include a steering sensor by rotation, a temperature sensor inside the vehicle, a humidity sensor inside the vehicle, an ultrasonic sensor, an illuminance sensor, an accelerator pedal position sensor, a brake pedal position sensor, and the like.

The sensing unit 120 includes vehicle attitude information, vehicle collision information, vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward/reverse information, battery Acquire sensing signals for information, fuel information, tire information, vehicle lamp information, vehicle interior temperature information, vehicle interior humidity information, steering wheel rotation angle, vehicle exterior illumination, pressure applied to the accelerator pedal, pressure applied to the brake pedal can do.

The sensing unit 120 includes, in addition, an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an intake air temperature sensor (ATS), a water temperature sensor (WTS), and a throttle position sensor (TPS), a TDC sensor, a crank angle sensor (CAS), and the like.

The interface unit 130 may serve as a passage with various types of external devices connected to the vehicle 100. For example, the interface unit 130 may be provided with a port connectable to the mobile terminal, and may be connected to the mobile terminal through the port. In this case, the interface unit 130 may exchange data with the mobile terminal.

Meanwhile, the interface unit 130 may serve as a passage for supplying electrical energy to the connected mobile terminal. When the mobile terminal is electrically connected to the interface unit 130, under the control of the control unit 170, the interface unit 130 may provide the mobile terminal with electric energy supplied from the power supply unit 190.

The memory 140 is electrically connected to the control unit 170. The memory 140 may store basic data for the unit, control data for controlling the operation of the unit, and input/output data. The memory 140 may be various storage devices such as ROM, RAM, EPROM, flash drive, hard drive, and the like in hardware. The memory 140 may store various data for the overall operation of the vehicle 100, such as a program for processing or controlling the control unit 170.

According to an embodiment, the memory 140 may be integrally formed with the control unit 170 or may be implemented as a lower component of the control unit 170.

The control unit 170 may control the overall operation of each unit in the vehicle 100. The control unit 170 may be referred to as an electronic control unit (ECU).

The power supply unit 190 may supply power required for the operation of each component under the control of the control unit 170. In particular, the power supply unit 190 may receive power from a battery or the like inside the vehicle.

One or more processors and controls 170 included in the vehicle 100 include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), FPGAs ( field programmable gate arrays, processors, controllers, micro-controllers, microprocessors, and other electrical units for performing other functions.

Hereinafter, the display device 800 provided in the vehicle 100 will be described in detail.

The display device 800 is provided in the vehicle 100, may be made of an independent device that can be attached and detached to the vehicle 100, or may be integrally installed in the vehicle 100 to be a part of the vehicle 100. .

Hereinafter, for convenience of description, the display device 800 will be described as having a separate configuration independent from the control unit 170 of the vehicle 100. However, this is only an embodiment of the present invention, and the operation and control methods of all the display devices 800 described herein may be performed by the control unit 170 of the vehicle 100. That is, the operation and/or control method performed by the processor 870 of the display device 800 may be performed by the control unit 170 of the vehicle 800.

8 is a conceptual diagram illustrating a display device according to an embodiment of the present invention.

Referring to FIG. 8, the display device 800 includes a communication unit 810, a touch screen 830, a haptic module 850, and a processor 870.

The communication unit 810 is configured to perform communication with various components described in FIG. 7. For example, the communication unit 810 may receive various information provided through a controller (CAN). As another example, the communication unit 810 may communicate with all devices capable of communication such as a vehicle, a mobile terminal and a server, and other vehicles. This may be called V2X (Vehicle to everything) communication. V2X communication can be defined as a technology that exchanges or shares information such as traffic conditions while communicating with road infrastructure and other vehicles while driving.

The communication unit 810 is configured to perform communication with one or more displays provided in the vehicle 100.

Furthermore, the communication unit 810 may receive information related to driving of the vehicle from most devices provided in the vehicle 100. Information transmitted from the vehicle 100 to the display device 800 is referred to as “vehicle driving information”.

The vehicle driving information includes vehicle information and surrounding information of the vehicle. Based on the frame of the vehicle 100, information related to the inside of the vehicle may be defined as vehicle information and information related to the outside of the vehicle as surrounding information.

The vehicle information means information about the vehicle itself. For example, vehicle information includes the vehicle's driving speed, driving direction, acceleration, angular velocity, position (GPS), weight, vehicle occupancy, vehicle braking force, maximum braking force of the vehicle, air pressure of each wheel, and centrifugal force applied to the vehicle. , Driving mode of the vehicle (whether it is autonomous driving mode or manual driving), parking mode of the vehicle (autonomous parking mode, automatic parking mode, manual parking mode), whether the user is in the vehicle and information related to the user It can contain.

The surrounding information refers to information related to other objects located within a predetermined range around the vehicle and information related to the outside of the vehicle. For example, the condition of the road surface where the vehicle is driving (friction force), weather, distance from the vehicle in front (or rear), the relative speed of the vehicle in front (or rear), the curvature of the curve when the driving lane is a curve, vehicle Ambient brightness, information related to an object existing in a reference area (constant area) based on a vehicle, whether an object enters/departs from the predetermined area, whether a user exists around the vehicle, and information related to the user (eg For example, whether or not the user is an authenticated user).

In addition, the surrounding information includes, ambient brightness, temperature, sun location, object information (people, other vehicles, signs, etc.) located in the vicinity, type of road surface being driven, terrain feature, lane information, and driving lane (Lane) ) Information, information necessary for autonomous driving/autonomous parking/automatic parking/manual parking mode.

In addition, the surrounding information includes an object (object) existing around the vehicle and a distance to the vehicle 100, a possibility of collision, the type of the object, a parking space in which the vehicle can park, and an object for identifying the parking space (for example, , Parking lines, strings, other vehicles, walls, etc.).

The vehicle driving information is not limited to the example described above, and may include all information generated from components provided in the vehicle 100.

Meanwhile, the processor 870 is configured to control one or more displays provided in the vehicle 100 using the communication unit 810.

Specifically, the processor 870 may determine whether at least one condition is satisfied among a plurality of preset conditions based on vehicle driving information received through the communication unit 810. Depending on the satisfied condition, the processor 870 may control the one or more displays in different ways.

In relation to a preset condition, the processor 870 may detect that an event has occurred in an electrical appliance and/or application provided in the vehicle 100, and determine whether the detected event satisfies the preset condition. At this time, the processor 870 may detect that an event has occurred from information received through the communication unit 810.

The application is a concept including a widget or a home launcher, and means all types of programs that can be driven in the vehicle 100. Therefore, the application may be a program that performs a function of a web browser, video playback, message transmission and reception, schedule management, and application update.

Furthermore, the application includes Forward Collision Warning (FCW), Blind Spot Detection (BSD), Lane Departure Warning (LDW), Pedestrian Detection (PD), Curve Speed Warning (Curve Speed Warning, CSW) and turn by turn navigation (TBT).

For example, when an event occurs, when there is a missed call, when there is an application to be updated, when a message arrives, start on, start off, autonomous driving on/off, display activation key is pressed (LCD awake key), alarm (alarm), call connection (Incoming call), and may be missed notification (missed notification).

As another example, the event generation may be a case in which an alert set by the ADAS (advanced driver assistance system) or a function set by the ADAS is performed. For example, when a forward collision warning occurs, when a blind spot detection occurs, when a lane departure warning occurs, lane keeping assist warning) occurs, it can be considered that an event has occurred when an emergency braking function is performed.

As another example, when changing from a forward gear to a reverse gear, when an acceleration greater than a predetermined value occurs, when a deceleration greater than a predetermined value occurs, when a power unit is changed from an internal combustion engine to a motor, or at a motor Even if it is changed to an internal combustion engine, it can be considered that the event has occurred.

In addition, it can be considered that an event has occurred even when various ECUs provided in the vehicle 100 perform a specific function.

When the generated event is satisfied with a preset condition, the processor 870 controls the communication unit 810 such that information corresponding to the satisfied condition is displayed on the one or more displays.

The touch screen 830 is for generating output related to vision. The display may form a mutual layer structure with the touch sensor or be integrally formed to implement the touch screen 830. The touch screen may function as a user input unit that provides an input interface between the display device 800 and a user, and at the same time, provide an output interface between the display device 800 and a user.

The touch sensor detects a touch (or a touch input) applied to the touch screen 830 using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method.

As an example, the touch sensor may be configured to convert a change in pressure applied to a specific part of the touch screen or capacitance generated in the specific part into an electrical input signal. The touch sensor may be configured to detect a location, area, pressure when touching, and capacitance when touching, when a touch object applying a touch on the touch screen is touched on the touch sensor. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen or a stylus pen, a pointer, and the like.

As such, when there is a touch input to the touch sensor, the signal(s) corresponding thereto is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the controller 180. Accordingly, the processor 870 can know which area of the touch screen 830 has been touched. Here, the touch controller may be a separate component from the processor 870 and may be the processor 870 itself.

Meanwhile, the processor 870 may perform different controls or the same control according to the type of the touch object that touches the touch screen (or a touch key provided in addition to the touch screen). Whether to perform different control or the same control according to the type of the touch object, it may be determined according to an operating state of the current display device 800 or an application program being executed.

On the other hand, the touch sensors and proximity sensors described above can be independently or in combination, short (or tap) touch on the touch screen, long touch, long touch, multi touch, drag touch ), flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, etc. You can sense the touch.

The ultrasonic sensor may recognize location information of a sensing target using ultrasonic waves. On the other hand, the processor 870 may calculate the position of the wave generating source through information detected from the optical sensor and the plurality of ultrasonic sensors. The position of the wave generator can be calculated by using a property in which light is much faster than ultrasonic waves, that is, a time when light reaches the optical sensor is much faster than a time when ultrasonic waves reach the ultrasonic sensor. More specifically, the position of the wave generating source may be calculated by using a time difference from the time at which ultrasonic waves reach the light as a reference signal.

Meanwhile, a camera may be further provided to receive user input. The camera includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or image sensor), and a laser sensor.

The camera and the laser sensor are combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. The photo sensor may be stacked on the display element, which is configured to scan the movement of the sensing object close to the touch screen. More specifically, the photo sensor mounts photo diodes and TRs (transistors) in rows/columns to scan the contents placed on the photo sensor using electrical signals that change according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the sensing target according to the amount of change of light, and through this, location information of the sensing target may be obtained.

The touch screen 830 displays (outputs) information processed by the display device 800. For example, the touch screen 830 may display execution screen information of an application program driven by the display device 800 or UI (User Interface) or GUI (Graphic User Interface) information according to the execution screen information. .

Also, the touch screen 830 may be configured as a stereoscopic display unit displaying a stereoscopic image.

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glasses-free method), or a projection method (holographic method) may be applied to the stereoscopic display unit.

The haptic module 850 generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic module 850 may be vibration. The intensity and pattern of vibration generated in the haptic module 850 may be controlled by a user's selection or setting of a control unit. For example, the haptic module 850 may synthesize different vibrations and output them sequentially or sequentially.

In addition to vibration, the haptic module 850 is used for stimulation such as pin arrangement that vertically moves with respect to the skin surface of the contact, spray or suction power of air through a spray or intake, grazing on the skin surface, contact with an electrode, and electrostatic force. Various tactile effects can be generated, such as an effect caused by an effect and an effect of reproducing a feeling of cold and warm using an element capable of absorbing heat or generating heat.

The haptic module 850 may not only deliver a tactile effect through direct contact, but may also be implemented so that a user can feel the tactile effect through muscle sensations such as fingers or arms. Two or more haptic modules 850 may be provided according to a configuration aspect of the display device 800.

The haptic module 850 may generate vibration in at least one area of the touch screen.

The memory (not shown) stores data supporting various functions of the display device 800. The memory may store a number of application programs or applications that are driven in the display device 800 and data and instructions for the operation of the display device 800. At least some of these applications can be downloaded from external servers via wireless communication. In addition, at least some of these application programs may exist on the display device 800 from the time of shipment for basic functions of the display device 800 (for example, an incoming call, a calling function, a message reception, and a calling function). Meanwhile, the application program may be stored in a memory, installed on the display device 800, and driven by the processor 870 to perform an operation (or function) of the display device 800.

The processor 870 controls the overall operation of the display device 800 in addition to the operations related to the application program. The processor 870 processes signals, data, information, or the like input or output through the above-described components, or By driving the application program stored in the memory, it is possible to provide or process appropriate information or functions to the user.

In addition, the processor 870 may control at least some of the components described with reference to FIGS. 7 and 8 to drive an application program stored in the memory. Furthermore, the processor 870 may operate by combining at least two or more of the components included in the display device 800 to drive the application program.

Hereinafter, the operation of the display device 800 will be described in more detail with reference to the accompanying drawings.

9 is a flowchart illustrating a control method of the display device of FIG. 8.

The processor 870 may display a plurality of graphic objects associated with different control functions (S910).

A home screen may be displayed on the touch screen 830, or an execution screen according to execution of an application may be displayed. The home screen or the execution screen includes one or more graphic objects set to execute a preset function by user input. For example, a first graphic object set to execute a first function and a second graphic object set to execute a second function different from the first function may be displayed on the touch screen 830.

The processor 870 may determine different tactile effects on the basis of information on the electrical equipment received through the communication unit (S930 ).

The electronics information is received from the one or more electronics mounted on the vehicle 800 through the communication unit 810. Here, the electrical equipment information may mean vehicle driving information described above with reference to FIG. 8.

The processor 870 may control the haptic module 830 such that different tactile effects are generated according to the electrical equipment information even when the same user input, that is, a touch is applied to the same graphic object.

Various embodiments of determining different tactile effects according to electrical equipment information will be described later with reference to the following drawings.

The processor 870 may control the haptic module such that a determined tactile effect is generated on a finger to which the touch is applied in response to a touch being applied to at least one of the graphic objects (S950).

The processor 870 controls the haptic module to generate a tactile effect on a finger to which the touch is applied in response to a touch being applied to at least one of the graphic objects. At this time, the predetermined tactile effect may vary depending on the electrical equipment information received through the communication unit 810.

The processor 870 may control the haptic module 830 so that the predetermined tactile effect does not occur based on the electrical equipment information.

In other words, the processor 870 may determine whether or not a tactile effect is generated based on the electronic information, and also determine the type of the tactile effect that is generated.

Here, the different tactile effects mean that at least one of the vibration types that can be expressed by vibration size, frequency, and frequency is different.

The display device 800 can provide an effective user interface to the driver because the tactile effect is differentiated according to the driving situation.

10 is a flowchart illustrating a method of determining different tactile effects based on electrical equipment information, and FIGS. 11A, 11B, and 11C are examples for explaining an embodiment of providing different tactile effects according to driving conditions They are.

The processor 870 may determine the state of the vehicle 100 based on the electrical equipment information received through the communication unit 810 (S1010). Then, different tactile effects may be determined based on the state of the vehicle 100 (S1030).

Various conditions may be preset in the memory. When the electrical equipment information is not satisfied with any of the above conditions, the state of the vehicle 100 is determined as the basic state. In the basic state, a basic basic tactile effect occurs. For example, in response to a touch applied to a graphic object, the haptic module 830 may generate a constant vibration once for a predetermined time.

The processor 870 may determine the first state when the electrical equipment information satisfies the first condition, and determine the second state when the second condition is satisfied. The processor 870 may control the haptic module 830 such that a first tactile effect occurs in the first state instead of the basic tactile effect, and a second tactile effect occurs in the second state.

For example, the processor 870 may determine the state of the vehicle as the safety state in which the probability of collision is lower than the reference or a dangerous state in which the probability of collision is higher than or equal to the reference based on the electrical equipment information. The processor 870 may comprehensively consider information received from various electric devices and calculate the collision probability, or may receive the collision possibility from a vehicle control unit (ECU) that calculates the collision probability.

As illustrated in FIG. 11A, a plurality of graphic objects may be displayed on the touch screen 830 of the display device 800. When a touch is applied to a graphic object 1110, the processor 870 controls the haptic module 850 to generate a tactile effect corresponding to the touch. In other words, different tactile effects may occur depending on the touch method.

Furthermore, even when the same touch is applied to the same graphic object, the processor 830 may generate different tactile effects according to the electrical equipment information received through the communication unit 810.

For example, a first tactile effect may occur in a safety state in which the possibility of collision of the vehicle 100 is lower than a reference, and a second tactile effect may occur in a dangerous state in which a collision situation is higher than or equal to a reference due to a dangerous situation have.

The possibility of the collision can be calculated by the information of the electrical equipment. For example, if the driver does not look forward, and looks inside the vehicle for a longer period of time, drowsy driving, lane intrusion, objects that may collide based on the driving direction are searched It can be calculated comprehensively according to the case.

When a dangerous situation such as lane departure is detected, the display device 800 provides passengers with different tactile effects and patterns. This can help arouse the attention of the passengers and quickly recognize the surrounding situation. At this time, the processor 870 may additionally display a predetermined image on the edge of the touch screen 830 to allow the passenger to recognize the situation.

As another example, the processor 870 determines that the vehicle 100 is in a low-speed driving state when driving or stopping within a first speed range, and determines a high-speed driving state when driving outside the first speed range. Can. That is, the low-speed driving state may be defined as a state in which the vehicle is driving within a first speed range, and the high-speed driving state may be defined as a driving state within a second speed range different from the first speed range.

As shown in FIG. 11B, in the case of a stop, it may be determined as a low-speed driving state, and in the case of a driving situation, it may be determined as a high-speed driving state. A tactile effect of basic strength is provided in a low-speed driving state. In a high-speed driving state, the tactile effect of the basic strength may not be felt by the passenger due to the movement of the vehicle or noise in the vehicle. Therefore, in a high-speed driving state, a tactile effect is provided in which the magnitude of vibration is greater than the basic strength. Thereby, a situation in which the tactile effect is not felt due to vibration in the vehicle does not occur.

As another example, the processor 870 is a manual driving state in which the driving direction of the vehicle is changed by the driver of the vehicle or an autonomous driving state in which the driving direction of the vehicle is changed regardless of the intention of the driver. According to this, different tactile effects may be generated.

The autonomous driving state may be variously defined. In the present invention, an autonomous driving state is defined as an autonomous driving state in which a driving direction of a vehicle is changed regardless of a driver's intention, but is not limited thereto. That is, the autonomous driving state may be variously modified by a person having ordinary skill in the technical field related to the vehicle. In this case, the manual driving state is defined as a state other than an autonomous driving state.

The processor 870 may set at least one area of the touch screen as a tactile effect providing area 1130. When a touch is applied to a graphic object displayed in the tactile effect providing area 1130, a predetermined tactile effect corresponding thereto is provided, but when a touch is applied to a graphic object not displayed in the tactile effect providing area 1130, the predetermined tactile effect Is not provided.

The processor 870 may determine the state of the vehicle 100 based on the electronic information, and determine a tactile effect providing area 1130 based on the state of the vehicle 100. In other words, at least one of the size, position, and shape of the tactile effect providing area 1130 may be changed according to the electrical equipment information.

For example, as illustrated in FIG. 11C, in the manual driving state, the entire area of the touch screen 830 is set as the tactile effect providing area 1130, but in the autonomous driving state, a partial area of the touch screen 830 is tactile. It may be set as an effect providing area 1130.

This is to minimize the risk of driver's distraction by setting the tactile effect to the entire area in the manual driving state. In the autonomous driving state, the driver is not obligated to look forward, so that the driver can freely operate the display device 800. By eliminating or minimizing feedback such as tactile effects, unnecessary feedback can be prevented from being provided to the driver in advance.

The processor 870 may reset the tactile effect providing area 1130 according to a screen displayed on the touch screen 830. The tactile effect providing area 1130 may be set only for an area in which a graphic object to which a tactile effect is to be provided is displayed.

12 is a flowchart illustrating a method of providing different tactile effects according to passengers inputting user input, and FIG. 13 is an exemplary view illustrating the embodiment of FIG. 12.

The processor 870 may determine a seat of a passenger who inputs a touch based on the electronic information (S1210). The processor 870 may control the haptic module 830 to generate different tactile effects according to the seat (S1230).

The electronic information includes passenger information on which the touch is input, and even when the same touch is input on the same graphic object, different tactile effects may occur depending on the seat of the passenger who input the touch.

The display device 800 may be disposed at the center fascia of the vehicle 100 or between a meteorite and a passenger seat. Accordingly, a touch may be input to the display device 800 by a driver or a passenger in the passenger seat.

The processor 870 may classify whether the passenger who has applied the touch is the driver or the passenger in the passenger seat based on the information of the electronic equipment and provide different tactile effects.

For example, the passenger information may include an image of the interior of the vehicle. The processor 870 may determine a seat of a passenger who inputs the touch based on the image, and may control the haptic module 850 to generate different tactile effects according to the seat.

As illustrated in FIG. 13, when a driver applies a touch to a graphic object 1310, a first tactile effect occurs, but when a passenger in a passenger seat applies a touch to the graphic object 1310, a second tactile effect is generated. Can occur.

14 is an exemplary view for explaining a method of providing a tactile effect to a steering wheel.

When the touch is applied to at least one graphic object, the processor 870 may transmit a control command through the communication unit 810 to generate a tactile effect on the steering wheel 1410 provided in the vehicle 100. have. A tactile effect indicating that the driver should focus on driving may be provided to the driver through the steering wheel 1410.

When both hands are positioned on the steering wheel 1410, the processor 870 may transmit a new control command through the communication unit to stop the tactile effect generated by the steering wheel.

While driving, the driver may grasp the steering wheel with one hand and apply a touch to the display device 800 with the other hand. In this case, the processor 870 may provide a tactile effect different from the conventional one through the haptic module 850, meaning to focus on driving. Furthermore, a tactile effect is also generated on the steering wheel, so that the driver can hold the steering wheel with both hands. The tactile effect generated by the steering wheel may continue until the driver lifts the steering wheel with both hands. This causes the driver to focus on driving again.

The present invention can be extended to a vehicle 100 having a display device 800 described with reference to FIGS. 8 to 14.

The above-described present invention can be embodied as computer readable codes (or applications or software) on a medium on which a program is recorded. The above-described control method of the autonomous vehicle can be realized by a code stored in a memory or the like.

The computer-readable medium includes all types of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include a hard disk drive (HDD), solid state disk (SSD), silicon disk drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage device. This includes, and is also implemented in the form of a carrier wave (eg, transmission over the Internet). Also, the computer may include a processor or a control unit. Accordingly, the above detailed description should not be construed as limiting in all respects, but should be considered illustrative. The scope of the invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the invention are included in the scope of the invention.

Claims (10)

A display device mounted on a vehicle,
A touch screen displaying a plurality of graphic objects linked to different control functions;
A haptic module that generates vibration in at least one area of the touch screen;
A communication unit configured to receive electrical equipment information from one or more electrical equipment mounted on the vehicle; And
And a processor that controls the haptic module to generate a tactile effect on a finger to which the touch is applied in response to a touch being applied to at least one of the graphic objects,
The processor,
The haptic module is controlled to generate different tactile effects according to the electronic information,
Set at least one area of the entire area of the touch screen as a tactile effect providing area based on the electronic information, and at least one of the size, position, and shape of the tactile effect providing area is variable according to the electronic information,
When a touch is applied to a graphic object displayed in the tactile effect providing area, the haptic module is controlled to provide different tactile effects according to the electrical equipment information,
A display device characterized by controlling the haptic module so as not to provide a tactile effect when a touch is applied to a graphic object not displayed in the tactile effect providing area. According to claim 1,
The processor,
Determine the state of the vehicle based on the electrical equipment information,
In the first state, the haptic module is controlled to generate a first tactile effect,
In the second state, the display device characterized in that the haptic module is controlled to generate a second tactile effect different from the first tactile effect. According to claim 2,
The processor,
And determining the state of the vehicle as the first state in which the probability of collision is lower than the reference or the second state in which the probability of collision is higher than or equal to the reference based on the electrical equipment information. According to claim 3,
The processor,
A display device characterized in that the possibility of the collision is calculated based on the electrical equipment information. According to claim 2,
The processor,
When the touch is applied to the at least one in the second state, a display device characterized in that a control command is transmitted through the communication unit to generate a tactile effect on the steering wheel provided in the vehicle. The method of claim 5,
The processor,
When both hands are positioned on the steering wheel, a display device characterized in that a new control command is transmitted through the communication unit so that the tactile effect generated by the steering wheel is stopped. According to claim 2,
The first state is a manual driving state in which the driving direction of the vehicle is changed by the driver of the vehicle, and the second state is an autonomous driving state in which the driving direction of the vehicle is changed regardless of the intention of the driver. Display device. According to claim 2,
The first state is a state in which the vehicle is driving within a first speed range, and the second state is a state in which the vehicle is driving within a second speed range different from the first speed range. According to claim 1,
The electronic equipment information includes passenger information inputting the touch,
A display device characterized in that different tactile effects are generated according to the seats of the passengers who have input the touch. The method of claim 9,
The passenger information includes an image of the inside of the vehicle,
The processor,
A display device comprising determining a seat of a passenger who inputs the touch based on the image, and controlling the haptic module to generate different tactile effects according to the seat.

Images