KR101892498B1 - Vehicle interface device, vehicle and mobile terminal link system - Google Patents

Abstract

The present invention relates to a display; A communication unit for performing pairing with the first mobile terminal; Generating a first message including location information and text of the vehicle and transmitting the first message to the first mobile terminal and, when the first mobile terminal receives the corresponding second message of the first message, And a processor for receiving text and point of interest information corresponding to the position information included in the second message, and displaying the text and the point of interest information on a display.

Description

[0001] Vehicle interface device, vehicle and mobile terminal link system [

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a vehicle user interface device for displaying a message including location information of a mobile terminal, and an interworking system of a vehicle and a mobile terminal

A vehicle is a device that moves a user in a desired direction by a boarding user. Typically, automobiles are examples.

In recent years, studies on interworking between a vehicle and a mobile terminal have been actively conducted. The vehicle can provide more functions according to the interworking of the mobile terminals.

Research on providing functions provided by a mobile terminal to a driver of a vehicle using the mobile terminal is also required. In this case, research is needed to provide a method for providing information to the driver while minimizing the driver's manipulation for convenience.

The present invention provides a vehicle interface apparatus for displaying an information providing screen on a vehicle and an interlocking system of a vehicle and a mobile terminal in response to positional information of the vehicle and the mobile terminal in a state where the vehicle and the mobile terminal are interlocked with each other.

The problems of the present invention are not limited to the above-mentioned problems, and other problems not mentioned can be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, there is provided a mobile communication terminal, comprising: a display; a communication unit for performing a pairing with a first mobile terminal; a first mobile terminal for receiving a message from the second mobile terminal, A processor for receiving the location information of the second mobile terminal, generating an icon corresponding to the message, matching the icon to a map corresponding to the location information of the second mobile terminal, and displaying the map on the display A vehicle user interface device,

The mobile communication terminal also generates a first message including a display, a communication unit that performs pairing with the first mobile terminal, location information of the vehicle, text, and transmits the first message to the first mobile terminal, When the first mobile terminal receives the text and interest point information corresponding to the location information included in the second message from the first mobile terminal and displays the text and the point of interest information on the display A vehicle user interface device comprising a processor,

The first mobile terminal transmits a first message including a server, a mobile terminal equipped with a wireless communication unit, a display, a communication unit for performing pairing with the first mobile terminal, location information of the vehicle, and text, When the first mobile terminal receives a corresponding second message from the first mobile terminal, receives text and interest point information corresponding to the location information included in the second message from the first mobile terminal, And a vehicle user interface device including a processor for displaying point information on a display.

The details of other embodiments are included in the detailed description and drawings.

According to an embodiment of the present invention, there is one or more of the following effects.

First, there is an effect that the user does not have to check the mobile terminal frequently while driving.

Second, a message including positional information is graphically processed and provided to an information providing screen, so that the driver can intuitively confirm information.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description of the claims.

1 is a view showing an appearance of a vehicle according to an embodiment of the present invention.
2 is a block diagram of a vehicle according to an embodiment of the present invention.
3 is a diagram illustrating an appearance of various mobile terminals according to an embodiment of the present invention.
4 is a block diagram of a mobile terminal according to an embodiment of the present invention.
5 is a flowchart referred to explain a message receiving operation of the vehicle user interface device according to the embodiment of the present invention.
6 is a flowchart referred to explain a message transmission / reception operation of a vehicle user interface device according to an embodiment of the present invention.
7 is a flowchart referred to explain a map setting process according to a location of a second mobile terminal according to an embodiment of the present invention.
8 is a flowchart referred to explain a process of receiving a message to a user registered in a first mobile terminal according to an embodiment of the present invention.
9 is a flowchart referred to explain a process of transmitting and receiving a message corresponding to a vehicle running state according to an embodiment of the present invention.
10 is a flowchart referred to in explaining an icon corresponding to point information of interest in an embodiment of the present invention.
11 is a flowchart referred to explain control for receiving TPEG information according to an embodiment of the present invention.
12 is a diagram for explaining how a message including location information is received and displayed on a display according to an embodiment of the present invention.
13 is a referenced diagram illustrating transmitting and receiving a message including location information according to an embodiment of the present invention.
Figure 14 is a diagram referenced to illustrate receiving and displaying a TPEG, in accordance with an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

The vehicle described herein may be a concept including a car, a motorcycle. Hereinafter, the vehicle will be described mainly with respect to the vehicle.

The vehicle described in the present specification may be a concept including both an internal combustion engine vehicle having an engine as a power source, a hybrid vehicle having an engine and an electric motor as a power source, and an electric vehicle having an electric motor as a power source.

A mobile terminal as described herein may be a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC, A tablet PC, an ultrabook, a wearable device such as a smartwatch, a smart glass, and a head mounted display (HMD). have.

1 and 2, the vehicle 100 may include a wheel rotated by a power source, and a steering input device 510 for adjusting the traveling direction of the vehicle 100. [

The vehicle 100 may be an autonomous vehicle.

The vehicle 100 can be switched to the autonomous running mode or the manual mode based on the user input.

For example, the vehicle 100 can be switched from the manual mode to the autonomous mode, or switched from the autonomous mode to the manual mode, based on the received user input, via the user interface device 200. [

The vehicle 100 can be switched to the autonomous running mode or the manual mode based on the running situation information. The running situation information can be generated based on the object information provided by the object detecting apparatus 300. [

For example, the vehicle 100 can be switched from the manual mode to the autonomous mode or switched from the autonomous mode to the manual mode based on the running condition information generated by the object detection device 300. [

For example, the vehicle 100 can be switched from the manual mode to the autonomous mode or switched from the autonomous mode to the manual mode based on the running condition information received via the communication device 400. [

The vehicle 100 can be switched from the manual mode to the autonomous mode based on information, data and signals provided from the external device, or can be switched from the autonomous mode to the manual mode.

When the vehicle 100 is operated in the self-running mode, the autonomous vehicle 100 can be operated on the basis of the running system 700. [

For example, the autonomous vehicle 100 may be operated based on information, data or signals generated in the traveling system 710, the outgoing system 740, and the parking system 750. [

When the vehicle 100 is operated in the manual mode, the autonomous vehicle 100 can receive a user input for driving through the driving operation device 500. [ Based on the user input received through the driving operation device 500, the vehicle 100 can be operated.

The overall length means the length from the front portion to the rear portion of the vehicle 100 and the width is the width of the vehicle 100 and the height means the length from the bottom of the wheel to the roof. In the following description, it is assumed that the total length direction L is a direction in which the full length direction of the vehicle 100 is measured, the full width direction W is a reference for the full width measurement of the vehicle 100, Which is a reference for the measurement of the height of the object 100.

2, the vehicle 100 includes a user interface device 200, an object detection device 300, a communication device 400, a driving operation device 500, a vehicle driving device 600, A navigation system 770, a sensing unit 120, an interface unit 130, a memory 140, a control unit 170, and a power supply unit 190.

According to the embodiment, the vehicle 100 may further include other components than the components described herein, or may not include some of the components described.

The user interface device 200 is a device for communicating between the vehicle 100 and a user. The user interface device 200 may receive user input and provide information generated by the vehicle 100 to the user. The vehicle 100 can implement UI (User Interfaces) or UX (User Experience) through the user interface device 200. [

The user interface device 200 may include an input unit 200, an internal camera 220, a biological sensing unit 230, an output unit 250, and a processor 270.

According to the embodiment, the user interface device 200 may further include other components than the components described, or may not include some of the components described.

The input unit 200 is for receiving information from the user. The data collected by the input unit 120 may be analyzed by the processor 270 and processed by a user's control command.

The input unit 200 can be disposed inside the vehicle. For example, the input unit 200 may include one area of a steering wheel, one area of an instrument panel, one area of a seat, one area of each pillar, one area of the head console, one area of the door, one area of the center console, one area of the head lining, one area of the sun visor, one area of the windshield, One area or the like.

The input unit 200 may include an audio input unit 211, a gesture input unit 212, a touch input unit 213, and a mechanical input unit 214.

The voice input unit 211 can switch the voice input of the user into an electrical signal. The converted electrical signal may be provided to the processor 270 or the control unit 170.

The voice input unit 211 may include one or more microphones.

The gesture input unit 212 can switch the user's gesture input to an electrical signal. The converted electrical signal may be provided to the processor 270 or the control unit 170.

The gesture input unit 212 may include at least one of an infrared sensor and an image sensor for detecting a user's gesture input.

According to an embodiment, the gesture input 212 may sense a user's three-dimensional gesture input. To this end, the gesture input unit 212 may include an optical output unit for outputting a plurality of infrared rays or a plurality of image sensors.

The gesture input unit 212 can sense a user's three-dimensional gesture input through a time of flight (TOF) method, a structured light method, or a disparity method.

The touch input unit 213 can switch the touch input of the user into an electrical signal. The converted electrical signal may be provided to the processor 270 or the controller 170.

The touch input unit 213 may include a touch sensor for sensing a touch input of a user.

According to the embodiment, the touch input unit 213 is integrated with the display unit 251, thereby realizing a touch screen. Such a touch screen may provide an input interface and an output interface between the vehicle 100 and a user.

The mechanical input unit 214 may include at least one of a button, a dome switch, a jog wheel, and a jog switch. The electrical signal generated by the mechanical input 214 may be provided to the processor 270 or the controller 170.

The mechanical input unit 214 may be disposed on a steering wheel, a centepascia, a center console, a cockpit module, a door, or the like.

The internal camera 220 can acquire the in-vehicle image. The processor 270 can sense the state of the user based on the in-vehicle image. The processor 270 can obtain the user's gaze information from the in-vehicle image. The processor 270 may sense the user's gesture in the in-vehicle video.

The biometric sensor 230 can acquire biometric information of the user. The biometric sensor 230 includes a sensor capable of acquiring biometric information of a user, and can acquire fingerprint information, heartbeat information, etc. of a user using a sensor. Biometric information can be used for user authentication.

The output unit 250 is for generating an output related to a visual, auditory or tactile sense or the like.

The output unit 250 may include at least one of a display unit 251, an acoustic output unit 252, and a haptic output unit 253.

The display unit 251 may display graphic objects corresponding to various information.

The display unit 251 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) display, a 3D display, and an e-ink display.

The display unit 251 may have a mutual layer structure with the touch input unit 213 or may be integrally formed to realize a touch screen.

The display unit 251 may be implemented as a Head Up Display (HUD). When the display unit 251 is implemented as an HUD, the display unit 251 may include a projection module to output information through an image projected on a windshield or a window.

The display unit 251 may include a transparent display. The transparent display may be attached to the windshield or window.

The transparent display can display a predetermined screen while having a predetermined transparency. Transparent displays can be made of transparent TFEL (Thin Film Elecroluminescent), transparent OLED (Organic Light-Emitting Diode), transparent LCD (Liquid Crystal Display), transmissive transparent display, transparent LED (Light Emitting Diode) Or the like. The transparency of the transparent display can be adjusted.

Meanwhile, the user interface device 200 may include a plurality of display units 251a to 251g.

The display unit 251 includes one area of the steering wheel, one area of the inspiration panel 521a, 251b and 251e, one area of the seat 251d, one area of each filler 251f, 251g), one area of the center console, one area of the head lining, one area of the sun visor, one area 251c of the windshield, and one area 251h of the window.

The audio output unit 252 converts an electric signal provided from the processor 270 or the control unit 170 into an audio signal and outputs the audio signal. To this end, the sound output section 252 may include one or more speakers.

The haptic output unit 253 generates a tactile output. For example, the haptic output section 253 may operate to vibrate the steering wheel, the seat belt, the seat 110FL, 110FR, 110RL, and 110RR so that the user can recognize the output.

The processor 270 may control the overall operation of each unit of the user interface device 200.

In accordance with an embodiment, the user interface device 200 may include a plurality of processors 270, or may not include a processor 270. [

If the user interface device 200 does not include the processor 270, the user interface device 200 may be operated under the control of the processor or the control unit 170 of another apparatus in the vehicle 100. [

On the other hand, the user interface device 200 may be referred to as a vehicle display device.

The user interface device 200 may be operated under the control of the control unit 170.

The processor 270 may receive the message via paired with the first mobile terminal.

The first mobile terminal is a device that transmits and receives data with the vehicle by pairing with the communication device of the vehicle.

Specifically, when the occupant holding the first mobile terminal is present in the vehicle 100 or located within a predetermined distance from the vehicle 100, the vehicle can be paired with the first mobile terminal. The vehicle can be paired with the first mobile terminal using BLE (Bluetooth Low Energy).

The second mobile terminal communicates with the first mobile terminal and transmits and receives data to and from the first mobile terminal.

The message is data including text and location information of a second mobile terminal that creates the text.

The processor 270 may receive the text contained in the message from the first mobile terminal, and the location information of the second mobile terminal.

The location information of the second mobile terminal may be data sensed by a GPS sensor included in the second mobile terminal.

The processor 270 may generate an icon corresponding to the message.

The icon may be displayed on the display as a graphic object corresponding to the message.

Processor 270 may generate a text icon corresponding to the text. Processor 270 may generate an icon corresponding to the second mobile terminal.

For example, the processor 270 may receive the message from a second mobile terminal that is registered with the first mobile terminal.

The processor 270 may receive at least one of a message number and a message ID from a list registered in the first mobile terminal.

The processor 270 may generate an icon based on the image corresponding to the second mobile terminal stored in the first mobile terminal.

For example, when receiving a message from a second mobile terminal that is not registered with the first mobile terminal, the processor 270 may generate an icon corresponding to the second mobile terminal based on the predetermined image.

The processor 270 may match the icon to the map corresponding to the location information of the second mobile terminal.

The processor 270 may match at least one of the text icon and the second mobile terminal icon to the map corresponding to the position information of the second mobile terminal.

The processor 270 can set the range of the map within a predetermined distance based on the current position information of the vehicle.

The processor 270 can set the range of the map based on the input location information corresponding to the user input.

The processor 270 may match the icon of the second mobile terminal within a predetermined range based on the predetermined map. For example, if the location of the second mobile terminal is outside a predetermined range, the processor 270 may not match the location of the second mobile terminal to the map.

The processor 270 may display on the display a map matched with the icon corresponding to the message.

The processor 270 may receive the speed information of the vehicle, the traveling state of the vehicle, and the traveling mode information of the vehicle from the sensing unit 120. [

The processor 270 may display the message on the display corresponding to at least one of the speed information of the vehicle, the running state information of the vehicle, and the mode information of the vehicle.

The processor 270 may receive the vehicle status information from the control unit 170 or the sensing unit 120. [

For example, if the vehicle is in private mode, processor 270 may not display a message on the display. The private mode is a mode in which a message received by the user is provided to the user. The processor 270 may generate a predetermined response message in response to the message.

For example, when the vehicle is in a running state, the processor 270 may display a message.

For example, if the vehicle is in autonomous mode, processor 270 may display a message.

For example, if the vehicle is in passive driving mode and the vehicle speed is less than a predetermined speed, the processor 270 may display the message.

For example, if the vehicle is in passive driving mode and the speed of the vehicle is above a predetermined speed, the processor 270 may store the message in a queue without displaying a message.

The processor 270 may generate a first message containing location information, text, of the vehicle.

Processor 270 may include the text, location information, and interest information in a first message as a drag and drop input.

The processor 270 can receive the touch and drag input through the display unit through the input unit 200 and set the position of the vehicle.

Processor 270 may include the location of the vehicle in the first message, via a touch-and-drag input, corresponding to the user input.

Processor 270 may receive a corresponding second message of the first message from the first mobile terminal.

The processor 270 may receive point of interest information corresponding to the location information of the vehicle included in the second message from the first mobile terminal.

The point-of-interest information is provided as coordinates for major facilities such as stations, airports, terminals, hotels, and the like.

Processor 270 may receive TPEG (Transport Protocol Expert Group) information. The TPEG information is information including traffic information, weather information, news, and interest point information.

For example, when the current position information of the second mobile terminal is included in the second message and the position of the second mobile terminal is within a predetermined range from the coordinates included in the point of interest information, 2 TPEG information from the mobile terminal.

The processor 270 may also receive the TPEG information from the server via the communication device 400. [

Processor 270 may generate an icon corresponding to the point of interest information.

The processor 270 may generate the message according to the category of the main facilities included in the point of interest information based on the point of interest information.

The processor 270 may generate an icon corresponding to the category of the TPEG information.

The processor 270 may set the icon type and icon color corresponding to the point of interest information.

Processor 270 may display on the display the text, point of interest corresponding to the location information contained in the second message.

For example, the processor 270 may display an icon corresponding to the point of interest information on the display. The processor 270 may display an icon corresponding to the TPEG information on the display.

The processor 270 may match the icon corresponding to the point of interest information to the map based on the in-vehicle location information.

The processor 270 may set a map within a predetermined range corresponding to the vehicle position information.

The processor 270 may receive the coordinates included in the point of interest information, and may match the icon corresponding to the second message with the map.

The processor 270 may match the icon corresponding to the TPEG information to the map based on the vehicle location information.

The processor 270 may display on the display a map matched with the icon corresponding to the point of interest information.

The processor 270 may display on the display a map matched with the icon corresponding to the TPEG information

The processor 270 may receive corresponding mobile terminal information displayed on the display based on input information by the user input through the input unit 200. [

Processor 270 may select an icon corresponding to the point of interest information corresponding to the user input.

 Processor 270 may select an icon corresponding to the TPEG information corresponding to the user input.

The processor 270 may display the point of interest information corresponding to the selected icon on the display.

The processor 270 may display the TPEG information on the display based on the point of interest information. The processor 270 may graphically process the point of interest information generated based on the TPEG to generate an information providing screen.

The object detecting apparatus 300 is an apparatus for detecting an object located outside the vehicle 100. [

The object may be various objects related to the operation of the vehicle 100.

The object detection apparatus 300 may include a camera 310, a radar 320, a LR 330, an ultrasonic sensor 340, an infrared sensor 350, and a processor 370.

According to the embodiment, the object detecting apparatus 300 may further include other elements other than the described elements, or may not include some of the described elements.

The camera 310 may be located at an appropriate location outside the vehicle to obtain the vehicle exterior image. The camera 310 may be a mono camera, a stereo camera 310a, an AVM (Around View Monitoring) camera 310b, or a 360 degree camera.

For example, the camera 310 may be disposed in the interior of the vehicle, close to the front windshield, to acquire an image of the front of the vehicle. Alternatively, the camera 310 may be disposed around a front bumper or radiator grill.

For example, the camera 310 can be disposed in the interior of the vehicle, close to the rear glass, to acquire images of the rear of the vehicle. Alternatively, the camera 310 may be disposed around a rear bumper, trunk, or tailgate.

For example, the camera 310 may be disposed close to at least one of the side windows in the interior of the vehicle to obtain the image of the side of the vehicle. Alternatively, the camera 310 may be disposed around a side mirror, fender, or door.

The camera 310 may provide the acquired image to the processor 370.

The radar 320 may include an electromagnetic wave transmitting unit and a receiving unit. The radar 320 may be implemented by a pulse radar system or a continuous wave radar system in terms of the radio wave emission principle. The radar 320 may be implemented by a Frequency Modulated Continuous Wave (FMCW) scheme or a Frequency Shift Keying (FSK) scheme according to a signal waveform in a continuous wave radar scheme.

The radar 320 detects an object based on a time-of-flight (TOF) method or a phase-shift method through electromagnetic waves, and detects the position of the detected object, the distance to the detected object, Can be detected.

The radar 320 may be disposed at a suitable location outside the vehicle to sense objects located at the front, rear, or side of the vehicle.

The ladder 330 may include a laser transmitting unit and a receiving unit. The LIDAR 330 may be implemented in a time of flight (TOF) scheme or a phase-shift scheme.

The lidar 330 may be implemented as a drive or an unshifted drive.

When implemented in a driving manner, the LIDAR 330 is rotated by a motor and can detect an object in the vicinity of the vehicle 100. [

In the case of non-driven implementation, the LIDAR 330 can detect an object located within a predetermined range with respect to the vehicle 100 by optical steering. The vehicle 100 may include a plurality of non-driven RRs 330. [

The lidar 330 detects an object based on a laser light medium, a time of flight (TOF) method, or a phase-shift method, and detects the position of the detected object, The relative speed can be detected.

The lidar 330 may be disposed at an appropriate location outside the vehicle to sense objects located at the front, rear, or side of the vehicle.

The ultrasonic sensor 340 may include an ultrasonic transmitter and a receiver. The ultrasonic sensor 340 can detect the object based on the ultrasonic wave, and can detect the position of the detected object, the distance to the detected object, and the relative speed.

The ultrasonic sensor 340 may be disposed at an appropriate position outside the vehicle for sensing an object located at the front, rear, or side of the vehicle.

The infrared sensor 350 may include an infrared ray transmitter and a receiver. The infrared sensor 340 can detect the object based on the infrared light, and can detect the position of the detected object, the distance to the detected object, and the relative speed.

The infrared sensor 350 may be disposed at an appropriate position outside the vehicle for sensing an object located at the front, rear, or side of the vehicle.

The processor 370 can control the overall operation of each unit of the object detecting apparatus 300. [

The processor 370 can detect and track the object based on the acquired image. The processor 370 can perform operations such as calculating a distance to an object, calculating a relative speed with respect to the object, and the like through an image processing algorithm.

The processor 370 can detect and track the object based on the reflected electromagnetic waves that are reflected from the object by the transmitted electromagnetic waves. The processor 370 can perform operations such as calculating a distance to an object and calculating a relative speed with respect to the object based on electromagnetic waves.

The processor 370 can detect and track the object based on the reflected laser light reflected back from the object by the transmitted laser. Based on the laser light, the processor 370 can perform operations such as calculating the distance to the object and calculating the relative speed with respect to the object.

The processor 370 can detect and track the object on the basis of the reflected ultrasonic waves reflected by the object and transmitted back. The processor 370 can perform operations such as calculating the distance to the object and calculating the relative speed with respect to the object based on the ultrasonic waves.

The processor 370 can detect and track the object based on the reflected infrared light that the transmitted infrared light reflects back to the object. The processor 370 can perform operations such as calculating the distance to the object and calculating the relative speed with respect to the object based on the infrared light.

According to the embodiment, the object detecting apparatus 300 may include a plurality of processors 370 or may not include the processor 370. [ For example, each of the camera 310, the radar 320, the RI 330, the ultrasonic sensor 340, and the infrared sensor 350 may individually include a processor.

The object detecting apparatus 300 can be operated under the control of the processor of the apparatus in the vehicle 100 or the controller 170 when the object detecting apparatus 300 does not include the processor 370. [

The object detecting apparatus 400 can be operated under the control of the control unit 170. [

The communication device 400 is a device for performing communication with an external device. Here, the external device may be another vehicle, a mobile terminal, or a server.

The communication device 400 may include at least one of a transmission antenna, a reception antenna, an RF (Radio Frequency) circuit capable of implementing various communication protocols, and an RF device to perform communication.

The communication device 400 may include a local communication unit 410, a location information unit 420, a V2X communication unit 430, an optical communication unit 440, a broadcast transmission / reception unit 450, and a processor 470.

According to the embodiment, the communication device 400 may further include other components than the components described, or may not include some of the components described.

The short-range communication unit 410 is a unit for short-range communication. The short-range communication unit 410 may be a wireless communication unit such as Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC) -Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology.

The short-range communication unit 410 may form short-range wireless communication networks to perform short-range communication between the vehicle 100 and at least one external device.

The position information section 420 is a unit for acquiring the position information of the vehicle 100. [ For example, the location information unit 420 may include a Global Positioning System (GPS) module or a Differential Global Positioning System (DGPS) module.

The V2X communication unit 430 is a unit for performing wireless communication with a server (V2I: Vehicle to Infra), another vehicle (V2V: Vehicle to Vehicle), or a pedestrian (V2P: Vehicle to Pedestrian). The V2X communication unit 430 may include an RF circuit capable of implementing communication with the infrastructure (V2I), inter-vehicle communication (V2V), and communication with the pedestrian (V2P) protocol.

The optical communication unit 440 is a unit for performing communication with an external device via light. The optical communication unit 440 may include a light emitting unit that converts an electric signal into an optical signal and transmits it to the outside, and a light receiving unit that converts the received optical signal into an electric signal.

According to the embodiment, the light emitting portion may be formed so as to be integrated with the lamp included in the vehicle 100. [

The broadcast transmission / reception unit 450 is a unit for receiving a broadcast signal from an external broadcast management server through a broadcast channel or transmitting a broadcast signal to a broadcast management server. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal.

The processor 470 can control the overall operation of each unit of the communication device 400.

In accordance with an embodiment, the communication device 400 may include a plurality of processors 470 or may not include a processor 470. [

When the processor 400 is not included in the communication device 400, the communication device 400 can be operated under the control of the processor or the control unit 170 of another apparatus in the vehicle 100. [

On the other hand, the communication device 400 can implement the vehicle display device together with the user interface device 200. [ In this case, the vehicle display device can be named as a telematics device or an AVN (Audio Video Navigation) device.

The communication device 400 may be operated under the control of the control unit 170. [

The driving operation device 500 is a device for receiving a user input for operation.

In the manual mode, the vehicle 100 can be operated on the basis of the signal provided by the driving operation device 500.

The driving operation device 500 may include a steering input device 510, an acceleration input device 530, and a brake input device 570.

The steering input device 510 may receive a forward direction input of the vehicle 100 from a user. The steering input device 510 is preferably formed in a wheel shape so that steering input is possible by rotation. According to an embodiment, the steering input device may be formed as a touch screen, a touch pad, or a button.

The acceleration input device 530 may receive an input for acceleration of the vehicle 100 from a user. The brake input device 570 can receive an input for deceleration of the vehicle 100 from the user. The acceleration input device 530 and the brake input device 570 are preferably formed in a pedal shape. According to an embodiment, the acceleration input device or the brake input device may be formed as a touch screen, a touch pad, or a button.

The driving operation device 500 can be operated under the control of the control unit 170. [

The vehicle driving device 600 is an apparatus for electrically controlling the driving of various devices in the vehicle 100. [

The vehicle driving apparatus 600 includes a power train driving unit 610, a chassis driving unit 620, a door / window driving unit 630, a safety driving unit 640, a lamp driving unit 650 and an air conditioning driving unit 660 .

According to the embodiment, the vehicle drive system 600 may further include other elements other than the described elements, or may not include some of the elements described.

On the other hand, the vehicle drive apparatus 600 may include a processor. Each unit of the vehicle drive apparatus 600 may individually include a processor.

The power train driving unit 610 can control the operation of the power train apparatus.

The power train driving unit 610 may include a power source driving unit 611 and a transmission driving unit 612.

The power source drive unit 611 can perform control on the power source of the vehicle 100. [

For example, when the fossil fuel-based engine is a power source, the power source drive unit 610 can perform electronic control of the engine. Thus, the output torque of the engine and the like can be controlled. The power source drive unit 611 can adjust the engine output torque under the control of the control unit 170. [

For example, when the electric energy based motor is a power source, the power source driving unit 610 can perform control on the motor. The power source drive unit 610 can adjust the rotation speed, torque, and the like of the motor under the control of the control unit 170. [

The transmission drive unit 612 can perform control on the transmission.

The transmission drive unit 612 can adjust the state of the transmission. The transmission drive unit 612 can adjust the state of the transmission to forward (D), reverse (R), neutral (N), or parking (P).

On the other hand, when the engine is a power source, the transmission drive unit 612 can adjust the gear engagement state in the forward (D) state.

The chassis driving unit 620 can control the operation of the chassis apparatus.

The chassis driving unit 620 may include a steering driving unit 621, a brake driving unit 622, and a suspension driving unit 623.

The steering driver 621 may perform electronic control of the steering apparatus in the vehicle 100. [ The steering driver 621 can change the traveling direction of the vehicle.

The brake driver 622 can perform electronic control of the brake apparatus in the vehicle 100. [ For example, it is possible to reduce the speed of the vehicle 100 by controlling the operation of the brakes disposed on the wheels.

On the other hand, the brake driver 622 can individually control each of the plurality of brakes. The brake driving unit 622 can control the braking forces applied to the plurality of wheels to be different from each other.

The suspension driving unit 623 can perform electronic control on a suspension apparatus in the vehicle 100. [ For example, when there is a curvature on the road surface, the suspension driving unit 623 can control the suspension device so as to reduce the vibration of the vehicle 100. [

On the other hand, the suspension driving unit 623 can individually control each of the plurality of suspensions.

The door / window driving unit 630 may perform electronic control of a door apparatus or a window apparatus in the vehicle 100.

The door / window driving unit 630 may include a door driving unit 631 and a window driving unit 632.

The door driving unit 631 can control the door device. The door driving unit 631 can control the opening and closing of a plurality of doors included in the vehicle 100. [ The door driving unit 631 can control the opening or closing of a trunk or a tail gate. The door driving unit 631 can control the opening or closing of the sunroof.

The window driving unit 632 may perform an electronic control on a window apparatus. It is possible to control the opening or closing of the plurality of windows included in the vehicle 100. [

The safety device driving unit 640 can perform electronic control of various safety apparatuses in the vehicle 100. [

The safety device driving unit 640 may include an airbag driving unit 641, a seat belt driving unit 642, and a pedestrian protection device driving unit 643. [

The airbag driver 641 may perform electronic control of the airbag apparatus in the vehicle 100. [ For example, the airbag driver 641 can control the deployment of the airbag when a danger is detected.

The seat belt driving portion 642 can perform electronic control on the seat belt appartus in the vehicle 100. [ For example, the seat belt driving portion 642 can control the passenger to be fixed to the seats 110FL, 110FR, 110RL, and 110RR using the seat belt when a danger is detected.

The pedestrian protection device driving section 643 can perform electronic control on the hood lift and the pedestrian airbag. For example, the pedestrian protection device driving section 643 can control the hood lift-up and the pedestrian airbag deployment when a collision with a pedestrian is detected.

The lamp driving unit 650 can perform electronic control of various lamp apparatuses in the vehicle 100. [

The air conditioning driving unit 660 can perform electronic control on the air conditioner in the vehicle 100. [ For example, when the temperature inside the vehicle is high, the air conditioning driving unit 660 can control the air conditioner to operate so that the cool air is supplied to the inside of the vehicle.

The vehicle drive apparatus 600 may include a processor. Each unit of the vehicle drive apparatus 600 may individually include a processor.

The vehicle drive apparatus 600 can be operated under the control of the control section 170. [

The operating system 700 is a system for controlling various operations of the vehicle 100. [ The travel system 700 can be operated in the autonomous mode.

The travel system 700 may include a travel system 710, an outbound system 740, and a parking system 750.

According to the embodiment, the travel system 700 may further include other components than the components described, or may not include some of the components described.

On the other hand, the travel system 700 may include a processor. Each unit of the travel system 700 may each include a processor individually.

Meanwhile, according to the embodiment, when the driving system 700 is implemented in software, it may be a sub-concept of the control unit 170.

According to the embodiment, the operating system 700 includes at least one of the user interface device 200, the object detecting device 300, the communication device 400, the vehicle driving device 600, and the control unit 170 It can be a concept that includes.

The traveling system 710 can perform traveling of the vehicle 100. [

The navigation system 710 can receive navigation information from the navigation system 770 and provide a control signal to the vehicle drive system 600 to perform the travel of the vehicle 100. [

The traveling system 710 can receive the object information from the object detecting apparatus 300 and provide the vehicle driving apparatus 600 with a control signal to perform the traveling of the vehicle 100. [

The traveling system 710 can receive the signal from the external device through the communication device 400 and provide a control signal to the vehicle driving device 600 to perform the traveling of the vehicle 100. [

The departure system 740 can perform the departure of the vehicle 100.

The outpost system 740 can receive navigation information from the navigation system 770 and provide control signals to the vehicle driving apparatus 600 to perform the departure of the vehicle 100. [

The departure system 740 can receive object information from the object detecting apparatus 300 and provide a control signal to the vehicle driving apparatus 600 to carry out the departure of the vehicle 100. [

The departure system 740 can receive a signal from the external device via the communication device 400 and provide a control signal to the vehicle driving device 600 to perform the departure of the vehicle 100. [

The parking system 750 can perform parking of the vehicle 100. [

The parking system 750 may receive navigation information from the navigation system 770 and provide a control signal to the vehicle driving device 600 to perform parking of the vehicle 100. [

The parking system 750 is capable of performing parking of the vehicle 100 by receiving object information from the object detecting apparatus 300 and providing a control signal to the vehicle driving apparatus 600. [

The parking system 750 can receive the signal from the external device via the communication device 400 and provide a control signal to the vehicle driving device 600 to perform parking of the vehicle 100. [

The navigation system 770 may provide navigation information. The navigation information may include at least one of map information, set destination information, route information according to the destination setting, information about various objects on the route, lane information, and current location information of the vehicle.

The navigation system 770 may include a memory, a processor. The memory can store navigation information. The processor may control the operation of the navigation system 770.

According to an embodiment, the navigation system 770 can receive information from an external device via the communication device 400 and update the stored information.

According to an embodiment, the navigation system 770 may be classified as a subcomponent of the user interface device 200.

The sensing unit 120 can sense the state of the vehicle. The sensing unit 120 may include a sensor such as a yaw sensor, a roll sensor, a pitch sensor, a collision sensor, a wheel sensor, a velocity sensor, A sensor, a weight sensor, a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward / backward sensor, a battery sensor, A vehicle interior temperature sensor, an internal humidity sensor, an ultrasonic sensor, an illuminance sensor, an accelerator pedal position sensor, a brake pedal position sensor, and the like.

The sensing unit 120 is configured to generate the sensing information based on the vehicle attitude information, the vehicle collision information, the vehicle direction information, the vehicle position information (GPS information), the vehicle angle information, the vehicle speed information, Obtain a sensing signal for information, fuel information, tire information, vehicle lamp information, vehicle interior temperature information, vehicle interior humidity information, steering wheel rotation angle, vehicle exterior illumination, pressure applied to the accelerator pedal, pressure applied to the brake pedal, can do.

The sensing unit 120 may further include an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor AFS, an intake air temperature sensor ATS, a water temperature sensor WTS, (TPS), a TDC sensor, a crank angle sensor (CAS), and the like.

The interface unit 130 may serve as a pathway to various kinds of external devices connected to the vehicle 100. For example, the interface unit 130 may include a port that can be connected to the mobile terminal, and may be connected to the mobile terminal through the port. In this case, the interface unit 130 can exchange data with the mobile terminal.

Meanwhile, the interface unit 130 may serve as a channel for supplying electrical energy to the connected mobile terminal. When the mobile terminal is electrically connected to the interface unit 130, the interface unit 130 may provide the mobile terminal with electric energy supplied from the power supply unit 190 under the control of the controller 170.

The memory 140 is electrically connected to the control unit 170. The memory 140 may store basic data for the unit, control data for controlling the operation of the unit, and input / output data. The memory 140 may be, in hardware, various storage devices such as ROM, RAM, EPROM, flash drive, hard drive, and the like. The memory 140 may store various data for operation of the vehicle 100, such as a program for processing or controlling the controller 170. [

According to the embodiment, the memory 140 may be formed integrally with the controller 170 or may be implemented as a subcomponent of the controller 170. [

The control unit 170 can control the overall operation of each unit in the vehicle 100. [ The control unit 170 may be referred to as an ECU (Electronic Control Unit).

The power supply unit 190 can supply power necessary for the operation of each component under the control of the control unit 170. Particularly, the power supply unit 190 can receive power from a battery or the like inside the vehicle.

One or more processors and controls 170 included in vehicle 100 may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs) field programmable gate arrays, processors, controllers, micro-controllers, microprocessors, and other electrical units for performing other functions.

The sensor information may include a type of a sensor mounted on the vehicle 100. [ The type of the sensor may include a sensor mounted on the sensing part 125 of the vehicle and a sensor mounted on the object sensing part 160 of the vehicle. The type of sensor may also include a sensor that the user additionally attaches to the vehicle.

3 to 4, the mobile terminal 900 includes a wireless communication unit 910, an input unit 920, a sensing unit 940, an output unit 950, an interface unit 960, a memory 970, A wireless charging unit 971, a control unit 980, a power supply unit 990, and the like. The components shown in FIG. 4 are not essential for implementing a mobile terminal, so that the mobile terminal described herein may have more or fewer components than the components listed above.

The wireless communication unit 910 may be connected between the mobile terminal 900 and the wireless communication system or between the mobile terminal 900 and another mobile terminal 900 or between the mobile terminal 900 and the external server 900. [ Lt; RTI ID = 0.0 > wireless < / RTI > In addition, the wireless communication unit 910 may include one or more modules that connect the mobile terminal 900 to one or more networks.

The wireless communication unit 910 may include at least one of a broadcast receiving module 911, a mobile communication module 912, a wireless Internet module 913, a local communication module 914, and a location information module 915 .

The wireless communication unit 910 can communicate with an external electronic device to exchange data. For example, the wireless communication unit 910 can be connected to a broadcasting company server to receive broadcasting contents. For example, the wireless communication unit 910 may be connected to a traffic information providing server and receive TPEG (Transport Protocol Experts Group) information.

The input unit 920 includes a camera 921 or a video input unit for inputting a video signal, a microphone 922 for inputting an audio signal, or an audio input unit, a user input unit 923 for receiving information from a user A touch key, a mechanical key, and the like). The voice data or the image data collected by the input unit 920 may be analyzed and processed by the user's control command.

The sensing unit 940 may include at least one sensor for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 940 may include a proximity sensor 941, an illumination sensor 942, a touch sensor, an acceleration sensor, a magnetic sensor, A G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, A microphone 2222, a battery gauge, an environmental sensor (e.g., a barometer, a hygrometer, a thermometer, a radiation detection sensor, A thermal sensor, a gas sensor, etc.), a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification can combine and utilize information sensed by at least two of the sensors.

The output unit 950 includes at least one of a display unit 951, an acoustic output unit 952, a haptrip module 953, and a light output unit 954 to generate an output related to visual, auditory, can do. The display unit 951 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. The touch screen may function as a user input unit 923 that provides an input interface between the mobile terminal 900 and the user and may provide an output interface between the mobile terminal 900 and the user.

The interface unit 960 serves as a channel with various types of external devices connected to the mobile terminal 900. The interface unit 960 is connected to a device having a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, And may include at least one of a port, an audio I / O port, a video I / O port, and an earphone port. In the mobile terminal 900, corresponding to the connection of the external device to the interface unit 960, the mobile terminal 900 can perform appropriate control related to the connected external device.

In addition, the memory 970 stores data supporting various functions of the mobile terminal 900. The memory 970 may store a plurality of application programs or applications running on the mobile terminal 900, data for operation of the mobile terminal 900, and commands. At least some of these applications may be downloaded from an external server via wireless communication. At least some of these application programs may exist on the mobile terminal 900 from the time of shipment for basic functions of the mobile terminal 900 (e.g., telephone call reception, calling function, message reception, and calling function). The application program may be stored in the memory 970 and installed on the mobile terminal 900 and may be operated by the control unit 980 to perform the operation (or function) of the mobile terminal.

The control unit 980 typically controls the overall operation of the mobile terminal 900 in addition to the operations associated with the application program. The control unit 980 may process or process signals, data, information, and the like input or output through the above-described components, or may drive an application program stored in the memory 970 to provide or process appropriate information or functions to the user.

In addition, the controller 980 may control at least some of the components illustrated in FIG. 4 in order to drive an application program stored in the memory 970. In addition, the controller 980 can operate at least two of the components included in the mobile terminal 900 in combination with each other for driving the application program.

The controller 980 may be implemented in hardware as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs) processors, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions.

Under the control of the control unit 980, the power supply unit 990 receives power from the external power source and supplies power to the respective components included in the mobile terminal 900. The power supply unit 990 includes a battery, which may be an internal battery or a replaceable battery.

At least some of the components may operate in cooperation with one another to implement a method of operation, control, or control of a mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 970.

Hereinafter, the components listed above will be described in more detail with reference to FIG. 4 before explaining various embodiments implemented through the mobile terminal 900 as described above.

First, referring to the wireless communication unit 910, the broadcast receiving module 911 of the wireless communication unit 910 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 900 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The mobile communication module 912 may be a mobile communication module or a mobile communication module capable of communicating with a mobile communication device through a communication network such as a mobile communication network, (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution And an external terminal, or a server on a mobile communication network established according to a long term evolution (AR), a long term evolution (AR), or the like.

The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 913 is a module for wireless Internet access, and may be embedded in the mobile terminal 900 or externally. The wireless Internet module 913 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) 913 send and receive data according to at least one wireless Internet technology, including Internet technologies not listed above.

The wireless Internet module 913 for performing a wireless Internet connection through the mobile communication network may be used for wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE or LTE- May be understood as a kind of the mobile communication module 912.

The short-range communication module 914 is for short-range communication. The short-range communication module 914 may be a Bluetooth ™, a Radio Frequency Identification (RFID), an Infrared Data Association (IrDA), an Ultra Wideband (UWB), a ZigBee, (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The local area communication module 914 may be connected to the mobile terminal 900 and the wireless communication system through the wireless area networks or between the mobile terminal 900 and another mobile terminal 900 or between the mobile terminal 900 ) And another mobile terminal 200 (or an external server). The short-range wireless communication network may be a short-range wireless personal area network.

Herein, another mobile terminal 900 is a wearable device (e.g., a smartwatch, a smart glass, etc.) capable of interchanging data with the mobile terminal 900 according to the present invention (smart glass), HMD (head mounted display)). The short range communication module 914 can detect (or recognize) a wearable device capable of communicating with the mobile terminal 900 around the mobile terminal 900. [ If the detected wearable device is a device authenticated to communicate with the mobile terminal 900 according to the present invention, the control unit 980 may transmit at least a part of the data processed by the mobile terminal 900 to the short- 914 to the wearable device. Therefore, the user of the wearable device can use the data processed by the mobile terminal 900 through the wearable device. For example, according to this, when a telephone is received in the mobile terminal 900, the user performs a telephone conversation via the wearable device, or when a message is received in the mobile terminal 900, It is possible to check the message.

The location information module 915 is a module for obtaining the location (or current location) of the mobile terminal, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, it can acquire the position of the mobile terminal by using a signal transmitted from the GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, it can acquire the position of the mobile terminal based on information of a wireless access point (AP) that transmits or receives the wireless signal with the Wi-Fi module. Optionally, the location information module 915 may perform any of the other functions of the wireless communication unit 910 to obtain data regarding the location of the mobile terminal, in addition or in addition. The location information module 915 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 920 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For inputting image information, Or a plurality of cameras 921. The camera 921 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 951 or stored in the memory 970. [ A plurality of cameras 921 provided in the mobile terminal 900 may be arranged to have a matrix structure and various angles or foci may be provided to the mobile terminal 900 through a camera 921 having a matrix structure A plurality of pieces of image information can be input. In addition, the plurality of cameras 921 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 922 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or a running application program) being executed in the mobile terminal 900. [ Meanwhile, various noise elimination algorithms may be implemented in the microphone 922 to remove noise generated in receiving an external sound signal.

The user input unit 923 is used to receive information from the user. When information is input through the user input unit 923, the control unit 980 can control the operation of the mobile terminal 900 to correspond to the input information . The user input unit 923 may include a mechanical input means (or a mechanical key such as a button located on the side of the transmission cap or side of the mobile terminal 900, a dome switch, , Jog switches, etc.) and touch-type input means. For example, the touch-type input means may comprise a virtual key, a soft key or a visual key displayed on the touch screen through software processing, The virtual key or the visual key can be displayed on the touch screen with various forms. For example, the virtual key or the visual key can be displayed on the touch screen, ), An icon, a video, or a combination thereof.

Meanwhile, the sensing unit 940 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a corresponding sensing signal. The control unit 980 may control the driving or operation of the mobile terminal 900 or may perform data processing, function or operation related to the application program installed in the mobile terminal 900 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 940 will be described in more detail.

First, the proximity sensor 941 refers to a sensor that detects the presence of an object approaching a predetermined detection surface, or the presence of an object in the vicinity of the detection surface, without mechanical contact by using electromagnetic force or infrared rays. The proximity sensor 941 may be disposed in an inner region of the mobile terminal or in proximity to the touch screen, which is enclosed by the touch screen.

Examples of the proximity sensor 941 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is electrostatic, the proximity sensor 941 can be configured to detect the proximity of the object with a change of the electric field along the proximity of the object having conductivity. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the act of recognizing that the object is located on the touch screen in proximity with no object touching the touch screen is referred to as "proximity touch & The act of actually touching an object on the screen is called a "contact touch. &Quot; The position at which the object is closely touched on the touch screen means a position where the object corresponds to the touch screen vertically when the object is touched. The proximity sensor 941 can detect proximity touches and proximity touch patterns (e.g., proximity touch distance, proximity touch direction, proximity touch rate, proximity touch time, proximity touch location, proximity touch movement state, have. The control unit 980 processes the data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 941 as described above, and further provides visual information corresponding to the processed data It can be output on the touch screen. Further, the control unit 980 can control the mobile terminal 900 such that different operations or data (or information) are processed depending on whether the touch to the same point on the touch screen is a proximity touch or a contact touch .

(Or touch input) applied to the touch screen (or the display unit 951) by using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, Detection.

For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the touch screen or a capacitance generated in a specific portion to an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, a capacitance at the time of touch, and the like where a touch object touching the touch screen is touched on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits corresponding data to the controller 980. Accordingly, the control unit 980 can know which area of the display unit 951 is touched or the like. Here, the touch controller may be a separate component from the control unit 980, and may be the control unit 980 itself.

On the other hand, the control unit 980 can perform different controls or perform the same control according to the type of the touch object, which touches the touch screen (or a touch key provided on the touch screen). Whether to perform different controls or to perform the same control according to the type of the touch object may be determined according to the current state of the mobile terminal 900 or an application program being executed.

On the other hand, the touch sensors and the proximity sensors discussed above can be used independently or in combination to provide a short touch (touch), a long touch, a multi touch, a drag touch ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, and the like. Touch can be sensed.

The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. On the other hand, the controller 980 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera 921 includes at least one of a camera sensor (for example, a CCD, a CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 921 and the laser sensor may be combined with each other to sense a touch of the sensing object with respect to the three-dimensional stereoscopic image. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.

The display unit 951 displays (outputs) information to be processed by the mobile terminal 900. For example, the display unit 951 may display execution screen information of an application program driven by the mobile terminal 900, or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

In addition, the display unit 951 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system) can be applied.

The audio output unit 952 may receive audio data received from the wireless communication unit 910 or stored in the memory 970 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 952 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 900. [ The sound output unit 952 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 953 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 953 may be vibration. The intensity and pattern of the vibration generated in the haptic module 953 can be controlled by the user's selection or the setting of the control unit. For example, the haptic module 953 may synthesize and output different vibrations or sequentially output the vibrations.

In addition to vibration, the haptic module 953 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 953 can not only transmit the tactile effect through direct contact but also can be implemented so that the user can feel the tactile effect through the muscles of the finger or arm. At least two haptic modules 953 may be provided according to the configuration of the mobile terminal 900.

The light output unit 954 outputs a signal for notifying the occurrence of an event using the light of the light source of the mobile terminal 900. Examples of events that occur in the mobile terminal 900 may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output by the optical output unit 954 is implemented as the mobile terminal emits light of a single color or a plurality of colors to the front or rear surface. The signal output may be terminated by the mobile terminal detecting the event confirmation of the user.

The interface unit 960 serves as a path to all the external devices connected to the mobile terminal 900. The interface unit 960 receives data from an external device or supplies power to each component in the mobile terminal 900 or allows data in the mobile terminal 900 to be transmitted to an external device. For example, a port for connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, an audio I / O port, a video I / O port, an earphone port, and the like may be included in the interface unit 960.

The identification module is a chip for storing various information for authenticating the usage right of the mobile terminal 900 and includes a user identification module (UIM), a subscriber identity module (SIM) A universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Therefore, the identification device can be connected to the terminal 900 through the interface unit 960.

The interface unit 960 may be a path through which power from the cradle is supplied to the mobile terminal 900 when the mobile terminal 900 is connected to an external cradle, And various command signals may be transmitted to the mobile terminal 900. The various command signals or the power from the cradle can be operated as a signal for recognizing that the mobile terminal 900 is correctly mounted on the cradle.

The memory 970 may store a program for the operation of the controller 980 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 970 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 970 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read memory, a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and / or an optical disk. The mobile terminal 900 may operate in association with a web storage that performs the storage function of the memory 970 on the Internet.

The wireless charging unit 971 receives electrical energy from the vehicle wirelessly when the mobile terminal 900 is electromagnetically coupled to the vehicle 100. [ The wireless charging unit 971 charges the battery using the supplied electric energy. In this case, the wireless charger 971 can receive electric energy from the vehicle 100 through an inductively coupled system or a resonant coupled system.

In the inductive coupling method, when the intensity of the current flowing in the primary coil of two adjacent coils is changed, the magnetic field is changed by the current, and thereby the secondary coil passes through the coil The magnetic flux is changed and an induced electromotive force is generated on the secondary coil side. That is, according to this method, induction electromotive force is generated when only the current of the primary coil is changed while keeping the two coils close to each other without moving the two conductors spatially. In this case, the frequency characteristic is not largely affected, but the arrangement between the transmitting apparatus including each coil (for example, a wireless charging apparatus of a vehicle) and the receiving apparatus (for example, mobile terminal) And the distance (Distance).

On the other hand, the resonance coupling method is a method in which a resonance frequency is applied to a primary coil of two coils spaced apart by a certain distance, And the induced electromotive force is generated in the secondary coil by being applied to the coil. That is, according to this method, when the transmitting and receiving devices resonate at the same frequency, the electromagnetic waves are transmitted through the near-field electromagnetic field, so that there is no energy transmission when the frequencies are different. In this case, the choice of frequency can be an important issue. Since there is no energy transfer between the resonance frequencies separated by a predetermined distance or more, the device to be charged can be selected through the resonance frequency selection. If only one device is assigned to one resonance frequency, the selection of the resonance frequency may have the meaning of selecting the device to be charged soon.

Compared to the inductive coupling method, the resonance coupling method has an advantage that the alignment and the distance between the transmitting device and the receiving device including each coil have a relatively less effect on the power efficiency.

Meanwhile, as described above, the control unit 980 controls an operation related to an application program and an overall operation of the mobile terminal 900. [ For example, the control unit 980 may execute or release a lock state for restricting input of a user's control command to applications if the state of the mobile terminal meets a set condition.

In addition, the control unit 980 performs control and processing related to voice communication, data communication, video call, or the like, or performs pattern recognition processing that can recognize handwriting input or drawing input performed on the touch screen as characters and images, respectively . Further, the control unit 980 may control any one or a plurality of the above-described components in order to implement various embodiments described below on the mobile terminal 900 according to the present invention.

The power supply unit 990 receives external power and internal power under the control of the controller 980 and supplies power required for operation of the respective components. The power supply unit 990 includes a battery, the battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 990 may include a connection port, and the connection port may be configured as an example of an interface 960 through which an external charger for supplying power for charging the battery is electrically connected.

As another example, the power supply 990 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 990 may use at least one of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission apparatus or a magnetic resonance coupling method based on an electromagnetic resonance phenomenon Power can be delivered.

In the following, various embodiments may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

Referring to FIG. 3, the disclosed mobile terminal 900 includes a bar-shaped terminal body. However, the present invention is not limited thereto and can be applied to various structures such as a folder type, a flip type, a slide type, a swing type, and a swivel type in which a watch type, a clip type, a glass type or two or more bodies are relatively movably coupled . A description of a particular type of mobile terminal, although relevant to a particular type of mobile terminal, is generally applicable to other types of mobile terminals.

Herein, the terminal body can be understood as a concept of referring to the mobile terminal 900 as at least one aggregate.

The mobile terminal 900 includes a case (e.g., a frame, a housing, a cover, etc.) which forms an appearance. As shown, the mobile terminal 900 may include a front case 901 and a rear case 902. Various electronic components are disposed in the inner space formed by the combination of the front case 901 and the rear case 902. At least one middle case may be additionally disposed between the front case 901 and the rear case 902. [

A display unit 951 is disposed on a front surface of the terminal body to output information. The window 951a of the display unit 951 may be mounted on the front case 901 to form a front surface of the terminal body together with the front case 901. [

In some cases, electronic components may be mounted on the rear case 902 as well. The electronic parts that can be mounted on the rear case 902 include a detachable battery, an identification module, a memory card, and the like. In this case, a rear cover 903 for covering the mounted electronic component can be detachably coupled to the rear case 902. [ Therefore, when the rear cover 903 is separated from the rear case 902, the electronic parts mounted on the rear case 902 are exposed to the outside.

As shown, when the rear cover 903 is coupled to the rear case 902, a side portion of the rear case 902 can be exposed. In some cases, the rear case 902 may be completely covered by the rear cover 903 during the engagement. Meanwhile, the rear cover 903 may be provided with an opening for exposing the camera 921b and the sound output unit 952b to the outside.

These cases 901, 902 and 903 may be formed by injection molding of synthetic resin or may be formed of metal such as stainless steel (STS), aluminum (Al), titanium (Ti) or the like.

The mobile terminal 900 may be configured such that one case provides the internal space, unlike the above example where a plurality of cases provide an internal space for accommodating various electronic components. In this case, a universal mobile terminal 900 in which synthetic resin or metal is connected from the side to the rear side can be realized.

Meanwhile, the mobile terminal 900 may include a waterproof portion (not shown) for preventing water from penetrating into the terminal body. For example, the waterproof portion is provided between the window 951a and the front case 901, between the front case 901 and the rear case 902, or between the rear case 902 and the rear cover 903, And a waterproof member for sealing the inside space of the oven.

The mobile terminal 900 is provided with a display unit 951, first and second sound output units 952a and 952b, a proximity sensor 941, an illuminance sensor 942, a light output unit 954, Cameras 921a and 921b, first and second operation units 923a and 923b, a microphone 922, an interface unit 960, and the like.

3, a display unit 951, a first sound output unit 952a, a proximity sensor 941, a light intensity sensor 942, a light output unit 954, A second operation unit 923b, a microphone 922 and an interface unit 960 are disposed on the side surface of the terminal body and the first camera 921a and the first operation unit 923a are disposed on the rear surface of the terminal body. The mobile terminal 900 having the second sound output unit 952b and the second camera 921b will be described as an example.

However, these configurations are not limited to this arrangement. These configurations may be excluded or replaced as needed, or placed on different planes. For example, the first operation unit 923a may not be provided on the front surface of the terminal body, and the second sound output unit 952b may be provided on the side surface of the terminal body rather than the rear surface of the terminal body.

The display unit 951 displays (outputs) information to be processed by the mobile terminal 900. For example, the display unit 951 may display execution screen information of an application program driven by the mobile terminal 900, or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

The display unit 951 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) display, a 3D display, and an e-ink display.

In addition, the display unit 951 may exist in two or more depending on the implementation of the mobile terminal 900. [ In this case, the mobile terminal 900 may be provided with a plurality of display portions which are spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces, respectively.

The display unit 951 may include a touch sensor that senses a touch to the display unit 951 so that a control command can be received by a touch method. When a touch is made to the display unit 951, the touch sensor senses the touch, and the control unit 980 generates a control command corresponding to the touch based on the touch. The content input by the touch method may be a letter or a number, an instruction in various modes, a menu item which can be designated, and the like.

On the other hand, the touch sensor is formed in the form of a film having a touch pattern and disposed between the window 951a and a display (not shown) on the back side of the window 951a, or a metal wire . Alternatively, the touch sensor may be formed integrally with the display. For example, the touch sensor may be disposed on a substrate of the display or inside the display.

As described above, the display unit 951 can form a touch screen together with the touch sensor. In this case, the touch screen can function as a user input unit 923 (see FIG. 3A). In some cases, the touch screen may replace at least some functions of the first operation unit 923a.

The first sound output unit 952a may be implemented as a receiver for transmitting a call sound to a user's ear and the second sound output unit 952b may be implemented as a loud speaker for outputting various alarm sounds or multimedia playback sounds. ). ≪ / RTI >

The window 951a of the display unit 951 may be provided with an acoustic hole for emitting the sound generated from the first acoustic output unit 952a. However, the present invention is not limited to this, and the sound may be configured to be emitted along an assembly clearance (for example, a gap between the window 951a and the front case 901) between the structures. In this case, the appearance of the mobile terminal 900 can be made simpler because the holes independently formed for the apparent acoustic output are hidden or hidden.

The light output unit 954 is configured to output light for notifying the occurrence of an event. Examples of the event include a message reception, a call signal reception, a missed call, an alarm, a schedule notification, an email reception, and reception of information through an application. The control unit 980 may control the light output unit 954 to terminate the light output when the event confirmation of the user is detected.

The first camera 921a processes an image frame of a still image or moving image obtained by the image sensor in the photographing mode or the video communication mode. The processed image frame may be displayed on the display portion 951 and stored in the memory 970. [

The first and second operation units 923a and 923b may be collectively referred to as a manipulating portion as an example of a user input unit 923 operated to receive a command for controlling the operation of the mobile terminal 900 have. The first and second operation units 923a and 923b can be employed in any manner as long as the user is in a tactile manner such as touching, pushing, or scrolling. In addition, the first and second operation units 923a and 923b can be employed in a manner such that they are operated without a tactile feeling of the user through proximity touch, hovering touch, or the like.

In the drawing, the first operation unit 923a is a touch key, but the present invention is not limited thereto. For example, the first operation unit 923a may be a mechanical key or a combination of a touch key and a touch key.

The contents input by the first and second operation units 923a and 923b can be variously set. For example, the first operation unit 923a receives a command such as a menu, a home key, a cancellation, a search, and the like, and the second operation unit 923b receives a command from the first or second sound output unit 952a or 952b The size of the sound, and the switch to the touch recognition mode of the display unit 951 can be input.

Meanwhile, a rear input unit (not shown) may be provided on the rear surface of the terminal body as another example of the user input unit 923. The rear input unit is operated to receive a command for controlling the operation of the mobile terminal 900, and input contents can be variously set. For example, commands such as power on / off, start, end, scrolling, and the like, the size adjustment of sound output from the first and second sound output units 952a and 952b, and the touch recognition mode of the display unit 951 And the like can be inputted. The rear input unit may be implemented as a touch input, a push input, or a combination thereof.

The rear input unit may be disposed so as to overlap the front display unit 951 in the thickness direction of the terminal body. For example, the rear input unit may be disposed at the rear upper end of the terminal body such that when the user holds the terminal body with one hand, the rear input unit can be easily operated using the index finger. However, the present invention is not limited thereto, and the position of the rear input unit may be changed.

When a rear input unit is provided on the rear surface of the terminal body, a new type of user interface using the rear input unit can be realized. When the first operation unit 923a is not disposed on the front surface of the terminal body in place of at least a part of the functions of the first operation unit 923a provided on the front surface of the terminal body, The display unit 951 may be configured as a larger screen.

Meanwhile, the mobile terminal 900 may include a fingerprint recognition sensor for recognizing the fingerprint of the user, and the controller 980 may use the fingerprint information sensed through the fingerprint recognition sensor as authentication means. The fingerprint recognition sensor may be embedded in the display unit 951 or the user input unit 923. [

The microphone 922 is configured to receive the user's voice, other sounds, and the like. The microphone 922 may be provided at a plurality of locations to receive stereophonic sound.

The interface unit 960 is a path through which the mobile terminal 900 can be connected to an external device. For example, the interface unit 960 may include a connection terminal for connection with another device (e.g., earphone, external speaker), a port for short-range communication (e.g., an infrared port (IrDA Port), a Bluetooth port A wireless LAN port, or the like), or a power supply terminal for supplying power to the mobile terminal 900. The interface unit 960 may be implemented as a socket for receiving an external card such as a Subscriber Identification Module (SIM) or a User Identity Module (UIM), a memory card for information storage, and the like.

5 is a flowchart referred to explain a message receiving operation of the vehicle user interface device according to the embodiment of the present invention.

Referring to FIG. 5, the processor 270 grasps the location information included in the message based on the message, matches the icon corresponding to the location information of the message with the map, and outputs the map to the display . And may transmit the message generated in the second mobile terminal to the first mobile terminal (S510). The first mobile terminal may receive the message from the second mobile terminal, and may transmit the message to the vehicle interface device 200 (S520).

Meanwhile, the vehicle 100 performs a pairing operation with the first mobile terminal through the communication device 400. [ The vehicle 100 may perform the pairing with the first mobile terminal through the short-

For example, when the first mobile terminal exists in the vehicle 100, the vehicle 100 can perform the pairing operation with the first mobile terminal through the Bluetooth communication method.

Specifically, in a state in which the vehicle 100 is paired with the first mobile terminal, the vehicle interface apparatus 200 can receive a message from the first mobile terminal via the communication device 400. [

Processor 270 may be a microprocessor. The text included in the message and the location information of the second mobile terminal may be received (S530). The location information of the second mobile terminal may be GPS information indicating the location of the second mobile terminal when the second mobile terminal sends a message to the first mobile terminal.

The processor 270 may generate an icon corresponding to the message (S540). For example, the processor 270 may generate an icon corresponding to the second mobile terminal. The processor 270 may generate a text icon corresponding only to the text contained in the message.

The processor 270 may match the icon to the map corresponding to the location information of the second mobile terminal (S550). The processor 270 can set the map by a predetermined distance based on the current position information of the vehicle. The processor 270 may output the map to the display (S560).

6 is a flowchart referred to explain a message transmission / reception operation of a vehicle user interface device according to an embodiment of the present invention.

Referring to FIG. 6, the in-vehicle interface device 200 generates and transmits a first message including text and location information of a vehicle, and transmits, when a second message is received, a second message corresponding to the first message The information of the interest point included in the second message can be grasped and the interest point information can be output to the display.

 The processor 270 may generate a first message including location information and text of the vehicle (S610).

For example, when the first message is generated through the input unit 200 in a state of being paired with the first mobile terminal, the processor 270 may include a text corresponding to the user input in the message.

In addition, processor 270 may include the location of the vehicle in the first message, via a touch-and-drag input, corresponding to the user input.

For example, the processor 270 can receive a touch and drag input through the display unit by a user input through the input unit 200, thereby setting the position of the vehicle.

Processor 270 may include the text, location information, and interest information in a first message as a drag and drop input. Processor 270 may receive the location information via the TTS in a drag and drop state, and may include the location information in the first message.

The processor 270 may transmit the first message to the first mobile terminal via the communication device 400. The first mobile terminal may receive the first message to the second mobile terminal (S620). The second mobile terminal can receive the first message from the first mobile terminal (S630).

The second mobile terminal may generate a second message corresponding to the first message (S640).

For example, the second message may be a message corresponding to the first message. The second message may include text, point of interest information corresponding to the location information of the first mobile terminal.

The point-of-interest information may include main facilities such as a station, an airport, a terminal, a hotel, and the like within a predetermined distance in the location information, based on the location information of the first mobile terminal provided by the second mobile terminal. In addition, the point of interest information may include coordinates of the main facility. Also, the second message may include current location information of the second mobile terminal.

The second mobile terminal may transmit a second message to the first mobile terminal. The first mobile terminal may receive the second message (S650). The processor 270 may receive the second message from the first mobile terminal via the communication device 400. [ The processor 270 may receive the text included in the second message, the point of interest information (S660).

The processor 270 may display the text, the point-of-interest information on the display (S670). The processor 270 may display the text and the point-of-interest information in one area of the display unit 251. The processor 270 may control to display the graphic object corresponding to the interest information on the display unit.

7 is a flowchart referred to explain a map setting process according to a location of a second mobile terminal according to an embodiment of the present invention.

Referring to FIG. 7, the processor 270 may receive the current position information of the vehicle (S710). For example, the position information of the vehicle 100 may be received through the position information section 420 of the vehicle 100 have. Also, the location information of the first mobile terminal can be received through the GPS sensor of the first mobile terminal.

The processor 270 may set the range of the map within a predetermined distance based on the current position information of the vehicle (S720). In addition, the processor 270 may set the range of the map based on the input location information corresponding to the user input through the input unit 200. [

The processor 270 may match the icon to the map corresponding to the location information of the second mobile terminal (S730).

For example, if the location of the second mobile terminal is within a predetermined range based on the map, the processor 270 may match the icon of the second mobile terminal to the map.

Also, if the location of the second mobile terminal is out of a predetermined range based on the map, the processor 270 may not match the icon of the second mobile terminal to the map.

8 is a flowchart referred to explain a process of receiving a message to a user registered in a first mobile terminal according to an embodiment of the present invention.

Referring to FIG. 8, the processor 270 may receive a message from a second mobile terminal stored in the first mobile terminal (S810). The processor 270 may receive at least one of a message number and a message ID from a list registered in the first mobile terminal.

The processor 270 may generate an image or a corresponding icon stored in the first mobile terminal (S820). For example, the processor 270 may generate an icon based on the image corresponding to the second mobile terminal stored in the first mobile terminal.

In addition, when receiving a message from a second mobile terminal that is not registered in the first mobile terminal, the processor 270 may generate an icon corresponding to the second mobile terminal based on the predetermined image.

9 is a flowchart referred to explain a process of transmitting and receiving a message corresponding to a vehicle running state according to an embodiment of the present invention.

Referring to FIG. 9, the processor 270 may receive a message from a first mobile terminal.

The processor 270 may receive the speed information of the vehicle, the traveling state of the vehicle, and the traveling mode information of the vehicle (S910). The processor 270 may respond to the message based on at least one of speed information of the vehicle, traveling state of the vehicle, and traveling mode information of the vehicle. The processor 270 may determine whether the vehicle is in the private mode (S920).

In the private mode, the processor 270 may not display the message on the display. The processor 270 may generate a predetermined response message corresponding to the message (S925).

If the vehicle is not in the private mode, the processor 270 may determine whether the vehicle is in a traveling state (S930).

If the vehicle is not in a running state, the processor 270 may display the message on the display. The processor 270 may generate a response message corresponding to the message through the input unit 200.

If the vehicle is in the running state, the processor 270 may determine whether the vehicle is autonomously traveling (S940).

If the vehicle is in autonomous driving, then the processor 270 may display the message on the display if the vehicle is not in a running state. The processor 270 may generate a response message corresponding to the message through the input unit 200.

The processor 270 may determine whether the vehicle is a manual driving mode when the vehicle is not in the self-driving mode. If the vehicle is a manual cruise, the processor 270 may determine whether the vehicle speed is less than a predetermined speed (S950).

The processor 270 may display the message on the display if the vehicle speed is greater than or equal to the predetermined speed, if the vehicle is in autonomous driving, and the vehicle is not in the running state. The processor 270 may generate a response message corresponding to the message through the input unit 200.

When the speed of the vehicle is less than a predetermined speed, the processor 270 can control the voice output of the message through TTS (Text to Speech). The processor 270 may generate a response message corresponding to the message via the TTS. The processor 270 may store the response message in a queue (S955).

10 is a flowchart referred to in explaining an icon corresponding to point information of interest in an embodiment of the present invention.

Processor 270 may receive a second message including text and point of interest information. The processor 270 may generate an icon corresponding to the second message (S1010)

For example, the processor 270 may generate an icon according to the categories of major facilities included in the point of interest information, based on the point of interest information. The processor 270 may set the icon type and icon color corresponding to the point of interest information.

In addition, the processor 270 may generate an icon of the second message based on the image if the second message includes the image.

The processor 270 may match the icon to the map based on the vehicle location information (S1020).

The processor 270 may set a map within a predetermined range corresponding to the vehicle position information.

The processor 270 may receive the coordinates included in the point of interest information, and may match the icon corresponding to the second message with the map.

The processor 270 may display the icon on the display (S1030).

Processor 270 may receive user input via input 200 and select the icon. (S1040).

The processor 270 may display the point of interest information corresponding to the icon on the display (S1050).

11 is a flowchart referred to explain control for receiving TPEG information according to an embodiment of the present invention.

11,

The processor 270 may receive the TPEG information from the second mobile terminal via the first mobile terminal (S1110).

When the current position information of the second mobile terminal is included in the second message and the position of the second mobile terminal is within a predetermined range from the coordinates included in the point of interest information, TPEG information can be received

Processor 270 may also receive TPEG information from the server via communication device 400

The processor 270 may generate an icon corresponding to the TPEG information based on the point of interest information included in the second message (S1120).

For example, processor 270 may generate an icon corresponding to a category of TPEG information. The processor 270 may set the icon type and icon color corresponding to the TPEG information.

The processor 270 may output an icon corresponding to the TPEG information to the display (S1130)

For example, the processor 270 may display the icon in one area of the display 251. In addition, the processor 270 may match the icon to a map based on the vehicle location information.

Processor 270 may receive user input via input 200 and select the icon. (S1140). The processor 270 may receive a user input through the input unit 200 and receive a touch input to the display unit. Processor 270 may select an icon corresponding to the touch input.

The processor 270 may display the point of interest information corresponding to the icon on the display (S1150). The processor 270 may graphically process the point of interest information generated based on the TPEG to generate an information providing screen.

12 is a diagram for explaining how a message including location information is received and displayed on a display according to an embodiment of the present invention.

12,

The processor 270 may receive the message from the first mobile terminal 1220.

The message includes the location information and the text information of the second mobile terminal and the processor 270 transmits the message to the first mobile terminal 1220. [ The text included in the message, and the location information of the second mobile terminal.

The processor 270 may receive the location information of the second mobile terminal included in the message. The processor 270 may generate a text icon corresponding to the text information. The processor 270 may generate an icon corresponding to the second mobile terminal 1210. [ The processor 270 may display the icon on the entire map of the location information of the second mobile terminal.

For example, if the message is a message received from a second mobile terminal previously stored in the first mobile terminal 1220,

The processor 270 may display an image corresponding to the second mobile terminal 1210 stored in the first mobile terminal 1220 as an icon of the second mobile terminal.

If the message is a message received from the second mobile terminal 1210 that is not stored in the first mobile terminal 1220,

The processor 270 may list the second mobile terminal 1210 within a predetermined distance based on the location information included in the message. In addition, the processor 270 may generate an icon corresponding to the second mobile terminal that is not previously stored. The processor 270 may change the size of the icon in response to the number of responses to the pre-message or the satisfaction with the response.

The processor 270 can set the size of the map within a predetermined range based on the current position information of the vehicle.

The processor 270 may match the text icon and the icon of the second mobile terminal to the map in response to the location information of the second mobile terminal.

Processor 270 may display and display the map.

13 is a referenced diagram illustrating transmitting and receiving a message including location information according to an embodiment of the present invention.

13 is a diagram for transmitting a message including position information of a vehicle. 13, when the first message is transmitted to the first mobile terminal 1330 through the vehicle user interface device 1310, the processor 270 transmits a first message 1320 including text and location information of the vehicle Can be generated.

Processor 270 may send the first message 1320 to the first mobile terminal 1330. The first mobile terminal 1330 may transmit the first message 1320 from the second mobile terminal 1340.

When the second mobile terminal 1340 transmits the first message 1320 and responds with a second message 1350 corresponding to the first message, the second message 1350 includes the point of interest information .

Processor 270 may receive the second message 1350. The processor 270 may generate an icon corresponding to the point of interest information. The processor 270 may match the map 1360 based on the vehicle location information. Processor 270 may display the map 1360 on the display. Processor 270 may receive user input via input 200 and select the icon. The processor 270 may display the point of interest information corresponding to the icon on the display.

Figure 14 is a diagram referenced to illustrate receiving and displaying a TPEG corresponding to the information of interest, in accordance with an embodiment of the present invention.

14 is a diagram for transmitting a message including point of interest information. 14, when a first message 1420 including text, vehicle position information, and point of interest information is transmitted through the vehicle user interface device 1410, the processor 270 transmits the first message 1420 To the first mobile terminal 1430. The first mobile terminal may transmit the first message 1420 from the second mobile terminal 1440.

When the second mobile terminal 1440 transmits a second message corresponding to the first message 1420, the second message may include text, point of interest information, TPEG.

The processor 270 may receive the TPEG information corresponding to the point of interest information including the second message.

Processor 270 may generate an icon 1450 corresponding to the TPEG information. Processor 270 may display the icon in one area of the display.

The processor 270 may match the icon to the map 1460 set based on the vehicle position information when the icon is selected corresponding to the user input through the input unit 200. [ Processor 270 may display the map 1460 on the display.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). In addition, the computer may include a controller 180 or 280. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

100: vehicle
900: mobile terminal

Claims (10)

delete display;
A communication unit for performing pairing with the first mobile terminal;
Generating a first message including location information and text of the vehicle, transmitting the first message to the first mobile terminal,
When the first mobile terminal receives the corresponding second message of the first message from the second mobile terminal,
The mobile terminal receives text and interest point information corresponding to the location information included in the second message from the first mobile terminal,
A processor for displaying the text, the point of interest information on a display;
And the vehicle user interface device.
3. The method of claim 2,
The processor comprising:
Sets a range of the map within a predetermined distance based on the current position information of the vehicle, and matches the map with the icon of the second mobile terminal.
3. The method of claim 2,
The processor comprising:
When receiving the message from the second mobile terminal registered in the first mobile terminal,
And displays an icon corresponding to the second mobile terminal on the display.
3. The method of claim 2,
The processor comprising:
And displays the message on the display in accordance with at least one of speed information of the vehicle, state information of the vehicle, and mode information of the vehicle.
3. The method of claim 2,
The processor comprising:
Matches the icon corresponding to the point of interest information with a map based on the vehicle location information, and displays the map.
The method according to claim 6,
Further comprising: an input for receiving user input,
The processor comprising:
When the icon is selected corresponding to user input,
And displays the point of interest information corresponding to the selected icon on the display.
3. The method of claim 2,
The processor comprising:
From the second mobile terminal within a predetermined range based on the point of interest information,
And receiving the second message, TPEG (Transport Protocol Expert Group) information.
9. The method of claim 8,
The processor comprising:
And displays the TPEG information on the display based on the point of interest information.
An interworking system of a vehicle and a mobile terminal including a mobile terminal having a wireless communication unit and a vehicle user interface device,
The vehicle user interface device includes:
display;
A communication unit for performing pairing with the first mobile terminal;
Transmitting a first message including location information and text of the vehicle to the first mobile terminal,
When the first mobile terminal receives the corresponding second message of the first message,
And a processor for receiving text and interest point information corresponding to the location information included in the second message from the first mobile terminal and displaying the text and the point of interest information on a display, Interlocking system.

Images