KR101890620B1 - Mobile terminal and method for controlling a vehicle using the same - Google Patents

Abstract

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a mobile terminal, and more particularly, to a mobile terminal and a control method thereof capable of acquiring and controlling vehicle-related information and functions by being connected to a vehicle. According to an aspect of the present invention, there is provided a method of controlling a mobile terminal, the method comprising: communicating with a control device of a vehicle via a communication module; Receiving resource information including information of an active device connected to the control device and information of a passive device; Displaying a list of the passive devices on a touch screen; Selecting a first passive device from the displayed list; And a step in which the mobile terminal and the first passive device are paired.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a mobile terminal,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a mobile terminal, and more particularly, to a mobile terminal and a control method thereof capable of acquiring and controlling vehicle-related information and functions by being connected to a vehicle.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

2. Description of the Related Art [0002] In recent years, a display device is provided in a vehicle, and not only conventional radio or air conditioner control is performed, but also navigation and output functions of multimedia contents are provided. Also, the mobile terminal may be connected to the display device by wire / wireless, and the content stored in the mobile terminal may be output on the display device. The mode in which such a function is provided can be referred to as "terminal mode (TM) ".

In general, in the TM mode, all the control is performed through the display device provided in the vehicle, and since the mobile terminal performs only the role of providing the content, it is difficult to control various functions of the mobile terminal. Control is also not optimized for the connected mobile terminal. In addition, when there are a plurality of mobile terminals in a vehicle, a need for network configuration among the terminals is increasing.

The present invention provides a mobile terminal and a control method thereof that can perform information exchange and control more conveniently when connected to a vehicle.

The present invention also provides a mobile terminal capable of forming a network between terminals when connected to a vehicle, and a control method thereof.

Another object of the present invention is to provide a mobile terminal and a control method thereof, which can acquire operation state information of a vehicle when connected to a vehicle, and inform a user of a problem in an operation state and take subsequent actions.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

According to an aspect of the present invention, there is provided a method of controlling a mobile terminal, the method comprising: communicating with a control device of a vehicle via a communication module; Receiving resource information including information of an active device connected to the control device and information of a passive device; Displaying a list of the passive devices on a touch screen; Selecting a first passive device from the displayed list; And a step in which the mobile terminal and the first passive device are paired.

According to another aspect of the present invention, there is provided a vehicle control apparatus for controlling a plurality of displays and a plurality of display apparatuses, A mobile terminal performing: a touch screen; A communication module connected to the vehicle control device via wire / wireless for exchanging data; And a control unit for receiving resource information including information of at least one display device connected to the control device when the control device is connected to the vehicle control device through the communication module and displaying the list of the at least one display device And a controller for performing a pairing operation with the first display device when the first display device is selected from the displayed list.

According to another aspect of the present invention, there is provided a method of controlling a mobile terminal, the method comprising the steps of: communicating with a control device of a vehicle via a communication module; Receiving from the control device a first status value corresponding to first status information among status information detected from at least one sensor connected to the control device; And outputting the comparison result of the first state value and the second state value set in advance to the mobile terminal through the display unit with respect to the first state value and the first state information.

The information exchange and control can be performed more conveniently in a state where the mobile terminal is connected to the vehicle through the mobile terminal related to at least one embodiment of the present invention.

In addition, the mobile terminal according to at least one embodiment of the present invention participates in forming a network between terminals when sharing a connection with a vehicle, and can share embedded contents or a screen / application.

In addition, the mobile terminal according to at least one embodiment of the present invention obtains the operation status information from the vehicle, notifies the user of the abnormal status through the audiovisual output when the information indicates abnormal operation, Can be transmitted.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a front perspective view of a mobile terminal according to an embodiment of the present invention.
3 is a view showing an example of a vehicle center fascia for explaining a vehicle structure to which embodiments of the present invention are applied.
FIG. 4A is a view showing an example of a vehicle structure for explaining a vehicle structure to which embodiments of the present invention are applied.
4B shows an example of the interaction of each element constituting the vehicle to which the embodiments of the present invention are applied.
5 is a flowchart illustrating an example of a process in which a mobile terminal according to an exemplary embodiment of the present invention is connected to a vehicle control device to select a display and perform control of a specific function through the display.
6 shows an example of a process of selecting a vehicle display according to a resource list reception in a mobile terminal according to an embodiment of the present invention.
FIG. 7 illustrates an example of a content search process of another active device in a mobile terminal according to an embodiment of the present invention.
FIG. 8 shows an example of a display sharing process and a control process of a passive device in a mobile terminal according to an embodiment of the present invention.
9 is a display state diagram illustrating an example of the configuration of a status information check menu according to another embodiment of the present invention.
10 is a view for explaining the operation of the mobile terminal and the vehicle control apparatus according to the fuel / oil information according to another embodiment of the present invention.
11 is a view for explaining the operation of the mobile terminal according to the travel information according to another embodiment of the present invention.
12 is a view for explaining an operation according to a cluster warning in a mobile terminal according to another embodiment of the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation system, . However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

Overall configuration

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only And a Digital Broadcasting System (ISDB-T) (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IRDA), Ultra Wideband (UWB), ZigBee, and Near Field Communication (NFC) can be used as short range communication technology. have.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating an output relating to visual, auditory or tactile sense and includes a display unit 151, an acoustic output module 152, an alarm unit 153, a haptic module 154, 155), and the like.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152 so that they may be classified as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The projector module 155 is a component for performing an image project function using the mobile terminal 100 and is similar to the image displayed on the display unit 151 in accordance with a control signal of the controller 180 Or at least partly display another image on an external screen or wall.

Specifically, the projector module 155 includes a light source (not shown) that generates light (for example, laser light) for outputting an image to the outside, a light source And a lens (not shown) for enlarging and outputting the image at a predetermined focal distance to the outside. Further, the projector module 155 may include a device (not shown) capable of mechanically moving the lens or the entire module to adjust the image projection direction.

The projector module 155 can be divided into a CRT (Cathode Ray Tube) module, an LCD (Liquid Crystal Display) module and a DLP (Digital Light Processing) module according to the type of the display means. In particular, the DLP module may be advantageous for miniaturization of the projector module 151 by enlarging and projecting an image generated by reflecting light generated from a light source on a DMD (Digital Micromirror Device) chip.

Preferably, the projector module 155 may be provided longitudinally on the side, front or back side of the mobile terminal 100. It goes without saying that the projector module 155 may be provided at any position of the mobile terminal 100 as occasion demands.

The memory unit 160 may store a program for processing and controlling the control unit 180 and temporarily store the input / output data (e.g., telephone directory, message, audio, For example. The memory unit 160 may also store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia). In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

Organization description

FIG. 2 is a perspective view of a mobile terminal or a portable terminal according to the present invention, as viewed from the front.

The disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding a synthetic resin, or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, the interface 170, and the like may be disposed in the front body 101 have.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 151 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the portable terminal 100 and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may be collectively referred to as a manipulating portion and may be employed in any manner as long as the user operates in a tactile manner.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 To the touch recognition mode of the touch screen.

On the other hand, the display unit 151 may be operated as an entire area or divided into a plurality of areas. In the latter case, the plurality of areas can be configured to operate in association with each other. In addition, various kinds of time information can be displayed on the display unit 151. These pieces of information can be displayed in the form of letters, numbers, symbols, graphics, or icons.

At least one of the letters, numbers, symbols, graphics, or icons may be displayed in a predetermined arrangement for inputting such information, thereby being implemented as a keypad. Such a keypad may be referred to as a so-called " virtual keypad ".

The display unit 151 or the touch pad 135 may be configured to receive a touch input by scrolling, as well as the input method described in the above embodiments. The user can move a cursor or a pointer located on an object displayed on the display unit 151, for example, an icon or the like, by scrolling the display unit 151 or the touch pad 135. [ Further, when the finger is moved on the display portion 151 or the touch pad 135, the path along which the finger moves may be visually displayed on the display portion 151. [ This will be useful for editing the image displayed on the display unit 151. [

On the other hand, an arrow or finger-shaped graphic for pointing a specific object or selecting a menu in the display unit is called a pointer or a cursor. However, in the case of a pointer, it often means a finger or a stylus pen for a touch operation or the like. Therefore, in this specification, a graphic displayed on the display unit is referred to as a cursor, and a physical means for performing a touch, a proximity touch, and a gesture, such as a finger or a stylus pen, is referred to as a pointer.

The mobile terminal according to the present invention described below includes at least one of the components described above with reference to Fig. 1, but is not necessarily limited thereto, and may include more components than those of Fig. 1, . ≪ / RTI > For convenience, it is assumed that the display unit 151 of the mobile terminal 100 according to the present invention is a touch screen, and the interface unit 170 for connecting the vehicle with the wire and / or the wireless communication unit 110 ).

Vehicle structure and connection with mobile terminal

Hereinafter, a vehicle structure for applying embodiments of the present invention will be described with reference to FIG.

3 is a view showing an example of a vehicle center fascia for explaining a vehicle structure to which embodiments of the present invention are applied.

Generally, on the front of the driver's seat of the vehicle, a steering wheel for steering and an instrument panel for displaying various vehicle driving related information are disposed, and a glove box is disposed on the front of the passenger seat. And, in the space between the instrument panel / handle and the glove box, an operation section for controlling the audio apparatus or the air conditioning apparatus is disposed, which is often called a center fascia.

In the vehicle to which the present invention is applied, such a center fascia is provided with a display device 201 as shown in FIG. 3, and this display device can be connected to the sensors, the driving parts and / or the control parts of each part for performing electronic control of the vehicle, Or receive information therefrom and display it through a predetermined user interface. Examples of this include state information of a vehicle, a map for navigation, a rear camera image, and a multimedia content playback function. Recently, a vehicle can be connected to an external device as well as an apparatus provided inside the vehicle, and a display device is provided to control the connected external device or to use the stored content. When the vehicle and the mobile terminal 100 are connected by wire, a USB standard connection may be used. In a wireless connection, a wireless interface such as Wi-Fi or Bluetooth may be used. However, the present invention is not limited thereto, and the connection means between the mobile terminal and the vehicle according to the present invention is applicable to any connection method capable of communication between the mobile terminal and the vehicle within the vehicle.

Hereinafter, for convenience of explanation, it is assumed that a display device provided in a vehicle, an electronic device of a vehicle connected thereto to provide information or control a vehicle function, a key / touch button for inputting a command, A communication device for performing data communication by wire or wireless is collectively referred to as a "vehicle control device ".

Here, the display device of the vehicle may be a touch screen. In addition, the display device may be disposed in the headrest or the backrest of the front seat in consideration of the rear-seat passenger in addition to being disposed in the center pace as shown in FIG. 3, have. Hereinafter, the display device disposed in the center pacea and the operation unit for controlling the display device will be referred to as a " center fascia display ", and the display device disposed in the headrest or the backrest will be referred to as a "head unit ". Further, the center fascia display and the head unit can be collectively referred to as "vehicle display ".

In the embodiments of the present invention described below, a 1: 1 connection between a mobile terminal and a vehicle control device is extended on the basis of a network between all the mobile terminals existing in the vehicle, and the vehicle control device performs a gateway function . The premise for this is as follows.

a. All the devices in the vehicle are: 1) an active device that provides user content and controller functions, 2) a passive device that collects information or outputs information, and 3) And a gateway device that takes charge of a connection link.

b. The active device may be a mobile terminal according to the present invention. The passive device may be a sensor (various sensing devices such as a front / rear obstacle sensor and a propriety sensing sensor), an audiovisual input / output device (a camera, a black box, A display device itself of the center fascia display, etc.), and the gateway device may be a vehicle control device.

c. The vehicle control device configures a network connection with all the passive devices installed in the vehicle, and may also perform a manager function by presenting a connection list so that the active device can selectively establish a connection.

d. The active device is brought into the vehicle and paired with the head unit or the center fascia display at a ratio of 1: 1, so that the passive device and the active device registered in the vehicle control device can share system resources. Thus, the mobile terminal is 1: 1 connected to the head unit or the center fascia display in terms of the active device, but is one of several active / passive devices being managed from the viewpoint of the vehicle control device. For this purpose, the vehicle control apparatus includes an IP connection routing function between each passive / active device, a content integrated search / listing / address management function per device, an application sharing / execution result distribution function per device, and a multiple control / Function can be performed.

The vehicle structure and the operation of each component will be described below with reference to FIGS. 4A and 4B based on the operation of each device.

FIG. 4A is a view showing an example of a vehicle structure for explaining a vehicle structure to which embodiments of the present invention are applied.

Referring to FIG. 4A, a vehicle 200 to which embodiments of the present invention are applied includes a center fascia display 201 for outputting images, a right head unit 203 provided at the rear of the passenger seat, (205). The vehicle 200 also includes a right camera 211, a front black box 213, a left camera 215 and a rear camera 217 for image acquisition. In addition, a plurality of proximity sensors 221 and 223 are disposed at each edge of the vehicle 200.

The number or position of the head unit for sensor, camera, or video output is illustrative, and the present invention is not limited thereto.

4B shows an example of the interaction of each element constituting the vehicle to which the embodiments of the present invention are applied.

4B, a plurality of mobile terminals 100a, 100b, and 100c, a plurality of cameras 210, a plurality of sensors 220, and a plurality of head units 203, 205 are connected to a vehicle control device . 4B, the center fascia display 201 is a part of a vehicle control device that performs a gateway function as well as a video output.

The plurality of mobile terminals 100a, 100b, and 100c are registered in the vehicle control device to share and control contents and applications. The sensor 220 and the cameras 210 are registered in the vehicle control device, Provide images. In addition, the head units 203 and 205 may register / display images to be registered in the vehicle control device, or may control other devices registered in the vehicle control device.

When the mobile terminal 100a operates as an active device and the cameras 210 operate as a passive device, when a specific camera among a plurality of cameras is selected through the mobile terminal, (410). ≪ / RTI > In addition, when the mobile terminal 100c operates as an active device and the head unit 205 operates as a passive device, an image output from the head unit 205 may be output through the center fascia display 201 (420 ). When the head unit 203 operates as an active device and the cameras 210 operate as a passive device, when a specific one of the plurality of cameras is selected through the operation unit of the head unit, (Step 430).

Hereinafter, a process in which a mobile terminal according to an embodiment of the present invention is connected to a vehicle control device and performs control will be described with reference to FIG.

5 is a flowchart illustrating an example of a process in which a mobile terminal according to an exemplary embodiment of the present invention is connected to a vehicle control device to select a display and perform control of a specific function through the display.

5, the control unit 180 of the mobile terminal first connects to the vehicle controller through the interface unit 170, or when the vehicle controller is found through the wireless communication unit 110, The user may enter the terminal mode TM through a predetermined menu input through the touch panel (S510).

Upon entering the terminal mode, the controller 180 may transmit its information (identification information, capability information, application list, mobile terminal setting information, and the like) to the vehicle control device to perform the registration procedure with respect to the vehicle control device S520).

Thereafter, the control unit receives the resource list from the vehicle control apparatus (S530). The resource list may include information on the active / passive device (e.g., other connected mobile terminal or vehicle display information) connected to the vehicle itself (vehicle identification information, capability information, supported application list).

When the reception of the resource list is completed, a vehicle display to be paired with the mobile terminal may be selected (S540). The selection of the vehicle display can be performed by a method of outputting a list of the vehicle display on the touch screen 151 in a predetermined form and receiving a touch input inputted on the touch screen among the output list.

Information on the selected vehicle display is transmitted to the vehicle control device, and the vehicle control device activates the corresponding vehicle display to be paired with the terminal (S550).

If there is an instruction input through the touch screen 151 of the mobile terminal or another user input unit 130 at step S560, the controller 180 transmits a signal corresponding to the command to the vehicle controller at step S570.

Accordingly, the vehicle control device performs control according to the received signal. In place of the touch screen 151 of the mobile terminal or the separate user input unit 130, it is also possible to input a command through an operation unit corresponding to the paired vehicle display itself. For example, if the vehicle display paired with the mobile terminal is a touch screen, the command input may be performed via the touch screen that constitutes the vehicle display.

In the above-described process, the center fascia display or the head unit can maintain the existing operation regardless of registration of a new terminal until the selected vehicle display is activated through pairing.

The selection process of the vehicle display described above with reference to Fig. 6 will be described in more detail.

6 shows an example of a process of selecting a vehicle display according to a resource list reception in a mobile terminal according to an embodiment of the present invention.

In FIGS. 6 (b) and 6 (c), it is assumed that the vehicle is connected to a vehicle including four vehicle displays, two for each of the front and rear seats. At this time, the two vehicle displays corresponding to the two front seats (i.e., the driver's seat and the assistant driver's seat) may be implemented through a single center fascia display providing dual view functionality, . Here, the dual view function refers to a function of allowing two users having different viewpoints to view different images through one display.

First, when a resource list is received from the vehicle control device at the mobile terminal, a list of active devices connected as shown in FIG. 6A may be displayed on the touch screen 151. [ The list of active devices may be displayed through the icons 611, 613, and 615 corresponding to the connected active devices and the pairing information (for example, the paired active device names).

In addition, a vehicle display list may be displayed on the touch screen 151 of the mobile terminal 100 for vehicle display selection. The vehicle display list can display the position of each vehicle display on the vehicle image through an icon and identification information as shown in FIG. 6 (b). Here, the pairing information 622 for the vehicle display corresponding to the driver's seat indicates that it is paired with the active device having the name P1, and the pairing information 623 for the right head unit indicates that it will be paired with the active device having the P2 name. The pairing information 621 for the vehicle display and the pairing information 624 for the left head unit corresponding to the passenger seat indicate that there is no paired active device.

At this time, if the user touches the area where the identification information 621 of the vehicle display corresponding to the passenger seat is displayed on the touch screen 151, the identification information 621 ' Indicating that it is paired to a user. Meanwhile, the control unit 180 transmits information on the selected vehicle display to the vehicle control device performing the gateway function, so that the vehicle control device can pair the mobile terminal and the selected vehicle display. Therefore, it is desirable for the user to select the nearest vehicle display at his boarding position in his / her vehicle.

Once the pairing is complete, the touch screen 151 of the mobile terminal and the selected vehicle display may be synchronized (i.e., displaying the same image).

Next, content sharing and control of the passive device will be described with reference to Figs. 7 and 8. Fig.

FIG. 7 illustrates an example of a content search process of another active device in a mobile terminal according to an embodiment of the present invention.

When the pairing with the vehicle display is completed, the contents tab 710, the display tab 720, and the camera tab 730 may be displayed on the touch screen 151 as shown in FIG. 7 (a).

When the contents tab 710 is selected, a list of active devices currently connected to the vehicle control device is displayed. When the icon 701 corresponding to the active device having the name of P1 is selected, the tab 740 for the device is generated as shown in FIG. 7B, and the content held in the device is displayed for each category. 7B shows a case where categories are classified into three kinds of media file 741, application 742, and resource 743. When the media file 741 is selected, the media file tab 750 is generated as shown in FIG. 7C, and the media files held in the corresponding device are displayed for each category. FIG. 7C shows a case where categories are classified into three categories, namely, a video list 751, a music list 752, and an image list 753.

Although not shown, if content is selected from each list, the content can be played back on the paired vehicle display. 7B, when the application 742 is selected, a list of applications available from the P1 active device is displayed in the form of an icon map. When a specific icon is selected, a specific icon Can be executed. In addition, when the resource 743 is selected in (b) of FIG. 7, a list of hardware resources (HW resources) available from the P1 active device can be displayed. If a particular hardware resource is selected from the list, the activation result of that hardware resource may be displayed on the paired vehicle display.

Next, the display tab and the camera tab will be described with reference to Fig.

FIG. 8 shows an example of a display sharing process and a control process of a passive device in a mobile terminal according to an embodiment of the present invention.

8A, when the content tab 810, the display tab 820, and the camera tab 830 are displayed on the touch screen 151 after the pairing with the vehicle display is completed, the display tab 820 Assume the selected case.

As the display tab 820 is selected, a list of vehicle displays (center fascia display and head unit) among the passive devices currently connected to the vehicle control device is displayed with the pairing information on the vehicle image. And the pairing information 823 corresponding to the vehicle display on the left side of the front seat indicates that the user's mobile terminal is paired with the corresponding vehicle display. At this time, if the pairing information 821 on the left side of the front magnet is selected, the image currently displayed in the vehicle display on the left side of the front seat can be displayed on the vehicle display paired with the user's mobile terminal. However, when selecting a vehicle display that has already been paired with another active device, the control of the selected vehicle display through the mobile terminal can be restricted.

If the pairing information 827 corresponding to the vehicle display of the unpaired right rear seat is selected, the vehicle control apparatus cancels the pairing of the user's mobile terminal and the front seat right vehicle display, To be paired to the display.

When the camera tap 830 is selected, a list of cameras among the passive devices connected to the current vehicle control device is displayed as icon shapes 831, 833, 835, and 837 on the vehicle image, as shown in FIG. 8B. When the user selects one of the icons, the image of the camera corresponding to the icon selected through the vehicle display paired with the mobile terminal of the user can be displayed. This function can be executed even when parking is not in progress.

The process shown in FIGS. 6 to 8 is described as being performed on the touch screen 151 of the mobile terminal, but may also be performed on a vehicle display paired with the mobile terminal in the same or similar form.

Acquisition of vehicle status information and operation of the mobile terminal accordingly

According to another embodiment of the present invention, when the mobile terminal and the vehicle control device are connected, if the state information of the vehicle is transmitted to the mobile terminal and the abnormal operation or state of the vehicle is detected through the state information, To be performed.

In this embodiment, it is required that the mobile terminal be connected (or registered) with the vehicle control device, but the pairing with the passive device may not be required. That is, when the mobile terminal is paired with the specific vehicle display, the operation process to be described below can be performed through the paired vehicle display, and if not paired, the operation process can be performed through the center pisa display by default.

When the connection between the mobile terminal and the vehicle control apparatus is completed, a status information confirmation menu for selecting the status information to be confirmed can be displayed on the center fascia display. Since the connection procedure is similar to that described above with reference to FIG. 5, redundant description will be omitted for clarity of description, and the configuration of the status information check menu will be described with reference to FIG.

9 is a display state diagram illustrating an example of the configuration of a status information check menu according to another embodiment of the present invention.

Referring to FIG. 9, a state information check menu may be displayed on the center fascia display 201 according to a predetermined menu operation after the mobile terminal and the vehicle control device are connected to each other via wire / wireless. The state information confirmation menu may include engine state information 910, running information 920, fuel / oil information 930, tire pressure information 940, and the like.

When any one of the pieces of information is selected, the vehicle control device transfers the state information of the selected item to the mobile terminal, and the controller 180 of the mobile terminal 100, which has acquired the state information, Can be compared with the reference value. At this time, selection of items may be performed by an operation unit disposed around the center fascia or the like or a touch screen constituting the center fascia display.

 If it is determined that there is a problem in the vehicle state as a result of comparison, the controller 180 may perform an appropriate operation for solving the problem. Hereinafter, the operation of the mobile terminal according to each state information will be described with reference to FIGS. 10 and 11. FIG.

10 is a view for explaining the operation of the mobile terminal and the vehicle control apparatus according to the fuel / oil information according to another embodiment of the present invention.

When the fuel / oil information 930 is selected in the state information confirmation menu of FIG. 9, the vehicle control device transmits current fuel / oil information to the mobile terminal. The fuel gauge 1010 and the engine oil information 1020 according to the information received on the touch screen 151 of the mobile terminal 100 are displayed as shown in FIG. 10 (a). In addition, a message for notifying the user of an item that does not satisfy a preset reference value may be displayed. In FIG. 10A, a text 1030 indicating that the fuel is low is displayed. When such a problematic situation occurs, the control unit 180 of the mobile terminal 100 may output information for solving the problem. For example, in order to solve the situation where the fuel is insufficient, the control unit 180 displays the gasoline information 1040 having the lowest oil value nearby or the gasoline station information 1050 that has recently been visited as shown in FIG. 10 (b) Can be displayed. If the route guidance menu 1060 is selected after any one of the displayed gas station information is selected by the user, the controller 180 transmits the location information on the selected gas station to the vehicle control device. Accordingly, in the center fisicia display 201, the navigation to the corresponding gas station can be started as shown in FIG. 10 (c).

11 is a view for explaining the operation of the mobile terminal according to the travel information according to another embodiment of the present invention.

When the driving information 920 is selected in the state information confirmation menu of FIG. 9, the vehicle control device transmits average fuel efficiency information as current driving information to the mobile terminal. Accordingly, the average fuel efficiency information 1110 according to the information received on the touch screen 151 of the mobile terminal 100 is displayed as shown in FIG. 11 (a). In addition, when the average fuel efficiency is compared with the authorized fuel efficiency and the average fuel efficiency differs from the authorized fuel efficiency by more than a predetermined level, a message 1120 for informing the user of the difference may be displayed. When such a problematic situation occurs, the control unit 180 of the mobile terminal 100 may output information for solving the problem. For example, the control unit 180 may output information for improving the fuel consumption on the touch screen 151 as shown in FIG. 10 (b) for improving fuel economy, or may voice the information through the sound output unit 152 Output.

The information included in the status information confirmation menu shown in FIG. 9 and the user interface configuration examples shown in FIGS. 10 to 11 are illustrative, and the present invention is not limited thereto and can be applied to various menu / user interface configurations.

According to another aspect of the present invention, the vehicle control apparatus automatically informs the mobile terminal of the abnormal state when an abnormal state occurs in the vehicle during the TM connection, and the mobile terminal informs the user of the abnormal state and the solution means to the user can do. This will be described with reference to FIG.

12 is a view for explaining an operation according to a cluster warning in a mobile terminal according to another embodiment of the present invention.

12 (a), when the vehicle control apparatus senses abnormality (here, tire air pressure drop) in the state information input from the sensors in a state where the mobile terminal and the vehicle control apparatus are connected to TM, The tire air pressure warning lamp 1211 corresponding to the abnormal state is turned on in the cluster (instrument panel) 1210 of the vehicle. At the same time, the vehicle control apparatus transmits information on the abnormal state to the TM-connected mobile terminal. The control unit 180 of the mobile terminal 100 displays information on the abnormal state received from the vehicle control device on the touch screen 151 as shown in FIG. 12 (b). At this time, an icon 1211 ', such as a warning lamp that lights up in the cluster, is displayed on the touch screen 151 to help the user understand the problem state. This is especially useful when the driver of the vehicle is not intuitive or unaware of the contents of the warning light according to the status abnormality.

If the control unit 180 determines that the user has confirmed the abnormal state such as touch input on the touch screen, the control unit 180 determines whether to transmit information on the abnormal state to the service center as shown in FIG. 12 (c) And outputs a message for confirmation to the touch screen.

When the user selects transmission, the control unit 180 transmits information indicating that the tire air pressure is decreased through the wireless communication unit 110 and identification information of the corresponding vehicle to the preset service center server. When the transmission is successfully completed, the controller 180 can notify the user of the transmission success through the touch screen as shown in (d) of FIG. 12, and when the reservation information is provided by the service center server, Can be displayed.

Therefore, the user can easily grasp and solve the information about the vehicle abnormality through the above-described method.

Further, according to an embodiment of the present invention, the above-described method can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The above-described mobile terminal and the vehicle control method using the same can be applied to a configuration and a method of the embodiments described above in a limited manner, but the embodiments can be applied to all or a part of each embodiment Or may be selectively combined.

Claims (15)

A mobile terminal connected to a vehicle including at least two vehicle display devices and a control device of a vehicle controlling the vehicle display devices and performing data exchange with the control device,
touch screen;
A communication module for communicating with the control device and exchanging data; And
Wherein the active device information includes at least one other mobile terminal information connected to the control device, wherein the passive device information includes at least one of the information of the active device and the information of the passive device connected to the control device, At least one vehicle display device information provided inside the vehicle display device,
Displaying a first list including the at least one vehicle display device on the touch screen,
When the first vehicle display device is selected in the first list, pairing with the first vehicle display device via the communication module,
Controlling a second list including at least one other mobile terminal to be displayed on the first vehicle display device,
And a controller for controlling the first vehicle display device to display a third list including at least one content included in the selected specific mobile terminal when a specific mobile terminal is selected in the second list, . The method according to claim 1,
Wherein the control unit controls the first list to be displayed on the first vehicle display device after being paired with the first vehicle display device and, when the second vehicle display device is selected in the first list, And controls an image displayed on the display device to be output to the first vehicle display device. The method according to claim 1,
Wherein the information of the passive device further includes information of at least one sensor provided in the vehicle,
Wherein the control unit controls the fourth list including the at least one sensor after being paired with the first vehicle display device to be displayed on the first vehicle display device and when the first sensor is selected in the fourth list, And the sensing information generated through the selected first sensor is displayed on the first vehicle display device. The method of claim 3,
Wherein the first sensor comprises at least one camera,
Wherein the controller controls to display an image photographed through the first camera among the at least one camera. The method according to claim 1,
Wherein the control unit controls the selected specific content to be displayed on the first vehicle display device when a specific content is selected in the third list. The method according to claim 1,
Wherein the control unit controls the received resource information to be displayed on the first vehicle display device. The method of claim 3,
Wherein the controller receives the first status value corresponding to the first status information from the status information detected by the at least one sensor from the control device through the communication module, And displays a comparison result of the second status value preset in the mobile terminal on the touch screen. 8. The method of claim 7,
Wherein the first state information includes a residual fuel amount,
The control unit searches for at least one gas station through the communication module if the first state value is equal to or less than the second state value and transmits the location information of a specific gas station among the searched at least one gas station, To the control device. 8. The method of claim 7,
Wherein the control unit outputs a warning sound through the sound output unit of the mobile terminal if the first status value is less than the second status value. 8. The method of claim 7,
The control unit transmits information on the vehicle abnormality to the predetermined external device through the communication module when the control device detects the vehicle abnormality and receives information on the vehicle abnormality from the control device through the communication module And receives a response to the transmission from the external device. delete delete delete delete delete

Images