KR20130034893A - Mobile terminal and method for controlling a vehicle using the same - Google Patents

Abstract

PURPOSE: A portable terminal and a vehicle control method using the same are provided to share content or an application included in the portable terminal by forming a network between terminals. CONSTITUTION: A control unit of a portable terminal enters a TM(Terminal Mode) through a predetermined menu input by using a user input unit(S510). The control unit executes a registration procedure for a vehicle control device(S520). The control unit receives a resource list from the vehicle control device(S530). A user selects a vehicle display paired in the portable terminal(S540). The vehicle control device activates the selected vehicle display(S550). The control unit transmits the corresponding signal to the vehicle control device according to a user command(S570). [Reference numerals] (AA) Start; (BB) End; (S510) Recognizing connection and entering a TM mode; (S520) Registering to a vehicle control device; (S530) Receiving a resource list; (S540) Selecting a vehicle display; (S550) Activating the selected vehicle display; (S560) User input?; (S570) Transferring input contents to the vehicle control device;

Description

MOBILE TERMINAL AND METHOD FOR CONTROLLING A VEHICLE USING THE SAME}

The present invention relates to a mobile terminal, and more particularly, to a mobile terminal and a method of controlling the same, which can be connected to a vehicle to obtain and control vehicle-related information and functions.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

Recently, a vehicle is provided with a display device, and not only conventional radio or air conditioner control is performed, but also a navigation or multimedia content output function is provided. In addition, the mobile terminal is connected to the display device via a wired or wireless connection so that content stored in the mobile terminal is output on the display device. The mode in which this function is provided may be referred to as a "terminal mode (TM)".

However, in general, in the TM mode, all the control is performed through the display device provided in the vehicle, and since the mobile terminal performs only a role of providing content, it is difficult to control various functions of the mobile terminal. Control also has a problem that is not optimized for the connected mobile terminal. In addition, when a plurality of mobile terminals exist in a vehicle, there is a growing need for a network configuration between the respective terminals.

The present invention is to provide a mobile terminal and a control method thereof that can perform information exchange and control more conveniently when connected to a vehicle.

The present invention also provides a mobile terminal capable of forming a network between terminals when connected to a vehicle and a control method thereof.

In addition, the present invention is to provide a mobile terminal and a control method for acquiring the operation state information of the vehicle when connected to the vehicle, informing the user when there is a problem in the operation state and taking follow-up measures.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

In order to solve the above technical problem, a control method of a mobile terminal according to an embodiment of the present invention, the step of being connected to the control device of the vehicle via a communication module in a wired / wireless; Receiving resource information including information of an active device and information of a passive device connected to the control device; Displaying the list of manual devices on a touch screen; Selecting a first passive device from the displayed list; And pairing the mobile terminal with the first passive device.

In addition, in order to solve the above technical problem, connected to a vehicle including a plurality of displays and a vehicle control device for controlling the plurality of display devices according to an embodiment of the present invention to exchange data with the vehicle control device The mobile terminal to perform, the touch screen; A communication module connected to the vehicle control device via wire / wireless to exchange data; And resource information including information of at least one display device connected to the control device when the vehicle control device and the communication module are connected, and list the at least one display device using the display device information. May be displayed on the touch screen, and if the first display device is selected from the displayed list, the controller may control to perform pairing with the first display device.

In addition, the control method of the mobile terminal according to another embodiment of the present invention, the step of being connected to the control device of the vehicle via a communication module wired / wireless; Receiving a first state value corresponding to first state information among state information detected by at least one sensor connected to the control device, from the control device; And outputting a comparison result between the first state value and the second state value preset in the mobile terminal with respect to the first state information through a display unit.

The exchange and control of information may be performed more conveniently in a state of being connected to a vehicle through a mobile terminal related to at least one embodiment of the present invention configured as described above.

In addition, the mobile terminal according to at least one embodiment of the present invention can participate in the network formation between the terminals when connecting to the vehicle and share the embedded content or the screen / application.

In addition, the mobile terminal according to at least one embodiment of the present invention obtains the operation state information from the vehicle, if the information indicates an abnormal operation to inform the user through the audio-visual output, and the corresponding state information to the preset external device Can be transmitted.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a front perspective view of a mobile terminal according to an embodiment of the present invention.
3 is a diagram illustrating an example of a vehicle center fascia for explaining a vehicle structure to which embodiments of the present invention are applied.
4A is a diagram illustrating an example of a vehicle structure for explaining a vehicle structure to which embodiments of the present invention are applied.
Figure 4b shows an example of the interaction for each element constituting the vehicle to which the embodiments of the present invention are applied.
5 is a flowchart illustrating an example of a process in which a mobile terminal is connected to a vehicle control apparatus according to an embodiment of the present invention to select a display and control a specific function therethrough.
6 illustrates an example of a process of selecting a vehicle display according to resource list reception in a mobile terminal according to an embodiment of the present invention.
7 illustrates an example of a content searching process of another active device in a mobile terminal according to an embodiment of the present invention.
8 illustrates an example of a control process of a display sharing and passive device in a mobile terminal according to an embodiment of the present invention.
9 is a display state diagram illustrating an example of a configuration of a status information confirmation menu according to another embodiment of the present invention.
10 is a view for explaining the operation of the mobile terminal and the vehicle control apparatus according to the fuel / oil information according to another embodiment of the present invention.
11 is a diagram for describing an operation of a mobile terminal according to driving information according to another embodiment of the present invention.
12 is a diagram illustrating an operation according to a cluster warning in a mobile terminal according to another embodiment of the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation system, . However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs, desktop computers, etc., except when applicable only to mobile terminals.

Overall configuration

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 may include, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), and Digital Video Broadcast (DVB-H). Digital broadcast signals can be received using digital broadcasting systems such as Handheld and Integrated Services Digital Broadcast-Terrestrial (ISDB-T). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 114 refers to a module for short range communication. Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and Near Field Communication (NFC) can be used as short range communication technology. have.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to the external device may be sensed. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating an output relating to visual, auditory or tactile sense and includes a display unit 151, an acoustic output module 152, an alarm unit 153, a haptic module 154, 155, and the like.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). and at least one of a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another, or may be disposed integrally with one another, and may be disposed on different surfaces, respectively.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 may be configured in addition to an output device. Can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching the pointer on the screen is called "contact touch." The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152 so that they may be classified as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to vibration, the haptic module 154 may be configured to provide a pin array that vertically moves with respect to the contact skin surface, a jetting force or suction force of air through an injection or inlet port, grazing to the skin surface, contact of an electrode, electrostatic force, and the like. Various tactile effects can be generated, such as effects by the endothermic and the reproduction of a sense of cold using the elements capable of endotherm or heat generation.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The projector module 155 is a component for performing an image project function using the mobile terminal 100 and is similar to the image displayed on the display unit 151 in accordance with a control signal of the controller 180 Or at least partly display another image on an external screen or wall.

Specifically, the projector module 155 includes a light source (not shown) that generates light (for example, laser light) for outputting an image to the outside, a light source And a lens (not shown) for enlarging and outputting the image at a predetermined focal distance to the outside. Further, the projector module 155 may include a device (not shown) capable of mechanically moving the lens or the entire module to adjust the image projection direction.

The projector module 155 can be divided into a CRT (Cathode Ray Tube) module, an LCD (Liquid Crystal Display) module and a DLP (Digital Light Processing) module according to the type of the display means. In particular, the DLP module may be advantageous for miniaturization of the projector module 151 by enlarging and projecting an image generated by reflecting light generated from a light source on a DMD (Digital Micromirror Device) chip.

Preferably, the projector module 155 may be provided longitudinally on the side, front or back side of the mobile terminal 100. It goes without saying that the projector module 155 may be provided at any position of the mobile terminal 100 as occasion demands.

The memory unit 160 may store a program for processing and controlling the control unit 180 and temporarily store the input / output data (e.g., telephone directory, message, audio, For example. The memory unit 160 may also store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia). In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface unit may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various command signals input from the cradle by a user may be transferred. It may be a passage that is delivered to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. The described embodiments may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

Organization description

FIG. 2 is a perspective view of a mobile terminal or a portable terminal according to the present invention, as viewed from the front.

The disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injecting synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, the interface 170, and the like may be disposed in the front body 101 have.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 151 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the portable terminal 100 and may include a plurality of operation units 131 and 132. The manipulation units 131 and 132 may also be collectively referred to as manipulating portions, and may be employed in any manner as long as the user operates the tactile manner with a tactile feeling.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 To the touch recognition mode of the touch screen.

On the other hand, the display unit 151 may be operated in the entire area or divided into a plurality of areas. In the latter case, the plurality of areas can be configured to operate in association with each other. In addition, the display unit 151 may display various types of visual information. These pieces of information can be displayed in the form of letters, numbers, symbols, graphics, or icons.

At least one of the letters, numbers, symbols, graphics, or icons may be displayed in a predetermined arrangement for inputting such information, thereby being implemented as a keypad. Such a keypad may be referred to as a so-called " virtual keypad ".

The display unit 151 or the touch pad 135 may be configured to receive a touch input by scrolling, as well as the input method described in the above embodiments. The user can move a cursor or a pointer located on an object displayed on the display unit 151, for example, an icon or the like, by scrolling the display unit 151 or the touch pad 135. [ Further, when the finger is moved on the display portion 151 or the touch pad 135, the path along which the finger moves may be visually displayed on the display portion 151. [ This will be useful for editing the image displayed on the display unit 151. [

Meanwhile, a graphic in the form of an arrow or a finger for pointing a specific object or selecting a menu on the display unit is called a pointer or a cursor. However, in the case of a pointer, it often means a finger or a stylus pen for a touch operation or the like. Therefore, in this specification, a graphic displayed on the display unit is referred to as a cursor, and a physical means for performing a touch, a proximity touch, and a gesture, such as a finger or a stylus pen, is referred to as a pointer.

The mobile terminal according to the present invention described below includes at least one of the components described above with reference to FIG. 1, but is not necessarily limited thereto, and may include more components than those of FIG. 1 or fewer components. It may also include. For convenience, it is assumed that the display unit 151 of the mobile terminal 100 according to the present invention is a touch screen, and the interface unit 170 for connecting the vehicle with the wire and / or the wireless communication unit 110 ).

Vehicle structure and connection with mobile terminal

Hereinafter, a vehicle structure to which embodiments of the present invention are applied will be described with reference to FIG. 3.

3 is a view showing an example of a vehicle center fascia for explaining a vehicle structure to which embodiments of the present invention are applied.

Generally, on the front of the driver's seat of the vehicle, a steering wheel for steering and an instrument panel for displaying various vehicle driving related information are disposed, and a glove box is disposed on the front of the passenger seat. And, in the space between the instrument panel / handle and the glove box, an operation section for controlling the audio apparatus or the air conditioning apparatus is disposed, which is often called a center fascia.

The vehicle to which the present invention is applied is provided with a display device 201 in such a center fascia as shown in FIG. Control or receive information therefrom and display via a predetermined user interface. Examples of this include state information of a vehicle, a map for navigation, a rear camera image, and a multimedia content playback function. Recently, a vehicle can be connected to an external device as well as an apparatus provided inside the vehicle, and a display device is provided to control the connected external device or to use the stored content. When the vehicle and the mobile terminal 100 are connected by wire, a USB standard connection may be used, and when wirelessly connected, a wireless interface such as Wi-Fi or Bluetooth may be used. However, this is merely an example, and the connection means of the mobile terminal and the vehicle according to the present invention is not limited thereto and may be applied to any connection method capable of communication between the mobile terminal and the vehicle in the vehicle.

Hereinafter, for convenience of explanation, it is assumed that a display device provided in a vehicle, an electronic device of a vehicle connected thereto to provide information or control a vehicle function, a key / touch button for inputting a command, A communication device for performing data communication by wire or wireless is collectively referred to as a "vehicle control device ".

The display device of the vehicle may be a touch screen. In addition, the display device may be disposed in the front seat head rest (head rest) or the backrest in consideration of the rear seat passenger, in addition to being disposed in the center fascia as shown in FIG. have. Hereinafter, the display apparatus disposed in the center fascia and the operation unit for controlling the same are referred to as "center fascia display", and the display apparatus disposed in the head rest or the backrest is called "head unit". In addition, the center fascia display and head unit may be collectively referred to as a "vehicle display".

In the embodiments of the present invention to be described below, the vehicle control device performs a gateway function by extending the 1: 1 connection between the mobile terminal and the vehicle control device based on the network between all the mobile terminals existing in the vehicle. Suggest that you do. The premise for this is as follows.

a. All devices present in the vehicle include: 1) an active device that provides user content provision and controller functions, 2) a passive device that collects or outputs information, and 3) between them. It can be divided into three classes of gateway devices.

b. The active device may be a mobile terminal according to the present invention. The passive device may include sensors (eg, various sensing devices such as front and rear obstacle sensors and rain detection sensors) and audio-visual input / output devices (cameras, black boxes, head units / The display device itself of the center fascia display, etc.), and the gateway device may be a vehicle control device.

c. The vehicle controller configures a network connection with all passive devices mounted in the vehicle, and may also perform a manager function by which the active device can selectively establish a connection by presenting a connection list.

d. The active device may be brought into a vehicle and paired 1: 1 with a head unit or a center fascia display to share system resources with an active device previously registered in the vehicle control device together with the passive device. Therefore, the mobile terminal is connected 1: 1 with the head unit or the center fascia display from the viewpoint of the active device, but becomes one of various active / passive devices under management from the vehicle control device. To this end, the vehicle control device has an Internet protocol connection routing function for each passive / active device, integrated content search / listing / address management function for each device, application sharing / execution result distribution for each device, and multiple control / scheduling. Function can be performed.

Based on the operation of each device described above, with reference to Figures 4a and 4b will be described in more detail the vehicle structure and the operation of each component.

4A is a diagram illustrating an example of a vehicle structure for explaining a vehicle structure to which embodiments of the present invention are applied.

Referring to FIG. 4A, a vehicle 200 to which embodiments of the present invention are applied includes a center fascia display 201 for outputting an image, a right head unit 203 provided at the rear of a passenger seat, and a left head unit provided behind a driver's seat. 205. In addition, the vehicle 200 includes a right camera 211, a front black box 213, a left camera 215, and a rear camera 217 for image acquisition. In addition, a plurality of proximity sensors 221 and 223 are disposed at each edge of the vehicle 200.

The number or position of the sensor, the camera, or the head unit for image output is exemplary, and the present invention is not limited thereto.

Figure 4b shows an example of the interaction for each element constituting the vehicle to which the embodiments of the present invention are applied.

Referring to FIG. 4B, a plurality of mobile terminals 100a, 100b and 100c, a plurality of cameras 210, a plurality of sensors 220, and a plurality of head units 203, and 205 may be connected to a vehicle control apparatus. Connected. In FIG. 4B, the center fascia display 201 refers to a part of a vehicle control apparatus that performs a gateway function as well as an image output.

A plurality of mobile terminals (100a, 100b and 100c) is registered in the vehicle control device to share the content and applications or to perform control, the sensor 220 or the cameras 210 are registered in the vehicle control device is detected information or Provide video. In addition, the head units 203 and 205 may share / output images displayed and registered in the vehicle control apparatus or control other devices registered in the vehicle control apparatus.

When the mobile terminal 100a operates as an active device and the cameras 210 operate as a passive device When a specific camera is selected from among a plurality of cameras through the mobile terminal, the image of the camera is displayed in the center fascia display 201. It may be displayed through (410). In addition, when the mobile terminal 100c operates as an active device and the head unit 205 operates as a passive device, an image output from the head unit 205 may be output through the center fascia display 201 (420). ). In addition, when the head unit 203 operates as an active device and the cameras 210 operate as a passive device, when a specific camera is selected from a plurality of cameras through an operation unit of the head unit, the image of the corresponding camera is displayed in the head unit. It may be displayed through 203 (430).

Hereinafter, a process in which a mobile terminal is connected to a vehicle control apparatus and performs control according to an embodiment of the present invention will be described with reference to FIG. 5.

5 is a flowchart illustrating an example of a process in which a mobile terminal is connected to a vehicle control apparatus according to an embodiment of the present invention to select a display and control a specific function therethrough.

Referring to FIG. 5, first, the controller 180 of the mobile terminal is wired through the vehicle controller and the interface unit 170, or when the vehicle controller is searched through the wireless communication unit 110, the user input unit 130. The terminal may enter the terminal mode (TM) through a predetermined menu input through S510.

As the terminal enters the terminal mode, the controller 180 may transmit its information (identification information, capability information, application list, mobile terminal setting information, etc.) to the vehicle control apparatus to perform a registration procedure for the vehicle control apparatus ( S520).

Thereafter, the controller receives the resource list from the vehicle controller (S530). The resource list may include information about the active / passive device (for example, other connected mobile terminal or vehicle display information) connected with information of the vehicle itself (vehicle identification information, capability information, supporting application list).

When the reception of the resource list is completed, the vehicle display to be paired with respect to the mobile terminal may be selected (S540). The selection of the vehicle display may be performed by outputting a list of the vehicle display on the touch screen 151 in a predetermined form and receiving a touch input input on the touch screen among the output lists.

Information on the selected vehicle display is transmitted to the vehicle controller, and the vehicle controller activates the vehicle display to be paired with respect to the terminal (S550).

Thereafter, when there is a command input through the touch screen 151 of the mobile terminal or a separate user input unit 130 (S560), the controller 180 transmits a signal corresponding to the command to the vehicle controller (S570).

Accordingly, the vehicle controller performs control according to the received signal. Of course, instead of the touch screen 151 of the mobile terminal or the separate user input unit 130, a command input through the operation unit corresponding to the paired vehicle display itself is also possible. For example, when a vehicle display paired with a mobile terminal is a touch screen, command input may be performed through a touch screen constituting the vehicle display.

In the above-described process, the center fascia display or the head unit may maintain the existing operation regardless of registration of a new terminal until the selected vehicle display is activated through pairing.

Referring to Figure 6 will be described in more detail the selection process of the vehicle display described above.

6 illustrates an example of a process of selecting a vehicle display according to resource list reception in a mobile terminal according to an embodiment of the present invention.

In FIGS. 6B and 6C, it is assumed that a connection with a vehicle including a total of four vehicle displays, two for each of the front and rear seats. In this case, the two vehicle displays corresponding to the two front seats (that is, the driver's seat and the front passenger's seat) may be implemented through one center fascia display that provides a dual view function or two centersia displays. May be Here, the dual view function refers to a function that allows two users with different viewpoints to view different images through one display.

First, when the resource list is received from the vehicle control apparatus in the mobile terminal, a list of connected active devices may be displayed on the touch screen 151 as shown in FIG. The list of active devices may be displayed through icons 611, 613, and 615 corresponding to each connected active device and pairing information (eg, paired active device names).

In addition, the vehicle display list may be displayed on the touch screen 151 of the mobile terminal 100 to select the vehicle display. As shown in (b) of FIG. 6, the vehicle display list may display the position of each vehicle display on the vehicle image through an icon and identification information. Here, the pairing information 622 for the vehicle display corresponding to the driver's seat indicates that the pairing information is paired to the active device having the P1 name, and the pairing information 623 for the right head unit indicates that the pairing information is paired to the active device having the P2 name. Pairing information 621 on the vehicle display corresponding to the passenger seat and pairing information 624 on the left head unit respectively indicate that there is no paired active device.

In this case, when the user touches a region where the identification information 621 of the vehicle display corresponding to the passenger seat is displayed on the touch screen 151, the identification information 621 ′ may be included in the identification information 621 ′ of FIG. It indicates that the user is paired. Meanwhile, the controller 180 transmits the information about the selected vehicle display to the vehicle control apparatus that performs the gateway function, and thus the vehicle controller can pair the mobile terminal with the selected vehicle display. Therefore, it is desirable for the user to select the vehicle display closest to the riding position in his vehicle.

When the pairing is completed, the touch screen 151 of the mobile terminal and the selected vehicle display may be synchronized (that is, display the same image).

Next, the control of the content sharing and passive devices will be described with reference to FIGS. 7 and 8.

7 illustrates an example of a content searching process of another active device in a mobile terminal according to an embodiment of the present invention.

When pairing with the vehicle display is completed, the content tab 710, the display tab 720, and the camera tab 730 may be displayed on the touch screen 151 as shown in FIG. 7A.

When the content tab 710 is selected, a list of active devices currently connected to the vehicle controller is displayed. If an icon 701 corresponding to the active device named P1 is selected, as shown in FIG. 7B, a tab 740 for the corresponding device is generated, and contents held in the corresponding device are displayed for each category. FIG. 7B illustrates a case in which categories are classified into three kinds of media files 741, applications 742, and resources 743. In this case, when the media file 741 is selected, the media file tab 750 is generated as shown in FIG. 7C, and the media files held in the corresponding device are displayed for each category. FIG. 7C illustrates a case in which categories are classified into three types: a video list 751, a music list 752, and an image list 753.

Although not shown, when specific content is selected from each list, the corresponding content may be played on the paired vehicle display. Meanwhile, when the application 742 is selected in FIG. 7B, a list of applications that can be provided by the P1 active device is displayed in the form of an icon map. When a specific icon is selected, the specific icon is displayed on the paired vehicle display. An application corresponding to may be executed. In addition, when the resource 743 is selected in FIG. 7B, a list of hardware resources (HW resources) that can be provided by the P1 active device may be displayed. When a specific hardware resource is selected from the list, the activation result of the hardware resource may be displayed on the paired vehicle display.

Next, the display tab and the camera tab will be described with reference to FIG. 8.

8 illustrates an example of a control process of a display sharing and passive device in a mobile terminal according to an embodiment of the present invention.

In FIG. 8A, when the content tab 810, the display tab 820, and the camera tab 830 are displayed on the touch screen 151 after pairing with the vehicle display is completed, the display tab 820 is displayed. Assume the case selected.

As the display tab 820 is selected, a list of vehicle displays (center fascia display and head unit) among passive devices currently connected to the vehicle control apparatus is displayed along with pairing information on the vehicle image. Pairing information 823 corresponding to the vehicle display on the left side of the front seat indicates that the user's mobile terminal is paired with the vehicle display. In this case, when the pairing information 821 on the left side of the front seat is selected, an image currently displayed on the vehicle display on the left side of the front seat may be displayed on the vehicle display paired with the user's mobile terminal. However, when selecting a vehicle display already paired with another active device in this way, control of the selected vehicle display through the corresponding mobile terminal may be limited.

If the pairing information 827 corresponding to the vehicle display of the right rear seat that is not paired is selected, the vehicle controller releases pairing between the user's mobile terminal and the front right vehicle display, and the mobile terminal releases the vehicle of the right rear seat. It can be paired to the display.

Meanwhile, when the camera tab 830 is selected, a list of cameras among passive devices currently connected to the vehicle control apparatus as shown in FIG. 8B is displayed in the form of icons 831, 833, 835, and 837 on the vehicle image. When the user selects one of the icons, an image of a camera corresponding to the selected icon may be displayed through the vehicle display paired to the user's mobile terminal. This function can be executed even when not parked.

6 to 8 have been described as being performed on the touch screen 151 of the mobile terminal, but may be performed on the vehicle display paired with the mobile terminal in the same or similar form.

Acquisition of vehicle status information and operation of the mobile terminal accordingly

In another embodiment of the present invention, when the mobile terminal and the vehicle control device are connected, the state information of the vehicle is transmitted to the mobile terminal, and if the abnormal operation or state of the vehicle is detected through the state information, appropriate follow-up actions are performed through the mobile terminal. It is suggested to be performed.

In this embodiment, the mobile terminal is required to be connected (or registered) with the vehicle control device, but pairing with the passive device may not be required. That is, when the mobile terminal is paired with a specific vehicle display, the operation process to be described below may be performed through the paired vehicle display, and if not paired, the operation process may be performed through the center fascia display by default.

When the connection between the mobile terminal and the vehicle control apparatus is completed, a status information confirmation menu for selecting status information to check may be displayed on the center fascia display. Since the connection process is similar to that described above with reference to FIG. 5, redundant description is omitted for simplicity of the specification, and the configuration of the status information confirmation menu will be described with reference to FIG. 9.

9 is a display state diagram illustrating an example of a configuration of a status information confirmation menu according to another embodiment of the present invention.

Referring to FIG. 9, after the mobile terminal and the vehicle control device are connected to each other via wired / wireless TM, a status information confirmation menu may be displayed on the center fascia display 201 according to a predetermined menu operation. The state information confirmation menu may include engine state information 910, driving information 920, fuel / oil information 930, tire air pressure information 940, and the like.

When any one item of each information is selected, the vehicle controller transmits the state information of the selected item to the mobile terminal, and the controller 180 of the mobile terminal 100 that obtains the state information is set in advance for the corresponding state information. Can be compared with a reference value. In this case, the selection of the item may be performed by a manipulation unit arranged around the center fascia or the touch screen constituting the center fascia display.

 When it is determined that there is a problem in the vehicle state as a result of the comparison, the controller 180 may perform an appropriate operation for solving the problem. Hereinafter, operations of the mobile terminal for each state information will be described with reference to FIGS. 10 and 11.

10 is a view for explaining the operation of the mobile terminal and the vehicle control apparatus according to the fuel / oil information according to another embodiment of the present invention.

When fuel / oil information 930 is selected in the status information confirmation menu of FIG. 9, the vehicle controller transmits current fuel / oil information to the mobile terminal. Accordingly, the fuel gauge 1010 and the engine oil information 1020 according to the information received on the touch screen 151 of the mobile terminal 100 are displayed as shown in FIG. Also, a message for notifying a user of an item that does not satisfy a predetermined reference value among two pieces of information may be displayed. In FIG. 10A, text 1030 indicating that fuel is insufficient is displayed. When such a problem situation occurs, the controller 180 of the mobile terminal 100 may output information for solving the problem. For example, in order to solve a situation in which fuel is insufficient, the controller 180 may display gas station information 1040 having the lowest oil price or recently visited gas station information 1050 on the touch screen as shown in FIG. I can display it. If one of the displayed gas station information is selected by the user and the road guidance menu 1060 is selected, the controller 180 transmits the position information on the selected gas station to the vehicle controller. Accordingly, in the center fascia display 201, the navigation to the corresponding gas station can be started as shown in FIG.

11 is a diagram for describing an operation of a mobile terminal according to driving information according to another embodiment of the present invention.

When the driving information 920 is selected in the status information confirmation menu of FIG. 9, the vehicle controller transmits average fuel efficiency information as current driving information to the mobile terminal. Accordingly, as shown in FIG. 11A, the average fuel efficiency information 1110 according to the information received on the touch screen 151 of the mobile terminal 100 is displayed. In addition, when the average fuel efficiency is compared with the certified fuel economy by more than a predetermined level by comparing the average fuel efficiency information with the certified fuel economy, a message 1120 for notifying the user of this may be displayed. When such a problem situation occurs, the controller 180 of the mobile terminal 100 may output information for solving the problem. For example, the controller 180 outputs fuel efficiency information on the touch screen 151 as shown in FIG. 10 (b) to improve fuel efficiency, or outputs the corresponding information by voice through the audio output unit 152. You can also output

Information included in the status information confirmation menu shown in FIG. 9 and user interface configuration forms of FIGS. 10 to 11 are exemplary, and the present disclosure is not limited thereto and may be applied to various menu / user interface configurations.

On the other hand, according to another aspect of the present embodiment, the vehicle control device automatically informs the mobile terminal of the abnormal state as the abnormal state occurs in the vehicle during the TM connection, the mobile terminal provides the user with information and solutions for the abnormal state can do. This will be described with reference to FIG. 12.

12 is a diagram illustrating an operation according to a cluster warning in a mobile terminal according to another embodiment of the present invention.

Referring to (a) of FIG. 12, when the vehicle controller detects an abnormality (here, tire pressure drop) in the state information input from the sensors in a situation where the mobile terminal and the vehicle controller are TM connected, to notify the driver of the abnormality. The tire pneumatic warning light 1211 corresponding to the abnormal condition is turned on in the cluster (the dashboard 1210) of the vehicle. At the same time, the vehicle controller transmits information on the abnormal state to the TM-connected mobile terminal. The controller 180 of the mobile terminal 100 displays the information on the abnormal state received from the vehicle defroster as shown in FIG. 12B on the touch screen 151. In this case, an icon 1211 ′ such as a warning light that is lit on the cluster may be displayed on the touch screen 151 to help the user understand the problem state. This is particularly useful when the driver of the vehicle generally does not know or understand the contents of the warning light according to the abnormal condition.

When the controller 180 determines that the user checks the abnormal state such as applying a touch input on the touch screen, the controller 180 informs the user whether to transmit the information about the abnormal state to the service center as shown in FIG. Prints a message for confirmation on the touch screen.

When the user selects transmission, the controller 180 transmits information indicating that the tire air pressure is lowered and identification information of the corresponding vehicle through the wireless communication unit 110 to a preset service center server. When the transmission is successfully completed, the controller 180 can inform the user of the successful transmission through the touch screen as shown in FIG. 12 (d). When the reservation information is provided by the service center server, the corresponding information is also displayed on the touch screen. Can be marked on.

Therefore, the user can easily grasp and solve the information on the vehicle abnormality through the above-described method.

Further, according to an embodiment of the present invention, the above-described method can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The above-described mobile terminal and the method for controlling the vehicle using the same are not limited to the configuration and method of the above-described embodiments, but the embodiments may be modified in whole or in part to enable various modifications. It may alternatively be configured in combination.

Claims (15)

In the control method of a mobile terminal,
Connecting to a control device of the vehicle through a communication module in a wired / wireless manner;
Receiving resource information including information of an active device and information of a passive device connected to the control device;
Displaying the list of manual devices on a touch screen;
Selecting a first passive device from the displayed list; And
And pairing the mobile terminal with the first passive device. The method of claim 1,
Information of the manual device,
Includes information on at least one vehicle display device provided in the vehicle,
The first passive device is a control method of a mobile terminal, characterized in that the first vehicle display device of the at least one vehicle display device. The method of claim 2,
After the pairing step,
Displaying the list of the at least one vehicle display device on the first vehicle display device;
Selecting a second vehicle display device from the list; And
And outputting an image displayed on the second vehicle display apparatus through the first vehicle display apparatus. The method of claim 1,
The information of the passive device includes information of at least one sensor provided in the vehicle,
After the pairing step,
Displaying the list of the at least one sensor on the first vehicle display device;
Selecting a first sensor from the list of sensors; And
And displaying the sensing information generated by the first sensor through the first vehicle display apparatus. 5. The method of claim 4,
The at least one sensor is at least one camera,
Displaying the sensing information,
And displaying an image photographed through a first camera of the at least one camera. The method of claim 2,
The information of the active device,
Includes information of at least one other mobile terminal connected to the control device,
After the pairing step,
Displaying the list of the at least one other mobile terminal on the first vehicle display device;
Selecting a specific mobile terminal from the list of mobile terminals; And
And displaying a list of contents included in the specific mobile terminal through the first vehicle display apparatus. The method according to claim 6,
The list of contents is
A method for controlling a mobile terminal, characterized in that the media file, application and resource information are displayed separately. The method according to claim 6,
Selecting specific content from the list of contents; And
And displaying the specific content through the first vehicle display apparatus. In the control method of a mobile terminal,
Connecting to a control device of the vehicle through a communication module in a wired / wireless manner;
Receiving resource information including information of at least one display device connected to the control device;
Displaying a list of the at least one display device on a touch screen using the display device information;
Receiving a selection of a first display device from the displayed list;
Pairing the mobile terminal with the first display device; And
And displaying the resource information through the first display device. A mobile terminal connected to a vehicle including a plurality of displays and a vehicle control device for controlling the plurality of display devices, the mobile terminal performing data exchange with the vehicle control device,
touch screen;
A communication module connected to the vehicle control device via wire / wireless to exchange data; And
When connected to the vehicle control device through the communication module, resource information including information of at least one display device connected to the control device is received, and the list of the at least one display device is obtained using the display device information. And a controller which is displayed on the touch screen and controls to perform pairing with the first display device when a first display device is selected from the displayed list. In the control method of a mobile terminal,
Connecting to a control device of the vehicle through a communication module in a wired / wireless manner;
Receiving a first state value corresponding to first state information among state information detected by at least one sensor connected to the control device, from the control device; And
And outputting a comparison result of the second state value preset in the mobile terminal with respect to the first state value and the first state information through a display unit. 12. The method of claim 11,
The first state information is the remaining fuel amount,
Searching for at least one gas station when the first state value is less than or equal to the second state value; And
And transmitting the position information of a specific gas station among the searched at least one gas station to the control device. 12. The method of claim 11,
And outputting a warning sound through the sound output unit of the mobile terminal when the first state value is less than or equal to the second state value. 12. The method of claim 11,
When the controller detects a vehicle abnormality, receiving information about the vehicle abnormality from the controller;
Transmitting information on the vehicle error to a preset external device through a wireless communication unit; And
Receiving a response to the transmission from the external device. Connecting to a control device of the vehicle through a communication module of a mobile terminal in a wired / wireless manner;
Displaying a list of state information detected from at least one sensor connected to the control device on a vehicle display connected to the control device;
Selecting first state information from the list;
Transmitting a first state value corresponding to the first state information from the control device to the mobile terminal; And
And outputting a comparison result between the first state value and the second state value preset in the mobile terminal with respect to the first state information through a display unit provided in the mobile terminal.

Images