KR101716145B1 - Mobile terminal, vehicle and mobile terminal link system - Google Patents

Abstract

The present invention relates to a vehicular drive system including a display unit, a wireless communication unit for performing pairing with a vehicle having a cluster on a dashboard, and a display unit for receiving vehicle status information or vehicle driving information from the paired vehicle, Vehicle information generated based on the driving information or the driving information to generate an information providing screen including information more detailed than the information provided through the cluster, and the information providing screen is displayed on the display And a control unit for controlling the display unit to display the information.

Description

[0001] The present invention relates to a mobile terminal, a vehicle and a mobile terminal link system,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a mobile terminal for graphically displaying vehicle status information or vehicle driving information and an interlocking system for a vehicle and a mobile terminal.

A vehicle is a device that moves a user in a desired direction by a boarding user. Typically, automobiles are examples.

In recent years, studies on interworking between a vehicle and a mobile terminal have been actively conducted. The vehicle can provide more functions according to the interworking of the mobile terminals.

On the other hand, the cluster provided in the vehicle simply displays the speed, RPM, component failure, and mileage information. In some cases, the driver wishes to obtain more information than the information displayed in the cluster before, during, and after driving. In this case, research is needed on information providing method that provides driver with more information while minimizing driver 's divergence of sight for safety.

On the other hand, an AVN (Audio Video Navigation) device buried in or embedded in a vehicle is expensive and causes a rise in the price of a vehicle when a consumer purchases the vehicle. Accordingly, research on providing functions provided by the AVN apparatus using a mobile terminal without a separate AVN apparatus is also required.

The present invention relates to a mobile terminal for displaying an information providing screen including information more detailed than information provided to a cluster by graphically processing vehicle status information or vehicle running information through a mobile terminal in a state of being interlocked with a vehicle and a mobile terminal, And provides an interlocking system between the vehicle and the mobile terminal.

The problems of the present invention are not limited to the above-mentioned problems, and other problems not mentioned can be clearly understood by those skilled in the art from the following description.

The mobile terminal includes a display unit, a wireless communication unit for performing pairing with a vehicle having a cluster on a dashboard, and a display unit for receiving vehicle status information or vehicle driving information from the paired vehicle, , Graphically processes at least any one of the vehicle driving information and the vehicle driving information or the vehicle auxiliary information generated based on the driving information to generate an information providing screen including more detailed information than information provided through the cluster And a control unit for controlling the display unit to display the information providing screen.

According to another aspect of the present invention, there is provided an interworking system for a vehicle and a mobile terminal, comprising: a vehicle and a display including a cluster disposed on a dashboard; A wireless communication unit for performing pairing with the vehicle; And a control unit that receives vehicle status information or vehicle driving information from the paired vehicle, and performs at least one of the vehicle status information, the vehicle driving information, and the vehicle driving information or the vehicle auxiliary information generated based on the driving information, And a control unit for generating an information providing screen including information more detailed than the information provided through the cluster and controlling the information providing screen to be displayed on the display unit.

The details of other embodiments are included in the detailed description and drawings.

According to an embodiment of the present invention, there is one or more of the following effects.

First, the information displayed on the cluster or the mobile terminal can be confirmed even when the driver keeps the gaze ahead, thereby providing the driver with the information required by the driver while minimizing the disturbance of the driver's operation.

Second, even in a vehicle that does not have an expensive AVN device, the AVN functions can be provided to the driver through the mobile terminal.

Third, there is an effect that the driver can intuitively confirm information by graphically processing the vehicle status information or the vehicle driving information to provide the information providing screen.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description of the claims.

1 is a view showing an appearance of a vehicle according to an embodiment of the present invention.
2 is a block diagram of a vehicle according to an embodiment of the present invention.
3 is a diagram illustrating an appearance of various mobile terminals according to an embodiment of the present invention.
4 is a block diagram of a mobile terminal according to an embodiment of the present invention.
5 is a flowchart referred to explain the operation of the vehicle and the mobile terminal according to the embodiment of the present invention.
FIG. 6 is a diagram referred to explain a vehicle interior according to an embodiment of the present invention.
7A and 7B are diagrams for explaining an operation of controlling a mobile terminal through a user input unit provided in a vehicle according to an embodiment of the present invention.
8A to 8B are diagrams referred to for describing an operation of displaying vehicle state information or vehicle driving information according to an embodiment of the present invention.
9-11 are diagrams that are referenced to describe various embodiments for displaying vehicle status information or vehicle driving information, in accordance with an embodiment of the present invention.
Figs. 12 to 14 are diagrams referred to explain the operation of displaying necessary vehicle auxiliary information to the mobile terminal according to the state of the vehicle according to the embodiment of the present invention. Fig.
FIG. 15 is a diagram for describing an operation of displaying an image around a vehicle obtained through a camera of a vehicle on an information providing screen according to an embodiment of the present invention.
FIG. 16 is a diagram for describing an operation of photographing in a mobile terminal when a user input is received through a user input portion of the vehicle, according to an embodiment of the present invention. FIG.
17 is a diagram referred to explain an operation of displaying vehicle driving information obtained in a vehicle driving assist system on an information providing screen according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

The vehicle described herein may be a concept including a car, a motorcycle. Hereinafter, the vehicle will be described mainly with respect to the vehicle.

The vehicle described in the present specification may be a concept including both an internal combustion engine vehicle having an engine as a power source, a hybrid vehicle having an engine and an electric motor as a power source, and an electric vehicle having an electric motor as a power source.

A mobile terminal as described herein may be a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC, A tablet PC, an ultrabook, a wearable device such as a smartwatch, a smart glass, and a head mounted display (HMD). have.

1 is a view showing an appearance of a vehicle according to an embodiment of the present invention.

1, the vehicle 100 includes wheels 10FR, 10FL, 10RL, etc. rotated by a power source, steering input means 121a for adjusting the traveling direction of the vehicle 100, A camera 122a for capturing an image, and various electrical units provided in the vehicle 100. [

The vehicle 100 includes a camera (not shown) for photographing an in-vehicle image, a vehicle display device (not shown) for visually displaying various information, a vehicle status information or a cluster for visually displaying vehicle driving information (Not shown) on which the mobile terminal 200 can be mounted.

2 is a block diagram of a vehicle according to an embodiment of the present invention.

The vehicle 100 includes a communication unit 110, an input unit 120, a sensing unit 130, an output unit 140, a vehicle driving unit 150, a memory 160, an interface unit 170, a control unit 180, (Not shown).

The communication unit 110 is a communication unit that transmits and receives data between the vehicle 100 and the mobile terminal 200 or between the vehicle 100 and the external server 310 or between the vehicle 100 and the other vehicle 320, Modules. In addition, the communication unit 110 may include one or more modules that connect the vehicle 100 to one or more networks.

The communication unit 110 may include a broadcast receiving module 111, a wireless Internet module 112, a short range communication module 113, a location information module 114, and an optical communication module 115.

The broadcast receiving module 111 receives broadcast signals or broadcast-related information from an external broadcast management server through a broadcast channel. Here, the broadcast includes a radio broadcast or a TV broadcast.

The wireless Internet module 112 refers to a module for wireless Internet access, and may be built in or externally mounted in the vehicle 100. The wireless Internet module 112 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) 112 transmit and receive data according to at least one wireless Internet technology, including Internet technologies not listed above.

The short-range communication module 113 is for short-range communication and may be a Bluetooth ™, a Radio Frequency Identification (RFID), an Infrared Data Association (IrDA), a UWB (Ultra Wideband) It is possible to support near-field communication using at least one of Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct and Wireless USB (Universal Serial Bus)

The short-range communication module 113 may form short-range wireless communication networks to perform short-range communication between the vehicle 100 and at least one external device.

The position information module 114 is a module for obtaining the position of the vehicle 100, and a representative example thereof is a Global Positioning System (GPS) module. For example, when the mobile terminal utilizes the GPS module, it can acquire the position of the mobile terminal by using a signal transmitted from the GPS satellite.

The optical communication module 115 may include a light emitting portion and a light receiving portion.

The light receiving section can convert the light signal into an electric signal and receive the information. The light receiving unit may include a photodiode (PD) for receiving light. Photodiodes can convert light into electrical signals. For example, the light receiving section can receive information of the front vehicle through light emitted from the light source included in the front vehicle.

The light emitting unit may include at least one light emitting element for converting an electric signal into an optical signal. Here, the light emitting element is preferably an LED (Light Emitting Diode). The optical transmitter converts the electrical signal into an optical signal and transmits it to the outside. For example, the optical transmitter can emit the optical signal to the outside through the blinking of the light emitting element corresponding to the predetermined frequency. According to an embodiment, the light emitting portion may include a plurality of light emitting element arrays. According to the embodiment, the light emitting portion can be integrated with the lamp provided in the vehicle 100. [ For example, the light emitting portion may be at least one of a headlight, a tail light, a brake light, a turn signal lamp, and a car light.

The input unit 120 may include a driving operation unit 121, a camera 122, a microphone 123, and a user input unit 124.

The driving operation means 121 receives a user input for driving the vehicle 100. The driving operation means 121 may include a steering input means 121a, a shift input means 121b, an acceleration input means 121c and a brake input means 121d.

The steering input means 121a receives a forward direction input of the vehicle 100 from the user. The steering input means 121a is preferably formed in a wheel shape so that steering input can be performed by rotation. According to the embodiment, the steering input means 121a may be formed of a touch screen, a touch pad, or a button.

The shift input means 121b receives the input of parking (P), forward (D), neutral (N), and reverse (R) of the vehicle 100 from the user. The shift input means 121b is preferably formed in a lever shape. According to an embodiment, the shift input means 121b may be formed of a touch screen, a touch pad, or a button.

The acceleration input means 121c receives an input for acceleration of the vehicle 100 from the user. The brake input means 121d receives an input for decelerating the vehicle 100 from the user. The acceleration input means 121c and the brake input means 121d are preferably formed in the form of a pedal. According to the embodiment, the acceleration input means 121c or the brake input means 121d may be formed of a touch screen, a touch pad, or a button.

The camera 122 may include an image sensor and an image processing module. The camera 122 may process still images or moving images obtained by an image sensor (e.g., CMOS or CCD). The image processing module can process the still image or the moving image obtained through the image sensor, extract necessary information, and transmit the extracted information to the control unit 180. The vehicle 100 may include a first camera 121a for capturing an image of the front of the vehicle and a second camera 122b for capturing an in-vehicle image.

The first camera 122a is constituted by a stereo camera, and can acquire a stereo image in front of the vehicle. At this time, the image processing module can provide the distance information with respect to the object detected on the stereo image through the binocular parallax information.

And the second camera 122b may acquire an image of the occupant. And the second camera 122b can acquire an image for biometrics of the passenger.

The microphone 123 can process an external acoustic signal into electrical data. The processed data can be utilized variously according to functions performed in the vehicle 100. The microphone 123 can convert the voice command of the user into electrical data. The converted electrical data may be transmitted to the control unit 180.

The camera 122 or the microphone 123 may be a component included in the sensing unit 130 and not a component included in the input unit 120. [

The user input unit 124 is for receiving information from a user. When the information is inputted through the user input unit 124, the control unit 180 can control the operation of the vehicle 100 to correspond to the input information. The user input unit 124 may include a touch input means or a mechanical input means. According to an embodiment, the user input 124 may be located in one area of the steering wheel. In this case, the driver can operate the user input unit 124 with his / her finger while holding the steering wheel.

The sensing unit 130 senses a signal related to the running of the vehicle 100 or the like. To this end, the sensing unit 130 may include a sensor such as a collision sensor, a wheel sensor, a velocity sensor, a tilt sensor, a weight sensor, a heading sensor, a yaw sensor, a gyro sensor, , A position module, a vehicle forward / reverse sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor by steering wheel rotation, a vehicle internal temperature sensor, an internal humidity sensor, an ultrasonic sensor, a radar, .

Thus, the sensing unit 130 can acquire the vehicle collision information, vehicle direction information, vehicle position information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, , Fuel information, tire information, vehicle lamp information, vehicle internal temperature information, vehicle interior humidity information, and the like.

The sensing unit 130 may further include an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor AFS, an intake air temperature sensor ATS, a water temperature sensor WTS, A position sensor (TPS), a TDC sensor, a crank angle sensor (CAS), and the like.

The sensing unit 130 may include a biometric information sensing unit. The biometric information sensing unit senses and acquires the biometric information of the passenger. The biometric information may include fingerprint information, iris-scan information, retina-scan information, hand geo-metry information, facial recognition information, Voice recognition information. The biometric information sensing unit may include a sensor that senses the passenger's biometric information. Here, the camera 122 and the microphone 123 can operate as sensors. The biometric information sensing unit may acquire hand shape information and facial recognition information through the second camera 122b. The biometric information sensing unit 131 can acquire the voice recognition information through the microphone 123. [

Meanwhile, the biometric information sensing unit may further include a fingerprint recognition scanner, an iris recognition scanner, or a retinal recognition scanner to acquire fingerprint recognition information, iris recognition information, or retinal recognition information of the passenger.

The output unit 140 may include a display unit 141, an acoustic output unit 142, and a haptic output unit 143 for outputting information processed by the control unit 180.

The display unit 141 may display information processed by the controller 180. [ For example, the display unit 141 can display vehicle-related information. Here, the vehicle-related information may include vehicle control information for direct control of the vehicle, or vehicle driving assistance information for a driving guide to the vehicle driver. Further, the vehicle-related information may include vehicle state information indicating the current state of the vehicle or vehicle driving information related to the driving of the vehicle.

The display unit 141 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) display, a 3D display, and an e-ink display.

The display unit 141 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. Such a touch screen may function as a user input 148 that provides an input interface between the vehicle 100 and a user and may provide an output interface between the vehicle 100 and a user. In this case, the display unit 141 may include a touch sensor that senses a touch with respect to the display unit 141 so as to receive a control command by a touch method. When a touch is made to the display unit 141, the touch sensor senses the touch, and the control unit 180 generates a control command corresponding to the touch based on the touch. The content input by the touch method may be a letter or a number, an instruction in various modes, a menu item which can be designated, and the like.

Meanwhile, the display unit 141 may include a cluster so that the driver can check the vehicle state information or the vehicle driving information while driving. Clusters can be located on the dashboard. In this case, the driver can confirm the information displayed in the cluster while keeping the line of sight ahead of the vehicle.

Meanwhile, according to the embodiment, the display unit 141 may be implemented as a Head Up Display (HUD). When the display unit 141 is implemented as a HUD, information can be output through a transparent display provided in the windshield. Alternatively, the display unit 141 may include a projection module to output information through an image projected on the windshield.

The sound output unit 142 converts an electric signal from the control unit 180 into an audio signal and outputs the audio signal. For this purpose, the sound output unit 142 may include a speaker or the like. It is also possible for the sound output section 142 to output a sound corresponding to the operation of the user input section 124. [

The haptic output unit 143 generates a tactile output. For example, the haptic output section 143 may operate to vibrate the steering wheel, the seat belt, and the seat so that the user can recognize the output.

The vehicle drive unit 150 can control the operation of various devices of the vehicle. The vehicle driving unit 150 includes a power source driving unit 151, a steering driving unit 152, a brake driving unit 153, a lamp driving unit 154, an air conditioning driving unit 155, a window driving unit 156, an airbag driving unit 157, A driving unit 158 and a suspension driving unit 159.

The power source drive unit 151 can perform electronic control of the power source in the vehicle 100. [

For example, when the fossil fuel-based engine (not shown) is a power source, the power source drive unit 151 can perform electronic control of the engine. Thus, the output torque of the engine and the like can be controlled. When the power source driving unit 151 is an engine, the speed of the vehicle can be limited by limiting the engine output torque under the control of the control unit 180. [

As another example, when the electric-based motor (not shown) is a power source, the power source drive unit 151 can perform control on the motor. Thus, the rotation speed, torque, etc. of the motor can be controlled.

The steering driver 152 may perform electronic control of the steering apparatus in the vehicle 100. [ Thus, the traveling direction of the vehicle can be changed.

The brake driver 153 can perform electronic control of a brake apparatus (not shown) in the vehicle 100. [ For example, the speed of the vehicle 100 can be reduced by controlling the operation of the brakes disposed on the wheels. As another example, it is possible to adjust the traveling direction of the vehicle 100 to the left or right by differently operating the brakes respectively disposed on the left wheel and the right wheel.

The lamp driving unit 154 can control the turn-on / turn-off of the lamp disposed inside or outside the vehicle. Also, the intensity, direction, etc. of the light of the lamp can be controlled. For example, it is possible to perform control on a direction indicating lamp, a brake lamp, and the like.

The air conditioning driving unit 155 can perform electronic control on an air conditioner (not shown) in the vehicle 100. [ For example, when the temperature inside the vehicle is high, the air conditioner can be operated to control the cooling air to be supplied into the vehicle.

The window driving unit 156 may perform electronic control of a window apparatus in the vehicle 100. [ For example, it can control the opening or closing of left and right windows on the side of the vehicle.

The airbag drive unit 157 may perform electronic control of an airbag apparatus in the vehicle 100. [ For example, at risk, the airbag can be controlled to fire.

The sunroof driving unit 158 may perform electronic control of a sunroof apparatus (not shown) in the vehicle 100. [ For example, you can control the opening or closing of the sunroof.

The suspension driving unit 159 can perform electronic control on a suspension apparatus (not shown) in the vehicle 100. [ For example, when there is a curvature on the road surface, it is possible to control the suspension device so as to reduce the vibration of the vehicle 100. [

The memory 160 is electrically connected to the control unit 180. The memory 180 may store basic data for the unit, control data for controlling the operation of the unit, and input / output data. The memory 190 may be, in hardware, various storage devices such as ROM, RAM, EPROM, flash drive, hard drive, and the like.

The interface unit 170 may serve as a pathway to various kinds of external devices connected to the vehicle 100. For example, the interface unit 170 may include a port that can be connected to the mobile terminal 200, and may be connected to the mobile terminal 200 through the port. In this case, the interface unit 170 can exchange data with the mobile terminal 200.

Meanwhile, the interface unit 170 may serve as a passageway for supplying electrical energy to the connected mobile terminal 200. The interface unit 170 provides the electric energy supplied from the power supply unit 190 to the mobile terminal 200 under the control of the controller 180 when the mobile terminal 200 is electrically connected to the interface unit 170 do.

The control unit 180 can control the overall operation of each unit in the vehicle 100. [ The control unit 180 may be referred to as an ECU.

The controller 180 may be implemented in hardware as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs) processors, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions.

According to the control of the controller 180, the power supply 190 can supply power necessary for operation of each component. Particularly, the power supply unit 180 can receive power from a battery (not shown) or the like inside the vehicle.

3 to 4, the mobile terminal 200 includes a wireless communication unit 210, an input unit 220, a sensing unit 240, an output unit 250, an interface unit 260, a memory 270, A wireless charging unit 271, a control unit 280, a power supply unit 290, and the like. The components shown in FIG. 4 are not essential for implementing a mobile terminal, so that the mobile terminal described herein may have more or fewer components than the components listed above.

The wireless communication unit 210 may be connected between the mobile terminal 200 and the wireless communication system or between the mobile terminal 200 and another mobile terminal 200 or between the mobile terminal 200 and the external server 200. [ Lt; RTI ID = 0.0 > wireless < / RTI > In addition, the wireless communication unit 210 may include one or more modules that connect the mobile terminal 200 to one or more networks.

The wireless communication unit 210 may include at least one of a broadcast receiving module 211, a mobile communication module 212, a wireless Internet module 213, a short distance communication module 214 and a location information module 215 .

The input unit 220 includes a camera 221 or an image input unit for inputting an image signal, a microphone 222 for inputting an audio signal, or an audio input unit, a user input unit 123 for receiving information from a user A touch key, a mechanical key, and the like). The voice data or image data collected by the input unit 220 may be analyzed and processed by a user's control command.

The sensing unit 240 may include at least one sensor for sensing at least one of the information in the mobile terminal, the surrounding environment information surrounding the mobile terminal, and the user information. For example, the sensing unit 240 may include a proximity sensor 241, an illumination sensor 242, a touch sensor, an acceleration sensor, a magnetic sensor, A G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, A microphone 221, a battery gauge, an environmental sensor (such as a barometer, a hygrometer, a thermometer, a radiation detection sensor, a temperature sensor, A thermal sensor, a gas sensor, etc.), a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification can combine and utilize information sensed by at least two of the sensors.

The output unit 250 includes at least one of a display unit 251, an acoustic output unit 252, a haptrip module 253, and a light output unit 254 for generating an output related to a visual, auditory, can do. The display unit 251 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. The touch screen may function as a user input unit 223 for providing an input interface between the mobile terminal 200 and a user and may provide an output interface between the mobile terminal 200 and a user.

The interface unit 260 serves as a channel with various types of external devices connected to the mobile terminal 200. The interface unit 260 may be configured to connect a device having a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, And may include at least one of a port, an audio I / O port, a video I / O port, and an earphone port. In the mobile terminal 200, corresponding to the connection of the external device to the interface 260, it is possible to perform appropriate control related to the connected external device.

In addition, the memory 270 stores data supporting various functions of the mobile terminal 200. The memory 270 may store a plurality of application programs or applications driven by the mobile terminal 200, data for operation of the mobile terminal 200, and commands. At least some of these applications may be downloaded from an external server via wireless communication. Also, at least a part of these application programs may exist on the mobile terminal 200 from the time of departure for the basic functions (e.g., telephone call receiving function, message receiving function, and calling function) of the mobile terminal 200. Meanwhile, the application program may be stored in the memory 270, installed on the mobile terminal 200, and may be driven by the control unit 280 to perform the operation (or function) of the mobile terminal.

In addition to the operations related to the application program, the control unit 280 typically controls the overall operation of the mobile terminal 200. The control unit 280 may process or process signals, data, information or the like inputted or outputted through the above-mentioned components or may drive an application program stored in the memory 270 to provide or process appropriate information or functions to the user.

In addition, the controller 280 may control at least some of the components illustrated in FIG. 4 to drive an application program stored in the memory 270. FIG. Further, the control unit 280 may operate at least two or more of the components included in the mobile terminal 200 in combination with each other for driving the application program.

The control unit 280 may be implemented in hardware as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs) processors, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions.

The power supply unit 290 receives external power and internal power under the control of the controller 280 and supplies power to the respective components included in the mobile terminal 200. The power supply unit 290 includes a battery, which may be an internal battery or a replaceable battery.

At least some of the components may operate in cooperation with one another to implement a method of operation, control, or control of a mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 270. [

Hereinafter, the components listed above will be described in more detail with reference to FIG. 4 before explaining various embodiments implemented through the mobile terminal 200 as described above.

First, referring to the wireless communication unit 210, the broadcast receiving module 211 of the wireless communication unit 210 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. More than one broadcast receiving module may be provided to the mobile terminal 200 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The mobile communication module 212 may be a mobile communication module or a mobile communication module that is capable of communicating with one or more mobile communication devices in a mobile communication environment using technology standards or communication methods (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution And an external terminal, or a server on a mobile communication network established according to a long term evolution (AR), a long term evolution (AR), or the like.

The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 213 is a module for wireless Internet access, and may be embedded in the mobile terminal 200 or externally. The wireless Internet module 213 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) 213 transmit and receive data according to at least one wireless Internet technology in a range including internet technologies not listed above.

The wireless Internet module 213 for performing a wireless Internet connection through the mobile communication network can be used for wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE and LTE- May be understood as a kind of the mobile communication module 212.

The short-range communication module 214 is for short-range communication, and includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short distance communication module 214 may be connected to the mobile terminal 200 and the wireless communication system through the wireless area network or between the mobile terminal 200 and another mobile terminal 200 or between the mobile terminal 200 ) And another mobile terminal 200 (or an external server). The short-range wireless communication network may be a short-range wireless personal area network.

Here, another mobile terminal 200 is a wearable device (e.g., a smartwatch, a smart glass, etc.) capable of interchanging data with the mobile terminal 200 according to the present invention (smart glass), HMD (head mounted display)). The short range communication module 214 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 200 around the mobile terminal 200. If the detected wearable device is a device authenticated to communicate with the mobile terminal 200 according to the present invention, the control unit 280 may transmit at least a part of the data processed by the mobile terminal 200 to the short- 214 to the wearable device. Therefore, the user of the wearable device can use the data processed by the mobile terminal 200 through the wearable device. For example, according to this, when a phone is received in the mobile terminal 200, the user performs a phone call through the wearable device, or when a message is received in the mobile terminal 200, It is possible to check the message.

The position information module 215 is a module for obtaining the position (or current position) of the mobile terminal, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, it can acquire the position of the mobile terminal by using a signal transmitted from the GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, it can acquire the position of the mobile terminal based on information of a wireless access point (AP) that transmits or receives the wireless signal with the Wi-Fi module. Optionally, the location information module 215 may replace or additionally perform any of the other modules of the wireless communication unit 210 to obtain data regarding the location of the mobile terminal. The position information module 215 is a module used for obtaining the position (or the current position) of the mobile terminal, and is not limited to the module for directly calculating or acquiring the position of the mobile terminal.

Next, the input unit 220 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For inputting image information, Or a plurality of cameras 221 may be provided. The camera 221 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 251 or stored in the memory 270. [ The plurality of cameras 221 provided in the mobile terminal 200 may be arranged to have a matrix structure and various angles or foci may be provided to the mobile terminal 200 through the camera 221 having the matrix structure A plurality of pieces of image information can be input. In addition, the plurality of cameras 221 may be arranged in a stereo structure to acquire a left image and a right image for realizing the stereoscopic image.

The microphone 222 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or a running application program) being executed in the mobile terminal 200. Meanwhile, the microphone 222 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 223 is for receiving information from a user and when the information is inputted through the user input unit 223, the control unit 280 can control the operation of the mobile terminal 200 to correspond to the input information . The user input unit 223 may include a mechanical input means (or a mechanical key such as a button located on the front, rear or side of the mobile terminal 200, a dome switch, a jog wheel, Jog switches, etc.) and touch-type input means. For example, the touch-type input means may comprise a virtual key, a soft key or a visual key displayed on the touch screen through software processing, The virtual key or the visual key can be displayed on the touch screen with various forms. For example, the virtual key or the visual key can be displayed on the touch screen, ), An icon, a video, or a combination thereof.

Meanwhile, the sensing unit 240 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a corresponding sensing signal. The control unit 280 may control the driving or operation of the mobile terminal 200 or may perform data processing, function or operation related to the application program installed in the mobile terminal 200 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 240 will be described in more detail.

First, the proximity sensor 241 refers to a sensor that detects the presence of an object approaching a predetermined detection surface, or the presence of an object in the vicinity of the detection surface, without mechanical contact by using electromagnetic force or infrared rays. The proximity sensor 241 may be disposed in an inner area of the mobile terminal or in proximity to the touch screen, which is covered by the touch screen.

Examples of the proximity sensor 241 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is electrostatic, the proximity sensor 241 can be configured to detect the proximity of the object with a change in the electric field along the proximity of the object having conductivity. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the act of recognizing that the object is located on the touch screen in proximity with no object touching the touch screen is referred to as "proximity touch & The act of actually touching an object on the screen is called a "contact touch. &Quot; The position at which the object is closely touched on the touch screen means a position where the object corresponds to the touch screen vertically when the object is touched. The proximity sensor 241 is capable of sensing proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, have. Meanwhile, the control unit 280 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 241 as described above, and further provides visual information corresponding to the processed data It can be output on the touch screen. Further, the control unit 280 can control the mobile terminal 200 so that different operations or data (or information) are processed depending on whether the touch to the same point on the touch screen is a proximity touch or a touch contact .

The touch sensor uses a touch (or touch input) applied to the touch screen (or the display unit 251) using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, Detection.

For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the touch screen or a capacitance generated in a specific portion to an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, a capacitance at the time of touch, and the like where a touch object touching the touch screen is touched on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the control unit 280. Thus, the control unit 280 can know which area of the display unit 251 is touched or the like. Here, the touch controller may be a separate component from the control unit 280, and may be the control unit 280 itself.

On the other hand, the control unit 280 may perform different controls or perform the same control according to the type of the touch object, which touches the touch screen (or a touch key provided in the touch screen). Whether to perform different controls or to perform the same control depending on the type of the touch object may be determined according to the current state of the mobile terminal 200 or an application program being executed.

On the other hand, the touch sensors and the proximity sensors discussed above can be used independently or in combination to provide a short touch (touch), a long touch, a multi touch, a drag touch ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, and the like. Touch can be sensed.

The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. On the other hand, the controller 280 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera 221 includes at least one of a camera sensor (for example, a CCD, a CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 221 and the laser sensor can be combined with each other to sense a touch of a sensing object with respect to a three-dimensional stereoscopic image. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.

The display unit 251 displays (outputs) information processed by the mobile terminal 200. For example, the display unit 251 may display execution screen information of an application program driven by the mobile terminal 200 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

Also, the display unit 251 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system) can be applied.

The audio output unit 252 may output audio data received from the wireless communication unit 210 or stored in the memory 270 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 252 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, and the like) performed by the mobile terminal 200. [ The sound output unit 252 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 253 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 253 may be vibration. The intensity and pattern of the vibration generated in the haptic module 253 can be controlled by the user's selection or the setting of the control unit. For example, the haptic module 253 may combine and output different vibrations or sequentially output the vibrations.

In addition to vibration, the haptic module 253 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a scratch on the skin surface, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 253 can not only transmit the tactile effect through the direct contact but also can be implemented so that the user can feel the tactile effect through the muscular sense such as the finger or the arm. The haptic module 253 may include two or more haptic modules according to the configuration of the mobile terminal 200.

The light output unit 254 outputs a signal for notifying the occurrence of an event using the light of the light source of the mobile terminal 200. Examples of events that occur in the mobile terminal 200 may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output by the optical output unit 254 is implemented as the mobile terminal emits light of a single color or a plurality of colors to the front or rear surface. The signal output may be terminated by the mobile terminal detecting the event confirmation of the user.

The interface unit 260 serves as a path for communication with all external devices connected to the mobile terminal 200. The interface unit 260 receives data from an external device or supplies power to each component in the mobile terminal 200 or allows data in the mobile terminal 200 to be transmitted to an external device. For example, a port for connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, an audio input / output port, a video input / output port, an earphone port, and the like may be included in the interface unit 260.

The identification module is a chip for storing various information for authenticating the usage right of the mobile terminal 200 and includes a user identification module (UIM), a subscriber identity module (SIM) A universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 200 through the interface unit 260.

The interface unit 260 may be a path through which power from the cradle is supplied to the mobile terminal 200 when the mobile terminal 200 is connected to an external cradle, And various command signals may be transmitted to the mobile terminal 200. Various command signals or power from the cradle can be operated as a signal to recognize that the mobile terminal 200 is correctly mounted on the cradle.

The memory 270 may store a program for the operation of the control unit 280 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 270 may store data on vibrations and sounds of various patterns that are output upon touch input on the touch screen.

The memory 270 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read memory, a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and / or an optical disk. The mobile terminal 200 may operate in association with a web storage that performs a storage function of the memory 270 on the Internet.

The wireless charging unit 271 receives electric energy wirelessly from the vehicle when the mobile terminal 200 is electromagnetically coupled with the vehicle 100. [ The wireless charging unit 271 charges the battery using the supplied electric energy. At this time, the wireless charging unit 271 can receive electric energy from the vehicle 100 through an inductively coupled system or a resonant coupled system.

In the inductive coupling method, when the intensity of the current flowing in the primary coil of two adjacent coils is changed, the magnetic field is changed by the current, and thereby the secondary coil passes through the coil The magnetic flux is changed and an induced electromotive force is generated on the secondary coil side. That is, according to this method, induction electromotive force is generated when only the current of the primary coil is changed while keeping the two coils close to each other without moving the two conductors spatially. In this case, the frequency characteristic is not largely affected, but the arrangement between the transmitting apparatus including each coil (for example, a wireless charging apparatus of a vehicle) and the receiving apparatus (for example, mobile terminal) And the distance (Distance).

On the other hand, the resonance coupling method is a method in which a resonance frequency is applied to a primary coil of two coils spaced apart by a certain distance, And the induced electromotive force is generated in the secondary coil by being applied to the coil. That is, according to this method, when the transmitting and receiving devices resonate at the same frequency, the electromagnetic waves are transmitted through the near-field electromagnetic field, so that there is no energy transmission when the frequencies are different. In this case, the choice of frequency can be an important issue. Since there is no energy transfer between the resonance frequencies separated by a predetermined distance or more, the device to be charged can be selected through the resonance frequency selection. If only one device is assigned to one resonance frequency, the selection of the resonance frequency may have the meaning of selecting the device to be charged soon.

Compared to the inductive coupling method, the resonance coupling method has an advantage that the alignment and the distance between the transmitting device and the receiving device including each coil have a relatively less effect on the power efficiency.

Meanwhile, as described above, the control unit 280 controls an operation related to an application program and an overall operation of the mobile terminal 200. [ For example, when the state of the mobile terminal satisfies a set condition, the control unit 280 can execute or release a lock state for restricting input of a user's control command to applications.

In addition, the control unit 280 performs control and processing related to voice communication, data communication, video call, or the like, or performs pattern recognition processing capable of recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively . Further, the control unit 280 may control any one or a plurality of the above-described components in order to implement various embodiments described below on the mobile terminal 200 according to the present invention.

The power supply unit 290 receives external power and internal power under the control of the controller 280 and supplies power required for operation of the respective components. The power supply unit 290 includes a battery, the battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 290 may include a connection port, and the connection port may be configured as an example of an interface 260 through which an external charger for supplying power for charging the battery is electrically connected.

As another example, the power supply unit 290 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 290 may use at least one of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission apparatus and a magnetic resonance coupling method based on an electromagnetic resonance phenomenon Power can be delivered.

In the following, various embodiments may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

Referring to FIG. 3, the disclosed mobile terminal 200 includes a bar-shaped terminal body. However, the present invention is not limited thereto and can be applied to various structures such as a folder type, a flip type, a slide type, a swing type, and a swivel type in which a watch type, a clip type, a glass type or two or more bodies are relatively movably coupled . A description of a particular type of mobile terminal, although relevant to a particular type of mobile terminal, is generally applicable to other types of mobile terminals.

Here, the terminal body can be understood as a concept of referring to the mobile terminal 200 as at least one aggregate.

The mobile terminal 200 includes a case (for example, a frame, a housing, a cover, etc.) which forms an appearance. As shown, the mobile terminal 200 may include a front case 201 and a rear case 202. Various electronic components are disposed in the inner space formed by the combination of the front case 201 and the rear case 202. At least one middle case may be additionally disposed between the front case 201 and the rear case 202. [

A display unit 251 is disposed on a front surface of the terminal body to output information. The window 251a of the display unit 251 may be mounted on the front case 201 to form a front surface of the terminal body together with the front case 201. [

In some cases, electronic components may be mounted on the rear case 202 as well. The electronic parts that can be attached to the rear case 202 include detachable batteries, an identification module, a memory card, and the like. In this case, a rear cover 203 for covering the mounted electronic component can be detachably coupled to the rear case 202. Therefore, when the rear cover 203 is separated from the rear case 202, the electronic parts mounted on the rear case 202 are exposed to the outside.

As shown, when the rear cover 203 is coupled to the rear case 202, a part of the side surface of the rear case 202 can be exposed. In some cases, the rear case 202 may be completely covered by the rear cover 203 during the engagement. Meanwhile, the rear cover 203 may be provided with an opening for exposing the camera 221b or the sound output unit 252b to the outside.

These cases 201, 202 and 203 may be formed by injection molding of synthetic resin or may be formed of metal such as stainless steel (STS), aluminum (Al), titanium (Ti) or the like.

The mobile terminal 200 may be configured such that one case provides the internal space, unlike the above example in which a plurality of cases provide an internal space for accommodating various electronic components. In this case, a universal mobile terminal 200 in which a synthetic resin or a metal is connected from the side to the rear side can be realized.

Meanwhile, the mobile terminal 200 may include a waterproof part (not shown) for preventing water from penetrating into the terminal body. For example, the waterproof portion is provided between the window 251a and the front case 201, between the front case 201 and the rear case 202, or between the rear case 202 and the rear cover 203, And a waterproof member for sealing the inside space of the oven.

The mobile terminal 200 is provided with a display unit 251, first and second sound output units 252a and 252b, a proximity sensor 241, an illuminance sensor 242, a light output unit 254, Cameras 221a and 221b, first and second operation units 223a and 223b, a microphone 222, an interface unit 260, and the like.

3, a display unit 251, a first sound output unit 252a, a proximity sensor 241, an illuminance sensor 242, an optical output unit 254, A second operating unit 223b, a microphone 222 and an interface unit 260 are disposed on the side surface of the terminal body, and the first camera 221a and the first operating unit 223a are disposed on the rear surface of the terminal body. The mobile terminal 200 in which the second sound output unit 252b and the second camera 221b are disposed will be described as an example.

However, these configurations are not limited to this arrangement. These configurations may be excluded or replaced as needed, or placed on different planes. For example, the first operation unit 223a may not be provided on the front surface of the terminal body, and the second sound output unit 252b may be provided on the side surface of the terminal body rather than the rear surface of the terminal body.

The display unit 251 displays (outputs) information processed by the mobile terminal 200. For example, the display unit 251 may display execution screen information of an application program driven by the mobile terminal 200 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

The display unit 251 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) display, a 3D display, and an e-ink display.

In addition, the display unit 251 may exist in two or more depending on the embodiment of the mobile terminal 200. [ In this case, the mobile terminal 200 may be provided with a plurality of display portions spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

The display unit 251 may include a touch sensor that senses a touch with respect to the display unit 251 so as to receive a control command by a touch method. When a touch is made to the display unit 251, the touch sensor senses the touch, and the control unit 280 generates a control command corresponding to the touch based on the touch. The content input by the touch method may be a letter or a number, an instruction in various modes, a menu item which can be designated, and the like.

Meanwhile, the touch sensor is formed of a film having a touch pattern and is disposed between the window 251a and a display (not shown) on the rear surface of the window 251a, or a metal wire (not shown) directly patterned on the rear surface of the window 251a . Alternatively, the touch sensor may be formed integrally with the display. For example, the touch sensor may be disposed on a substrate of the display or inside the display.

In this way, the display unit 251 can form a touch screen together with the touch sensor. In this case, the touch screen can function as the user input unit 223 (see FIG. 3A). In some cases, the touch screen may replace at least some functions of the first operation unit 223a.

The first sound output unit 252a may be implemented as a receiver for transmitting a call sound to a user's ear and the second sound output unit 252b may be implemented as a loud speaker for outputting various alarm sounds or multimedia playback sounds. ). ≪ / RTI >

The window 251a of the display unit 251 may be provided with an acoustic hole for emitting sound generated from the first acoustic output unit 252a. However, the present invention is not limited to this, and the sound may be configured to be emitted along an assembly gap (for example, a gap between the window 251a and the front case 201) between the structures. In this case, the appearance of the mobile terminal 200 can be made simpler because the holes that are formed independently for the apparent acoustic output are hidden or hidden.

The light output unit 254 is configured to output light for notifying the occurrence of an event. Examples of the event include a message reception, a call signal reception, a missed call, an alarm, a schedule notification, an email reception, and reception of information through an application. The control unit 280 may control the light output unit 254 to terminate the light output when the event confirmation of the user is detected.

The first camera 221a processes an image frame of a still image or a moving image obtained by the image sensor in a photographing mode or a video communication mode. The processed image frame can be displayed on the display unit 251 and can be stored in the memory 270. [

The first and second operation units 223a and 223b may be collectively referred to as a manipulating portion as an example of a user input portion 223 operated to receive a command for controlling the operation of the mobile terminal 200 have. The first and second operation units 223a and 223b can be employed in any manner as long as the user is in a tactile manner such as touching, pushing, or scrolling. Also, the first and second operation units 223a and 223b can be employed in a manner that the user operates the touch panel without touching the user through a proximity touch, a hovering touch, or the like.

In the figure, the first operation unit 223a is a touch key, but the present invention is not limited thereto. For example, the first operation unit 223a may be a mechanical key or a combination of a touch key and a touch key.

The contents input by the first and second operation units 223a and 223b can be variously set. For example, the first operation unit 223a receives commands such as a menu, a home key, a cancellation, a search, and the like, and the second operation unit 223b receives a command from the first or second sound output unit 252a or 252b The size of the sound, and switching to the touch recognition mode of the display unit 251. [

Meanwhile, a rear input unit (not shown) may be provided on the rear surface of the terminal body as another example of the user input unit 223. The rear input unit is operated to receive a command for controlling the operation of the mobile terminal 200, and input contents may be variously set. For example, commands such as power on / off, start, end, scrolling, and the like, the size adjustment of sound output from the first and second sound output units 252a and 252b, and the touch recognition mode of the display unit 251 And the like can be inputted. The rear input unit may be implemented as a touch input, a push input, or a combination thereof.

The rear input unit may be disposed so as to overlap the front display unit 251 in the thickness direction of the terminal body. For example, the rear input unit may be disposed at the rear upper end of the terminal body such that when the user holds the terminal body with one hand, the rear input unit can be easily operated using the index finger. However, the present invention is not limited thereto, and the position of the rear input unit may be changed.

When a rear input unit is provided on the rear surface of the terminal body, a new type of user interface using the rear input unit can be realized. When the first operation unit 223a is not disposed on the front surface of the terminal body in place of at least a part of the functions of the first operation unit 223a provided on the front surface of the terminal body, The display unit 251 may be configured as a larger screen.

Meanwhile, the mobile terminal 200 may include a fingerprint recognition sensor for recognizing the fingerprint of the user, and the controller 280 may use the fingerprint information sensed through the fingerprint recognition sensor as authentication means. The fingerprint recognition sensor may be embedded in the display unit 251 or the user input unit 223.

The microphone 222 is configured to receive a user's voice, other sounds, and the like. The microphone 222 may be provided at a plurality of locations to receive stereophonic sound.

The interface unit 260 is a path through which the mobile terminal 200 can be connected to an external device. For example, the interface unit 260 may include a connection terminal for connection with another device (e.g., an earphone or an external speaker), a port for short-range communication (e.g., an infrared port (IrDA Port), a Bluetooth port A wireless LAN port, or the like), or a power supply terminal for supplying power to the mobile terminal 200. The interface unit 260 may be implemented as a socket for receiving an external card such as a Subscriber Identification Module (SIM) or a User Identity Module (UIM) or a memory card for information storage.

And a second camera 221b may be disposed on a rear surface of the terminal body. In this case, the second camera 221b has a photographing direction which is substantially opposite to that of the first camera 221a.

The second camera 221b may include a plurality of lenses arranged along at least one line. The plurality of lenses may be arranged in a matrix form. Such a camera may be termed an "array camera ". When the second camera 221b is constituted by an array camera, images can be taken in various ways using a plurality of lenses, and a better quality image can be obtained.

The flash 224 may be disposed adjacent to the second camera 221b. The flash 224 illuminates the subject toward the subject when the subject is photographed by the second camera 221b.

A second sound output unit 252b may be additionally disposed in the terminal body. The second sound output unit 252b may implement a stereo function together with the first sound output unit 252a and may be used for implementing a speakerphone mode during a call.

The terminal body may be provided with at least one antenna for wireless communication. The antenna may be embedded in the terminal body or formed in the case. For example, an antenna constituting a part of the broadcast receiving module 211 (see FIG. 3 (a)) may be configured to be fetchable from the terminal body. Alternatively, the antenna may be formed in a film type and attached to the inner surface of the rear cover 203, or a case including a conductive material may be configured to function as an antenna.

The terminal body is provided with a power supply unit 290 (see FIG. 3 (a)) for supplying power to the mobile terminal 200. The power supply unit 290 may include a battery 291 built in the terminal body or detachable from the outside of the terminal body.

The battery 291 may be configured to receive power through a power cable connected to the interface unit 260. In addition, the battery 291 may be configured to be wirelessly chargeable through a wireless charger. The wireless charging may be implemented by a magnetic induction method or a resonance method (magnetic resonance method).

The rear cover 203 is coupled to the rear case 202 so as to cover the battery 291 to restrict the release of the battery 291 and to protect the battery 291 from external impacts and foreign matter . When the battery 291 is detachably attached to the terminal body, the rear cover 203 may be detachably coupled to the rear case 202.

The mobile terminal 200 may be provided with an accessory that protects the appearance or supports or extends the function of the mobile terminal 200. [ One example of such an accessory is a cover or pouch that covers or accommodates at least one side of the mobile terminal 200. The cover or pouch may be configured to interlock with the display unit 251 to expand the function of the mobile terminal 200. Another example of an accessory is a touch pen for supplementing or extending a touch input to the touch screen.

5 is a flowchart referred to explain the operation of the vehicle according to the embodiment of the present invention.

First, the vehicle 100 will be described with reference to the drawings.

The vehicle 100 is coupled with the mobile terminal (S510). For example, when the mobile terminal 200 is mounted on a mount provided on the dashboard, the vehicle 100 is electromagnetically coupled to the mobile terminal 200. [

In a state where the vehicle 100 is electromagnetically coupled with the mobile terminal 200, the vehicle 100 wirelessly provides the mobile terminal 100 with electrical energy (S515). To this end, the vehicle 100 may include a wireless charging device. The vehicle 100 provides the mobile terminal 200 with electric energy available for charging the battery of the mobile terminal 200 using an inductive coupling method or a resonant coupling method.

Meanwhile, the vehicle 100 performs a pairing operation with the mobile terminal 200 through the communication unit 110 (S520). The vehicle 100 may perform the pairing with the mobile terminal 200 through the short distance communication module 113. [ For example, when the mobile terminal 200 is mounted on a docking station provided on the dashboard, a tagging operation is performed, and after authenticating the mobile terminal 200 through the NFC communication method, It is possible to perform a pairing operation. For example, when the passenger carrying the mobile terminal 200 is boarding the vehicle 100 or located within a predetermined distance from the vehicle 100, the vehicle 100 may perform Wi-Fi communication The mobile terminal 200 can perform a pairing operation.

Meanwhile, in the present embodiment, it is described that the pairing is performed after the coupling. However, it is specified that the coupling operation may be performed after the pairing, and that the order is not limited.

In a state that the vehicle 100 is paired with the mobile terminal 200, the vehicle 100 transmits the vehicle status information or the vehicle driving information to the mobile terminal 200 (S525). Here, the vehicle 100 can continuously transmit vehicle state information or vehicle driving information to the mobile terminal 200 in a state where the pairing is maintained.

The vehicle state information is information on the current state of the vehicle. For example, the vehicle status information may include tire air pressure information, replacement information of various consumables (e.g., engine oil, brake oil, mission oil, etc.), information on energy status (e.g., residual fuel, Temperature information of a dynamometer (e.g., engine, motor, battery), failure information of a part provided in the vehicle, and the like.

On the other hand, when the vehicle 100 is an automobile powered by an internal combustion engine, the energy is fossil fuel. When the vehicle 100 is an electric vehicle powered by a motor, the energy is electric energy.

The vehicle driving information is information generated during the operation of the vehicle. For example, the vehicle driving information may include vehicle speed information, RPM information of a vehicle, output information of a power source, trip information, destination information, remaining distance information to a destination, Driving efficiency information, energy consumption information according to mileage or driving time, and the like.

The vehicle 100 displays the vehicle status information or the vehicle driving information on the cluster (S530). For example, the vehicle 100 may include tire air pressure information, replacement information for various consumables (e.g., engine oil, brake oil, mission oil, cooling water, etc.), residual energy (e.g., residual fuel, Temperature information of the dynamometer (e.g., engine, motor, battery), and failure information of the parts provided in the vehicle can be displayed on the cluster. The vehicle 100 is also provided with vehicle speed information, RPM information of the vehicle, output information of the power source, trip information, destination information, remaining distance information to the destination, Energy consumption information according to information, mileage or driving time can be displayed in the cluster.

If a user input for controlling the mobile terminal 200 is received through the user input unit 124 in a state paired with the mobile terminal 200, the vehicle 100 transmits a signal corresponding to the user input To the mobile terminal 200 through the communication unit 110 (S540).

Thereafter, the vehicle 100 ends the pairing operation with the mobile terminal 200 (S545). For example, when the mobile terminal 200 is detached from the mount of the vehicle 100, the vehicle 100 ends the pairing operation with the mobile terminal 200. [ For example, when the passenger holding the mobile terminal 200 gets off the vehicle 100 or moves away from the vehicle 100 by a predetermined distance, the vehicle 100 terminates the pairing operation with the mobile terminal 200 do.

The vehicle 100 ends the coupling operation with the mobile terminal 200 (S546). For example, when the mobile terminal 200 is detached from the mount of the vehicle 100, the vehicle 100 ends the coupling with the mobile terminal 200.

On the other hand, in the present embodiment, the coupling is terminated after the end of pairing. However, it is specified that the pairing may be ended after the end of coupling, and that the order is not limited.

Next, the mobile terminal 200 will be described with reference to the drawings.

The control unit 280 of the mobile terminal controls the wireless communication unit 210 to perform coupling with the vehicle 100 (S560). When the mobile terminal 200 is mounted on a mount provided on the dashboard, the control unit 280 of the mobile terminal controls to be electromagnetically coupled to the vehicle 100.

In a state of being electromagnetically coupled with the vehicle 100, the control unit 280 of the mobile terminal controls to wirelessly receive electric energy from the vehicle 100 and charge the battery with the electric energy (S565) . The control unit 280 of the mobile terminal can charge the battery through the wireless charging unit 271. [ The mobile terminal 200 can wirelessly receive electric energy using an inductive coupling method or a resonant coupling method.

On the other hand, the control unit 280 of the mobile terminal performs a pairing operation with the vehicle 100 and controls to enter the vehicle mode (S570).

The control unit 280 of the mobile terminal can control the pairing with the vehicle 100 through the short distance communication module 213. [ For example, when the mobile terminal 200 is mounted on a mount provided on a dashboard, a tagging operation is performed, and the mobile terminal 200 transmits the vehicle 100 100 to perform a pairing operation. The control unit 280 of the mobile terminal 100 may authenticate the vehicle 100 after the vehicle 100 is authenticated by the control unit 280. In the case where the passenger carrying the mobile terminal 200 is present in the vehicle 100 or within a predetermined distance from the vehicle 100, Via the Wi-Fi communication method, to perform the pairing operation with the vehicle 100. [

Meanwhile, in the present embodiment, it is described that the pairing is performed after the coupling. However, it is specified that the coupling operation may be performed after the pairing, and that the order is not limited.

On the other hand, the vehicle mode is a mode for providing a passenger with a function suitable for driving the vehicle 100 in a state of being paired with the vehicle 100. [ The control unit 280 of the mobile terminal can graphically process the vehicle status information or the vehicle driving information received from the vehicle 100 and display the information on the display unit 251. [ The control unit 280 of the mobile terminal provides an application suitable for driving the vehicle (for example, navigation, a black box, a text to speech (TTS), a speech to text (STT), etc.) Or an existing application can be displayed suitably for vehicle operation.

In a state where the vehicle 100 is paired with the vehicle 100, the control unit 280 of the mobile terminal controls to receive the vehicle status information or the vehicle operation information from the vehicle 100 (S575). Here, the control unit 280 of the mobile terminal can continuously receive vehicle status information or vehicle driving information from the vehicle 100 in a state where the pairing is maintained.

The control unit 280 of the mobile terminal graphically processes at least any of vehicle state information, vehicle driving information, and vehicle auxiliary information generated based on the vehicle driving information or the vehicle driving information to generate an information providing screen. The control unit 280 of the mobile terminal controls the display unit 251 to display the information providing screen (S580). Here, the information included in the information providing screen may include more detailed information than the information provided through the clusters included in the vehicle 100. [ The information providing screen will be described with reference to Figs. 8A to 17.

When the user input is received through the user input unit 124 provided in the vehicle 100 while being paired with the vehicle 100, the control unit 280 of the mobile terminal transmits the user input to the wireless communication unit 210, Lt; / RTI > The control unit 280 of the mobile terminal generates a control command according to the user input. Here, the user input may be for controlling the screen displayed on the display unit 251. The control unit 280 of the mobile terminal may control to change the information providing screen according to the user input received through the wireless communication unit 210 (S585).

When a first user input is received through the wireless communication unit 210 in a state where a screen including a plurality of items is displayed on the display unit 251 and a first item among the plurality of items is highlighted, The control unit 280 may display the item to be highlighted by changing the item from the first item to the second item. When the second item is highlighted and the second user input is received through the wireless communication unit 210, the control unit 280 of the mobile terminal can select the second item. When a predetermined item is selected and the third user input is received through the wireless communication unit 210, the control unit 280 of the mobile terminal can adjust the volume.

Thereafter, the control unit 280 of the mobile terminal controls to terminate the pairing operation with the vehicle 100. In addition, the control unit 280 of the mobile terminal controls to release the vehicle mode after completing the pairing (S590). For example, when the mobile terminal 200 is detached from the mount of the vehicle 100, the mobile terminal 200 controls to terminate the pairing operation with the vehicle 100. [ For example, when the passenger holding the mobile terminal 200 gets off the vehicle 100 or moves away from the vehicle 100 by a predetermined distance, the mobile terminal 200 terminates the pairing operation with the vehicle 100 do.

The control unit 280 of the mobile terminal ends the coupling operation with the vehicle 100 (S591). For example, when the mobile terminal 200 is detached from the mount of the vehicle 100, the control unit 280 of the mobile terminal ends the coupling with the vehicle 100. [

On the other hand, in the present embodiment, the coupling is terminated after the end of pairing. However, it is specified that the pairing may be ended after the end of coupling, and that the order is not limited.

FIG. 6 is a diagram referred to explain a vehicle interior according to an embodiment of the present invention.

6, the vehicle 100 includes steering input means 121a, a dashboard 610, a cluster 620, and a mounting portion 630 therein.

The cluster 620 is placed on the dashboard 610 so that the information displayed in the cluster 620 can be confirmed while the driver holds the line of sight ahead of the vehicle 100. [

The cluster 620 displays vehicle status information under the control of the vehicle control unit 180. [ For example, the cluster 620 may store tire air pressure information, replacement information for various consumables (e.g., engine oil, brake fluid, mission oil, cooling water, etc.), residual energy (e.g., residual fuel, Temperature information of the dynamometer (e.g., engine, motor, battery), failure information of the parts provided in the vehicle, and indoor or outdoor temperature information of the vehicle. At this time, the cluster can display information with a predetermined icon or text.

The cluster 620 displays the vehicle driving information under the control of the vehicle control unit 180. [ For example, the cluster 620 may store the current speed information of the vehicle, the current RPM information of the vehicle, the current output information of the power source, the trip information, the destination information, the remaining distance information to the destination, Information on the driving efficiency, information on the mileage, and energy consumption information according to the driving time are displayed in the cluster. At this time, the cluster can display information in a predetermined instrument panel, graph or text.

The mounting portion 630 is mounted on the mobile terminal 200. The mounting portion 630 may be formed to mount the mobile terminal 200 of various sizes or manufacturers. The mounting portion 630 may include a fixing portion (not shown) for fixing the mobile terminal 200.

According to an embodiment, the mounting portion 630 may include an NFC communication module. When the NFC communication module is included in the mounting portion 630, when the mobile terminal 200 is mounted on the mounting portion 630, tagging is performed to pair the vehicle 100 and the mobile terminal 200 through the NFC communication method. Can be performed.

When the mobile terminal 100 is paired with the vehicle 100, the control unit 280 generates an information providing screen and displays the generated information providing screen on the display unit 251. Here, the information providing screen is a screen generated by graphically processing the vehicle status information or the vehicle driving information received from the vehicle 100 through the wireless communication unit 210.

7A and 7B are diagrams for explaining an operation of controlling a mobile terminal through a user input unit provided in a vehicle according to an embodiment of the present invention.

Referring to FIG. 7A, the vehicle 100 includes a user input 124. The user input unit 124 may be disposed in one area of the steering wheel 121a. The user input unit 124 may include a touch input means or a mechanical input means.

When the vehicle 100 and the mobile terminal 200 are paired, the driver can operate the user input portion 124 while holding the steering wheel 121a. In this case, the control unit 280 of the mobile terminal may receive the user input inputted through the user input unit 124 through the wireless communication unit 210. In the case of being paired through the NFC communication method, the control unit 280 of the mobile terminal can receive user input through the NFC communication method. When paired via the Wi-Fi communication method, the control unit 280 of the mobile terminal can receive the user input through the Wi-Fi communication method.

When the user input is received, the control unit 280 of the mobile terminal may control to change the information providing screen or select a predetermined item according to the user's input.

The navigation item 701, the media item 720 and the vehicle information item 703 are displayed on the display unit 251 of the mobile terminal 200 and the navigation item 701 is highlighted, When the first user input is received, the control unit 280 of the mobile terminal can display the item to be highlighted by changing the item from the navigation item to the media item. At this time, the navigation item is moved to the left of the screen, the size is reduced, the brightness diminishes, the media item moves to the center of the screen, and the size increases and the brightness diminishes. The first user input may be an input received through the right direction button 711 in the user input unit 124 of the vehicle.

When the navigation item is highlighted and the second user input is received through the wireless communication unit 210, the control unit 280 of the mobile terminal selects the navigation item. When the navigation item is selected, the control unit 280 of the mobile terminal displays a navigation screen on the entire display unit 251. Meanwhile, the second user input may be an input received through the enter button 715 in the user input unit 124.

When the navigation item is selected and the third user input is received through the wireless communication unit 210, the control unit 280 of the mobile terminal adjusts the volume. Here, the third user input may be the up or down direction buttons 713 and 714 in the user input unit 124.

When the user input unit 124 is configured as a touch pad, the mobile terminal 200 may be controlled in response to a touch input or a drag input in a predetermined direction.

Referring to FIG. 7B, the controller 280 of the mobile terminal can display a plurality of items 720 in a three-dimensional manner. For example, the control unit 280 of the mobile terminal may display a predetermined polyhedron on the display unit 251 and match each face of the polyhedron to a plurality of items.

When a first user input is received through the wireless communication unit 210 while the first item matched to the first face is displayed, the controller 280 of the mobile terminal three-dimensionally rotates the polyhedron in the first direction, And the second item matched to the second face is displayed.

For example, when a navigation item corresponding to the first face of the cube is displayed and a user input corresponding to the left display button input is received through the wireless communication unit 210, the control unit 280 of the mobile terminal To the left to display media items that match the second side.

8A to 8B are diagrams referred to for describing an operation of displaying vehicle state information or vehicle driving information according to an embodiment of the present invention.

8A, the control unit 180 of the vehicle displays vehicle status information 811, 812, and 813 or vehicle driving information 821, 822, 823, and 824 in a cluster 620 as text, icons, Or at least one of them.

The control unit 180 of the vehicle displays the room temperature information 811 in one area of the cluster screen. The control unit 180 of the vehicle displays trip information 812 in one area of the cluster screen. The control unit 180 of the vehicle displays the remaining energy information 813 in one area of the cluster screen.

The control unit 180 of the vehicle displays the current speed information 821 in one area of the cluster screen. The control unit 180 of the vehicle displays the current output information 822 of the power source in one area of the cluster screen. The control unit 180 of the vehicle displays the mileage information 823 in one area of the cluster screen. The control unit 180 of the vehicle displays the traveling mode information 824 in one area of the cluster screen.

The control unit 280 of the mobile terminal receives the vehicle status information or the vehicle driving information from the vehicle and displays more detailed information on the display unit 251 than information displayed in the cluster.

The control unit 280 of the mobile terminal can display the vehicle status information in at least one area of the information providing screen 830. [ For example, the control unit 280 of the mobile terminal includes power source status information 832, consumable replacement information 833, energy status information 834 and 835, and power source temperature information 832 in at least one area of the information providing screen 830 The tire pressure information 836, the tire pressure information 837, and the component failure information 838. [

On the other hand, when one of the items is selected according to the user input, the control unit 280 of the mobile terminal can display more detailed information about the selected item. Here, the user input may be input through the user input unit 124 provided in the vehicle or the user input unit 223 of the mobile terminal. For example, when the component failure information 838 is selected, the control unit 280 of the mobile terminal displays on the display unit 251 more detailed information about which failure has occurred in which part.

The control unit 280 of the mobile terminal can display the vehicle image 831 corresponding to the vehicle 100 in at least one area of the information providing screen 830. [ In this case, it is possible to control each of the above-described vehicle state information to be displayed in association with the vehicle image 831. [

8B, the control unit 280 of the mobile terminal controls the display of the tire inflation pressure information 861 by indicating an area 851 corresponding to the tire of the vehicle in the vehicle image 831. [

The control unit 280 of the mobile terminal instructs the area 852 corresponding to the engine of the vehicle in the vehicle image 831 to display the information 862 of the engine oil change.

The control unit 280 of the mobile terminal controls the display of the energy state information 863 by indicating an area 853 corresponding to the fuel tank or the battery of the vehicle in the vehicle image 831. [

The control unit 280 of the mobile terminal controls the display of the engine or motor temperature information 864 by indicating the area 852 corresponding to the engine or motor of the vehicle in the vehicle image 831. [

9-11 are diagrams that are referenced to describe various embodiments for displaying vehicle status information or vehicle driving information, in accordance with an embodiment of the present invention.

9, the control unit 280 of the mobile terminal receives the vehicle status information or the vehicle driving information from the vehicle, and displays more detailed information on the display unit 251 than information displayed in the cluster.

The control unit 280 of the mobile terminal can control to display the vehicle driving information in at least one area of the information providing screen 930. [ Here, the vehicle driving information may be an echo index 931 or an energy flow 932.

The Eco Index (931) is a measure of the current driving efficiency versus energy during driving. For example, when the vehicle 100 is an internal combustion engine vehicle, the fossil fuel is used as an energy source of the engine. At this time, the eco index 931 may be an index obtained by measuring the output (e.g., torque) of the engine relative to the consumed unit fossil fuel. Alternatively, the eco index 931 may be an index that measures the distance traveled to the unit fossil fuel consumed.

For example, when the vehicle 100 is an electric vehicle, electric energy is used as an energy source of the motor. At this time, the echo index 931 may be an index obtained by measuring the output (e.g., torque) of the motor with respect to the consumed unit electric energy. Alternatively, the echo index 931 may be an index obtained by measuring the distance traveled with respect to the consumed unit electric energy.

The control unit 280 of the mobile terminal may display the echo index 931 in text or graph form.

The energy flow 932 is a trend of energy consumption depending on mileage or traveling time. For example, if the vehicle 100 is an internal combustion engine, the energy flow 932 may be a trend of fossil fuel consumption relative to mileage or running time.

For example, if the vehicle 100 is an electric vehicle, the energy flow 932 may be a trend of consumption of electrical energy versus mileage or running time.

The controller 280 of the mobile terminal may display the energy flow 932 in text or graphs.

Referring to FIG. 10, the controller 280 of the mobile terminal may display at least one instrument panel image in one area of the information providing screen 1030. The controller 280 of the mobile terminal can display the first instrument panel image 1031 by matching the speed information of the vehicle. The control unit 280 of the mobile terminal can display the RPM information of the vehicle on the second instrument panel image 1032 and display the same. The controller 280 of the mobile terminal may display the energy remaining amount information on the third instrument panel image 1033 and display the same. The control unit 280 of the mobile terminal can display the instantaneous output information of the power source on the fourth instrument panel image 1034 and display it. The control unit 280 of the mobile terminal can display the power source temperature information on the fifth instrument panel image 1035. [

On the other hand, which information among the plurality of instrument panels is displayed and matched can be determined according to the user setting. For example, when the RPM information of the vehicle is matched with the first dashboard image according to the user input, the controller 280 of the mobile terminal may display and match the RPM information of the vehicle on the first dashboard image.

As described with reference to the drawings, there is an effect that the driver can intuitively grasp information by displaying the vehicle state information or the vehicle driving information by matching with the instrument panel image.

Referring to FIG. 11, the control unit 280 of the mobile terminal controls to display the vehicle driving information in one area of the information providing screen 1130. Here, the vehicle driving information may include driving history information or driving habit information.

The driving record information may include driving distance information according to the section driving, driving time information according to the section driving, fuel consumption information according to the section driving, and fuel efficiency information according to the section driving.

The control unit 280 of the mobile terminal controls to display the travel distance information 1131 according to the section travel in one area of the information providing screen 1130. The control unit 280 of the mobile terminal controls the driving time information 1132 according to the section driving to be displayed in one area of the information providing screen 1130. The control unit 280 of the mobile terminal controls the display unit 1130 to display the energy consumption information 1133 corresponding to the section operation in one area of the information providing screen 1130. The controller 280 of the mobile terminal controls to display the energy efficiency information 1134 according to the section operation on one area of the information providing screen 1130.

The control unit 280 of the mobile terminal can display the energy efficiency information 1134 by dividing the energy efficiency information 1134 by intervals. For example, when the driving section is divided into the first section, the second section, and the third section, the controller 280 of the mobile terminal calculates the energy efficiency information 1141 in the first section, the energy efficiency information in the second section 1142, and energy efficiency information 1143 in the third section. In this case, the controller 280 of the mobile terminal determines whether the interval in which the efficiency is in the first range is the first color, the interval in which the efficiency is in the second range is the second color, and the interval in which the efficiency is in the third range, It can be displayed in color. For example, when the efficiency of the first section is classified as green, the efficiency of the third section is yellow, and when the efficiency of the second section is classified as normal, the efficiency of the third section is considered as bad. , It can be displayed in red.

The control unit 280 of the mobile terminal determines the position of each area in which the traveling distance information 1131, the traveling time information 1132, the fuel consumption information 1133, and the fuel efficiency information 1134 are displayed, Can be changed.

The driving habit information 1136 is information obtained by evaluating the driving habits based on the operation of the steering wheel, the brake pedal, and the excel pedal provided in the vehicle 100 during the section operation and quantifying or grading the driving habits. For example, the control unit 280 of the mobile terminal can measure and quantify or classify each case in which rapid acceleration, rapid deceleration, and sudden lane change occur.

The control unit 280 of the mobile terminal may store the driving record information or the driving habit information in the memory 270 after the interval operation. The control unit 280 of the mobile terminal can transmit the driving record information or the driving habit information to the vehicle 100 through the wireless communication unit 210. [

Figs. 12 to 14 are diagrams referred to explain the operation of displaying necessary vehicle auxiliary information to the mobile terminal according to the state of the vehicle according to the embodiment of the present invention. Fig.

The control unit 280 of the mobile terminal can display the vehicle auxiliary information in one area of the information providing screen 1230. [ The vehicle auxiliary information may be information generated based on vehicle state information or vehicle driving information received from the vehicle 100 via the wireless communication unit 210. [ For example, the vehicle auxiliary information may be information determined to be necessary for the driver based on the vehicle state information or the vehicle driving information.

12, when the energy level of the vehicle 100 is equal to or lower than a predetermined value, the control unit 280 of the mobile terminal stores the energy charging place information in one area of the information providing screen 1230 Can be controlled. Here, the energy charging location information may include information on the location of the energy charging place near the current location of the vehicle, distance to the energy charging place, information on the required time, energy charging location information with the lowest charging charge, and the like. At this time, the control unit 280 of the mobile terminal can access the external server through the wireless communication unit 210 and receive energy charging location information.

13, when any one of the components provided in the vehicle 100 is broken down, the control unit 280 of the mobile terminal displays, as vehicle auxiliary information, a vehicle maintenance place Information can be controlled to be displayed. Here, the vehicle maintenance place information may include information on the location of the vehicle maintenance place near the current vehicle position, the distance to the vehicle maintenance place, the time required, the vehicle maintenance place information with the lowest maintenance cost, and the like. At this time, the control unit 280 of the mobile terminal can access the external server through the wireless communication unit 210 and receive the vehicle maintenance place information.

14, when the vehicle 100 is an electric vehicle and the electric vehicle is being charged, the control unit 280 of the mobile terminal may be provided with vehicle auxiliary information such that electric vehicles are charged in one area of the information providing screen 1430 It is possible to control the driver to display the place information where the driver can wait or receive a predetermined service. For example, the control unit 280 of the mobile terminal can control the display of nearby shopping center or resting facility information, which allows the driver to spend time during the charging time of the vehicle. At this time, the control unit 280 of the mobile terminal can access the external server through the wireless communication unit 210 and receive the place information.

FIG. 15 is a diagram for describing an operation of displaying an image around a vehicle obtained through a camera of a vehicle on an information providing screen according to an embodiment of the present invention.

Referring to FIG. 15, a camera 122 provided in the vehicle 100 may acquire a vehicle surroundings image. The vehicle periphery image obtained by the camera 122 provided in the vehicle may be a concept included in the vehicle driving information.

For example, the camera 122 provided in the vehicle 100 can acquire a rear image of the vehicle at the time of parking. For example, the camera 122 provided in the vehicle 100 may be constituted by a stereo camera to acquire an image of the front of the vehicle, and provide distance information with respect to the object detected on the stereo image through the parallax information . For example, the camera 122 provided in the vehicle 100 can acquire images of all directions of the vehicle using a camera used in an AVM (Around View Monitoring) system.

The control unit 280 of the mobile terminal controls the wireless communication unit 210 to receive the vehicle periphery image. The control unit 280 of the mobile terminal controls the received peripheral image of the vehicle to be displayed in one area of the information providing screen 1530.

FIG. 16 is a diagram for describing an operation of photographing in a mobile terminal when a user input is received through a user input portion of the vehicle, according to an embodiment of the present invention. FIG.

Referring to FIG. 16, the controller 280 of the mobile terminal may drive a camera 221 of the mobile terminal according to a user input to photograph a surrounding image. In a state in which the vehicle 100 and the mobile terminal 200 are paired, the control unit 280 of the mobile terminal can receive the user input and enter the shooting mode. Here, the user input may be input through the user input unit 124 of the vehicle 100, and may be transmitted to the mobile terminal 200 through the local area communication method. The control unit 280 of the mobile terminal receives the user input inputted through the user input unit 124 provided in the vehicle through the wireless communication unit 210, , The image obtained through the camera 221 of the mobile terminal can be stored in the memory 270.

17 is a diagram referred to explain an operation of displaying vehicle driving information obtained in a vehicle driving assist system on an information providing screen according to an embodiment of the present invention.

Referring to FIG. 17, the vehicle 100 may be provided with an ADAS (Advanced Driver Assistance System).

The ADAS includes a stereo camera. The ADAS detects the object in the image ahead of the vehicle obtained through the stereo camera. Here, the object may be a concept including a preceding vehicle, a pedestrian, a lane, and a traffic sign.

ADAS acquires various information about an object from an image acquired through a stereo camera. For example, the ADAS can acquire and obtain distance information with the object using the disparity information. In addition, ADAS can obtain traffic signal information displayed on traffic signs. In addition, the ADAS can obtain the lane information. Here, the information about the object acquired by the ADAS may be a concept included in the vehicle driving information.

The control unit 280 of the mobile terminal can receive information on the object obtained in the ADAS through the wireless communication unit 210. [ The control unit 280 of the mobile terminal can control the information about the object to be displayed in one area of the information providing screen 1730. [

The control unit 280 of the mobile terminal controls the object 1710 detected by the ADAS to be displayed in one area of the information providing screen 1730. The control unit 280 of the mobile terminal controls the distance information 1720 to the object 1710 acquired by the ADAS to be displayed in one area of the information providing screen 1730. The control unit 280 of the mobile terminal controls the traffic signal information 1740 acquired by the ADAS to be displayed in one area of the information providing screen 1730. The control unit 280 of the mobile terminal controls the lane information 1750 acquired by the ADAS to be displayed in one area of the information providing screen 1730.

Meanwhile, the control unit 280 of the mobile terminal acquires the image of the front of the vehicle through the camera 221 of the mobile terminal and displays the information on the object on the display unit 251, Augmented Reality).

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). In addition, the computer may include a controller 180 or 280. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

100: vehicle
200: mobile terminal

Claims (20)

A display unit;
A wireless communication unit for performing pairing with a vehicle having a camera for acquiring an image of a surrounding area and an ADAS (Advanced Driver Assistance System) for acquiring information about an object using the camera; And
Receiving information on the object detected based on the image from the paired vehicle,
And a control unit for controlling the display unit to display information about the object,
Wherein the information on the object includes distance information on the detected object and traffic signal information displayed on a traffic sign,
Wherein,
Speed driving, rapid deceleration, and sudden lane change of the vehicle are measured, numericalized, and graded to generate driving habit information, and further display on the display unit,
And transmits the driving habit information to the vehicle through the wireless communication unit. The method according to claim 1,
The vehicle comprising a cluster,
Wherein,
Receiving vehicle status information or vehicle driving information from the vehicle,
Graphics processing the at least one of the vehicle state information, the vehicle driving information, and the vehicle auxiliary information to generate an information providing screen including more detailed information than information provided through the cluster,
Controls to display the information providing screen on the display unit,
Wherein the vehicle auxiliary information is generated based on the vehicle state information or the vehicle driving information. The method according to claim 1,
And a wireless charger coupled electromagnetically with the vehicle to receive electrical energy for charging the battery wirelessly from the vehicle. 3. The method of claim 2,
Wherein the wireless communication unit receives a user input inputted through a user input unit provided in the vehicle,
Wherein the control unit controls the information providing screen to change or select a predetermined item according to the user input,
Wherein,
When a first user input is received through the wireless communication unit, a plurality of items are displayed in a state of being highlighted,
And selects a highlighted item when a second user input is received through the wireless communication unit. 3. The method of claim 2,
The control unit displays at least one of the power source status information, the consumable replacement information, the energy status information, the power source temperature information, the tire pressure information, and the failure information of the parts provided in the vehicle in at least one area of the information providing screen The mobile terminal comprising: 6. The method of claim 5,
Wherein the control unit controls to display a vehicle image corresponding to the vehicle in one area of the information providing screen. The method according to claim 6,
Wherein the control unit instructs an area corresponding to a tire of the vehicle in the vehicle image to display the tire air pressure information. The method according to claim 6,
The consumable is engine oil,
Wherein the control unit instructs an area corresponding to the engine of the vehicle in the image of the vehicle so as to display replacement information of the engine oil. The method according to claim 6,
The energy is fossil fuel or electric energy,
Wherein the control unit instructs an area corresponding to a fuel tank or a battery of the vehicle to display the energy state information in the image of the vehicle. The method according to claim 6,
The power source is an engine or a motor,
Wherein the control unit instructs an area corresponding to an engine or a motor of the vehicle to display temperature information of the engine or the motor in the vehicle image. 3. The method of claim 2,
Wherein the control unit controls the display unit to display at least one of an echo index obtained by measuring the energy efficiency relative to at least one region of the information providing screen and an energy flow indicative of a driving distance or an energy consumption amount according to the driving time, . 3. The method of claim 2,
The control unit displays a plurality of instrument panel images in at least one area of the information providing screen and displays at least one of the engine speed information, the RPM information of the vehicle, the energy remaining amount information, the power source output information of the vehicle, And controls one of the plurality of instrument panel images to be matched and displayed on the plurality of instrument panel images. 3. The method of claim 2,
Wherein the control unit controls to display at least one of traveling distance information, traveling time information, energy consumption information, and fuel efficiency information in at least one area of the information providing screen. 14. The method of claim 13,
And a memory for storing the driving distance information, the driving time information, the energy consumption information, the fuel efficiency information, or the driving habit information. 3. The method of claim 2,
Wherein the control unit controls to display the energy charging place information in at least one area of the information providing screen when the energy level of the vehicle is equal to or less than a predetermined value. 3. The method of claim 2,
Wherein the control unit controls to display the vehicle maintenance place information in at least one area of the information providing screen when any one of the parts provided in the vehicle is faulty. 3. The method of claim 2,
Wherein the vehicle is an electric vehicle, and when the electric vehicle is being charged,
Wherein the control unit displays place information in at least one area of the information providing screen that the driver can wait while the electric vehicle is being charged or a predetermined service can be provided. The method according to claim 1,
Further comprising a camera,
Wherein,
And displays information about the object as an augmented reality in a state in which the vehicle front image acquired through the camera is displayed on the display unit. The method according to claim 1,
A camera for acquiring a surrounding image; And
Further comprising a memory,
Wherein the wireless communication unit receives a user input inputted through a user input unit provided in the vehicle,
Wherein the control unit controls to store an image acquired through the camera in the memory according to the user input. A vehicle including a cluster, a camera for acquiring images of the surroundings, and an ADAS (Advanced Driver Assistance System) for acquiring information about the object using the camera; And
A display unit; A wireless communication unit for performing pairing with the vehicle; And means for receiving vehicle status information or vehicle driving information from the paired vehicle and performing at least one of the vehicle status information, the vehicle driving information, and the vehicle driving information or the vehicle auxiliary information generated based on the driving information, And a control unit for generating an information providing screen including information more detailed than information provided through the cluster and controlling the information providing screen to be displayed on the display unit,
Wherein,
Information on an object detected based on the image is received via the wireless communication unit and displayed on the display unit,
Wherein the information on the object includes distance information on the detected object and traffic signal information displayed on a traffic sign,
Wherein,
Speed driving, rapid deceleration, and sudden lane change of the vehicle are measured, numericalized, and graded to generate driving habit information, and further display on the display unit,
And to transmit the driving habit information to the vehicle through the wireless communication unit.

Images