KR20160023755A - Mobile terminal and method for controlling the same - Google Patents

Abstract

The prevent invention is to provide a mobile terminal for remotely controlling a vehicle by a user and a method for controlling the same. According to an embodiment disclosed in the specification, a mobile terminal which is always in contact with a user′s wrist and worn thereon comprises: a muscle detection sensor for detecting the movement of muscles in the user′s wrist; a proximity sensor which is positioned on a front portion of the wrist when wearing the mobile terminal to detect objects ahead; a wireless communication unit for performing communications with a vehicle control apparatus installed in a vehicle; and a control unit for transmitting a preset control command to the vehicle control apparatus based on any one between a value measured by the muscle detection sensor and a value measured by the proximity sensor or a combination thereof.

Description

[0001] MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME [0002]

TECHNICAL FIELD [0002] The present invention relates to a mobile terminal and a control method thereof, and more particularly to a mobile terminal and a control method thereof for remotely controlling a vehicle.

A terminal can be divided into a mobile / portable terminal and a stationary terminal depending on whether the terminal is movable. Again, the mobile terminal may be divided into a handheld terminal and a vehicle mount terminal according to whether the user can carry the mobile phone directly.

As the functions of the terminal are diversified, the terminal is implemented in the form of a multimedia device having a combination of functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, have. Further, in order to support and enhance the function of the terminal, it may be considered to improve the structural and software parts of the terminal.

Recently, various types of mobile terminals have been developed in consideration of user convenience. Among these, a wearable device includes all kinds of electronic devices that a user can wear on the body or clothes. Such a wearable device may be, for example, a smart watch, a wearable computer, a google glass, a Bluetooth headset, a smart wear, or the like.

Such a wearable device is implemented in the form of a multimedia device having a complex function according to various functions. For example, in addition to the basic functions provided as a clock in the case of a smart watch, the multimedia contents may be reproduced through a function of photographing a still image through a provided camera, recording a moving picture, or a display unit formed in the main body. Or various e-mail plug-ins or the like to check messages via the wireless Internet or access the social network.

Research has been actively conducted to provide users with more convenience by utilizing various functions of such mobile terminals or wearable devices.

Particularly, there is a growing need to utilize such mobile terminals or wearable devices in connection with the operation or operation of a vehicle.

The technical problem disclosed in the present specification is to provide a mobile terminal and a control method thereof for a user to remotely control a vehicle.

One embodiment disclosed in this specification is a mobile terminal that is always in contact with and worn by a user's wrist, comprising: a muscle detection sensor that senses the movement of the muscle of the user's wrist region; A proximity sensor for sensing an object in front of the vehicle, a wireless communication unit for communicating with a vehicle control device installed in the vehicle, and a value measured by the muscle sensor and a value measured by the proximity sensor, And transmits a predetermined control command to the vehicle control device based on a combination of the control command and the control command.

According to one embodiment, the control command is a control command for opening a door or a window of the vehicle, and the door is any one of a door and a trunk for at least one seat installed in the vehicle. .

According to an embodiment, whether or not the vehicle is operated by the control command is determined according to a distance between the mobile terminal and the vehicle control device.

According to an embodiment, the operation of the vehicle by the control command may be such that the distance between the vehicle control device and the mobile terminal is greater than or equal to a threshold value The operation of the vehicle by the control command is performed when the distance between the vehicle control device and the mobile terminal is close to the critical distance.

According to an embodiment, the mobile communication terminal further includes a location information module for recognizing the location of the mobile terminal, wherein the control unit controls the location of the vehicle control device received through the wireless communication unit and the location of the mobile terminal through the location information module And calculates a distance to the vehicle control device based on the calculated distance.

According to an embodiment, the controller detects movement of the muscles according to the distance between the wrist and the wrist detected through the proximity sensor.

According to one embodiment, the control unit transmits the control command corresponding to the shape of the finger or the wrist estimated based on the change of the muscle sensed through the muscle sensor through the wireless communication unit The mobile terminal is started.

According to one embodiment, the control command transmits a control command corresponding to the approach direction based on an approach direction of the mobile terminal to the vehicle control device.

According to one embodiment, the control command is a control command for opening a door of the vehicle corresponding to the approach direction.

According to one embodiment, the operation of the vehicle by the control command is such that, when the control command is determined at a distance based on a predetermined threshold distance between the vehicle control device and the mobile terminal, And when the distance between the vehicle control device and the mobile terminal belongs to a short distance based on the critical distance, the operation of the vehicle by the control command generated in the long distance is performed.

According to one embodiment, the mobile terminal further comprises an output unit for outputting the approach direction as one of display, voice and vibration, or a combination thereof.

According to one embodiment, the output section may be configured to display the guidance direction in one of display, voice, or vibration, or a combination thereof, so as to guide the approach direction in the predetermined approach direction when the approach direction is different from the predetermined approach direction To the mobile terminal.

According to one embodiment, the mobile terminal further comprises an input section for receiving, from a user, an input for selecting at least one vehicle control device for transmitting the control command among the plurality of vehicle control devices.

According to an embodiment, the control unit may further include a microphone, and the control unit may perform a confirmation procedure as to whether or not to transmit the control command to the vehicle control device by recognizing the user voice received through the microphone.

According to one embodiment, the control unit may perform an authentication procedure with the vehicle control device before transmitting the control command to the vehicle control device.

According to an embodiment, the control unit may perform a first authentication procedure to establish a communication connection with the vehicle control apparatus through the wireless communication unit.

According to an embodiment, the control unit may perform a second authentication procedure to transmit the control command to the vehicle control device when the mobile terminal is in the unlocked state.

According to an embodiment, the control unit can perform the third authentication procedure by recognizing the user's voice received via the microphone.

According to an embodiment, the controller may perform the third authentication procedure using the received user voice in the process of checking whether to transmit the control command to the vehicle control device.

According to one embodiment, an input unit for receiving, from a plurality of the vehicle control devices, an input for selecting at least one vehicle control device for transmitting the control command may be further included.

According to an embodiment of the present invention, there is provided a vehicle control device installed in a vehicle, the vehicle control device comprising: a communication unit that is in contact with a wrist part of the user at all times and performs communication with the worn mobile terminal; Wherein the mobile terminal measures a muscle movement of the user's wrist and transmits the predetermined control command to the vehicle control device when the measured value is equal to or greater than a threshold value A vehicle control device is disclosed.

According to one embodiment, a vehicle is characterized in that the vehicle control device is mounted.

In addition, an embodiment disclosed herein relates to a method of controlling a mobile terminal that is always in contact with and worn by a wearer's wrist, comprising the steps of: detecting a movement of the muscles of the wrist region of the user; A step of measuring an interval with an object through a proximity sensor toward a wrist portion of the wrist, and the control unit is operable to determine, based on a value measured by the muscle sensor and a value measured by the proximity sensor, And transmitting the preset control command via the wireless communication unit to the vehicle control device installed in the vehicle.

According to one embodiment, the control command is a control command for opening a door or a window of the vehicle, and the door is any one of a door and a trunk for at least one seat installed in the vehicle. A control method of the present invention will be described.

According to an embodiment, the control unit may further include a step of calculating a distance from the vehicle control device, wherein whether or not the vehicle is operated by the control command is determined according to a distance between the mobile terminal and the vehicle control device A control method of the mobile terminal is disclosed.

Determining whether the generation of the control command is generated at a remote distance based on the threshold distance, and if the control command generation is generated at a long distance, determining whether the distance between the vehicle control apparatus and the mobile terminal exceeds the threshold The method further comprises the step of performing the operation of the vehicle by the control command when it belongs to a short distance based on the distance.

According to one embodiment, the step of calculating the distance may include a step of recognizing the position of the mobile terminal by the position information module, and the step of determining the position of the vehicle control device received via the wireless communication part, And calculating a distance to the vehicle control device based on the position of the mobile terminal.

According to an embodiment, the step of transmitting to the vehicle control device may include detecting the movement of the muscles according to an interval between the wrist and the wrist measured through the proximity sensor. A control method is disclosed.

According to one embodiment, the method further comprises determining an approach direction of the mobile terminal to the vehicle control device, wherein the step of transmitting the control command to the vehicle control device comprises: The control command can be transmitted.

According to one embodiment, the output unit may further comprise outputting the approach direction as one of display, voice and vibration, or a combination thereof.

According to one embodiment, the output section may be configured to display the guidance direction in one of display, voice, or vibration, or a combination thereof, so as to guide the approach direction in the predetermined approach direction when the approach direction is different from the predetermined approach direction And outputting the output signal.

According to an embodiment, the control unit may further include a step of recognizing the user's voice received through the microphone and performing a checking procedure for transmitting the control command.

According to an embodiment, before the step of transmitting the control command to the vehicle control device, the control unit may further include performing an authentication procedure with the vehicle control device.

According to an embodiment, performing the authentication procedure may perform a first authentication procedure when establishing a communication connection with the vehicle control apparatus through the wireless communication unit.

According to one embodiment, performing the authentication procedure includes: changing the mobile terminal to an unlocked state by a second authentication procedure; generating the control command when the mobile terminal is in the unlocked state; And transmits the control command to the vehicle control device.

According to an embodiment, the step of performing the authentication procedure may include: performing a third authentication procedure by recognizing a user's voice received through a microphone, generating the control command upon successful authentication, To the vehicle control device.

According to one embodiment, the step of performing the authentication procedure may include performing a third authentication procedure using the received user voice in a process of performing a confirmation procedure as to whether or not to transmit the control command to the vehicle control device can do.

According to one embodiment, the input may further comprise receiving from an user an input for selecting at least one vehicle control device for transmitting the control command among the plurality of vehicle control devices.

Further, an embodiment disclosed in this specification discloses a computer-readable recording medium on which a computer program for executing the control method of the mobile terminal is recorded.

According to the mobile terminal or its control method according to an embodiment disclosed herein, when the mobile terminal controls the vehicle through the vehicle control device, the user inputs the user input through a sensor that detects the user's body, And control the vehicle accordingly.

In addition, according to the mobile terminal or the control method thereof according to the embodiment disclosed herein, it is possible to estimate the shape of the user's finger or wrist based on the muscle movement sensed through the sensor, It is possible to prevent the user from unintentionally controlling the vehicle because the vehicle control is performed through the mobile terminal.

Further, according to the mobile terminal or the control method thereof according to the embodiment disclosed in this specification, the vehicle is controlled based on the reference critical distance from the vehicle, thereby preventing the intrusion of the vehicle to the unintended vehicle.

In addition, according to the mobile terminal or the control method thereof according to the embodiment disclosed herein, it is possible to judge whether the user gives a force to the hand by using a proximity sensor additionally, It is possible to improve the accuracy of judgment as to whether or not it is.

Further, according to the mobile terminal or the control method thereof according to the embodiment disclosed herein, when the user determines the approach direction to the vehicle and outputs the approach direction corresponding thereto or outputs the guidance direction when the direction is different from the predetermined approach direction , The user can approach the vehicle in the intended direction, thereby allowing the vehicle to be controlled accordingly.

In addition, according to the mobile terminal or the control method thereof according to the embodiment disclosed herein, when the vehicle is controlled through the mobile terminal, the authentication procedure is performed so that the unauthorized person can not control the vehicle through the mobile terminal, It is possible to enhance security for vehicle control.

1 is a block diagram illustrating a mobile terminal according to one embodiment disclosed herein.
2A and 2B are conceptual diagrams of a communication system in which a mobile terminal can operate according to the present invention.
FIGS. 3A and 3B are front and rear views of a smart watch according to an embodiment of the present invention.
4A is a block diagram for explaining a vehicle control device related to the present invention.
4B is an exemplary view showing an example of external devices connected to the vehicle control device related to the present invention.
5 is an exemplary view for explaining a display unit of a vehicle control apparatus according to an embodiment disclosed herein.
6A is a block diagram showing a configuration of a vehicle control apparatus according to another embodiment disclosed herein.
6B is a block diagram showing a configuration of a vehicle control device according to another embodiment disclosed herein.
6C is an exemplary diagram illustrating a screen associated with a navigation function according to an embodiment disclosed herein.
7 is a view showing the distribution of muscles in the wrist region of the body.
8 is a longitudinal sectional view of a mobile terminal worn on a wrist according to an embodiment disclosed herein.
9 is a diagram illustrating an example of a finger shape of a user detected by a mobile terminal according to an embodiment disclosed herein.
10 is an exemplary view of a relationship between a mobile terminal and a vehicle according to an embodiment disclosed herein.
11 is an exemplary view of a scenario utilizing a mobile terminal according to an embodiment disclosed herein.
12 is an exemplary view of a scenario utilizing a mobile terminal according to another embodiment disclosed herein.
13 is a diagram illustrating an area around a vehicle in which a mobile terminal can be located according to an embodiment disclosed herein.
14 is a schematic configuration diagram of an electric vehicle having a battery charging device according to an embodiment disclosed herein.
FIG. 15 is a block diagram showing a stepwise control method of a mobile terminal according to an embodiment disclosed herein.
FIG. 16 is a block diagram showing a stepwise control method of a mobile terminal according to another embodiment disclosed herein.
FIG. 17 is a block diagram showing a stepwise control method of a mobile terminal according to another embodiment disclosed herein.
18 is a block diagram showing a stepwise control method of a mobile terminal according to another embodiment disclosed herein.
FIG. 19 is a block diagram showing a stepwise control method of a mobile terminal according to another embodiment disclosed herein.

The techniques disclosed in this specification can be applied to a mobile terminal and a control method thereof. In particular, the techniques disclosed in this specification can be applied to a wearable device that is linked to or interlocked with a vehicle and a control method thereof.

Specifically, the technique disclosed in the present specification relates to a mobile terminal that communicates with a vehicle control device installed in a vehicle, and operates in conjunction with or linked to the vehicle control device, and a control method thereof.

In particular, the technique disclosed in this specification can provide a mobile terminal capable of providing a traveling direction to a destination and interlocking with vehicle navigation, and a control method thereof.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC , A tablet PC (tablet PC), an ultrabook, a wearable device, and the like. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

The vehicle control apparatus described in the present specification may be applied to a telematics terminal, a navigation terminal, an AVN (Audio Video Navigation) terminal, a television, a 3D television, an A / V (Audio / A center, a call center, and the like.

In addition, the vehicle control apparatus described in this specification may also be in the form of a mobile terminal connected to the vehicle by wire or wirelessly. In this case, the vehicle control device may be a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP) A slate PC, a tablet PC, an ultrabook, a wearable device, and the like.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. . Also, the technical terms used herein should be interpreted as being generally understood by those skilled in the art to which the presently disclosed subject matter belongs, unless the context clearly dictates otherwise in this specification, Should not be construed in a broader sense, or interpreted in an oversimplified sense. In addition, when a technical term used in this specification is an erroneous technical term that does not accurately express the concept of the technology disclosed in this specification, it should be understood that technical terms which can be understood by a person skilled in the art are replaced. Also, the general terms used in the present specification should be interpreted in accordance with the predefined or prior context, and should not be construed as being excessively reduced in meaning.

Also, the singular forms "as used herein include plural referents unless the context clearly dictates otherwise. In this specification, the terms "comprising ", or" comprising ", etc. should not be construed as necessarily including the various elements or steps described in the specification, Or may be further comprised of additional components or steps. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

Furthermore, terms including ordinals such as first, second, etc. used in this specification can be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted.

Further, in the description of the technology disclosed in this specification, a detailed description of related arts will be omitted if it is determined that the gist of the technology disclosed in this specification may be obscured. It is to be noted that the attached drawings are only for the purpose of easily understanding the concept of the technology disclosed in the present specification, and should not be construed as limiting the spirit of the technology by the attached drawings.

Mobile terminal

Hereinafter, the configuration or form of the mobile terminal according to the embodiment disclosed herein will be described in detail with reference to FIGS. 1 to 3B.

1 is a block diagram illustrating a mobile terminal 100 in accordance with one embodiment disclosed herein.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (DVF-H) And a Digital Broadcasting System (ISDB-T) (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The mobile communication module 112 is configured to implement a video communication mode and a voice communication mode. The video call mode refers to a state of talking while viewing a video of the other party, and the voice call mode refers to a state in which a call is made without viewing the other party's video. In order to implement the video communication mode and the voice communication mode, the mobile communication module 112 is configured to transmit and receive at least one of voice and image.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Examples of the wireless Internet technology include a wireless LAN (WLAN), a wireless fidelity (WiFi) direct, a DLNA (Digital Living Network Alliance), a Wibro (Wireless broadband), a Wimax (World Interoperability for Microwave Access), HSDPA Can be used.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, NFC (Near Field Communication), etc. are used as short range communication technology .

The position information module 115 is a module for obtaining the position of the mobile terminal, and representative examples thereof include a Global Position System (GPS) module or a Wireless Fidelity (WiFi) module.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to an external device through the wireless communication unit 110. [ Further, the position information of the user and the like can be calculated from the image frame obtained by the camera 121. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data according to a control command for controlling the operation of the mobile terminal 100 applied by the user. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 may sense the position of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence of the user, the orientation of the mobile terminal, And generates a sensing signal (or sensing signal) for sensing the current state and controlling the operation of the mobile terminal 100. For example, the sensing unit 140 may detect whether the slide phone is opened or closed when the mobile terminal 100 is in the form of a slide phone. The sensing unit 140 may sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like.

The output unit 150 may include a display unit 151, an audio output module 153, an alarm unit 154, a haptic module 155, and the like in order to generate output related to visual, auditory, have.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the display unit 151 displays the photographed and / or received video or UI and GUI.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see the object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

Also, the display unit 151 may be configured as a stereoscopic display unit 152 for displaying a stereoscopic image.

Here, a stereoscopic image represents a 3-dimensional stereoscopic image, and a 3-dimensional stereoscopic image represents a progressive depth and reality in which objects are located on a monitor or a screen, It is an image that makes you feel the same as the space. 3D stereoscopic images are implemented using binocular disparity. The binocular parallax means a parallax caused by the position of two eyes away from each other. When two eyes see two different images and the images are transmitted to the brain through the retina and fused, the depth and real feeling of the stereoscopic image can be felt .

The stereoscopic display unit 152 may be applied to a three-dimensional display system such as a stereoscopic system (eyeglass system), an autostereoscopic system (non-eyeglass system), and a projection system (holographic system). The stereoscopic method, which is widely used in home television receivers, includes a Wheatstone stereoscopic method.

Examples of the autostereoscopic method include a parallax barrier method, a lenticular method, an integral imaging method, and a switchable lens method. The projection method includes a reflection type holographic method and a transmission type holographic method.

Generally, 3D stereoscopic images consist of left image (left eye image) and right image (right eye image). A top-down method of arranging a left image and a right image in one frame according to a method in which a left image and a right image are combined into a three-dimensional stereoscopic image, A checker board system in which pieces of a left image and a right image are arranged in a tile form, a left-to-right (right-side) Or an interlaced method in which rows are alternately arranged, and a time sequential (frame-by-frame) method in which right and left images are alternately displayed in time.

In addition, the 3D thumbnail image can generate a left image thumbnail and a right image thumbnail from the left image and right image of the original image frame, respectively, and combine them to generate one 3D thumbnail image. In general, a thumbnail means a reduced image or a reduced still image. The left image thumbnail and the right image thumbnail generated in this way are displayed on the screen with a difference of the left and right distance by the depth corresponding to the parallax between the left image and the right image, thereby exhibiting a stereoscopic spatial feeling.

The left and right images necessary for realizing the three-dimensional stereoscopic image can be displayed on the stereoscopic display unit 152 by a stereoscopic processing unit (not shown). The stereoscopic processing unit receives a 3D image and extracts a left image and a right image from the 3D image, or receives a 2D image and converts it into a left image and a right image.

On the other hand, when a display unit 151 and a sensor (hereinafter, referred to as 'touch sensor') that detects a touch operation form a mutual layer structure (hereinafter referred to as a 'touch screen' It can also be used as an input device in addition to the device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area where the touch object is touched on the touch sensor but also the pressure at the time of touch. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

Referring to FIG. 1, a proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is surrounded by the touch screen. The proximity sensor 141 may be provided as an example of the sensing unit 140. The proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface or an object existing in the vicinity of the detection surface without mechanical contact using an electromagnetic force or an infrared ray. The proximity sensor 141 has a longer life than the contact type sensor and its utilization is also high.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is electrostatic, it is configured to detect the proximity of the pointer by a change of the electric field along the proximity of an object having conductivity (hereinafter, referred to as a pointer). In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

In the case where the three-dimensional display unit 152 and the touch sensor have a mutual layer structure (hereinafter referred to as a 'three-dimensional touch screen') or a three-dimensional sensor that detects the touch operation and the stereoscopic display unit 152 are combined with each other The stereoscopic display unit 152 may also be used as a three-dimensional input device.

The sensing unit 140 may include a proximity sensor 141, a three-dimensional touch sensing unit 142, an ultrasonic sensing unit 143, and a camera sensing unit 144 as an example of the three-dimensional sensor.

The proximity sensor 141 measures the distance between the sensing surface (for example, a user's finger or a stylus pen) to which the touch is applied without mechanical contact using the force of the electromagnetic field or infrared rays. The terminal recognizes which part of the stereoscopic image has been touched using the distance. In particular, when the touch screen is of the electrostatic type, the proximity of the sensing object is detected by a change of the electric field according to the proximity of the sensing object, and the touch on the three-dimensional is recognized using the proximity.

The stereoscopic touch sensing unit 142 senses the strength or duration of a touch applied to the touch screen. For example, the three-dimensional touch sensing unit 142 senses a pressure to apply a touch, and when the pressing force is strong, recognizes the touch as a touch to an object located further away from the touch screen toward the inside of the terminal.

The ultrasonic sensing unit 143 is configured to recognize the position information of the sensing target using ultrasonic waves.

The ultrasound sensing unit 143 may include, for example, an optical sensor and a plurality of ultrasound sensors. The light sensor is configured to sense light, and the ultrasonic sensor is configured to sense ultrasonic waves. Since light is much faster than ultrasonic waves, the time it takes for light to reach the optical sensor is much faster than the time it takes for the ultrasonic waves to reach the ultrasonic sensor. Therefore, it is possible to calculate the position of the wave generating source using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera sensing unit 144 includes at least one of a camera 121, a photo sensor, and a laser sensor.

For example, the camera 121 and the laser sensor are combined with each other to sense a touch of a sensing target with respect to a three-dimensional stereoscopic image. When the distance information detected by the laser sensor is added to the two-dimensional image photographed by the camera, three-dimensional information can be obtained.

As another example, a photosensor may be stacked on a display element. The photosensor is configured to scan the movement of the object proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of light change, thereby acquiring position information of the object to be sensed.

The sensing unit 140 may further include a bio-signal detection sensor 145a and a muscle detection sensor 145b.

A detailed description of the biological signal detection sensor 145a and the muscle detection sensor 145b will be described later with reference to FIG. 3b.

The audio output module 153 can output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 153 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The sound output module 153 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 154 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events generated in the mobile terminal 100 include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 154 may output a signal for notifying the occurrence of an event by using a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the sound output module 153 so that the display unit 151 and the sound output module 153 may be classified as a part of the alarm unit 154 .

The haptic module 155 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 155 may be vibration. The intensity and pattern of the vibration generated by the hit module 155 can be controlled by the user's selection or setting of the control unit. For example, the haptic module 155 may combine and output different vibrations or sequentially output the vibrations.

In addition to the vibration, the haptic module 155 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 155 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sense of the finger or arm. At least two haptic modules 155 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read- And may include a storage medium of at least one type of disk and optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a port for connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, An audio I / O port, a video I / O port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM) A universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Therefore, the identification device can be connected to the terminal 100 through the interface unit 170. [

The interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, And various command signals may be transmitted to the mobile terminal 100. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal 100. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

 In addition, the control unit 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

In addition, if the state of the mobile terminal meets a set condition, the controller 180 can execute a lock state for restricting input of a control command of the user to the applications. In addition, the controller 180 may control the lock screen displayed in the locked state based on a touch input sensed through the display unit 151 in the locked state.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays , Microprocessors, microprocessors, microprocessors, and other electronic units for carrying out other functions. In some cases, the embodiments described herein may be implemented by the controller 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein.

The software code may be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

Next, a communication system that can be implemented through the mobile terminal 100 according to the present invention will be described.

2A and 2B are conceptual diagrams of a communication system in which the mobile terminal 100 according to the present invention can operate.

First, referring to FIG. 2A, the communication system may use different wireless interfaces and / or physical layers. For example, wireless interfaces that can be used by a communication system include Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA) , Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE)), Global System for Mobile Communications (GSM), and the like.

Hereinafter, for the sake of convenience of description, the description will be limited to CDMA. However, it is apparent that the present invention can be applied to all communication systems including CDMA wireless communication systems.

2A, a CDMA wireless communication system includes at least one terminal 100, at least one base station (BS) 270, at least one base station controller (BSCs) 275 , And a mobile switching center (MSC) The MSC 280 is configured to be coupled to a Public Switched Telephone Network (PSTN) 290 and BSCs 275. BSCs 275 may be coupled in pairs with BS 270 through a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL or xDSL. Thus, a plurality of BSCs 275 may be included in the system shown in FIG. 2A.

Each of the plurality of BSs 270 may include at least one sector, and each sector may include an omnidirectional antenna or an antenna pointing to a particular direction of radials from the BS 270. In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments and each of the plurality of frequency assignments may have a specific spectrum (e.g., 1.25 MHz, 5 MHz, etc.).

The intersection of sector and frequency assignment may be referred to as a CDMA channel. The BS 270 may be referred to as a Base Station Transceiver Subsystem (BTSs). In this case, one BSC 275 and at least one BS 270 may be collectively referred to as a " base station ". The base station may also indicate a "cell site ". Alternatively, each of the plurality of sectors for a particular BS 270 may be referred to as a plurality of cell sites.

As shown in FIG. 2A, a broadcasting transmitter (BT) 295 transmits a broadcasting signal to terminals 100 operating in the system. The broadcast receiving module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295.

In addition, Figure 2A shows a satellite 300 of a Global Positioning System (GPS). The satellite 300 aids in locating the mobile terminal 100. Although FIG. 2A shows two satellites, useful location information may be obtained by two or more satellites. The location information module 115 shown in FIG. 1 cooperates with the satellite 300 shown in FIG. 2A to obtain desired location information. Here, the position of the mobile terminal 100 can be tracked using all the techniques capable of tracking the location as well as the GPS tracking technology. Also, at least one of the GPS satellites 300 may optionally or additionally be responsible for satellite DMB transmission.

Of the typical operation of a wireless communication system, the BS 270 receives a reverse link signal from the mobile terminal 100. At this time, the mobile terminal 100 is connecting a call, transmitting or receiving a message, or performing another communication operation. Each of the reverse link signals received by the particular base station 270 is processed by the particular base station 270. The data resulting from the processing is transmitted to the connected BSC 275. The BSC 275 provides call resource allocation and mobility management functions, including the organization of soft handoffs between the base stations 270. BSCs 275 also transmit the received data to MSC 280 and MSC 280 provides additional transport services for connection with PSTN 290. [ Similarly, the PSTN 290 is connected to the MSC 280, the MSC 280 is connected to the BSCs 275, and the BSCs 275 are connected to the BS 100 so that the forward link signal is transmitted to the mobile terminal 100 270 can be controlled.

Next, a method of acquiring location information of a mobile terminal using a WiFi (Wireless Fidelity) Positioning System (WPS) will be described with reference to FIG. 2B.

A WiFi Positioning System (WPS) 300 uses a WiFi module included in the mobile terminal 100 and a wireless access point 320 transmitting or receiving a wireless signal with the WiFi module, Is a technology for tracking the position of the terminal 100, and refers to a WLAN (Wireless Local Area Network) based positioning technology using WiFi.

The WiFi location tracking system 300 includes a Wi-Fi location server 310, a mobile terminal 100, a wireless AP 330 connected to the mobile terminal 100, and a database 330 in which certain wireless AP information is stored .

The WiFi location server 310 extracts information of the wireless AP 320 connected to the mobile terminal 100 based on the location information request message (or signal) of the mobile terminal 100. The information of the wireless AP 320 connected to the mobile terminal 100 may be transmitted to the Wi-Fi position server 310 through the mobile terminal 100 or may be transmitted from the wireless AP 320 to the Wi- Lt; / RTI >

SSID, RSSI, channel information, Privacy, Network Type, Signal Strength, and Noise Strength based on the location information request message of the mobile terminal 100, Lt; / RTI >

The WiFi location server 310 receives the information of the wireless AP 320 connected to the mobile terminal 100 and transmits the information included in the built-in database 330 and the received wireless AP 320, And extracts (or analyzes) the location information of the mobile terminal 100 by comparing the information.

2B, the wireless APs connected to the mobile terminal 100 are illustrated as first, second, and third wireless APs 320 as an example. However, the number of wireless APs connected to the mobile terminal 100 can be variously changed according to the wireless communication environment in which the mobile terminal 100 is located. The WiFi location tracking system 300 is capable of tracking the location of the mobile terminal 100 when the mobile terminal 100 is connected to at least one wireless AP.

Next, the database 330 may store various information of arbitrary wireless APs located at different locations, as will be described in more detail with respect to a database 330 in which arbitrary wireless AP information is stored.

The information of any wireless APs stored in the database 300 includes at least one of MAC address, SSID, RSSI, channel information, privacy, network type, radar coordinate of the wireless AP, (Available in GPS coordinates), address of the AP owner, telephone number, and the like.

Since the database 330 stores any wireless AP information and location information corresponding to the wireless AP, the WiFi location server 310 can search the mobile terminal 100 in the database 330, The location information of the mobile terminal 100 can be extracted by searching for wireless AP information corresponding to the information of the wireless AP 320 connected to the wireless AP 320 and extracting location information matched with the retrieved wireless AP information.

The extracted location information of the mobile terminal 100 is transmitted to the mobile terminal 100 through the Wi-Fi location server 310 so that the mobile terminal 100 can acquire the location information.

Hereinafter, an embodiment of a mobile terminal according to an embodiment disclosed herein will be described with reference to FIGS. 3A and 3B.

3A and 3B are front and rear views of a smart watch according to an embodiment of the present invention.

That is, FIGS. 3A and 3B show a case where the mobile terminal 100 has a smart watch type which is a watch type mobile terminal in the form of a wearable device.

The disclosed Smart Watch (200) has a rectangular shape. However, the present invention is not limited thereto, and it goes without saying that the present invention is also applicable to a smart watch having various structures, that is, a polygonal structure of various shapes such as a circle or a triangle.

According to one embodiment, the smart watch 200 comprises a band 230 and a body 220. The outer case of the main body 220 may be divided into a front case 210 and a rear case 250. Various electronic parts are embedded in the space formed between the front case 210 and the rear case 250. [ At least one intermediate case may be additionally disposed between the front case 210 and the rear case 250. [ The cases may be formed by injection molding a synthetic resin or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti) or the like.

3A, a display unit 151, a camera 121, a microphone 122, and the like may be disposed on the front case 210.

The display unit 151 occupies most of the main surface of the front case 210. A camera 121 and a microphone 122 may be disposed at both ends of the display unit 151.

On the other hand, the display unit 151 may display various types of time information. These pieces of information can be displayed in the form of letters, numbers, symbols, graphics, or icons.

At least one of the letters, numbers, symbols, graphics, or icons may be displayed in a predetermined arrangement for inputting such information, thereby being implemented as a keypad. Such a keypad may be called a so-called " soft key ".

The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with each other.

Also, a wired / wireless headset port (not shown) and a wired / wireless data port (not shown) may be disposed on one side of the main body 220 of the smart watch 200. The ports are configured as an example of the interface 170 (see FIG. 1).

Referring to FIG. 3B, the first sensor 145a may be disposed on the rear surface of the main body 220, that is, on the rear case 250. The first sensor 145a corresponds to the biological signal detection sensor 145a shown in FIG. 1, and may be a sensor for detecting a user's skin condition or a user's biological signal.

In addition, a second sensor 145b may be disposed in at least one region of the band 230 that is in contact with the skin of the rear part of the wrist of the actual user to detect movement of the user's muscles. The second sensor 145b corresponds to the muscle sensor 145b shown in FIG. 1, and a specific embodiment using the second sensor 145b will be described later in detail.

An antenna for receiving broadcast signals may be additionally disposed on the side surface of the main body 220. An antenna constituting a part of the broadcast receiving module 111 (see FIG. 1) may be installed to be able to be drawn out from the main body 220.

The main body 220 of the smart watch 200 may include an audio output module (not shown), an interface, and the like. A user input unit 340 and a connection port may be disposed on the side surfaces of the front case 210 and the rear case 250.

The user input unit 240 is operated to receive a command for controlling the operation of the smart watch 200 and may include at least one operation unit 240a, 240b, 240c, and 240d. The operating units may also be referred to as manipulating portions and may be employed in any manner as long as the user is operating in a tactile manner with a tactile impression.

Contents inputted by a plurality of operation units can be set variously. For example, inputting a command such as start, end, scroll, and the like, adjusting the size of sound output from the sound output unit 152, or switching the touch recognition mode of the display unit 151 have.

The connection port receives data from an external device or supplies power to each component in the smart watch 200 or allows data in the smart watch 200 to be transmitted to an external device. The connection port may be configured as an example of the interface 170 (see FIG. 1).

A main body 220 of the smart watch 200 is provided with a power supply unit (not shown) for supplying power to the smart watch 200. The power supply unit may be built in the main body 220.

It will be apparent to those skilled in the art that the techniques for mobile terminals or wearable devices disclosed herein may be embodied in other specific forms without departing from the spirit of the invention disclosed herein.

Vehicle control device

Hereinafter, the vehicle control device disclosed in this specification and the navigation function that can be performed by the vehicle control device will be described in detail with reference to Figs. 4A to 6C.

6A is a block diagram for explaining a vehicle control apparatus related to the present invention.

6B is an exemplary view showing an example of external devices connected to the vehicle control device related to the present invention.

6A and 6B are block diagrams for explaining a vehicle control apparatus according to an embodiment disclosed herein, and FIG. 6B is a block diagram of a vehicle control apparatus according to an embodiment disclosed herein, And an example of external devices is shown.

6A, a vehicle control apparatus 400 according to an embodiment of the present invention includes a control unit 410, a sensing unit 430 connected to the control unit 410, a vehicle driving unit 420, And a memory 440, and may further include an output unit 450. The vehicle control apparatus 400 may be formed in a body portion of a vehicle including an outer frame forming an outer appearance of the vehicle, a window, and an inner frame formed so that the user can ride. Here, the components shown in FIG. 6A are not essential in implementing the vehicle control apparatus 400 related to the present invention, so that the vehicle control apparatus 400 described in this specification may be configured to have more , Or may have fewer components.

The sensing unit 430 may include at least one sensor for sensing at least one of information in the vehicle control device 400, surrounding environment information surrounding the vehicle control device 400, and user information. For example, the sensing unit 430 may include a proximity sensor 432, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, a gravity sensor A G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, A sensor such as an optical sensor, an environmental sensor (for example, a barometer, a hygrometer, a thermometer, a radiation sensor, a heat sensor, a gas sensor, And the like). Meanwhile, the vehicle control apparatus 400 disclosed in this specification can combine and utilize the information sensed by at least two of the sensors.

Meanwhile, the sensing unit 430 may further include a near field communication module 431. The short-range communication module 431 is for short-range communication. The short-range communication module 431 may be a Bluetooth ™, a Radio Frequency Identification (RFID), an Infrared Data Association (IrDA), an Ultra Wideband (UWB) (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short range communication module 431 may support wireless communication between the vehicle control device 400 and the external device 170 (see FIG. 6B) through the wireless area networks.

The external device may be the mobile terminal 100 described above. In particular, the external device may be a wearable device 200, which is a form of the mobile terminal described above.

The vehicle drive unit 420 can release the locked state of the vehicle or switch the state of the vehicle to the locked state. Here, the locked state of the vehicle may be a state in which the function of the vehicle is limited in whole or in part, or the state in which the vehicle is not started or the door is not opened. On the contrary, the state in which the locked state is released means that at least one of a door of a driver's seat or an assistant seat of a vehicle, a door of a rear seat or a trunk is opened, or all the functions of the vehicle, Or a variety of functions such as a navigation function and a ventilation function can be made available.

In addition, the vehicle drive unit 420 may change various settings of the vehicle or perform functions automatically. For example, the vehicle drive unit 420 may control the components of the vehicle such as the driver's seat of the front seat, the degree of opening of the assistant's seat, the angle of the side mirror, And the seat height of at least one of the driver's seat or the assistant and rear seats or the horizontal position of the seat (for example, the distance between the seats) can be adjusted. In addition, the vehicle driver 120 may set the steering wheel handle setting, that is, the height of the steering wheel, the sensitivity of the steering wheel, etc., under the control of the controller 410. In addition, the vehicle drive unit 420 may cause the gear of the vehicle to operate in the automatic shift mode or the manual shift mode under the control of the control unit 410. In the case of a hybrid vehicle, Or a mode in which an electric motor is used may be preferentially selected.

The vehicle driving unit 420 may change not only the physical setting state of the vehicle but also the software setting according to the control of the controller 410. [ For example, the vehicle drive unit 420 may display a preset music list under the control of the control unit 410, or may automatically reproduce one of the music on the preset list. Or the vehicle driving unit 420 may automatically set a predetermined specific destination and automatically display the route to the specific destination through the provided navigation. Alternatively, the vehicle drive unit 420 may automatically set the vehicle-to-vehicle distance or the vehicle speed under the control of the control unit 410 at the time of cruise control of the vehicle.

To this end, the vehicle driving unit 420 may have at least one different lower driving unit, and each of the lower driving units may change a physical setting state or a software setting state of the vehicle. Hereinafter, the lower driving unit for changing the physical setting state of the vehicle will be referred to as a first driving unit 421, and the lower driving unit for changing the software setting state of the vehicle will be referred to as a second driving unit 422. [

The first driving unit 421 may include other components that can change an outer frame or an inner frame of the vehicle to change a physical setting of the vehicle. For example, the first driving unit 421 may further include a physical driving unit for adjusting the height of the seat or the angle of the backrest, and may include an elastic member such as a coil or a spring for increasing or decreasing the height of the handle, And a handle height adjusting unit including the handle height adjusting unit.

Meanwhile, the second driver 422 may be implemented by at least one application program or application. For example, the second drive unit 122 may be implemented as an application program for playing back any one of application programs for driving navigation or pre-stored media data (for example, MP3) These application programs or applications may be any of those for driving control of the vehicle.

The output unit 450 includes at least one of a display unit 451, an acoustic output unit 452, a haptrip module 453, and a light output unit 454 to generate an output related to visual, auditory, can do. The display unit 451 for displaying various image information may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. This touch screen may function as a user input portion 423 that provides an input interface between the vehicle control device 100 and a user and may provide an output interface between the vehicle control device 400 and the user.

Such a touch screen can be implemented in various parts of the vehicle. For example, the touch screen may be implemented on all or part of a windshield glass of a vehicle, and may be an outer surface (a surface exposed to the outside of the vehicle) or an inner surface (a surface facing the inside of the vehicle) Lt; / RTI > Also, the touch screen may be implemented on a window on a side of a driver's seat, a window on a side surface of an assistant's seat, or an outer surface or an inner surface of a window in a rear seat of the vehicle. Alternatively, the touch screen may be implemented in a side mirror of a vehicle or a sunroof of a vehicle.

Such a touch screen may also be implemented not only in the gals portion of the vehicle's window or sunroof, but also in the outer or inner frame of the vehicle. For example, the touch screen may be implemented on a surface of an outer frame of a vehicle, such as an A-pillar, a B-pillar, a C-pillar, between a windshield glass and a window, or between a window and a window. Or at least a portion of the exterior surface of the vehicle door (e.g., near the handle portion of the vehicle door). In addition, the touch screen may be formed on a cover surface of a gear box inside the vehicle or on a cover portion of a console box. It should be understood that a plurality of touch screens may be formed on at least one or more different portions of the vehicle.

The memory 440 stores data supporting various functions of the vehicle control device 400. [ The memory 440 may store a plurality of application programs (application programs or applications) driven by the vehicle control device 400, data for operation of the vehicle control device 400, and commands. At least some of these applications may be downloaded from an external server via wireless communication. At least some of these application programs may also be present on the vehicle control device 400 from the time of departure for the basic functions of the vehicle control device 400 (e.g., start function, navigation function, vehicle lock and unlock function) . On the other hand, the application program is stored in the memory 440, installed on the vehicle control device 400, and can be driven by the control unit 410 to perform the operation (or function) of the vehicle control device.

According to one embodiment, the application program may be a navigation program that performs a navigation function.

In addition, the memory 440 may store information related to at least one or more users. Here, the user-related information may be information on the authentication information of the user and the setting status of various vehicles set by the user directly or appropriately set based on the user's biometric information. For example, it may be internal temperature or humidity of a vehicle set by a specific user, or setting information according to a user's driving habits. Or the travel route record of the user may be such information. The authentication information may be information on a password, a pattern preset by the user, or information based on the user's biometric information such as fingerprint or iris recognition information. Alternatively, the authentication information may be information related to a user's gesture.

According to one embodiment, the biometric information of the user may be obtained by the mobile terminal 100 or the wearable device 200.

In this case, the wearable device may further include a communication unit that communicates with a vehicle control device installed in the vehicle, and a biometric information obtaining unit that obtains biometric information on the user from the specific body part (e.g., the wrist) .

Here, the communication unit may transmit the acquired biometric information of the user to the vehicle control device 400, and the storage unit 440 may store the biometric information of the user.

The biometric information may be at least one of information on the heart rate, body fat, blood pressure, blood sugar, face shape, fingerprint, brain waves, and iris for the user.

The memory 440 may store a program for the operation of the controller 410 and may temporarily store input / output data (e.g., user authentication information and operation environment setting information). The memory 440 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 440 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable memory (EEPROM) read-only memory (ROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk. The vehicle control apparatus 400 may be operated in association with a web storage that performs a storage function of the memory 440 on the Internet.

In addition to the operation related to the application program, the control unit 410 typically controls the overall operation of the vehicle control device 400. [ The control unit 410 may control the driving of the vehicle by processing signals, data, information or the like inputted or outputted through the above-mentioned components or driving an application program stored in the memory 440. In addition, the control unit 410 may control at least some of the components illustrated in FIG. 1A in order to drive an application program stored in the memory 440. Further, the control unit 410 may operate at least two or more of the components included in the vehicle control device 400 in combination with each other for driving the application program.

Meanwhile, the control unit 410 can receive authentication information from a user, and can determine whether the user is an authenticated user based on the input authentication information. Here, the authentication information may be a fingerprint of the user or recognition information of a predetermined pattern. Or the authentication information may be iris recognition information of a user or information related to a specific gesture of a user. For example, the control unit 410 may recognize information of a pattern of a plurality of knocks (for example, tabs or knocks) applied to a portion of a surface of the vehicle exterior or interior by a user, Or a touch screen area formed on a surface of a part of the interior, a window of a driver's seat or an assistant's seat, and a windshield glass, etc., as the authentication information. Alternatively, the control unit 410 may recognize a user's gesture made inside or outside the vehicle by using a photosensor or a camera provided in the sensing unit 430, or may recognize the iris information of the user.

Then, the control unit 410 can release the locked state of the vehicle only for the authenticated user. Therefore, the vehicle control apparatus 400 has: The user can open the door of the vehicle or open the trunk or the like without using the key. Alternatively, the vehicle may be started using the authentication information of the predetermined user. Or vice versa to switch the state of the vehicle to the locked state. That is, the control unit 410 may maintain the locked state of the vehicle until the authentication information of the authenticated user is input again based on the selection of the authenticated user. On the other hand, when the authentication information of the user is inputted through the outside of the vehicle while the vehicle is unlocked, the control unit 410 can switch the state of the vehicle to the locked state based on the user's authentication information. If the same authentication information is input once again while the vehicle is switched to the locked state, the vehicle may be switched to the unlocked state again.

The controller 410 may be configured to form a touch screen on a part of the vehicle to receive the authentication information of the user. The control unit 410 may receive the fingerprint information of the user, input the pattern information, or receive the preset password through the formed touch screen. For this purpose, the control unit 410 can perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively. Furthermore, the control unit 410 may control any one or a plurality of the above-described components in order to implement various embodiments described below on the vehicle control device 400 according to the present invention.

In addition, the control unit 410 may display various image information on the touch screen formed on a part of the vehicle. For example, the control unit 410 may display a fingerprint input area for user authentication or graphic objects for pattern input on the touch screen, and may display the authentication result of the user or information related to the currently authenticated user .

In the case of the authenticated user, the control unit 410 may change the setting state of the vehicle using the user-related information corresponding to the user. For example, the control unit 410 may control the first driving unit 421 to adjust the seat height or the angle of the backrest of the driver's seat or the like based on the information of the authenticated user, have. Alternatively, the control unit 410 may adjust the degree of opening of the driver's seat and assistant window, the angle of the side mirror, or the like, or the height of the steering wheel, based on the information corresponding to the authenticated user.

In addition, the control unit 410 may cause various operation modes of the vehicle to be changed according to the authenticated user. For example, the control unit 410 may change the operation mode of the power steering apparatus of the steering wheel to any one of the operation modes (for example, a normal mode or a sports mode) May be selected. Alternatively, the control unit 110 may set the gear shift mode to any one of the manual shift mode or the automatic shift mode that the user prefers in the shift mode of the gear.

In addition, the control unit 410 may perform software setting change as well as physical setting change. For example, when the authenticated user boarded the vehicle, the control unit 410 can automatically select a music list preferred by the user or a music list currently listened to by the authenticated user. Or the control unit 410 may automatically select a channel of the radio station that the currently authenticated user mainly hears.

Also, the control unit 410 may change various vehicle settings based on the time when the authenticated user boarded the vehicle. For example, the control unit 410 can analyze a destination that the user mainly travels at the time, based on the time at which the authenticated user boarded the vehicle, that is, the time at which the user was authenticated and the travel history of the authenticated user. In other words, when the user mainly has a driving habit toward "home" from 8:00 am to 9:00 am, the control unit 410, based on the user's driving record, When the user is boarding the vehicle, the destination may be automatically set to "home" and the route may be displayed on the display unit of the built-in navigation system.

As described above, the control unit 410 of the vehicle control device 400 related to the embodiment of the present invention allows the user to control the vehicle using the authentication information, thereby making it easier for the user to ride on the vehicle and use the vehicle. In addition, when the user is authenticated, the control unit 410 of the vehicle control device 400 according to the embodiment of the present invention adjusts various environment settings of the vehicle based on the authenticated user, As shown in FIG.

In addition, not only when the user is not boarding the vehicle, but also when the user is boarding the vehicle, the control unit 410 allows the physical setting change or the software setting change of the vehicle to be easily changed based on the user's selection It is possible. For example, the control unit 410 may control at least one of the physical setting changes based on a plurality of knocks (Tabs) applied to the interior of the vehicle, for example, a console box, a gear box, Or software configuration changes may be made. For example, when the user applies a plurality of taps to the handle portion of the vehicle, the controller 410 recognizes the taps so that the height of the steering wheel is adjusted or the operation mode of the power steering device is changed to another mode.

On the other hand, the control unit 410 can change not only the plurality of tabs but also the physical or software setting state based on the gesture of the user. For example, the control unit 410 can detect movement of a driver or an assistant on board the vehicle using a camera, a photo sensor, a laser sensor, or an infrared sensor provided in the vehicle. And a specific function may be performed based on the movement of the driver or assistant, or the currently set state may be adjusted. For example, if an occupant seated in an assisting seat takes a hand-down gesture near the assisting window, the assisting window may be adjusted in its degree of opening based on the occupant's gesture. Alternatively, the control unit 410 may cause the predetermined specific music data to be reproduced when a specific gesture (e.g., a gesture for flicking or clapping a finger) is detected based on the gesture of the driver's seat or the passenger.

At least some of the components may operate in cooperation with one another to implement the operation, control, or control method of the vehicle control apparatus 400 according to the various embodiments described below. In addition, the operation, control, or control method of the vehicle control device 400 may be implemented on the vehicle control device 400 by driving at least one application program stored in the memory 440.

Hereinafter, the components listed above will be described in more detail with reference to FIG. 4A, before explaining various embodiments implemented through the vehicle control apparatus 400 described above.

The sensing unit 430 senses at least one of information in the vehicle control device, surrounding environment information surrounding the vehicle control device, and user information, and generates a corresponding sensing signal. The control unit 410 may control the driving or operation of the vehicle control device 400 or may perform data processing, function, or operation related to the application program installed in the vehicle control device 400 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 430 will be described in more detail.

First, the proximity sensor 432 refers to a sensor that detects the presence of an object approaching a predetermined detection surface, or the presence of an object in the vicinity thereof, without mechanical contact using an electromagnetic force or an infrared ray. Such a proximity sensor 432 may be disposed in each area inside or outside the vehicle or near the touch screen.

Examples of the proximity sensor 432 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is electrostatic, the proximity sensor 432 can be configured to detect the proximity of the object with a change of the electric field along the proximity of the object having conductivity. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the act of recognizing that the object is located on the touch screen in proximity to the touch screen without touching the object is referred to as "proximity touch" The act of actually touching an object on the screen is called a "contact touch. &Quot; The position at which the object is closely touched on the touch screen means a position where the object corresponds to the touch screen vertically when the object is touched. The proximity sensor 432 can detect proximity touches and proximity touch patterns (e.g., proximity touch distance, proximity touch direction, proximity touch rate, proximity touch time, proximity touch location, proximity touch movement state, have. Meanwhile, the control unit 410 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 432 as described above, and further provides visual information corresponding to the processed data It can be output on the touch screen. Further, the control unit 410 may control the vehicle control apparatus 400 so that different operations or data (or information) are processed depending on whether the touch to the same point on the touch screen is a proximity touch or a contact touch have.

The touch sensor senses a touch (or touch input) applied to the touch screen (or the display unit 451) by using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, do.

For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the touch screen or a capacitance generated in a specific portion to an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, a capacitance at the time of touch, and the like where a touch object touching the touch screen is touched on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the control unit 410. Thus, the control unit 110 can know which area of the display unit 451 is touched or the like. Here, the touch controller may be a separate component from the controller 410, and may be the controller 410 itself.

Meanwhile, the control unit 410 may perform different controls or perform the same control according to the type of the touch object, which touches the touch screen (or a touch key provided on the touch screen). Whether to perform different controls or to perform the same control depending on the type of the touch object may be determined according to the operating state of the current vehicle control device 400 or an application program being executed.

On the other hand, the touch sensors and the proximity sensors discussed above can be used independently or in combination to provide a short touch (touch), a long touch, a multi touch, a drag touch ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, and the like. Touch can be sensed.

The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. Meanwhile, the controller 410 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.

The sensing unit 430 may include at least one of a camera sensor (e.g., a CCD, a CMOS, etc.), a photosensor (or an image sensor), and a laser sensor to recognize a gesture of a user.

The camera 421 and the laser sensor are combined with each other to sense the touch of the object to be sensed. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.

The display unit 451 may display various image information related to the user's authentication information input as described above. For example, the display unit 451 may display a graphic object displaying an area for receiving a fingerprint of a user or a graphic object for receiving pattern information in a part of a vehicle where a touch screen is formed. Alternatively, the display unit 451 may display information related to the user authentication result and the currently authenticated user when the user authentication is completed. Such image information may be displayed on at least a part of the windshield glass of the vehicle or a window of the driver's seat or assistant's seat, and thus the window of the vehicle or the windshield glass of the vehicle equipped with the vehicle control apparatus 400 according to the embodiment of the present invention At least a portion of the electrodes may be designed to sense the user's touch input.

Also, the display portion 451 may be formed on the inner surface as well as the outer surface of the windshield glass and the window. The display unit 451 formed on the inner surface may display (output) information to be processed by the vehicle control device 400. For example, the screen information displayed on the display unit 451 formed on the inner surface may include execution screen information of an application program driven by the vehicle control apparatus 400, UI (User Interface) based on the execution screen information, , And GUI (Graphic User Interface) information.

Also, the display unit 451 may be included in the sensing unit 130. In this case, the display unit 451 may display the detection result of the sensing unit 430, the matching result of the user authentication information, or a part of the unique authentication information of the user (e.g., the name of the user) .

The audio output unit 452 can output the audio data stored in the memory 440. The sound output unit 152 also outputs sound signals related to functions (e.g., user authentication sound, user authentication sound, etc.) performed in the vehicle control device 400. [ The sound output unit 452 may include a speaker, a buzzer, and the like.

Meanwhile, the output unit 450 of the vehicle control apparatus 400 according to the embodiment disclosed herein may include a haptic module 453. [ The haptic module 453 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 453 may be vibration. The controller 410 can output tactile information using the haptic module 453 when a user's touch input is detected on a touch screen implemented in an outer frame of the vehicle, an inner frame, a glass window, or the like. Accordingly, the user can check whether or not the authentication information inputted by himself / herself is correctly inputted by using the tactile information.

The intensity and pattern of the vibration generated in the haptic module 453 can be controlled by the user's selection or the setting of the control unit. For example, the haptic module 453 may combine and output different vibrations or sequentially output the vibrations.

In addition to vibration, the haptic module 453 can be used for a variety of applications such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of air through the injection port or the suction port, a touch on the skin surface, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 453 can transmit the tactile effect through the direct contact, and the tactile effect can be realized by the user through the muscular sense of the finger or arm. More than two haptic modules 453 may be provided in accordance with the configuration of the vehicle control device 400.

In the following, various embodiments may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

Meanwhile, the sensing unit 430 of the vehicle control apparatus 400 according to the embodiment of the present invention includes a body mounted on the body unit to contact a part of the user's body, Or a tab sensing unit 433 for sensing a tab gesture. Here, the tabs sensed by the tap sensing unit 433 of the vehicle control device 400 are means for inputting authentication information of the user, or may be configured to control various functions of the vehicle control device 400 when the user boarded the vehicle As shown in FIG. These tabs can be understood as an operation of lightly tapping the body or the object of the vehicle control device 400 with a tap object such as a finger or an operation of lightly touching the tap object to the body or the object of the vehicle control device 400. [ Here, the body of the sensing unit 430 may be formed in a body portion of the vehicle including an outer frame of the vehicle, an inner frame, and a window or a windshield glass.

The tap object to which the tap is applied may be an object that can apply external force to the body of the vehicle control device 400 or an object. For example, the tap object may include a finger, a stylus pen, a pen, , A fist, and the like. The tap object is not limited to an object to which a touch input can be applied to the vehicle control device 400 according to the present invention. If the object is an object that can apply an external force to the body or the object of the vehicle control device 400, The kind is irrelevant.

On the other hand, the object to which the tap gesture is applied may include at least one of a body of the vehicle control device 400 and an object placed on the vehicle control device 400.

The tap or tap gesture may be sensed by at least one of an acceleration sensor and a touch sensor included in the tap sensing unit 433. [ Here, the acceleration sensor is a sensor capable of measuring dynamic forces such as acceleration, vibration, and impact of the main body of the vehicle control device 400.

That is, the acceleration sensor can sense vibration (or movement) of the main body of the vehicle control device 400 generated by the tap gesture, and detect whether the tap is applied to the object. Therefore, the acceleration sensor is positioned close to the main body of the vehicle controller 400 so as to detect a tap with respect to the main body of the vehicle controller 400 or to detect whether movement or vibration occurs in the main body of the vehicle controller 400 It is possible to detect that an object is tapped.

As long as the acceleration sensor can detect movement or vibration in the main body of the vehicle control device 400, the acceleration sensor can be applied not only to the case where the tap is applied to the main body of the vehicle control device 400, It is possible to detect the tab.

In the vehicle control device 100 according to the present invention, only one of the acceleration sensor and the touch sensor, the acceleration sensor, and the touch sensor are sequentially used for sensing the tab of the main body of the vehicle control device 400, Or an acceleration sensor and a touch sensor can be used at the same time. On the other hand, in order to sense a tap, a mode using only an acceleration sensor may be named as a first mode, a mode using a touch sensor may be referred to as a second mode, and both the acceleration sensor and the touch sensor may be used Mode) may be referred to as a third mode or a hybrid mode.

On the other hand, when the tab is sensed through the touch sensor, it is possible to more accurately grasp the position where the tab is sensed.

In the vehicle control apparatus 400 according to an embodiment of the present invention, in order to sense the tap through the acceleration sensor or the touch sensor, the display unit 451 of the vehicle control device 400 may be operated with a minimum current or power Can be operated in a specific mode consumed. This particular mode may be named "Doze mode ".

For example, in the doze mode, in a touch screen structure in which a touch sensor and a display unit 451 form a mutual layer structure, a light emitting element for outputting a screen in the display unit 451 is turned off, The sensor may be in the on-state state. Alternatively, the doze mode may be a mode in which the display unit 451 is turned off, and the acceleration sensor is kept in an on-state. Alternatively, the dose mode may be a mode in which the display unit 451 is turned off, and the touch sensor and the acceleration sensor are all kept on.

Therefore, in the doze mode state, that is, in a state where the display unit 451 is turned off (the display unit 451 is in an inactive state), the user can perform at least one point on the touch screen formed on a part of the vehicle, 400, when the tab is attached to a specific point of the main body, it is possible to detect that the tab is applied from the user through at least one of the on-touch sensor and the acceleration sensor.

In order to distinguish the taps as the means for inputting the user's authentication information or the taps as the means for controlling the functions of the vehicle control device 400 and simply any external objects, It is judged that a "tab" for the purpose of inputting the user's authentication information or controlling the vehicle control device 400 is detected only when at least two or more tabs are applied to the touch screen formed on a part of the vehicle within the reference time can do. For example, if it is determined that one tap is applied to the touch screen formed on a part of the vehicle as a result of the detection by the tap detection unit 433, the control unit 410 inputs the user's authentication information It may be recognized that an arbitrary external object or human body has collided.

Accordingly, the control unit 410 may be configured to input the authentication information of the user only when at least two or more tabs (or a plurality of times) that are continuously applied within the reference time are detected by the tab detecting unit 433 Quot; tab " as a means for controlling the function of the vehicle control device 400 is detected.

That is, tap gestures may mean that at least two or more tap gestures are continuously sensed within a reference time. Therefore, in the following description, the detection of the "tap " may mean that it has been sensed that a user's finger, a touch pen, or the like is struck by the body of the vehicle control apparatus 400 substantially plural times.

In addition, the controller 410 may determine whether the tab is sensed by the user's other finger or one finger, as well as that the tab is sensed within the reference time. For example, the control unit 410 may control a predetermined area of the vehicle, that is, a window of the vehicle or a part of the windshield glass or a portion of the A, B, C pillars or the vehicle roof, When the tabs are detected in a box, a gear box, or the like, the user can sense whether the tabs are made through one finger or through different fingers, using fingerprints sensed at the portions where the tabs are applied. The control unit 410 recognizes the position of the taps on the display unit 451 or the acceleration generated due to the taps through at least one of the touch sensor or the acceleration sensor provided in the tap sensing unit 433, You can detect if the tabs are made with one finger or each with a different finger.

Further, the control unit 410 determines whether the user has input the tabs through one hand or one finger, or both hands or at least two fingers It is possible to judge whether or not it is inputted.

The taps may be a plurality of tapes continuously sensed within the reference time. Here, the reference time may be a very short time, for example, 300 ms to 2 s or less.

If the tap detecting unit 433 detects that the main body of the vehicle control apparatus 400 has been tapped for the first time, the tap detecting unit 433 detects the tap for the first time after the first tapping You can detect if there is a tap. If the next tap is detected within the reference time, the tap sensing unit 433 or the control unit 410 may input the authentication information of the user or the specific function of the vehicle control device 400 according to the embodiment of the present invention. It can be determined that a tab for controlling is detected. In this way, the controller 410 recognizes the second tab only when the second tab is detected within a predetermined time period after the first tab is detected, thereby enabling the user to input the authentication information, Or whether it is merely a user's mistake or an unintended object crashing outside or inside the vehicle.

There are various methods for allowing the "valid tab" to be recognized. For example, the control unit 410 may control the second tap for tapping the body by the second reference number or by the second reference number within a predetermined time after the first tap is detected by the first reference count or by the first reference count or more, May be recognized as the " valid tap ". Here, the number of the first reference times and the number of the second reference times may be equal to or different from each other. For example, the first reference number may be one, and the second reference number may be two. As another example, the first reference number and the second reference number may all be one.

Also, the control unit 410 may determine that the "tabs " are detected only when the tab is within the" predetermined area ". That is, when it is detected that the main body of the vehicle controller 400 is tapped for the first time, the controller 410 may calculate a predetermined area from the point where the first tapping is detected. Then, the control unit 410 determines whether or not the first hit is followed by the first or second reference count or the first or second reference count or more within the reference time from the time when the first hit is sensed It can be determined that the first tab or the second tab is applied.

It is to be understood that the reference time and the predetermined region may be variously modified according to the embodiment.

Meanwhile, the first tap and the second tap may be sensed not only as a reference time and a predetermined area, but also as separate tabs depending on the detected position of each tab. That is, the controller 410 can determine that the first tab and the second tab are applied when the second tab is detected at a position spaced apart by a predetermined distance from the position where the first tab is sensed. When the first tap and the second tap are recognized based on the sensed position, the first tap and the second tap may be simultaneously detected.

Also, when the first tap and the second tap are configured by a plurality of touches, that is, a plurality of tapes, a plurality of touches constituting the first tap and the second tap may be simultaneously detected. For example, when the first touch constituting the first tab is detected and the first touch constituting the second tab is positioned at a position spaced apart from the position where the first touch of the first tab is sensed If it is sensed, the controller 110 may sense the first touch constituting the first tap and the second tap, respectively. The controller 410 senses an additional touch input sensed at each position and determines that the first tab and the second tab are applied when a touch is detected at a first reference frequency or at a second reference frequency or more at each position can do.

If the tab of the main body of the vehicle control device 400 is detected a plurality of times from the tap sensing unit 133, the control unit 410 not only authenticates the user, 400 may be controlled so that at least one of the executable functions is controlled. Here, the functions executable on the vehicle control device 400 may mean all kinds of functions that can be executed or driven by the vehicle control device 400. [ Here, one of the executable functions may be an application installed in the vehicle control apparatus 400. And "an arbitrary function is executed" may mean that "any application program is executed or driven in the vehicle control apparatus 400 ". For example, the control unit 410 may play a music file based on a plurality of tabs of the user detected in the console box, or may control the navigation to automatically set a path to a predetermined destination.

As another example, a function executable in the vehicle control device 400 may be a function necessary for basic driving of the vehicle control device 400. [ For example, the functions required for basic driving may be a function of turning on / off an air conditioner or a hot air fan provided in the vehicle, and may be a function for starting the vehicle, switching the vehicle from the locked state to the unlocked state, And a function of switching from a state to a locked state. Or to turn the cruise control function of the vehicle on or off.

On the other hand, the control unit 410 can form a position where the user's authentication information is input based on the body of the user's tab or a point on the touch screen. For example, the control unit 410 forms an area for receiving the pattern information, centering on a point where the first user's taps are applied, or forms an area for receiving the user's biometric information, . In this case, the point at which the user's pattern information or the biometric authentication information is input may be changed every time, even if the user taps the body or another point on the touch screen every time. Accordingly, the user can minimize the exposure of the authentication information, and thus can be safer from a threat such as theft of the vehicle.

Needless to say, the user authentication information may be input to the vehicle control device 400 via a predetermined external device based on the user's selection. That is, for example, the sensing unit 430 may be connected to a predetermined external device outside the vehicle using the short-range communication module 431, and authentication information of the user input through the external device may be transmitted to the short- 431 to the sensing unit 430 and may be authenticated by the control unit 410.

The vehicle control apparatus 400 can acquire vehicle information from the vehicle.

According to one embodiment, the vehicle information may be acquired through the sensing unit 430 described above.

According to another embodiment, the vehicle control apparatus 400 may further include a vehicle information obtaining section 460 for obtaining the vehicle information.

Here, the vehicle information includes at least one of an air conditioning function for the vehicle, whether or not the door (including a bonnet, a trunk, and a fuel supply port) is open or closed, whether a window is open or closed, whether a sunroof is opened or closed, A parking position, a navigation function provided in the vehicle, a stolen state of the vehicle, and a state of running of the vehicle.

The vehicle information may further include information related to at least one of an operation speed of the vehicle, an operation acceleration, a travel distance to the present, a rapid acceleration frequency, and a sudden braking frequency.

For this purpose, the vehicle information obtaining unit 460 may perform communication with various sensors provided in the vehicle.

For example, the vehicle information acquiring unit 460 may acquire acceleration information for the vehicle by communicating with an acceleration sensor installed in the vehicle and measuring an acceleration of the vehicle.

In addition, for example, the vehicle information obtaining unit 460 can communicate with the black box provided in the vehicle to obtain an accident image when a vehicle accident occurs. In this case, the memory 440 may store the accident image.

FIG. 4B shows an example in which the predetermined external device is connected to the vehicle control apparatus according to the embodiment of the present invention.

Referring to FIG. 4B, the predetermined external device 170 may be a mobile terminal such as a smart phone 171 or a smart key 172 of the user. In this case, the controller 110 recognizes the unique information of the external device 170, and automatically recognizes a specific user when the external device 170 is within a predetermined distance. The control unit 410 may receive the authentication information input by the user through the external device 170. The authentication information input by the external device 170 may include a communication module provided in the external device 170, And may be transmitted to the vehicle control device 400 through the short range communication module 431 of the sensing unit 430.

The authentication information may be biometric information of the user.

According to one embodiment, the biometric information may be obtained by the mobile terminal 100 or the wearable device 200.

Here, the biometric information may be at least one of information on the heart rate, body fat, blood pressure, blood glucose, face shape, fingerprint, brain waves, and iris for the user.

For example, the authentication information may be a user's heart rate, fingerprint or iris recognition information, or predetermined password or pattern information. Such authentication information may also be information related to a specific user's gesture.

The authentication for the user may be based on a plurality of biometric information or a plurality of authentication information.

For example, authentication of the user may be performed by checking both the heart rate of the user and the gesture of the user.

The external device 170 may be configured to receive authentication information from a user, that is, to receive at least some of the sensors provided in the sensing unit 430 of the vehicle control device 400, And may further include configurations that are the same, similar or corresponding to those of the sensors.

For example, the external device 170 such as the smart key 172 or the smart phone 171 may be provided with a touch screen on which a user can input pattern information or a touch screen on which the user can input pattern information, A sensing unit may be provided that is the same as, or similar to, the tap sensing unit 433. The external device 170 may further include a fingerprint recognition unit for recognizing the fingerprint of the user. In addition, the external device 170 may further include an inertial sensor, a gyro sensor, or an acceleration sensor for recognizing the user's gesture.

For example, the smart watch 173, which is a watch type mobile terminal, may include a sensor capable of acquiring a user's heart rate. In the case of the smart glasses 174 as a spectacle type mobile terminal, And an iris recognition camera for recognizing the iris of the subject.

In this case, the user can input his / her authentication information using at least one of the fingerprint, predetermined pattern information, and iris recognition information through the external device 170. Alternatively, the user may be allowed to input his / her authentication information to the external device 170 by taking a specific gesture while wearing the external device 170. In this case, the controller 110 of the external device 170 may use the measured value of the position change of the external device 170, that is, the acceleration measurement value, the gravity change amount, or the inertia change amount according to the gesture of the user So that the gesture of the user can be recognized and utilized as authentication information. Alternatively, the external device 170 may recognize that the position has been changed using a user's image input through a camera or the like, and may measure the changed value.

Meanwhile, when the authentication information is input through the external device 170, the control unit 410 of the vehicle control device 400 can control driving of the vehicle using the input authentication information. For example, the control unit 410 may recognize the current user according to the authentication information, cancel the locked state of the vehicle, and set the vehicle internal environment corresponding to the recognized user. Alternatively, the control unit 410 may change the unlocked state of the vehicle to the locked state when the current vehicle state is the unlocked state and the authentication information is input again once the startup is completed.

Meanwhile, the driving of the vehicle may be immediately controlled using the authentication information of the user input through the external device 170. However, the control unit 410 may request the user for a single authentication process. In this case, when the external device 170 is within a predetermined distance or when authentication information is inputted through the external device 170, the control unit 410 changes the state of the vehicle to a wake up state , And prepare to drive the vehicle according to the authentication information input from the authenticated user. When the user enters the authentication information again in a predetermined area (for example, the driver's seat or the assistant's window, A, B, C pillar, etc.) outside or inside the vehicle in a state of being switched to the wakeup state Receives the input, authenticates the user, and drives the vehicle accordingly.

In addition, although it has been described in the above description that only one authentication procedure is performed, it is needless to say that more authentication procedures can be performed. In the above description, a plurality of authentication procedures are performed when the user's authentication information is input through the external device 170. However, the plurality of authentication procedures may be performed by a user directly in a touch screen area It is needless to say that the present invention can also be applied to the case of inputting the authentication information of the user.

5 is an exemplary view for explaining a display unit of a vehicle control apparatus according to an embodiment disclosed herein.

5 shows a case where the vehicle control device 400 is implemented in the form of a head unit of a vehicle.

The vehicle control apparatus 400 may include a plurality of display units D100 to D102.

For example, as shown in FIG. 5, the vehicle control apparatus 400 includes a first display unit D100 in front of the driver's seat and two second display units D101 and D102 in front of the rear seats .

At this time, in general, only the first display unit D100 is restricted from the driving regulation.

Therefore, only the first display unit D100 is limited by the vehicle display method, and the second display units D101 and D102 can display the entire contents without any limitation.

6A is a block diagram showing a configuration of a vehicle control apparatus according to another embodiment disclosed herein.

FIG. 6A illustrates a case where the vehicle control apparatus 400 is implemented in the form of a video display device, a head unit of a vehicle, or a telematics terminal.

8A, the vehicle control apparatus 400 'includes a control section (for example, a central processing unit (CPU) 412') for controlling the overall operation of the vehicle control apparatus 400 ' A key control unit 411 'for controlling various key signals, an LCD control unit 411' for controlling a liquid crystal display (LCD), a memory 413 'for storing input / output data, And a main board 410 'having a built-in mother board 414'.

The memory 413 'may store map information (map data) for displaying the route guidance information on the digital map. In addition, the memory 413 'may store traffic information collection control algorithm that allows the vehicle to input traffic information according to the current road conditions, and information for controlling the algorithm.

The main board 410 'is provided with a unique device number and is provided with a code division multiple access (CDMA) module 406' embedded in the vehicle, a GPS signal for tracking the location of the vehicle, A GPS module 207 that receives traffic information collected by a user or transmits traffic information collected by a user as a Global Positioning System (GPS) signal, a CD deck 408 'for reproducing a signal recorded on a compact disc (CD) A gyro sensor 409 ', and the like. The CDMA module 406 'and the GPS module 407' can transmit and receive signals through the antennas 404 'and 405'.

In addition, the broadcast receiving module 422 'is connected to the main board 410' and can receive broadcast signals through the antenna 423 '. The main board 410 'includes a display unit (LCD) 401' under the control of the LCD control unit 414 'through an interface board 430', a front board (not shown) under the control of the key control unit 411 ' 402 'and a camera 427' for photographing the interior and / or exterior of the vehicle. The display unit 401 'displays various video signals and character signals, and the front board 402' includes buttons for inputting various key signals. The key signals corresponding to the user- (410 '). Also, the display unit 401 'includes a proximity sensor and a touch sensor (touch screen).

The front board 402 'has a menu key for directly inputting traffic information, and the menu key may be controlled by the key controller 411'.

The audio board 417 'is connected to the main board 410' and processes various audio signals. The audio board 417 'includes a microcomputer 419' for controlling the audio board 417 ', a tuner 418' for receiving a radio signal, a power source unit for supplying power to the microcomputer 419 ' And a signal processing unit 415 'for processing various audio signals.

The audio board 417 'includes a radio antenna 420' for receiving a radio signal and a tape deck 421 'for reproducing an audio tape. The audio board 417 'may further include a sound output unit (for example, an amplifier) 426' for outputting a sound signal processed by the audio board 417 '.

The audio output unit (amplifier) 426 'is connected to the vehicle interface 424'. That is, the audio board 417 'and the main board 410' are connected to the vehicle interface 424 '. The vehicle interface 424 'may be connected to a handsfree 425a' for inputting a voice signal, an airbag 425b 'for occupant safety, a speed sensor 425c' for detecting the speed of the vehicle, and the like. The speed sensor 425c 'calculates the vehicle speed and provides the calculated vehicle speed information to the central processing unit 412'.

The navigation session 400_1 'applied to the vehicle control device 400' generates route guidance information based on the map data and the vehicle current position information, and notifies the user of the generated route guidance information.

The display unit 401 'senses the proximity touch in the display window through the proximity sensor. For example, the display unit 401 'detects the position of the proximity touch when a pointer (for example, a finger or a stylus pen) is touched proximately, and obtains position information corresponding to the detected position And outputs it to the controller 412 '.

The speech recognition device (or speech recognition module) 401_1 'recognizes the speech uttered by the user and performs the corresponding function according to the recognized speech signal.

The navigation session 400_1 'applied to the vehicle control device 400' displays a traveling route on the map data, and when the position of the mobile terminal 100 is determined in advance from a dead zone included in the traveling route, (For example, a vehicle navigation device) mounted on a nearby vehicle and / or a mobile terminal carried by a neighboring pedestrian through a wireless communication (for example, a short-range wireless communication network) The location information of the surrounding vehicle is received from the terminal mounted on the peripheral vehicle, and the location information of the surrounding pedestrian is received from the mobile terminal carried by the peripheral pedestrian.

Meanwhile, the main board 410 'may be connected to the interface unit 430', and the interface unit 430 'includes the external device interface unit 431' and the network interface unit 432 '.

The external device interface unit 431 'can connect the external device and the vehicle control device 400'. To this end, the external device interface unit 431 'may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 431 'may be connected to an external device such as a DVD (Digital Versatile Disk), a Blu ray, a game device, a camera, a camcorder, a computer (notebook) The external device interface unit 231 transmits external video, audio or data signals to the control unit 412 'of the vehicle control device 400' through the connected external device. Further, the controller 412 'can output the video, audio, or data signal processed by the controller 412' to the connected external device. To this end, the external device interface unit 431 'may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The A / V input / output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog) terminal, A DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, and the like.

The wireless communication unit can perform short-range wireless communication with other electronic devices. The vehicle control apparatus 400 'may be, for example, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, DLNA Alliance), and the like.

Also, the external device interface unit 431 'may be connected to at least one of various set-top boxes and various terminals to perform input / output operations with the set-top box.

On the other hand, the external device interface unit 431 'can receive the application or application list in the adjacent external device and transmit it to the control unit 412' or the memory 413 '.

The network interface unit 432 'provides an interface for connecting the vehicle control device 400' to a wired / wireless network including the Internet network. The network interface unit 432 'may include an Ethernet terminal or the like for connection to a wired network and may be connected to a wireless LAN (WLAN) (Wi -Fi, Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), and HSDPA (High Speed Downlink Packet Access) communication standards.

The network interface unit 432 'may transmit or receive data to another user or other electronic device via the network to which it is connected or another network linked to the network to which it is connected. Particularly, it is possible to transmit a part of content data stored in the vehicle control device 400 'to another user registered in the vehicle control device 400' or a selected user or selected electronic device among other electronic devices.

On the other hand, the network interface unit 432 'can access a predetermined web page through the connected network or another network linked to the connected network. That is, it is possible to access a predetermined web page through a network and transmit or receive data with the server. In addition, content or data provided by a content provider or a network operator can be received. That is, it can receive contents such as a movie, an advertisement, a game, a VOD, a broadcast signal, and related information provided from a content provider or a network provider through a network. In addition, the update information and the update file of the firmware provided by the network operator can be received. It may also transmit data to the Internet or a content provider or network operator.

In addition, the network interface unit 432 'can select and receive a desired one of applications open to the public via the network.

6B is a block diagram showing a configuration of a vehicle control device according to another embodiment disclosed herein.

6B is a configuration diagram showing the vehicle control device 400 with emphasis on the function of the vehicle navigation device.

When the vehicle control apparatus 400 '' is implemented as a vehicle navigation apparatus, the vehicle control apparatus 400 '' may be classified into an in-dash type and an on-dash type, ). The navigation system of the Indy type is inserted into a fixed space allocated in a dashboard of the vehicle and is fixedly mounted. The on-deck type navigation (vehicle navigation) device is mounted on a dashboard of a vehicle or installed near the vehicle by using a fixed support, and can be detachably attached to the vehicle.

The vehicle control apparatus 400 '' according to the present embodiment includes navigation system (vehicle navigation) apparatuses of the intra-city type and the on-scene type. In addition, a navigation message transmitted from GPS (Global Positioning System) And a portable terminal capable of performing a navigation function in conjunction with a GPS receiver that receives the traffic information.

6B, the vehicle control apparatus 400 '' receives a global positioning system (GPS) signal received from a satellite and transmits the GPS signal to the navigation device 100 ) Which generates second vehicle position data based on the traveling direction of the vehicle and the speed of the vehicle, a GPS module 401 '' for generating first vehicle position data of the vehicle (Or memory) 404 '' for storing map data and various information; a vehicle position estimating unit 402 for estimating a vehicle based on the first vehicle position data and the second vehicle position data; (Map matching link or map matching road) in the map data stored in the storage unit 404 ", and outputs the matched map information Results) A communication unit 408 '' for receiving real-time traffic information from the information providing center and / or a nearby vehicle through the wireless communication network 500 '', receiving the traffic light information, and performing telephone communication through the wireless communication network 500 ' A control unit 407 '' for generating route guidance information based on the matched map information (map matching result), a route guidance map (including interest information) included in the route guidance information, A voice output unit 406 '' for outputting a voice signal corresponding to the voice guidance information (the voice guidance voice message) and the traffic signal light information included in the voice guidance information included in the voice guidance information, . ≪ / RTI >

Here, the communication unit 408 '' may further include a hands-free unit having a Bluetooth module, and may receive a broadcast signal including traffic information in TPEG format from a broadcasting station through an antenna. The broadcast signal may include not only video and audio data according to various standards such as terrestrial or satellite digital multimedia broadcasting (DMB), digital audio broadcasting (DAB), digital video broadcasting (DVB-T, DVB- Service, traffic information according to a Binary Format for Scene (BIFS) data service, and various additional data. Further, the communication unit 408 " tunes the signal band in which the traffic information is provided, demodulates the tuned signal, and outputs the demodulated signal to the TPEG decoder (included in the control unit 407).

The TPEG decoder decodes traffic information in the TPEG format and provides various information including traffic signal information included in the traffic information to the controller 407 ''.

The route guidance information may include not only map data but also various information related to driving such as lane information, traveling speed limit information, turn-by-turn information, traffic safety information, traffic guidance information, vehicle information, .

The signals received through the GPS module 401 " include 802.11, which is a standard specification of a wireless network for a wireless LAN including a wireless LAN and some infrared communication proposed by IEEE (Institute of Electrical and Electronics Engineers) A Broadband Wireless Access (BWA) system including 802.15, which is a standard for a wireless personal area network (PAN) including a UWB, a ZigBee, and the like, and a fixed broadband network (FWA) , 802.20, which is a standard for the mobile Internet, and 802.20, which is a standard for the mobile Internet (MBWA) including WiBro, And to provide positional information of the terminal to the vehicle control device 400 ".

The vehicle control apparatus 400 '' may further include an input unit, and the input unit may be a variety of devices such as a keypad, a touch screen, a jog shuttle, and a microphone, .

The map matching unit 403 '' generates a vehicle estimated position based on the first position data and the second position data, and reads the map data corresponding to the traveling path from the storage unit 404 '' do.

The map matching unit 403 '' matches the vehicle estimated position with a link (road) included in the map data, and outputs the matched map information (map matching result) to the controller 407 ''. . For example, the map matching unit 403 " generates a vehicle estimated position based on the first position data and the second position data, and stores the generated vehicle estimated position and the storage unit 404 & , And outputs the matched map information (map matching result) to the control unit 407 ". The map matching unit 403 '' may output the road attribute information such as a single-storey road or a multi-storey road included in the matched map information (map matching result) to the control unit 407 ''. Also, the function of the map matching unit 403 " may be implemented in the control unit 407 " '.

The storage unit 404 " stores map data. At this time, the stored map data includes geographic coordinates (geographic coordinates or latitude and longitude coordinates) indicating latitude and longitude in units of minutes (DMS unit: Degree / Minute / Second). In addition to the geographical coordinates, UTM (Universal Transverse Mercator) coordinates, UPS (Universal Polar System) coordinates, and TM (Transverse Mercator) coordinates may be used as the stored map data.

The storage unit 404 '' stores various information such as various menu screens, point of interest (POI), and function characteristic information according to a specific position of the map data.

The storage unit 404 '' stores various user interface (UI) and / or graphical user interface (GUI).

The storage unit 404 '' stores data and programs necessary for the navigation apparatus 400 to operate.

The storage unit 404 '' stores destination information inputted from the user through the input unit. At this time, the destination information may be a destination, or a source and a destination.

The display unit 405 " displays image information (or a route guidance map) included in the route guidance information generated by the control unit 407. [ Here, the display unit 405 includes a touch sensor (touch screen) and a proximity sensor. The route guidance information includes not only map data but also various types of information related to driving such as lane information, running restriction speed information, turn-by-turn (TBT) information, traffic safety information, traffic guidance information, May be included.

When displaying the image information, the display unit 405 '' displays various contents such as various menu screens and route guidance information by using the user interface and / or graphical user interface included in the storage unit 404 can do. Here, the content displayed on the display unit 405 " includes various text or image data (including map data and various information data) and a menu screen including data such as icons, list menus, and combo boxes.

The voice output unit 406 '' outputs voice information (or voice message for the route guidance information) included in the route guidance information generated by the control unit 407. Here, the audio output unit 406 " may be an amplifier or a speaker.

The control unit 407 '' generates the route guidance information based on the matched map information and outputs the generated route guidance information to the display unit 405 '' and the voice output unit 406 '' . At this time, the display unit 405 '' displays the guidance information.

Real-time traffic information is received from the control unit 407 '', the information providing center, and / or a terminal (vehicle navigation device) installed in the nearby vehicle, thereby generating the route guidance information.

The control unit 407 '' is connected to the call center through the communication unit 408 '' to perform a telephone conversation or transmit / receive information between the vehicle control device 400 '' and the call center . Here, the communication unit 408 '' further includes a hands-free module having a Bluetooth function using a short-range wireless communication system.

When the POI search menu is selected by the user, the controller 407 '' searches POIs located on the route from the current position to the destination, and displays the retrieved POI on the display unit 405 ". At this time, the control unit 407 '' determines whether the POI located on the route (POI located on the left or right side of the travel road, for example, where the route is not to be changed (re-searching)) and / (A point at which a path should be changed, for example, a point at which a predetermined path is to be changed to pass through a surrounding POI) located in the POI 405, and displays the retrieved POI on the display unit 405 ".

6C is an exemplary diagram illustrating a screen associated with the navigation function according to an embodiment disclosed herein.

The screen shown in FIG. 6C may be a screen displayed by the mobile terminal 100, the wearable device 200, or the vehicle control devices 400, 400 ', and 400' '.

The mobile terminal 100 may be a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP) 6C, only some of the components shown in FIG. 6C may be displayed, or all of the illustrated components shown in FIG. 6C may not be displayed.

As shown in FIG. 6C, the display unit providing the screen related to the navigation function may display an icon (I1) indicating the orientation of the map displayed in one area of the screen. The display unit providing a screen related to the navigation function may display a map such that a specific direction (for example, a true north direction of the earth), a moving direction of the moving object, a direction in which the destination is located, and the like are fixed and displayed in the upward direction of the screen.

The display unit providing the screen related to the navigation function may display an icon (I2) indicating whether the sound output module (162) is activated and volume setting in one area of the screen. The user can activate or deactivate the sound output module 162 or adjust the volume thereof by applying a touch input to the icon I2.

The display unit may display an icon (I3) indicating whether or not to activate a route search function using Transport Portal Experts Group (TPEG) in one area of the screen. TPEG (Transport Portal Experts Group) is a group for establishing a traffic information protocol established by the European Broadcasting Union in 1997. However, the navigation system is widely known as a route guidance function using real time traffic situation information have.

The display unit may display an icon (I4) indicating a scale of the map data in one area of the screen.

The display unit may display an icon (I5) indicating a current time in one area of the screen. In addition, the display unit 161 may display an icon I6 indicating an estimated time to reach a predetermined destination in one area of the screen. In addition, an icon indicating the expected time to reach the predetermined destination may be displayed.

The display unit may display an icon (I7) indicating a remaining distance to a predetermined destination in one area of the screen.

The display unit may display an icon (I8) for enlarging a map displayed in one area of the screen or an icon (I8 ') for zooming.

The display unit may display an icon (I9) indicating a position and a moving direction of the moving object in one area of the screen. The icon I9 may be displayed on the map at a position corresponding to the current position of the mobile unit. In addition, the moving direction of the moving object can be indicated by the arrow I9 in the direction of the vertex of the arrow or the like.

The display unit may display an icon (I10) indicating a place name of the area where the moving object is located in one area of the screen.

The display unit may display an icon (I11) indicating a lane configuration of the traffic lane when the mobile body is a road lane on which a moving object travels in one area of the screen.

The display unit may display a route necessary for reaching the predetermined destination (I12, see FIG. 8). The path may not be displayed if the destination of the moving object is not set.

All the functions (e.g., navigation functions) performed by the vehicle control devices 400, 400 ', 400 " described above are performed by the mobile terminal 100 or the mobile terminal 100 connected to the vehicle control device 400, Can all be performed by the wearable device 200.

Alternatively, the vehicle control apparatuses 400, 400 ', 400 "and the mobile terminal 100 may perform all the functions by interlocking or linking with each other.

To this end, the mobile terminal 100 or the wearable device 200 may include components that are the same, similar or corresponding to those included in the vehicle control apparatus 400.

For example, the acceleration sensor included in the vehicle control apparatus 400 may be performed by the acceleration sensor provided in the mobile terminal 100 or the wearable device 200.

According to one embodiment, a VNC (Virtual Network Computing) scheme may be applied to interworking or linking the vehicle control apparatuses 400, 400 ', 400' 'and the mobile terminal 100.

VNC (Virtual Network Computing) may refer to a graphical desktop sharing system that remotely controls another computer (or other terminal) using a RFB protocol in a computer environment.

The VNC may provide a method of transmitting a keyboard, a mouse, or a touch event from one terminal to another and updating the graphic screen via the network.

In addition, all the functions performed by the vehicle control apparatuses 400, 400 ', 400' 'described above are performed by the vehicle control apparatuses 400, 400', 400 "and the mobile terminal 100 or the wearable device (200).

That is, when a specific function among all the functions performed by the vehicle control apparatuses 400, 400 ', 400' 'described above is performed, some of the specific functions may be transmitted to the vehicle control apparatus 400, 400' ', And the remaining functions may be performed by the mobile terminal 100 or the wearable device 200.

For example, in the case of the air conditioning function for the vehicle, an input to the set temperature for the air conditioner provided in the vehicle is performed by the mobile terminal 100 or the wearable device 200, May be performed by the vehicle control device (400).

It will be apparent to those skilled in the art that the description of the vehicle control apparatus disclosed herein may be embodied in other specific forms without departing from the spirit of the invention disclosed herein.

Hereinafter, with reference to FIGS. 7 to 13, a mobile terminal for detecting a user's muscle change according to an embodiment disclosed herein and controlling the vehicle will be described in detail.

A mobile terminal for controlling a vehicle,

Hereinafter, a description will be given of a mobile terminal that detects a user's muscle movement and controls a vehicle according to an embodiment of the present invention, but the contents overlapping with those described above will be replaced thereby, and a detailed description thereof will be omitted.

3A and 3B (hereinafter, referred to as "mobile terminal") will be described with reference to a mobile terminal in the form of a wearable device worn on the wrist of various embodiments of the mobile terminal Reference).

1, 3A and 3B, a mobile terminal according to an embodiment of the present invention includes a muscle sensor (a second sensor 145b shown in FIG. 1) that detects movement of muscles of a user's wrist region, (Hereinafter referred to as "muscle detection sensor"), and when the measured value through the wireless communication unit 110 and the muscle detection sensor 145b, which communicate with the vehicle control device installed in the vehicle, And a control unit 180 for transmitting control commands to the vehicle control devices 400, 400 ', and 400' '.

The mobile terminal 100 worn on the user's wrist part senses the user's muscle movement or the like through the muscle detection sensor 145b.

The muscle detection sensor 145b may be installed on a part of the band 230 to sense whether the muscle of the wrist part is contracted.

According to one embodiment, when the resistance value of the pressure measured through the FSR (Force Sensing Resistor) sensor is equal to or greater than a predetermined threshold value, it is determined that the muscle has contracted, and the contraction of the muscle sensed through the plurality of FSR sensors causes the controller 180 ) Can estimate hand movements. Typical hand movements detected by the muscle detection sensor 145b may include a hand-held fist and a hand-operated state, and the bending motion of the other wrist may be sensed.

It goes without saying that the other muscle detection sensor 145b may use other sensors as well as the above-described FSR sensor. Specifically, a force sensor or a strain gauge sensor for sensing the pressure can be used to sense the contraction or relaxation of the muscles and further estimate the hand movement. When a force sensor is used as the muscle detection sensor 145b, the hand movement can be estimated similarly to using the FSR sensor. However, when the strain sensor is used, the degree of tension / shrinkage of the surface is measured, So that the movement of the hand can be detected. For example, the degree of bending of the wrist in the direction of bending can be estimated by grasping the hand or holding the hand by the degree of tension / shrinkage of the band 230 of the mobile terminal 100 worn on the wrist.

As described above, any one or a combination of FSR sensor, force sensor, and strain sensor may be used to sense muscle movement.

The mobile terminal according to an embodiment of the present invention detects the movement of the user's muscles in the wrist region through the muscle detection sensor 145b and transmits a control command to the vehicle control device based on the movement, And the vehicle control devices 400, 400 ', and 400' '.

11 is an exemplary view of a scenario utilizing a mobile terminal according to an embodiment disclosed herein.

For example, as shown in FIG. 11, when a user wearing the mobile terminal 100 on his or her wrists holds a load on both hands, in order to load the load held on both hands by the user on the vehicle 500, , The door (or trunk) of the vehicle must be opened.

According to an embodiment of the present invention, in order to solve the above-described problem, a proximity sensor is provided under the trunk-direction vehicle, and the proximity of the object is determined to determine the opening and closing of the trunk door.

Thus, a user holding a load on both hands allows the proximity sensor to recognize this by inserting a leg in the lower portion of the vehicle in the trunk direction, thereby allowing the vehicle to open the trunk.

However, according to this conventional embodiment, when the user holds a bulky load, the user can not see the bottom, and in particular, it is difficult to accurately recognize the lower position of the vehicle. Therefore, .

Further, even when the vehicle is parked on a slippery floor, or the user wears uncomfortable shoes, there is a problem that the user can not operate the trunk so that the trunk can be opened due to fear of injury.

However, according to the embodiment disclosed in the present specification, even if a user holding a load on both hands, the user wears a shoe which is placed in a slippery position or is uncomfortable for a user even if the load is large in volume The mobile terminal 100 senses the movement of the muscles of the user's wrist region and controls the corresponding control command, that is, a trunk open command, to the vehicle control Device, so that the vehicle can open the trunk.

At this time, the vehicle controllers 400, 400 'and 400' 'receive control commands from the mobile terminal 100 through the communication units 430, 406' and 408 '', , And controls the vehicle to operate the vehicle in accordance with the control command.

The communication between the mobile terminal 100 and the vehicle controllers 400, 400 ', 400' 'is performed through the wireless communication unit 110 and at least one of the vehicle controllers 400, 400', 400 " The mobile communication module 112, the wireless Internet module 113, the local area communication module 114, and the location information module 115 via the network of the local area network (LAN)

The control command transmitted from the mobile terminal 100 to the vehicle control devices 400, 400 ', 400 " is a control command for the entire vehicle including a vehicle air conditioning control command, a vehicle start on / off command, , But according to one embodiment disclosed herein, there is a control command to open at least one door or window of the vehicle 500, wherein the door is only a door installed in all seats of the vehicle 500 But it is preferable to include a trunk.

The control command selects at least one or a plurality of control commands among the various control commands through the user input unit 130 and transmits the control commands to the vehicle control apparatuses 400, 400 ', and 400 " Can be set.

Further, in the case of selecting a plurality of control commands, it is possible to set the order of the plurality of selected control commands, or to set a constant interval between the plurality of control operations when the vehicle 500 is operated according to the control command have.

Of course, in order to prevent repeated control commands from being transmitted when the mobile terminal 100 detects movement of the muscles and accordingly transmits control commands to the vehicle control apparatuses 400, 400 ', 400 & When transmitting a plurality of control commands, a control command may be transmitted with a predetermined interval therebetween.

Meanwhile, according to another embodiment disclosed herein, using the motion detection of the muscles through the muscle detection sensor 145b, the controller 180 can estimate the shape of the finger or wrist (bending, etc.) The control unit 180 may transmit the control command corresponding to the type of the estimated finger or wrist to the vehicle control device 400, 400 ', or 400' 'through the wireless communication unit 110. [

9 is a diagram illustrating an example of a finger shape of a user detected by a mobile terminal according to an embodiment disclosed herein.

As shown in Figs. 9 (a) to 9 (c), the control unit 180 can estimate the finger shape taken by the user using the muscle detection sensor 145b, To the vehicle control apparatuses 400, 400 ', 400 ".

Specifically, when the control unit 180 estimates the finger shape in which the index fingers are spread as shown in FIG. 9A, the control commands for opening the trunk are transmitted to the vehicle controllers 400, 400 ', 400 " 9B, a control command for opening the assisting seat side door of the vehicle 500 is transmitted to the vehicle control device 400, 400 ', 400' '. 9 (c), a control command for opening the assistant rear seat door of the vehicle 500 is transmitted to the vehicle control device 400, 400 ', 400 '').

On the other hand, Fig. 7 is a view showing the distribution of muscles in the wrist region of the body.

As shown in FIG. 7, the pronator quadratus (M) is located on the front part of the wrist in the body, but only the ligament is formed on the upper and lower sides of the a pisiform bone (B) It is located, but no muscle is formed.

Herein, the term "front portion" of the wrist portion in the specification means a portion in the same direction as the palm of the outer surface of the wrist, and "rear portion" means the back portion located opposite to the front portion.

Accordingly, the mobile terminal 100 according to an embodiment disclosed herein includes a proximity sensor 141, wherein the proximity sensor 141 is disposed on the front side of the wrist when the mobile terminal 100 is worn on the user's wrist. Is preferable.

8 is a longitudinal sectional view of a mobile terminal worn on a wrist according to an embodiment disclosed herein.

8 (a), the front portion of the wrist portion is spaced apart from the band 230 at a certain distance. However, when the user applies a force to the hand, as shown in Fig. 8 (b) The inner circumference M of the quadrangular pyramid shrinks and the front part of the wrist part has a narrower interval than the interval formed when the band 230 is not in contact with the hand or when the hand is not exerting a force.

Therefore, the proximity sensor 141 is provided at the position of the band 230 (the position of P3 shown in FIG. 8) corresponding to the front portion of the wrist portion having the inside of the rectangle M, It is preferable to detect the movement of the muscles according to the intervals of the muscles.

On the other hand, the proximity sensor 141 is located on the front portion of the user's wrist to sense an object in front of the proximity sensor 141. Depending on the distance between the proximity sensor 141 and the wrist, .

If the interval between the proximity sensor 141 and the forward object is smaller than the predetermined value, the control unit 180 determines that a force is applied to the user's hand, and transmits a control command to the vehicle controller 400 or 400 ' , 400 ".

At this time, the critical interval, which is a criterion for determining whether or not a force is applied to the user's hand, may be set by the user in advance, but may be set by learning.

For example, the control unit 180 may use a perceptron algorithm or the like used in a neural network study based on the distance from a plurality of measured forward objects through the proximity sensor 141, The interval can be calculated through repetitive learning, and the calculated critical interval can be set.

Here, the controller 180 makes final determination as to whether or not the muscles move by using both the detection result through the muscle detection sensor 145b and the movement of the muscle sensed through the proximity sensor 141, It is possible to improve the accuracy of judgment as to whether or not the user has made the decision.

For example, when the control unit 180 determines that the user has exerted the force only when the movement of the muscles is detected from both the muscle sensor 140 and the proximity sensor 141, It is possible to prevent the malfunction of the vehicle 500 due to malfunction of the mobile terminal 100 even if an error occurs.

In addition, the mobile terminal 100 may repeatedly measure the muscle sensor 140 and / or the proximity sensor 141 continuously or at regular intervals, in order to detect whether the user's muscles move.

Further, in order to detect whether or not the user is moving the muscles, the measurement time using the muscle detection sensor 140 and / or the proximity sensor 141 may be limited to a case where certain conditions are met. For example, The muscle sensor 140 and / or the proximity sensor 141 can be used only when the value measured by the acceleration sensor (not shown) provided in the mobile terminal 100 is less than a predetermined value, It is possible to detect whether or not the user's muscles are moving.

For example, when the user holds a heavy load, since the movement of the mobile terminal 100 worn on the wrist is expected to be small, when the movement of the mobile terminal 100 is large, And not to the control devices 400, 400 ', 400 ".

Meanwhile, the mobile terminal 100 according to another embodiment disclosed herein calculates the distance to the vehicle 500, specifically, the vehicle control device 400, 400 ', 400' ', Control commands to the vehicle control apparatuses 400, 400 ', 400 ".

10, when a user wearing the mobile terminal 100 applies a force to the hand while approaching the vehicle 500, the mobile terminal 100 senses the movement of the muscle, To the vehicle 500, and the door can be opened.

However, if the door of the vehicle 500 is opened at a distance longer than the preset distance D (hereinafter referred to as "critical distance"), before the user reaches the vehicle 500, There is a possibility that the vehicle 500 may be intruded and there is a possibility that the vehicle 500 may be stolen.

Therefore, only when the position of the mobile terminal 100 around the vehicle controllers 400, 400 ', 400' 'is within the range that the user can handle the vehicle 500, that is, within the critical distance, The above problem can be solved by transmitting the control command according to the muscle motion detection to the vehicle control devices 400, 400 ', and 400' '.

According to another embodiment, when the mobile terminal 100 detects movement of the user's muscles outside the critical distance, it does not transmit the predetermined control command to the vehicle control apparatuses 400, 400 ', 400 " Or when the distance between the mobile terminal 100 and the vehicle controllers 400, 400 ', 400 "is within a critical distance, when the mobile terminal 100 approaches the vehicle 500 within a predetermined time, It is preferable that the set control command is transmitted to the vehicle control device 400, 400 ', 400' 'so that the vehicle 500 performs the operation according to the control command.

As described above, the mobile terminal 100 and / or the vehicle control devices 400, 400 ', 400 " may follow known methods to calculate the distance therebetween, but according to one embodiment, The mobile terminal 100 determines the current position recognized using the position information module 115 and the current position calculated using the GPS module 407 ' And calculate the distance between the mobile terminal 100 and the vehicle controllers 400, 400 ', and 400' 'based on the positions of the mobile terminal 100 and the vehicle controllers 400, 400', and 400 ''.

The mobile terminal 100 and the vehicle control device 400 may be connected to each other using the communication availability or the communication signal intensity by the communication module mounted on the mobile terminal 100 and the vehicle controllers 400, (400, 400 ', 400' ') may be calculated. However, detailed description thereof will be omitted because they are outside the scope of the present invention.

In the meantime, according to an embodiment disclosed herein, the mobile terminal 100 can detect a movement of a muscle and transmit a predetermined control command to the vehicle control device 400, 400 ', 400 " As shown in FIG.

However, the mobile terminal 100 may transmit a corresponding control command to the vehicle control apparatuses 400, 400 ', 400' 'according to the direction in which the mobile terminal 100 approaches the vehicle 500.

The direction of approach of the mobile terminal 100 to the vehicle 500 or the vehicle controllers 400, 400 ', 400 "is determined by the position of the mobile terminal 100 measured at predetermined time intervals, 400 ', and 400' ', and may be calculated based on the direction component of the change vector.

The azimuth measured by various sensors (GPS module, MEMS-based sensors, etc.) mounted on the vehicle controllers 400, 400 ', 400 " The approach direction of the mobile terminal 100 can be calculated in consideration of the position of the mobile terminal 100 based on the position of the mobile terminal 100. [

Although it is possible to calculate the approach direction of the mobile terminal 100 to the vehicle control devices 400, 400 ', 400' 'by various known methods, the present invention does not limit the specific method of calculating the approach direction Do not.

13 is a diagram illustrating an area around a vehicle in which a mobile terminal can be located according to an embodiment disclosed herein.

For example, the area around the vehicle can be divided into the side areas A1 and A3, the right areas A2 and A4 and the rear area A5 with the vehicle as the center, as shown in Fig.

At this time, the area partitioned around the vehicle 500 takes into consideration the positions of the door and the trunk mounted on the vehicle 500, but the area can be modified or changed by the setting of the user.

At this time, when the user wearing the mobile terminal 100 approaches the rear area A5 of the vehicle 500, the mobile terminal 100 transmits a control command to open the trunk based on the approach direction to the vehicle controller 400 , 400 ', 400 "

Alternatively, when the mobile terminal 100 approaches from the area A1 to A4 of the vehicle 500, the door corresponding to each area (sequentially, the driver's seat side door, the assistant driver's side door, the driver's seat side rear door door, (Rear seat door) to the vehicle control device 400, 400 ', 400 ".

At this time, the output unit 150 may output the approach direction by any one of a display unit 151, an acoustic output unit 153, and a haptic module 155, or a combination thereof.

For example, the example shown in Fig. 13 may be output to the screen through the display unit 151, the sound or voice according to the approaching direction may be output, or the user may feel different touch depending on the approach direction .

On the other hand, the user can specify the approach direction of the vehicle 500 in advance to the mobile terminal 100.

Accordingly, when the approach direction of the mobile terminal 100 to the vehicle control devices 400, 400 ', 400' 'is different from the approach direction set by the user, the approach direction of the mobile terminal 100 is set to the predetermined The direction of the guidance can be output to the display unit 151, the sound output unit 153, and the haptic module 155, or a combination thereof, so as to be guided in the approach direction.

Suppose that the user has previously set the mobile terminal 100 to approach the vehicle 500 via the direction of the area A4 of the vehicle 500. [

If the mobile terminal 100 approaches the vehicle 500 from the rear area A5 of the vehicle, as shown in Fig. 13, the mobile terminal 100 may approach the vehicle 500 from the area direction of A4 The P path for guiding from the A5 area to the A4 area may be output through the display part 151, the sound output part 153 and the haptic module 155 or a combination thereof.

It is preferable to output through the output unit 150 in the form of a turn-by-turn (TBT) when outputting a path leading from the approach direction of the mobile terminal 100 to the preset approach direction.

Meanwhile, the mobile terminal according to one embodiment of the present invention transmits a control command to the vehicle controller 400, 400 ', 400' 'based on the approach direction of the mobile terminal 100 to the vehicle 500. If the control command is predefined in the mobile terminal 100 outside the critical distance centering on the position of the vehicle control device 400, 400 ', 400' ', the direction of approach of the mobile terminal 100 , 400 ', and 400' 'according to the distance between the mobile terminal 100 and the vehicle control devices 400, 400', and 400 ' .

Preferably, the mobile terminal 100 can automatically set the approach direction to the vehicle 500 in accordance with the control command set outside the critical distance.

Accordingly, when the approaching direction of the mobile terminal 100 to the vehicle 500 is different from the predetermined approaching direction, the guidance direction is guided through the output unit 150 so as to be guided to the predetermined approaching direction, .

For example, if a user holding a load on both hands wants to load a cargo in the back seat of the passenger seat far from the vehicle 500, the user can set an open command of the passenger's side rear seat door outside the critical distance from the vehicle 500 .

Accordingly, the mobile terminal 100 automatically sets the approach direction to approach the vehicle 500 through the A4 area, and if the user wearing the mobile terminal 100 accesses the vehicle 500 through the area A5 The mobile terminal 100 may output an induction signal along the P path so as to approach the vehicle 500 through the A4 area through the output unit 150. [

Even if the mobile terminal 100 is positioned within a critical distance centered on the vehicle control device 400, 400 ', or 400' through the A5 area, the vehicle 500 is controlled according to a predetermined control command regardless of the approach direction. Can open the passenger seat side rear seat door according to the control command by the vehicle control devices 400, 400 ', 400 ".

Meanwhile, according to one embodiment disclosed herein, the controller 180 recognizes the user voice received through the microphone 122, thereby transmitting a control command to the vehicle control apparatuses 400, 400 ', 400 " A confirmation process can be performed.

12 is an exemplary view of a scenario utilizing a mobile terminal according to another embodiment disclosed herein.

When the user merely moves the muscles of the wrist region, the mobile terminal 100 senses the movement of the muscles of the user's wrist region and transmits a corresponding control command, that is, a trunk open command, So that the vehicle can open the trunk (see Fig. 11).

At this time, the mobile terminal 100 senses the movement of the muscles through the muscle sensor 145b and transmits a predetermined control command to the vehicle controllers 400, 400 ', and 400' ', As shown in FIG. 12, the mobile terminal 100 can perform the verification procedure before transmitting the data to the vehicle control apparatuses 400, 400 ', 400' '.

When the mobile terminal 100 senses the movement of the muscles, the mobile terminal 100 can be set by the user, through the sound output unit 153, the haptic module 155, or the like, A confirmation message for confirming the control command to the user. For example, as shown in FIG. 12, when the mobile terminal 100 senses the movement of the muscles, it can output an acknowledgment message "Would you like to open the trunk?" Through the sound output unit 153.

In response to this, the control unit 180 recognizes the user voice received via the microphone 122 and transmits the control command to the vehicle control apparatuses 400, 400 ', 400' 'so that the vehicle 500 It is possible to operate according to the control command. For example, as shown in FIG. 12, the mobile terminal 100 receives and responds to "yes" and / or "thank you" among the voice of the user who affirms the confirmation message via the microphone 122, To transmit the control command to open the trunk to the vehicle control device 400, 400 ', 400 ".

Meanwhile, the mobile terminal 100 according to an embodiment disclosed herein may be configured to transmit the control command to the vehicle control device 400, 400 ', 400' 'before transmitting the control command to the vehicle control device 400, 400' ') And at least one authentication procedure.

Specifically, when communication is established between the mobile terminal 100 and the vehicle controllers 400, 400 ', 400' '(the mobile terminal 100 and the vehicle controllers 400, 400', 400 " The mobile terminal 100 and the vehicle controllers 400, 400 ', 400', 400 ', 400', 400 ', 400' and 400 ' It is desirable to establish a communication connection so that data can be transmitted and received between the terminals 400 and 400 '.

Also, the control unit 180 can receive the authentication information from the user through the user input unit 130, and can perform the second authentication procedure based on the input authentication information.

At this time, the authentication information may be a preset password, a fingerprint of the user, recognition information of a predetermined pattern, iris recognition information of the user, or information related to a specific gesture of the user.

Accordingly, only the authorized user can control the vehicle 500 using the mobile terminal 100, thereby preventing a third party using the stolen mobile terminal 100 from approaching the vehicle 500 in advance .

In addition, the control unit 180 can recognize the user's voice received through the microphone 122 and perform the third authentication procedure.

Specifically, a third authentication procedure through biometrics is performed, and a unique voice level, a volume, a tone, and the like of each person can be used.

That is, the control unit 180 can determine whether the authentication is successful by comparing the user's voice received through the microphone 122, the voice height, the amount, and the tone of the authenticated user stored in the memory 160.

However, it is possible to prevent the unauthorized control of the vehicle 500 by the unauthorized user by performing the third authentication procedure separately. However, in order to solve the troublesome problem by the additional authentication procedure, The mobile terminal 100 transmits a voice received via the microphone 122 in the process of performing a confirmation procedure for transmitting a control command to the vehicle controllers 400, 400 ', 400 " It is preferable to perform the third authentication procedure.

Meanwhile, the mobile terminal according to an embodiment disclosed herein may simultaneously or sequentially transmit a control command for a plurality of vehicles, so that a plurality of vehicles receiving the control command operate according to a control command.

That is, when the mobile terminal 100 senses the movement of the muscles, it can transmit the control command to the plurality of vehicle control devices 400, 400 ', 400 ".

Accordingly, the mobile terminal 100 can select at least one control command transmission target among a plurality of registered vehicle control devices 400, 400 ', and 400' ', and further includes a user input unit 130 ).

A vehicle control device that interacts with a mobile terminal that controls a vehicle by sensing movement of a user's muscles;

Hereinafter, a vehicle control apparatus interworking with a mobile terminal according to an embodiment disclosed herein includes a communication unit for performing communication with a mobile terminal 100 worn on a wrist portion of a user, And a control unit 410 for controlling the vehicle through the vehicle driving unit 420 according to a control command.

At this time, the mobile terminal 100 detects movement of the user's muscles and transmits a control command to the vehicle controllers 400, 400 ', and 400' 'as described above. However, The detailed description of the image forming apparatus 100 is the same as that described above, and thus a detailed description thereof will be omitted.

As described above, the vehicle control apparatuses 400, 400 ', 400' 'may be capable of controlling the vehicle through the vehicle driving unit 420 according to the control command received from the mobile terminal 100, Functions and navigation functions of the vehicle control apparatuses 400, 400 ', 400 ", and the description of each configuration of the vehicle control apparatuses 400, 400', 400" is the same as that described above, do.

The techniques disclosed herein may be applied to vehicles

Hereinafter, a vehicle to which the vehicle control device disclosed in this specification is applicable will be described with reference to Fig.

Although the electric vehicle is described in Fig. 14, the techniques disclosed herein may also be applied to other types of vehicles (e.g., a gasoline engine, a diesel engine, or a vehicle with an LPG engine) without departing from the technical concept disclosed herein Applicable to those skilled in the art.

22 is a schematic configuration diagram of an electric vehicle having a battery charging device according to the embodiment disclosed in this specification.

As shown in FIG. 22, an electric vehicle 600 having a battery charging apparatus according to an embodiment of the present invention includes a vehicle body 610, a battery 625 provided in the vehicle body 610, And a battery charging device 640 provided in the vehicle body 610 and connected to an external power source to charge the battery 625.

In the upper region of the vehicle body 610, although not shown, a passenger space on which the driver or the passenger can ride may be provided. For example, the vehicle body 610 may include a cabin (not shown) in which a boarding space is formed.

The vehicle body 610 may include a plurality of wheels 615 so that the vehicle body 610 can travel. A suspension 620 may be provided between the vehicle body 610 and the wheels 615, respectively. Accordingly, vibrations and shocks generated when the vehicle body 610 travels on the road surface can be alleviated.

The wheels 615 may be disposed on both the front and rear sides of the vehicle body 610, respectively.

The vehicle body 610 may be provided with a battery 625 for supplying power.

The battery 625 may be a rechargeable battery.

An electric motor 630 may be provided on one side of the vehicle body 610 to provide a driving force to the wheel 615.

The vehicle body 610 may be provided with an inverter device 635 for providing driving power to the electric motor 630. The inverter device 635 may be connected to the battery 625 and the motor 630, respectively.

The inverter unit 635 is connected to the battery 125 and receives DC power and converts the DC power to a power suitable for driving the motor 630 and provides the power to the motor 130.

The vehicle body 610 may be provided with a battery charging device 640 to charge the battery 625. The battery charging device 640 includes a charging circuit 660 connected to an external commercial power supply AC to convert commercial power into a power suitable for charging the battery 625 and providing the power to the battery 625, . The charging circuit 660 includes a commercial power input unit connected to a commercial power source and receiving commercial power, a rectifying unit converting a commercial power input through the commercial power input unit to DC, And a power conversion unit converting the converted DC power into a power suitable for charging the battery 625 and outputting the converted power.

Control method of mobile terminal

FIG. 15 is a block diagram showing a stepwise control method of a mobile terminal according to an embodiment disclosed herein.

As shown in FIG. 15, the method of controlling a mobile terminal according to an embodiment disclosed herein may include the steps of (S10) detecting a muscle movement of a user's wrist region by the muscle detection sensor 145b, The wireless communication unit 110 transmits a predetermined control command to the vehicle control apparatuses 400, 400 ', and 400' installed in the vehicle 500. The controller 400 determines whether the measured value of the muscle movement is greater than or equal to a threshold value, (Step S30).

The step of detecting the movement of the muscles S10 may be performed by the control unit 180 using any one of a FSR (Force Sensing Resistor) sensor, a force sensor and a Strain Guage sensor, or a combination thereof, The hand movement can be estimated by sensing the contraction or relaxation of the muscle or by measuring the degree of tension / contraction of the surface.

At this time, it is preferable that the muscle sensor 145b is installed at a part of the band.

When the movement of the muscle is detected through the muscle detection sensor 145b, the controller 180 determines whether the measured value is greater than or equal to a threshold value by the muscle detection sensor 145b. If the measured value is greater than or equal to the threshold value, (S30) to the vehicle controllers 400, 400 ', and 400' 'via the control unit 110 (S30), so that the vehicle 500 can drive according to the control commands.

For example, as shown in FIG. 11 or 12, even if the user holds a load on both hands, even if the load of the load is large, the user can not easily put the shoe in a slippery position, The mobile terminal 100 senses the movement of the muscles of the user's wrist region and transmits a corresponding control command, that is, a trunk open command, to the vehicle 100. In this case, To the control device so that the vehicle can open the trunk.

At this time, the vehicle control command transmitted from the mobile terminal 100 to the vehicle control devices 400, 400 ', 400 " includes the vehicle overall control command including the vehicle air conditioning control command, the vehicle start on / The door may be a control command to open at least one door or window of the vehicle 500 according to one embodiment disclosed herein, It is preferable to include a trunk as well as a door installed in the seat.

According to one embodiment, the controller 180 can estimate the shape of the finger or the shape of the wrist using the measured value through the muscle sensor 145b, and the controller 180 May transmit a control command corresponding thereto to the vehicle control apparatuses 400, 400 ', 400 "via the wireless communication unit 110. [

9A to 9C, the control unit 180 can estimate the finger shape taken by the user using the muscle detection sensor 145b, Control commands to the vehicle control apparatuses 400, 400 ', 400 ".

FIG. 16 is a block diagram showing a stepwise control method of a mobile terminal according to another embodiment disclosed herein.

16, the control unit 180 may further include a step S21 of calculating a distance to the vehicle control apparatuses 400, 400 ', 400' ', 400, 400 ', 400' 'may be determined according to the distance between the mobile terminal 100 and the vehicle controllers 400, 400', 400 ".

According to one embodiment, the control unit 180 may transmit a control command determined according to the calculated distance to the vehicle control apparatuses 400, 400 ', 400 ".

10, when a user wearing the mobile terminal 100 applies a force to the hand while approaching the vehicle 500, the mobile terminal 100 senses the movement of the muscle, To the vehicle 500, and the door can be opened.

However, if the door of the vehicle 500 is opened at a distance longer than the critical distance D, there is a risk of intrusion of the vehicle 500 by the intruder before the user reaches the vehicle 500, There is a problem with stolen goods.

Therefore, it may further include a step S22 of determining whether the generation of the control command is generated at a distance based on the critical distance D about the vehicle control apparatuses 400, 400 ', 400 " .

When the control command is generated in the vicinity based on the critical distance D, the generated control command is transmitted to the vehicle controllers 400, 400 'and 400' '(S30) The distance between the vehicle control apparatuses 400, 400 ', 400' 'and the mobile terminal 100 is set to be close to the threshold distance D on the basis of the distance D, (S23). ≪ / RTI >

Accordingly, when the distance between the mobile terminal 100 and the vehicle controllers 400, 400 ', 400' 'falls within the critical distance D, the operation of the vehicle 500 by the control command is performed desirable.

If the distance between the mobile terminal 100 and the vehicle control apparatuses 400, 400 ', 400' 'does not fall within the critical distance D, it is determined whether or not it is repeatedly close to the predetermined period The control unit 400 may transmit the control command to the vehicle control devices 400, 400 ', and 400' 'so that the vehicle is controlled by the vehicle driving unit 420. [

The step S21 of calculating the distance between the mobile terminal 100 and the vehicle controllers 400, 400 'and 400' 'may be performed using the location information module 115 in the mobile terminal 100, (Not shown) and the position of the vehicle control device 400, 400 ', 400' 'received via the wireless communication unit 110 and the position calculated by using the position information module 115 (Not shown) of calculating the distance between the mobile terminal 100 and the vehicle control apparatuses 400, 400 ', 400' 'based on the position of the terminal 100.

FIG. 17 is a block diagram showing a stepwise control method of a mobile terminal according to another embodiment disclosed herein.

As shown in FIG. 17, the control unit 180 may further include a step S24 of determining whether or not the muscles are moved according to the distance from the forward object measured through the proximity sensor 141.

7, when the mobile terminal 100 is worn on the wearer's wrist, the proximity sensor 141 is located at the front part of the wrist, And it is preferably installed on a part of the band 230 so as to be positioned on the front part of the wrist.

8 (a), the front portion of the wrist portion is spaced apart from the band 230 at a certain distance. However, when the user applies a force to the hand, as shown in Fig. 8 (b) The inner circumference M of the quadrangular pyramid shrinks and the front part of the wrist part has a narrower interval than the interval formed when the band 230 is not in contact with the hand or when the hand is not exerting a force.

On the other hand, the proximity sensor 141 is located on the front portion of the user's wrist to sense an object in front of the proximity sensor 141. Depending on the distance between the proximity sensor 141 and the wrist, .

If the interval between the proximity sensor 141 and the forward object is smaller than the predetermined value, the control unit 180 determines that a force is applied to the user's hand, and transmits a control command to the vehicle controller 400 or 400 ' , 400 ".

At this time, the critical interval, which is a criterion for determining whether or not a force is applied to the user's hand, may be set by the user in advance, but may be set by learning.

For example, the control unit 180 may use a perceptron algorithm or the like used in a neural network study based on the distance from a plurality of measured forward objects through the proximity sensor 141, The interval can be set by calculating through repetitive learning.

Here, the controller 180 makes final determination as to whether or not the muscles move by using both the detection result through the muscle detection sensor 145b and the movement of the muscle sensed through the proximity sensor 141, It is possible to improve the accuracy of judgment as to whether or not the user has made the decision.

In addition, the mobile terminal 100 may repeatedly measure the muscle sensor 140 and / or the proximity sensor 141 continuously or at regular intervals, in order to detect whether the user's muscles move.

Further, in order to detect whether or not the user is moving the muscles, the measurement time using the muscle detection sensor 140 and / or the proximity sensor 141 may be limited to a case where certain conditions are met. For example, The muscle sensor 140 and / or the proximity sensor 141 can be used only when the value measured by the acceleration sensor (not shown) provided in the mobile terminal 100 is less than a predetermined value, It is possible to detect whether or not the user's muscles are moving.

18 is a block diagram showing a stepwise control method of a mobile terminal according to another embodiment disclosed herein.

(S25) of judging the approach direction of the mobile terminal 100 to the vehicle controllers 400, 400 ', 400' 'as shown in Fig. 18, , The control command corresponding to the approach direction can be transmitted to the vehicle control apparatuses 400, 400 ', 400 ".

A specific method of determining the approach direction of the mobile terminal 100 to the vehicle control apparatuses 400, 400 ', 400' 'is to calculate the positional change of the mobile terminal 100 over time, Alternatively, the approach direction can be calculated using the azimuths measured by various sensors mounted on the vehicle control devices 400, 400 ', 400' '. However, the present invention does not limit the specific method for calculating the approach direction.

13, when the user wearing the mobile terminal 100 approaches the rear area A5 of the vehicle 500, the mobile terminal 100 opens the trunk based on the approach direction, for example, 400 ', 400' 'are driven to open the trunk through the vehicle drive unit 420. The vehicle control unit 400, 400', 400 " can do.

On the other hand, according to another embodiment, the output unit 150 may further include a step (S27) of outputting the approach direction as one of display, voice, and vibration, or a combination thereof.

The output unit 150 may output the approach direction using any one of a display unit 151, an acoustic output unit 153, and a haptic module 155, or a combination thereof.

For example, the example shown in Fig. 13 may be output to the screen through the display unit 151, the sound or voice according to the approaching direction may be output, or the user may feel different touch depending on the approach direction .

According to another embodiment, the user can set the approach direction of the vehicle 500 to the mobile terminal 100 in advance.

The method may further include a step S26 of determining whether the approach direction of the mobile terminal 100 to the vehicle controllers 400, 400 ', 400 " is the same as the approach direction set by the user.

If the approach direction of the mobile terminal 100 to the vehicle control devices 400, 400 ', 400' 'is different from the approach direction set by the user, the approach direction of the mobile terminal 100 is set to the predetermined approach The display unit 151, the sound output unit 153, and the haptic module 155, or a combination of the display unit 151, the acoustic output unit 153, and the haptic module 155 (S28).

The control unit 180 calculates a path from the current position of the mobile terminal 100 to the predetermined approach direction and outputs the path through the output unit 150. The control unit 180 preferably outputs a turn- Can be output.

On the other hand, when the control command is set to the mobile terminal 100 outside the critical distance D, the control unit 180 can automatically set the approach direction to the vehicle 500 according to the set control command.

Accordingly, when the approaching direction of the mobile terminal 100 to the vehicle 500 is different from the predetermined approaching direction, the guidance direction is guided through the output unit 150 so as to be guided to the predetermined approaching direction, .

According to another embodiment, the mobile terminal 100 may transmit a control command to the vehicle control device 400, 400 ', 400 " based on the approach direction to the vehicle 500, When the command is predefined in the mobile terminal 100 outside the critical distance centered on the position of the vehicle control device 400, 400 ', 400' ', the command is transmitted to the mobile terminal 100 regardless of the approach direction of the mobile terminal 100, 400 ', 400 "in accordance with the distance between the vehicle control device 400, 400', 400" and the vehicle control device 400, 400 ', 400 " .

Even if the mobile terminal 100 is positioned within a critical distance centered on the vehicle control device 400, 400 ', or 400' through the A5 area, the vehicle 500 is controlled according to a predetermined control command regardless of the approach direction. Can open the rear passenger door on the passenger seat side in accordance with a control command by the vehicle control devices 400, 400 ', 400 " (refer to FIG. 13).

Meanwhile, in the control method of the mobile terminal according to another embodiment disclosed herein, the control unit 180 recognizes the user voice received through the microphone 122, and confirms whether or not to transmit the control command (See Fig. 19).

When the user merely moves the muscles of the wrist region, the mobile terminal 100 senses the movement of the muscles of the user's wrist region and transmits a corresponding control command, that is, a trunk open command, The vehicle control device 400, 400 ', 400 "' may transmit the control command to the vehicle control device 400, 400 ', 400' ', , The mobile terminal 100 can perform the confirmation procedure as shown in FIG.

That is, when the mobile terminal 100 senses the movement of the muscles, the mobile terminal 100 may be pre-set, determined by the approach direction, A confirmation message for confirming the determined control command to the user. For example, as shown in FIG. 12, when the mobile terminal 100 senses the movement of the muscles, it can output an acknowledgment message "Would you like to open the trunk?" Through the sound output unit 153.

In response to this, the control unit 180 recognizes the user voice received via the microphone 122 and transmits the control command to the vehicle control apparatuses 400, 400 ', 400' 'so that the vehicle 500 It is possible to operate according to the control command. For example, as shown in FIG. 12, the mobile terminal 100 receives and responds to "yes" and / or "thank you" among the voice of the user who affirms the confirmation message via the microphone 122, To transmit the control command to open the trunk to the vehicle control device 400, 400 ', 400 ".

FIG. 19 is a block diagram showing a stepwise control method of a mobile terminal according to another embodiment disclosed herein.

As shown in FIG. 19, the controller 180 according to the embodiment disclosed herein may be configured to transmit the control command to the vehicle control apparatuses 400, 400 ', 400 "before transmitting the control command to the vehicle control apparatuses 400, 400' 400 ', 400 ") and at least one authentication procedure.

Specifically, when the communication establishing S2 between the mobile terminal 100 and the vehicle controllers 400, 400 'and 400' '(the mobile terminal 100 and the vehicle controllers 400, 400' and 400 ' The mobile terminal 100 and the vehicle control device 400 may be configured to perform the first authentication procedure before the first authentication procedure is successful, , 400 ', and 400 ", respectively.

Of course, if the first authentication procedure fails, no communication connection is established between the mobile terminal 100 and the vehicle control apparatuses 400, 400 ', 400 ".

According to another embodiment, the control unit 180 may further include a step (S3) of receiving the authentication information from the user through the user input unit 130 and performing a second authentication procedure based on the input authentication information can do.

At this time, the authentication information may be a preset password, a fingerprint of the user, recognition information of a predetermined pattern, iris recognition information of the user, or information related to a specific gesture of the user.

Accordingly, by allowing the authorized user who succeeds the second authentication procedure to control the vehicle 500 using the mobile terminal 100, a third party can access the vehicle 500 using the stolen mobile terminal 100 Can be prevented in advance.

The control unit 180 may further include a step (S29b) of recognizing the user voice received through the microphone 122 and performing a third authentication procedure.

Specifically, a third authentication procedure through biometrics is performed, and a unique voice level, a volume, a tone, and the like of each person can be used.

That is, the control unit 180 compares the user's voice received through the microphone 122 with the voice height, sound and tone of the authenticated user stored in the memory 160, Can be determined.

However, it is possible to prevent the unauthorized control of the vehicle 500 by the unauthorized user by performing the third authentication procedure separately. However, in order to solve the troublesome problem by the additional authentication procedure, The mobile terminal 100 performs a confirmation process of whether to transmit a control command to the vehicle control apparatuses 400, 400 ', 400 " in step S29a, It is preferable to perform the third authentication procedure.

As described above, when the vehicle 500 is controlled through the mobile terminal 100, the authentication process is performed so that the unauthorized person can not control the vehicle through the mobile terminal, thereby enhancing the security of the vehicle control.

Computer readable recording medium

The control method of the mobile terminal according to an embodiment of the present invention described above can be implemented in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program commands, data files, data structures, and the like, alone or in combination. The program instructions recorded on the computer-readable recording medium may be those specially designed and configured for the present invention or may be those known and used by those skilled in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; optical media), and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules for performing the processing according to the present invention, and vice versa.

The scope of the present invention is not limited to the embodiments disclosed herein, and the present invention can be modified, changed, or improved in various forms within the scope of the present invention and the claims.

100: mobile terminal 110: wireless communication unit
122: microphone 130: user input
150: output unit 151: display unit
153: Acoustic output unit 155: Haptic module
160: memory 180:
200: Wearable device 400, 400 ', 400'': Vehicle control device

Claims (22)

A mobile terminal which is always in contact with a wrist part of a user and is worn,
A muscle detection sensor for detecting movement of muscles of the user's wrist region;
A proximity sensor located at the front of the wrist when the mobile terminal is worn and sensing an object ahead;
A wireless communication unit for communicating with a vehicle control device installed in the vehicle; And
A controller for transmitting a predetermined control command to the vehicle control device based on any one of a value measured by the muscle sensor and a value measured by the proximity sensor, or a combination thereof;
. The method according to claim 1,
The control command includes:
Wherein the door is a control command for opening a door or a window of the vehicle, and the door is any one of a door and a trunk for at least one seat installed in the vehicle. The method according to claim 1,
Whether or not the vehicle is operated by the control command,
Wherein the distance is determined according to a distance between the mobile terminal and the vehicle control device. The method of claim 3,
Wherein the operation of the vehicle by the control command includes:
Even if the distance between the vehicle control device and the mobile terminal is greater than a threshold value measured at a distance from the muscle detection sensor based on a predetermined threshold distance, And when the vehicle belongs to a short distance as a reference, the operation of the vehicle by the control command is performed. The method of claim 3,
A location information module for recognizing the location of the mobile terminal;
, ≪ / RTI >
Wherein,
And calculates the distance to the vehicle control device based on the position of the vehicle control device received through the wireless communication part and the position of the mobile terminal through the position information module. The method according to claim 1,
Wherein,
Wherein the mobile terminal senses whether the muscle is moving according to an interval between the wrist and the part detected through the proximity sensor. The method according to claim 1,
Wherein,
And transmits the control command corresponding to the type of the finger or wrist estimated based on the change of the muscle sensed by the muscle sensor through the wireless communication unit. The method according to claim 1,
The control command includes:
And transmits a control command corresponding to the approach direction based on the approach direction of the mobile terminal to the vehicle control device. 9. The method of claim 8,
The control command includes:
Wherein the control command is a control command for opening the door of the vehicle corresponding to the approach direction. 9. The method of claim 8,
Wherein the operation of the vehicle by the control command includes:
Wherein when the distance between the vehicle control device and the mobile terminal is determined based on a predetermined threshold distance based on a distance from the vehicle control device to the mobile terminal, The operation of the vehicle by the control command generated at the long distance is performed. 9. The method of claim 8,
An output unit outputting the approach direction as one of display, voice and vibration, or a combination thereof;
The mobile terminal further comprising: 12. The method of claim 11,
The output unit includes:
And outputs the guidance direction as one of display, voice, and vibration, or a combination thereof, so as to guide the approaching direction to the predetermined approaching direction when the approaching direction is different from the predetermined approaching direction. The method according to claim 1,
An input for receiving from the user an input for selecting at least one vehicle control device for transmitting the control command among the plurality of vehicle control devices;
The mobile terminal further comprising: A method of controlling a mobile terminal that is always in contact with a wrist portion of a user and is worn,
Detecting a movement of the muscles of the wrist region of the user;
Measuring an interval to an object through a proximity sensor toward the wrist of the user; And
The control unit transmits a predetermined control command to the vehicle control device installed in the vehicle through the wireless communication unit based on any one or combination of the values measured by the muscle sensor and the proximity sensor ;
And transmitting the control information to the mobile terminal. 15. The method of claim 14,
The control command includes:
Wherein the door is a control command for opening a door or a window of the vehicle, and the door is any one of a door and a trunk for at least one seat installed in the vehicle. 15. The method of claim 14,
Wherein the control unit calculates a distance to the vehicle control device;
Further comprising:
Wherein the operation of the vehicle by the control command is determined according to a distance between the mobile terminal and the vehicle control device. 17. The method of claim 16,
Determining whether generation of the control command is generated at a distance based on a critical distance; And
Performing the operation of the vehicle by the control command when the distance between the vehicle control device and the mobile terminal is close to the critical distance reference when the control command generation is generated at a long distance;
The method of claim 1, further comprising: 17. The method of claim 16,
Wherein the calculating the distance comprises:
The location information module recognizing the location of the mobile terminal; And
Calculating a distance to the vehicle control device based on the position of the vehicle control device received through the wireless communication unit and the position of the mobile terminal through the position information module;
Wherein the mobile terminal is a mobile terminal. 15. The method of claim 14,
Wherein the step of transmitting to the vehicle control device comprises:
Wherein the control unit senses whether the muscle is moving according to an interval between the wrist and the part measured through the proximity sensor. 15. The method of claim 14,
Determining an approach direction of the mobile terminal to the vehicle control device;
Further comprising:
Wherein the step of transmitting the control command to the vehicle control apparatus comprises:
And transmits a control command corresponding to the approach direction based on the approach direction. 21. The method of claim 20,
The output unit outputs the approach direction as one of display, voice, and vibration, or a combination thereof;
The method of claim 1, further comprising: 22. The method of claim 21,
The output section outputting the guidance direction as one of display, voice, and vibration, or a combination thereof, so as to guide the approach direction to the predetermined approach direction when the approach direction is different from the predetermined approach direction;
The method of claim 1, further comprising:

Images