KR102385089B1 - Mobile terminal and control method for the mobile terminal - Google Patents

Abstract

The present invention relates to a mobile terminal capable of quickly providing a menu desired by a user based on a touch input and a method for controlling the same. a display unit; Displaying a control menu for controlling execution information of the menu based on a first touch input applied to the displayed menu on the display unit, and controlling the execution information based on a second touch input applied to the control menu It may include a control unit.

Description

Mobile terminal and its control method

The present invention relates to a mobile terminal and a method for controlling the same.

The terminal may be divided into a mobile/portable terminal and a stationary terminal according to whether the terminal can be moved. Again, the mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can carry it directly.

As such terminals are diversified in functions, for example, in the form of a multimedia device (Multimedia player) equipped with complex functions such as taking pictures or videos, playing music or video files, playing games, and receiving broadcasts. is being implemented.

An object of the present invention is to provide a mobile terminal capable of quickly providing a menu desired by a user based on a touch input and a method for controlling the same.

A mobile terminal according to an embodiment of the present invention includes: a display unit for displaying a menu indicating execution information of an application; Displaying a control menu for controlling execution information of the menu based on a first touch input applied to the displayed menu on the display unit, and controlling the execution information based on a second touch input applied to the control menu It may include a control unit.

In an embodiment of the present invention, the controller may display detailed information related to the execution information on the display unit based on a third touch input applied to the displayed menu.

In an embodiment of the present invention, the control unit sequentially displays the menu, the execution information, and the detailed information on the display unit based on a fourth touch input applied to the displayed menu, 5 Based on a touch input, the menu, the execution information, and the detailed information may be displayed on the display unit in a reverse order.

In an embodiment of the present invention, the controller may execute a first function or a second function of the control menu based on different types of touch inputs applied to the control menu.

In an embodiment of the present invention, if the control unit is not displayed on the display unit in a state in which a voice guidance voice corresponding to the road guidance information is muted while displaying the road guidance information on the display unit, You can automatically unmute your voice.

A mobile terminal and a method for controlling the same according to embodiments of the present invention can quickly provide a menu desired by a user based on a touch input.

A mobile terminal and a method for controlling the same according to embodiments of the present invention respond to the route guidance information if the route guidance information is not displayed when the voice corresponding to the route guidance information is muted while displaying the route guidance information By automatically outputting a voice that says

1 is a schematic diagram showing a vehicle for explaining an embodiment of the present invention.
2 is a diagram illustrating a configuration of a vehicle (eg, a hybrid electric vehicle) for explaining an embodiment of the present invention.
3 is a block diagram showing the configuration of a telematics terminal (vehicle terminal) 200 for explaining embodiments of the present invention.
4 is a block diagram illustrating a mobile terminal related to the present invention.
5A and 5B are conceptual views of an example of a mobile terminal related to the present invention viewed from different directions.
6 is a perspective view illustrating an example of a watch-type mobile terminal according to an embodiment of the present invention.
7 is a flowchart illustrating a method for controlling a mobile terminal according to an embodiment of the present invention.
8 is an exemplary view showing a menu according to an embodiment of the present invention.
9 is an exemplary diagram illustrating a control menu for controlling execution information of a menu according to an embodiment of the present invention.
10 is an exemplary diagram illustrating a method of converting a control screen (control menu) to an information screen (menu indicating execution information) according to an embodiment of the present invention.
11A-11D are exemplary views illustrating a method for converting a menu screen to a control screen or a detailed information screen according to an embodiment of the present invention.
12 is an exemplary diagram illustrating a method for controlling a menu according to an embodiment of the present invention.
13 is an exemplary diagram illustrating a method of controlling a sound output according to a menu control according to an embodiment of the present invention.

It should be noted that the technical terms used herein are used only to describe specific embodiments, and are not intended to limit the present invention. In addition, the technical terms used in this specification should be interpreted in the meaning generally understood by those of ordinary skill in the art to which the present invention belongs, unless otherwise defined in this specification, and excessively inclusive. It should not be construed in the meaning of a human being or in an excessively reduced meaning. In addition, when the technical terms used in the present specification are incorrect technical terms that do not accurately express the spirit of the present invention, they should be understood by being replaced with technical terms that can be correctly understood by those skilled in the art. In addition, the general terms used in the present invention should be interpreted according to the definition in the dictionary or according to the context before and after, and should not be interpreted in an excessively reduced meaning.

Also, as used herein, the singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “consisting of” or “comprising” should not be construed as necessarily including all of the various components or various steps described in the specification, some of which components or some steps are It should be construed that it may not include, or may further include additional components or steps.

In addition, terms including an ordinal number such as first, second, etc. used herein may be used to describe a plurality of elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component.

Hereinafter, a preferred embodiment according to the present invention will be described in detail with reference to the accompanying drawings, but the same or similar components are given the same reference numerals regardless of reference numerals, and redundant description thereof will be omitted.

In addition, in the description of the present invention, if it is determined that a detailed description of a related known technology may obscure the gist of the present invention, the detailed description thereof will be omitted. In addition, it should be noted that the accompanying drawings are only for easy understanding of the spirit of the present invention, and should not be construed as limiting the spirit of the present invention by the accompanying drawings.

1 is a schematic diagram showing a vehicle for explaining an embodiment of the present invention. Embodiments of the present invention can be applied not only to general automobiles (eg, gasoline automobiles, case automobiles, gas automobiles, etc.), but also pure electric vehicles, hybrid electric vehicles, and the like. The hybrid electric vehicle (HEV) is equipped with a battery pack composed of a plurality of battery cells to receive necessary power. The plurality of battery cells included in the battery pack needs to make the voltage of each battery cell uniform in order to improve safety and lifespan, and to obtain high output.

2 is a diagram illustrating a configuration of a vehicle (eg, a hybrid electric vehicle) for explaining an embodiment of the present invention.

As shown in FIG. 2 , a vehicle 100 for explaining an embodiment of the present invention includes an engine 101 and a motor/generator unit (hereinafter, referred to as “M/G unit” for short) as power sources. ) (102). A driven wheel driven by a power source is a front-wheel in a front-wheel drive vehicle and a rear-wheel in a rear-wheel drive vehicle. However, hereinafter, the front-wheel drive vehicle will be described. Embodiments relating to the rear-wheel drive vehicle are apparent from the following description of the front-wheel drive vehicle.

The M/B unit 102 is a device that selectively functions as a motor or a generator according to a driving state, and is apparent to those skilled in the art. Therefore, in the following description, the M/G unit 102 may be used with the same name as a motor or a generator for convenience of understanding, but all refer to the same components. The engine 101 and the motor 102 of the electric vehicle are connected to a transmission in series.

The M/G unit 102 is driven by a signal from an inverter 104 under the control of a motor control unit (MCU) 103 .

The inverter 104 drives the M/G unit 102 as a power source by using the electric energy stored in the battery 105 under the control of the MCU 103, and turns the M/G unit 102 into a generator. In the case of driving with the M/G unit 102, the electric energy generated by the battery 105 is charged.

The power of the engine 101 and the M/G unit 102 is transmitted to the transmission (T/M) 107 through the clutch 106 , and a final drive gear (F/R) 108 . is transmitted to the front wheel 109 through The rear wheels 110 are non-driven wheels that are not driven by the engine 101 and the M/G unit 102 .

A wheel brake apparatus 111 for reducing the rotation speed of each wheel is interposed in each of the front wheel 109 and the rear wheel 110 . And to drive each wheel brake device 111, a hydraulic control system ( hydraulic control system) (113). The electric vehicle includes a brake control unit (BCU) 114 that controls the hydraulic control system 113 and receives a brake control state from the hydraulic control system 113 .

The BCU 114 detects hydraulic pressure generated by the hydraulic pressure control system 113 when the driver operates the brake pedal 112 . The BCU 114 calculates a braking force to be applied to the driving wheels (eg, the front wheels 109 ), a hydraulic braking force to be braked by hydraulic pressure, and a regenerative braking force to be braked by regenerative braking, based on this. Accordingly, the BCU 114 supplies the calculated hydraulic braking force to the wheel brake device 111 of the front wheel 109 through the control of the hydraulic control system 113 .

The electric vehicle communicates with the BCU 114 and the MCU 103 and controls them to implement an electric vehicle that performs the maximum speed limiting method (hybrid electric vehicle electronic control unit: HEV-ECU) ) (115).

The regenerative braking force calculated by the BCU 114 is transmitted to the HEV-ECU 115 , and accordingly, the HEV-ECU 115 controls the MCU 103 based on the received regenerative braking force. Accordingly, the MCU 103 drives the M/G unit 102 as a generator so that the regenerative braking force specified from the HEV-ECU 115 is implemented. At this time, the electrical energy generated by the M/G unit 102 is stored in the battery 105 .

The electric vehicle further comprises a vehicle speed detector 116 that detects the vehicle speed.

The HEV-ECU 115 uses the vehicle speed detected by the vehicle speed detector 116 as data for controlling the BCU 114 and the MCU 103 .

In addition, the electric vehicle includes a battery voltage detector 117 that detects the voltage of the battery 105 . The battery voltage detection unit 117 detects the current voltage of the battery 105 and allows the HEV-ECU 115 to limit the maximum speed of the electric vehicle according to a deviation between the detected current voltage and a preset reference voltage. provide the resulting data.

Hereinafter, the configuration of the telematics terminal 200 for explaining an embodiment of the present invention will be described with reference to FIG. 3 .

3 is a block diagram showing the configuration of a telematics terminal (vehicle terminal) 200 for explaining embodiments of the present invention.

As shown in FIG. 3 , the telematics terminal 200 includes a controller (eg, central processing unit, CPU) 212 that controls the telematics terminal 200 as a whole, and a memory 213 that stores various information; , a key control unit 211 for controlling various key signals, and a main board 210 having a built-in LCD control unit 214 for controlling a liquid crystal display (LCD).

The memory 213 stores map information (map data) for displaying road guidance information on a digital map. In addition, the memory 213 stores a traffic information collection control algorithm for inputting traffic information according to a road condition on which the vehicle is currently traveling, and information for controlling the algorithm.

The main board is a CDMA (code division multiple access) module 206, which is a mobile communication terminal built into the vehicle with a unique device number, GPS (Global Positioning System) for guiding the location of the vehicle, tracking the driving route from the origin to the destination, etc. A GPS module 207 for receiving a positioning system signal or transmitting traffic information collected by a user as a GPS signal, a CD deck 208 for reproducing a signal recorded on a CD (compact disk), a gyro It is composed of a sensor (gyro sensor) 209 and the like. The CDMA module 206 and the GPS module 207 transmit/receive signals through the antennas 204 and 205 .

Also, the broadcast reception module 222 is connected to the main board and receives a broadcast signal through the antenna 223 . The main board includes a display unit (LCD) 201 that is controlled by the LCD control unit 214 through the interface board 203, a front board 202 that is controlled by the key control unit 211, and the interior and/or interior of the vehicle. Alternatively, a camera 227 for photographing the outside is connected. The display unit 201 displays various video signals and text signals, and the front board 202 includes buttons for inputting various key signals, and provides key signals corresponding to user-selected buttons to the main board. do. In addition, the display unit 201 includes a proximity sensor and a touch sensor (touch screen) of FIG. 2 . The display unit 201 may be a Head Up Display (HUD) or a vehicle cluster.

The front board 202 may include a menu key for directly inputting traffic information, and the menu key may be configured to be controlled by the key controller 211 .

The audio board 217 is connected to the main board and processes various audio signals. The audio board 217 includes a microcomputer 219 for controlling the audio board 217 , a tuner 218 for receiving radio signals, a power supply unit 216 for supplying power to the microcomputer 219 , and various voices. Consists of a signal processing unit 215 for processing a signal.

In addition, the audio board 217 includes a radio antenna 220 for receiving a radio signal and a CD deck 221 for reproducing an audio signal of a compact disc (CD). The audio board 217 may further include an audio output unit (eg, an amplifier) 226 for outputting the audio signal processed by the audio board 217 .

The audio output unit (amplifier) 226 is connected to the vehicle interface 224 . That is, the audio board 217 and the main board are connected to the vehicle interface 224 . The vehicle interface 224 may be connected to a hands-free 225a for inputting a voice signal, an airbag 225b for occupant safety, and a speed sensor 225c for detecting vehicle speed. The speed sensor 225c calculates a vehicle speed and provides the calculated vehicle speed information to the central processing unit 212 .

The navigation session 299 applied to the telematics terminal 200 generates route guidance information based on map data and vehicle current location information, and notifies the user of the generated route guidance information.

The display unit 201 detects a proximity touch in the display window through a proximity sensor. For example, when a pointer (eg, a finger or a stylus pen) is touched in proximity, the display unit 201 detects a position of the proximity touch, and displays position information corresponding to the detected position. output to the control unit 212 .

The voice recognition device (or voice recognition module) 298 recognizes a voice uttered by a user, and performs a corresponding function according to the recognized voice signal.

A navigation session 299 applied to the telematics terminal 200 displays a driving route on map data, and when the location of the mobile terminal is within a preset distance from a blind spot included in the driving route, wireless By automatically forming a wireless network with a terminal (eg, a vehicle navigation device) mounted on a nearby vehicle and/or a mobile terminal carried by a nearby pedestrian through communication (eg, a local area wireless communication network), the It receives the location information of the surrounding vehicle from the mounted terminal, and receives the location information of the surrounding pedestrian from the mobile terminal carried by the surrounding pedestrian.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation system, and a slate PC. , tablet PCs, ultrabooks, wearable devices, for example, watch-type terminals (smartwatch), glass-type terminals (smart glass), HMD (head mounted display), etc. may be included. there is.

4 is a block diagram illustrating a mobile terminal 300 related to the present invention.

The mobile terminal 300 includes a wireless communication unit 310 , an input unit 320 , a sensing unit 340 , an output unit 350 , an interface unit 360 , a memory 370 , a control unit 380 , and a power supply unit 390 . ) and the like. Since the components shown in FIG. 4 are not essential for implementing the mobile terminal, the mobile terminal described in this specification may have more or fewer components than those listed above.

More specifically, among the components, the wireless communication unit 310 includes a wireless communication system between the mobile terminal 300 and the wireless communication system, between the mobile terminal 300 and another mobile terminal, or between the mobile terminal 300 and an external server. It may include one or more modules that enable communication. In addition, the wireless communication unit 310 may include one or more modules for connecting the mobile terminal 300 to one or more networks.

The wireless communication unit 310 may include at least one of a broadcast reception module 311 , a mobile communication module 312 , a wireless Internet module 313 , a short-range communication module 314 , and a location information module 315 . .

The input unit 320 includes a camera 321 or image input unit for inputting an image signal, a microphone 322 or an audio input unit for inputting an audio signal, and a user input unit 323 for receiving information from a user, for example , a touch key, a push key, etc.). The voice data or image data collected by the input unit 320 may be analyzed and processed as a user's control command.

The sensing unit 340 may include one or more sensors for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 340 may include a proximity sensor 341 , an illumination sensor 342 , an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, and gravity. Sensor (G-sensor), gyroscope sensor, motion sensor, RGB sensor, infrared sensor (IR sensor: infrared sensor), fingerprint recognition sensor (finger scan sensor), ultrasonic sensor , optical sensors (eg, cameras (see 321)), microphones (see 322), battery gauges, environmental sensors (eg, barometers, hygrometers, thermometers, radiation sensors, It may include at least one of a thermal sensor, a gas sensor, etc.) and a chemical sensor (eg, an electronic nose, a healthcare sensor, a biometric sensor, etc.).

The biometric sensor may include any one or more of a fingerprint recognition sensor, an iris recognition sensor, a photo plethysmogram (PPG) sensor, an electrocardiogram (ECG) sensor, a heart rate variability (HRV) sensor, etc. there is.

Meanwhile, the mobile terminal disclosed in the present specification may combine and utilize information sensed by at least two or more of these sensors.

The output unit 350 is for generating an output related to visual, auditory or tactile sense, and includes at least one of a display unit 351 , a sound output unit 352 , a haptic module 353 , and an optical output unit 354 . can do. The display unit 351 may implement a touch screen by forming a mutually layered structure or integrally formed with the touch sensor. Such a touch screen may function as a user input unit 323 providing an input interface between the mobile terminal 300 and a user, and may provide an output interface between the mobile terminal 300 and a user.

The interface unit 360 serves as a passage with various types of external devices connected to the mobile terminal 300 . The interface unit 360 connects a device equipped with a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and an identification module. It may include at least one of a port, an audio I/O (Input/Output) port, a video I/O (Input/Output) port, and an earphone port. In response to the connection of the external device to the interface unit 360 , the mobile terminal 300 may perform appropriate control related to the connected external device.

Also, the memory 370 stores data supporting various functions of the mobile terminal 300 . The memory 370 may store a plurality of application programs (or applications) driven in the mobile terminal 300 , data for operation of the mobile terminal 300 , and commands. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs may exist on the mobile terminal 300 from the time of shipment for basic functions (eg, incoming calls, outgoing functions, message reception, and outgoing functions) of the mobile terminal 300 . Meanwhile, the application program may be stored in the memory 370 , installed on the mobile terminal 300 , and driven to perform an operation (or function) of the mobile terminal by the controller 380 .

The controller 380 generally controls the overall operation of the mobile terminal 300 in addition to the operation related to the application program. The controller 380 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 370 .

Also, the controller 380 may control at least some of the components discussed with reference to FIG. 4 in order to drive an application program stored in the memory 370 . Furthermore, in order to drive the application program, the controller 380 may operate at least two or more of the components included in the mobile terminal 300 in combination with each other.

The power supply unit 390 receives external power and internal power under the control of the control unit 380 to supply power to each component included in the mobile terminal 300 . The power supply 390 may include a battery 391 , and the battery 391 may be a built-in battery or a replaceable battery.

Meanwhile, the power supply unit 390 according to an embodiment of the present invention may apply power to the sensing unit 340 separately from the power applied to the control unit 380 . Accordingly, even when the power of the mobile terminal 300 is turned off, a state in which a preset level of power is applied to the sensing unit 340 may be maintained, and at least one sensor included in the sensing unit 340 may be You can also make it work.

At least some of the respective components may operate in cooperation with each other in order to implement an operation, control, or control method of a mobile terminal according to various embodiments to be described below. Also, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 370 .

Hereinafter, before looking at various embodiments implemented through the mobile terminal 300 as described above, the above-listed components will be described in more detail with reference to FIG. 4 .

First, referring to the wireless communication unit 310 , the broadcast reception module 311 of the wireless communication unit 310 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more of the broadcast reception modules may be provided to the mobile terminal 300 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The mobile communication module 312 is, the technical standards or communication methods for mobile communication (eg, Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), EV -Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (DO), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), LTE-A (Long Term Evolution-Advanced, etc.) transmits and receives a radio signal to and from at least one of a base station, an external terminal, and a server on a mobile communication network constructed according to.

The wireless signal may include various types of data according to transmission/reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 313 refers to a module for wireless Internet access, and may be built-in or external to the mobile terminal 300 . The wireless Internet module 313 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

As wireless Internet technology, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), etc., and the wireless Internet module ( 113) transmits and receives data according to at least one wireless Internet technology within a range including Internet technologies not listed above.

From the point of view that wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through a mobile communication network, the wireless Internet module 313 performs wireless Internet access through the mobile communication network. ) may be understood as a type of the mobile communication module 312 .

The short-range communication module 314 is for short-range communication, and includes Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, NFC. At least one of (Near Field Communication), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies may be used to support short-range communication. The short-distance communication module 314 is, between the mobile terminal 300 and the wireless communication system, between the mobile terminal 300 and another mobile terminal 300, or the mobile terminal 300 via wireless area networks (Wireless Area Networks). ) and a network in which another mobile terminal 300 or an external server is located can support wireless communication. The local area network may be local area networks (Wireless Personal Area Networks).

Here, the other mobile terminal 300 is a wearable device capable of exchanging (or interworking) data with the mobile terminal 300 according to the present invention, for example, a smart watch, a smart It may be glass (smart glass) or HMD (Head Mounted Display). The short-range communication module 314 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 300 in the vicinity of the mobile terminal 300 . Furthermore, when the sensed wearable device is a device authenticated to communicate with the mobile terminal 300 according to the present invention, the controller 380 transmits at least a portion of data processed in the mobile terminal 300 to the short-range communication module ( 314) may be transmitted to the wearable device. Accordingly, the user of the wearable device may use data processed by the mobile terminal 300 through the wearable device. For example, according to this, when a call is received in the mobile terminal 300, the user performs a phone call through the wearable device, or when a message is received in the mobile terminal 300, the user receives the received call through the wearable device. It is possible to check the message.

The location information module 315 is a module for acquiring a location (or current location) of a mobile terminal, and a representative example thereof includes a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, if the mobile terminal utilizes a GPS module, it can acquire the location of the mobile terminal by using a signal transmitted from a GPS satellite. As another example, if the mobile terminal utilizes the Wi-Fi module, the location of the mobile terminal may be obtained based on information of the Wi-Fi module and a wireless access point (AP) that transmits or receives a wireless signal. If necessary, the location information module 315 may perform any function of the other modules of the wireless communication unit 310 to obtain data on the location of the mobile terminal as a substitute or additionally. The location information module 315 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 320 is for input of image information (or signal), audio information (or signal), data, or information input from a user. For input of image information, the mobile terminal 300 has one Alternatively, a plurality of cameras 321 may be provided. The camera 321 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display 351 or stored in the memory 370 . On the other hand, a plurality of cameras 321 provided in the mobile terminal 300 may be arranged to form a matrix structure, and through the cameras 321 forming the matrix structure in this way, various angles or focal points are applied to the mobile terminal 300 . A plurality of image information with can be input. Also, the plurality of cameras 321 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 322 processes an external sound signal as electrical voice data. The processed voice data may be utilized in various ways according to a function (or a running application program) being performed by the mobile terminal 300 . Meanwhile, various noise removal algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 322 .

The user input unit 323 is for receiving information from the user, and when information is input through the user input unit 323 , the controller 380 may control the operation of the mobile terminal 300 to correspond to the input information. . Such a user input unit 323 is a mechanical input means (or a mechanical key, for example, a button located on the front or rear or side of the mobile terminal 100 , a dome switch, a jog wheel, a jog). switch, etc.) and a touch input means. As an example, the touch input means consists of a virtual key, a soft key, or a visual key displayed on the touch screen through software processing, or a part other than the touch screen. It may be made of a touch key (touch key) disposed on the. On the other hand, the virtual key or the visual key, it is possible to be displayed on the touch screen while having various forms, for example, graphic (graphic), text (text), icon (icon), video (video) or these can be made by a combination of

Meanwhile, the sensing unit 340 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a sensing signal corresponding thereto. The controller 380 may control the driving or operation of the mobile terminal 300 or perform data processing, functions, or operations related to an application program installed in the mobile terminal 300 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 340 will be described in more detail.

First, the proximity sensor 341 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor 341 may be disposed in an inner region of the mobile terminal covered by the touch screen as described above or in the vicinity of the touch screen.

Examples of the proximity sensor 341 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is a capacitive touch screen, the proximity sensor 341 may be configured to detect the proximity of an object having conductivity by a change in an electric field according to the proximity of the object. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the act of approaching an object on the touch screen without being in contact so that the object is recognized that it is located on the touch screen is called “proximity touch”, and the touch The act of actually touching an object on the screen is called "contact touch". The position at which the object is touched in proximity on the touch screen means a position in which the object vertically corresponds to the touch screen when the object is touched in proximity. The proximity sensor 341 may detect a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.) there is. On the other hand, the controller 380 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern detected through the proximity sensor 341 as described above, and furthermore, provides visual information corresponding to the processed data. It can be output on the touch screen. Furthermore, the controller 380 may control the mobile terminal 300 to process different operations or data (or information) according to whether a touch to the same point on the touch screen is a proximity touch or a contact touch. .

The touch sensor senses a touch (or touch input) applied to the touch screen (or the display unit 151) using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method. do.

As an example, the touch sensor may be configured to convert a change in pressure applied to a specific part of the touch screen or a change in capacitance occurring in a specific part of the touch screen into an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of a touch, an electrostatic capacitance at the time of a touch, etc. where a touch object applying a touch on the touch screen is touched on the touch sensor. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen, a stylus pen, or a pointer.

As such, when there is a touch input to the touch sensor, a signal(s) corresponding thereto is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the controller 180 . Accordingly, the control unit 380 can know which area of the display unit 351 has been touched, and the like. Here, the touch controller may be a component separate from the controller 380 , or may be the controller 380 itself.

Meanwhile, the controller 380 may perform different controls or may perform the same control according to the type of the touch object that touches the touch screen (or a touch key provided in addition to the touch screen). Whether to perform different controls or the same control according to the type of the touch object may be determined according to the current operating state of the mobile terminal 300 or a running application program.

On the other hand, the touch sensor and the proximity sensor described above are independently or in combination, a short (or tap) touch (short touch), long touch (long touch), multi touch (multi touch), drag touch (drag touch) on the touch screen ), flick touch, pinch-in touch, pinch-out touch, swype touch, hovering touch, etc. It can sense touch.

The ultrasonic sensor may recognize position information of a sensing target by using ultrasonic waves. On the other hand, the control unit 380 can calculate the position of the wave source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source may be calculated using the property that light is much faster than ultrasonic waves, that is, the time for light to reach the optical sensor is much faster than the time for ultrasonic waves to reach the ultrasonic sensor. More specifically, the position of the wave source may be calculated using a time difference from the time that the ultrasonic wave arrives using light as a reference signal.

On the other hand, the camera 321 as seen in the configuration of the input unit 320 includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 321 and the laser sensor may be combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. The photo sensor may be stacked on the display device, and the photo sensor is configured to scan the movement of the sensing target close to the touch screen. More specifically, the photo sensor mounts photo diodes and transistors (TRs) in rows/columns and scans the contents placed on the photo sensors using electrical signals that change according to the amount of light applied to the photo diodes. That is, the photo sensor calculates the coordinates of the sensing target according to the amount of change in light, and through this, location information of the sensing target can be obtained.

The display unit 351 displays (outputs) information processed by the mobile terminal 300 . For example, the display unit 351 may display information on an execution screen of an application program driven in the mobile terminal 300 , or user interface (UI) and graphic user interface (GUI) information according to the information on the execution screen. .

Also, the display unit 351 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glassesless method), or a projection method (holographic method) may be applied to the stereoscopic display unit.

The sound output unit 352 may output audio data received from the wireless communication unit 310 or stored in the memory 370 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output unit 352 also outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 300 . The sound output unit 352 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 353 generates various tactile effects that the user can feel. A representative example of the tactile effect generated by the haptic module 353 may be vibration. The intensity and pattern of vibration generated by the haptic module 353 may be controlled by a user's selection or setting of the controller 380 . For example, the haptic module 353 may synthesize and output different vibrations or output them sequentially.

In addition to vibration, the haptic module 353 is configured to respond to stimulation such as a pin arrangement that moves vertically with respect to the contact skin surface, a jet force or suction force of air through a nozzle or an inlet, a brush against the skin surface, contact of an electrode, an electrostatic force, etc. Various tactile effects can be generated, such as the effect of heat absorption and the effect of reproducing a feeling of coolness and warmth using an element capable of absorbing heat or generating heat.

The haptic module 353 may not only deliver a tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through a muscle sensation such as a finger or arm. Two or more haptic modules 353 may be provided according to the configuration of the mobile terminal 300 .

The light output unit 354 outputs a signal for notifying the occurrence of an event by using the light of the light source of the mobile terminal 300 . Examples of the event generated in the mobile terminal 300 may be message reception, call signal reception, missed call, alarm, schedule notification, e-mail reception, information reception through an application, and the like.

The signal output from the optical output unit 354 is implemented as the mobile terminal emits light of a single color or a plurality of colors toward the front or rear. The signal output may be terminated when the mobile terminal detects the user's event confirmation.

The interface unit 360 serves as a passage with all external devices connected to the mobile terminal 300 . The interface unit 360 receives data from an external device, receives power and transmits it to each component inside the mobile terminal 300 , or transmits data inside the mobile terminal 300 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a device equipped with an identification module. A port, an audio I/O (Input/Output) port, a video I/O (Input/Output) port, an earphone port, etc. may be included in the interface unit 360 .

On the other hand, the identification module is a chip storing various information for authenticating the usage right of the mobile terminal 300, a user identification module (UIM), a subscriber identity module (subscriber identity module; SIM), universal user authentication It may include a universal subscriber identity module (USIM) and the like. A device equipped with an identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Accordingly, the identification device may be connected to the terminal through the interface unit 360 .

In addition, the interface unit 360 is a passage through which power from the cradle is supplied to the mobile terminal 300 when the mobile terminal 300 is connected to an external cradle, or is input from the cradle by a user. Various command signals may be a passage through which the mobile terminal 300 is transmitted. Various command signals or the power input from the cradle may be operated as signals for recognizing that the mobile terminal 300 is correctly mounted on the cradle.

The memory 370 may store a program for the operation of the controller 380 and may temporarily store input/output data (eg, a phone book, a message, a still image, a moving image, etc.). The memory 370 may store data related to vibrations and sounds of various patterns output when a touch input on the touch screen is input.

The memory 370 is a flash memory type, a hard disk type, a solid state disk type (SSD), a silicon disk drive type (SDD), and a multimedia card micro type. ), card-type memory (such as SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read (EEPROM) -only memory), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk may include at least one type of storage medium. The mobile terminal 300 may be operated in relation to a web storage that performs a storage function of the memory 370 on the Internet.

Meanwhile, as described above, the controller 380 controls the operation related to the application program and the general operation of the mobile terminal 300 in general. For example, if the state of the mobile terminal satisfies a set condition, the controller 380 may execute or release a lock state that restricts input of a user's control command to applications.

In addition, the controller 380 performs control and processing related to voice calls, data communication, video calls, etc., or performs pattern recognition processing capable of recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively. can Furthermore, the control unit 380 may control any one or a plurality of components described above in order to implement various embodiments described below on the mobile terminal 300 according to the present invention.

The power supply unit 390 receives external power and internal power under the control of the control unit 380 to supply power required for operation of each component. The power supply unit 390 includes a battery, and the battery may be a built-in battery configured to be rechargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 390 may include a connection port, and the connection port may be configured as an example of the interface 360 to which an external charger that supplies power for charging the battery is electrically connected.

As another example, the power supply 390 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply 390 uses one or more of an inductive coupling method based on a magnetic induction phenomenon or a resonance coupling method based on an electromagnetic resonance phenomenon from an external wireless power transmitter. power can be transmitted.

Meanwhile, various embodiments below may be implemented in a computer-readable recording medium using, for example, software, hardware, or a combination thereof.

On the other hand, the sensing unit 340 of the mobile terminal 100 according to an embodiment of the present invention includes a tap sensing unit ( 343) may be further provided.

Here, the tap detection unit 343 may detect a gesture of tapping the main body of the mobile terminal 300 , the display unit 351 , or an object. More specifically, the tap is an operation of lightly tapping the main body or the display unit 351 or an object of the mobile terminal 300 with a tap object such as a finger, or lightly touching the tap object to the main body of the mobile terminal 300 or the display unit 351 or an object. It can be understood as a contact action.

On the other hand, the tap object to which the tap is applied may be an object capable of applying an external force to the main body of the mobile terminal 300 , the display unit 351 , or an object, for example, a finger, a stylus pen, or a pen. (pen), pointer, fist, etc. On the other hand, the tap object is not necessarily limited to an object that can apply a touch input to the mobile terminal 300 according to the present invention, and an external force can be applied to the main body of the mobile terminal 300, the display unit 351, or an object. As long as it is an object, its kind is irrelevant.

Meanwhile, the object to which the tap gesture is applied may include at least one of the main body of the mobile terminal 300 , the display unit 351 , and an object on which the mobile terminal 300 is placed.

Meanwhile, in the present invention, the tap or the tap gesture may be detected by at least one of an acceleration sensor and a touch sensor included in the tap sensing unit 343 . Here, the acceleration sensor is a sensor capable of measuring a dynamic force such as acceleration, vibration, or shock of the main body of the mobile terminal 300 .

That is, the acceleration sensor may detect whether a tap is applied to an object by detecting the movement (or vibration) of the main body of the mobile terminal 300 generated by the tap gesture. Accordingly, the acceleration sensor detects a tap on the main body of the mobile terminal 300 or the display unit 351, or detects whether movement or vibration has occurred in the main body of the mobile terminal 300. It is possible to detect that an object located close to and is tapped.

In this way, as long as the acceleration sensor is capable of detecting movement or vibration in the main body of the mobile terminal 300 , not only when the tap is applied to the main body of the mobile terminal 300 or the display unit 351 , but also the main body The tap can be detected even when it is applied to an deviated point.

In the mobile terminal according to the present invention, in order to detect a tap on the main body of the mobile terminal 300 or the display unit 351, either one of the acceleration sensor and the touch sensor is used, or the acceleration sensor and the touch sensor are sequentially used, or , or an acceleration sensor and a touch sensor may be used at the same time. Meanwhile, in order to detect a tap, a mode using only the acceleration sensor may be referred to as a first mode, and a mode using a touch sensor may be referred to as a second mode, and both the acceleration sensor and the touch sensor are used (simultaneously or sequentially) possible) may be referred to as a third mode or a hybrid mode.

On the other hand, when the tap is sensed through the touch sensor, it may be possible to more accurately determine the position where the tap is sensed.

Meanwhile, in the mobile terminal 300 according to the present invention, in order to detect the tap through an acceleration sensor or a touch sensor, the power supply unit ( 390) may be operated in a specific operating mode in which a minimum current or power applied from the device is maintained. This specific operation mode may be called a 'dose mode (or doze mode)'.

For example, in the doze mode, in the touch screen structure in which the touch sensor and the display unit 351 form a mutually layered structure, only the light emitting device for outputting a screen from the display unit 351 is off, and the touch The sensor may be in a state that maintains an on state. Alternatively, the doze mode may be a mode in which the display unit 351 is turned off and the acceleration sensor is maintained in an on state. Alternatively, the doze mode may be a mode in which the display unit 351 is turned off and both the touch sensor and the acceleration sensor are turned on.

Accordingly, in the doze mode state, that is, in a state in which the display unit 351 is illuminated, or in a state in which the display unit 351 is turned off (the display unit 351 is inactive), the user ), when the tap is applied to at least one point on the mobile terminal 300 or to a specific point on the main body of the mobile terminal 300, it is possible to detect that the tap has been applied by the user through at least one of an on touch sensor or an acceleration sensor. there is.

Also, the tap detection unit 343 may determine that a “tap” for the purpose of controlling the mobile terminal 300 is detected only when at least two or more taps are applied within a reference time period. For example, when a single tap is applied to the display 351 by a touch object capable of applying a touch to the display 351 , the tap detecting unit 343 converts the single tap into a touch input. can recognize That is, in this case, the controller 380 does not control the function corresponding to the single tap, but a function according to the touch input corresponding to the single tap (eg, the function output at the point where the touch input is applied). The ability to select an icon) can be controlled.

Accordingly, the control unit 380 is configured to control one or more functions only when at least two or more (or multiple) taps continuously applied within a reference time are sensed by the tap detection unit 343 . It may be determined that 'tap' is detected.

That is, tap gestures may mean that at least two tap gestures are continuously detected within a reference time. Therefore, hereinafter, "tap" is sensed may mean that a user's finger or an object such as a touch pen has been sensed to be tapped on the main body or display unit 351 of the mobile terminal 300 substantially multiple times. .

Furthermore, the controller 380 may determine whether the tap is detected within the reference time, as well as whether the tap is detected by different fingers or one finger of the user. For example, when the taps are detected by the display unit 351 , the controller 380 may determine whether the taps are made by one finger or by using different fingers using a fingerprint sensed at a portion to which the taps are applied. can detect whether Alternatively, the controller 380 may recognize a position at which the taps are sensed or an acceleration generated by the taps on the display unit 351 through at least one of a touch sensor and an acceleration sensor provided in the tap detection unit 343, Whether the taps are made through one finger or through different fingers may be detected.

Furthermore, the controller 380 further considers the angle and distance at which the tap is applied, or the direction in which the fingerprint is recognized, whether the user inputs the taps with one hand or one finger, or through both hands or at least two fingers. It can be determined whether or not an input has been made.

Meanwhile, the taps may mean a plurality of taps continuously sensed within a reference time. Here, the reference time may be a very short time, for example, may be within 300 ms to 2 s.

To this end, when it is sensed that the main body of the mobile terminal 300 is first tapped by the tap detector 343 , the tap detector 343 taps the next tap after the first tap within a reference time from the time the first tap is sensed. It can be detected that there is And when the next tap is detected within a reference time, the tap detection unit 343 or the controller 380 determines that a tap for controlling a specific function of the mobile terminal 300 is detected according to an embodiment of the present invention. can judge As such, the controller 380 recognizes as a 'valid tap' only when a second tap is detected within a predetermined time after the first tap is sensed, so that the user wants to control the mobile terminal 300 or by mistake. You can tell if a tap has been applied.

Also, there may be various methods for recognizing the 'valid tap'. For example, the control unit 380 controls the main body or the display unit 351 within a predetermined time after the first tap is tapped the first reference number of times or more than the first reference number of times is sensed for the second reference number of times or the second reference number. Detecting a second tap tapped more than a number of times may be recognized as the 'valid tap'. Here, the number of the first reference number of times and the number of the second reference number of times may be the same as or different from each other. For example, the first reference number of times may be one, and the second reference number of times may be two. As another example, both the first reference number and the second reference number may be one time.

Also, the controller 380 may determine that the “taps” are detected only when the tap is applied within a “predetermined area”. That is, when it is sensed that the main body of the mobile terminal 300 or the display unit 351 is first tapped, the controller 380 may calculate a predetermined area from the point where the first tap is sensed. Then, the control unit 380 taps the first or second reference number of times or more than the first or second reference number of times after the first tapping in the "predetermined area" within the reference time from the time the first tapping is sensed When this is detected, it may be determined that the first tap or the second tap has been applied.

Meanwhile, it goes without saying that the above-described reference time and predetermined region may be variously modified according to embodiments.

Meanwhile, it goes without saying that the first tap and the second tap may be sensed as separate taps according to a reference time and a predetermined area as well as a position where each tap is sensed. That is, when the second tap is sensed at a location spaced apart from the first tap by a predetermined distance or more, the controller 380 may determine that the first tap and the second tap have been applied. Also, when the first tap and the second tap are recognized based on the sensed position, the first tap and the second tap may be simultaneously sensed.

In addition, when the first tap and the second tap are composed of a plurality of touches, that is, a plurality of taps, it goes without saying that a plurality of touches constituting the first tap and the second tap, respectively, may also be simultaneously sensed. For example, at the same time as the first touch constituting the first tap is sensed, the first touch constituting the second tap is detected at a location more than a certain distance from the sensed position of the first touch of the first tap. When detected, the controller 380 may detect first touches constituting the first tap and the second tap, respectively. In addition, the controller 380 detects an additional touch input sensed at each location, and determines that the first tap and the second tap have been applied when a touch equal to or greater than the first reference number or the second reference number is sensed at each location can do.

On the other hand, when a tap on the main body of the mobile terminal 300 is detected a plurality of times by the tap detection unit 343 , the controller 380 controls at least one of the functions executable in the mobile terminal 300 based on the taps sensed a plurality of times. One can be controlled.

For example, when the plurality of taps corresponds to a preset condition, the controller 380 may control at least one of functions executable on the mobile terminal. For example, when the user applies the plurality of taps, the controller 380 may control different functions depending on whether the user uses only one finger or one hand, or uses at least two fingers or both hands. Alternatively, at least one of the functions executable in the mobile terminal 300 may be controlled based on the multiple taps based on the current operating state of the mobile terminal 300 and the environmental state of the mobile terminal 300 .

Here, the functions executable on the mobile terminal 300 may mean all types of functions that are executed or can be driven by the mobile terminal 300 . For example, one of the executable functions may be an application installed in the mobile terminal 300 . For example, 'an arbitrary function is executed' may mean 'an arbitrary application is executed or driven in the mobile terminal 300'.

As another example, the function executable in the mobile terminal 300 may be a function necessary for basic driving of the mobile terminal 300 . For example, a function necessary for basic driving may be a function of turning on/off the lighting provided in the display unit 351 , and switching the mobile terminal 300 from the unlocked state to the locked state, or vice versa in the locked state. There may be a function of switching to a release state, a function of setting a communication network, a function of changing setting information of the mobile terminal 300 , and the like.

On the other hand, the power supply unit 390 of the mobile terminal according to an embodiment of the present invention is a pattern recognition unit ( 392) may be included. In this case, the pattern recognition unit 392 may compare the patterns formed from the plurality of taps with the pre-stored patterns in the doze mode state, and according to the comparison result, the control unit 380 of the mobile terminal 300 and Power can be applied to each component. Accordingly, in the mobile terminal 300 according to an embodiment of the present invention, the power of the mobile terminal 300 is turned on based on a plurality of taps applied to the main body or the display unit 351 in a state in which the power is turned off. can

In addition, the function of the mobile terminal 300 that can be executed based on the plurality of taps may be a function of turning off the power of the mobile terminal 300 . In this case, the control unit 380 may turn off the power of the mobile terminal 300 by the plurality of taps, and on the contrary, the power of the mobile terminal 300 in the turned off state is turned on based on the plurality of taps. you might as well make it Accordingly, in the present invention, power on/off of the mobile terminal 300 can be controlled without using the power key.

5A and 5B are conceptual views of an example of a mobile terminal related to the present invention viewed from different directions.

5A and 5B, the disclosed mobile terminal 300 has a bar-shaped terminal body. However, the present invention is not limited thereto, and may be applied to various structures such as a watch type, a clip type, a glass type, or a folder type in which two or more bodies are coupled to be relatively movable, a flip type, a slide type, a swing type, a swivel type, etc. . Although it will relate to a particular type of mobile terminal, descriptions regarding a particular type of mobile terminal are generally applicable to other types of mobile terminals.

Here, the terminal body may be understood as a concept referring to the mobile terminal 300 as at least one aggregate.

The mobile terminal 300 includes a case (eg, a frame, a housing, a cover, etc.) forming an exterior. As shown, the mobile terminal 300 may include a front case 301 and a rear case 302 . Various electronic components are disposed in the inner space formed by the combination of the front case 301 and the rear case 302 . At least one middle case may be additionally disposed between the front case 301 and the rear case 302 .

A display unit 351 is disposed on the front surface of the terminal body to output information. As illustrated, the window 351a of the display unit 351 may be mounted on the front case 301 to form a front surface of the terminal body together with the front case 301 .

In some cases, an electronic component may also be mounted on the rear case 302 . Electronic components mountable to the rear case 302 include a removable battery, an identification module, a memory card, and the like. In this case, a rear cover 303 for covering the mounted electronic component may be detachably coupled to the rear case 302 . Accordingly, when the rear cover 303 is separated from the rear case 302 , the electronic components mounted on the rear case 302 are exposed to the outside.

As shown, when the rear cover 303 is coupled to the rear case 302 , a portion of the side surface of the rear case 302 may be exposed. In some cases, the rear case 302 may be completely covered by the rear cover 303 when combined. On the other hand, the rear cover 303 may be provided with an opening for exposing the camera 321b or the sound output unit 352b to the outside.

These cases 301 , 302 , and 303 may be formed by injection of synthetic resin or may be formed of metal, for example, stainless steel (STS), aluminum (Al), titanium (Ti), or the like.

Unlike the above example in which a plurality of cases provide an internal space for accommodating various electronic components, the mobile terminal 300 may be configured such that one case provides the internal space. In this case, the mobile terminal 300 of a uni-body in which synthetic resin or metal is connected from the side to the back can be implemented.

Meanwhile, the mobile terminal 300 may include a waterproofing unit (not shown) that prevents water from permeating into the terminal body. For example, the waterproof part is provided between the window 351a and the front case 301, between the front case 301 and the rear case 302, or between the rear case 302 and the rear cover 303, and a combination thereof It may include a waterproof member for sealing the inner space of the city.

The mobile terminal 300 includes a display unit 351 , first and second sound output units 352a and 352b , a proximity sensor 341 , an illuminance sensor 342 , a light output unit 354 , and first and second sound output units 352a and 352b. Cameras 321a and 321b, first and second operation units 323a and 323b, a microphone 322, an interface unit 360, and the like may be provided.

Hereinafter, as shown in FIGS. 5A and 5B , the display unit 351, the first sound output unit 352a, the proximity sensor 341, the illuminance sensor 342, and the light output unit ( 354), the first camera 321a and the first operation unit 323a are arranged, the second operation unit 323b, the microphone 322 and the interface unit 360 are arranged on the side of the terminal body, the terminal body The mobile terminal 300 in which the second sound output unit 352b and the second camera 321b are disposed on the rear side of the will be described as an example.

However, these configurations are not limited to this arrangement. These components may be excluded or replaced as necessary, or may be disposed on different sides. For example, the first operation unit 323a may not be provided on the front surface of the terminal body, and the second sound output unit 352b may be provided on the side surface of the terminal body rather than the rear surface of the terminal body.

The display unit 351 displays (outputs) information processed by the mobile terminal 300 . For example, the display unit 351 may display information on an execution screen of an application program driven in the mobile terminal 300 , or user interface (UI) and graphic user interface (GUI) information according to the information on the execution screen. .

The display unit 351 is a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display (flexible). display), a three-dimensional display (3D display), and an electronic ink display (e-ink display) may include at least one.

In addition, two or more display units 351 may exist according to an implementation form of the mobile terminal 300 . In this case, in the mobile terminal 300 , a plurality of display units may be spaced apart from each other on one surface or may be integrally disposed, or may be respectively disposed on different surfaces.

The display unit 351 may include a touch sensor for sensing a touch on the display unit 351 so as to receive a control command input by a touch method. Using this, when a touch is made on the display unit 351 , the touch sensor detects the touch, and the controller 380 may generate a control command corresponding to the touch based thereon. The content input by the touch method may be letters or numbers, or menu items that can be instructed or designated in various modes.

On the other hand, the touch sensor is configured in the form of a film having a touch pattern and disposed between the window 351a and a display (not shown) on the rear surface of the window 351a, or a metal wire patterned directly on the rear surface of the window 351a. may be Alternatively, the touch sensor may be formed integrally with the display. For example, the touch sensor may be disposed on a substrate of the display or provided inside the display.

As such, the display unit 351 may form a touch screen together with the touch sensor, and in this case, the touch screen may function as the user input unit 323 . In some cases, the touch screen may replace at least some functions of the first operation unit 323a.

The first sound output unit 352a may be implemented as a receiver that transmits a call sound to the user's ear, and the second sound output unit 352b is a loudspeaker that outputs various alarm sounds or multimedia reproduction sounds. ) can be implemented in the form of

A sound hole for emitting sound generated from the first sound output unit 352a may be formed in the window 351a of the display unit 351 . However, the present invention is not limited thereto, and the sound may be configured to be emitted along an assembly gap between structures (eg, a gap between the window 351a and the front case 301 ). In this case, the appearance of the mobile terminal 300 may be simpler because the hole formed independently for sound output is not visible or hidden.

The light output unit 354 is configured to output light to notify the occurrence of an event. Examples of the event include message reception, call signal reception, missed call, alarm, schedule notification, email reception, and information reception through an application. When the user's event confirmation is sensed, the controller 380 may control the light output unit 354 to end the light output.

The first camera 321a processes an image frame of a still image or a moving image obtained by an image sensor in a shooting mode or a video call mode. The processed image frame may be displayed on the display 351 and stored in the memory 370 .

The first and second manipulation units 323a and 323b are an example of the user input unit 323 operated to receive a command for controlling the operation of the mobile terminal 300, and may be collectively referred to as a manipulating portion. there is. The first and second operation units 323a and 323b may be adopted in any manner as long as they are operated in a tactile manner such as touch, push, scroll, and the like while the user receives a tactile feeling. Also, the first and second manipulation units 323a and 323b may be operated in a manner in which the user is operated without a tactile feeling through a proximity touch, a hovering touch, or the like.

In this drawing, the first operation unit 323a is illustrated as a touch key, but the present invention is not limited thereto. For example, the first operation unit 323a may be a push key (mechanical key) or may be configured as a combination of a touch key and a push key.

The contents input by the first and second operation units 323a and 323b may be variously set. For example, the first operation unit 323a receives commands such as menu, home key, cancel, search, etc., and the second operation unit 323b is output from the first or second sound output units 352a and 352b. It is possible to receive a command such as adjusting the volume of the sound and switching the display unit 351 to the touch recognition mode.

Meanwhile, as another example of the user input unit 323, a rear input unit (not shown) may be provided on the rear surface of the terminal body. The rear input unit is manipulated to receive a command for controlling the operation of the mobile terminal 300 , and input contents may be variously set. For example, a command such as power on/off, start, end, scroll, etc., control of the sound output from the first and second sound output units 352a and 352b, and a touch recognition mode of the display unit 351 You can receive commands such as switching of The rear input unit may be implemented in a form capable of input by a touch input, a push input, or a combination thereof.

The rear input unit may be disposed to overlap the display unit 351 on the front side in the thickness direction of the terminal body. For example, the rear input unit may be disposed on the upper rear portion of the terminal body so that the user can easily manipulate the terminal body using the index finger when holding the terminal body with one hand. However, the present invention is not necessarily limited thereto, and the position of the rear input unit may be changed.

As such, when the rear input unit is provided on the rear surface of the terminal body, a new type of user interface using the same can be implemented. In addition, when the aforementioned touch screen or rear input unit replaces at least some functions of the first operation unit 323a provided on the front surface of the terminal body, the first operation unit 323a is not disposed on the front surface of the terminal body, The display unit 351 may be configured as a larger screen.

Meanwhile, the mobile terminal 300 may be provided with a fingerprint recognition sensor for recognizing a user's fingerprint, and the controller 380 may use fingerprint information detected through the fingerprint recognition sensor as an authentication means. The fingerprint recognition sensor may be built in the display unit 351 or the user input unit 323 .

The microphone 322 is configured to receive a user's voice, other sounds, and the like. The microphone 322 may be provided at a plurality of locations and configured to receive stereo sound.

The interface unit 360 serves as a passage through which the mobile terminal 300 can be connected to an external device. For example, the interface unit 360 includes a connection terminal for connection with another device (eg, earphone, external speaker), a port for short-range communication (eg, an infrared port (IrDA Port), a Bluetooth port (Bluetooth) Port), a wireless LAN port, etc.], or at least one of a power supply terminal for supplying power to the mobile terminal 300 . The interface unit 360 may be implemented in the form of a socket for accommodating an external card such as a subscriber identification module (SIM), a user identity module (UIM), or a memory card for storing information.

A second camera 321b may be disposed on the rear side of the terminal body. In this case, the second camera 321b has a photographing direction substantially opposite to that of the first camera 321a.

The second camera 321b may include a plurality of lenses arranged along at least one line. The plurality of lenses may be arranged in a matrix form. These cameras, as 'array cameras'? can be named When the second camera 321b is configured as an array camera, an image may be captured in various ways using a plurality of lenses, and an image of better quality may be obtained.

The flash 324 may be disposed adjacent to the second camera 321b. The flash 324 illuminates light toward the subject when the subject is photographed by the second camera 321b.

A second sound output unit 352b may be additionally disposed on the terminal body. The second sound output unit 352b may implement a stereo function together with the first sound output unit 352a, and may be used to implement a speakerphone mode during a call.

At least one antenna for wireless communication may be provided in the terminal body. The antenna may be built into the terminal body or formed in the case. For example, an antenna forming a part of the broadcast reception module 311 may be configured to be withdrawn from the terminal body. Alternatively, the antenna may be formed in a film type and attached to the inner surface of the rear cover 303 , and a case including a conductive material may be configured to function as an antenna.

A power supply unit 390 (refer to FIG. 4 ) for supplying power to the mobile terminal 300 is provided in the terminal body. The power supply unit 390 may include a battery 391 built into the terminal body or detachably configured from the outside of the terminal body.

The battery 391 may be configured to receive power through a power cable connected to the interface unit 360 . In addition, the battery 391 may be configured to be wirelessly charged through a wireless charging device. The wireless charging may be implemented by a magnetic induction method or a resonance method (magnetic resonance method).

On the other hand, in this figure, the rear cover 303 is coupled to the rear case 302 to cover the battery 391 to limit the detachment of the battery 391 and to protect the battery 391 from external shocks and foreign substances. is foreshadowing When the battery 391 is configured to be detachably attached to the terminal body, the rear cover 303 may be detachably coupled to the rear case 302 .

An accessory for protecting the appearance of the mobile terminal 300 or assisting or extending the function of the mobile terminal 300 may be added to the mobile terminal 300 . As an example of such an accessory, there may be a cover or a pouch that covers or accommodates at least one surface of the mobile terminal 300 . The cover or pouch may be configured to extend the function of the mobile terminal 300 by interworking with the display unit 351 . As another example of the accessory, there may be a touch pen (pen unit) for assisting or extending a touch input to a touch screen.

Next, a communication system that can be implemented through the mobile terminal 300 according to the present invention will be described.

First, the communication system may use different air interfaces and/or physical layers. For example, the air interfaces available by a communication system include Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA). ), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A)), Global System for Mobile Communications (GSM), etc. may be included.

Hereinafter, for convenience of description, the description will be limited to CDMA. However, it is apparent that the present invention can be applied to all communication systems including CDMA wireless communication systems as well as OFDM (Orthogonal Frequency Division Multiplexing) wireless communication systems.

The CDMA wireless communication system includes at least one terminal 100, at least one base station (Base Station, BS (also referred to as Node B or Evolved Node B)), and at least one base station controller (Base Station Controllers, BSCs). ), and a mobile switching center (MSC). The MSC is configured to be connected to a Public Switched Telephone Network (PSTN) and BSCs. BSCs may be connected in pairs with a BS through a backhaul line. The backhaul line may be provided according to at least one of E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, and xDSL. Accordingly, a plurality of BSCs may be included in a CDMA wireless communication system.

Each of the plurality of BSs may include at least one sector, and each sector may include an omni-directional antenna or an antenna pointing in a specific radial direction from the BS. In addition, each sector may include two or more antennas of various types. Each BS may be configured to support multiple frequency assignments, and each of the multiple frequency assignments may have a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

A broadcast transmitter (BT) transmits a broadcast signal to the terminals 100 operating in the system. The broadcast reception module 311 shown in FIG. 4 is provided in the terminal 300 to receive a broadcast signal transmitted by BT.

In addition, a global positioning system (GPS) for confirming the location of the mobile terminal 300 may be linked to the CDMA wireless communication system. The satellite helps to locate the mobile terminal 300 . Useful location information may be obtained by two or fewer or more satellites. Here, the location of the mobile terminal 300 may be tracked using not only the GPS tracking technology but also all techniques capable of tracking the location. In addition, at least one of the GPS satellites may optionally or additionally be responsible for satellite DMB transmission.

The location information module 315 provided in the mobile terminal is for detecting, calculating, or identifying the location of the mobile terminal, and representative examples include a Global Position System (GPS) module and a Wireless Fidelity (WiFi) module. If necessary, the location information module 315 may perform any function of the other modules of the wireless communication unit 310 to obtain data on the location of the mobile terminal as a substitute or additionally.

The GPS module 315 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to accurately calculate three-dimensional current location information according to latitude, longitude, and altitude. can do. Currently, a method of calculating position and time information using three satellites and correcting errors in the calculated position and time information using another one satellite is widely used. In addition, the GPS module 315 may calculate the speed information by continuously calculating the current location in real time. However, it is difficult to accurately measure the position of the mobile terminal using the GPS module in the shaded area of the satellite signal, such as indoors. Accordingly, in order to compensate for positioning by the GPS method, a WiFi Positioning System (WPS) may be utilized.

A WiFi positioning system (WPS) uses a WiFi module provided in the mobile terminal 100 and a wireless AP (Wireless Access Point) that transmits or receives a wireless signal with the WiFi module, the mobile terminal 100 As a technology for tracking the location of a wireless network, it refers to a wireless local area network (WLAN)-based positioning technology using WiFi.

The Wi-Fi location tracking system may include a Wi-Fi positioning server, a mobile terminal 300, a wireless AP connected to the mobile terminal 300, and a database in which arbitrary wireless AP information is stored.

The mobile terminal 300 connected to the wireless AP may transmit a location information request message to the Wi-Fi location location server.

The Wi-Fi positioning server extracts information on the wireless AP connected to the mobile terminal 300 based on the location information request message (or signal) of the mobile terminal 300 . Information on the wireless AP connected to the mobile terminal 300 may be transmitted to the Wi-Fi positioning server through the mobile terminal 300 or may be transmitted from the wireless AP to the Wi-Fi positioning server.

Based on the location information request message of the mobile terminal 300, the extracted wireless AP information is MAC Address, Service Set IDentification (SSID), Received Signal Strength Indicator (RSSI), Reference Signal Received Power (RSRP), RSRQ ( Reference Signal Received Quality), channel information, Privacy, Network Type, signal strength, and noise strength may be at least one.

As described above, the Wi-Fi positioning server may receive information on a wireless AP connected to the mobile terminal 300 and extract wireless AP information corresponding to the wireless AP to which the mobile terminal is connected from a pre-established database. At this time, the information of arbitrary wireless APs stored in the database includes MAC Address, SSID, channel information, Privacy, Network Type, latitude and longitude coordinates of the wireless AP, the name of the building where the wireless AP is located, the number of floors, and detailed indoor location information (GPS coordinates). available), the AP owner's address, phone number, and the like. In this case, in order to remove a mobile AP or a wireless AP provided using an illegal MAC address in the positioning process, the Wi-Fi positioning server may extract only a predetermined number of wireless AP information in order of increasing RSSI.

Thereafter, the Wi-Fi positioning server may extract (or analyze) the location information of the mobile terminal 300 using at least one wireless AP information extracted from the database. By comparing the included information and the received wireless AP information, the location information of the mobile terminal 300 is extracted (or analyzed).

As a method for extracting (or analyzing) the location information of the mobile terminal 300, a Cell-ID method, a fingerprint method, a triangulation method, a landmark method, etc. may be utilized.

The Cell-ID method is a method of determining the location of a wireless AP having the strongest signal strength among surrounding wireless AP information collected by the mobile terminal as the location of the mobile terminal. It has the advantages of being simple to implement, not requiring additional cost, and being able to quickly obtain location information, but has a disadvantage in that the positioning accuracy is lowered when the installation density of the wireless AP is low.

The fingerprint method is a method of collecting signal strength information by selecting a reference position in a service area, and estimating the position through signal strength information transmitted from a mobile terminal based on the collected signal strength information. In order to use the fingerprint method, it is necessary to make a database of propagation characteristics in advance.

The triangulation method is a method of calculating the position of a mobile terminal based on the coordinates of at least three wireless APs and the distance between the mobile terminal. In order to measure the distance between the mobile terminal and the wireless AP, the signal strength is converted into distance information, the time at which a wireless signal is transmitted (Time of Arrival, ToA), and the time difference of the signal is transmitted (Time Difference of Arrival, TDoA) , the angle at which the signal is transmitted (Angle of Arrival, AoA), etc. may be used.

The landmark method is a method of measuring the location of a mobile terminal using a landmark transmitter that knows the location.

In addition to the enumerated methods, various algorithms may be utilized as a method for extracting (or analyzing) location information of a mobile terminal.

The extracted location information of the mobile terminal 300 is transmitted to the mobile terminal 300 through the Wi-Fi positioning server, so that the mobile terminal 300 can acquire the location information.

The mobile terminal 300 may acquire location information by being connected to at least one wireless AP. In this case, the number of wireless APs required to acquire the location information of the mobile terminal 300 may be variously changed according to the wireless communication environment in which the mobile terminal 300 is located.

4, the mobile terminal according to the present invention includes Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and Near Field Communication (NFC). Field Communication), a short-distance communication technology such as Wireless USB (Wireless Universal Serial Bus) may be applied.

Among them, the NFC module provided in the mobile terminal supports contactless short-range wireless communication between terminals at a distance of about 10 cm. The NFC module may operate in any one of a card mode, a reader mode, and a P2P mode. In order for the NFC module to operate in the card mode, the mobile terminal 300 may further include a security module for storing card information. Here, the security module may be a physical medium such as a Universal Integrated Circuit Card (UICC) (eg, a Subscriber Identification Module (SIM) or a Universal SIM (USIM)), a Secure micro SD, and a sticker, or a logical medium embedded in the mobile terminal ( For example, it may be an embedded secure element (SE). Data exchange based on SWP (Single Wire Protocol) may be performed between the NFC module and the security module.

When the NFC module is operated in card mode, the mobile terminal may transmit stored card information to the outside like a traditional IC card. Specifically, when a mobile terminal that stores card information of a payment card, such as a credit card or a bus card, is brought close to a payment machine, a mobile short-distance payment can be processed, and the mobile terminal that stores card information of the access card is approved for access Proximity to the aircraft may initiate the access approval process. Cards such as credit cards, transportation cards, and access cards are loaded in the security module in the form of an applet, and the security module may store card information about the loaded card. Here, the card information of the payment card may be at least one of a card number, balance, and usage history, and the card information of the access card is at least one of a user's name, number (eg, user's student number or company number), and access details. can be one

When the NFC module is operated in the reader mode, the mobile terminal may read data from an external tag. In this case, data received by the mobile terminal from the tag may be coded in a data exchange format determined by the NFC forum. In addition, the NFC forum defines four record types. Specifically, the NFC forum defines four Record Type Definitions (RTDs) such as Smart Poster, Text, Uniform Resource Identifier (URI), and General Control. When the data received from the tag is a smart poster type, the controller executes a browser (eg, an Internet browser), and when the data received from the tag is a text type, the controller executes a text viewer. When the data received from the tag is a URI type, the controller executes a browser or makes a call, and when the data received from the tag is a general control type, an appropriate operation may be executed according to the control content.

When the NFC module operates in a peer-to-peer (P2P) mode, the mobile terminal may perform P2P communication with another mobile terminal. In this case, a Logical Link Control Protocol (LLCP) may be applied to P2P communication. For P2P communication, a connection may be created between a mobile terminal and another mobile terminal. In this case, the generated connection may be divided into a connectionless mode in which one packet is exchanged and terminated, and a connection-oriented mode in which packets are continuously exchanged. Through P2P communication, data such as electronic business cards, contact information, digital photos, URLs, and setup parameters for Bluetooth and Wi-Fi connections may be exchanged. However, since the available distance of NFC communication is short, the P2P mode may be effectively utilized for exchanging small-sized data.

The present invention described above can be implemented as computer-readable codes on a medium in which a program is recorded. The computer-readable medium includes all types of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is also a carrier wave (eg, transmission over the Internet) that is implemented in the form of. In addition, the computer may include the control unit 180 of the terminal. Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

Hereinafter, embodiments related to a control method that can be implemented in a mobile terminal configured as described above will be described with reference to the accompanying drawings. It is apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit and essential characteristics of the present invention.

The mobile terminal 300 described above is configured to sense a touch input by a pen unit. The pen unit may be a stylus pen capable of applying a touch input to the touch screen, a wireless pen configured to transmit and receive wireless signals to and from the terminal, or the like. The wireless signal may be transmitted/received using ultrasonic waves, magnetic fields, infrared rays, or the like.

The display unit 351 may include a touch sensor that detects a touch input. The screen information output from the display unit 351 includes various graphic objects, and in this case, the graphic objects may be implemented in the form of images, texts, and icons. The home screen page may also be expressed as an idle screen, and the home screen page may be output on the display unit 151 when the terminal is in an idle state. More specifically, an icon of an application installed in the mobile terminal, an icon of a folder in which the icons are stored, or an icon of a widget may be displayed on the home screen page. Here, icons (thumbnail images) or folders are examples of the graphic object.

On the other hand, the mobile terminal can be extended to a wearable device that can be worn on the body beyond the dimension that the user mainly holds in his hand. Such wearable devices include smart watches, smart glasses, and head mounted displays (HMDs). Hereinafter, examples of mobile terminals extended to wearable devices will be described.

The wearable device may be configured to be able to exchange (or interwork) data with another mobile terminal 300 . The short-range communication module 314 may detect (or recognize) a wearable device capable of communicating around the mobile terminal 300 . Furthermore, when the detected wearable device is a device that is authenticated to communicate with the mobile terminal 300 , the controller 380 transmits at least a portion of data processed by the mobile terminal 300 to the wearable device through the short-range communication module 314 . can be sent to Accordingly, the user may use data processed by the mobile terminal 300 through the wearable device. For example, when a call is received in the mobile terminal 300, a phone call is performed through the wearable device, or when a message is received in the mobile terminal 300, it is possible to check the received message through the wearable device .

6 is a perspective view illustrating an example of a watch-type mobile terminal 400 related to an embodiment of the present invention.

Referring to FIG. 6 , the watch-type mobile terminal 400 includes a main body 401 having a display unit 451 and a band 402 connected to the main body 401 to be worn on the wrist. In general, the mobile terminal 400 may include all or some of the components of the mobile terminal 300 of FIG. 4 .

The body 401 includes a case forming an exterior. As illustrated, the case may include a first case 401a and a second case 401b that provide an internal space for accommodating various electronic components. However, the present invention is not limited thereto, and one case is configured to provide the inner space, so that the unibody mobile terminal 400 may be implemented.

The watch-type mobile terminal 400 is configured to enable wireless communication, and an antenna for the wireless communication may be installed in the main body 401 . On the other hand, the antenna can expand its performance by using a case. For example, a case including a conductive material may be electrically connected to the antenna to expand the ground area or the radiation area.

A display unit 451 may be disposed on the front surface of the main body 401 to output information, and a touch sensor may be provided on the display unit 451 to be implemented as a touch screen. As illustrated, the window 451a of the display unit 451 may be mounted on the first case 401a to form a front surface of the terminal body together with the first case 401a.

The main body 401 may include a sound output unit 452 , a camera 421 , a microphone 422 , a user input unit 423 , and the like. When the display unit 451 is implemented as a touch screen, it may function as the user input unit 423 , and accordingly, a separate key may not be provided in the main body 401 .

The band 402 is worn on the wrist to surround the wrist, and may be formed of a flexible material for easy wearing. As such, the band 402 may be made of leather, rubber, silicone, synthetic resin, or the like. In addition, the band 402 is configured to be detachably from the body 401, and may be configured to be replaceable with a band of various types according to the user's taste.

On the other hand, the band 402 may be used to extend the performance of the antenna. For example, the band may have a built-in ground extension unit (not shown) electrically connected to the antenna to expand the ground area.

The band 402 may include a fastener 402a. The fastener 402a may be implemented by a buckle, a snap-fit hook structure, or velcro (trade name), etc., and may include an elastic section or material. . In this figure, an example in which the fastener 402a is implemented in the form of a buckle is presented.

Hereinafter, the telematics terminal 200 will be described as a mobile terminal.

7 is a flowchart illustrating a method for controlling a mobile terminal according to an embodiment of the present invention.

First, the control unit 212 displays a menu indicating execution information of the application on the display unit 201 (S11). For example, the controller 212 may control execution information (eg, turn-by-turn of a navigation application) of an application executed among a plurality of applications (eg, a navigation application, a music application, a phone application, a mirror link application, etc.). information, music information of a music application, sender or receiver information of a phone application, screen information of a mirror link application, etc.) is displayed on the display unit 201 .

The control unit 212 displays a control menu for controlling execution information of the menu on the display unit 201 based on a touch input applied to the menu indicating execution information of the application (S12).

8 is an exemplary view showing a menu according to an embodiment of the present invention.

As shown in FIG. 8 , the controller 212 controls execution information (eg, a navigation application) of an application executed among a plurality of applications (eg, a navigation application, a music application, a phone application, a mirror link application, etc.). Turn-by-turn information of , music information of a music application, sender or receiver information of a phone application, screen information of a mirror link application, etc.) (or information screen) 8-1 is displayed on the display unit 201 . When there are a plurality of menus 8-1 representing the execution information, the control unit 212 may display the plurality of menus on the display unit 201 in order of user preference. When there are a plurality of menus 8-1 indicating the execution information, the control unit 212 may display the plurality of menus on the display unit 201 in the order of most recent use.

The control unit 212 may control a touch input (eg, menu 8-1) applied to a menu 8-1 indicating execution information of the application or any one of the plurality of menus 8-2. A control menu for controlling the execution information of the menus 8-1 and 8-2 based on the flicking touch to the right at the point of any one of the plurality of menus (8-2) (8-3) displayed on the display unit 201 . For example, the control unit 212 may control a touch & drag (flicking) input (flick touch) 8-3 applied to the menu 8-1 or any one of the plurality of menus 8-2. When this is received, a control menu (or control screen) for controlling the execution screen of the menu 8-1 or the execution screen of any one of the plurality of menus 8-2 is displayed on the display unit 201 .

The control unit 212 is a short (or tap) touch (short touch), long touch (long touch), multi-touch ( multi touch), drag touch, pinch-in touch, pinch-out touch, swype touch, hovering touch, etc. When received, an execution screen of the menu 8-1 or a control menu for controlling an execution screen of any one of the plurality of menus 8-2 may be displayed on the display unit 201 .

9 is an exemplary diagram illustrating a control menu for controlling execution information of a menu according to an embodiment of the present invention.

As shown in FIG. 9 , when a touch input (eg, flick touch) applied to the menu 8-1 or any one of the plurality of menus 8-2 is received, the controller 212 receives A control menu 9-1 for controlling the execution screen of the menu 8-1 or the execution screen of any one of the plurality of menus 8-2 is displayed on the display unit 201 . For example, when it is assumed that the menu 8-1 or any one of the plurality of menus 8-2 is music information (eg, a song title, a singer's name, etc.), the control unit 212 may control the When a touch input (eg, flick touch) applied to the menu 8-1 or one of the plurality of menus 8-2 is received, a music play menu (icon, button), a music pause menu (icon , button), a music reproduction speed control menu (icon, button), etc. may be displayed on the display unit 201 as the control menu (or control screen) 9-1.

When it is assumed that the menu 8-1 or any one of the plurality of menus 8-2 is navigation information (eg, turn-by-turn information), the control unit 212 controls the menu 8-1. Alternatively, when a touch input (eg, flick touch) applied to any one of the plurality of menus 8-2 is received, for controlling an audio output level of the navigation information (eg, turn-by-turn information) A menu, a menu for enlarging or reducing map data of the navigation information (eg, turn-by-turn information) may be displayed on the display unit 201 as the control menu (or control screen).

When it is assumed that the menu 8-1 or any one of the plurality of menus 8-2 is navigation information (eg, turn-by-turn information), the control unit 212 controls the menu 8-1. Or, when a touch input (eg, flick touch) applied to any one of the plurality of menus 8-2 is received, detailed information (eg, turn-by-turn information) of the navigation information (eg, turn-by-turn information) is received. Turn-by-turn information 9-2a, current location 9-2b, detailed information including map data 9-2c, etc.) 9-2 may be displayed on the display unit 201 .

The controller 212 controls execution information of the menu based on a touch input applied to the control menu (S13). For example, when it is assumed that the control menu is the music play menu (icon, button), the music pause menu (icon, button), and the music playback speed control menu (icon, button), When the music pause menu (icon, button) is selected, the currently playing music is paused, and when the music playback speed control menu (icon, button) is selected, the playing music is played slowly or quickly.

10 is an exemplary diagram illustrating a method for converting a control screen (control menu) to an information screen (menu indicating execution information) according to an embodiment of the present invention.

As shown in FIG. 10 , the control unit 212 controls a touch input applied to the control menu 9-1 (eg, a flick touch from the point of the control menu 9-1 to the left) (10). When -1) is received, the control menu 9-1 is switched (returned) to a menu (information screen) indicating the execution information. For example, the control unit 212 controls the menu 9-1 including a music play menu (icon, button), a music pause menu (icon, button), a music playback speed control menu (icon, button), and the like. When an applied touch input (eg, a flick touch from the point of the control menu 9-1 to the left) 10-1 is received, the control menu 9-1 is displayed as a menu (information) indicating the music information. screen) to (return).

The control unit 212 controls detailed information (eg, turn-by-turn information 9-2a, current location 9-2b, and map data 9- of the navigation information (eg, turn-by-turn information)). 2c) When a touch input (eg, flick touch from the point of the detailed information 9-2 to the left) 10-2 applied to the detailed information 9-2 is received, the detailed information including 2c) 9-2 is received. The information 9-2 is switched (returned) to a menu (information screen) indicating the navigation information (eg, turn-by-turn information).

11A-11D are exemplary views illustrating a method for converting a menu screen to a control screen or a detailed information screen according to an embodiment of the present invention.

As shown in FIG. 11A , the control unit 212 controls menus (icons, etc.) 11-1 representing a plurality of applications (eg, navigation applications, music applications, phone applications, mirror link applications, video applications, etc.) ) is indicated.

As shown in FIG. 11B , the control unit 212 controls menus (icons, etc.) 11- representing the plurality of applications (eg, navigation applications, music applications, phone applications, mirror link applications, video applications, etc.) 1) When a touch input (eg, pinch-out touch input) is received on the screen, execution information of the menu (eg, turn-by-turn information of a navigation application, music information of a music application, caller or receiver information of a phone application) , a menu (or information screen) 8-1 indicating screen information of the mirror link application, etc.) is displayed on the display unit 201 .

11C , when the touch input (eg, pinch-out touch input) is received again on the menu 8-1 indicating the execution information, the controller 212 receives the menu 8-1 ), a control menu 9-1 for controlling execution information is displayed on the display unit 201 .

When it is assumed that the menu 8-1 is navigation information (eg, turn-by-turn information), the control unit 212 controls the touch input (eg, pinch-out touch) on the menu 8-1. input) is received again, the detailed information of the navigation information (eg, turn-by-turn information) (eg, detailed information including turn-by-turn information, current location, map data, etc.) 9-2 It may be displayed on the display unit 201 .

11D , when a touch input (eg, double touch, long touch, etc.) for enlarging or reducing the detailed information 9-2 is received, the control unit 212 receives the detailed information 9 -2) is enlarged (11-2) or reduced.

The control unit 212 sequentially displays the menu, the execution information, and the detailed information on the display unit 201 based on a touch input (eg, pinch-out touch input) applied to the displayed menu. The control unit 212 may display the menu, the execution information, and the detailed information on the display unit 201 in reverse order based on a touch input (eg, pinch-in touch input) applied to the displayed menu. there is.

12 is an exemplary diagram illustrating a method for controlling a menu according to an embodiment of the present invention.

As shown in FIG. 12 , the control unit 212 displays control menus indicating the execution information on the display unit 201, and then applies the control menus applied to the first control menu 12-1 among the control menus to each other. A first function or a second function of the first control menu 12-1 is executed based on a different type of touch input. For example, assuming that the first control menu 12 - 1 is a music control menu, the controller 212 receives a flicking touch input from the position of the music control menu to the previous song (music). ), and when a flicking touch input downward from the position of the music control menu is received, the next song may be played.

Assuming that the first control menu 12-1 is a navigation control menu, the controller 212 provides previous navigation information and recently registered when a flicking touch input upward from the location of the navigation control menu is received. Any one or more of information provision and route cancellation may be performed. When a flicking touch input downward from the location of the navigation control menu is received, the controller 212 may perform any one or more of providing next route information, providing route guidance information to home, and muting the navigation.

Assuming that the first control menu 12-1 is a media control menu, the control unit 212 provides a previous file when a flicking touch input upward from the position of the media control menu is received, and provides the media control menu. When a flicking touch input downward from the position of the control menu is received, the next file may be provided.

Assuming that the first control menu 12-1 is a phone call control menu, the control unit 212 provides a list of recent calls when a flicking touch input upward from the location of the phone call control menu is received, , when a flicking touch input downward from the location of the phone call control menu is received, a list of phone numbers may be provided.

13 is an exemplary diagram illustrating a method of controlling a sound output according to a menu control according to an embodiment of the present invention.

13 , the controller 212 controls the menu 11-1 and the execution information (turn-by) based on a touch input (eg, pinch-out touch input) applied to the displayed menu. Turn information) 8-2, the detailed information (navigation information) 9-2, and the enlarged information 11-1 are sequentially displayed on the display unit 201 . The control unit 212 controls the menu 11-1, the execution information 8-2, and the detailed information 9 based on a touch input (eg, pinch-in touch input) applied to the displayed menu. -2) and the enlarged information (enlarged navigation image) 11-1 may be displayed on the display unit 201 in the reverse order. The controller 212 may mute a voice corresponding to the route guide information based on a user input while outputting route guide information (navigation information) from the current location to the destination.

The control unit 212 controls the enlarged road guidance image 11-1, the detailed information (path guidance information) 9-2, and the execution information (turn-by-turn information) 8 as in the group A of FIG. 13 . As shown in -2), if the voice corresponding to the navigation information is in the muted state when the road guidance information is displayed, the muted state of the voice is maintained. On the other hand, the control unit 212 controls the enlarged road guidance image 11-1, the detailed information (path guidance information) 9-2, and the execution information (turn-by-turn information) as in group B of FIG. 13 . As shown in (8-2), when the voice guidance information is not displayed on the display unit 201 and the voice corresponding to the road guidance information is in the muted state, the voice is automatically canceled. For example, the control unit 212 controls the enlarged road guidance image 11-1, the detailed information (path guidance information) 9-2, and the execution information (turn-by-turn), as in the group B of FIG. 13 . information) (8-2), when the navigation information is not displayed on the display unit 201 and only the navigation menu 13-1 is displayed, a voice corresponding to the navigation information is automatically output. That is, the control unit 212 displays the navigation information on the display unit 201 in a state in which the navigation information corresponding to the navigation information is muted while the navigation information (road guide information) is displayed on the display unit 201 . If not, the voice guidance voice is automatically canceled.

On the other hand, when the navigation information is displayed again on the display unit 201 after automatically canceling the voice guidance voice, the controller 212 automatically deletes the voice guidance voice.

As described above, the mobile terminal and the method for controlling the same according to embodiments of the present invention can quickly provide a menu desired by a user based on a touch input.

A mobile terminal and a method for controlling the same according to embodiments of the present invention respond to the route guide information if the route guide information is not displayed when the voice corresponding to the route guide information is muted while displaying the route guide information By automatically outputting a voice to the driver, the driver can easily and quickly receive route guidance information.

The present invention described above can be implemented as computer-readable codes on a medium in which a program is recorded. The computer-readable medium includes all types of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is also a carrier wave (eg, transmission over the Internet) that is implemented in the form of. In addition, the computer may include the control unit 180 of the terminal. Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

Claims (5)

a display unit for displaying a menu indicating execution information of an application;
A control menu for controlling execution information of the menu is displayed on the display unit based on a first touch input applied to the displayed menu, and the execution information is controlled based on a second touch input applied to the control menu, ,
While outputting the route information from the current location to the destination, based on a user input, mute a voice corresponding to the route guide information;
If the way guidance information is not displayed on the display unit in a state in which a voice guidance voice corresponding to the road guidance information is muted while displaying the road guidance information on the display unit, automatically cancel the erasure of the navigation voice;
automatically outputting a voice corresponding to the route guidance information when only the navigation menu is displayed without the route guidance information being displayed on the display unit;
and a controller for maintaining the muted state of the voice when the road guidance information is displayed on the display in a state in which the voice corresponding to the road guidance information is muted. According to claim 1, wherein the control unit,
and displaying detailed information related to the execution information on the display unit based on a third touch input applied to the displayed menu. According to claim 2, wherein the control unit,
The menu, the execution information, and the detailed information are sequentially displayed on the display unit based on a fourth touch input applied to the displayed menu, and the menu and the execution information are sequentially displayed on the display unit based on a fifth touch input applied to the displayed menu. Information and the detailed information are displayed on the display unit in a reverse order. According to claim 1, wherein the control unit,
and executing a first function or a second function of the control menu based on different types of touch inputs applied to the control menu. According to claim 1,
When the control menu executes the first function of the navigation control menu, the control unit provides previous navigation information, provides information on the latest registered place, or cancels a route when a flicking touch input upward from the location of the navigation control menu is received. any one or more of the
When the control menu receives a flicking touch input downward from the position of the navigation control menu, any one or more of providing next route information, providing route guidance information to the home, and muting the navigation is performed,
When the navigation mute is executed, mute the voice corresponding to the route guidance information;
When one of the enlarged road guidance image, the road guidance information, or the execution information of the navigation control menu is displayed on the display unit, if the voice corresponding to the road guidance information is in a muted state, maintaining the muted state of the voice Characterized by a mobile terminal.

Images