KR20120045126A - Mobile terminal and operating method thereof - Google Patents

Abstract

PURPOSE: A portable terminal and operation method thereof are provided to enable a user to effectively confirm on or off state by using an operation key area displayed on a touch screen. CONSTITUTION: An output unit(150) outputs one or more images, sound, vibration in the turn on state of a three dimensional motion recognition function. The output unit displays one or more touch areas on a touch screen. A sensing unit(140) senses a three dimensional motion a first touch motion for a specific part of a portable terminal. A control unit(180) turns on or off the three dimensional recognition function by responding to the first touch motion. The control unit executes a specific function by responding to the three dimensional motion and the second touch motion.

Description

Mobile terminal and its driving method {MOBILE TERMINAL AND OPERATING METHOD THEREOF}

The present invention relates to a mobile terminal and a mobile terminal driving method capable of performing a predetermined function by using a 3D motion recognition function.

As terminals, such as personal computers, laptops, mobile phones, and smartphones, are diversified in function, multimedia devices with complex functions such as taking pictures or videos, playing music or video files, and receiving games and broadcasts It is implemented in the form of (multimedia player).

For functional support and enhancement of the terminal, it may be considered to improve the structural and / or software part of the terminal. Recently, a variety of terminals including mobile terminals provide a complex and various functions, and the menu structure is also becoming complicated.

In particular, recently, studies for performing various functions of the mobile terminal using 3D motion recognition have been actively conducted. Here, 3-dimensional gesture recognition refers to executing a predetermined function by recognizing a movement in a three-dimensional space, such as shaking or shaking a mobile terminal itself.

In order to implement such a three-dimensional gesture recognition function in a mobile terminal, a hardware gesture key for preventing a mobile terminal from performing a predetermined function in response to a three-dimensional gesture in which a user's intention is unknown. Is needed. However, such hardware operation keys may be a limitation in the hardware structure design of the mobile terminal.

SUMMARY OF THE INVENTION The present invention has been made in an effort to provide a mobile terminal capable of replacing a hardware operation key with a touch screen for preventing malfunction when performing a 3D motion recognition function and a method of driving the mobile terminal using the same.

Technical problems to be achieved by the present invention are not limited to the above-mentioned technical problems, and other technical problems not mentioned above will be clearly understood by those skilled in the art from the following description. Could be.

In order to solve the technical problem, a mobile terminal equipped with a 3D motion recognition function may include an output unit, a sensing unit, and a controller. The output unit outputs at least one of an image, a sound, and a vibration representing an on state of the 3D motion recognition function, and displays at least one touch area used to activate the 3D motion recognition function on a touch screen. can do.

The sensing unit may detect a first touch motion and a predetermined three-dimensional motion with respect to a specific portion of the mobile terminal. When the first touch motion is detected, the controller turns on the 3D motion recognition function and in response to the second touch motion and the predetermined 3D motion for the at least one area, the predetermined 3 A specific function corresponding to the dimensional operation can be performed.

According to an aspect of the present invention, there is provided a method of driving a mobile terminal equipped with a 3D motion recognition function, the method comprising: turning on the 3D motion recognition function in response to a first touch operation on a specific portion of the mobile terminal; Outputting at least one of an image, a sound, and a vibration representing an on state of the 3D motion recognition function; Displaying at least one touch area on a touch screen used to activate the 3D motion recognition function; And when a second touch operation and a predetermined three-dimensional motion with respect to the at least one touch area are detected, performing a specific function corresponding to the predetermined three-dimensional motion.

In the mobile terminal according to the present invention, a separate hardware configuration such as a hardware operation key for performing a 3D motion recognition function is not required.

In addition, a user of the mobile terminal according to the present invention can easily turn on / off the 3D motion recognition function with a touch of a specific part and easily turn on or off the 3D motion recognition function. You can check it.

In addition, the user of the mobile terminal according to the present invention can easily activate the 3D motion recognition function by using the operation key area displayed on the touch screen.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a flowchart illustrating a method of driving a mobile terminal according to an embodiment of the present invention.
3 is a diagram illustrating that a 3D motion recognition function of the mobile terminal is turned on in response to a double tapping operation on the rear surface of the mobile terminal.
4 illustrates an operation key area displayed on a blank area of a screen displayed on a touch screen.
5 illustrates an example of a 3D motion recognition function performed in a mobile terminal according to a comparative example of the present invention performing a 3D motion recognition function using a hardware operation key.
6 illustrates an example of a 3D motion recognition function performed in a mobile terminal according to an embodiment of the present invention.
7 illustrates another example of a 3D motion recognition function performed in a mobile terminal according to an embodiment of the present invention.
8 to 10 illustrate various examples of operation key regions displayed on a touch screen in a mobile terminal according to an embodiment of the present invention.
11 illustrates that an operation key is moved in a mobile terminal according to an embodiment of the present invention.
12 is a flowchart illustrating a method of driving a mobile terminal according to another embodiment of the present invention.
FIG. 13 is a diagram illustrating that a touch operation on an operation key region may have different strengths in a mobile terminal according to an exemplary embodiment of the present invention.
14 illustrates that a predetermined function is performed in response to a touch operation and a three-dimensional operation on the operation key area when the touch intensity with respect to the operation key area is within a predetermined range.
FIG. 15 is a diagram illustrating that a specific operation corresponding to the touch operation may be performed when the touch intensity of the operation key region is greater than or equal to a predetermined range.

The foregoing objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Like numbers refer to like elements throughout. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, and the like.

1 is a block diagram of a mobile terminal 100 according to an embodiment of the present invention. Referring to FIG. 1, the mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, The memory unit 160, the interface unit 170, the controller 180, and the power supply unit 190 may be included. The components shown in FIG. 1 are not essential, so the mobile terminal 100 may have more or fewer components.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems that provide broadcast signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory unit 160.

The mobile communication module 112 transmits and receives a radio signal to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and the wireless Internet module 113 can be embedded in the mobile terminal 100 or externally. Wireless Internet technologies include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and Long Term Evolution (LTE). Can be.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. The location information module 115 may obtain location information using a global navigation satellite system (GNSS). Here, the Global Positioning System (GNSS) is a term used to describe the radionavigation satellite systems in which certain types of radionavigation receivers orbiting the Earth are transmitting reference signals that can determine their position near the surface or ground surface . The Global Positioning System (GNSS) includes Global Positioning System (GPS) in the United States, Galileo in Europe, GLONASS (Global Orbiting Navigational Satelite System) in Russia, COMPASS in China and Japan QZSS (Quasi-Zenith Satellite System), which is operated by the Ministry of Land, Infrastructure and Transport.

As a representative example of the GNSS, the location information module 115 may be a Global Position System (GPS) module. The GPS module calculates information on a distance (distance) from three or more satellites to a point (object), information on a time when the distance information is measured, and then applies a trigonometric method to the calculated distance information, Dimensional position information according to latitude, longitude, and altitude with respect to a point (object) in the three-dimensional space. Furthermore, a method of calculating position and time information using three satellites and correcting the error of the calculated position and time information using another satellite is also used. The GPS module continuously calculates the current position in real time, and calculates velocity information using the current position.

Referring to FIG. 1, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory unit 160 or transmitted to the outside through the wireless communication unit 110. The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 140 moves such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, presence or absence of a user contact, a user's touch operation on a specific portion, orientation of the mobile terminal, acceleration / deceleration of the mobile terminal, and the like. By detecting the current state of the terminal 100 generates a sensing signal for controlling the operation of the mobile terminal 100. The sensing signal may be transmitted to the controller 180, and may be the basis on which the controller 180 performs a specific function.

The sensing unit 140 may include a touch sensor for detecting a touch of a user, a vibration sensor for detecting vibration generated based on the touch of the user, and a gyro for detecting rotation of the mobile terminal 100. Sensors, acceleration sensors, geomagnetic sensors, and the like. However, the scope of the present invention is not limited thereto.

For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, the sensor 190 may be responsible for sensing functions related to whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled to an external device. Meanwhile, the sensing unit 140 may include a proximity sensor.

The output unit 150 is used to generate an output related to sight, hearing, or tactile sense, and may include a display unit 151, an audio output unit 152, an alarm unit 153, and a haptic module 154. have.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, the mobile terminal displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays photographed and / or received images, a UI, and a GUI.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display).

Some of these displays can be configured to be transparent or light transmissive so that they can be seen from the outside. This may be referred to as a transparent display. A representative example of the transparent display is a transparent LCD. The rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see the object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

According to an implementation form of the mobile terminal 100, two or more display units 151 may exist. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another, or may be disposed integrally with one another, and may be disposed on different surfaces, respectively.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 may be configured in addition to an output device. Can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.

The proximity sensor may be disposed in an inner region of the mobile terminal covered by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using a mechanical contact by using an electromagnetic force or infrared rays. Proximity sensors have a longer life and higher utilization than touch sensors.

Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by a change in an electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory unit 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output unit 152 outputs a sound signal related to a function (for example, a call signal reception sound and a message reception sound) performed in the mobile terminal 100. The sound output unit 152 may include a receiver, a speaker, a buzzer, and the like. In addition, the sound output unit 152 may output sound through the earphone jack 116. The user can connect the earphone to the earphone jack 116 to hear the sound output.

The alarm unit 153 may output a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The video signal or the audio signal may also be output through the display unit 151 or the sound output unit 152.

The haptic module 154 generates various tactile effects that a user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

In addition to the vibration, the haptic module 154 may be used for the effects of stimulation by the arrangement of pins vertically moving with respect to the contact skin surface, the effect of the injection force of the air through the injection or inlet or the stimulation through the suction force, and the stimulation that rubs the skin surface. Various tactile effects may be generated, such as effects by stimulation through contact of electrodes, effects by stimulation using electrostatic force, and effects of reproducing a sense of warmth and heat using an endothermic or heat generating element.

The haptic module 154 may not only deliver the haptic effect through direct contact, but also implement the haptic effect through the muscle sense of the user's finger or arm. Two or more haptic modules 154 may be provided according to a configuration aspect of the mobile terminal 100.

The memory unit 160 may store a program for the operation of the controller 180 and may temporarily store input / output data (for example, a phone book, a message, a still image, a video, etc.). The memory unit 160 may store data regarding vibration and sound of various patterns output when a touch input on the touch screen is performed.

The memory unit 160 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) Magnetic Memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory unit 160 on the Internet.

The interface unit 170 serves as a path with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

Here, the identification module is a chip that stores various information (that is, user identification information) for authenticating the use authority of the mobile terminal 100, and includes a user identification module (UIM) and a subscriber identification module (Subscriber Identify Module). , SIM), Universal Subscriber Identity Module (USIM), and the like. The device equipped with the identification module may be manufactured in the form of a card. In this case, the interface unit 170 may include a card slot in which the identification module of the card type may be mounted. Then, the identification module may be connected to the mobile terminal 100 through the card slot.

The interface unit 170 may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various commands input from the cradle by a user. The signal may be a passage for transmitting to the mobile terminal. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. The controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing the functions. It may be implemented by the controller 180.

In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. Also, the software codes may be stored in the memory unit 160 and executed by the control unit 180. [

In the above, the general operation and function of the mobile terminal 100 according to the present invention have been described with reference to FIG. 1. Hereinafter, referring to FIGS. 2 to 15, the characteristics of the mobile terminal according to an embodiment of the present invention that utilizes the touch screen as a gesture key for preventing a malfunction when performing the 3D gesture recognition function will be described. see.

2 is a flowchart illustrating a method of driving a mobile terminal according to an embodiment of the present invention. A method of driving the mobile terminal will be described with reference to FIGS. 1 and 2.

First, the sensing unit 140 of the mobile terminal 100 detects a user's first touch operation with respect to a specific part of the mobile terminal 100 (S110). Then, the controller 180 of the mobile terminal 100 turns on the 3D gesture recognition function in response to the first touch operation (S120). If the user performs the first touch operation on the specific part once while the 3D motion recognition function is turned on, the controller 180 may turn off the 3D motion recognition function.

Here, the specific portion of the mobile terminal 100 may be the back of the mobile terminal 100, the first touch operation may be a double tapping operation on the back of the mobile terminal 100. have. Then, the user can easily turn on / off the 3D motion recognition function while holding the mobile terminal 100.

However, the scope of the present invention is not limited thereto. For example, the specific part of the mobile terminal 100 for turning on / off the 3D motion recognition function may be another part in which the sensing unit 140 may recognize the first touch motion of the user. The touch operation may also be a touch operation other than double tapping.

In the present specification, the on state of the 3D motion recognition function means a state in which the user can select whether to use the 3D motion recognition function in the mobile terminal 100. Therefore, the user can select whether to activate the 3D motion recognition function while the 3D motion recognition function is turned on.

When the 3D motion recognition function is turned on, the controller 180 displays an image indicating the on state of the 3D motion recognition function in the indicator area (S130). Here, the controller 180 may further generate a sound and / or vibration indicating an on state of the 3D motion recognition function.

3 is a diagram illustrating that the 3D motion recognition function of the mobile terminal 100 is turned on in response to a double tapping operation on the rear surface of the mobile terminal. Referring to FIG. 3, when the user double-taps the rear surface of the mobile terminal 100 (FIG. 3A), the controller 180 operates a 3D operation on an indicator area of the screen of the mobile terminal 100. It can be seen that an icon indicating the on state of the recognition function is displayed (FIG. 3B).

When an image indicating an on state of the 3D motion recognition function is displayed, the controller 180 outputs an operation key area including at least one touch area used to activate the 3D motion recognition function on the touch screen. 150 may be controlled (S140). The icon may be displayed in the indicator area until the 3D motion recognition function is turned off, or may be deleted after a predetermined time elapses.

4 illustrates an operation key area displayed on a blank area of a screen displayed on a touch screen. Referring to FIG. 4, the controller 180 may display an operation key area including two touch areas in a blank area of the screen. The operation key region may be displayed semi-transparently, the remaining portions except the edges may be displayed transparently, and the blank region itself may be the operation key region.

Here, the blank area of the screen means an area that does not contain information related to performing a specific function. For example, as illustrated in FIG. 4, an area in which a user does not perform a specific function even when a user touches on a web page screen, or an area in which no icon is displayed on the standby screen may be a blank area. However, the scope of the present invention is not limited thereto.

After the operation key area becomes a touch screen, a user performs a second touch operation (eg, a long-touch) on the operation key area to activate a three-dimensional motion recognition function. At the same time, when performing a specific three-dimensional operation, the sensing unit 140 detects this and transmits the detection result to the control unit 180 (S150).

Then, the controller 180 performs a predetermined specific function corresponding to the three-dimensional motion in response to the detected second touch motion and the three-dimensional motion (S160). Here, the three-dimensional operation may include an operation of tilting the mobile terminal 100 in a specific direction, an operation of rotating based on a specific axis, and an operation of shaking in the vertical or horizontal direction. However, the scope of the present invention is not limited thereto. In addition, a specific function corresponding to each of the 3D operations may be preset and stored in the memory unit 160.

For example, when the user tilts the mobile terminal 100 in a specific direction while the user long-touchs the operation key region when the web browsing application is executed, the controller 180 may display a web page displayed on the screen in the specific direction. You can scroll. In addition, in the mobile terminal 100 capable of displaying a plurality of switchable home screens, when the user shakes the mobile terminal 100 left / right in a state of long-touching the operation key area, the controller 180 The home screen displayed on the screen may be switched to the home screen before and after the current home screen.

5 illustrates an example of a 3D motion recognition function performed in a mobile terminal 200 according to a comparative example of the present invention performing a 3D motion recognition function using a hardware operation key. 6 illustrates an example of a 3D motion recognition function performed in the mobile terminal 100 according to an embodiment of the present invention.

Referring to FIG. 5, when a user presses a hardware operation key (FIG. 5A) and then tilts up the mobile terminal 200 upward, the controller of the mobile terminal 200 is tilted. It can be seen that scrolls down the web page currently displayed on the screen (Fig. 5 (b)). However, referring to FIG. 6, while the user presses the action key area displayed in the blank area of the web page displayed on the screen (FIG. 6A), the user may scroll down the web page displayed on the screen by performing a tilt up operation. It can be seen that (Fig. 6 (b)).

7 illustrates another example of a 3D motion recognition function performed in the mobile terminal 100 according to an embodiment of the present invention. In more detail, FIG. 7 illustrates varying a thumbnail selected based on a three-dimensional motion of a user in an image view application execution screen. Referring to FIG. 7, when a specific thumbnail is selected (FIG. 7A), when the user tilts down the mobile terminal 100, it can be seen that a thumbnail under the previously selected thumbnail is selected ( (B) of FIG. 7).

4, 6, and 7, it can be seen that an operation key region in the mobile terminal 100 according to an embodiment of the present invention may be displayed in a predetermined region of a blank region of the touch screen. However, in the mobile terminal 100 according to the embodiment of the present invention, the operation key area may be displayed on at least one predetermined specific area of the screen displayed on the touch screen. In this case, the specific area in which the operation key area is displayed on the screen displayed on the touch screen may vary depending on the type of menu or application being executed or the execution step of the menu or application being executed.

8 to 10 illustrate various examples of operation key regions displayed on a touch screen in a mobile terminal according to an embodiment of the present invention. First, referring to FIGS. 8 and 9, it can be seen that the controller 180 of the mobile terminal 100 displays an operation key area on a specific area of a specific home screen. In addition, referring to FIG. 10, the controller 180 may display an operation key area on a specific area of a setting menu execution screen. Although not shown in the drawing, the controller 180 may change the position of the operation key region according to an execution step of a menu or an application as described above.

The controller 180 may move the operation key region by moving a touch on the operation key region displayed on the screen of the touch screen (for example, by touching and dragging the operation key region).

11 illustrates that an operation key is moved in a mobile terminal according to an embodiment of the present invention. Referring to FIG. 11, it can be seen that the user can move the operation key region to a desired position by touching and moving the operation key region displayed on the specific region of the music playing application.

The controller 180 may use the operation key area displayed on the screen of the touch screen to perform a function other than the operation key of the 3D motion recognition function. For example, when the touch intensity of the second touch operation is within a predetermined range, the controller 180 activates the 3D gesture recognition function in response to the second touch operation, and the touch intensity of the second touch operation is determined by the control unit 180. If it is out of a predetermined range, a specific function corresponding to the second touch operation may be performed. Such features of the mobile terminal 100 according to an embodiment of the present invention will be described in detail with reference to FIGS. 12 to 15.

12 is a flowchart illustrating a method of driving a mobile terminal according to another embodiment of the present invention. Hereinafter, a method of driving the mobile terminal will be described with reference to FIGS. 1 and 12.

When the user performs the second touch operation on the operation key region, the sensing unit 140 detects the second touch operation on the operation key region and transmits the detection result to the controller 180 (S210). Then, the controller 180 calculates the strength of the second touch operation with respect to the operation key area (S220).

Then, the controller 180 determines whether the touch intensity of the second touch operation is lower than a predetermined threshold intensity (S230). If the touch intensity of the second touch operation is lower than the threshold intensity, the controller 180 activates a 3D gesture recognition function (S240), otherwise, the controller 180 is connected to the second touch operation. It performs a corresponding specific function (S250). That is, in the embodiment of FIG. 12, the predetermined range of the touch intensity at which the controller 180 activates the 3D gesture recognition function is a range in which the intensity of the second touch operation is lower than the threshold intensity.

FIG. 13 is a diagram illustrating that a touch operation on an operation key region may have different strengths in the mobile terminal 100 according to an exemplary embodiment of the present invention. In this case, the controller 180 of the mobile terminal 100 may determine the touch intensity of the second touch operation based on the touch area of the touch screen according to the second touch operation with respect to the operation key area.

Referring to FIG. 12, when the touch area of the touch screen according to the second touch operation is within a predetermined range, the controller 180 determines the intensity of the second touch operation as a first step, and determines the touch screen. If the touch area is out of the predetermined range, the intensity of the second touch operation may be determined as the second step.

In this case, if the intensity of the second touch operation is a first step, the controller 180 activates a 3D gesture recognition function in response to the second touch operation, and if the intensity of the second touch operation is a second step, A predetermined function corresponding to the second touch operation may be performed. Based on this, the example shown in FIG. 14 and FIG. 15 is demonstrated.

14 illustrates that a predetermined function is performed in response to a touch operation and a three-dimensional operation on the operation key area when the touch intensity with respect to the operation key area is within a predetermined range. That is, FIG. 14 illustrates an example in which a 3D gesture recognition function is activated in response to the touch gesture and then a function corresponding to the 3D gesture is performed when the touch intensity of the operation key region is the first step.

Referring to FIG. 14, when a user's touch operation on an operation key region is sensed to activate a 3D motion recognition function, and then the user performs a tilt operation that is a 3D motion on the mobile terminal 100 (FIG. 14). (A)), the control unit 180 can be seen that performs a function of scrolling through the album list which is a specific function corresponding to the tilt operation on the music playback application execution screen (Fig. 14 (b)).

FIG. 15 is a diagram illustrating that a specific operation corresponding to the touch operation may be performed when the touch intensity of the operation key region is greater than or equal to a predetermined range. That is, FIG. 15 illustrates an example in which a specific function corresponding to the touch operation is performed in response to the touch operation when the touch intensity of the operation key region is the second step. At this time, the 3D gesture recognition function is not activated based on the touch gesture.

Referring to FIG. 15, when a user's touch operation on an operation key area is detected, the controller 180 performs a function of selecting an album list, which is a specific function corresponding to the touch operation, on a music playing application execution screen. (FIG. 15A). At this time, it can be seen that the touch area in the operation key area in FIG. 15 is larger than the touch area in the operation key area in FIG. 14 (FIG. 15B).

As described above, each of the mobile terminal driving methods according to the present invention may be implemented in a program form that can be executed by various computer means and recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program recorded on the medium may be those specially designed and constructed for the present invention or may be those known to those skilled in the computer software.

Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of programs include high-level language code that can be executed by a computer using an interpreter or the like, as well as machine code as produced by a compiler. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

As described above, the present invention has been described by way of limited embodiments and drawings, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the claims below but also by the equivalents of the claims.

100: mobile terminal 110: wireless communication unit
120: A / V input unit 130: user input unit
140: sensing unit 150: output unit
151: display unit 152: sound output unit
160: memory unit 170: interface unit
180: control unit 190: power unit

Claims (16)

In a mobile terminal equipped with a three-dimensional motion recognition function,
An output unit for outputting at least one of an image, a sound, and a vibration indicating an on state of the 3D motion recognition function, and displaying at least one touch area used to activate the 3D motion recognition function on a touch screen ;
A sensing unit configured to sense a first touch motion and a predetermined three-dimensional motion with respect to a specific part of the mobile terminal; And
Turn on / off the 3D gesture recognition function in response to the first touch gesture, and the second touch gesture for the at least one touch area and the predetermined 3D gesture in response to the predetermined 3D gesture. A mobile terminal performing a specific function corresponding to the determined three-dimensional operation. The method of claim 1, wherein the first touch operation is performed.
And a double tapping operation on the rear surface of the mobile terminal. The method of claim 1, wherein the on / off state of the three-dimensional motion recognition function,
And a predetermined image is displayed on an indicator area of a screen displayed on the touch screen. The method of claim 1, wherein the at least one touch area is,
And at least one touch area displayed on a blank area of a screen displayed on the touch screen. The method of claim 1, wherein the at least one touch area is,
At least one touch area displayed on a predetermined specific area of the screen displayed on the touch screen,
The location of the specific area,
And a type of menu or application being executed and a step of executing the menu or application being executed. The method of claim 1, wherein the control unit,
And the at least one touch area is moved in response to a third touch operation on the at least one touch area. The method of claim 1, wherein the control unit,
If the touch intensity of the second touch operation is within a predetermined range, the 3D gesture recognition function is activated in response to the second touch operation, and if the touch intensity of the second touch operation is outside the predetermined range, A mobile terminal, characterized in that for performing a specific function corresponding to a touch operation. The method of claim 7, wherein the control unit,
And a touch intensity of the second touch operation based on the touch area of the touch screen according to the second touch operation. In the mobile terminal driving method using a three-dimensional motion recognition function,
Turning on the three-dimensional gesture recognition function in response to a first touch gesture with respect to a specific portion of the mobile terminal;
Outputting at least one of an image, a sound, and a vibration representing an on state of the 3D motion recognition function;
Displaying at least one touch area on a touch screen used to activate the 3D motion recognition function; And
And when a second touch operation and a predetermined three-dimensional motion with respect to the at least one touch area are detected, performing a specific function corresponding to the predetermined three-dimensional motion. The method of claim 9, wherein the first touch operation is performed.
And a double tapping operation on the rear surface of the mobile terminal. The method of claim 9, wherein the on state of the three-dimensional motion recognition function,
And displaying a predetermined image in an indicator area of a screen displayed on the touch screen. The method of claim 9, wherein the at least one touch area is,
And at least one touch area displayed on a blank area of a screen displayed on the touch screen. The method of claim 9, wherein the at least one touch area is,
At least one touch area displayed on a predetermined specific area of the screen displayed on the touch screen,
The location of the specific area,
A method of driving a mobile terminal, characterized in that it varies depending on the type of menu or application being executed and the step of executing the menu or application being executed. The method of claim 9, wherein the mobile terminal driving method comprises:
And moving the at least one touch area in response to a touch movement with respect to the at least one touch area. The method of claim 9, wherein the mobile terminal driving method comprises:
And performing a specific function corresponding to the second touch operation when the touch intensity of the second touch operation is out of a predetermined range. The method of claim 15, wherein the mobile terminal driving method comprises:
And determining the touch intensity of the second touch operation based on the touch area of the touch screen according to the second touch operation.

Images