KR102197912B1 - Method, apparatus and recovering medium for executing a funtion according to a gesture recognition - Google Patents

Abstract

A method of executing a function according to gesture recognition, the method comprising: analyzing a type of a gesture when a gesture is generated; And executing a function corresponding to the analyzed gesture type and displaying it on a screen, and the function corresponding to the gesture type includes at least one of a terminal information display control function and a function execution control function of the terminal. It is characterized by including a control function.

Description

Function execution method according to gesture recognition, device and recording medium {METHOD, APPARATUS AND RECOVERING MEDIUM FOR EXECUTING A FUNTION ACCORDING TO A GESTURE RECOGNITION}

The present invention relates to a method, an apparatus, and a recording medium for executing a function according to gesture recognition on a touch screen of a portable terminal device.

In addition to smartphones, mobile phones, and tablet PCs, portable terminals include wearable portable devices that can be attached to wrists, waists, and ankles, such as wrist-mounted portable devices (or watch-type touch devices). In addition, most of the portable terminals have a touch screen in recent years, so that various services and additional functions of the portable terminal can be operated by a touch input through a user's body and touchable input means.

The present invention is based on gesture recognition for executing a defined function of a specific touch gesture input on any screen when a specific touch gesture is input to a portable terminal such as a wearable portable device, a smart phone, a mobile phone, and a tablet PC. It is possible to provide a function execution method, device and recording medium.

In addition, the present invention minimizes the size of the mobile terminal by excluding the physical buttons of the mobile terminal and/or virtual buttons displayed on the touch screen as much as possible, and executes a function according to gesture recognition to enable efficient use of the screen at the same time. It is possible to provide a method, apparatus and recording medium.

According to an aspect of the present invention, there is provided a method of executing a function according to gesture recognition, the method comprising: analyzing a type of a gesture when a gesture is generated; And executing a function corresponding to the analyzed gesture type and displaying it on the screen,

The function corresponding to the type of gesture may include at least one of a terminal information display control function and a function execution control function of the terminal.

According to another aspect of the present invention, in an apparatus for executing a function according to gesture recognition, when a gesture is detected on a touch screen and the touch screen, the gesture type is analyzed, and a function corresponding to the analyzed gesture type is executed. And a control unit for displaying on the screen of the touch screen,

The function corresponding to the type of gesture is characterized in that it includes at least one of an information display control function of the device and a function execution control function of the device.

According to another aspect of the present invention, in a function execution recording medium according to gesture recognition, when a gesture is sensed by a touch screen and the touch screen, the type of the gesture is analyzed, and the terminal corresponding to the analyzed gesture type is A program for performing a function including at least one control function of an information display control function and a function execution control function of the terminal to be displayed on the screen of the touch screen is recorded.

As described above, when a specific touch gesture is input to a portable terminal such as a wearable portable device, a smart phone, a mobile phone, or a tablet PC by using the method, device and recording medium according to gesture recognition, any screen A defined function of the input specific touch gesture may be executed. Accordingly, the size of the portable terminal can be minimized by excluding the physical buttons of the portable terminal and/or virtual buttons displayed on the touch screen as much as possible, and the user can use the screen efficiently.

1 is a block diagram of a mobile terminal performing a function execution operation according to gesture recognition according to an embodiment of the present invention;
2 is a flowchart of a function execution operation according to gesture recognition according to an embodiment of the present invention
3 is a flowchart of a function execution operation according to a first gesture recognition according to an embodiment of the present invention
4 is an exemplary view of a function execution screen according to a first gesture recognition according to an embodiment of the present invention
5 is a flowchart of a function execution operation according to a second gesture recognition according to an embodiment of the present invention
6 is an exemplary diagram of a function execution screen according to a second gesture recognition according to an embodiment of the present invention
7 is a flowchart of a function execution operation according to a third gesture recognition according to an embodiment of the present invention
8 is an exemplary diagram of a function execution screen according to a third gesture recognition according to an embodiment of the present invention
9 is a flowchart of a function execution operation according to a fourth gesture recognition according to an embodiment of the present invention
10 is an exemplary view of a function execution screen according to a fourth gesture recognition according to an embodiment of the present invention
11 is a flowchart of a function execution operation according to a fifth gesture recognition according to an embodiment of the present invention
12 is an exemplary view of a function execution screen according to a fifth gesture recognition according to an embodiment of the present invention

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, specific items such as a top-bezel sweep-down gesture, a two-finger double-tap, and an index search screen are shown. This is provided to help a more general understanding of the present invention, and these specific items are provided within the scope of the present invention. It will be apparent to those of ordinary skill in the art that modifications or changes may be made.

1 is a block diagram of a mobile terminal performing a function execution operation according to gesture recognition according to an embodiment of the present invention. Referring to FIG. 1, the portable terminal 100 may include a touch screen 120, a touch screen controller 130, an input unit 140, an output unit 150, a storage unit 170, and a control unit 110. have. In addition, the mobile terminal 100 may include a mobile communication module 180 and a sub communication module 190.

The touch screen 120 receives a user's manipulation and may display an execution image of an application program, an operation state, and a menu state. That is, the touch screen 120 may provide a user interface corresponding to various services (eg, call, data transmission, broadcasting, and photography) to a user. The touch screen 120 may transmit an analog signal corresponding to at least one touch input to the user interface to the touch screen controller 130. The touch screen 120 may receive at least one touch input through a user's body (eg, a finger including a thumb) or a touchable input means such as an electronic pen (eg, a stylus pen). In addition, the touch screen 120 may receive a continuous motion of one touch among at least one touch. The touch screen 120 may transmit an analog signal corresponding to a continuous motion of an input touch to the touch screen controller 130.

Further, the touch is not limited to direct contact between the touch screen 120 and a user's body or a touchable input means, and may include non-contact.

The interval detectable on the touch screen 120 may be changed according to the performance or structure of the portable terminal 100. In addition, the touch screen 120 distinguishes between a touch event caused by contact with a user's body or a touchable input means and an input (eg, hovering) event in a non-contact state and detects the touch event and the hovering event. A value detected by an event (eg, a current value, etc.) may be configured to be output differently. In addition, when recognizing a hovering event, the touch screen 120 outputs different values (eg, current values) detected according to the distance between the space where the hovering event occurs and the touch screen 120.

The touch screen 120 may be implemented in, for example, a resistive method, a capacitive method, an infrared method, or an acoustic wave method.

Meanwhile, the touch screen controller 130 converts the analog signal received from the touch screen 120 into a digital signal (eg, X and Y coordinates) and transmits it to the controller 110. The controller 110 may control the touch screen 120 using a digital signal received from the touch screen controller 130. For example, the controller 110 may cause a shortcut icon (not shown) displayed on the touch screen 120 to be selected or execute a shortcut icon (not shown) in response to a touch event or a hovering event. In addition, the touch screen controller 130 may be included in the controller 110.

In addition, the touch screen controller 130 can check the distance between the space where the hovering event occurs and the touch screen 190 by detecting a value output through the touch screen 120 (eg, a current value, etc.). The resulting distance value may be converted into a digital signal (eg, Z coordinate) and provided to the controller 110.

In addition, the touch screen 120 includes at least two touch screen panels capable of sensing a touch or proximity of a user's body and a touchable input means, respectively, so that input by a user's body and a touchable input means can be simultaneously input. It may include. The at least two touch screen panels provide different output values to the touch screen controller 130, and the touch screen controller 130 recognizes values inputted from the at least two touch screen panels differently, It distinguishes whether the input is input by the user's body or by a touchable input means.

The input unit 140 receives a user's manipulation and may include at least one of a button (not shown), a keypad (not shown), and a microphone (not shown).

A button (not shown) may be formed on the front, side or rear of the housing of the mobile terminal 100, and may be at least one of a power/lock button, a menu button, and a home button.

The keypad (not shown) may receive a key input from a user to control the portable terminal 100. The keypad (not shown) may include a physical keypad formed on the mobile terminal 100 or a virtual keypad displayed on the touch screen 120. The physical keypad formed on the portable terminal 100 may be excluded according to the performance or structure of the portable terminal 100.

A microphone (not shown) receives a voice or sound under the control of the controller 110 and generates an electrical signal.

The output unit 150 may include at least one of a speaker (not shown) and a vibration motor (not shown).

A speaker (not shown) is applied to various signals (eg, wireless signals, broadcast signals, digital audio files, digital video files, etc.) of the mobile communication module 180 or the sub communication module 190 under the control of the controller 110. The corresponding sound can be output to the outside of the portable terminal 100. The speaker (not shown) may output a sound corresponding to a function performed by the portable terminal 100 (eg, a button operation sound corresponding to a phone call, or a call connection sound). One or more speakers (not shown) may be formed at appropriate positions or positions of the housing of the portable terminal 100.

The vibration motor (not shown) may convert an electrical signal into mechanical vibration under the control of the controller 110. For example, when the portable terminal 100 in the vibration mode receives a voice call from another device (not shown), a vibration motor (not shown) operates. One or more may be formed in the housing of the portable terminal 100. The vibration motor (not shown) may operate in response to a user's touch motion of touching the touch screen 120 and a continuous motion of the touch on the touch screen 120.

The mobile communication module 180 allows the mobile terminal 100 to be connected to an external device through mobile communication using at least one or a plurality of antennas (not shown) under the control of the controller 110. The mobile communication module 180 includes a mobile phone (not shown), a smart phone (not shown), a tablet PC, or other device (not shown) having a phone number input to the mobile terminal 100 for a voice call or a video call. , Transmitting/receiving wireless signals for text messages (SMS) or multimedia messages (MMS). In addition, the mobile communication module 180 is connected to a wireless Internet or the like at a place where a wireless access point (AP) is installed through a Wi-Fi or 3G/4G data network under the control of the controller 110. It transmits/receives wireless signals wirelessly with devices.

The sub communication module 190 may include at least one of a wireless LAN module (not shown) and a short-range communication module (not shown).

The wireless LAN module (not shown) may be connected to the Internet at a place where a wireless access point (AP) (not shown) is installed under the control of the controller 110. The wireless LAN module (not shown) supports the wireless LAN standard (IEEE802.11x) of the American Institute of Electrical and Electronic Engineers (IEEE). The short-range communication module (not shown) may wirelessly perform short-range communication between the portable terminals 100 under the control of the controller 110.

The portable terminal 100 may include at least one of a mobile communication module 180, a wireless LAN module (not shown), and a short-range communication module (not shown) according to performance. For example, the portable terminal 100 may include a combination of a mobile communication module 180, a wireless LAN module (not shown), and a short-range communication module (not shown) according to performance.

The storage unit 170 is input to correspond to the operation of the touch screen 120, the input unit 140, the output unit 150, the mobile communication module 180, and the sub communication module 190 under the control of the controller 110. / Can store the output signal or data. The storage unit 170 may store control programs and applications for controlling the mobile terminal 100 or the controller 110.

The term “storage unit” refers to the storage unit 170, a ROM (not shown) in the control unit 110, a RAM (not shown), or a memory card (not shown) mounted in the mobile terminal 100 (eg, SD card, memory stick). The storage unit may include a nonvolatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD).

The controller 110 stores a CPU (not shown), a ROM (ROM, not shown) in which a control program for controlling the portable terminal 100 is stored, and a signal or data input from the outside of the portable terminal 100 or , It may include a RAM (RAM, not shown) used as a storage area for a task performed in the portable terminal 100. The CPU (not shown) may include a single core, dual core, triple core, or quad core. The CPU (not shown), ROM (not shown), and RAM (not shown) may be interconnected through an internal bus.

The controller 110 may control the touch screen 120, the touch screen controller 130, the input unit 140, the output unit 150, and the storage unit 170.

In addition, the controller 110 analyzes the type of gesture when a gesture is sensed on the touch screen 120 according to a control characteristic of a function execution operation according to gesture recognition according to an embodiment of the present invention. A function corresponding to the analyzed gesture type may be executed and displayed on the screen of the touch screen 120.

2 is a flowchart of a function execution operation according to gesture recognition according to an embodiment of the present invention. Referring to FIG. 2, in step 210, it is determined whether a touch gesture is generated according to a user's touch input. If it is determined that the touch gesture has occurred in step 210, the process proceeds to step 230, and if it is determined that the touch gesture has not occurred in step 210, the operation of the present invention is terminated. In step 230 after step 210, the type of touch gesture is analyzed. In step 250 after step 230, a function corresponding to the analyzed touch gesture type is executed as will be described later in the following embodiments. The function at this time may include at least one of an information display control function of the portable terminal and a function execution control function of the portable terminal. The information display control function may include at least one of a control related to a screen change, a control related to an index search screen display, and a control related to an information screen display.

The function execution control of the portable terminal is a control that adjusts at least one of sound and screen brightness, a control that blocks a consonant sound, a control that cancels a transmission sound block, a control that mutes the sound of a portable terminal, and a mute of the portable terminal. It may include at least one of a control to perform, a control to stop playing a video or music, and a control to release a stop to play a video or music.

3 is a flowchart of a function execution operation according to a first gesture recognition according to an embodiment of the present invention, and FIG. 4 is an exemplary diagram of a function execution screen according to a first gesture recognition according to an embodiment of the present invention. The first gesture is a touched state from any one point in a preset area at the top of the screen of the touch screen 120 as shown in (a) of FIG. 4 and dragged to the inside of the screen; a user's finger or a touchable input It may be a top-bezel sweep down (referred to as a top-bezel sweep down; 10) by moving to another point while touching one point of the touch screen and removing the touch after stopping. At this time, the minimum length to be dragged into the inside of the screen while being touched with the preset area at the top of the screen may be set or/and changed during manufacture or by a user.

First, in step 310, it is determined whether or not a touch gesture has occurred. If it is determined that the touch gesture has occurred in step 310, the process proceeds to step 330, and if it is determined that the touch gesture has not occurred in step 310, the operation of the present invention is terminated. In operation 330 after operation 310, it is determined whether the touch gesture is the top bezel sweep-down gesture 10. If it is determined that the top bezel sweep-down gesture 10 is in step 330, the process proceeds to step 350, and if it is determined that the top bezel sweep-down gesture 10 is not in step 330, the process returns to step 310. In step 350 after step 330, the screen is switched to the execution screen displayed before the current screen. However, if it is determined in step 330 that it is not the top bezel sweep-down gesture, it is described that the process returns to step 310. However, if the recognized touch gesture is another predefined gesture, a function corresponding to the other gesture may be executed.

That is, according to the above operation, by inputting the top bezel sweep-down gesture 10 on the screen of the touch screen 120 of the mobile terminal as shown in (a) of FIG. 4, the current screen is displayed as shown in (b) of FIG. You can make it go back to the previous screen.

5 is a flowchart of a function execution operation according to a second gesture recognition according to an embodiment of the present invention, and FIG. 6 is an exemplary view of a function execution screen according to a second gesture recognition according to an embodiment of the present invention. The second gesture is dragged to the inside of the screen while being touched from any one point in a preset area at the bottom of the screen of the touch screen 120 as shown in FIG. 6A (bottom-bezel sweep up; It is called bezel sweep up; it can be 20). At this time, the minimum length to be dragged into the inside of the screen while being touched with the preset area at the bottom of the screen may be set or/and changed during manufacture or by a user.

First, in step 410, it is determined whether or not a touch gesture has occurred. If it is determined that the touch gesture has occurred in step 410, the process proceeds to step 420, and if it is determined that the touch gesture has not occurred in step 410, the operation of the present invention is terminated. In step 420 after step 410, it is determined whether the touch gesture is the bottom bezel sweep up 20 gesture. If it is determined in step 420 that the touch gesture is the bottom bezel sweep up 20 gesture, the process proceeds to step 430, and if it is determined that the touch gesture is not the bottom bezel sweep up 20 gesture in step 420, the process returns to step 410. In step 430 after step 420, an index search screen (also referred to as an index scroll screen; 1200) is displayed by overlapping with the current screen as shown in FIG. 6B. At this time, the index search screen 1200 has a function of displaying a screen having an index desired by the user. In addition, the index search screen 1200 may allow the current screen to be scrolled quickly and automatically to display a screen with a corresponding index. Referring to FIG. 6B, a preset index may be displayed on the index search screen 1200. Additionally, the index search screen 1200 may include index switch buttons 1203 and 1205 for switching indexes in a set order. In step 440 after step 430, the current screen is scrolled so that a screen corresponding to the index displayed on the index search screen 1200 is displayed. However, if the current screen is a screen corresponding to the corresponding index displayed on the index search screen 1200, step 440 may be omitted. In step 450 after step 440, it is determined whether a tap gesture 30 has occurred on the index switch button 1203 or 1205 of the index search screen 1200. If it is determined in step 450 that the tap gesture 30 has occurred on the index switch button 1203 or 1205 of the index search screen 1200, the process proceeds to step 460, and in step 450, the index switch button of the index search screen 1200 ( If it is determined that the tap gesture 30 has not occurred at 1203 or 1205, the process proceeds to step 480. After step 450 and step 460, the index displayed on the index search screen 1200 is converted to an index corresponding to the tap gesture 30. The index switch button 1203 or 1205 is for switching indexes in a preset order, and when a tap gesture is input to the index switch button 1203 or 1205, the index displayed on the index search screen 1200 is converted to the index search screen ( 1200), it switches to the next (or previous) index. In step 470 after step 460, the current screen is scrolled so that the screen corresponding to the converted index is displayed on the index search screen 1200. In step 480 after step 470, it is determined whether a preset time has elapsed. If it is determined that the preset time has elapsed in step 480, the process proceeds to step 490, and if it is determined that the preset time has not elapsed in step 480, the process returns to step 450. In step 490 after step 480, the index search screen 1200 disappears. That is, in step 490, the operation of displaying the index search screen 1200 is terminated. However, if it is determined in step 420 that the touch gesture is not the bottom-bezel sweep-up gesture 20, it is described as returning to step 410, but when the recognized touch gesture is another predefined gesture, a function corresponding to the other gesture You can also run

That is, according to the above operation, by inputting the bottom bezel sweep-up gesture 20 on the screen of the touch screen 120 of the mobile terminal as shown in (a) of FIG. 6, the current screen is displayed as shown in (b) of FIG. The index search screen 1200 may be overlapped and displayed. In this case, if the current screen does not correspond to the index displayed on the index search screen 1200, the current screen may be rapidly scrolled so that a screen corresponding to the index displayed on the index search screen 1200 is displayed. In addition, when the tap gesture 30 is input to the index conversion button 1205 of the index search screen 1200 as shown in FIG. 6B, the index of the index search screen 1200 is converted according to a preset order and simultaneously The current screen may be rapidly scrolled so that a screen corresponding to the index displayed on the index search screen 1200 is displayed. In FIG. 6, the index of the index search screen 1200 may display various indexes according to settings and conditions. In addition, the size and display position of the index search screen 1200 may vary.

7 is a flowchart of a function execution operation according to a third gesture recognition according to an embodiment of the present invention, and FIG. 8 is an exemplary view of a function execution screen according to a third gesture recognition according to an embodiment of the present invention. The third gesture may be that two points on the screen of the touch screen 120 are simultaneously touched twice within a preset time interval (referred to as two finger double tap; 40).

First, in step 510, it is determined whether or not a touch gesture has occurred. If it is determined that the touch gesture has occurred in step 510, the process proceeds to step 530, and if it is determined that the touch gesture has not occurred in step 510, the operation of the present invention is terminated. In step 530 after step 510, it is determined whether the touch gesture is a two-finger double tap gesture 40. If it is determined that the touch gesture is the two-finger double-tap gesture 40 in step 530, the process proceeds to step 550, and if it is determined that the touch gesture is not the two-finger double-tap gesture 40 in step 530, the process returns to step 510. In step 550 after step 530, an information screen 1300 is displayed as shown in (b) of FIG. 8. The information screen 1300 displays current time, date information, battery information, function execution information such as blue pitcher turn on information, and the like, and various information may be displayed according to settings. Additionally, when the two-finger double tap gesture 40 is input to the touch screen 120 while the information screen 1300 is displayed, the displayed information screen 1300 may disappear. In other words, when the two-finger double tap gesture 40 is input to the touch screen 120 while the information screen 1300 is displayed, the operation of displaying the information screen 1300 may be terminated. In addition, when a preset time elapses while the information screen 1300 is displayed, the displayed information screen 1300 may disappear, that is, an operation of displaying the information screen 1300 may be terminated. In addition, if it is determined in step 530 that the touch gesture is not the two-finger double tap gesture 40, it is described that the process returns to step 510, but when the recognized touch gesture is another predefined gesture, a function corresponding to the other gesture You can also run

That is, according to the above operation, when a two-finger double tap gesture 40 is input on the screen of the touch screen 120 of the mobile terminal as shown in (a) of FIG. 8, the information screen 1300 as shown in (b) of FIG. Can be displayed. Also, if the two-finger double tap gesture 40 is input while the information screen 1300 is displayed on the current screen, the information screen 1300 may disappear. In other words, if the two-finger double tap gesture 40 is input while the information screen 1300 is displayed on the current screen, the operation of displaying the information screen 1300 may be terminated. In addition, the information screen 1300 displayed according to the setting may disappear after a predetermined time elapses. The size and display position of the information screen 1300 may vary.

9 is a flowchart of a function execution operation according to a fourth gesture recognition according to an embodiment of the present invention, and FIG. 10 is an exemplary view of a function execution screen according to a fourth gesture recognition according to an embodiment of the present invention. The fourth gesture is dragged toward the bottom of the screen while two points on the screen of the touch screen 120 are touched (two finger sweep down), or the touch screen 120 Dragging toward the top of the screen while touching any two points on the screen of (two finger sweep up; referred to as two finger sweep up; 50), or touching any two points on the screen of the touch screen 120 Dragging in the right direction of the screen in the state of being (two finger sweep right), or dragging in the left direction of the screen while touching any two points of the screen of the touch screen 120 It can be one of (two finger sweep left; called a two finger sweep raft). In this case, the minimum length to be dragged in any direction of the screen while being touched may be set or/and changed by the user or during manufacture.

First, in step 610, it is determined whether or not a touch gesture has occurred. If it is determined that the touch gesture has occurred in step 610, the process proceeds to step 630, and if it is determined that the touch gesture has not occurred in step 610, the operation of the present invention is terminated. In step 630 after step 610, it is determined whether the touch gesture is a two-finger sweep-up gesture or a two-finger sweep-down gesture 50. If it is determined in step 630 that the touch gesture is a two-finger sweep-up gesture or a two-finger sweep-down gesture 50, the process proceeds to step 650, and in step 630, the touch gesture is a two-finger sweep-up gesture or a two-finger sweep-down gesture 50. If it is determined that it is not, it returns to step 610. In step 650 after step 630, a screen 1400 for adjusting the sound 1401 and screen brightness 1403 is displayed as shown in FIG. 10. In addition, when a preset time elapses, the screen 1400 for adjusting the displayed sound 1401 and the screen brightness 1403 may disappear, that is, the operation of displaying the screen 1400 for adjusting may be terminated. . In addition, if it is determined in step 630 that the touch gesture is not the two-finger sweep-up gesture or the two-finger sweep-down gesture 50, it is described that the process returns to step 610. However, if the recognized touch gesture is another predefined gesture, another You can also execute a function corresponding to a gesture. In addition, even when the touch gesture is a two-finger sweep light or two-finger sweep raft gesture, a screen for adjusting sound and screen brightness may be displayed.

That is, according to the above operation, when a two-finger sweep-up gesture or a two-finger sweep-down gesture 50 is input on the screen of the touch screen 120 of the mobile terminal as shown in FIG. 10(a), as shown in FIG. 10(b) Similarly, a screen 1400 for adjusting the sound 1401 and the screen brightness 1403 may be displayed. In addition, the displayed sound 1401 and the screen 1400 for adjusting the screen brightness 1403 may disappear after a predetermined time elapses. The size and display position of the screen 1400 for controlling the sound 1401 and the screen brightness 1403 may vary. In addition, even when a two-finger sweep light or two-finger sweep raft is input, the screen 1400 for adjusting the sound 1401 and the screen brightness 1403 may be displayed.

11 is a flowchart of a function execution operation according to a fifth gesture recognition according to an embodiment of the present invention, and FIG. 12 is an exemplary view of a function execution screen according to a fifth gesture recognition according to an embodiment of the present invention. The fifth gesture means, for example, when a person touches the screen of the touch screen 120 of the mobile terminal with a palm to cover it, and the fifth gesture is a touch point when the screen of the touch screen 120 is touched. It may be recognized as being equal to or greater than the preset area threshold (palm touch; referred to as palm touch; 60).

First, in step 710, it is determined whether a touch gesture has occurred during a phone call. If it is determined in step 710 that a touch gesture has occurred during a phone call, the process proceeds to step 730, and if it is determined in step 710 that a touch gesture has not occurred during a phone call, the operation of the present invention is terminated. In step 730 after step 710, it is determined whether the touch gesture is the palm touch gesture 60. If it is determined in step 730 that the touch gesture is the palm touch gesture 60, the process proceeds to step 750, and if it is determined that the touch gesture is not the palm touch gesture 60 in step 730, the process returns to step 710. In step 750 after step 730, the song sound is cut off. After step 750, in step 770, the current screen indicating that the call is in progress as shown in (a) of FIG. 12 is switched to a screen indicating that the cutoff function has been executed, as shown in (b) of FIG. 12. Referring to (b) of FIG. 12, the screen indicating that the transmission sound blocking function has been executed includes a speaker on button 1501 for canceling the transmission sound blocking, and a tap gesture ( When 30) is input, the cutoff function is released. In addition, when the palm touch gesture 60 is input while the screen is switched to a screen indicating that the transmission sound blocking function has been executed, the transmission sound blocking function may be canceled. In addition, if it is determined in step 730 that the touch gesture is not the palm touch gesture 60, it is described that the process returns to step 710. However, if the recognized touch gesture is another predefined gesture, a function corresponding to the other gesture may be executed. have.

That is, according to the above operation, if the palm touch gesture 60 is input on the touch screen 120 screen of the mobile terminal during a phone call as shown in (a) of FIG. 12, the transmission sound may be blocked, and the ( As shown in b), the screen during a call may be switched to a screen indicating that the transmission tone blocking function has been executed. In addition, if the palm touch gesture 60 is input on the screen of the touch screen 120 of the portable terminal while the transmission sound is blocked, the transmission sound blocking may be canceled.

As described above, the configuration and operation of the method and apparatus for executing a function according to the gesture recognition of the present invention according to an embodiment can be made. Meanwhile, in the above description of the present invention, specific embodiments have been described, but in addition to various implementations of the present invention. Examples, but there may be various modifications and variations. Each of the operations described in the present specification may be all or part of them simultaneously performed in parallel, some of them may be omitted, or may include other additional operations.

For example, in the index search screen 1200 of FIGS. 5 and 6, the position of the corresponding index is automatically searched so that the current screen is switched to the screen with the corresponding index. Accordingly, step 440 This may be an operation of converting a screen to a screen corresponding to a corresponding index displayed on the index search screen. In addition, step 470 may be an operation of converting the current screen to a screen corresponding to the index converted to the index search screen.

In addition, although the description related to FIGS. 9 and 10 described that a screen for adjusting sound and screen brightness is displayed according to a generated gesture, a screen for adjusting only sound can be displayed by the generated gesture. A screen in which only screen brightness is adjusted may be displayed by the generated gesture.

In addition, when the palm touch gesture 60 is input, other functions may be executed in addition to the above-described cutoff and release of cutoff.

In another embodiment related to the palm touch gesture 60, when the palm touch gesture 60 is input to the portable terminal 100, the sound of the portable terminal 100 is muted, and a screen indicating that the mute function has been executed is displayed. Can be displayed. In addition, when the palm touch gesture 60 is again input to the screen indicating that the mute function has been executed, the mute of the portable terminal 100 may be released.

In another embodiment related to the palm touch gesture 60, when a video or music is being played, when the palm touch gesture 60 is input, the video or music is paused, and the video or music is paused. You can switch the screen to a screen that notifies you that this has been executed. In addition, when the palm touch gesture 60 is again input to the screen indicating that the pause function of the video or music playback has been executed, the video or music in which playback is paused may be played from the point when the playback is paused.

In addition, indices may be arranged and displayed in a preset order in a certain area at the bottom of the current screen where a bezel sweep-up gesture is input to execute the index search screen 1200. Among the areas in which indexes in a preset order are located When a bezel sweep-up gesture is input by touching any one area, the index displayed on the index search screen 1200 may be a preset index for the touched area.

In addition, it will be appreciated that the embodiments of the present invention can be realized in the form of hardware, software, or a combination of hardware and software. Any such software may be, for example, a nonvolatile storage device such as a storage device such as a ROM, or a memory such as a RAM, a memory chip, a device or an integrated circuit, or For example, it may be optically or magnetically recordable, such as a CD, DVD, magnetic disk or magnetic tape, and stored in a machine (eg, computer) readable storage medium. It will be appreciated that the memory that may be included in the portable terminal is an example of a program including instructions for implementing the embodiments of the present invention or a machine-readable storage medium suitable for storing programs. Accordingly, the present invention includes a program including code for implementing the apparatus or method described in any claim of the present specification, and a machine-readable storage medium storing such a program. Further, such a program may be transferred electronically through any medium, such as a communication signal transmitted through a wired or wireless connection, and the present invention suitably includes equivalents thereto.

Claims (23)

In a method of executing a function according to gesture recognition performed in a mobile terminal,
In response to confirmation of occurrence of the first gesture, checking whether an area on the touch screen of the portable terminal touched by the first gesture is equal to or greater than a preset area threshold;
In response to determining that the area on the touch screen touched by the first gesture is greater than or equal to the area threshold, a voice blocking function is executed, and a first screen notifying that the voice blocking function is executed is displayed on the touch screen Action,
While displaying the first screen, confirming that the second gesture having an area on the touch screen of the portable terminal touched by a second gesture is equal to or greater than the area threshold value, and
And releasing the voice blocking function in response to confirmation of the occurrence of the second gesture. The method of claim 1,
Confirming the occurrence of the third gesture,
Checking whether the third gesture is a gesture that is dragged to the inside of the screen while being touched from a point in a preset area at the top of the screen displayed on the touch screen, and
In response to confirming that the third gesture is a gesture dragged into the inside of the screen while being touched from the one point in the preset area at the top of the screen,
A method of executing a function according to gesture recognition, further comprising: switching a screen to an execution screen previously displayed on the screen. The method of claim 1,
Confirming the occurrence of the third gesture,
Checking whether the third gesture is a gesture that is dragged into the screen while being touched from a point in a preset area below the screen displayed on the touch screen, and
In response to confirming that the third gesture is a gesture that is dragged into the screen while being touched from the one point in the preset area at the bottom of the screen, the index overlaps the screen to display a preset index A method of executing a function according to gesture recognition, further comprising an operation of displaying a search screen. The method of claim 3, wherein the index search screen,
And an index switching button for switching the indexes in a preset order. The method of claim 3,
The method of executing a function according to gesture recognition, further comprising: switching the screen to a screen corresponding to the index or scrolling to display a screen corresponding to the index. The method of claim 1,
Confirming the occurrence of the third gesture,
Checking whether the third gesture is a gesture in which two points on the touch screen are simultaneously touched twice within a preset time interval, and
In response to confirming that the third gesture is a gesture in which two points on the touch screen are simultaneously touched twice within the preset time interval, at least one of time, date, battery information, and at least one function execution information of the portable terminal A method of executing a function according to gesture recognition, further comprising an operation of displaying an information screen including one. The method of claim 6,
In response to recognizing a fourth gesture in which two points on the touch screen are simultaneously touched twice within the preset time interval when the information screen is displayed, terminating the operation of displaying the information screen , How to execute a function according to gesture recognition. The method of claim 1,
Confirming the occurrence of the third gesture,
The third gesture is a gesture of dragging toward the bottom of the screen while two points of the screen on the touch screen are touched, or a gesture of dragging toward the top of the screen while two points of the screen are touched, or Checking whether a gesture dragged to the right side of the screen while two points of the screen are touched or a gesture dragged to the left side of the screen while two points of the screen are touched, and
The method of executing a function according to gesture recognition, further comprising displaying a screen for adjusting at least one of a volume and a screen brightness. The operation of displaying a screen according to any one of claims 3, 6, or 8, according to execution of a function corresponding to the analyzed type of the third gesture, is terminated when a preset time elapses. A method of executing a function according to gesture recognition, characterized in that. The method of claim 1,
The method for executing a function according to gesture recognition, wherein the voice blocking function includes a mute function. The method of claim 1,
The voice blocking function is a transmission sound blocking function, and a graphic object is included in the first screen,
The method further comprises an operation of releasing the voice blocking function in response to confirming a touch input to the graphic object. The method of claim 1,
The voice blocking function includes a function of pausing playback of a video or music. In the function execution device according to gesture recognition,
Including a touch screen and a control unit,
The control unit:
In response to confirming the occurrence of the first gesture on the touch screen, it is checked whether the area on the touch screen touched by the first gesture is greater than or equal to a preset area threshold,
In response to determining that the area on the touch screen touched by the first gesture is greater than or equal to the area threshold, a voice blocking function is executed, and a first screen notifying that the voice blocking function is executed is displayed on the touch screen and,
While displaying the first screen, confirming that the second gesture having an area on the touch screen touched by a second gesture being equal to or greater than the area threshold is generated,
The apparatus for executing a function according to gesture recognition, characterized in that the second gesture is set to cancel the voice blocking function in response to the confirmation of the occurrence of the second gesture. The method of claim 13, wherein the control unit,
Confirming the occurrence of the third gesture,
Check whether the third gesture is a gesture that is dragged to the inside of the screen while being touched from a point in a preset area at the top of the screen displayed on the touch screen, and the third gesture is Gesture, characterized in that in response to being identified as a gesture dragged into the screen while being touched from the one point in the preset area at the top, the gesture is set to switch the screen to the execution screen previously displayed on the screen Device for executing functions according to recognition. The method of claim 13, wherein the control unit,
Confirming the occurrence of the third gesture,
Check whether the third gesture is a gesture that is dragged into the inside of the screen while being touched from a point in a preset area at the bottom of the screen displayed on the touch screen,
In response to confirming that the third gesture is a gesture that is dragged to the inside of the screen while being touched from the one point in the preset area at the bottom of the screen on the touch screen, a preset index overlaps the screen A function execution device according to gesture recognition, wherein the index search screen is displayed, and the screen is set to switch to a screen corresponding to the index or to scroll the screen to display a screen corresponding to the index. The method of claim 15, wherein the index search screen,
And a function execution device according to gesture recognition, comprising: an index change button for switching the indexes in a preset order. The method of claim 13, wherein the control unit,
Confirming the occurrence of the third gesture,
Check whether the third gesture is a gesture in which two points of the screen on the touch screen are simultaneously touched twice within a preset time interval,
In response to confirming that the third gesture is a gesture in which two points of the screen are simultaneously touched twice within a preset time interval, at least one of time, date, battery information, and at least one function execution information of the device is included. A device for executing a function according to gesture recognition, characterized in that it is set to display an information screen to be displayed. The method of claim 17, wherein the control unit,
Gesture, characterized in that, when the information screen is displayed, in response to recognizing a fourth gesture in which two points of the screen are simultaneously touched twice within a preset time interval, the operation of displaying the information screen is set to end Device for executing functions according to recognition. The method of claim 13, wherein the control unit,
Confirming the occurrence of the third gesture,
The third gesture is dragged toward the bottom of the screen while two points of the screen on the touch screen are touched, or dragged toward the top of the screen while two points of the screen are touched, or Check whether it includes either dragging in the right direction of the screen while two points of the screen are touched, or dragging in the left direction of the screen while two points of the screen are touched,
A device for executing a function according to gesture recognition, characterized in that set to display a screen for adjusting at least one of a volume and a screen brightness. The apparatus of claim 13, wherein the voice blocking function includes a muting function. The method of claim 13, wherein the voice blocking function is a transmission sound blocking function, and a graphic object is included in the first screen,
The control unit is configured to cancel the voice blocking function in response to a confirmation of a touch input to the graphic object. 14. The apparatus of claim 13, wherein the voice blocking function includes a function of pausing playback of video or music. In a recording medium in which instructions are stored, when the instructions are executed by a control unit of a portable terminal, the control unit causes:
In response to the occurrence of the first gesture on the touch screen of the portable terminal, it is checked whether the area on the touch screen touched by the first gesture is greater than or equal to a preset area threshold,
In response to determining that the area on the touch screen touched by the first gesture is greater than or equal to the area threshold, a voice blocking function is executed, and a first screen notifying that the voice blocking function is executed is displayed on the touch screen and,
While displaying the first screen, confirming that the second gesture having an area on the touch screen of the portable terminal touched by a second gesture is equal to or greater than the area threshold value, and
And in response to confirming the occurrence of the second gesture, causing the voice blocking function to be released.

Images