KR20100045434A - A method for inputting orders using gestures - Google Patents

Abstract

PURPOSE: An inputting method using a gesture is provided to practice a various command every various action mode of a mobile terminal by using gesturing. CONSTITUTION: If a gesturing mode is activated, a user inclines a mobile terminal to a clockwise direction at a predetermined angle. A display screen of the mobile terminal is scrolled to the right side of a web page. If the user inclines the mobile terminal to the clockwise direction at the predetermined angle, a motion sensor of the mobile terminal detects an inclination.

Description

A method for inputting orders using gestures}

The present invention relates to a mobile terminal equipped with a motion sensor and a control method thereof.

More specifically, the present invention provides a variety of methods for detecting a user's gesture to control various operations for each operation mode of the mobile terminal.

There are various portable mobile terminals such as mobile phones, MP3 players, PMPs, notebooks, PDAs, and microcomputers. Because of their portability, they place many restrictions on the user interface for input and output. It is not used at any one place, but it is often used while the user is moving and the volume of the device is very small due to the nature of the portable device, so the input / output of QWERTY keyboard, remote controller, etc. The device is often inadequate.

Therefore, a user interface suitable for a portable device is used, and a touch pad, a touch screen, a navigation pad, and the like are used.

Despite these various user interfaces, input and output of mobile terminals are subject to a lot of limitations, and the user also feels uncomfortable.

For example, in the case of a mobile phone, various additional functions are added in addition to a call function. For example, an MP3 player, a camera function, and an internet connection function are added.

Naturally, many of these functions are configured to be controlled by the user, but it is inconvenient for the user to control the functions properly according to the use state of the mobile terminal.

Recently, as a number of additional functions have been added to a mobile phone, efforts are being made to improve a user interface provided to a user to operate the mobile phone.

Due to the portability of the mobile phone, there are many restrictions on the user interface for input and output. It is not used at any one place, but it is often used while the user is moving and the volume of the device is very small due to the nature of the portable device, so the input / output of QWERTY keyboard, remote controller, etc. The device is often inadequate.

Therefore, a user interface suitable for a portable device is used, and a touch pad, a touch screen, a navigation pad, etc. may be used.

Despite these various user interfaces, input and output of mobile terminals are subject to a lot of limitations, and the user also feels uncomfortable.

An object of the present invention is to provide a convenient user interface to a user of a mobile terminal equipped with various functions.

An object of the present invention is to provide an improved user interface to a mobile terminal having a restricted input device by sensing a user's gesture.

A user interface control method according to an embodiment of the present invention is a method of controlling a user interface of a mobile terminal having a plurality of different operation modes and at least one function specified for each operation mode, by a gesture of a user. Detecting movement of the mobile terminal applied to the mobile terminal; Determining a current operation mode of the mobile terminal among the plurality of operation modes; And performing at least one function specified for the determined current operation mode according to the detected movement of the mobile terminal.

A method of controlling a user interface according to an embodiment of the present invention includes a method of controlling a user interface of a mobile terminal configured to support multimedia operations, the method including: detecting a movement of the mobile terminal applied by a gesture of a user; If the mobile terminal has a plurality of activated work windows, moving from the work window displayed on the mobile terminal to another work window according to the movement of the detected mobile terminal; And displaying a part or all of one or more work windows activated according to the moving step on a display on the mobile terminal.

According to an aspect of the present invention, there is provided a method of controlling a user interface of a mobile terminal, the method including: detecting one of a gesture of tilting the mobile terminal to the left or the right, a yawing gesture, or a transition gesture; And performing an operation corresponding to the left click or the right click of the computer mouse according to the detected gesture.

A user interface control method according to an embodiment of the present invention is a method of controlling a user interface of a mobile terminal configured to support a plurality of tasks, when the mobile terminal has a plurality of active task windows, by a gesture of a user. Determining whether a predetermined movement of the authorized mobile terminal is detected; And closing all activated work windows of the mobile terminal when the movement of the predetermined mobile terminal is detected.

A mobile terminal according to an embodiment of the present invention is a mobile terminal having a plurality of different operation modes and having at least one predetermined function for each operation mode, the mobile terminal of which is applied by a gesture of a user. A detector configured to detect movement; And a controller configured to determine a current operation mode of the mobile terminal among the plurality of operation modes, and to perform at least one function predetermined for the current operation mode according to the detected movement of the mobile terminal.

According to an aspect of the present invention, there is provided a mobile terminal, comprising: a detector configured to detect a movement of the mobile terminal applied by a user; display; And a control unit configured to move from the work window displayed on the display to another work window by controlling the display according to the movement of the detected mobile terminal when a plurality of work windows are activated.

According to an embodiment of the present invention, a mobile terminal capable of controlling a user interface includes a detector configured to detect one of a gesture of tilting the mobile terminal to the left or the right, a gesture of yawing or a gesture of transitioning; And a controller configured to perform an operation corresponding to a left click or a right click of a computer mouse according to the detected gesture.

According to an embodiment of the present invention, a mobile terminal configured to support a plurality of tasks includes: a detector configured to detect a predetermined movement of the mobile terminal applied by a gesture of a user; And determining whether there is a predetermined movement of the detected mobile terminal when there are a plurality of activated task windows in the mobile terminal, determining a predetermined movement of the mobile terminal and closing all active task windows of the mobile terminal. It includes a control unit configured to.

According to the present invention, a user may execute various commands for various operation modes of a mobile terminal using his gesture.

1A and 1B illustrate a control method of a mobile terminal using gesture according to the present invention.
2A to 2E illustrate embodiments of a user interface control method according to an operation mode of a mobile terminal according to one embodiment of the present invention.
3 illustrates a method for controlling a mobile terminal by gestures according to another embodiment of the present invention.
4 illustrates a method for controlling a mobile terminal by gesture according to another embodiment of the present invention.
5A and 5B illustrate a method of controlling a user interface of a mobile terminal according to an embodiment of the present invention.
6 to 9 illustrate a control method of a mobile terminal using gesture according to an embodiment of the present invention.
10 illustrates a method of terminating running tasks of a mobile terminal according to an embodiment of the present invention.
11 is a block diagram of a mobile terminal according to an embodiment of the present invention.
12 is a block diagram of a CDMA wireless communication system that can be driven by the mobile terminal of FIG.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1A and 1B illustrate a method of controlling a mobile terminal using a gesture of a user applied to the mobile terminal according to the present invention.

The mobile terminal according to the present invention includes all kinds of portable devices such as a mobile phone, an MP3 player, a PMP, a notebook, a PDA, a smart phone, and the like.

The mobile terminal according to the present invention is equipped with a motion sensor (not shown) capable of detecting a user's gesture applied to the mobile terminal. The user's gesture may be rolling, pitching, yawing, and transition and any combination thereof. These gestures are described in detail below. As the motion sensor, a gyro sensor, an inclination sensor, an acceleration sensor, or known sensors may be used. The mobile terminal may also include a proximity sensor or a distance sensor for detecting the position of the mobile terminal with respect to the user.

Embodiments of the present invention are described below assuming that the mobile terminal is a mobile phone. However, the present invention can be equally applied to any type of mobile terminal or electronic device.

The mobile phone shown in the accompanying drawings is a so-called "full touch screen phone", a touch screen occupies most of the front surface and is a mobile phone without a physical number button.

As shown in FIG. 1A, when a user tilts a mobile terminal such as a mobile phone to the right in a state where the user lifts his or her hand, the motion sensor detects the movement.

If the detected movement is tilted to the right (or other direction), the controller (not shown) of the mobile terminal may perform a corresponding operation, for example, moving the screen, up / down of the volume, zooming in / out of the screen, and the like. This will be described in detail later.

According to an embodiment, as shown in FIG. 1B, the activation key 11 is mounted on one side of the mobile terminal, and the operation is performed in response to the movement applied by the user detected only while the user presses the activation key 11. It can also be configured to. That is, it may not always respond to the user's gesture, but may perform an operation in response to the user's gesture only in a specific mode (hereinafter, referred to as a "gesture mode").

Alternatively, the gesture mode may be activated only when the preset area of the touch screen mounted on the mobile terminal is touched.

The method of activating the gesture mode may be variously changed. For example, according to the embodiment, without placing the physical activation key 11 outside of the mobile terminal, it is configured to enter a mode for detecting the gesture by operating the software installed in the mobile terminal through the user's menu operation. You may.

In addition, the user may set a specific gesture as a gesture for entering a gesture, and enter or exit a gesture mode when the specific gesture is applied. For example, when the user shakes the mobile terminal once, the user enters the gesture mode, and the controller of the mobile terminal can execute an operation according to the gesture measured by the motion sensor, and when the user shakes the mobile terminal again in the gesture mode, the gesture mode You can also configure it to exit from. The same operation can be configured to perform even when shaking several times.

The gesture for activating the gesture mode and the gesture for deactivating may be different or the same, and in the same case, the gesture mode and the non-gesture mode are toggled each time the gesture is performed. In one embodiment, the user may set a gesture desired by the user as a gesture for entering the gesture mode and / or a gesture for exiting the gesture mode.

In addition, the user may specify an angle at which the user views the mobile terminal, and the gesture mode may be activated when the user stops for a predetermined time. In other words, if the user stops for 3 seconds or more while holding the mobile terminal, the motion sensor in the mobile terminal may detect that there is no movement and enter the gesturing mode. When the user does not use the mobile terminal, the display may be configured to be turned off, and when the display is turned off, the gesture mode may not be activated.

2A to 2E illustrate a method of controlling a user interface by gestures according to which operation mode a mobile terminal having various operation modes is in accordance with an embodiment of the present invention.

In recent years, mobile terminals such as mobile phones, PMPs, and MP3s have functions according to their original uses, that is, a call function, music playback, a video playback, a TV tuner, or a TV using a decoder such as DVB-H or DMB. It offers numerous features such as watching, electronic dictionaries, games, voice recording, electronic organizers, and more. In the case of PDAs and laptops, depending on the software originally installed, they can provide various functions.

According to an embodiment of the present invention, one gesture may control the user interface in different forms according to various operation modes.

2A illustrates an example in which a user browses the Internet by wire or wirelessly using a mobile terminal.

In this example, the left screen of FIG. 2A represents a portion of the Internet web page being browsed. When the gesturing mode is activated, as shown in FIG. 1A or 1B, when the user tilts the mobile terminal to the right by a predetermined angle, the displayed screen of the mobile terminal scrolls to the right side of the web page.

That is, when the user tilts the mobile terminal to the right by a predetermined angle, the motion sensor mounted in the mobile terminal detects the tilt and scrolls the displayed page or image to the right according to the detection. Similarly, tilting left may scroll left. In addition, when the display of the mobile terminal is tilted downward (ie, the upper portion of the mobile terminal is closer to the user) and tilted downward and upward (that is, the lower portion of the mobile terminal is closer to the user) of the webpage You can scroll up. The present invention allows the page or image displayed on the display to be scrolled according to the direction of tilting the mobile terminal. At this time, the direction of tilting the mobile terminal includes not only up, down, left, and right, but also arbitrary directions such as a diagonal line.

According to an exemplary embodiment, whenever the mobile terminal is tilted more than a predetermined angle, the mobile terminal may be scrolled by a predetermined distance. That is, when the mobile terminal is tilted more than a preset threshold angle, it may scroll by a predetermined distance. Alternatively, scrolling may be started when the mobile terminal is tilted more than the original position, and the screen may be scrolled by a length of the web page by a length proportional to the angle of tilting the mobile terminal.

In addition, the scroll speed may be configured to be proportional to the inclination angle.

The scrolling direction may also be variously modified according to the gesture of the user. For example, contrary to the above description, it is possible to scroll to the left when tilted to the right, to the right when tilted to the left, to scroll down when the screen is tilted downward, and to tilt upward when tilted upward. Also, as the mobile terminal is tilted, an image or page displayed on the display may be zoomed in or zoomed out. For example, in web browsing mode, when a mobile terminal is moved forward (ie toward the user) or backward (ie away from the user), the image or page of the display may be zoomed in or zoomed out.

According to an embodiment of the present invention, the mobile terminal may be configured to allow a user to set a scrolling direction for each tilting direction. For example, the user may set the displayed page or image to scroll downward or in a specific direction when the mobile terminal is tilted to the right. The user may match any user gesture described herein to any method of user interface control described herein. As a result, according to the present invention, a page scrolling method desired by a user can be provided.

A gesture applied when playing a multimedia file such as an audio file, a video file, a photo file, or the like may be detected and a specific operation may be performed according to the gesture.

2B illustrates a case where a mobile terminal plays an audio file according to an embodiment of the present invention.

2B shows a display screen of the mobile terminal when the first audio file MUSIC1 is being reproduced among the 30 audio lists. When the user tilts the mobile terminal to the right by a predetermined angle as shown in FIG. 1A or 1B, the motion sensor of the mobile terminal may detect the same and play the next audio file MUSIC2 as shown in the left figure of FIG. 2B.

That is, in the present invention, when a specific gesture is detected in the mobile terminal, for example, a gesture of tilting the mobile terminal to the right, a function to be executed may vary according to an operation mode currently performed by the mobile terminal. In the example of FIG. 2A, since the current mode of operation of the mobile terminal is web browsing, the user's gesture applied to the mobile terminal will scroll the page. In the example of FIG. 2B, since the current operation mode of the mobile terminal is the MP3 playback mode, the user's gesture applied to the mobile terminal plays audio data. 2C to 2F described below provide examples in which different functions are performed based on a gesture of a user according to a current operation mode of a mobile terminal.

In FIG. 2B, when the user tilts the mobile terminal to the left while playing the audio file, the previous audio file may be played. The user may cause the mobile terminal to flick left / right or up / down to allow scrolling between files (or songs). Other functions related to the MP3 audio player operation or audio recording / playback operation of the mobile terminal (eg, trick play such as fast forwarding or rewinding to another part) may also be controlled by the user's gesture.

In addition, according to another embodiment of the present invention, when tilting to the up and down (or in another specific direction) of the mobile terminal can be configured to up / down the volume.

At this time, the gesture mode function should be activated, and the method of activating the gesture mode may be applied to the above-described method.

2C illustrates a case in which a mobile terminal performs a video playback function according to an embodiment of the present invention.

The left shows a display screen of the mobile terminal when the first video file (VIDEO1.wmv) is being played out of the 30 video files. When the user tilts the mobile terminal to the right by a predetermined angle as shown in FIG. 1A or 1B, the motion sensor of the mobile terminal detects this and configures the next video file (VIDEO2.wmv) to be played as shown in the right figure of FIG. 2C. have.

That is, when a specific gesture is applied to the mobile terminal, that is, a gesture that tilts to the right, the mobile terminal may play the next video file when the mobile terminal is in the current video playback mode. If the user tilts the mobile terminal to the left while playing the video file, the previous video file may be played. As with the example described with reference to FIG. 2B, the user may allow the mobile terminal to flick left / right or up / down, to scroll between files (or between video files or between scenes of a video file). have. The number of files / scenes scrolled may be proportional to the number of shakers. Further, when the mobile terminal is moved in a predetermined manner, continuous scrolling between video files may be performed (eg, when the user flicks to the right while pressing a specific button on the mobile terminal in the video playback mode, the video may continue to scroll forward). Can be). According to the user's gesture, other functions related to the video recording / playback operation of the mobile terminal (eg, trick play such as fast forwarding or rewinding within a single video file or movie file) may be controlled.

In addition, in the example of FIGS. 2B and 2C, when tilting the mobile terminal up and down, the volume may be configured to be up / down or may be configured to up / down the brightness of the video.

In the above-described embodiment, when the tilting of the mobile terminal is configured to up / down the volume, each time the mobile terminal is tilted once, the volume may be configured to be up / down by one step. When the volume is up and down, the change is preferably displayed to the user as shown in FIG. 5B.

If the mobile terminal is in picture view mode, the mobile terminal can be configured to display the next or previous picture (from a previously stored picture) by tilting it left or right (or in any specified direction), and tilting up or down You can configure it to zoom in or out, or you can exit the picture view mode.

2d illustrates a case in which a mobile terminal operates in a TV mode according to an embodiment of the present invention.

The left side of FIG. 2D shows a screen of the mobile terminal when watching NBC among TV channels, for example. When the user tilts the mobile terminal to the right by a predetermined angle as shown in FIG. 1A or 1B, the motion sensor of the mobile terminal detects this and displays the content broadcasted on the next channel of the NBC, for example, the ABC channel, as shown in the left figure of FIG. 2D. Can be.

That is, when detecting a gesture of tilting the mobile terminal to the right, when the mobile terminal is in TV mode, the controller of the mobile terminal instructs the TV receiving module such as DVB-H or DMB to change the channel.

As in the other embodiment, when the user tilts the mobile terminal to the left side, the broadcast of the lower channel of the NBC may be displayed.

In addition, when tilting the mobile terminal up and down, it may be configured to up / down the volume or up / down the brightness of the screen.

As with other embodiments, the gesturing mode function should be activated, and the method of activating the gesturing mode may apply any of the methods described above.

2E illustrates a case in which the mobile terminal operates in a camera photographing mode according to an embodiment of the present invention.

In a mobile terminal equipped with a conventional camera function, in order to adjust an image resolution, an image quality, or the like, or to operate a menu such as a night mode, a landscape mode, a video mode, etc., a user must press a separate button to enter a corresponding menu during camera shooting.

Since a mobile terminal, such as a mobile phone, is not dedicated to the camera, the user cannot easily recognize from the appearance which of the buttons arranged outside the mobile terminal is a menu button. In particular, recently introduced full touch mobile phones, which have no number buttons and display screens occupy most of the mobile phones, have only two or three buttons. Therefore, when operating in camera mode, various menu operations may be difficult. Can be.

In this case, gestures can be used to improve the limited user interface experience as follows:

In the camera photographing mode, when the user tilts the mobile terminal to the right by a predetermined angle as shown in FIG. 1A or 1B, the motion sensor of the mobile terminal may detect the same and display a menu required for camera operation as shown in FIG. 2E. In another example, when the mobile terminal is in the picture taking mode, when the user moves the mobile terminal up and down, the screen on which the preview is provided, that is, the screen to be photographed may be zoomed in or zoomed out. In another example, when the mobile terminal is in the picture taking mode, when the user brings the mobile terminal closer to or farther away from the user, the screen to be photographed may be zoomed in or zoomed out.

When the gesture of tilting the mobile terminal to the right is detected, when the mobile terminal is in TV mode, the controller of the mobile terminal may be configured to display a menu necessary for controlling the camera operation.

If the user tilts to the other side, a menu for controlling other functions of the camera may be displayed, or the user may enter the shooting mode most used.

In addition, when tilting the mobile terminal up and down, it may be configured to zoom in / up the volume. It is also possible to assign the function of activating the flash to one of the up and down movements.

In addition, when the movement of moving up and down is detected, it can be configured to up down the resolution of the photographed picture. At this time, it is preferable to configure the change of the resolution to be displayed on the screen.

Like other embodiments, the gesture mode function should be activated, and the method of activating the gesture mode may apply the above-described method.

Other modes of operation of the mobile terminal, such as an electronic organizer, radio reception, etc., may also assign a certain operation to the aforementioned tilt gesture.

For various operation modes mounted in the mobile terminal, an operation performed by the tilt gesture may be variously changed.

In the above-described embodiment, a case in which the user controls the user interface according to the operation mode with respect to the gesture of tilting the mobile terminal is described. However, in order to use the user interface, a motion sensor may be attached to the mobile terminal to detect the gesture. The gestures that are present can be varied.

3 illustrates a method for controlling a mobile terminal by gestures according to another embodiment of the present invention.

When the mobile terminal is equipped with a motion sensor such as an acceleration sensor or a gyro sensor, the movement direction and the speed of the mobile terminal can be detected.

As shown in FIG. 3, when the user grabs the mobile terminal and moves it up, down, left, and right, it may be detected and applied to control of the mobile terminal. An activation button 11 may be mounted to activate motion detection. That is, in FIG. 3, the gesture applied to the mobile terminal is a lateral movement (transition). A description of the user interface control method of the example shown in Figures 2a to 2f can also be applied to FIG. However, the same method can be applied to other gestures (eg, yawing / pivoting, etc.) applied to the mobile terminal.

For example, in the above-described embodiment, when the user uses the mobile terminal to browse the Internet web as shown in FIG. 2A, when the user takes gestures as shown in FIG. 3, the screen is displayed according to the direction in which the user moves on the web page. To scroll.

In addition, when the mobile terminal is in the audio file playback mode, the mobile terminal may be configured to play the next audio file or the previous audio file when the mobile terminal is moved to the right or left side. It can also be configured to raise or lower the volume when moving up and down.

When the mobile terminal is in the video file playback mode, as shown in FIG. 3, the mobile terminal may be configured to play the next video file or the previous video file when the mobile terminal is moved left and right. It can also be configured to move the volume up and down as the mobile terminal moves up and down.

When the mobile terminal is in the TV mode, it may be configured to display the next or previous channel when the mobile terminal moves left and right, and up or down when the mobile terminal moves up and down.

When the mobile terminal is in the camera shooting mode, the mobile terminal may be configured to display a shooting menu when the mobile terminal moves left and right, and to perform zoom in / zoom out when the mobile terminal moves up and down.

4 illustrates a method for controlling a mobile terminal by gestures according to another embodiment of the present invention.

By mounting a proximity sensor 12 such as a PSD sensor on the mobile terminal, the movement of the mobile terminal can be detected by measuring the distance between the user and the mobile terminal. Proximity sensor 12 includes users such as PSD sensor, magnetoresistive sensor, shadow sensor, visible light sensor, infrared sensor, color sensor, ultrasonic sensor, acoustic sensor, radar, thermal sensor, sonar, conductivity detector, resistance detector, etc. A sensor capable of detecting proximity between mobile terminals can be used.

When the user approaches the mobile terminal to himself / herself when the mobile terminal is in the web browsing mode, the proximity sensor 12 detects the proximity and the controller of the mobile terminal is configured to zoom in the webpage as shown in FIG. 5A. Can be. Conversely, if the mobile terminal is far away, the webpage can be zoomed out.

When the mobile terminal is in another operation mode, different operations may be performed depending on proximity.

In the audio file playback mode, it can be configured to turn up the volume when approaching, and to turn it down when away. When the volume is up and down, the change is preferably displayed to the user as shown in FIG. 5B.

In the video file playback mode, the screen may be zoomed in or out depending on proximity, or the volume may be up or down. Alternatively, it may be configured to display or hide a control menu displaying a progressive bar according to proximity. In addition, the brightness of the screen may be changed according to proximity.

Even in the TV mode, the screen can be configured to zoom in / out or the volume up or down depending on proximity. Alternatively, it may be configured to change the brightness of the screen.

In the photo capture mode, the screen can be configured to zoom in and out according to proximity.

As described above, the gesture performed by the same user may be variously changed according to the operation mode of the mobile terminal.

According to an exemplary embodiment, a gesture that can be detected may be set according to a sensor mounted in the mobile terminal, and the user may be configured to specify actions performed accordingly.

For example, when a tilting gesture is detected, a menu designated by a user may be displayed.

As shown in FIG. 1A or 1B, a gesture of moving a mobile terminal from side to side may be referred to as rolling. As shown in FIG. 3 or 4, a gesture for moving the mobile terminal up, down, left, or right may be referred to as a transition.

According to an embodiment of the present invention, in addition to the above gestures, other types of gestures may be used for controlling the mobile terminal.

As shown in FIG. 6, the front surface of the mobile terminal may be tilted downward, or conversely, the front surface may be tilted upward. Such a gesture may be referred to as pitching. The gesture of tilting the mobile terminal to the right or left may be referred to as rolling. Pitching and rolling gestures are both tilt gestures, but other types of tilt gestures.

In addition, as shown in FIG. 7, the mobile terminal may be moved around a central axis in a fan shape. Such a gesture may be referred to as yawing. The gesture as shown in FIG. 3 may be referred to as a transition gesture.

According to an embodiment of the present invention, the above operations may be combined and applied when web browsing is performed using a mobile terminal.

It is assumed that web browsing is performed using a mobile terminal, and a plurality of task windows are running. In this case, the above gesture may be applied to switch between the plurality of work windows.

Assume that a total of six task windows are running as shown in FIG. 8, and that six task windows are virtually arranged in two rows and three columns as shown in FIG. 8. In addition, it is assumed that the work window currently displayed on the mobile terminal is window 1. When the user rolls the mobile terminal as shown in FIG. 1A or 1B, the displayed window may be changed to window 2 or window 3.

Alternatively, even when the yawing gesture shown in FIG. 7 is applied to the mobile terminal, the work window may be switched. Alternatively, the work window may be switched by applying the transition gesture shown in FIGS. 3 and 4 to the mobile terminal.

In the case of applying the transition gesture to the mobile terminal as shown in FIG. 6, the work window may be switched. In FIG. 8, when the window currently displayed is assumed to be the first window, when the transition gesture is applied, the work window is switched up and down. Window 4 may be displayed.

In one embodiment of the present invention, one side of the mobile terminal is equipped with an activation key 11 as shown in FIG. 1B, and gestures only when the user applies the above gesture while holding the activation key 11. You can configure the task pane to switch in response.

In another embodiment of the present invention, when a plurality of windows are executed as shown in FIG. 9 and a transition gesture is made to the mobile terminal, the switching between the windows and the windows can be seamlessly switched. That is, when switching, two or more windows may be partially displayed on one screen. For example, if the user moves the mobile terminal laterally as a transition gesture, the display smoothly displays the work window portions covered by the display in accordance with the direction of the transition gesture as shown in FIG. Such a transition gesture may be configured such that the window is switched as shown in FIG. 9 only when the activation key 11 is mounted on one side of the mobile terminal and the mobile terminal is transitioned while the activation key 11 is held. In another example, a user may zoom in and zoom out of the display (eg, using a gesture) to display one or more pages or task panes. If multiple task windows are simultaneously displayed by a zoom in / zoom out operation, the user may select one of the task windows, for example, by touching the task windows or by another selection method.

The above embodiment may be applied to not only a case of browsing a plurality of web pages using a mobile terminal, but also to a case where the mobile terminal supports multitasking and a plurality of tasks are being executed.

According to an embodiment of the present invention, the user's gesture may be recognized as a left button click or a right button click of a mouse used in a general computer, and configured to perform an operation accordingly.

For example, in the case of web browsing using a mobile terminal, when the rolling gesture of tilting the mobile terminal to the left is applied, the computer may be configured to perform the same operation as when the left button of the mouse is clicked. You can configure it to do the same thing as when you right-click your computer's mouse. That is, when the mobile terminal is tilted to the left side, the hyperlink of the current pointer is located may be executed, and when the mobile terminal is tilted to the right side, the menu screen may be displayed.

The yaw and transition gestures can be configured to operate in the same manner.

The above operation may be configured to be executed while pressing a specific button on the mobile terminal, or may be configured to be executed only in a specific mode.

According to one embodiment of the present invention, when a plurality of work windows are being executed, the user's gesture can be detected to terminate the plurality of work windows at once. For example, as shown in FIG. 10, when a plurality of task windows are activated, shaking the mobile terminal a predetermined number of times, for example, once or twice while pressing the button 11 or not, causes all currently active task windows to be displayed. Can be configured to close.

Accordingly, the user can easily terminate the plurality of work windows while browsing the web through the mobile terminal. After all the work windows are finished, the main menu of the mobile terminal, that is, the top level menu, may be displayed.

11 is a block diagram of a mobile terminal 100 according to an embodiment of the present invention. Any mobile terminal (eg, mobile terminals 10, 21) referred to herein may be a mobile terminal 100 equipped with components that include a distance sensor. As mentioned above, the mobile terminal of the present invention can be implemented using various types of devices. For example, the mobile terminal described herein may be a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, or the like. have.

The illustrated mobile terminal 100 includes a wireless communication unit 110 that can be implemented with several known components. For example, the wireless communication unit 110 typically includes one or more components that enable wireless communication between the mobile terminal 100 and a wireless communication system or network in which the mobile terminal is located.

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcast systems providing broadcast signals as well as the digital broadcast system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

In addition, the mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless Internet module 113 is a module for wireless Internet access, and the wireless Internet module 113 can be built in or externally.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

In addition, the location information module 115 is a module for checking or obtaining the location of the mobile terminal. One example is the Global Position System (GPS) module. The GPS module receives location information from a plurality of satellites. Here, the location information may include coordinate information represented by latitude and longitude. For example, the GPS module can measure the exact time and distance from three or more satellites and accurately calculate the current position by triangulating three different distances. A method of obtaining distance and time information from three satellites and correcting the error with one satellite may be used. In particular, the GPS module can obtain not only the location of latitude, longitude, and altitude but also accurate time together with three-dimensional speed information from the location information received from the satellite.

Meanwhile, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the configuration aspect of the terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output in the call mode. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like. In particular, when the touch pad has a mutual layer structure with the display unit 151 described later, this may be referred to as a touch screen.

The sensing unit 140 detects a current state of the mobile terminal 100 such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, presence or absence of a user contact, orientation of the mobile terminal, acceleration / deceleration of the mobile terminal, and the like. To generate a sensing signal for controlling the operation of the mobile terminal 100.

The sensing unit 140 may include an inertial sensor for detecting a movement or a position of a gyro sensor, an acceleration sensor, or a distance sensor for detecting or measuring a distance relationship between a user and the mobile terminal 100.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, Video I / O (Input / Output) port, earphone port, etc. may be included.

Here, the identification module is a chip that stores various types of information for authenticating the use authority of the mobile terminal 100, and includes a user identification module (UIM) and a subscriber identify module (SIM). ), A Universal Subscriber Identity Module (“USIM”), and the like. In addition, the device equipped with the identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Therefore, the identification device may be connected to the terminal 100 through a port. The interface unit 170 receives data from an external device or receives power and transmits the data to each component inside the mobile terminal 100 or transmits the data inside the mobile terminal 100 to an external device.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, a sound output module 152, an alarm unit 153, and the like. The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, a user interface (UI) or a graphic user interface (GUI) related to a call is displayed. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays a photographed and / or received image, a UI, or a GUI.

The touch screen panel may be mounted on the display unit 151. By such a configuration, the display unit 151 may serve as both an input unit and an output unit.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, or a three-dimensional display. 3D display). In addition, two or more display units 151 may exist according to the implementation form of the mobile terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile terminal 100.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, and key signal input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. When a call signal is received or a message is received, the alarm unit 153 may output a vibration to inform this. Alternatively, when a key signal is input, the alarm unit 153 may output a vibration in response to the key signal input. Through the vibration output as described above, the user can recognize the occurrence of the event. Of course, the signal for notification of event occurrence may be output through the display unit 151 or the voice output module 152.

The memory 160 may store a program for processing and controlling the controller 180 and may provide a function for temporarily storing input / output data (for example, a phone book, a message, a still image, a video, etc.). It can also be done.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) magnetic memory, It may include at least one type of storage medium of the optical disk. In addition, the mobile terminal 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The controller 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. In addition, the control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The various embodiments described herein may be implemented in a computer readable recording medium using, for example, software, hardware or a combination thereof.

According to a hardware implementation, embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing the functions. It may be implemented by the controller 180.

In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. In addition, the software codes may be stored in the memory 160 and executed by the control unit 180. [

The terminal 100 illustrated in FIG. 11 may be configured to be operable in a communication system capable of transmitting data through a frame or packet, including a wired / wireless communication system and a satellite based communication system. Can be.

Hereinafter, referring to FIG. 12, a communication system capable of operating a terminal according to the present invention will be described.

The communication system may use different air interfaces and / or physical layers. For example, a radio interface usable by a communication system may include frequency division multiple access (FDMA), time division multiple access (TDMA), and code division multiple access (Code Division). Multiple Access (CDMA), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE)), Global System for Mobile Communications (GSM), etc. May be included. Hereinafter, for convenience of description, the description will be limited to CDMA. However, it is a matter of course that the present invention is applicable to all communication systems including the CDMA wireless communication system.

As shown in FIG. 12, the CDMA wireless communication system includes a plurality of terminals 100, a plurality of base stations (BS) 270, and base station controllers (BSCs) 275. ), And a mobile switching center (MSC) 280. The MSC 280 is configured to be connected to a public switched telephone network (PSTN) 290 and is also configured to be connected to BSCs 275. The BSCs 275 may be coupled to the BS 270 through a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. Thus, a plurality of BSCs 275 may be included in the system shown in FIG. 12.

Each BS 270 may include at least one sector, and each sector may include an omnidirectional antenna or an antenna pointing radially out of BS 270. In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments, each of which has a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of sectors and frequency assignments may be called a CDMA channel. BS 270 may be referred to as a base station transceiver subsystem ('BTSs'). In this case, the word "base station" may be called the sum of one BSC 275 and at least one BS 270. The base station may also indicate “cell site”. Alternatively, each of the plurality of sectors for a particular BS 270 may be called a plurality of cell sites.

As shown in FIG. 12, the broadcasting transmitter (BT) 295 transmits a broadcast signal to the terminals 100 operating in the system. The broadcast module 111 shown in FIG. 11 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295.

In addition, FIG. 12 illustrates a number of satellite positioning system (GPS) satellites 300. The satellites 300 help to locate the at least one terminal of the plurality of terminals 100. Although two satellites are shown in FIG. 12, useful location information may be obtained by two or less or more satellites. The GPS module 115 shown in FIG. 11 cooperates with the satellites 300 to obtain desired location information. Here, the location can be tracked using all the techniques that can track the location, not just the GPS tracking technology. In addition, at least one of the GPS satellites 300 may optionally or additionally be responsible for satellite DMB transmission.

During typical operation of a wireless communication system, BS 270 receives a reverse link signal from various terminals 100. At this time, the terminals 100 are connecting a call, transmitting or receiving a message, or performing another communication operation. Each of the reverse link signals received by a particular base station 270 is processed within by the particular base station 270. The data generated as a result of the processing is transmitted to the connected BSC 275. BSC 275 provides call resource allocation and mobility management functionality, including the organization of soft handoffs between base stations 270. In addition, the BSC 275 transmits the received data to the MSC 280, and the MSC 280 provides an additional transmission service for connection with the PSTN 290. Similarly, PSTN 290 connects with MSC 280, MSC 280 connects with BSCs 275, and BSCs 275 send BSs 270 to transmit a forward link signal to terminals 100. ).

Claims (4)

A method of controlling a user interface of a mobile terminal,
Detecting any one of a gesture of tilting the mobile terminal left or right, a yawing gesture, or a gesture of transitioning; And
And performing an operation corresponding to a left click or a right click of a computer mouse according to the detected gesture. A method of controlling a user interface of a mobile terminal configured to support a plurality of tasks, the method comprising:
Determining whether a gesture of shaking the mobile terminal is detected by a user's gesture when the mobile terminal has a plurality of active task windows; And
And closing all activated work windows of the mobile terminal when a gesture of shaking the mobile terminal is detected. A mobile terminal capable of controlling a user interface,
A detector configured to detect one of the gesture of tilting the mobile terminal left or right, a yawing gesture or a transitioning gesture; And
And a controller configured to perform an operation corresponding to a left click or a right click of a computer mouse according to the detected gesture. In the mobile terminal configured to support a plurality of tasks,
A detector configured to detect a predetermined movement of the mobile terminal applied by a gesture of a user; And
Determine if there is a predetermined movement of the detected mobile terminal when there are a plurality of active task windows in the mobile terminal, determine a predetermined movement of the mobile terminal and close all active task windows of the mobile terminal. A mobile terminal comprising a configured control unit.

Images