KR20090070050A - Mobile terminal and its method for controlling of user interface menu - Google Patents

Abstract

A mobile terminal and a user interface menu controlling method having an automatic scrolling function are provided to scroll contents displayed on a screen according to a direction and sense the rotation or tilt of the mobile terminal. A camera(121) outputs a memory(160). The memory stores the image inputted through camera to the specific time gap. A controller analyzes the stored image and inclines of the mobile terminal in a rotation or traveling direction. The controller executes a user interface menu or a special function according to the calculated direction automatically.

Description

MOBILE TERMINAL AND ITS METHOD FOR CONTROLLING OF USER INTERFACE MENU}

The present invention detects a movement such as tilting, rotation or movement of a mobile terminal and, according to the movement, controls a display of a preset content or menu, or controls execution of a specific function or menu, and a mobile terminal having the same. It is about.

The mobile terminal may be configured to perform various functions.

Examples of such various functions include data and voice communication functions, taking pictures or videos through a camera, storing voices, playing music files through a speaker system, and displaying images or videos. Some mobile terminals include additional functionality to play games, while others are implemented as multimedia devices. Moreover, recent mobile terminals can receive broadcast or multicast signals to watch video or television programs.

In addition, efforts to support and increase the function of the mobile terminal continue. The foregoing efforts include not only changes and improvements in the structural components forming the mobile terminal, but also improvements in software or hardware. As such a design form, a folder form, a slide form, a bar form or a rotation form design is applied to the mobile terminal.

However, in the related art, in order to scroll a content displayed on a screen in a specific direction, a user has to repeatedly press a specific key, and in order to call a menu to display or to select a called menu item, the user has to repeatedly press a specific key. .

The present invention provides a method for detecting a tilt or rotation of a mobile terminal and scrolling content displayed on a screen according to the tilted or rotated direction, and a mobile terminal having the same.

Another object of the present invention is to provide a method for detecting a tilt or rotation of a mobile terminal, displaying a specific menu according to the tilted or rotated direction, and moving the menu item, and a mobile terminal having the same.

Another object of the present invention is to provide a method for detecting a tilt or rotation of a mobile terminal and re-executing a specific function or menu previously executed according to the tilted or rotated direction, and a mobile terminal having the same.

The mobile terminal according to an embodiment of the present invention for realizing the above problem is to analyze the camera and the memory for storing the image received through the camera and the image input through the camera at a specific time interval to receive the image And a control unit for calculating a tilting, rotating, or moving direction of the mobile terminal, and automatically executing a predetermined function or a user interface menu according to the calculated direction.

In addition, the present invention for realizing the above problem is to store the image input through the camera at a specific time interval, and after calculating the movement of the terminal by analyzing the stored image, in accordance with the calculated movement of the terminal in advance It automatically executes certain set functions or menus.

The mobile terminal according to the present invention configured as described above has an effect of improving convenience by scrolling the content displayed on the screen according to the tilted or rotated direction even if a specific key is not repeatedly inputted.

In addition, the present invention configured as described above is interesting to the user by calling and displaying a specific menu according to the tilted or rotated direction of the mobile terminal even if a particular key is not repeatedly inputted, so that each item of the menu can be easily moved. It has the effect of giving convenience and improving convenience.

In addition, the present invention is configured as described above, even if you do not repeatedly enter a specific key, even if the menu call is not repeatedly performed according to the tilted or rotated direction of the mobile terminal by executing a specific function or menu that was previously executed There is an effect of improving the convenience.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the detailed description of the well-known technology and its configuration which are determined to obscure the gist of the present invention will be omitted. In addition, in describing the present invention with reference to the drawings, components that perform the same function will be described with the same reference numerals.

Hereinafter, a mobile terminal according to the present invention will be described in more detail with reference to the accompanying drawings.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal can be implemented in various forms. For example, the mobile terminal described herein may be a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, or the like. have.

The illustrated mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, The interface unit 170 may include a controller 180, a power supply unit 190, and the like. 1 illustrates a mobile terminal having various components. However, not all illustrated components are essential components. The mobile terminal may be implemented by more components than the illustrated components, or the mobile terminal may be implemented by fewer components.

Hereinafter, the components will be described in turn.

The wireless communication unit 110 may include one or more components for wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. have.

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcast systems providing broadcast signals as well as the digital broadcast system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

In addition, the mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be internal or external.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

In addition, the location information module 115 is a module for checking or obtaining the location of the mobile terminal. One example is the Global Position System (GPS) module. The GPS module receives location information from a plurality of satellites. Here, the location information may include coordinate information represented by latitude and longitude. For example, the GPS module can measure the exact time and distance from three or more satellites and accurately calculate the current position by triangulating three different distances. A method of obtaining distance and time information from three satellites and correcting the error with one satellite may be used. In particular, the GPS module can obtain not only the location of latitude, longitude, and altitude but also accurate time together with three-dimensional speed information from the location information received from the satellite.

Meanwhile, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the configuration aspect of the terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output in the call mode. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like. In particular, when the touch pad has a mutual layer structure with the display unit 151 described later, this may be referred to as a touch screen.

The sensing unit 140 detects a current state of the mobile terminal 100 such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, presence or absence of a user contact, orientation of the mobile terminal, acceleration / deceleration of the mobile terminal, and the like. To generate a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it is responsible for sensing functions related to whether the power supply unit 190 is supplied with power or whether the interface unit 170 is coupled to an external device.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, Video I / O (Input / Output) port, earphone port, etc. may be included.

Here, the identification module is a chip that stores various types of information for authenticating the use authority of the mobile terminal 100, and includes a user identification module (UIM) and a subscriber identify module (SIM). ), A Universal Subscriber Identity Module (“USIM”), and the like. In addition, the device equipped with the identification module (hereinafter referred to as 'identification device'), can be produced in the form of a smart card (smart card). Therefore, the identification device may be connected to the terminal 100 through a port. The interface unit 170 receives data from an external device or receives power and transmits the data to each component inside the mobile terminal 100 or transmits the data inside the mobile terminal 100 to an external device.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, a sound output module 152, an alarm unit 153, and the like.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, a user interface (UI) or a graphic user interface (GUI) related to a call is displayed. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays a photographed and / or received image, a UI, or a GUI.

Meanwhile, as described above, when the display unit 13 and the touch pad form a mutual layer structure to form a touch screen, the display unit 151 may be used as an input device in addition to the output device. The display unit 151 may include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display. 3D display). In addition, two or more display units 151 may exist according to the implementation form of the mobile terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile terminal 100.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, and key signal input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. When a call signal is received or a message is received, the alarm unit 153 may output a vibration to inform this. Alternatively, when a key signal is input, the alarm unit 153 may output a vibration in response to the key signal input. Through the vibration output as described above, the user can recognize the occurrence of the event. Of course, the signal for notification of event occurrence may be output through the display unit 151 or the voice output module 152.

The memory 160 may store a program for processing and controlling the controller 180 and may provide a function for temporarily storing input / output data (for example, a phone book, a message, a still image, a video, etc.). It can also be done.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) magnetic memory, It may include at least one type of storage medium of the optical disk. In addition, the mobile terminal 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The controller 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The various embodiments described herein may be implemented in a computer readable recording medium using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing the functions. It may be implemented by the controller 180.

In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. In addition, the software code may be stored in the memory 160 and executed by the controller 180.

 In the above, the mobile terminal related to the present invention has been described in terms of components according to functions. Hereinafter, referring to FIGS. 2 and 3, the mobile terminal related to the present invention will be further described in terms of components according to appearance. Hereinafter, for simplicity, a slider type mobile terminal is described as an example among various types of mobile terminals such as a folder type, a bar type, a swing type, a slider type, and the like. Therefore, the present invention is not limited to the slider type mobile terminal, but can be applied to all types of mobile terminals including the above-described type.

2 is a front perspective view of an example of a mobile terminal according to the present invention;

The mobile terminal of the present invention includes a first body 200 and a second body 205 configured to be slidable in at least one direction on the first body 200.

A state in which the first body 200 is disposed to overlap with the second body 205 may be referred to as a closed configuration, and as shown in the drawing, the first body 200 may be referred to as the second body 205. The exposed state of at least a portion of the N may be referred to as an open configuration.

The mobile terminal mainly operates in a standby mode in a closed state, but the standby mode may be released by a user's operation. In addition, although the mobile terminal operates mainly in a call mode or the like in an open state, the mobile terminal may be switched to a standby mode by a user's manipulation or a lapse of a predetermined time.

The case (casing, housing, cover, etc.) forming the exterior of the first body 200 is formed by the first front case 220 and the first rear case 225. Various electronic components are embedded in the space formed by the first front case 220 and the first rear case 225. At least one intermediate case may be further disposed between the first front case 220 and the first rear case 225.

The cases may be formed by injecting a synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display module 151, the audio output module 152, the camera 121, or the first user input unit 210 may be disposed on the first body 200, specifically, the first front case 220.

The display module 151 includes a liquid crystal display (LCD), organic light emitting diodes (OLED), and the like, which visually express information.

In addition, since the touch pad is superimposed on the display module 151 in a layer structure, the display module 151 may operate as a touch screen to enable input of information by a user's touch.

The sound output module 152 may be implemented in the form of a speaker.

The camera 121 may be implemented to be suitable for capturing an image or a video of a user or the like.

Like the first body 200, the case forming the exterior of the second body 205 is formed by the second front case 230 and the second rear case 235.

The second user input unit 215 may be disposed on the second body 205, specifically, on the front face of the second front case 230.

The third user input unit 245, the microphone 122, and the interface unit 170 may be disposed in at least one of the second front case 230 or the second rear case 235.

The first to third user inputs 210, 215, and 245 may be collectively referred to as a manipulating portion 130, and may be any type as long as the user is tactile in a tactile manner. Can be employed.

For example, the user input unit may be implemented as a dome switch or a touch pad capable of receiving a command or information by a user's push or touch operation, or a wheel or jog method of rotating a key, or a manipulation method such as a joystick. May also be implemented.

In functional terms, the first user input unit 210 is for inputting a command such as start, end, scroll, etc., and the second user input unit 215 is for inputting numbers, letters, symbols, and the like.

In addition, the third user input unit 245 may operate as a hot key for activating a special function in the mobile terminal.

The microphone 122 may be implemented in a form suitable for receiving a user's voice, other sounds, and the like.

The interface unit 170 serves as a passage for allowing the mobile terminal according to the present invention to exchange data with an external device. For example, the interface unit 170 is wired or wirelessly, a connection terminal for connecting with an earphone, a port for short-range communication (for example, an infrared port (IrDA port), a Bluetooth port, a wireless LAN port) wireless LAN port), or at least one of power supply terminals for supplying power to the mobile terminal.

The interface unit 170 may be a card socket that accommodates an external card such as a subscriber identification module (SIM) or a user identity module (UIM) and a memory card for storing information.

The power supply unit 190 for supplying power to the mobile terminal is mounted on the second rear case 235 side.

The power supply unit 190 may be detachably coupled for charging, for example, as a rechargeable battery.

3 is a rear perspective view of the mobile terminal of FIG.

Referring to FIG. 3, a camera 121 may be additionally mounted on the rear surface of the second rear case 235 of the second body 205. The camera 121 of the second body 205 has a photographing direction substantially opposite to the camera 121 of the first body 200, and the camera 121 and the camera 121 of the first body 200. And may have different pixels.

For example, the camera 121 of the first body 200 has a low pixel so that it is easy to take a picture of the user's face and transmit it to the counterpart in the case of a video call, and the camera 121 of the second body is generally It is desirable to have a high pixel because the subject is often photographed and not immediately transmitted.

The flash 250 and the mirror 255 may be further disposed adjacent to the camera 121 of the second body 205. The flash 250 illuminates the subject when the subject is photographed by the camera 121 of the second body 205. The mirror 255 allows the user to see the user's face or the like when photographing (self-photographing) the user by using the camera 121 of the second body 205.

The sound output module 152 may be further disposed on the second rear case 235.

The sound output module 152 of the second body 205 may implement a stereo function together with the sound output module 152 of the first body 200, and may be used for a call in a speakerphone mode.

In addition, an antenna 260 for receiving a broadcast signal may be disposed on one side of the second rear case 235. The antenna 260 may be installed to be pulled out of the second body 205.

A portion of the slide module 265 that slidably couples the first body 200 and the second body 205 is disposed on the side of the first rear case 225 of the first body 200.

The other part of the slide module 265 may be disposed on the second front case 230 side of the second body 205 and may not be exposed to the outside as shown in this drawing.

In the above description, the second camera 121 and the like have been described as being disposed on the second body 205, but the present invention is not limited thereto.

For example, at least one or more of the components 260, 121 to 250, and 152 described as disposed on the second rear case 235, such as the camera 121 of the second body, may be the first body 200. May be mounted on the first rear case 225. In such a case, there is an advantage that the configuration (s) disposed in the first rear case 225 in the closed state are protected by the second body 205. In addition, even if the camera 121 of the second body is not provided separately, the camera 121 of the first body may be rotatably formed so that the camera 121 of the second body may be photographed up to the photographing direction of the camera 121. .

The terminal 100 illustrated in FIGS. 1 to 3 may operate in a communication system capable of transmitting data through a frame or packet, including a wired / wireless communication system and a satellite-based communication system. It can be configured to.

Hereinafter, referring to FIG. 4, a communication system capable of operating a terminal according to the present invention will be described.

The communication system may use different air interfaces and / or physical layers. For example, a radio interface usable by a communication system may include frequency division multiple access (FDMA), time division multiple access (TDMA), and code division multiple access (Code Division). Multiple Access (CDMA), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE)), Global System for Mobile Communications (GSM), etc. May be included. Hereinafter, for convenience of description, the description will be limited to CDMA. However, it is a matter of course that the present invention is applicable to all communication systems including the CDMA wireless communication system.

As shown in FIG. 4, the CDMA wireless communication system includes a plurality of terminals 100, a plurality of base stations (BSs) 270, and base station controllers (BSCs) 275. ), And a mobile switching center (MSC) 280. The MSC 280 is configured to be connected to a public switched telephone network (PSTN) 290 and is also configured to be connected to BSCs 275. The BSCs 275 may be coupled to the BS 270 through a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. Thus, a plurality of BSCs 275 may be included in the system shown in FIG.

Each BS 270 may include at least one sector, and each sector may include an omnidirectional antenna or an antenna pointing radially out of BS 270. In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments, each of which has a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of sectors and frequency assignments may be called a CDMA channel. BS 270 may be referred to as a base station transceiver subsystem ('BTSs'). In this case, the word "base station" may be called the sum of one BSC 275 and at least one BS 270. The base station may also indicate “cell site”. Alternatively, each of the plurality of sectors for a particular BS 270 may be called a plurality of cell sites.

As shown in FIG. 4, a broadcasting transmitter (BT) 295 transmits a broadcast signal to terminals 100 operating in the system. The broadcast module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295. In addition, FIG. 4 illustrates several satellite positioning systems (GPS) satellites 300. The satellites 300 help to locate the at least one terminal of the plurality of terminals 100.

Although two satellites are shown in FIG. 4, useful location information may be obtained by two or more satellites. The GPS module 115 shown in FIG. 1 cooperates with the satellites 300 to obtain desired location information. Here, the location can be tracked using all the techniques that can track the location, not just the GPS tracking technology. In addition, at least one of the GPS satellites 300 may optionally or additionally be responsible for satellite DMB transmission.

During typical operation of a wireless communication system, BS 270 receives a reverse link signal from various terminals 100. At this time, the terminals 100 are connecting a call, transmitting or receiving a message, or performing another communication operation. Each of the reverse link signals received by a particular base station 270 is processed within by the particular base station 270.

The data generated as a result of the processing is transmitted to the connected BSC 275. BSC 275 provides call resource allocation and mobility management functionality, including the organization of soft handoffs between base stations 270. In addition, the BSC 275 transmits the received data to the MSC 280, and the MSC 280 provides an additional transmission service for connection with the PSTN 290. Similarly, PSTN 290 connects with MSC 280, MSC 280 connects with BSCs 275, and BSCs 275 send BSs 270 to transmit a forward link signal to terminals 100. ).

5 is a flowchart illustrating a method of controlling a user interface menu in a mobile terminal according to the present invention.

The controller 180 of the mobile terminal according to the present invention may perform a menu control function by receiving a specific button or a touch input and inclining (S101). That is, the device may enter a mode capable of controlling the operation of a specific function or menu by tilting (S102).

The mode may enter even when a specific function or menu is already executed.

For example, the user may enter the mode by receiving a specific button or touch input while the album view menu is executed, or enter the mode by receiving a specific button or touch input while the web browsing menu is executed.

Hereinafter, the mode is referred to as a "tilt operation mode" in order to distinguish it from a "call mode" or a "shooting mode" for convenience.

When the mobile terminal enters the tilt operation mode, the controller 180 detects that the display position of the subject is changed in the image input through the camera 121, and the mobile terminal is tilted using the changed position information. The direction of rotation or movement can be calculated. The controller 180 can calculate not only the tilting direction but also the moving direction (movement direction).

In order to detect or calculate the tilt, rotation, or movement direction, the sensing unit 140 may include a sensor for detecting a posture such as a gyro sensor. Hereinafter, the description of the method of detecting the inclination, rotation or direction of movement by the sensing unit will be omitted.

In the present invention, the tilt, rotation, or direction of movement may be calculated using an image input through the camera 121 provided in the terminal (S103). A detailed method of calculating a tilting or moving direction by using the camera 121 will be described with reference to FIG. 6.

When the information related to the tilt, rotation, or movement is calculated as described above, the controller 180 controls the operation of a function or menu already executed in the mobile terminal according to the calculated tilt, rotation, or movement direction. At this time, even if the tilt, rotation, or movement occurs in the same direction, different operations may be performed according to a function or a menu being executed at that time.

For example, when tilting or moving in the left direction occurs while the album view menu is executed, the controller 180 may control to move the displayed picture to the left direction or to display another picture. However, when tilting or moving in the left direction occurs while the web browsing menu is executed, the controller 180 may control to display a previous page. Even if tilting or moving occurs in the same direction as described above, other operations may be performed according to a function or a menu being executed at that time.

The controller 180 may detect the display position of the subject by analyzing the image at a specific time (S103), and calculate a direction in which the mobile terminal is tilted, rotated, or moved by using the detection result (S104). In addition, the angle of inclination, rotation or movement may be calculated according to a distance, a path or a direction in which the position of the subject is changed (S105). In addition, the speed of tilting, rotating or moving may be calculated. Here, the direction, angle, and speed are relative values.

The controller 180 may control the user interface menu by the calculated tilt, rotation, or movement information (S106). However, an operation that can be controlled according to a function or a menu executed when the information is detected may be individually set for each mobile terminal.

Hereinafter, a method of calculating the tilt and the moving direction by using the camera provided in the mobile terminal according to the present invention will be described.

6A is an exemplary diagram for describing a method of detecting a direction when the mobile terminal according to the present invention is tilted or moved about a first axis.

As illustrated, the controller 180 may detect a subject input through the camera 121 in an image when the mobile terminal is not moved, that is, an image in a stationary state. The controller 180 may use a characteristic shape of a straight line such as an outline of a subject, a desk, a box, or a gate to detect the object.

The controller 180 detects whether the position of the subject input through the camera is moved at specific time intervals. The specific time may vary according to the movement of the mobile terminal. For example, the faster the motion, the shorter the detection time, and the slower the motion, the longer the detection time.

When the position of the subject moves to the left, the controller 180 may determine that the mobile terminal is inclined to the left (320). Similarly, if the position of the subject moves to the right, it may be determined that the mobile terminal is inclined to the right (330).

6B is an exemplary diagram for explaining a method of detecting a direction when the mobile terminal according to the present invention is tilted or moved about a second axis. As shown, when the mobile terminal is tilted or moved, the position of the subject in the image input through the camera 121 is also moved.

Therefore, when the position of the subject moves upward, the controller 180 may determine that the mobile terminal is also inclined upward (420). Similarly, if the position of the subject moves downward, the mobile terminal may also be determined to be tilted downward (430).

6C is an exemplary view for explaining a method of detecting a direction when the mobile terminal according to the present invention is tilted or rotated about a third axis.

As illustrated, when the position of the subject rotates in the clockwise direction about the display unit 151, the controller 180 may determine that the mobile terminal is inclined or rotated in the counterclockwise direction. (520). Likewise, when the position of the subject rotates in the counterclockwise rotation direction, the mobile terminal may determine that it is inclined or rotates in the clockwise direction (530).

6D is an exemplary diagram for describing a method of detecting a direction when the mobile terminal according to the present invention is tilted or rotated about a fourth axis.

In FIG. 6C, the tilt and rotational movements of the body of the mobile terminal, particularly about the display unit 151, are described. However, as shown in FIG. 6D, the controller 180 may detect a rotational movement around the body of the mobile terminal except for the display unit 151 or any position other than the body. That is, as illustrated in FIG. 6D, the controller 180 may detect the inclination in the left direction or the right direction at an angle with respect to the lower portion of the body (620, 630).

Each embodiment described with reference to FIGS. 6A through 6D may be combined.

That is, the mobile terminal can be tilted or rotated about one or more axes, and the controller 180 can calculate the tilt or rotational movement information by analyzing the image input through the camera. The controller 180 may calculate an angle and a speed that are tilted or rotated according to the changed distance of the display position of the subject in the image.

6A to 6D are merely for explaining a method of calculating a direction by analyzing an image input through a camera, and the image input through the camera is actually displayed on the display unit 151. Note that this is not the case. That is, the controller 180 stores the image input through the camera in a specific region of the memory 160 and analyzes the images stored in the memory to calculate tilting or rotating.

In addition, depending on the circuit configuration, the image input through the camera may be directly stored in a specific area of the memory 160 without being controlled by the controller 180 in the 'tilt operation mode'. The specific area is a capacity for storing an image necessary for tilt analysis. For example, assuming that the time required for image analysis is 5 seconds, 5 seconds of the image is maintained in the memory area in a first in first out (FIFO) manner.

For reference, the controller 180 does not detect an inclined state of the mobile terminal, but detects an inclined or moving operation.

Hereinafter, a method of controlling a user interface menu using information related to tilting or rotational movement of a mobile terminal analyzed by an image input through a camera as described above will be described.

7 is a diagram illustrating a method of displaying a picture according to the movement of the terminal in the album view mode of the mobile terminal according to the present invention.

As shown in the drawing, in the state where the album view menu is executed, the controller 180 may change the same folder according to the direction when the mobile terminal is tilted or rotated in a specific direction, even if a specific button for changing and displaying a picture is not input. The pictures stored in (Folder) can be displayed by changing to the previous picture or the next picture in order, or the pictures stored in another folder (Folder). For example, the controller 180 displays the previous picture or the next picture in the same folder when the mobile device is tilted left or right, and the previous picture or next picture in another folder when the mobile device is tilted upward or downward. Display the picture.

8 is an exemplary view illustrating a method of displaying a web page according to the movement of the terminal in the web browsing mode of the mobile terminal according to the present invention.

As shown in the drawing, the controller 180 displays the previous web page or the next web page according to the direction in which the mobile terminal is tilted or rotated even when a specific button or menu is not input while the web browsing is performed. can do. For example, while using the second visited web page through the mobile terminal (710), when the mobile terminal is tilted in the left direction, the first visited web page is displayed (720) and the mobile terminal is tilted in the right direction. If it is lost, the third visited web page may be displayed (730).

9 is an exemplary view illustrating a method of displaying a menu in one region of the display unit according to the movement of a mobile terminal according to the present invention.

As shown, when the mobile terminal is in the standby state, the controller 180 displays a specific menu or displays a specific function in one region of the display unit according to the direction when the mobile terminal is tilted or rotated in a specific direction. It can be run automatically. The displayed menu may be a menu related to the function being executed when a specific function is already executed.

Even if tilting or rotation occurs in the same direction as described above, other operations may be performed according to a function or a menu being executed at that time. In addition, the display position may be changed according to the direction in which the menu is inclined or rotated.

10 is an exemplary diagram illustrating a method of reexecuting a function which has already been executed in the order of history according to the movement of a mobile terminal according to the present invention.

For example, it is assumed that a user uses a function of 'schedule' → 'Bluetooth' → 'camera' → 'view album' → 'calculator' through a mobile terminal. When the mobile terminal is tilted or rotated in a specific direction, the controller 180 can automatically re-execute a function previously executed according to the direction.

For example, when the mobile terminal is tilted to the left in the state of executing the 'album viewing' function (810), the 'Bluetooth' function is automatically executed (820), while the 'album viewing' function is being executed. When the mobile terminal is tilted in the right direction, the 'calculator' function may be automatically executed (830).

Meanwhile, the menu or function being executed may include a 'game' function and may also be used to control the movement of a specific character or item in the 'game'.

In the above, preferred embodiments of the present invention have been described with reference to the accompanying drawings.

Here, the terms or words used in the present specification and claims should not be construed as being limited to the common or dictionary meanings, but should be interpreted as meanings and concepts corresponding to the technical spirit of the present invention.

Therefore, the embodiments described in the specification and the drawings shown in the drawings are only the most preferred embodiment of the present invention, and do not represent all of the technical idea of the present invention, which can be replaced at the time of the present application It should be understood that there may be various equivalents and variations.

1 is a block diagram of a mobile terminal associated with one embodiment of the present invention;

Figure 2 is a front perspective view of an example of a mobile terminal according to the present invention.

3 is a rear perspective view of the mobile terminal of FIG. 2;

4 is an exemplary diagram of a communication system operable by a terminal according to the present invention;

5 is a flowchart illustrating a method of controlling a user interface menu in a mobile terminal according to the present invention.

6A is an exemplary diagram for describing a method of detecting a direction when the mobile terminal according to the present invention is tilted or moved about a first axis;

6B is an exemplary view for explaining a method of detecting a direction when the mobile terminal according to the present invention is tilted or moved about a second axis.

6C is an exemplary view for explaining a method of detecting a direction when the mobile terminal according to the present invention is tilted or rotated about a third axis;

6D is an exemplary view for explaining a method of detecting a direction when the mobile terminal according to the present invention is tilted or rotated about a fourth axis;

7 is a first exemplary diagram for describing an operation according to a movement of a mobile terminal according to the present invention.

8 is a second exemplary view for explaining the operation according to the movement of the mobile terminal according to the present invention;

9 is a third exemplary view for explaining the operation according to the movement of the mobile terminal according to the present invention.

10 is a fourth exemplary diagram for describing an operation according to a movement of a mobile terminal according to the present invention.

Claims (10)

A camera which receives an image and outputs it to a memory; A memory configured to store an image input through the camera at specific time intervals; And a controller configured to analyze the stored image to calculate a tilting, rotating, or moving direction of the mobile terminal, and to automatically execute a predetermined function or a user interface menu according to the calculated direction. Mobile terminal. The method of claim 1, wherein the control unit, And detecting a change in the position of the subject in the image stored in the memory at specific time intervals, and calculating a direction in which the mobile terminal is inclined, rotated, or moved by using the changed position information. The method of claim 2, wherein the control unit, According to the distance, path or direction in which the position of the subject is changed, And at least one of a direction, an angle, and a speed at which the mobile terminal is tilted, rotated, or moved. The method of claim 1, wherein the control unit, As the movement of the mobile terminal gets faster or slower Mobile terminal, characterized in that for changing the specific time short or long. The method of claim 2, wherein the control unit, If the position of the subject moves And determining that the terminal is moved in the opposite direction of the movement. The method of claim 2, wherein the control unit, If the position of the subject is rotated, And a direction in which the terminal is inclined or rotated according to the rotating direction thereof. The method of claim 1, wherein the control unit, According to the calculated tilt or rotation or movement direction, A mobile terminal, characterized in that for controlling the movement of a specific character or item within a function currently being executed. Storing an image input through the camera at specific time intervals; Calculating a movement of the terminal by analyzing the stored image; And automatically executing a predetermined specific function or menu according to the calculated movement of the terminal. The method of claim 8, wherein the motion calculating step, By the distance, path or direction in which the position of the subject is changed in the image, A method of controlling a user interface menu of a mobile terminal, characterized in that the terminal calculates at least one of tilting, rotating, and moving directions, an angle, and a speed. The method of claim 9, wherein the motion calculating step, If the position of the subject rotates or moves, And determining a direction in which the terminal is inclined, rotated, or moved according to the rotating or moving direction thereof.

Images